The neural circuitry involved in the reading of German words and pseudowords: A PET study

The role of valence and arousal for phonological iconicity in the lexicon of German: a cross-validation study using pseudoword ratings

The notion of sound symbolism receives increasing interest in psycholinguistics. Recent research - including empirical effects of affective phonological iconicity on language processing (Adelman et al., 2018; Conrad et al., 2022) - suggested language codes affective meaning at a basic phonological level using specific phonemes as sublexical markers of emotion. Here, in a series of 8 rating-experiments, we investigate the sensitivity of language users to assumed affectively-iconic systematic distribution patterns of phonemes across the German vocabulary:After computing sublexical-affective-values (SAV) concerning valence and arousal for the entire German phoneme inventory according to occurrences of syllabic onsets, nuclei and codas in a large-scale affective normative lexical database, we constructed pseudoword material differing in SAV to test for subjective affective impressions.Results support affective iconicity as affective ratings mirrored sound-to-meaning correspondences in the lexical database. Varying SAV of otherwise semantically meaningless pseudowords altered affective impressions: Higher arousal was consistently assigned to pseudowords made of syllabic constituents more often used in high-arousal words - contrasted by less straightforward effects of valence SAV. Further disentangling specific differential effects of the two highly-related affective dimensions valence and arousal, our data clearly suggest arousal, rather than valence, as the relevant dimension driving affective iconicity effects.

Reading Braille by Touch Recruits Posterior Parietal Cortex

Blind readers use a tactile reading system consisting of raised dot arrays: braille/⠃⠗⠇. How do human brains implement reading by touch? The current study looked for signatures of reading-specific orthographic processes in braille, separate from low-level somatosensory responses and semantic processes. Of specific interest were responses in posterior parietal cortices (PPCs), because of their role in high-level tactile perception. Congenitally blind, proficient braille readers read real words and pseudowords by touch while undergoing fMRI. We leveraged the system of contractions in English braille, where one braille cell can represent multiple English print letters (e.g., "ing" ⠬, "one" ⠐⠕), making it possible to separate physical and orthographic word length. All words in the study consisted of four braille cells, but their corresponding Roman letter spellings varied from four to seven letters (e.g., "con-c-er-t" ⠒⠉⠻⠞. contracted: four cells; uncontracted: seven letters). We found that the bilateral supramarginal gyrus in the PPC increased its activity as the uncontracted word length increased. By contrast, in the hand region of primary somatosensory cortex (S1), activity increased as a function of a low-level somatosensory feature: dot-number per word. The PPC also showed greater response to pseudowords than real words and distinguished between real and pseudowords in multivariate-pattern analysis. Parieto-occipital, early visual and ventral occipito-temporal, as well as prefrontal cortices also showed sensitivity to the real-versus-pseudoword distinction. We conclude that PPC is involved in orthographic processing for braille, that is, braille character and word recognition, possibly because of braille's tactile modality.

Dynamics of working memory process revealed by independent component analysis in an fMRI study

Human memory is prone to errors in many everyday activities but also when cultivating hobbies such as traveling and/or learning a new language. For instance, while visiting foreign countries, people erroneously recall foreign language words that are meaningless to them. Our research simulated such errors in a modified Deese-Roediger-McDermott paradigm for short-term memory with phonologically related stimuli aimed at uncovering behavioral and neuronal indices of false memory formation with regard to time-of-day, a variable known to influence memory. Fifty-eight participants were tested in a magnetic resonance (MR) scanner twice. The results of an Independent Component Analysis revealed encoding-related activity of the medial visual network preceding correct recognition of positive probes and correct rejection of lure probes. The engagement of this network preceding false alarms was not observed. We also explored if diurnal rhythmicity influences working memory processes. Diurnal differences were seen in the default mode network and the medial visual network with lower deactivation in the evening hours. The GLM results showed greater activation of the right lingual gyrus, part of the visual cortex and the left cerebellum in the evening. The study offers new insight into the mechanisms associated with false memories, suggesting that deficient engagement of the medial visual network during the memorization phase of a task results in short-term memory distortions. The results shed new light on the dynamics of working memory processes by taking into account the effect of time-of-day on memory performance.

Syntactic and Semantic Processing in Japanese Sentence Reading: A Research Using Functional Near-Infrared Spectroscopy (fNIRS)

In order to examine whether syntactic processing is a necessary prerequisite for semantic integration in Japanese, cortical activation was monitored while participants engaged in silent reading task. Congruous sentences (CON), semantic violation sentences (V-SEM), and syntactic violation sentences (V-SYN) were presented in the experiment. The participants' oxygenated hemoglobin concentration changes during the reading task were measured using functional near-infrared spectroscopy. The results suggest that the CON sentences did not require additional cognitive load on syntactic processing or semantic processing. The V-SEM sentences demanded great cognitive load on semantic processing. Besides, it also elicited great cognitive load on syntactic processing. The V-SYN sentences induced great cognitive load on syntactic processing, but it did not induce additional load on semantic processing. These evidence demonstrates that, in Japanese language processing, the difficultness of semantic processing could influence the difficultness of syntactic processing, while the difficultness of syntactic processing would not influence the difficultness of semantic processing. Our findings are suggestive of the possibility that in Japanese language reading, semantic processing precedes syntactic processing, or semantic processing and syntactic processing are in parallel.

Phonetic Effects in the Perception of VOT in a Prevoicing Language

Previous production studies have reported differential amounts of closure voicing in plosives depending on the location of the oral constriction (anterior vs. posterior), vocalic context (high vs. low vowels), and speaker sex. Such differences have been attributed to the aerodynamic factors related to the configuration of the cavity behind the oral constriction, with certain articulations and physiological characteristics of the speaker facilitating vocal fold vibration during closure. The current study used perceptual identification tasks to examine whether similar effects of consonantal posteriority, adjacent vowel height, and speaker sex exist in the perception of voicing. The language of investigation was Russian, a prevoicing language that uses negative VOT to signal the voicing contrast in plosives. The study used both original and resynthesized tokens for speaker sex, which allowed it to focus on the role of differences in VOT specifically. Results indicated that listeners’ judgments were significantly affected by consonantal place of articulation, with listeners accepting less voicing in velar plosives. Speaker sex showed only a marginally significant difference in the expected direction, and vowel height had no effect on perceptual responses. These findings suggest that certain phonetic factors can affect both the initial production and subsequent perception of closure voicing.

Visual event-related potentials reveal the early lexical processing of Chinese characters

Logographic scripts such as Chinese differ markedly from alphabetic scripts. The time-course of the lexical processing of alphabetic words was widely studied by recording event-related potentials (ERPs), and the results indicated that alphabetic words are rapidly and automatically processed. This study investigated whether there is also rapid and automatic lexical processing of Chinese characters by recording ERPs. High-frequency (HF) characters and orthographically similar low-frequency (LF) characters were pseudo-randomly presented to proficient Chinese readers. The color of half of the characters was blue and the color of the other half was black. In the color decision task, participants were asked to determine the color of each character. In the lexical recognition task, participants were asked to report whether s/he knew each character (the LF characters in this study were very rare characters which were usually not recognized by proficient Chinese readers). In both tasks, the N170 elicited by HF characters peaked earlier than the N170 elicited by LF characters in the right parieto-occipital area (PO8), and the ERPs to HF characters diverged from the ERPs to LF characters around 210-222 ms after the stimulus onset. These results reflected the rapid and automatic lexical processing of Chinese characters. Source analysis results suggested that the left and the right occipitotemporal cortices and the right visual cortex were the neural origins of the early lexical processing of Chinese characters, and the peak activation was in the right visual cortex.

Simultaneously recorded subthalamic and cortical LFPs reveal different lexicality effects during reading aloud

Many language functions are traditionally assigned to cortical brain areas, leaving the contributions of subcortical structures to language processing largely unspecified. The present study examines a potential role of the subthalamic nucleus (STN) in lexical processing, specifically, reading aloud of words (e.g., 'fate') and pseudowords (e.g., 'fape'). We recorded local field potentials simultaneously from the STN and the cortex (precentral, postcentral, and superior temporal gyri) of 13 people with Parkinson's disease undergoing awake deep brain stimulation and compared STN's lexicality-related neural activity with that of the cortex. Both STN and cortical activity demonstrated significant task-related modulations, but the lexicality effects were different in the two brain structures. In the STN, an increase in gamma band activity (31-70 Hz) was present in pseudoword trials compared to word trials during subjects' spoken response. In the cortex, a greater decrease in beta band activity (12-30 Hz) was observed for pseudowords in the precentral gyrus. Additionally, 11 individual cortical sites showed lexicality effects with varying temporal and topographic characteristics in the alpha and beta frequency bands. These findings suggest that the STN and the sampled cortical regions are involved differently in the processing of lexical distinctions.

Rapid acquisition of novel written word-forms: ERP evidence

Background

Novel word acquisition is generally believed to be a rapid process, essential for ensuring a flexible and efficient communication system; at least in spoken language, learners are able to construct memory traces for new linguistic stimuli after just a few exposures. However, such rapid word learning has not been systematically found in visual domain, with different confounding factors obscuring the orthographic learning of novel words. This study explored the changes in human brain activity occurring online, during a brief training with novel written word-forms using a silent reading task

Results

Single-trial, cluster-based random permutation analysis revealed that training caused an extremely fast (after just one repetition) and stable facilitation in novel word processing, reflected in the modulation of P200 and N400 components, possibly indicating rapid dynamics at early and late stages of the lexical processing. Furthermore, neural source estimation of these effects revealed the recruitment of brain areas involved in orthographic and lexico-semantic processing, respectively.

Conclusions

These results suggest the formation of neural memory traces for novel written word-forms after a minimal exposure to them even in the absence of a semantic reference, resembling the rapid learning processes known to occur in spoken language.

Enhanced left inferior frontal to left superior temporal effective connectivity for complex sentence comprehension: fMRI evidence from Chinese relative clause processing

Previous studies investigating the processing of complex sentences have demonstrated the involvement of the left inferior frontal gyrus (LIFG) and left superior temporal gyrus (LSTG), which might subserve ordering and storage of linguistic components, respectively, for sentence comprehension. However, how these brain regions are interconnected, especially during the processing of Chinese sentences, need to be further explored. In this study, the neural network supporting the comprehension of Chinese relative clause was identified. Both the LIFG and LSTG exhibited higher activation in processing subject-extracted relative clauses (SRCs) than object-extracted relative clauses (ORCs). Moreover, a Granger causality analysis revealed that the effective connectivity from the LIFG to LSTG was significant only when participants read Chinese SRCs, which were argued to be more difficult than ORCs. Contrary to the observations of an SRC advantage in most other languages, the present results provide clear neuroimaging evidence for an ORC advantage in Chinese.

NDRA: A single route model of response times in the reading aloud task based on discriminative learning

We present the Naive Discriminative Reading Aloud (ndra) model. The ndra differs from existing models of response times in the reading aloud task in two ways. First, a single lexical architecture is responsible for both word and non-word naming. As such, the model differs from dual-route models, which consist of both a lexical route and a sub-lexical route that directly maps orthographic units onto phonological units. Second, the linguistic core of the ndra exclusively operates on the basis of the equilibrium equations for the well-established general human learning algorithm provided by the Rescorla-Wagner model. The model therefore does not posit language-specific processing mechanisms and avoids the problems of psychological and neurobiological implausibility associated with alternative computational implementations. We demonstrate that the single-route discriminative learning architecture of the ndra captures a wide range of effects documented in the experimental reading aloud literature and that the overall fit of the model is at least as good as that of state-of-the-art dual-route models.

Neural correlates of phonological, orthographic and semantic reading processing in dyslexia

Developmental dyslexia is one of the most prevalent learning disabilities, thought to be associated with dysfunction in the neural systems underlying typical reading acquisition. Neuroimaging research has shown that readers with dyslexia exhibit regional hypoactivation in left hemisphere reading nodes, relative to control counterparts. This evidence, however, comes from studies that have focused only on isolated aspects of reading. The present study aims to characterize left hemisphere regional hypoactivation in readers with dyslexia for the main processes involved in successful reading: phonological, orthographic and semantic. Forty-one participants performed a demanding reading task during MRI scanning. Results showed that readers with dyslexia exhibited hypoactivation associated with phonological processing in parietal regions; with orthographic processing in parietal regions, Broca's area, ventral occipitotemporal cortex and thalamus; and with semantic processing in angular gyrus and hippocampus. Stronger functional connectivity was observed for readers with dyslexia than for control readers 1) between the thalamus and the inferior parietal cortex/ventral occipitotemporal cortex during pseudoword reading; and, 2) between the hippocampus and the pars opercularis during word reading. These findings constitute the strongest evidence to date for the interplay between regional hypoactivation and functional connectivity in the main processes supporting reading in dyslexia.

Orthographic and phonological selectivity across the reading system in deaf skilled readers

People who are born deaf often have difficulty learning to read. Recently, several studies have examined the neural substrates involved in reading in deaf people and found a left lateralized reading system similar to hearing people involving temporo-parietal, inferior frontal, and ventral occipito-temporal cortices. Previous studies in typical hearing readers show that within this reading network there are separate regions that specialize in processing orthography and phonology. We used fMRI rapid adaptation in deaf adults who were skilled readers to examine neural selectivity in three functional ROIs in the left hemisphere: temporoparietal cortex (TPC), inferior frontal gyrus (IFG), and the visual word form area (VWFA). Results show that in deaf skilled readers, the left VWFA showed selectivity for orthography similar to what has been reported for hearing readers, the TPC showed less sensitivity to phonology than previously reported for hearing readers using the same paradigm, and the IFG showed selectivity to orthography, but not phonology (similar to what has been reported previously for hearing readers). These results provide evidence that while skilled deaf readers demonstrate coarsely tuned phonological representations in the TPC, they develop finely tuned representations for the orthography of written words in the VWFA and IFG. This result suggests that phonological tuning in the TPC may have little impact on the neural network associated with skilled reading for deaf adults.

Functional Dynamics of Dorsal and Ventral Reading Networks in Bilinguals

In today's world, bilingualism is increasingly common. However, it is still unclear how left-lateralized dorsal and ventral reading networks are tuned to reading in proficient second-language learners. Here, we investigated differences in functional regional activation and connectivity as a function of L1 and L2 reading, L2 orthographic depth, and task demands. Thirty-seven late bilinguals with the same L1 and either an opaque or transparent L2 performed perceptual and semantic reading tasks in L1 and L2 during functional magnetic resonance imaging (fMRI) scanning. Results revealed stronger regional recruitment for L2 versus L1 reading and stronger connectivity within the dorsal stream during L1 versus L2 reading. Differences in orthographic depth were associated with a segregated profile of left ventral occipitotemporal (vOT) coactivation with dorsal regions for the transparent L2 group and with ventral regions for the opaque L2 group. Finally, semantic versus perceptual demands modulated left vOT engagement, supporting the interactive account of the contribution of vOT to reading, and were associated with stronger coactivation within the ventral network. Our findings support a division of labor between ventral and dorsal reading networks, elucidating the critical role of the language used to read, L2 orthographic depth, and task demands on the functional dynamics of bilingual reading.

Source Reconstruction of Brain Potentials Using Bayesian Model Averaging to Analyze Face Intra-Domain vs. Face-Occupation Cross-Domain Processing

We investigated the neural correlates of the access to and retrieval of face structure information in contrast to those concerning the access to and retrieval of person-related verbal information, triggered by faces. We experimentally induced stimulus familiarity via a systematic learning procedure including faces with and without associated verbal information. Then, we recorded event-related potentials (ERPs) in both intra-domain (face-feature) and cross-domain (face-occupation) matching tasks while N400-like responses were elicited by incorrect eyes-eyebrows completions and occupations, respectively. A novel Bayesian source reconstruction approach plus conjunction analysis of group effects revealed that in both cases the generated N170s were of similar amplitude but had different neural origin. Thus, whereas the N170 of faces was associated predominantly to right fusiform and occipital regions (the so-called “Fusiform Face Area”, “FFA” and “Occipital Face Area”, “OFA”, respectively), the N170 of occupations was associated to a bilateral very posterior activity, suggestive of basic perceptual processes. Importantly, the right-sided perceptual P200 and the face-related N250 were evoked exclusively in the intra-domain task, with sources in OFA and extensively in the fusiform region, respectively. Regarding later latencies, the intra-domain N400 seemed to be generated in right posterior brain regions encompassing mainly OFA and, to some extent, the FFA, likely reflecting neural operations triggered by structural incongruities. In turn, the cross-domain N400 was related to more anterior left-sided fusiform and temporal inferior sources, paralleling those described previously for the classic verbal N400. These results support the existence of differentiated neural streams for face structure and person-related verbal processing triggered by faces, which can be activated differentially according to specific task demands.

Event-related desynchronization of mu and beta oscillations during the processing of novel tool names

According to the embodied cognition framework, the formation of conceptual representations integrates the type of experience during learning. In this electroencephalographic study, we applied a linguistic variant of a training paradigm, in which participants learned to associate novel names to novel tools while either manipulating or visually exploring them. The analysis focused on event-related desynchronization (ERD) of oscillations in the mu and beta frequency range, which reflects activation of sensorimotor brain areas. After three training sessions, processing names of manipulated tools elicited a stronger ERD of the beta (18-25 Hz, 140-260 ms) and the lower mu rhythm (8-10 Hz, 320-440 ms) than processing names of visually explored tools, reflecting a possible reactivation of experiential sensorimotor information. Given the unexpected result that familiarized pseudo-words elicited an ERD comparable to names of manipulated tools, our findings could reflect a suppression of sensorimotor activity during the processing of objects with exclusively visual features.

Learning and retrieving holistic and componential visual-verbal associations in reading and object naming

Understanding the neural processes that underlie learning to read can provide a scientific foundation for literacy education but studying these processes in real-world contexts remains challenging. We present behavioural data from adult participants learning to read artificial words and name artificial objects over two days. Learning profiles and generalisation confirmed that componential learning of visual-verbal associations distinguishes reading from object naming. Functional MRI data collected on the second day allowed us to identify the neural systems that support componential reading as distinct from systems supporting holistic visual-verbal associations in object naming. Results showed increased activation in posterior ventral occipitotemporal (vOT), parietal, and frontal cortices when reading an artificial orthography compared to naming artificial objects, and the reverse profile in anterior vOT regions. However, activation differences between trained and untrained words were absent, suggesting a lack of cortical representations for whole words. Despite this, hippocampal responses provided some evidence for overnight consolidation of both words and objects learned on day 1. The comparison between neural activity for artificial words and objects showed extensive overlap with systems differentially engaged for real object naming and English word/pseudoword reading in the same participants. These findings therefore provide evidence that artificial learning paradigms offer an alternative method for studying the neural systems supporting language and literacy. Implications for literacy acquisition are discussed.

•

Generalisation of novel orthography shows componential processing in reading.

•

Real and artificial words and objects rely upon the same neural systems.

•

Different neural systems support reading novel orthography and naming novel objects.

•

No evidence of whole-word cortical representations for artificial written words.

•

Reduced hippocampal responses suggest overnight consolidation of artificial items.

Reduced Left Lateralization of Language in Congenitally Blind Individuals

Language processing depends on a left-lateralized network of frontotemporal cortical regions. This network is remarkably consistent across individuals and cultures. However, there is also evidence that developmental factors, such as delayed exposure to language, can modify this network. Recently, it has been found that, in congenitally blind individuals, the typical frontotemporal language network expands to include parts of "visual" cortices. Here, we report that blindness is also associated with reduced left lateralization in frontotemporal language areas. We analyzed fMRI data from two samples of congenitally blind adults (n = 19 and n = 13) and one sample of congenitally blind children (n = 20). Laterality indices were computed for sentence comprehension relative to three different control conditions: solving math equations (Experiment 1), a memory task with nonwords (Experiment 2), and a "does this come next?" task with music (Experiment 3). Across experiments and participant samples, the frontotemporal language network was less left-lateralized in congenitally blind than in sighted individuals. Reduction in left lateralization was not related to Braille reading ability or amount of occipital plasticity. Notably, we observed a positive correlation between the lateralization of frontotemporal cortex and that of language-responsive occipital areas in blind individuals. Blind individuals with right-lateralized language responses in frontotemporal cortices also had right-lateralized occipital responses to language. Together, these results reveal a modified neurobiology of language in blindness. Our findings suggest that, despite its usual consistency across people, the neurobiology of language can be modified by nonlinguistic experiences.

The effect of aging on the brain network for exception word reading

Cognitive and computational models of reading aloud agree on the existence of two procedures for reading. Pseudowords (e.g., atendier) are correctly read through subword processes only while exception words (e.g., pint) are only correctly read via whole-words processes. Regular words can be correctly read by means of either way. Previous behavioral studies showed that older adults relied more on whole-word processing for reading. The aim of the present fMRI study was to verify whether this larger whole-word reliance for reading in older adults was reflected by changes in the pattern of brain activation. Both young and elderly participants read aloud pseudowords, exception and regular words in the scanner. Behavioral results reproduced those of previous studies showing that older adults made significantly less errors when reading exception words. Neuroimaging results showed significant activation of the left anterior temporal lobe (ATL), a key region implicated in whole-word reading for exception word reading in both young and elderly participants. Critically, ATL activation was also found for regular word reading in the elderly. No differences were observed in the pattern of activation between regular and pseudowords in the young. In conclusion, these results extend evidence on the critical role of the left ATL for exception word reading to elderly participants. Additionally, our study shows for the first time from a developmental point of view that the behavioral changes found in reading during normal aging also have a brain counterpart in the reading network changes that sustain exception and regular word reading in the elderly.

Phonological Iconicity Electrifies: An ERP Study on Affective Sound-to-Meaning Correspondences in German

While linguistic theory posits an arbitrary relation between signifiers and the signified (de Saussure, 1916), our analysis of a large-scale German database containing affective ratings of words revealed that certain phoneme clusters occur more often in words denoting concepts with negative and arousing meaning. Here, we investigate how such phoneme clusters that potentially serve as sublexical markers of affect can influence language processing. We registered the EEG signal during a lexical decision task with a novel manipulation of the words' putative sublexical affective potential: the means of valence and arousal values for single phoneme clusters, each computed as a function of respective values of words from the database these phoneme clusters occur in. Our experimental manipulations also investigate potential contributions of formal salience to the sublexical affective potential: Typically, negative high-arousing phonological segments-based on our calculations-tend to be less frequent and more structurally complex than neutral ones. We thus constructed two experimental sets, one involving this natural confound, while controlling for it in the other. A negative high-arousing sublexical affective potential in the strictly controlled stimulus set yielded an early posterior negativity (EPN), in similar ways as an independent manipulation of lexical affective content did. When other potentially salient formal features at the sublexical level were not controlled for, the effect of the sublexical affective potential was strengthened and prolonged (250-650 ms), presumably because formal salience helps making specific phoneme clusters efficient sublexical markers of negative high-arousing affective meaning. These neurophysiological data support the assumption that the organization of a language's vocabulary involves systematic sound-to-meaning correspondences at the phonemic level that influence the way we process language.

Uncovering phonological and orthographic selectivity across the reading network using fMRI-RA

Reading has been shown to rely on a dorsal brain circuit involving the temporoparietal cortex (TPC) for grapheme-to-phoneme conversion of novel words (Pugh et al., 2001), and a ventral stream involving left occipitotemporal cortex (OTC) (in particular in the so-called "visual word form area", VWFA) for visual identification of familiar words. In addition, portions of the inferior frontal cortex (IFC) have been posited to be an output of the dorsal reading pathway involved in phonology. While this dorsal versus ventral dichotomy for phonological and orthographic processing of words is widely accepted, it is not known if these brain areas are actually strictly sensitive to orthographic or phonological information. Using an fMRI rapid adaptation technique we probed the selectivity of the TPC, OTC, and IFC to orthographic and phonological features during single word reading. We found in two independent experiments using different task conditions in adult normal readers, that the TPC is exclusively sensitive to phonology and the VWFA in the OTC is exclusively sensitive to orthography. The dorsal IFC (BA 44), however, showed orthographic but not phonological selectivity. These results support the theory that reading involves a specific phonological-based temporoparietal region and a specific orthographic-based ventral occipitotemporal region. The dorsal IFC, however, was not sensitive to phonological processing, suggesting a more complex role for this region.

A brain-region-based meta-analysis method utilizing the Apriori algorithm

Background

Brain network connectivity modeling is a crucial method for studying the brain’s cognitive functions. Meta-analyses can unearth reliable results from individual studies. Meta-analytic connectivity modeling is a connectivity analysis method based on regions of interest (ROIs) which showed that meta-analyses could be used to discover brain network connectivity.

Results

In this paper, we propose a new meta-analysis method that can be used to find network connectivity models based on the Apriori algorithm, which has the potential to derive brain network connectivity models from activation information in the literature, without requiring ROIs. This method first extracts activation information from experimental studies that use cognitive tasks of the same category, and then maps the activation information to corresponding brain areas by using the automatic anatomical label atlas, after which the activation rate of these brain areas is calculated. Finally, using these brain areas, a potential brain network connectivity model is calculated based on the Apriori algorithm. The present study used this method to conduct a mining analysis on the citations in a language review article by Price (Neuroimage 62(2):816–847, 2012). The results showed that the obtained network connectivity model was consistent with that reported by Price.

Conclusions

The proposed method is helpful to find brain network connectivity by mining the co-activation relationships among brain regions. Furthermore, results of the co-activation relationship analysis can be used as a priori knowledge for the corresponding dynamic causal modeling analysis, possibly achieving a significant dimension-reducing effect, thus increasing the efficiency of the dynamic causal modeling analysis.

Identification of the regions involved in phonological assembly using a novel paradigm

Here we adopt a novel strategy to investigate phonological assembly. Participants performed a visual lexical decision task in English in which the letters in words and letterstrings were delivered either sequentially (promoting phonological assembly) or simultaneously (not promoting phonological assembly). A region of interest analysis confirmed that regions previously associated with phonological assembly, in studies contrasting different word types (e.g. words versus pseudowords), were also identified using our novel task that controls for a number of confounding variables. Specifically, the left pars opercularis, the superior part of the ventral precentral gyrus and the supramarginal gyrus were all recruited more during sequential delivery than simultaneous delivery, even when various psycholinguistic characteristics of the stimuli were controlled. This suggests that sequential delivery of orthographic stimuli is a useful tool to explore how readers, with various levels of proficiency, use sublexical phonological processing during visual word recognition.

Framing effects reveal discrete lexical-semantic and sublexical procedures in reading: an fMRI study

According to the dual-route model, a printed string of letters can be processed by either a grapheme-to-phoneme conversion (GPC) route or a lexical-semantic route. Although meta-analyses of the imaging literature support the existence of distinct but interacting reading procedures, individual neuroimaging studies that explored neural correlates of reading yielded inconclusive results. We used a list-manipulation paradigm to provide a fresh empirical look at this issue and to isolate specific areas that underlie the two reading procedures. In a lexical condition, we embedded disyllabic Italian words (target stimuli) in lists of either loanwords or trisyllabic Italian words with unpredictable stress position. In a GPC condition, similar target stimuli were included within lists of pseudowords. The procedure was designed to induce participants to emphasize either the lexical-semantic or the GPC reading procedure, while controlling for possible linguistic confounds and keeping the reading task requirements stable across the two conditions. Thirty-three adults participated in the behavioral study, and 20 further adult participants were included in the fMRI study. At the behavioral level, we found sizeable effects of the framing manipulations that included slower voice onset times for stimuli in the pseudoword frames. At the functional anatomical level, the occipital and temporal regions, and the intraparietal sulcus were specifically activated when subjects were reading target words in a lexical frame. The inferior parietal and anterior fusiform cortex were specifically activated in the GPC condition. These patterns of activation represented a valid classifying model of fMRI images associated with target reading in both frames in the multi-voxel pattern analyses. Further activations were shared by the two procedures in the occipital and inferior parietal areas, in the premotor cortex, in the frontal regions and the left supplementary motor area. These regions are most likely involved in either early input or late output processes.

Many neighbors are not silent. fMRI evidence for global lexical activity in visual word recognition

Many neurocognitive studies investigated the neural correlates of visual word recognition, some of which manipulated the orthographic neighborhood density of words and nonwords believed to influence the activation of orthographically similar representations in a hypothetical mental lexicon. Previous neuroimaging research failed to find evidence for such global lexical activity associated with neighborhood density. Rather, effects were interpreted to reflect semantic or domain general processing. The present fMRI study revealed effects of lexicality, orthographic neighborhood density and a lexicality by orthographic neighborhood density interaction in a silent reading task. For the first time we found greater activity for words and nonwords with a high number of neighbors. We propose that this activity in the dorsomedial prefrontal cortex reflects activation of orthographically similar codes in verbal working memory thus providing evidence for global lexical activity as the basis of the neighborhood density effect. The interaction of lexicality by neighborhood density in the ventromedial prefrontal cortex showed lower activity in response to words with a high number compared to nonwords with a high number of neighbors. In the light of these results the facilitatory effect for words and inhibitory effect for nonwords with many neighbors observed in previous studies can be understood as being due to the operation of a fast-guess mechanism for words and a temporal deadline mechanism for nonwords as predicted by models of visual word recognition. Furthermore, we propose that the lexicality effect with higher activity for words compared to nonwords in inferior parietal and middle temporal cortex reflects the operation of an identification mechanism based on local lexico-semantic activity.

Native language experience shapes neural basis of addressed and assembled phonologies

Previous studies have suggested differential engagement of addressed and assembled phonologies in reading Chinese and alphabetic languages (e.g., English) and the modulatory role of native language in learning to read a second language. However, it is not clear whether native language experience shapes the neural mechanisms of addressed and assembled phonologies. To address this question, we trained native Chinese and native English speakers to read the same artificial language (based on Korean Hangul) either through addressed (i.e., whole-word mapping) or assembled (i.e., grapheme-to-phoneme mapping) phonology. We found that, for both native Chinese and native English speakers, addressed phonology relied on the regions in the ventral pathway, whereas assembled phonology depended on the regions in the dorsal pathway. More importantly, we found that the neural mechanisms of addressed and assembled phonologies were shaped by native language experience. Specifically, one key region for addressed phonology (i.e., the left middle temporal gyrus) showed greater activation for addressed phonology in native Chinese speakers, while one key region for assembled phonology (i.e., the left supramarginal gyrus) showed more activation for assembled phonology in native English speakers. These results provide direct neuroimaging evidence for the effect of native language experience on the neural mechanisms of phonological access in a new language and support the assimilation-accommodation hypothesis.

How Early Does the Brain Distinguish between Regular Words, Irregular Words, and Pseudowords during the Reading Process? Evidence from Neurochronometric TMS

Cognitive theories on reading propose that the characteristics of written stimuli determine how they are processed in the brain. However, whether the brain distinguishes between regular words, irregular words, and pseudowords already at an early stage of the reading process is still subject to debate. Here we used chronometric TMS to address this issue. During the first 140 msec of regular word, irregular word, and pseudoword reading, TMS was used to disrupt the function of the ventral occipitotemporal, posterior middle temporal, and supramarginal gyri, which are key areas involved in orthographic, semantic, and phonological processing, respectively. Early TMS stimulation delivered on posterior middle temporal and supramarginal gyri affected regular and irregular word, but not pseudoword, reading. In contrast, ventral occipitotemporal disruption affected both word and pseudoword reading. We thus found evidence for an early distinction between word and pseudoword processing in the semantic and phonological systems, but not in the orthographic system.

The neural substrates of natural reading: a comparison of normal and nonword text using eyetracking and fMRI

Most previous studies investigating the neural correlates of reading have presented text using serial visual presentation (SVP), which may not fully reflect the underlying processes of natural reading. In the present study, eye movements and BOLD data were collected while subjects either read normal paragraphs naturally or moved their eyes through "paragraphs" of pseudo-text (pronounceable pseudowords or consonant letter strings) in two pseudo-reading conditions. Eye movement data established that subjects were reading and scanning the stimuli normally. A conjunction fMRI analysis across natural- and pseudo-reading showed that a common eye-movement network including frontal eye fields (FEF), supplementary eye fields (SEF), and intraparietal sulci was activated, consistent with previous studies using simpler eye movement tasks. In addition, natural reading versus pseudo-reading showed different patterns of brain activation: normal reading produced activation in a well-established language network that included superior temporal gyrus/sulcus, middle temporal gyrus (MTG), angular gyrus (AG), inferior frontal gyrus, and middle frontal gyrus, whereas pseudo-reading produced activation in an attentional network that included anterior/posterior cingulate and parietal cortex. These results are consistent with results found in previous single-saccade eye movement tasks and SVP reading studies, suggesting that component processes of eye-movement control and language processing observed in past fMRI research generalize to natural reading. The results also suggest that combining eyetracking and fMRI is a suitable method for investigating the component processes of natural reading in fMRI research.

Does pronounceability modulate the letter string deficit of children with dyslexia? A study with the rate and amount model

The locus of the deficit of children with dyslexia in dealing with strings of letters may be a deficit at a pre-lexical graphemic level or an inability to bind orthographic and phonological information. We evaluate these alternative hypotheses in two experiments by examining the role of stimulus pronounceability in a lexical decision task (LDT) and in a forced-choice letter discrimination task (Reicher-Wheeler paradigm). Seventeen fourth grade children with dyslexia and 24 peer control readers participated to two experiments. In the LDT children were presented with high-, low-frequency words, pronounceable pseudowords (such as DASU) and unpronounceable non-words (such as RNGM) of 4-, 5-, or 6- letters. No sign of group by pronounceability interaction was found when over-additivity was taken into account. Children with dyslexia were impaired when they had to process strings, not only of pronounceable stimuli but also of unpronounceable stimuli, a deficit well accounted for by a single global factor. Complementary results were obtained with the Reicher-Wheeler paradigm: both groups of children gained in accuracy in letter discrimination in the context of pronounceable primes (words and pseudowords) compared to unpronounceable primes (non-words). No global factor was detected in this task which requires the discrimination between a target letter and a competitor but does not involve simultaneous letter string processing. Overall, children with dyslexia show a selective difficulty in simultaneously processing a letter string as a whole, independent of its pronounceability; however, when the task involves isolated letter processing, also these children can make use of the ortho-phono-tactic information derived from a previously seen letter string. This pattern of findings is in keeping with the idea that an impairment in pre-lexical graphemic analysis may be a core deficit in developmental dyslexia.

Task dependent lexicality effects support interactive models of reading: a meta-analytic neuroimaging review

Models of reading must explain how orthographic input activates a phonological representation, and elicits the retrieval of word meaning from semantic memory. Comparisons between tasks that theoretically differ with respect to the degree to which they rely on connections between orthographic, phonological and semantic systems during reading can thus provide valuable insight into models of reading, but such direct comparisons are not well-represented in the literature. An ALE meta-analysis explored lexicality effects directly contrasting words and pseudowords using the lexical decision task and overt or covert naming, which we assume rely most on the semantic and phonological systems, respectively. Interactions between task and lexicality effects demonstrate that different demands of the lexical decision and naming tasks lead to different manifestations of lexicality effects.

The level of audiovisual print-speech integration deficits in dyslexia

The classical phonological deficit account of dyslexia is increasingly linked to impairments in grapho-phonological conversion, and to dysfunctions in superior temporal regions associated with audiovisual integration. The present study investigates mechanisms of audiovisual integration in typical and impaired readers at the critical developmental stage of adolescence. Congruent and incongruent audiovisual as well as unimodal (visual only and auditory only) material was presented. Audiovisual presentations were single letters and three-letter (consonant-vowel-consonant) stimuli accompanied by matching or mismatching speech sounds. Three-letter stimuli exhibited fast phonetic transitions as in real-life language processing and reading. Congruency effects, i.e. different brain responses to congruent and incongruent stimuli were taken as an indicator of audiovisual integration at a phonetic level (grapho-phonological conversion). Comparisons of unimodal and audiovisual stimuli revealed basic, more sensory aspects of audiovisual integration. By means of these two criteria of audiovisual integration, the generalizability of audiovisual deficits in dyslexia was tested. Moreover, it was expected that the more naturalistic three-letter stimuli are superior to single letters in revealing group differences. Electrophysiological and hemodynamic (EEG and fMRI) data were acquired simultaneously in a simple target detection task. Applying the same statistical models to event-related EEG potentials and fMRI responses allowed comparing the effects detected by the two techniques at a descriptive level. Group differences in congruency effects (congruent against incongruent) were observed in regions involved in grapho-phonological processing, including the left inferior frontal and angular gyri and the inferotemporal cortex. Importantly, such differences also emerged in superior temporal key regions. Three-letter stimuli revealed stronger group differences than single letters. No significant differences in basic measures of audiovisual integration emerged. Convergence of hemodynamic and electrophysiological signals appeared to be limited and mainly occurred for highly significant and large effects in visual cortices. The findings suggest efficient superior temporal tuning to audiovisual congruency in controls. In impaired readers, however, grapho-phonological conversion is effortful and inefficient, although basic audiovisual mechanisms seem intact. This unprecedented demonstration of audiovisual deficits in adolescent dyslexics provides critical evidence that the phonological deficit might be explained by impaired audiovisual integration at a phonetic level, especially for naturalistic and word-like stimulation.

[Do practices of learning activities improve the cognitive functioning of healthy elderly adults? From the viewpoint of a transfer effect]

The present study examined influences of reading aloud and performing simple calculation on the cognitive functioning of healthy elderly adults, based on the findings that these tasks activated the prefrontal lobe. The elderly adults' memory and inhibitory functions were assesed by Short-Term memory, CST, Stroop, and SRC tasks, before and after intervention for 18 months. The study found that the learning group had significant improvement from the pre- to the post-test for the short-term memory, STM, CST, and Stroop tasks. On the other hand, there was significant decline over the 18 months in the control group which was given only the assessment tasks. These results are discussed in terms of the effectiveness of cognitive training.

Dissecting the functional anatomy of auditory word repetition

This fMRI study used a single, multi-factorial, within-subjects design to dissociate multiple linguistic and non-linguistic processing areas that are all involved in repeating back heard words. The study compared: (1) auditory to visual inputs; (2) phonological to non-phonological inputs; (3) semantic to non-semantic inputs; and (4) speech production to finger-press responses. The stimuli included words (semantic and phonological inputs), pseudowords (phonological input), pictures and sounds of animals or objects (semantic input), and colored patterns and hums (non-semantic and non-phonological). The speech production tasks involved auditory repetition, reading, and naming while the finger press tasks involved one-back matching. The results from the main effects and interactions were compared to predictions from a previously reported functional anatomical model of language based on a meta-analysis of many different neuroimaging experiments. Although many findings from the current experiment replicated many of those predicted, our within-subject design also revealed novel results by providing sufficient anatomical precision to dissect several different regions within the anterior insula, pars orbitalis, anterior cingulate, SMA, and cerebellum. For example, we found one part of the pars orbitalis was involved in phonological processing and another in semantic processing. We also dissociated four different types of phonological effects in the left superior temporal sulcus (STS), left putamen, left ventral premotor cortex, and left pars orbitalis. Our findings challenge some of the commonly-held opinions on the functional anatomy of language, and resolve some previously conflicting findings about specific brain regions—and our experimental design reveals details of the word repetition process that are not well captured by current models.

Artificial language training reveals the neural substrates underlying addressed and assembled phonologies

Although behavioral and neuropsychological studies have suggested two distinct routes of phonological access, their neural substrates have not been clearly elucidated. Here, we designed an artificial language (based on Korean Hangul) that can be read either through addressed (i.e., whole word mapping) or assembled (i.e., grapheme-to-phoneme mapping) phonology. Two matched groups of native English-speaking participants were trained in one of the two conditions, one hour per day for eight days. Behavioral results showed that both groups correctly named more than 90% of the trained words after training. At the neural level, we found a clear dissociation of the neural pathways for addressed and assembled phonologies: There was greater involvement of the anterior cingulate cortex, posterior cingulate cortex, right orbital frontal cortex, angular gyrus and middle temporal gyrus for addressed phonology, but stronger activation in the left precentral gyrus/inferior frontal gyrus and supramarginal gyrus for assembled phonology. Furthermore, we found evidence supporting the strategy-shift hypothesis, which postulates that, with practice, reading strategy shifts from assembled to addressed phonology. Specifically, compared to untrained words, trained words in the assembled phonology group showed stronger activation in the addressed phonology network and less activation in the assembled phonology network. Our results provide clear brain-imaging evidence for the dual-route models of reading.

Combined ERP/fMRI evidence for early word recognition effects in the posterior inferior temporal gyrus

Two brain regions with established roles in reading are the posterior middle temporal gyrus and the posterior fusiform gyrus (FG). Lesion studies have also suggested that the region located between them, the posterior inferior temporal gyrus (pITG), plays a central role in word recognition. However, these lesion results could reflect disconnection effects since neuroimaging studies have not reported consistent lexicality effects in pITG. Here we tested whether these reported pITG lesion effects are due to disconnection effects or not using parallel Event-related Potentials (ERP)/functional magnetic resonance imaging (fMRI) studies. We predicted that the Recognition Potential (RP), a left-lateralized ERP negativity that peaks at about 200-250 msec, might be the electrophysiological correlate of pITG activity and that conditions that evoke the RP (perceptual degradation) might therefore also evoke pITG activity. In Experiment 1, twenty-three participants performed a lexical decision task (temporally flanked by supraliminal masks) while having high-density 129-channel ERP data collected. In Experiment 2, a separate group of fifteen participants underwent the same task while having fMRI data collected in a 3T scanner. Examination of the ERP data suggested that a canonical RP effect was produced. The strongest corresponding effect in the fMRI data was in the vicinity of the pITG. In addition, results indicated stimulus-dependent functional connectivity between pITG and a region of the posterior FG near the Visual Word Form Area (VWFA) during word compared to nonword processing. These results provide convergent spatiotemporal evidence that the pITG contributes to early lexical access through interaction with the VWFA.

At the mercy of strategies: the role of motor representations in language understanding

Classical cognitive theories hold that word representations in the brain are abstract and amodal, and are independent of the objects’ sensorimotor properties they refer to. An alternative hypothesis emphasizes the importance of bodily processes in cognition: the representation of a concept appears to be crucially dependent upon perceptual-motor processes that relate to it. Thus, understanding action-related words would rely upon the same motor structures that also support the execution of the same actions. In this context, motor simulation represents a key component. Our approach is to draw parallels between the literature on mental rotation and the literature on action verb/sentence processing. Here we will discuss recent studies on mental imagery, mental rotation, and language that clearly demonstrate how motor simulation is neither automatic nor necessary to language understanding. These studies have shown that motor representations can or cannot be activated depending on the type of strategy the participants adopt to perform tasks involving motor phrases. On the one hand, participants may imagine the movement with the body parts used to carry out the actions described by the verbs (i.e., motor strategy); on the other, individuals may solve the task without simulating the corresponding movements (i.e., visual strategy). While it is not surprising that the motor strategy is at work when participants process action-related verbs, it is however striking that sensorimotor activation has been reported also for imageable concrete words with no motor content, for “non-words” with regular phonology, for pseudo-verb stimuli, and also for negations. Based on the extant literature, we will argue that implicit motor imagery is not uniquely used when a body-related stimulus is encountered, and that it is not the type of stimulus that automatically triggers the motor simulation but the type of strategy. Finally, we will also comment on the view that sensorimotor activations are subjected to a top-down modulation.

The cerebellum and cognition: evidence from functional imaging studies

Evidence for a role of the human cerebellum in cognitive functions comes from anatomical, clinical and neuroimaging data. Functional neuroimaging reveals cerebellar activation during a variety of cognitive tasks, including language, visual-spatial, executive, and working memory processes. It is important to note that overt movement is not a prerequisite for cerebellar activation: the cerebellum is engaged during conditions which either control for motor output or do not involve motor responses. Resting-state functional connectivity data reveal that, in addition to networks underlying motor control, the cerebellum is part of "cognitive" networks with prefrontal and parietal association cortices. Consistent with these findings, regional differences in activation patterns within the cerebellum are evident depending on the task demands, suggesting that the cerebellum can be broadly divided into functional regions based on the patterns of anatomical connectivity between different regions of the cerebellum and sensorimotor and association areas of the cerebral cortex. However, the distinct contribution of the cerebellum to cognitive tasks is not clear. Here, the functional neuroimaging evidence for cerebellar involvement in cognitive functions is reviewed and related to hypotheses as to why the cerebellum is active during such tasks. Identifying the precise role of the cerebellum in cognition-as well as the mechanism by which the cerebellum modulates performance during a wide range of tasks-remains a challenge for future investigations.

Curvilinear relationship between phonological working memory load and social-emotional modulation

Accumulating evidence suggests that working memory load is an important factor for the interplay between cognitive and facial-affective processing. However, it is unclear how distraction caused by perception of faces interacts with load-related performance. We developed a modified version of the delayed match-to-sample task wherein task-irrelevant facial distracters were presented early in the rehearsal of pseudoword memoranda that varied incrementally in load size (1-syllable, 2-syllables, or 3-syllables). Facial distracters displayed happy, sad, or neutral expressions in Experiment 1 (N=60) and happy, fearful, or neutral expressions in Experiment 2 (N=29). Facial distracters significantly disrupted task performance in the intermediate load condition (2-syllable) but not in the low or high load conditions (1- and 3-syllables, respectively), an interaction replicated and generalised in Experiment 2. All facial distracters disrupted working memory in the intermediate load condition irrespective of valence, suggesting a primary and general effect of distraction caused by faces. However, sad and fearful faces tended to be less disruptive than happy faces, suggesting a secondary and specific valence effect. Working memory appears to be most vulnerable to social-emotional information at intermediate loads. At low loads, spare capacity is capable of accommodating the combinatorial load (1-syllable plus facial distracter), whereas high loads maximised capacity and deprived facial stimuli from occupying working memory slots to cause disruption.

A review and synthesis of the first 20 years of PET and fMRI studies of heard speech, spoken language and reading

The anatomy of language has been investigated with PET or fMRI for more than 20 years. Here I attempt to provide an overview of the brain areas associated with heard speech, speech production and reading. The conclusions of many hundreds of studies were considered, grouped according to the type of processing, and reported in the order that they were published. Many findings have been replicated time and time again leading to some consistent and undisputable conclusions. These are summarised in an anatomical model that indicates the location of the language areas and the most consistent functions that have been assigned to them. The implications for cognitive models of language processing are also considered. In particular, a distinction can be made between processes that are localized to specific structures (e.g. sensory and motor processing) and processes where specialisation arises in the distributed pattern of activation over many different areas that each participate in multiple functions. For example, phonological processing of heard speech is supported by the functional integration of auditory processing and articulation; and orthographic processing is supported by the functional integration of visual processing, articulation and semantics. Future studies will undoubtedly be able to improve the spatial precision with which functional regions can be dissociated but the greatest challenge will be to understand how different brain regions interact with one another in their attempts to comprehend and produce language.

Covert reading of letters in a case of global alexia

This study describes the case of a global alexic patient with a severe reading deficit affecting words, letters and Arabic numbers, following a left posterior lesion. The patient (VA) could not match spoken letters to their graphic form. A preserved ability to recognize shape and canonical orientation of letters indicates intact access to the representation of letters and numbers as visual objects. A relatively preserved ability to match lowercase to uppercase letters suggests partially spared access to abstract letter identities independently of their visual forms. The patient was also unable to match spoken letters and numbers to their visual form, indicating that she could not access the graphemic representations of letters from their phonological representations. This pattern of performance suggests that the link between graphemic and phonological representations is disrupted in this patient. We hypothesize that VA' residual reading abilities are supported by the right hemisphere.