The Long Road to Automation: Neurocognitive Development of Letter–Speech Sound Processing

Cortical tracking of language structures: Modality-dependent and independent responses

OBJECTIVES

The mental parsing of linguistic hierarchy is crucial for language comprehension, and while there is growing interest in the cortical tracking of auditory speech, the neurophysiological substrates for tracking written language are still unclear.

METHODS

We recorded electroencephalographic (EEG) responses from participants exposed to auditory and visual streams of either random syllables or tri-syllabic real words. Using a frequency-tagging approach, we analyzed the neural representations of physically presented (i.e., syllables) and mentally constructed (i.e., words) linguistic units and compared them between the two sensory modalities.

RESULTS

We found that tracking syllables is partially modality dependent, with anterior and posterior scalp regions more involved in the tracking of spoken and written syllables, respectively. The cortical tracking of spoken and written words instead was found to involve a shared anterior region to a similar degree, suggesting a modality-independent process for word tracking.

CONCLUSION

Our study suggests that basic linguistic features are represented in a sensory modality-specific manner, while more abstract ones are modality-unspecific during the online processing of continuous language input.

SIGNIFICANCE

The current methodology may be utilized in future research to examine the development of reading skills, especially the deficiencies in fluent reading among those with dyslexia.

Letter-speech sound integration in typical reading development during the first years of formal education

This study investigated the neural basis of letter and speech sound (LS) integration in 53 typical readers (35 girls, all White) during the first 2 years of reading education (ages 7-9). Changes in both sensory (multisensory vs unisensory) and linguistic (congruent vs incongruent) aspects of LS integration were examined. The left superior temporal cortex and bilateral inferior frontal cortex showed increasing activation for multisensory over unisensory LS over time, driven by reduced activation to speech sounds. No changes were noted in the congruency effect. However, at age nine, heightened activation to incongruent over congruent LS pairs were observed, correlating with individual differences in reading development. This suggests that the incongruency effect evolves at varying rates depending on reading skills.

The Role of Letter-Speech Sound Integration in Native and Second Language Reading: A Study in Native Japanese Readers Learning English

The automatic activation of letter-speech sound (L-SS) associations is a vital step in typical reading acquisition. However, the contribution of L-SS integration during nonalphabetic native and alphabetic second language (L2) reading remains unclear. This study explored whether L-SS integration plays a similar role in a nonalphabetic language as in alphabetic languages and its contribution to L2 reading among native Japanese-speaking adults with varying English proficiency. A priming paradigm in Japanese and English was performed by presenting visual letters or symbols, followed by auditory sounds. We compared behavioral and event-related responses elicited by congruent letter-sound pairs, incongruent pairs, and baseline condition (symbol-sound pairs). The behavioral experiment revealed shorter RTs in the congruent condition for Japanese and English tasks, suggesting a facilitation effect of congruency. The ERP experiment results showed an increased early N1 response to Japanese congruent pairs compared to corresponding incongruent stimuli at the left frontotemporal electrodes. Interestingly, advanced English learners exhibited greater activities in bilateral but predominantly right-lateralized frontotemporal regions for the congruent condition within the N1 time window. Moreover, the enhancement of P2 response to congruent pairs was observed in intermediate English learners. These findings indicate that, despite deviations from native language processing, advanced speakers may successfully integrate letters and sounds during English reading, whereas intermediate learners may encounter difficulty in achieving L-SS integration when reading L2. Furthermore, our results suggest that L2 proficiency may affect the level of automaticity in L-SS integration, with the right P2 congruency effect playing a compensatory role for intermediate learners.

Multiple number-naming associations: How the inversion property affects adults' two-digit number processing

Some number-naming systems are less transparent than others. For example, in Dutch, 49 is named "negenenveertig," which translates to "nine and forty," i.e., the unit is named first, followed by the decade. This is known as the "inversion property," where the morpho-syntactic representation of the number name is incongruent with its written Arabic form. Number word inversion can hamper children's developing mathematical skills. But little is known about its effects on adults' numeracy, the underlying mechanism, and how a person's bilingual background influences its effects. In the present study, Dutch-English bilingual adults performed an audiovisual matching task, where they heard a number word and simultaneously saw two-digit Arabic symbols and had to determine whether these matched in quantity. We experimentally manipulated the morpho-syntactic structure of the number words to alter their phonological (dis)similarities and numerical congruency with the target Arabic two-digit number. Results showed that morpho-syntactic (in)congruency differentially influenced quantity match and non-match decisions. Although participants were faster when hearing traditional non-transparent Dutch number names, they made more accurate decisions when hearing artificial, but morpho-syntactically transparent number words. This pattern was partly influenced by the participants' bilingual background, i.e., their L2 proficiency in English, which involves more transparent number names. Our findings suggest that, within inversion number-naming systems, multiple associations are formed between two-digit Arabic symbols and number names, which can influence adults' numerical cognition.

Fluent contextual reading is associated with greater synchronization of the visual and auditory networks, fluent reading and better speed of processing in children with dyslexia

The asynchrony theory of dyslexia postulates weaker visual (orthographical processing) and auditory (phonological processing) network synchrony in dyslexic readers. The weaker visual-auditory network synchronization is suggested to contribute to slow processing speed, which supports cognitive control, contributing to single-word reading difficulty and lower reading fluency. The current study aims to determine the neurobiological signature for this theory and to examine if prompting enhanced reading speed through deleted text is associated with a greater synchronization of functional connectivity of the visual and auditory networks in children with dyslexia and typical readers (TRs). We further aimed to determine if the change in visual-auditory connectivity prompted by deleted text is associated with reading fluency and processing speed abilities. Nineteen children with dyslexia and 21 typical readers ages 8-12 years old participated in a fMRI under two types of reading conditions: a still text condition and deleted text condition, in which letters was sequentially deleted from the screen. Effects of diagnostic group and condition on functional connectivity (FC) of visual and auditory networks were examined. Results revealed a significant overall effect of condition with a marginally significant Group × Condition interaction, such that as compared with TRs, children with dyslexia showed a significantly greater increase in visual-auditory FC between the still and deleted text conditions. Additionally, for children with dyslexia, this FC increase was significantly correlated with better reading fluency and verbal/nonverbal processing speed. These results support a relationship between the synchronization of the visual and auditory networks, fluent reading and increased speed of processing abilities in children with dyslexia, which can help guide fluency-based intervention strategies.

The development of simple addition problem solving in children: Reliance on automatized counting or memory retrieval depends on both expertise and problem size

In an experiment, 98 children aged 8 to 9, 10 to 12, and 13 to 15 years solved addition problems with a sum up to 10. In another experiment, the same children solved the same calculations within a sign priming paradigm where half the additions were displayed with the "+" sign 150 ms before the addends. Therefore, size effects and priming effects could be considered conjointly within the same populations. Our analyses revealed that small problems, constructed with addends from 1 to 4, presented a linear increase of solution times as a function of problem sums (i.e., size effect) in all age groups. However, an operator priming effect (i.e., facilitation of the solving process with the anticipated presentation of the "+" sign) was observed only in the group of oldest children. These results support the idea that children use a counting procedure that becomes automatized (as revealed by the priming effect) around 13 years of age. For larger problems and whatever the age group, no size or priming effects were observed, suggesting that the answers to these problems were already retrieved from memory at 8 to 9 years of age. For this specific category of large problems, negative slopes in solution times demonstrate that retrieval starts from the largest problems during development. These results are discussed in light of a horse race model in which procedures can win over retrieval.

Similarities and differences in the neural correlates of letter and speech sound integration in blind and sighted readers

Learning letter and speech sound (LS) associations is a major step in reading acquisition common for all alphabetic scripts, including Braille used by blind readers. The left superior temporal cortex (STC) plays an important role in audiovisual LS integration in sighted people, but it is still unknown what neural mechanisms are responsible for audiotactile LS integration in blind individuals. Here, we investigated the similarities and differences between LS integration in blind Braille (N = 42, age range: 9-60 y.o.) and sighted print (N = 47, age range: 9-60 y.o.) readers who acquired reading using different sensory modalities. In both groups, the STC responded to both isolated letters and isolated speech sounds, showed enhanced activation when they were presented together, and distinguished between congruent and incongruent letter and speech sound pairs. However, the direction of the congruency effect was different between the groups. Sighted subjects showed higher activity for incongruent LS pairs in the bilateral STC, similarly to previously studied typical readers of transparent orthographies. In the blind, congruent pairs resulted in an increased response in the right STC. These differences may be related to more sequential processing of Braille as compared to print reading. At the same time, behavioral efficiency in LS discrimination decisions and the congruency effect were found to be related to age and reading skill only in sighted participants, suggesting potential differences in the developmental trajectories of LS integration between blind and sighted readers.

Dynamic assessment of the effectiveness of digital game-based literacy training in beginning readers: a cluster randomised controlled trial

In this article, we report on a study evaluating the effectiveness of a digital game-based learning (DGBL) tool for beginning readers of Dutch, employing active (math game) and passive (no game) control conditions. This classroom-level randomized controlled trial included 247 first graders from 16 classrooms in the Netherlands and the Dutch-speaking part of Belgium. The intervention consisted of 10 to 15 min of daily playing during school time for a period of up to 7 weeks. Our outcome measures included reading fluency, phonological skills, as well as purpose built in-game proficiency levels to measure written lexical decision and letter speech sound association. After an average of 28 playing sessions, the literacy game improved letter knowledge at a scale generalizable for all children in the classroom compared to the two control conditions. In addition to a small classroom wide benefit in terms of reading fluency, we furthermore discovered that children who scored high on phonological awareness prior to training were more fluent readers after extensive exposure to the reading game. This study is among the first to exploit game generated data for the evaluation of DGBL for literacy interventions.

Neurodevelopmental trajectories of letter and speech sound processing from preschool to the end of elementary school

Learning to read alphabetic languages starts with learning letter-speech-sound associations. How this process changes brain function during development is still largely unknown. We followed 102 children with varying reading skills in a mixed-longitudinal/cross-sectional design from the prereading stage to the end of elementary school over five time points (n = 46 with two and more time points, of which n = 16 fully-longitudinal) to investigate the neural trajectories of letter and speech sound processing using fMRI. Children were presented with letters and speech sounds visually, auditorily, and audiovisually in kindergarten (6.7yo), at the middle (7.3yo) and end of first grade (7.6yo), and in second (8.4yo) and fifth grades (11.5yo). Activation of the ventral occipitotemporal cortex for visual and audiovisual processing followed a complex trajectory, with two peaks in first and fifth grades. The superior temporal gyrus (STG) showed an inverted U-shaped trajectory for audiovisual letter processing, a development that in poor readers was attenuated in middle STG and absent in posterior STG. Finally, the trajectories for letter-speech-sound integration were modulated by reading skills and showed differing directionality in the congruency effect depending on the time point. This unprecedented study captures the development of letter processing across elementary school and its neural trajectories in children with varying reading skills.

Short-term training helps second-language learners read like native readers: An ERP study

This randomized controlled trial study aimed to examine what experience other than immersion may help adult learners read with native-like neural responses. We compared a group of 13 native Chinese English learners completing English letter-sound association training with another group of 12 completing visual symbol-sound association training and included one group of native English readers as the reference. The results showed that after three hours of training, all learners no longer showed attenuated cross-modal mismatch negativity (MMN) to English letter-sound integration as in the pretest. After six hours of training, the learners receiving English letter-sound association training showed enhanced cross-modal MMN and theta oscillations, as native English readers did. The enhanced neural responses were significantly correlated with better phonological awareness. Thus, with training specific to critical second language reading skills of appropriate dosages, adult learners can overcome the constraints of their native language background and learn to read with native-like neural responses.

The multiple-level framework of developmental dyslexia: the long trace from a neurodevelopmental deficit to an impaired cultural technique

Developmental dyslexia is a neurodevelopmental disorder characterized by an unexpected impairment in literacy acquisition leading to specific poor academic achievement and possible secondary symptoms. The multi-level framework of developmental dyslexia considers five levels of a causal pathway on which a given genotype is expressed and hierarchically transmitted from one level to the next under the increasing influence of individual learning-relevant traits and environmental factors moderated by cultural conditions. These levels are the neurobiological, the information processing and the skill level (prerequisites and acquisition of literacy skills), the academic achievement level and the level of secondary effects. Various risk factors are present at each level within the assumed causal pathway and can increase the likelihood of exhibiting developmental dyslexia. Transition from one level to the next is neither unidirectional nor inevitable. This fact has direct implications for prevention and intervention which can mitigate transitions from one level to the next. In this paper, various evidence-based theories and findings regarding deficits at different levels are placed in the proposed framework. In addition, the moderating effect of cultural impact at and between information processing and skill levels are further elaborated based on a review of findings regarding influences of different writing systems and orthographies. These differences impose culture-specific demands for literacy-specific cognitive procedures, influencing both literacy acquisition and the manifestation of developmental dyslexia.

Differences in brain functional networks for audiovisual integration during reading between children and adults

Building robust letter-to-sound correspondences is a prerequisite for developing reading capacity. However, the neural mechanisms underlying the development of audiovisual integration for reading are largely unknown. This study used functional magnetic resonance imaging in a lexical decision task to investigate functional brain networks that support audiovisual integration during reading in developing child readers (10-12 years old) and skilled adult readers (20-28 years old). The results revealed enhanced connectivity in a prefrontal-superior temporal network (including the right medial frontal gyrus, right superior frontal gyrus, and left superior temporal gyrus) in adults relative to children, reflecting the development of attentional modulation of audiovisual integration involved in reading processing. Furthermore, the connectivity strength of this brain network was correlated with reading accuracy. Collectively, this study, for the first time, elucidates the differences in brain networks of audiovisual integration for reading between children and adults, promoting the understanding of the neurodevelopment of multisensory integration in high-level human cognition.

Reduced audiovisual temporal sensitivity in Chinese children with dyslexia

Background

Temporal processing deficits regarding audiovisual cross-modal stimuli could affect children's speed and accuracy of decoding.

Aim

To investigate the characteristics of audiovisual temporal sensitivity (ATS) in Chinese children, with and without developmental dyslexia and its impact on reading ability.

Methods

The audiovisual simultaneity judgment and temporal order judgment tasks were performed to investigate the ATS of 106 Chinese children (53 with dyslexia) aged 8 to 12 and 37 adults without a history of dyslexia. The predictive effect of children's audiovisual time binding window on their reading ability and the effects of extra cognitive processing in the temporal order judgment task on participants' ATS were also investigated.

Outcomes and results

With increasing inter-stimulus intervals, the percentage of synchronous responses in adults declined more rapidly than in children. Adults and typically developing children had significantly narrower time binding windows than children with dyslexia. The size of visual stimuli preceding auditory stimuli time binding window had a marginally significant predictive effect on children's reading fluency. Compared with the simultaneity judgment task, the extra cognitive processing of the temporal order judgment task affected children's ATS.

Conclusion and implications

The ATS of 8-12-year-old Chinese children is immature. Chinese children with dyslexia have lower ATS than their peers.

The influence of temporal asynchrony on character-speech integration in Chinese children with and without dyslexia: An ERP study

Dyslexic readers have been reported to show abnormal temporal acuity and multisensory integration deficiency. Here, we investigated the influence of temporal intervals on Chinese character-speech integration in children with and without dyslexia. Visual characters were presented synchronously to the onset of speech sounds (AV0) or before speech sound by 300 ms (AV300). Event-related potentials (ERP) evoked by congruent condition (speech sounds presented with congruent Chinese characters) and by baseline condition (speech sounds presented with Korean characters) were compared. Typically developing (TD) children exhibited congruency effect in AV0 condition, whereas dyslexic children exhibited congruency effect in AV300 condition. Moreover, congruency effect in TD children was due to enhanced neural activation to congruent trials, congruency effect in dyslexic children was contributed by neural suppression for baseline trials. These results suggested that different underlying mechanisms were involved in character-speech integration for typical and dyslexic children.

The different brain areas occupied for integrating information of hierarchical linguistic units: a study based on EEG and TMS

Human language units are hierarchical, and reading acquisition involves integrating multisensory information (typically from auditory and visual modalities) to access meaning. However, it is unclear how the brain processes and integrates language information at different linguistic units (words, phrases, and sentences) provided simultaneously in auditory and visual modalities. To address the issue, we presented participants with sequences of short Chinese sentences through auditory, visual, or combined audio-visual modalities while electroencephalographic responses were recorded. With a frequency tagging approach, we analyzed the neural representations of basic linguistic units (i.e. characters/monosyllabic words) and higher-level linguistic structures (i.e. phrases and sentences) across the 3 modalities separately. We found that audio-visual integration occurs in all linguistic units, and the brain areas involved in the integration varied across different linguistic levels. In particular, the integration of sentences activated the local left prefrontal area. Therefore, we used continuous theta-burst stimulation to verify that the left prefrontal cortex plays a vital role in the audio-visual integration of sentence information. Our findings suggest the advantage of bimodal language comprehension at hierarchical stages in language-related information processing and provide evidence for the causal role of the left prefrontal regions in processing information of audio-visual sentences.

Brain Source Correlates of Speech Perception and Reading Processes in Children With and Without Reading Difficulties

Neural correlates in reading and speech processing have been addressed extensively in the literature. While reading skills and speech perception have been shown to be associated with each other, their relationship remains debatable. In this study, we investigated reading skills, speech perception, reading, and their correlates with brain source activity in auditory and visual modalities. We used high-density event-related potentials (ERPs), fixation-related potentials (FRPs), and the source reconstruction method. The analysis was conducted on 12–13-year-old schoolchildren who had different reading levels. Brain ERP source indices were computed from frequently repeated Finnish speech stimuli presented in an auditory oddball paradigm. Brain FRP source indices were also computed for words within sentences presented in a reading task. The results showed significant correlations between speech ERP sources and reading scores at the P100 (P1) time range in the left hemisphere and the N250 time range in both hemispheres, and a weaker correlation for visual word processing N170 FRP source(s) in the posterior occipital areas, in the vicinity of the visual word form areas (VWFA). Furthermore, significant brain-to-brain correlations were found between the two modalities, where the speech brain sources of the P1 and N250 responses correlated with the reading N170 response. The results suggest that speech processes are linked to reading fluency and that brain activations to speech are linked to visual brain processes of reading. These results indicate that a relationship between language and reading systems is present even after several years of exposure to print.

The impact of musical training in symbolic and non-symbolic audiovisual judgements of magnitude

Quantity estimation can be represented in either an analog or symbolic manner and recent evidence now suggests that analog and symbolic representation of quantities interact. Nonetheless, those two representational forms of quantities may be enhanced by convergent multisensory information. Here, we elucidate those interactions using high-density electroencephalography (EEG) and an audiovisual oddball paradigm. Participants were presented simultaneous audiovisual tokens in which the co-varying pitch of tones was combined with the embedded cardinality of dot patterns. Incongruencies were elicited independently from symbolic and non-symbolic modality within the audio-visual percept, violating the newly acquired rule that “the higher the pitch of the tone, the larger the cardinality of the figure.” The effect of neural plasticity in symbolic and non-symbolic numerical representations of quantities was investigated through a cross-sectional design, comparing musicians to musically naïve controls. Individual’s cortical activity was reconstructed and statistically modeled for a predefined time-window of the evoked response (130–170 ms). To summarize, we show that symbolic and non-symbolic processing of magnitudes is re-organized in cortical space, with professional musicians showing altered activity in motor and temporal areas. Thus, we argue that the symbolic representation of quantities is altered through musical training.

How are visemes and graphemes integrated with speech sounds during spoken word recognition? ERP evidence for supra-additive responses during audiovisual compared to auditory speech processing

Both visual articulatory gestures and orthography provide information on the phonological content of speech. This EEG study investigated the integration between speech and these two visual inputs. A comparison of skilled readers' brain responses elicited by a spoken word presented alone versus synchronously with a static image of a viseme or a grapheme of the spoken word's onset showed that while neither visual input induced audiovisual integration on N1 acoustic component, both led to a supra-additive integration on P2, with a stronger integration between speech and graphemes on left-anterior electrodes. This pattern persisted in P350 time-window and generalized to all electrodes. The finding suggests a strong impact of spelling knowledge on phonetic processing and lexical access. It also indirectly indicates that the dynamic and predictive value present in natural lip movements but not in static visemes is particularly critical to the contribution of visual articulatory gestures to speech processing.

Longitudinal changes in cortical responses to letter-speech sound stimuli in 8-11 year-old children

While children are able to name letters fairly quickly, the automatisation of letter-speech sound mappings continues over the first years of reading development. In the current longitudinal fMRI study, we explored developmental changes in cortical responses to letters and speech sounds across 3 yearly measurements in a sample of 18 8-11 year old children. We employed a text-based recalibration paradigm in which combined exposure to text and ambiguous speech sounds shifts participants' later perception of the ambiguous sounds towards the text. Our results showed that activity of the left superior temporal and lateral inferior precentral gyri followed a non-linear developmental pattern across the measurement sessions. This pattern is reminiscent of previously reported inverted-u-shape developmental trajectories in children's visual cortical responses to text. Our findings suggest that the processing of letters and speech sounds involves non-linear changes in the brain's spoken language network possibly related to progressive automatisation of reading skills.

Neurofunctional basis underlying audiovisual integration of print and speech sound in Chinese children

Effortless print-sound integration is essential to reading development, and the superior temporal cortex (STC) is the most critical brain region. However, to date, the conclusion is almost restricted to alphabetic orthographies. To examine the neural basis in non-alphabetic languages and its relationship with reading abilities, we conducted a functional magnetic resonance imaging study in typically developing Chinese children. Two neuroimaging-based indicators of audiovisual processing-additive enhancement (higher activation in the congruent than the average activation of unimodal conditions) and neural integration (different activations between the congruent versus incongruent conditions)-were used to investigate character-sounds (opaque) and pinyin-sounds (transparent) processing. We found additive enhancement in bilateral STCs processing both character and pinyin stimulations. Moreover, the neural integrations in the left STC for the two scripts were strongly correlated. In terms of differentiation, first, areas beyond the STCs showed additive enhancement in processing pinyin-sounds. Second, while the bilateral STCs, left inferior/middle frontal and parietal regions manifested a striking neural integration (incongruent > congruent) for character-sounds, no significant clusters were revealed for pinyin-sounds. Finally, the neural integration in the left middle frontal gyrus for characters was specifically associated with silent reading comprehension proficiency, indicating automatic semantic processing during implicit character-sound integration. In contrast, the neural integration in the left STC for pinyin was specifically associated with oral reading fluency that relies on grapho-phonological mapping. To summarize, this study revealed both script-universal and script-specific neurofunctional substrates of print-sound integration as well as their processing- and region-dependent associations with reading abilities in typical Chinese children.

How Learning to Read Changes the Listening Brain

Reading acquisition reorganizes existing brain networks for speech and visual processing to form novel audio-visual language representations. This requires substantial cortical plasticity that is reflected in changes in brain activation and functional as well as structural connectivity between brain areas. The extent to which a child's brain can accommodate these changes may underlie the high variability in reading outcome in both typical and dyslexic readers. In this review, we focus on reading-induced functional changes of the dorsal speech network in particular and discuss how its reciprocal interactions with the ventral reading network contributes to reading outcome. We discuss how the dynamic and intertwined development of both reading networks may be best captured by approaching reading from a skill learning perspective, using audio-visual learning paradigms and longitudinal designs to follow neuro-behavioral changes while children's reading skills unfold.

Developmental Trajectories of Letter and Speech Sound Integration During Reading Acquisition

Reading acquisition in alphabetic languages starts with learning the associations between speech sounds and letters. This learning process is related to crucial developmental changes of brain regions that serve visual, auditory, multisensory integration, and higher cognitive processes. Here, we studied the development of audiovisual processing and integration of letter-speech sound pairs with an audiovisual target detection functional MRI paradigm. Using a longitudinal approach, we tested children with varying reading outcomes before the start of reading acquisition (T1, 6.5 yo), in first grade (T2, 7.5 yo), and in second grade (T3, 8.5 yo). Early audiovisual integration effects were characterized by higher activation for incongruent than congruent letter-speech sound pairs in the inferior frontal gyrus and ventral occipitotemporal cortex. Audiovisual processing in the left superior temporal gyrus significantly increased from the prereading (T1) to early reading stages (T2, T3). Region of interest analyses revealed that activation in left superior temporal gyrus (STG), inferior frontal gyrus and ventral occipitotemporal cortex increased in children with typical reading fluency skills, while poor readers did not show the same development in these regions. The incongruency effect bilaterally in parts of the STG and insular cortex at T1 was significantly associated with reading fluency skills at T3. These findings provide new insights into the development of the brain circuitry involved in audiovisual processing of letters, the building blocks of words, and reveal early markers of audiovisual integration that may be predictive of reading outcomes.

ERP Correlates of Altered Orthographic-Phonological Processing in Dyslexia

Automatic visual word recognition requires not only well-established phonological and orthographic representations but also efficient audio-visual integration of these representations. One possibility is that in developmental dyslexia, inefficient orthographic processing might underlie poor reading. Alternatively, reading deficit could be due to inefficient phonological processing or inefficient integration of orthographic and phonological information. In this event-related potential study, participants with dyslexia (N = 25) and control readers (N = 27) were presented with pairs of words and pseudowords in an implicit same-different task. The reference-target pairs could be identical, or different in the identity or the position of the letters. To test the orthographic-phonological processing, target stimuli were presented in visual-only and audiovisual conditions. Participants with and without dyslexia processed the reference stimuli similarly; however, group differences emerged in the processing of target stimuli, especially in the audiovisual condition where control readers showed greater N1 responses for words than for pseudowords, but readers with dyslexia did not show such difference. Moreover, after 300 ms lexicality effect exhibited a more focused frontal topographic distribution in readers with dyslexia. Our results suggest that in developmental dyslexia, phonological processing and audiovisual processing deficits are more pronounced than orthographic processing deficits.

The neural basis of number word processing in children and adults

The ability to map number words to their corresponding quantity representations is a gatekeeper for children's future math success (Spaepen et al., 2018). Without number word knowledge at school entry, children are at greater risk for developing math learning difficulties (Chu et al., 2019). In the present study, we used functional magnetic resonance imaging (fMRI) to examine the neural basis for processing the meaning of spoken number words and its developmental trajectory in 4- to 10-year-old children, and in adults. In a number word-quantity mapping paradigm, participants listened to number words while simultaneously viewing quantities that were congruent or incongruent to the number word they heard. Whole brain analyses revealed that adults showed a neural congruity effect with greater neural activation for incongruent relative to congruent trials in anterior cingulate cortex (ACC) and left intraparietal sulcus (LIPS). In contrast, children did not show a significant neural congruity effect. However, a region of interest analysis in the child sample demonstrated age-related increases in the neural congruity effect, specifically in the LIPS. The positive correlation between neural congruity in LIPS and age was stronger in children who were already attending school, suggesting that developmental changes in LIPS function are experience-dependent.

Reading-Related Brain Changes in Audiovisual Processing: Cross-Sectional and Longitudinal MEG Evidence

The ability to establish associations between visual objects and speech sounds is essential for human reading. Understanding the neural adjustments required for acquisition of these arbitrary audiovisual associations can shed light on fundamental reading mechanisms and help reveal how literacy builds on pre-existing brain circuits. To address these questions, the present longitudinal and cross-sectional MEG studies characterize the temporal and spatial neural correlates of audiovisual syllable congruency in children (age range, 4-9 years; 22 males and 20 females) learning to read. Both studies showed that during the first years of reading instruction children gradually set up audiovisual correspondences between letters and speech sounds, which can be detected within the first 400 ms of a bimodal presentation and recruit the superior portions of the left temporal cortex. These findings suggest that children progressively change the way they treat audiovisual syllables as a function of their reading experience. This reading-specific brain plasticity implies (partial) recruitment of pre-existing brain circuits for audiovisual analysis.SIGNIFICANCE STATEMENT Linking visual and auditory linguistic representations is the basis for the development of efficient reading, while dysfunctional audiovisual letter processing predicts future reading disorders. Our developmental MEG project included a longitudinal and a cross-sectional study; both studies showed that children's audiovisual brain circuits progressively change as a function of reading experience. They also revealed an exceptional degree of neuroplasticity in audiovisual neural networks, showing that as children develop literacy, the brain progressively adapts so as to better detect new correspondences between letters and speech sounds.

Phonemic Training Modulates Early Speech Processing in Pre-reading Children

Phonemic awareness and rudimentary grapheme knowledge concurrently develop in pre-school age. In a training study, we tried to disentangle the role of both precursor functions of reading for spoken word recognition. Two groups of children exercised with phonemic materials, but only one of both groups learnt corresponding letters to trained phonemes. A control group exercised finger-number associations (non-linguistic training). After the training, we tested how sensitive children were to prime-target variation in word onset priming. A group of young adults took part in the same experiment to provide data from experienced readers. While decision latencies to the targets suggested fine-grained spoken word processing in all groups, event-related potentials (ERPs) indicated that both phonemic training groups processed phonemic variation in more detail than the non-linguistic training group and young adults at early stages of speech processing. Our results indicate temporal plasticity of implicit speech processing in pre-school age as a function of explicit phonemic training.

How to capture developmental brain dynamics: gaps and solutions

Capturing developmental and learning-induced brain dynamics is extremely challenging as changes occur interactively across multiple levels and emerging functions. Different levels include the (social) environment, cognitive and behavioral levels, structural and functional brain changes, and genetics, while functions include domains such as math, reading, and executive function. Here, we report the insights that emerged from the workshop “Capturing Developmental Brain Dynamics”, organized to bring together multidisciplinary approaches to integrate data on development and learning across different levels, functions, and time points. During the workshop, current main gaps in our knowledge and tools were identified including the need for: (1) common frameworks, (2) longitudinal, large-scale, multisite studies using representative participant samples, (3) understanding interindividual variability, (4) explicit distinction of understanding versus predicting, and (5) reproducible research. After illustrating interactions across levels and functions during development, we discuss the identified gaps and provide solutions to advance the capturing of developmental brain dynamics.

Development of Print-Speech Integration in the Brain of Beginning Readers With Varying Reading Skills

Learning print-speech sound correspondences is a crucial step at the beginning of reading acquisition and often impaired in children with developmental dyslexia. Despite increasing insight into audiovisual language processing, it remains largely unclear how integration of print and speech develops at the neural level during initial learning in the first years of schooling. To investigate this development, 32 healthy, German-speaking children at varying risk for developmental dyslexia (17 typical readers and 15 poor readers) participated in a longitudinal study including behavioral and fMRI measurements in first (T1) and second (T2) grade. We used an implicit audiovisual (AV) non-word target detection task aimed at characterizing differential activation to congruent (AVc) and incongruent (AVi) audiovisual non-word pairs. While children’s brain activation did not differ between AVc and AVi pairs in first grade, an incongruency effect (AVi > AVc) emerged in bilateral inferior temporal and superior frontal gyri in second grade. Of note, pseudoword reading performance improvements with time were associated with the development of the congruency effect (AVc > AVi) in the left posterior superior temporal gyrus (STG) from first to second grade. Finally, functional connectivity analyses indicated divergent development and reading expertise dependent coupling from the left occipito-temporal and superior temporal cortex to regions of the default mode (precuneus) and fronto-temporal language networks. Our results suggest that audiovisual integration areas as well as their functional coupling to other language areas and areas of the default mode network show a different development in poor vs. typical readers at varying familial risk for dyslexia.

Rapid changes in brain activity during learning of grapheme-phoneme associations in adults

Learning to associate written letters with speech sounds is crucial for the initial phase of acquiring reading skills. However, little is known about the cortical reorganization for supporting letter-speech sound learning, particularly the brain dynamics during the learning of grapheme-phoneme associations. In the present study, we trained 30 Finnish participants (mean age: 24.33 years, SD: 3.50 years) to associate novel foreign letters with familiar Finnish speech sounds on two consecutive days (first day ​~ ​50 ​min; second day ​~ ​25 ​min), while neural activity was measured using magnetoencephalography (MEG). Two sets of audiovisual stimuli were used for the training in which the grapheme-phoneme association in one set (Learnable) could be learned based on the different learning cues provided, but not in the other set (Control). The learning progress was tracked at a trial-by-trial basis and used to segment different learning stages for the MEG source analysis. The learning-related changes were examined by comparing the brain responses to Learnable and Control uni/multi-sensory stimuli, as well as the brain responses to learning cues at different learning stages over the two days. We found dynamic changes in brain responses related to multi-sensory processing when grapheme-phoneme associations were learned. Further, changes were observed in the brain responses to the novel letters during the learning process. We also found that some of these learning effects were observed only after memory consolidation the following day. Overall, the learning process modulated the activity in a large network of brain regions, including the superior temporal cortex and the dorsal (parietal) pathway. Most interestingly, middle- and inferior-temporal regions were engaged during multi-sensory memory encoding after the cross-modal relationship was extracted from the learning cues. Our findings highlight the brain dynamics and plasticity related to the learning of letter-speech sound associations and provide a more refined model of grapheme-phoneme learning in reading acquisition.

Temporal representation impairment in developmental dyslexia for unisensory and multisensory stimuli

Dyslexia has been associated with a problem in visual-audio integration mechanisms. Here, we investigate for the first time the contribution of unisensory cues on multisensory audio and visual integration in 32 dyslexic children by modelling results using the Bayesian approach. Non-linguistic stimuli were used. Children performed a temporal task: they had to report whether the middle of three stimuli was closer in time to the first one or to the last one presented. Children with dyslexia, compared with typical children, exhibited poorer unimodal thresholds, requiring greater temporal distance between items for correct judgements, while multisensory thresholds were well predicted by the Bayesian model. This result suggests that the multisensory deficit in dyslexia is due to impaired audio and visual inputs rather than impaired multisensory processing per se. We also observed that poorer temporal skills correlated with lower reading skills in dyslexic children, suggesting that this temporal capability can be linked to reading abilities.

Skilled readers show different serial-position effects for letter versus non-letter target detection in mixed-material strings

The study explored whether target detection in a five-character string depends on whether a letter or a non-letter was presented, as a predesignated target. Skilled readers had to identify a single letter or non-letter in a five-character string, randomly composed of letters and non-letters. It was found that an analytic processing strategy is automatically elicited if participants were instructed to detect a letter target. In this instance, a linear model best explained the RT variance for letters: with increasing RTs from left to right, suggesting a serial item-by-item reading-specific strategy comparable to alphabetic reading. For non-letters, in contrast, a symmetrical U-shaped function best explained the RT variance, suggesting a symmetrical scanning-out from the central to the terminal positions of the string. Since the design precludes orthographic and semantic influences, it can be concluded that a reading-specific strategy for alphabetic processing is automatically activated if the string is scanned for a letter-target. Thus, the pre-designated target triggers the strategy for processing the string and determines related position effects. The results suggest that effects from earlier studies, which showed an analytic processing preference for isolated letters (APPLE) in recognition tasks, as a consequence of literacy acquisition, generalize to the processing of letters in strings.

Individual differences in the acquisition of non-linguistic audio-visual associations in 5 year olds

Audio-visual associative learning - at least when linguistic stimuli are employed - is known to rely on core linguistic skills such as phonological awareness. Here we ask whether this would also be the case in a task that does not manipulate linguistic information. Another question of interest is whether executive skills, often found to support learning, may play a larger role in a non-linguistic audio-visual associative task compared to a linguistic one. We present a new task that measures learning when having to associate non-linguistic auditory signals with novel visual shapes. Importantly, our novel task shares with linguistic processes such as reading acquisition the need to associate sounds with arbitrary shapes. Yet, rather than phonemes or syllables, it uses novel environmental sounds - therefore limiting direct reliance on linguistic abilities. Five-year-old French-speaking children (N = 76, 39 girls) were assessed individually in our novel audio-visual associative task, as well as in a number of other cognitive tasks evaluating linguistic abilities and executive functions. We found phonological awareness and language comprehension to be related to scores in the audio-visual associative task, while no correlation with executive functions was observed. These results underscore a key relation between foundational language competencies and audio-visual associative learning, even in the absence of linguistic input in the associative task.

Understanding functional illiteracy from a policy, adult education, and cognition point of view: Towards a joint referent framework

Abstract. The article discusses the emergence of a functional literacy construct and the rediscovery of illiteracy in industrialized countries during the second half of the 20th century. It offers a short explanation of how the construct evolved over time. In addition, it explores how functional (il)literacy is conceived differently by research discourses of cognitive and neural studies, on the one hand, and by prescriptive and normative international policy documents and adult education, on the other hand. Furthermore, it analyses how literacy skills surveys such as the Level One Study (leo.) or the PIAAC may help to bridge the gap between cognitive and more practical and educational approaches to literacy, the goal being to place the functional illiteracy (FI) construct within its existing scale levels. It also sheds more light on the way in which FI can be perceived in terms of different cognitive processes and underlying components of reading. By building on the previous work of other authors and previous definitions, the article brings together different views of FI and offers a perspective for a needed operational definition of the concept, which would be an appropriate reference point for future educational, political, and scientific utilization.

Braille readers break mirror invariance for both visual Braille and Latin letters

For this study, we started from the observation that the poor adequacy of a script to the requirements of the human visual system strongly impacts some aspects of reading expertise (e.g., fluent reading). Here we investigated another of these aspects, namely the ability to break mirror invariance, which makes it hard for readers to ignore the mirrored contrasts of letters even if this hinders performance. In particular, we hypothesized that this ability would be preserved for the visually presented letters of the Braille alphabet despite their poor fit to the constraints of the human visual system, as it did for congenital Braille readers when they explored the same letters through the tactile modality (de Heering, Collignon, & Kolinsky, 2018). To test so, we measured visual Braille readers' mirror costs, indexing for their difficulty to consider mirrored items as identical compared to strictly identical items, for three materials: Braille letters, geometrical shapes and Latin letters, which invariant properties are typically considered as having been selected through cultural evolution because they match the requirements of the visual system. Contrary to people having never experienced Braille, Braille readers' mirror cost was of the same magnitude for Latin letters and Braille letters and steadily increased the more they had experience with the latter material. Both these costs were also stronger than what was observed for geometrical shapes. Overall these results suggest that the poor adequacy of the Braille alphabet to the visual system does not impede Braille readers to break mirror invariance for the Braille material.

Brain and Cognitive Mechanisms of Top–Down Attentional Control in a Multisensory World: Benefits of Electrical Neuroimaging

In real-world environments, information is typically multisensory, and objects are a primary unit of information processing. Object recognition and action necessitate attentional selection of task-relevant from among task-irrelevant objects. However, the brain and cognitive mechanisms governing these processes remain not well understood. Here, we demonstrate that attentional selection of visual objects is controlled by integrated top–down audiovisual object representations (“attentional templates”) while revealing a new brain mechanism through which they can operate. In multistimulus (visual) arrays, attentional selection of objects in humans and animal models is traditionally quantified via “the N2pc component”: spatially selective enhancements of neural processing of objects within ventral visual cortices at approximately 150–300 msec poststimulus. In our adaptation of Folk et al.'s [Folk, C. L., Remington, R. W., & Johnston, J. C. Involuntary covert orienting is contingent on attentional control settings. Journal of Experimental Psychology: Human Perception and Performance, 18, 1030–1044, 1992] spatial cueing paradigm, visual cues elicited weaker behavioral attention capture and an attenuated N2pc during audiovisual versus visual search. To provide direct evidence for the brain, and so, cognitive, mechanisms underlying top–down control in multisensory search, we analyzed global features of the electrical field at the scalp across our N2pcs. In the N2pc time window (170–270 msec), color cues elicited brain responses differing in strength and their topography. This latter finding is indicative of changes in active brain sources. Thus, in multisensory environments, attentional selection is controlled via integrated top–down object representations, and so not only by separate sensory-specific top–down feature templates (as suggested by traditional N2pc analyses). We discuss how the electrical neuroimaging approach can aid research on top–down attentional control in naturalistic, multisensory settings and on other neurocognitive functions in the growing area of real-world neuroscience.

Reading-Induced Shifts in Speech Perception in Dyslexic and Typically Reading Children

One of the proposed mechanisms underlying reading difficulties observed in developmental dyslexia is impaired mapping of visual to auditory speech representations. We investigate these mappings in 20 typically reading and 20 children with dyslexia aged 8–10 years using text-based recalibration. In this paradigm, the pairing of visual text and ambiguous speech sounds shifts (recalibrates) the participant’s perception of the ambiguous speech in subsequent auditory-only post-test trials. Recent research in adults demonstrated this text-induced perceptual shift in typical, but not in dyslexic readers. Our current results instead show significant text-induced recalibration in both typically reading children and children with dyslexia. The strength of this effect was significantly linked to the strength of perceptual adaptation effects in children with dyslexia but not typically reading children. Furthermore, additional analyses in a sample of typically reading children of various reading levels revealed a significant link between recalibration and phoneme categorization. Taken together, our study highlights the importance of considering dynamic developmental changes in reading, letter-speech sound coupling and speech perception when investigating group differences between typical and dyslexic readers.

Audiovisual Processing of Chinese Characters Elicits Suppression and Congruency Effects in MEG

Learning to associate written letters/characters with speech sounds is crucial for reading acquisition. Most previous studies have focused on audiovisual integration in alphabetic languages. Less is known about logographic languages such as Chinese characters, which map onto mostly syllable-based morphemes in the spoken language. Here we investigated how long-term exposure to native language affects the underlying neural mechanisms of audiovisual integration in a logographic language using magnetoencephalography (MEG). MEG sensor and source data from 12 adult native Chinese speakers and a control group of 13 adult Finnish speakers were analyzed for audiovisual suppression (bimodal responses vs. sum of unimodal responses) and congruency (bimodal incongruent responses vs. bimodal congruent responses) effects. The suppressive integration effect was found in the left angular and supramarginal gyri (205-365 ms), left inferior frontal and left temporal cortices (575-800 ms) in the Chinese group. The Finnish group showed a distinct suppression effect only in the right parietal and occipital cortices at a relatively early time window (285-460 ms). The congruency effect was only observed in the Chinese group in left inferior frontal and superior temporal cortex in a late time window (about 500-800 ms) probably related to modulatory feedback from multi-sensory regions and semantic processing. The audiovisual integration in a logographic language showed a clear resemblance to that in alphabetic languages in the left superior temporal cortex, but with activation specific to the logographic stimuli observed in the left inferior frontal cortex. The current MEG study indicated that learning of logographic languages has a large impact on the audiovisual integration of written characters with some distinct features compared to previous results on alphabetic languages.

The Functional Neuroanatomy of Letter-Speech Sound Integration and Its Relation to Brain Abnormalities in Developmental Dyslexia

This mini-review provides a comparison of the brain systems associated with developmental dyslexia and the brain systems associated with letter-speech sound (LSS) integration. First, the findings on the functional neuroanatomy of LSS integration are summarized in order to obtain a comprehensive overview of the brain regions involved in this process. To this end, neurocognitive studies investigating LSS integration in both normal and abnormal reading development are taken into account. The neurobiological basis underlying LSS integration is consequently compared with existing neurocognitive models of functional and structural brain abnormalities in developmental dyslexia-focusing on superior temporal and occipito-temporal (OT) key regions. Ultimately, the commonalities and differences between the brain systems engaged by LSS integration and the brain systems identified with abnormalities in developmental dyslexia are investigated. This comparison will add to our understanding of the relation between LSS integration and normal and abnormal reading development.

Lost in the forest? Global to local interference depends on children's reading skills

We studied the global precedence effect in primary school children with and without developmental dyslexia, using a compound figures task with familiar (Latin) or unfamiliar (Hebrew) letters. The two components of the global precedence effect were considered separately: global advantage (faster processing of global than local letters) and asymmetric interference (global distracters interfere with local targets but not vice versa). Both groups of children showed a global advantage with familiar as well as with unfamiliar letters. Children without developmental dyslexia showed asymmetric interference on familiar letters, but not on unfamiliar ones. Children with developmental dyslexia showed no asymmetric interference, neither for familiar letters nor for unfamiliar ones. The results distinguish between alternative hypothesis regarding the roles of familiarity and visual processing strategies in the compound figures task. Consequences for understanding literacy acquisition and developmental dyslexia are discussed.

Deficient Letter-Speech Sound Integration Is Associated With Deficits in Reading but Not Spelling

Efficient and automatic integration of letters and speech sounds is assumed to enable fluent word recognition and may in turn also underlie the build-up of high-quality orthographic representations, which are relevant for accurate spelling. While previous research showed that developmental dyslexia is associated with deficient letter-speech sound integration, these studies did not differentiate between subcomponents of literacy skills. In order to investigate whether deficient letter-speech sound integration is associated with deficits in reading and/or spelling, three groups of third graders were recruited: (1) children with combined deficits in reading and spelling (RSD, N = 10); (2) children with isolated spelling deficit (ISD, N = 17); and (3) typically developing children (TD, N = 21). We assessed the neural correlates (EEG) of letter-speech sound integration using a Stroop-like interference paradigm: participants had to decide whether two visually presented letters look identical. In case of non-identical letter pairs, conflict items were the same letter in lower and upper case (e.g., “T t”), while non-conflict items were different letters (e.g., “T k”). In terms of behavioral results, each of the three groups exhibited a comparable amount of conflict-related reaction time (RT) increase, which may be a sign for no general inhibitory deficits. Event-related potentials (ERPs), on the other hand, revealed group-based differences: the amplitudes of the centro-parietal conflict slow potential (cSP) were increased for conflicting items in typical readers as well as the ISD group. Preliminary results suggest that this effect was missing for children with RSD. The results suggest that deficits in automatized letter-speech sound associations are associated with reading deficit, but no impairment was observed in spelling deficit.

There's a SNARC in the Size Congruity Task

The size congruity effect involves interference between numerical magnitude and physical size of visually presented numbers: congruent numbers (either both small or both large in numerical magnitude and physical size) are responded to faster than incongruent ones (small numerical magnitude/large physical size or vice versa). Besides, numerical magnitude is associated with lateralized response codes, leading to the Spatial Numerical Association of Response Codes (SNARC) effect: small numerical magnitudes are preferably responded to on the left side and large ones on the right side. Whereas size congruity effects are ascribed to interference between stimulus dimensions in the decision stage, SNARC effects are understood as (in)compatibilities in stimulus-response combinations. Accordingly, size congruity and SNARC effects were previously found to be independent in parity and in physical size judgment tasks. We investigated their dependency in numerical magnitude judgment tasks. We obtained independent size congruity and SNARC effects in these tasks and replicated this observation for the parity judgment task. The results confirm and extend the notion that size congruity and SNARC effects operate in different representational spaces. We discuss possible implications for number representation.

Orthographic-Phonological Mapping and the Emergence of Visual Expertise for Print: A Developmental Event-Related Potential Study

The N1 effect is an electrophysiological marker of visual specialization for print. The phonological mapping hypothesis (Maurer & McCandliss, 2007) posits that the left-lateralized effect reflects grapheme-phoneme integration. In this event-related potential study, first (age = 7.06 years, N = 32) and third-grade readers (age = 9.29 years, N = 28) were presented with pairs of pseudowords and Armenian character strings in a novel implicit same-different paradigm. To test the phonological mapping hypothesis, stimuli were presented in visual-only and audiovisual conditions. The results demonstrated that tuning for print already emerges in first grade. Moreover, the parallel presentation of auditory stimuli enhanced the N1 effect suggesting a role of orthographic-phonological mapping in the development of specialization for print.

Letter-sound integration in native Chinese speakers learning English: Brain fails in automatic responses but succeeds with more attention

Both native language background and second-language proficiency may shape brain responses to a second language. Using cross-modal mismatch negativity (MMN) (pre-attentive processing) and audiovisual P300 (attentive processing) paradigms, this study examined how native Chinese speakers with various second-language proficiency responded to English letter-sound integration and what role visual attention may play in this process. The results indicated that native Chinese speakers failed to integrate letters and sounds in pre-attentive stage of reading, regardless of their English proficiency level, in contrast to the successful letter-sound integration shown by native English speakers. With more explicit visual attention resources, native Chinese speakers integrated English letters and sounds just as successfully as native English speakers did. These findings suggest that native language background may exert profound constraints on automatic brain responses to a second language, and attention may help the brain overcome these constraints and respond as required by the second language.

Letter and Speech Sound Association in Emerging Readers With Familial Risk of Dyslexia

In alphabetic scripts, learning letter-sound (LS) association (i.e., letter knowledge) is a strong predictor of later reading skills. LS integration is related to left superior temporal cortex (STC) activity and its disruption was previously observed in dyslexia (DYS). Whether disruption in LS association is a cause of reading impairment or a consequence of decreased exposure to print remains unclear. Using fMRI, we compared activation for letters, speech sounds and LS association in emerging readers with (FHD+, N = 50) and without (FHD-, N = 35) familial history of DYS, out of whom 17 developed DYS 2 years later. Despite having similar reading skills, FHD+ and FHD- groups showed opposite pattern of activation in left STC: In FHD- children activation was higher for incongruent compared to congruent, whereas in FHD+ it was higher for congruent LS pairs. Higher activation to congruent LS pairs was also characteristic of future DYS. The magnitude of incongruency effect in left STC was positively related to early reading skills, but only in FHD- children and (retrospectively) in typical readers. We show that alterations in brain activity during LS association can be detected at very early stages of reading acquisition, suggesting their causal involvement in later reading impairments. Increased response of left STC to incongruent LS pairs in FHD- group might reflect an early stage of automatizing LS associations, where the brain responds actively to conflicting pairs. The absence of such response in FHD+ children could lead to failures in suppressing incongruent information during reading acquisition, which could result in future reading problems.

Grapheme-Phoneme Learning in an Unknown Orthography: A Study in Typical Reading and Dyslexic Children

In this study, we examined the learning of new grapheme-phoneme correspondences in individuals with and without dyslexia. Additionally, we investigated the relation between grapheme-phoneme learning and measures of phonological awareness, orthographic knowledge and rapid automatized naming, with a focus on the unique joint variance of grapheme-phoneme learning to word and non-word reading achievement. Training of grapheme-phoneme associations consisted of a 20-min training program in which eight novel letters (Hebrew) needed to be paired with speech sounds taken from the participant's native language (Dutch). Eighty-four third grade students, of whom 20 were diagnosed with dyslexia, participated in the training and testing. Our results indicate a reduced ability of dyslexic readers in applying newly learned grapheme-phoneme correspondences while reading words which consist of these novel letters. However, we did not observe a significant independent contribution of grapheme-phoneme learning to reading outcomes. Alternatively, results from the regression analysis indicate that failure to read may be due to differences in phonological and/or orthographic knowledge but not to differences in the grapheme-phoneme-conversion process itself.

Brain Responses to Letters and Speech Sounds and Their Correlations With Cognitive Skills Related to Reading in Children

Letter-speech sound (LSS) integration is crucial for initial stages of reading acquisition. However, the relationship between cortical organization for supporting LSS integration, including unimodal and multimodal processes, and reading skills in early readers remains unclear. In the present study, we measured brain responses to Finnish letters and speech sounds from 29 typically developing Finnish children in a child-friendly audiovisual integration experiment using magnetoencephalography. Brain source activations in response to auditory, visual and audiovisual stimuli as well as audiovisual integration response were correlated with reading skills and cognitive skills predictive of reading development after controlling for the effect of age. Regression analysis showed that from the brain measures, the auditory late response around 400 ms showed the largest association with phonological processing and rapid automatized naming abilities. In addition, audiovisual integration effect was most pronounced in the left and right temporoparietal regions and the activities in several of these temporoparietal regions correlated with reading and writing skills. Our findings indicated the important role of temporoparietal regions in the early phase of learning to read and their unique contribution to reading skills.