Development of neural specialization for print: Evidence for predictive coding in visual word recognition

Expectation Modulates Repetition Suppression at Late But Not Early Stages during Visual Word Recognition: Evidence from Event-related Potentials

Visual word recognition is commonly rapid and efficient, incorporating top-down predictive processing mechanisms. Neuroimaging studies with face stimuli suggest that repetition suppression (RS) reflects predictive processing at the neural level, as this effect is larger when repetitions are more frequent, that is, more expected. It remains unclear, however, at the temporal level whether and how RS and its modulation by expectation occur in visual word recognition. To address this gap, the present study aimed to investigate the presence and time course of these effects during visual word recognition using EEG. Thirty-six native Cantonese speakers were presented with pairs of Chinese written words and performed a nonlinguistic oddball task. The second word of a pair was either a repetition of the first or a different word (alternation). In repetition blocks, 75% of trials were repetitions and 25% were alternations, whereas the reverse was true in alternation blocks. Topographic analysis of variance of EEG at each time point showed robust RS effects in three time windows (141-227 msec, 242-445 msec, and 467-513 msec) reflecting facilitation of visual word recognition. Importantly, the modulation of RS by expectation was observed at the late rather than early intervals (334-387 msec, 465-550 msec, and 559-632 msec) and more than 100 msec after the first RS effects. In the predictive coding view of RS, only late repetition effects are modulated by expectation, whereas early RS effects may be mediated by lower-level predictions. Taken together, our findings provide the first EEG evidence revealing distinct temporal dynamics of RS effects and repetition probability on RS effects in visual processing of Chinese words.

Unraveling individual differences in learning potential: A dynamic framework for the case of reading development

Children show an enormous capacity to learn during development, but with large individual differences in the time course and trajectory of learning and the achieved skill level. Recent progress in developmental sciences has shown the contribution of a multitude of factors including genetic variation, brain plasticity, socio-cultural context and learning experiences to individual development. These factors interact in a complex manner, producing children's idiosyncratic and heterogeneous learning paths. Despite an increasing recognition of these intricate dynamics, current research on the development of culturally acquired skills such as reading still has a typical focus on snapshots of children's performance at discrete points in time. Here we argue that this 'static' approach is often insufficient and limits advancements in the prediction and mechanistic understanding of individual differences in learning capacity. We present a dynamic framework which highlights the importance of capturing short-term trajectories during learning across multiple stages and processes as a proxy for long-term development on the example of reading. This framework will help explain relevant variability in children's learning paths and outcomes and fosters new perspectives and approaches to study how children develop and learn.

Seeking the neural representation of statistical properties in print during implicit processing of visual words

Statistical learning (SL) plays a key role in literacy acquisition. Studies have increasingly revealed the influence of distributional statistical properties of words on visual word processing, including the effects of word frequency (lexical level) and mappings between orthography, phonology, and semantics (sub-lexical level). However, there has been scant evidence to directly confirm that the statistical properties contained in print can be directly characterized by neural activities. Using time-resolved representational similarity analysis (RSA), the present study examined neural representations of different types of statistical properties in visual word processing. From the perspective of predictive coding, an equal probability sequence with low built-in prediction precision and three oddball sequences with high built-in prediction precision were designed with consistent and three types of inconsistent (orthographically inconsistent, orthography-to-phonology inconsistent, and orthography-to-semantics inconsistent) Chinese characters as visual stimuli. In the three oddball sequences, consistent characters were set as the standard stimuli (probability of occurrence p = 0.75) and three types of inconsistent characters were set as deviant stimuli (p = 0.25), respectively. In the equal probability sequence, the same consistent and inconsistent characters were presented randomly with identical occurrence probability (p = 0.25). Significant neural representation activities of word frequency were observed in the equal probability sequence. By contrast, neural representations of sub-lexical statistics only emerged in oddball sequences where short-term predictions were shaped. These findings reveal that the statistical properties learned from long-term print environment continues to play a role in current word processing mechanisms and these mechanisms can be modulated by short-term predictions.

Neural Specialization for English and Arabic Print in Early Readers

Learning to read requires the specialization of a region in the left fusiform gyrus known as the visual word form area (VWFA). This region, which initially responds to faces and objects, develops specificity for print over a long trajectory of instruction and practice. VWFA neurons may be primed for print because of their pre-literate tuning properties, becoming specialized through top-down feedback mechanisms during learning. However, much of what is known about the VWFA comes from studies of Western orthographies, whose alphabets share common visual characteristics. Far less is known about the development of the VWFA for Arabic, which is a complex orthography and is significantly more difficult to achieve fluency in in reading. In the current study, electroencephalography responses were collected from first grade children in the United Arab Emirates learning to read in both English and Arabic. Children viewed words and false font strings in English and Arabic while performing a vigilance task. The P1 and N1 responses to all stimulus categories were quantified in two occipital and two parietal electrodes as well as the alpha band signal across all four electrodes of interest. Analysis revealed a significantly stronger N1 response to English compared to Arabic and decreased alpha power to Arabic compared to English. These findings suggest a fundamental difference in neural plasticity for these two distinct orthographies, even when instruction is concurrent. Future work is needed to determine whether VWFA specialization for Arabic takes longer than more well-studied orthographies and if differences in reading instruction approaches help accelerate this process.

Neural specialization to English words in Chinese children: Joint contribution of age and English reading abilities

N1 tuning to words, a neural marker of visual word recognition, develops by an interaction between age and ability. The development of N1 tuning to a second learnt print is unclear. The present study examined the joint contribution of age and English reading abilities to N1 amplitude and tuning to English print in Chinese children in Hong Kong. EEG signals were recorded from 179 children (six to nine years old) while they were performing a repetition detection task comprised of different print stimuli measuring three types of tuning, i.e., coarse tuning (real word versus false font), fine tuning (real versus nonword), and lexicality effect (real versus pseudo word). Children were assessed in English word reading accuracy (EWR) and English sub-lexical orthographic knowledge (EOK). Results indicated that coarse tuning decreased with age but increased with EWR and EOK. Fine tuning uniquely increased with EOK, and the lexicality effect increased with EWR. At last, higher EWR was linked to less right-lateralized coarse tuning in younger children. Taken together, the findings support the visual perceptual expertise account in the L2 context, in that N1 coarse tuning, fine tuning, and lexicality effect are driven by skill improvement.

Lexical and sublexical cortical tuning for print revealed by Steady-State Visual Evoked Potentials (SSVEPs) in early readers

There are multiple levels of processing relevant to reading that vary in their visual, sublexical, and lexical orthographic processing demands. Segregating distinct cortical sources for each of these levels has been challenging in EEG studies of early readers. To address this challenge, we applied recent advances in analyzing high-density EEG using Steady-State Visual Evoked Potentials (SSVEPs) via data-driven Reliable Components Analysis (RCA) in a group of early readers spanning from kindergarten to second grade. Three controlled stimulus contrasts-familiar words versus unfamiliar pseudofonts, familiar words versus pseudowords, and pseudowords versus nonwords-were used to isolate coarse print tuning, lexical processing, and sublexical orthography-related processing, respectively. First, three overlapping yet distinct neural sources-left vOT, dorsal parietal, and primary visual cortex were revealed underlying coarse print tuning. Second, we segregated distinct cortical sources for the other two levels of processing: lexical fine tuning over occipito-temporal/parietal regions; sublexical orthographic fine tuning over left occipital regions. Finally, exploratory group analyses based on children's reading fluency suggested that coarse print tuning emerges early even in children with limited reading knowledge, while sublexical and higher-level lexical processing emerge only in children with sufficient reading knowledge. RESEARCH HIGHLIGHTS: Cognitive processes underlying coarse print tuning, sublexical, and lexical fine tuning were examined in beginning readers. Three overlapping yet distinct neural sources-left ventral occipito-temporal (vOT), left temporo-parietal, and primary visual cortex-were revealed underlying coarse print tuning. Responses to sublexical orthographic fine tuning were found over left occipital regions, while responses to higher-level linguistic fine tuning were found over occipito-temporal/parietal regions. Exploratory group analyses suggested that coarse print tuning emerges in children with limited reading knowledge, while sublexical and higher-level linguistic fine tuning effects emerge in children with sufficient reading knowledge.

Neurodevelopmental trajectories of letter and speech sound processing from preschool to the end of elementary school

Learning to read alphabetic languages starts with learning letter-speech-sound associations. How this process changes brain function during development is still largely unknown. We followed 102 children with varying reading skills in a mixed-longitudinal/cross-sectional design from the prereading stage to the end of elementary school over five time points (n = 46 with two and more time points, of which n = 16 fully-longitudinal) to investigate the neural trajectories of letter and speech sound processing using fMRI. Children were presented with letters and speech sounds visually, auditorily, and audiovisually in kindergarten (6.7yo), at the middle (7.3yo) and end of first grade (7.6yo), and in second (8.4yo) and fifth grades (11.5yo). Activation of the ventral occipitotemporal cortex for visual and audiovisual processing followed a complex trajectory, with two peaks in first and fifth grades. The superior temporal gyrus (STG) showed an inverted U-shaped trajectory for audiovisual letter processing, a development that in poor readers was attenuated in middle STG and absent in posterior STG. Finally, the trajectories for letter-speech-sound integration were modulated by reading skills and showed differing directionality in the congruency effect depending on the time point. This unprecedented study captures the development of letter processing across elementary school and its neural trajectories in children with varying reading skills.

Visual event-related potentials reveal the early whole-word lexical processing of Chinese two-character words

Morphologically complex words are common across different languages, especially in Chinese, because more than 90% of common modern Chinese words are complex words. Many behavioral studies have suggested the whole-word processing of Chinese complex words, but the neural correlates of whole-word processing remain unclear. Previous electrophysiological studies revealed automatic and early (∼250 ms) access to the orthographic forms of monomorphic words in the ventral occipitotemporal area. In this study, we investigated whether there is also automatic and early orthographic recognition of Chinese complex words (as whole units) by recording event-related potentials (ERPs). A total of 150 two-character words and 150 two-character pseudowords composed of the same 300 characters (morphemes) were pseudorandomly presented to proficient Chinese readers. Participants were required to determine the color of each stimulus in the color decision task and to determine whether each stimulus was a word in the lexical decision task. The two constituent characters of each stimulus were horizontally arranged in Experiment 1 and vertically arranged in Experiment 2. The results revealed a significant early ERP difference between words and pseudowords approximately 250-300 ms after stimulus onset in the parieto-occipital scalp region. The early ERP difference was more prominent in the color decision task than in the lexical decision task, more prominent in Experiment 1 than in Experiment 2, and more prominent in the left parieto-occipital scalp region than in the right. Source analysis results showed that the early ERP difference originated from the left ventral occipitotemporal cortex. These results reflected early and automatic access to whole-word orthographic representations of Chinese complex words in the left ventral occipitotemporal cortex.

Neural correlates of visual acuity for fine text

Human sensitivity to visual input often scales with the magnitude of evoked responses in the brain. Here, we demonstrate an exception. We record electroencephalography (EEG) while people attempt to resolve fine print - similar to people attempting to read eye charts (the world's most popular means of testing vision). We find that the ability to resolve fine print is associated with smaller evoked responses recorded by large clusters of occipital-parietal sensors ∼150 ms after people see words. Moreover, we find that a better ability to resolve fine print is associated with enhanced alpha-band oscillatory brain activity immediately prior to word presentations. These investigations were inspired by psychophysical data, which suggested the ability to resolve fine print can be enhanced by pre-adaptation to flicker, which should encourage a reduced neural response to inputs. We included this manipulation in this study, and our results are broadly consistent with this conjecture. As alpha-band activity has been linked to inhibitory interactions in visual cortex, we regard our data as evidence that smaller neural responses to fine print can be promoted by inhibitory processes that target unhelpful blur-related signals, which thereby sharpen subsequent visual experiences.

Disentangling influences of dyslexia, development, and reading experience on effective brain connectivity in children

Altered brain connectivity between regions of the reading network has been associated with reading difficulties. However, it remains unclear whether connectivity differences between children with dyslexia (DYS) and those with typical reading skills (TR) are specific to reading impairments or to reading experience. In this functional MRI study, 132 children (M = 10.06 y, SD = 1.46) performed a phonological lexical decision task. We aimed to disentangle (1) disorder-specific from (2) experience-related differences in effective connectivity and to (3) characterize the development of DYS and TR. We applied dynamic causal modeling to age-matched (n_dys = 25, n_TR = 35) and reading-level-matched (n_dys = 25, n_TR = 22) groups. Developmental effects were assessed in beginning and advanced readers (TR: n_beg = 48, n_adv = 35, DYS: n_beg = 24, n_adv = 25). We show that altered feedback connectivity between the inferior parietal lobule and the visual word form area (VWFA) during print processing can be specifically attributed to reading impairments, because these alterations were found in DYS compared to both the age-matched and reading-level-matched TR. In contrast, feedforward connectivity from the VWFA to parietal and frontal regions characterized experience in TR and increased with age and reading skill. These directed connectivity findings pinpoint disorder-specific and experience-dependent alterations in the brain's reading network.

Early lexical processing of Chinese one-character words and Mongolian words: A comparative study using event-related potentials

Logographic language and alphabetic language differ significantly in orthography. Investigating the commonality and particularity of visual word recognition between the two distinct writing systems is informative for understating the neural mechanisms underlying visual word recognition. In the present study, we compared the chronometry of early lexical processing and the brain regions involved in early lexical processing between Chinese (logographic language) and Mongolian (alphabetic language) by recording event-related potentials (ERPs) using both implicit and explicit reading tasks. Familiar Chinese one-character words (lexical) and unknown Chinese one-character words (non-lexical) were pseudorandomly presented to native Chinese readers in Experiment 1. Mongolian words (lexical) and pseudowords (non-lexical) were pseudorandomly presented to native Mongolian readers in Experiment 2. In the color decision task, participants were asked to decide the color (black or blue) of each stimulus. In the lexical recognition task, participants were asked to report whether they could recognize each stimulus. The results showed that in both experiments and both tasks, ERPs to lexical items differed significantly from those to non-lexical items in the parietooccipital scalp region approximately 250 ms after stimulus onset, reflecting the early lexical processing, which likely originated from the ventral occipitotemporal cortex as revealed by source analysis. These results indicated that although Chinese and Mongolian differed markedly in orthographic features, the neural mechanisms underlying early lexical processing are similar between the two languages.

Neural attenuation: age-related dedifferentiation in the left occipitotemporal cortex for visual word processing

The present study investigated the age-related neural basis of cognitive decline in the left ventral occipitotemporal cortex (vOT)-a brain area that responds selectively to visual words processing. Functional magnetic resonance imaging was used to estimate neural activity in this area, while young and old adults viewed words and line drawings. Our results demonstrated the existence of neural dedifferentiation of the left vOT in old adults during visual word processing. More specifically, this dedifferentiation was due to neural attenuation that is, decreased response to words rather than increased response to line drawings in old adults compared with young adults. In addition, individuals who showed decreased neural response to words had worse performance in visual word processing. Taken together, our findings support the neural attenuation hypothesis for the cognitive decline in visual word processing in old adults.

Typical and Atypical Development of Visual Expertise for Print as Indexed by the Visual Word N1 (N170w): A Systematic Review

The visual word N1 (N170w) is an early brain ERP component that has been found to be a neurophysiological marker for print expertise, which is a prelexical requirement associated with reading development. To date, no other review has assimilated existing research on reading difficulties and atypical development of processes reflected in the N170w response. Hence, this systematic review synthesized results and evaluated neurophysiological and experimental procedures across different studies about visual print expertise in reading development. Literature databases were examined for relevant studies from 1995 to 2020 investigating the N170w response in individuals with or without reading disorders. To capture the development of the N170w related to reading, results were compared between three different age groups: pre-literate children, school-aged children, and young adults. The majority of available N170w studies (N = 69) investigated adults (n = 31) followed by children (school-aged: n = 21; pre-literate: n = 4) and adolescents (n = 1) while some studies investigated a combination of these age groups (n = 12). Most studies were conducted with German-speaking populations (n = 17), followed by English (n = 15) and Chinese (n = 14) speaking participants. The N170w was primarily investigated using a combination of words, pseudowords, and symbols (n = 20) and mostly used repetition-detection (n = 16) or lexical-decision tasks (n = 16). Different studies posed huge variability in selecting electrode sites for analysis; however, most focused on P7, P8, and O1 sites of the international 10–20 system. Most of the studies in adults have found a more negative N170w in controls than poor readers, whereas in children, the results have been mixed. In typical readers, N170w ranged from having a bilateral distribution to a left-hemispheric dominance throughout development, whereas in young, poor readers, the response was mainly right-lateralized and then remained in a bilateral distribution. Moreover, the N170w latency has varied according to age group, with adults having an earlier onset yet with shorter latency than school-aged and pre-literate children. This systematic review provides a comprehensive picture of the development of print expertise as indexed by the N170w across age groups and reading abilities and discusses theoretical and methodological differences and challenges in the field, aiming to guide future research.

Level of Orthographic Knowledge Helps to Reveal Automatic Predictions in Visual Word Processing

The brain generates predictions about visual word forms to support efficient reading. The “interactive account” suggests that the predictions in visual word processing can be strategic or automatic (non-strategic). Strategic predictions are frequently demonstrated in studies that manipulated task demands, however, few studies have investigated automatic predictions. Orthographic knowledge varies greatly among individuals and it offers a unique opportunity in revealing automatic predictions. The present study grouped the participants by level of orthographic knowledge and recorded EEGs in a non-linguistic color matching task. The visual word-selective N170 response was much stronger to pseudo than to real characters in participants with low orthographic knowledge, but not in those with high orthographic knowledge. Previous work on predictive coding has demonstrated that N170 is a good index for prediction errors, i.e., the mismatches between predictions and visual inputs. The present findings provide unambiguous evidence that automatic predictions modulate the early stage of visual word processing.

Visual event-related potentials reveal the early lexical processing of Chinese characters

Logographic scripts such as Chinese differ markedly from alphabetic scripts. The time-course of the lexical processing of alphabetic words was widely studied by recording event-related potentials (ERPs), and the results indicated that alphabetic words are rapidly and automatically processed. This study investigated whether there is also rapid and automatic lexical processing of Chinese characters by recording ERPs. High-frequency (HF) characters and orthographically similar low-frequency (LF) characters were pseudo-randomly presented to proficient Chinese readers. The color of half of the characters was blue and the color of the other half was black. In the color decision task, participants were asked to determine the color of each character. In the lexical recognition task, participants were asked to report whether s/he knew each character (the LF characters in this study were very rare characters which were usually not recognized by proficient Chinese readers). In both tasks, the N170 elicited by HF characters peaked earlier than the N170 elicited by LF characters in the right parieto-occipital area (PO8), and the ERPs to HF characters diverged from the ERPs to LF characters around 210-222 ms after the stimulus onset. These results reflected the rapid and automatic lexical processing of Chinese characters. Source analysis results suggested that the left and the right occipitotemporal cortices and the right visual cortex were the neural origins of the early lexical processing of Chinese characters, and the peak activation was in the right visual cortex.

Distinct neural sources underlying visual word form processing as revealed by steady state visual evoked potentials (SSVEP)

EEG has been central to investigations of the time course of various neural functions underpinning visual word recognition. Recently the steady-state visual evoked potential (SSVEP) paradigm has been increasingly adopted for word recognition studies due to its high signal-to-noise ratio. Such studies, however, have been typically framed around a single source in the left ventral occipitotemporal cortex (vOT). Here, we combine SSVEP recorded from 16 adult native English speakers with a data-driven spatial filtering approach—Reliable Components Analysis (RCA)—to elucidate distinct functional sources with overlapping yet separable time courses and topographies that emerge when contrasting words with pseudofont visual controls. The first component topography was maximal over left vOT regions with a shorter latency (approximately 180 ms). A second component was maximal over more dorsal parietal regions with a longer latency (approximately 260 ms). Both components consistently emerged across a range of parameter manipulations including changes in the spatial overlap between successive stimuli, and changes in both base and deviation frequency. We then contrasted word-in-nonword and word-in-pseudoword to test the hierarchical processing mechanisms underlying visual word recognition. Results suggest that these hierarchical contrasts fail to evoke a unitary component that might be reasonably associated with lexical access.

Resting state EEG network modularity predicts literacy skills in L1 Chinese but not in L2 English

EEG network modularity, as a proxy for cognitive plasticity, has been proposed to be a more reliable neural marker than power and coherence in predicting learning outcomes. The present study examined the associations between resting state EEG network modularity and both L1 Chinese and L2 English literacy skills among 90 Hong Kong first to fifth graders. The modularity indices of different frequency bands were highly correlated with one another. An exploratory factor analysis, performed to extract a general modularity index, explained 77.1% of the total variance. The modularity index was positively associated with Chinese word reading, Chinese phonological awareness, Chinese morphological awareness, and Chinese reading comprehension but was not significantly correlated with English word reading or English morphological awareness. Findings suggest that resting state EEG network modularity is likely to serve as a reasonable, reliable, and cost-effective neural marker of the development of first language but not second language literacy skills.

The rise and fall of rapid occipito-temporal sensitivity to letters: Transient specialization through elementary school

Letters, foundational units of alphabetic writing systems, are quintessential to human culture. The ability to read, indispensable to perform in today’s society, necessitates a reorganization of visual cortex for fast letter recognition, but the developmental course of this process has not yet been characterized. Here, we show the emergence of visual sensitivity to letters across five electroencephalography measurements from kindergarten and throughout elementary school and relate this development to emerging reading skills. We examined the visual N1, the electrophysiological correlate of ventral occipito-temporal cortex activation in 65 children at varying familial risk for dyslexia. N1 letter sensitivity emerged in first grade, when letter sound knowledge gains were most pronounced and decayed shortly after when letter knowledge is consolidated, showing an inverted U-shaped development. This trajectory can be interpreted within an interactive framework that underscores the influence of top-down predictions. While the N1 amplitudes to letters correlated with letter sound knowledge at the beginning of learning, no association between the early N1 letter response and later reading skills was found. In summary, the current findings provide an important reference point for our neuroscientific understanding of learning trajectories and the process of visual specialization during skill learning.

Electroencephalography decoding of Chinese characters in primary school children and its prediction for word reading performance and development

Research on what neural mechanisms facilitate word reading development in non-alphabetic scripts is relatively rare. The present study was among the first to adopt a multivariate pattern classification analysis to decode electroencephalographic signals recorded for primary school children (N = 236) while performing a Chinese character decision task. Chinese is an ideal script for studying the relationship between neural discriminability (i.e., decodability) of the orthography and behavioral word reading skills since the mapping from orthography to phonology is relatively arbitrary in Chinese. This was also among the first empirical attempts to examine the extent to which decoding performance can predict current and subsequent word reading skills using a longitudinal design. Results showed that neural activation patterns of real characters can be distinguished from activation patterns for pseudo-characters, non-characters, and random stroke combinations in both younger and older children. Topography of the transformed classifier weights revealed two distinct cognitive sub-processes underlying single character recognition, but temporal generalization analysis suggested common neural mechanisms between the distinct cognitive sub-processes. Suggestive evidence from correlational and hierarchical regression analyses showed that decoding performance, assessed on average 2 months before the year 2 behavioral testing, predicted both year 1 word reading performance and the development of word reading fluency over the year. Results demonstrate that decoding performance, one indicator of how the neural system is functionally organized in processing characters and character-like stimuli, can serve as a useful neural marker in predicting current word reading skills and the capacity to learn to read.