Word segmentation by alternating colors facilitates eye guidance in Chinese reading

The role of syllables and morphemes in silent reading: An eye-tracking study

German skilled readers have been found to engage in morphological and syllable-based processing in visual word recognition. However, the relative reliance on syllables and morphemes in reading multi-syllabic complex words is still unresolved. This study aimed to unveil which of these sublexical units are the preferred units of reading by employing eye-tracking technology. Participants silently read sentences while their eye-movements were recorded. Words were visually marked using colour alternation (Experiment 1) or hyphenation (Experiment 2)-at syllable boundary (e.g., Kir-schen), at morpheme boundary (e.g., Kirsch-en), or within the units themselves (e.g., Ki-rschen). A control condition without disruptions was used as a baseline (e.g., Kirschen). The results of Experiment 1 showed that eye-movements were not modulated by colour alternations. The results of Experiment 2 indicated that hyphens disrupting syllables had a larger inhibitory effect on reading times than hyphens disrupting morphemes, suggesting that eye-movements in German skilled readers are more influenced by syllabic than morphological structure.

Fixation-related fMRI analysis reveals the neural basis of natural reading of unspaced and spaced Chinese sentences

Although there are many eye-movement studies focusing on natural sentence reading and functional magnetic resonance imaging research on reading with serial visual presentation paradigms, there is a scarcity of investigations into the neural mechanism of natural sentence reading. The present study recruited 33 adults to read unspaced and spaced Chinese sentences with the eye tracking and functional magnetic resonance imaging data recorded simultaneously. By using fixation-related functional magnetic resonance imaging analysis, this study showed that natural reading of Chinese sentences produced activations in ventral visual, dorsal attention, and semantic brain regions, which were modulated by the properties of words such as word length and word frequency. The multivoxel pattern analysis showed that the activity pattern in the left middle temporal gyrus could significantly predict the visual layout categories (i.e. unspaced vs. spaced conditions). Dynamic causal modeling analysis showed that there were bidirectional brain connections between the left middle temporal gyrus and the left inferior occipital cortex in the unspaced Chinese sentence reading but not in the spaced reading. These results provide a neural mechanism for the natural reading of Chinese sentences from the perspective of word segmentation.

Joint effects of individual reading skills and word properties on Chinese children's eye movements during sentence reading

Word recognition during the reading of continuous text has received much attention. While a large body of research has investigated how linguistic properties of words affect eye movements during reading, it remains to be established how individual differences in reading skills affect momentary cognitive processes during sentence reading among typically developing Chinese readers. The present study set out to test the joint influences of word properties and individual reading skills on eye movements during reading among Chinese children. We recorded eye movements of 30 grade 3 (G3) children and 27 grade 5 (G5) children when they read sentences silently for comprehension. Predictors of linear mixed models included word frequency, visual complexity, and launch site distance, in addition to the participants' offline psychometric performances in rapid naming, morphological awareness, word segmenting, and character recognition. The results showed that word properties affected word recognition during sentence reading in both G3 and G5 children. Moreover, word segmenting predicted the G3 children's fixation durations and the G5 children's fixation location, whereas rapid naming predicted the G5 children's fixation duration. Implications are discussed based on the current findings, in light of how different literacy skills contribute to reading development.

Visual event-related potentials reveal the early whole-word lexical processing of Chinese two-character words

Morphologically complex words are common across different languages, especially in Chinese, because more than 90% of common modern Chinese words are complex words. Many behavioral studies have suggested the whole-word processing of Chinese complex words, but the neural correlates of whole-word processing remain unclear. Previous electrophysiological studies revealed automatic and early (∼250 ms) access to the orthographic forms of monomorphic words in the ventral occipitotemporal area. In this study, we investigated whether there is also automatic and early orthographic recognition of Chinese complex words (as whole units) by recording event-related potentials (ERPs). A total of 150 two-character words and 150 two-character pseudowords composed of the same 300 characters (morphemes) were pseudorandomly presented to proficient Chinese readers. Participants were required to determine the color of each stimulus in the color decision task and to determine whether each stimulus was a word in the lexical decision task. The two constituent characters of each stimulus were horizontally arranged in Experiment 1 and vertically arranged in Experiment 2. The results revealed a significant early ERP difference between words and pseudowords approximately 250-300 ms after stimulus onset in the parieto-occipital scalp region. The early ERP difference was more prominent in the color decision task than in the lexical decision task, more prominent in Experiment 1 than in Experiment 2, and more prominent in the left parieto-occipital scalp region than in the right. Source analysis results showed that the early ERP difference originated from the left ventral occipitotemporal cortex. These results reflected early and automatic access to whole-word orthographic representations of Chinese complex words in the left ventral occipitotemporal cortex.

Eye movement control in reading Chinese: A matter of strength of character?

This paper explores the processes underlying eye movement control in Chinese reading among a population of young 4th and 5th grade readers. Various proposals to explain the underlying mechanisms involved in eye movement control are examined and the paper concludes that the most likely account is of a two-factor process whereby the character is the main driver for longer saccades and that the word plays a role in shorter ones. A computational model is proposed to provide an integrated account of the dynamic interaction of these two factors.

An ERP megastudy of Chinese word recognition

This article reports the first ERP (event-related potential) megastudy in traditional Chinese word recognition. Fifty-one native Chinese undergraduates in Hong Kong, who were native Cantonese speakers, provided ERP data to 1020 two-character words and 204 two-character pseudowords in a go/no-go lexical decision task (go trials: pseudowords). The item list and the ERP data were compiled into a database called "E-MELD" (ERP MEgastudy of Lexical Decision). To illustrate how E-MELD can be utilized in research of traditional Chinese word recognition, a series of linear mixed-effects (LME) models were conducted to examine how properties at word (contextual diversity, number of strokes, and concreteness) and character (contextual diversity, number of homophones, and semantic transparency ratings) levels influenced the ERP amplitudes in different time windows. The results showed that in all time windows, both word and character variables influenced the amplitudes of ERP signals, which argued against the proposal that Chinese two-character words are recognized holistically. At the same time, there was no evidence that character effects preceded word effects (i.e., no evidence of character-mediated word recognition). Overall, the pattern suggests that characters and words are accessed simultaneously in Chinese word recognition. E-MELD is made available online, such that interested researchers can download it and use the data innovatively for their research purpose.

Effects of Spacing on Sentence Reading in Chinese

Given that Chinese writing conventions lack inter-word spacing, understanding whether and how readers of Chinese segment regular unspaced Chinese writing into words is an important question for theories of reading. This study examined the processing outcomes of introducing spaces to written Chinese sentences in varying positions based on native speaker consensus. The measure of consensus for every character transition in our stimuli sentences was the percent of raters who placed a word boundary in that position. The eye movements of native readers of Chinese were recorded while they silently read original unspaced sentences and their experimentally manipulated counterparts for comprehension. We introduced two types of spaced sentences: one with spaces inserted at every probable word boundary (heavily spaced), and another with spaces placed only at highly probable word boundaries (lightly spaced). Linear mixed-effects regression models showed that heavily spaced sentences took identical time to read as unspaced ones despite the shortened fixation times on individual words (Experiment 1). On the other hand, reading times for lightly spaced sentences and words were shorter than those for unspaced ones (Experiment 2). Thus, spaces proved to be advantageous but only when introduced at highly probable word boundaries. We discuss methodological and theoretical implications of these findings.

The Beijing Sentence Corpus: A Chinese sentence corpus with eye movement data and predictability norms

This report introduces the Beijing Sentence Corpus (BSC). This is a Chinese sentence corpus of eye-tracking data with relatively clear word boundaries. In addition, we report predictability norms for each word in the corpus. Eye movement corpora are available in alphabetic scripts such as English, German, and French. However, there is no publicly available corpus for Chinese. Thus, to study predictive processes during reading in Chinese, it is necessary to establish such a corpus. Also, given the clear word boundaries in the sentences, BSC is especially useful to provide evidence relevant to the theoretical debate of saccade target selection in Chinese. With the large-scale predictability norms, we conducted new analyses based on 60 BSC readers, testing the influences of launch word and target word properties while controlling for visual and oculomotor constraints, as well as sentence and subject-level individual differences. We discuss implications for guidance of eye movements in Chinese reading.

Eye-movement control during learning and scanning of English pseudoword stimuli: Exposure frequency effects and spacing effects in a visual search task

Wang et al. (Attention, Perception, and Psychophysics, in press, 2021) reported a Landolt-C learning and scanning experiment. In a learning session, they simulated exposure frequency effects successfully by training participants to learn target Landolt-C clusters with different exposures. The rate of learning high-frequency (HF) targets were greater than that of learning low-frequency (LF) targets. In a subsequent scanning session, participants were required to scan text-like Landolt-C strings to detect whether any pre-learnt target was embedded in the strings. The Landolt-C strings were displayed under different spacing formats (i.e., spaced format, unspaced format, and unspaced shaded format). However, the simulated exposure frequency effect did not occur in the scanning session. Wang et al. argued one straightforward reason for this might be because participants failed to maintain the memory of pre-learnt target to the scanning session. In the current study, we employed the same learning and scanning paradigm to investigate whether exposure frequency would occur in a target search task by using easier learning materials - pseudoword stimuli. The learning of pseudoword stimuli was much more successful than Landolt-C stimuli. Interestingly, however, we found a very different rate of learning effect such that the rate of learning LF targets was greater than HF targets. To our surprise, we did not find any influence of exposure frequency on eye movements during scanning even when participants were able to identify pre-learnt pseudowords in strings. Learning rate effect, exposure frequency effects, and saccadic targeting during the scanning of strings under different spacing formats are discussed in this paper.

Morphosemantic activation of opaque Chinese words in sentence comprehension

Two cross-modal priming experiments were conducted to investigate morphological processing in Chinese spoken word recognition during sentence comprehension. Participants heard sentences that contained opaque prime words and performed lexical decisions on visual targets that were related to second morpheme meanings of opaque words or whole-word meanings. The targets were presented at the auditory onset of the second morphemes or the subsequent syllables after the opaque primes to examine the time course of effects. In a neutral sentence context (Experiment 1), opaque word morpheme meanings produced morphological priming on target word recognition, which preceded lexical priming. When context biased toward whole opaque words (Experiment 2), morphological priming disappeared, while the effect of lexical meanings remained significant and emerged earlier than the effect of lexical meanings in the neutral context. These findings suggest that morphemes play a role in Chinese spoken word recognition, but their effects depend on the prior context during sentence comprehension.

Morphological and visual cues in compound word reading: Eye-tracking evidence from Hebrew

Hebrew noun-noun compounds offer a valuable opportunity to study the long-standing question of how morphologically complex words are processed during reading. Specifically, in some morpho-syntactic environments, the first (head) noun of a compound carries a suffix-a clear orthographic marker of being part of a compound-whereas in others it is homographic with a stand-alone noun. In addition to this morphological cue, Hebrew occasionally employs hyphenation as a visual signal that two nouns, which are typically separated by a space, are combined in a compound. In a factorial design, we orthogonally manipulated the morphological and the visual cues and recorded eye movements of 75 proficient Hebrew readers while they read sentences with embedded compounds. The effect of hyphenation on reading times was inhibitory. This slow-down was significantly weaker in compounds where the syntactic relation between constituents was overtly marked by a suffix compared with compounds without a morphological marker. We interpret these findings as evidence that hyphenation is largely a redundant cue but morphological markers of compounding are psychologically valid cues for semantic integration of compounds. We discuss the implications of this finding for accounts of morphological processing.

Linguistic processes do not beat visuo-motor constraints, but they modulate where the eyes move regardless of word boundaries: Evidence against top-down word-based eye-movement control during reading

Where readers move their eyes, while proceeding forward along lines of text, has long been assumed to be determined in a top-down word-based manner. According to this classical view, readers of alphabetic languages would invariably program their saccades towards the center of peripheral target words, as selected based on the (expected) needs of ongoing (word-identification) processing, and the variability in within-word landing positions would exclusively result from systematic and random errors. Here we put this predominant hypothesis to a strong test by estimating the respective influences of language-related variables (word frequency and word predictability) and lower-level visuo-motor factors (word length and saccadic launch-site distance to the beginning of words) on both word-skipping likelihood and within-word landing positions. Our eye-movement data were collected while forty participants read 316 pairs of sentences, that differed only by one word, the prime; this was either semantically related or unrelated to a following test word of variable frequency and length. We found that low-level visuo-motor variables largely predominated in determining which word would be fixated next, and where in a word the eye would land. In comparison, language-related variables only had tiny influences. Yet, linguistic variables affected both the likelihood of word skipping and within-word initial landing positions, all depending on the words’ length and how far on average the eye landed from the word boundaries, but pending the word could benefit from peripheral preview. These findings provide a strong case against the predominant word-based account of eye-movement guidance during reading, by showing that saccades are primarily driven by low-level visuo-motor processes, regardless of word boundaries, while being overall subject to subtle, one-off, language-based modulations. Our results also suggest that overall distributions of saccades’ landing positions, instead of truncated within-word landing-site distributions, should be used for a better understanding of eye-movement guidance during reading.

The effects of parafoveal word frequency and segmentation on saccade targeting during Chinese reading

Two eye-movement experiments are reported in which a boundary paradigm was used to manipulate the presence versus absence of boundaries for high-frequency and low-frequency target words in the parafovea. In Experiment 1, this was done by introducing a blank space after the target words, whereas in Experiment 2 this was done by rendering the target words in red. In both experiments, higher frequency targets engendered longer saccades, whereas the presence of parafoveal word boundaries engendered shorter saccades. This pattern suggests the operation of two countermanding saccade-targeting mechanisms: one that uses parafoveal processing difficulty to adjust saccade lengths and a second that uses word boundaries to direct the eyes toward specific saccade targets. The implications of these findings for models of eye-movement control during reading are discussed, as are suggestions for integrating dynamic-adjustment and default-targeting accounts.

EPS mid-career prize lecture 2017: Writing systems, reading, and language

Skilled reading reflects an accumulation of experience with written language. Written language is typically viewed as an expression of spoken language, and this perspective has motivated approaches to understanding reading and reading acquisition. However, in this article, I develop the proposal that written language has diverged from spoken language in important ways that maximise the transmission of meaningful information, and that this divergence has been central to the development of rapid, skilled reading. I use English as an example to show that weaknesses in the relationship between spelling and sound can give rise to strong regularities between spelling and meaning that are critical for the rapid analysis of printed words. I conclude by arguing that the nature of the reading system is a reflection of the writing system and that a deep understanding of reading can be obtained only through a deep understanding of written language.