Orthographic and Phonological Processing in Reading Chinese Text: Evidence From Eye Fixations

The time course of Cantonese and Hong Kong Sign Language phonological activation: An ERP study of deaf bimodal bilingual readers of Chinese

This study investigated Cantonese and Hong Kong Sign Language (HKSL) phonological activation patterns in Hong Kong deaf readers using the ERP technique. Two experiments employing the error disruption paradigm were conducted while recording participants' EEGs. Experiment 1 focused on orthographic and speech-based phonological processing, while Experiment 2 examined sign-phonological processing. ERP analyses focused on the P200 (180-220 ms) and N400 (300-500 ms) components. The results of Experiment 1 showed that hearing readers exhibited both orthographic and phonological effects in the P200 and N400 windows, consistent with previous studies on Chinese reading. In deaf readers, significant speech-based phonological effects were observed in the P200 window, and orthographic effects spanned both the P200 and N400 windows. Comparative analysis between the two groups revealed distinct spatial distributions for orthographic and speech-based phonological ERP effects, which may indicate the engagement of different neural networks during early processing stages. Experiment 2 found evidence of sign-phonological activation in both the P200 and N400 windows among deaf readers, which may reflect the involvement of sign-phonological representations in early lexical access and later semantic integration. Furthermore, exploratory analysis revealed that higher reading fluency in deaf readers correlated with stronger orthographic effects in the P200 window and diminished effects in the N400 window, indicating that efficient orthographic processing during early lexical access is a distinguishing feature of proficient deaf readers.

The role of orthographic and phonological processing during reading Chinese sentences: Evidence from eye movements

The role of phonological and orthographic processing and their time course during lexical processing and sentence reading remain controversial. By adopting a misspelled-characters disruption paradigm and eye-tracking technique, we manipulated the writing for the first characters of two-character target words to investigate the relative role of orthographic and phonological processing on word recognition in Chinese reading. There are four conditions: (a) correct character, (b) misspelled character with a stroke missing, (c) misspelled homographic character, and (d) misspelled homophonic character. The results showed that homophonic errors caused more disruptions than other conditions in the early (first-pass reading times) and later (total reading time) stages of lexical processing during Chinese reading. Homographic errors and omitted stroke errors lead to equal disruptions at the early stage of word recognition, but homographic errors cause more disruptions at the later stage. These results suggest that orthography plays a dominant role in word recognition during Chinese reading, whereas phonology plays a weaker and more limited role. The direct access and dual-rote hypothesis may well explain the mechanism of lexical processing in Chinese reading.

The processing of pseudoword form and meaning in production and comprehension: A computational modeling approach using linear discriminative learning

Pseudowords have long served as key tools in psycholinguistic investigations of the lexicon. A common assumption underlying the use of pseudowords is that they are devoid of meaning: Comparing words and pseudowords may then shed light on how meaningful linguistic elements are processed differently from meaningless sound strings. However, pseudowords may in fact carry meaning. On the basis of a computational model of lexical processing, linear discriminative learning (LDL Baayen et al., Complexity, 2019, 1-39, 2019), we compute numeric vectors representing the semantics of pseudowords. We demonstrate that quantitative measures gauging the semantic neighborhoods of pseudowords predict reaction times in the Massive Auditory Lexical Decision (MALD) database (Tucker et al., 2018). We also show that the model successfully predicts the acoustic durations of pseudowords. Importantly, model predictions hinge on the hypothesis that the mechanisms underlying speech production and comprehension interact. Thus, pseudowords emerge as an outstanding tool for gauging the resonance between production and comprehension. Many pseudowords in the MALD database contain inflectional suffixes. Unlike many contemporary models, LDL captures the semantic commonalities of forms sharing inflectional exponents without using the linguistic construct of morphemes. We discuss methodological and theoretical implications for models of lexical processing and morphological theory. The results of this study, complementing those on real words reported in Baayen et al., (Complexity, 2019, 1-39, 2019), thus provide further evidence for the usefulness of LDL both as a cognitive model of the mental lexicon, and as a tool for generating new quantitative measures that are predictive for human lexical processing.

Orthographic and phonological activation in Hong Kong deaf readers: An eye-tracking study

We used an error disruption paradigm to investigate how deaf readers from Hong Kong, who had varying levels of reading fluency, use orthographic, phonological, and mouth-shape-based (i.e., "visemic") codes during Chinese sentence reading while also examining the role of contextual information in facilitating lexical retrieval and integration. Participants had their eye movements recorded as they silently read Chinese sentences containing orthographic, homophonic, homovisemic, or unrelated errors. Sentences varied in terms of how much contextual information was available leading up to the target word. Fixation time analyses revealed that in early fixation measures, deaf readers activated word meanings primarily through orthographic representations. However, in contexts where targets were highly predictable, fixation times on homophonic errors decreased relative to those on unrelated errors, suggesting that higher levels of contextual predictability facilitated early phonological activation. In the measure of total reading time, results indicated that deaf readers activated word meanings primarily through orthographic representations, but they also appeared to activate word meanings through visemic representations in late error recovery processes. Examining the influence of reading fluency level on error recovery processes, we found that, in comparison to deaf readers with lower reading fluency levels, those with higher reading fluency levels could more quickly resolve homophonic and orthographic errors in the measures of gaze duration and total reading time, respectively. We conclude with a discussion of the theoretical implications of these findings as they relate to the lexical quality hypothesis and the dual-route cascaded model of reading by deaf adults.

The Effect of Word Predictability on Phonological Activation in Cantonese Reading: A Study of Eye-Fixations and Pupillary Response

This study aimed to investigate the effects of contextual predictability on orthographic and phonological activation during Chinese sentence reading by Cantonese-speaking readers using the error disruption paradigm. Participants' eye fixations and pupil sizes were recorded while they silently read Chinese sentences containing homophonic, orthographic, and unrelated errors. Sentences had varying amounts of contextual information leading up to target words such that some targets were more predictable than others. Results of the fixation time analysis indicated that orthographic effects were significant in first fixation and gaze duration, while phonological effects emerged later in total reading time. However, interactions between predictability and the homophonic condition were found in gaze duration. These results suggest that, while Cantonese readers activate word meanings primarily through orthography in early processing, early phonological activation can occur when facilitated by semantics in high-constraint sentence contexts. Analysis of pupillary response measurements revealed that participants' pupil sizes became larger when they read words containing orthographic errors, suggesting that orthographic error recovery processes significantly increase cognitive load.

Homophone Advantage in Sentence Acceptability Judgment: An Experiment with Japanese Kanji Words and Articulatory Suppression Technique

The purpose of this study was to examine the role and nature of phonology in silent reading of Japanese sentences. An experiment was conducted using a Japanese sentence acceptability judgment task. One important finding was that participants more rapidly rejected homophonic sentences in which one two-kanji compound word was replaced by its homophone word than non-homophonic sentences. In the latter, the word was replaced by a non-homophone spelling control; that is, we observed a homophone advantage. Participants were able to identify the correct word easily through foil's homophonic mate. This indicated that activated phonology played a role in the Japanese sentence acceptability judgment task and it contributed to the error detection/recovery process. Another important finding was that the homophone facilitation effect remained under articulatory suppression. It confirmed that phonology was activated at an early stage as abstract, non-articulatory phonology.

Parafoveal Processing in Chinese Sentence Reading: Early Extraction of Radical Level Phonology

The present study separated radical level phonology from character level phonology to explore the reliance on phonology during Chinese sentence reading with eye movement recording in a boundary paradigm. Participants viewed sentences with either regular, irregular, orthographically dissimilar homophone, or orthographically dissimilar non-homophone previews for the targets. Both regular and irregular characters contained the target character as the phonetic radical, with the regular character sharing the identical sound with its target phonetic radical. In Experiment 1, the irregular previews were different from the target phonetic radicals both in the first consonant and final compound vowels. In Experiment 2, the irregular characters would be replaced by the semi-regular previews, which shared the same final compound vowels but not the first consonant with the target characters. The radical level phonological preview benefit was obtained by the comparison between regular and irregular characters, while the character level phonological preview benefit was shown by the visually dissimilar homophones compared with the unrelated control condition. The preview benefit from parafoveal regular characters compared with irregular characters was observed in the first fixation duration, suggesting the early activation of phonological codes at radical levels. However, this preview benefit depends on phonological overlapping between the phonetic radicals and their host characters; it could be activated only when the pronunciation of the phonogram was totally consistent with that of its phonetic radical. Furthermore, the null preview effect of visually dissimilar homophones indicates no activation of phonological codes at the character level during Chinese sentence reading.

Concurrent correlates of Chinese word recognition in deaf and hard-of-hearing children

The aim of this study was to explore the relative contributions of phonological, semantic radical, and morphological awareness to Chinese word recognition in deaf and hard-of-hearing (DHH) children. Measures of word recognition, general intelligence, phonological, semantic radical, and morphological awareness were administered to 32 DHH and 35 hearing children in Hong Kong. Hierarchical regression analyses showed that tone, semantic radical, and morphological awareness made independent contributions to word recognition in DHH children after the effects of age and intelligence were statistically controlled for. Semantic radical and morphological awareness was found to explain significantly more variance than tone awareness in predicting word recognition in DHH children. This study has replicated previous evidence regarding the importance of semantic radical and morphological awareness in Chinese word recognition in hearing children and extended its significance to DHH children.

Paragraph-reading comprehension ability in Mandarin-speaking children with cochlear implants

OBJECTIVES

1) To investigate different aspects of paragraph reading in Mandarin-speaking students with cochlear implants (CIs) and the factors associated with unfavorable outcomes, and 2) to understand the replaceability of a paragraph-reading test with a sentence-reading test.

STUDY DESIGN

Cross-sectional, case-controlled study.

METHODS

Fifty-three students with CIs (aged 11.0 ± 1.4 years) and 53 grade- and gender-matched children with normal hearing (NH) participated in the study. A paragraph-reading comprehension test was conducted. Sentence and word reading, speech perception, language skills, and child/family characteristics were examined. An unfavorable paragraph-reading outcome was defined as a score lower than one standard deviation below the NH mean.

RESULTS

The CI subjects had significantly worse paragraph-reading comprehension than did the NH controls (P = 0.017, d = 0.54). Their performance in grades 5 to 6 was not significantly higher than of those with NH in grades 2 to 4. The CI children's abilities to understand semantics (P = 0.012) and syntax (P = 0.020) significantly fell behind the NH controls in grades 2 to 4, and the lag continued in grades 5 to 6 (P = 0.039, P = 0.002, respectively). Grade and sentence reading were independently associated with unfavorable paragraph-reading outcomes (R(2)  = 0.453). The optimal sensitivity and specificity of the sentence-reading test in identifying unfavorable paragraph-reading outcomes were 90.9% and 90.0%, respectively (area under the curve = 0.923).

CONCLUSIONS

Specialists should pay attention to CI students' development of different reading skills. Paragraph-reading tests enable a multidimensional evaluation of reading competence. Use of sentence-reading tests is suggested only as a tool for preliminary screening for basic reading capacities.

LEVEL OF EVIDENCE

3b.

Effects of orthography on speech production in Chinese

The potential role of orthographic representations on spoken word production was investigated with speakers of Chinese, a non-alphabetic and orthographically non-transparent language. Using the response generation procedure, we obtained the well-known facilitation from word-initial phonological overlap, but this effect was unaffected by whether or not responses shared the initial character. In a study which manipulated the visual similarity of the word-initial character, a significant inhibitory effect of orthography was found. However, this effect disappeared when prompt stimuli were presented auditorily, suggesting that the orthographic effect might be attributable to the memorization stage of the response generation task, rather than reflecting processes genuine to speaking. By contrast, a reliable orthographic effect was found in an oral reading task, suggesting that orthography plays a role only when it is relevant to the word production task. Furthermore, the present findings show that the orthographic effect is tied to the correspondence between orthography and phonology of a language when orthography is relevant to the task used.

Negative priming under rapid serial visual presentation

Negative priming (NP) was examined under a new paradigm wherein a target and distractors were temporally separated using rapid serial visual presentation (RSVP). The results from the two experiments revealed that (a) NP was robust under RSVP, such that the responses to a target were slower when the target served as a distractor in a previous trial than when it did not; (b) NP was found regardless of whether the distractors appeared before or after the targets; and (c) NP was stronger when the distractor was more distinctive. These findings are generally similar to those on NP in the spatial search task. The implications for the processes causing NP under RSVP are discussed in the current paper.

Prominent activation of the bilateral inferior parietal lobule of literate compared with illiterate subjects during Chinese logographic processing

Chinese is a logographic language system that differs from alphabetic languages, and some of the neurocognitive mechanisms underlying Chinese logographic reading also differ from those underlying alphabetic word reading. However, whether education level effects the neural activation associated with logographic processing of Chinese is still unknown. In the present study, 11 Chinese illiterate and 11 literate (age-matched) subjects participated in an event-related fMRI experiment with Chinese character discrimination (CD) and figure discrimination (FD) tasks. All subjects were asked to view the character or figure pairs and discriminate whether the characters or figures of each stimuli pair were the same or not using response keys. Both literate and illiterate subjects activated a widely distributed cerebral network, including the bilateral inferior, middle and superior frontal gyri, superior temporal gyrus and parietal lobe, in the CD task. Finally, we directly compared the activations of literate subjects with illiterate subjects. The results suggest that the bilateral parts of the angular gyrus and supramarginal gyrus are more active for literate than illiterate subjects in the CD task. We found no significant group difference in the FD task. Therefore, the present results may indicate that education level effects the neural activation associated with the logographic processing of Chinese.

Phonological activation in chinese reading: an event-related potential study using low-resolution electromagnetic tomography

The aim of the present study was to examine the pattern of phonological activation during Chinese sentence reading. Terminal words in high cloze sentences were manipulated across six conditions defined by word frequency and ending types. The P200 was smaller for the congruent targets than for the unrelated control targets, while there were no differences between the homophonic and unrelated control targets. No frequency effect on the P200 was observed. More importantly, a reduced N400 to the homophonic words was observed independent of word frequency. Source analysis by low resolution electromagnetic tomography (LORETA) revealed that the highly activated areas for the P200 were located at bilateral superior frontal (BA 6) and occipital (BA 17, 18 and 19) areas, while the N400 was located at left medial frontal (BA 6) area. These findings suggest that phonology is activated automatically for both high- and low-frequency words during Chinese sentence reading, even when the task is not focused on pronunciation.

From orthography to meaning: an electrophysiological investigation of the role of phonology in accessing meaning of Chinese single-character words

Homophone interference effects in Stroop experiments are often taken as evidence for the hypothesis that semantic access in written Chinese language is mediated by activation of phonological processing. We here aim to test this hypothesis with Chinese single-character words by means of event related potential (ERP) recordings. Using color words, homophones of color words and color-word associates as materials in a Stroop task, we found behavioral Stroop interference effects for all stimulus types and an N450 for incongruent color words and color-word associates. Critically, there was no difference in the ERP waveforms elicited by congruent and incongruent homophones in the N450 time window. However, in a later time window (600-800 ms) the incongruent homophones elicited an apparent positivity over left posterior regions. A similar effect was also observed for incongruent color words. These findings thus indicate that phonology does not play an important role in semantic activation of Chinese single-character words, and that the behavioral Stroop effects for homophones possibly arises at later stage of lexical processing.

Acquiring an Artificial Logographic Orthography

To date, studies have focused on the acquisition of alphabetic second languages in alphabetic first language (L1) users, demonstrating significant transfer effects. The present study examines the process from a reverse perspective, comparing logographic (Mandarin-Chinese) and alphabetic (English) L1 users in the acquisition of an artificial logographic script to determine whether similar language-specific advantageous transfer effects occurred. Chinese-English bilinguals, English-French bilinguals, and English monolinguals learned a small set of symbols (six nouns and six verbs) in an artificial logographic script. A lexical decision task on the artificial symbols revealed markedly faster response times in the Chinese-English bilinguals, indicating a logographic transfer effect suggestive of a language experience— specific advantage. A syntactic decision task evaluated the degree to which the new language was mastered beyond the single word level. No L1-specific transfer effects were found for artificial language strings. However, when carrying out the same task in the native language, both the Chinese-English and the English-French bilinguals outperformed the English monolinguals, indicative of a bilingual processing advantage. The results are discussed in relation to possible differences in processing styles relating to logographic versus alphabetic languages, variably involving visual versus phonological coding.

Eye fixation behaviour in the number bisection task: evidence for temporal specificity

Together with magnitude representations, knowledge about multiplicativity and parity contributes to numerical problem solving. In the present study, we used eye tracking to document how and when multiplicativity and parity are recruited in the number bisection task. Fourteen healthy adults evaluated whether the central number of a triplet (e.g., 21_24_27) corresponds to the arithmetic integer mean of the interval defined by the two outer numbers. We observed multiplicativity to specifically affect gaze duration on numbers, indicating that the information of multiplicative relatedness is activated at early processing stages. In contrast, parity only affected total reading time, suggesting involvement in later processing stages. We conclude that different representational features of numbers are available and integrated at different processing stages within the same task and outline a processing model for these temporal dynamics of numerical cognition.

The time course of semantic and orthographic encoding in Chinese word production: an event-related potential study

Previous studies have shown that access to conceptual/semantic information precedes phonological access in alphabetic language production such as English or Dutch. The present study investigated the time course of semantic and orthographic encoding in Chinese (a non-alphabetic language) spoken word production. Participants were shown pictures and carried out a dual-choice go/nogo task based on semantic information and orthographic information. The results of the N200 (related to response inhibition) and LRP (related to response preparation) indicated that semantic access preceded orthographic encoding by 176-202 ms. The different patterns of the two N200 effects suggest that they may tap into different processes. The N200 and LRP analyses also indicate that accessing the orthographic representation in speaking is likely optional and depends on specific task requirement.

Independent effects of orthographic and phonological facilitation on spoken word production in Mandarin

A picture-word interference paradigm with visually presented distractors was used to investigate the independent effects of orthographic and phonological facilitation on Mandarin monosyllabic word production. Both the stimulus-onset asynchrony (SOA) and the picture-word relationship along different lexical dimensions were varied. We observed a pure orthographic facilitation effect and a pure phonological facilitation effect, and found that the patterns of orthographic and phonological facilitation were different. Of most interest, the additive effects of orthographic and phonological facilitation at -150-ms and 0-ms SOAs indicated that the orthographic effect was largely independent of the phonological effect on spoken picture naming. We argue that the present findings are useful for constraining theoretical models of language production and contend that theoretical models of word production need to consider independent effects of orthography and phonology on picture naming, at least in Chinese.

Neural correlates of Chinese word-appropriateness judgment: An MEG study

To study the neural correlates of Chinese word-appropriateness judgment, we used 2-word phrases and corresponding meaningless pairs produced by replacing the second words (W2) with homophones. Fourteen right-handed healthy adults viewed word pairs randomly presented one word at a time, and judged the lexical appropriateness of the W2 for combining its preceding first word (W1) into a meaningful phrase. We measured magnetoencephalographic (MEG) responses to W1, appropriate W2, and inappropriate W2 stimuli. For each subject, multi-dipole analyses revealed sequential neuromagnetic activations which involved the bilateral visual cortices at approximately 100 milliseconds (ms), the bilateral occipitotemporal regions at approximately 190 ms, and the left temporal lobe at approximately 350 ms (M350) following stimuli. We found that the word appropriateness had no clear effect on the occipitotemporal activation to W2 stimuli, whereas the M350 activation to inappropriate W2 was greater than that to W1 or appropriate W2. In 8 of our subjects, we found an additional activation in the right temporal region, with a smaller amplitude as compared with the left M350. Our results suggest that the M350 activity reflects both lexical and semantic appropriateness assessment. The lateralized M350 strengths may be used to determine the language dominance hemisphere; and additionally, our 2-word contexture judgment paradigm can be applied in further research on the cortical processing of lexicon-semantic information in Chinese speakers.

The effect of word predictability on the eye movements of Chinese readers

Eye movements of Chinese readers were monitored as they read sentences containing target words whose predictability from the preceding context was high, medium, or low. Readers fixated for less time on high- and medium-predictable target words than on low-predictable target words. They were also more likely to fixate on low-predictable target words than on high- or medium-predictable target words. The results were highly similar to those of a study by Rayner and Well (1996) with English readers and demonstrate that Chinese readers, like readers of English, exploit target word predictability during reading.

The role of phonological activation in the visual semantic retrieval of Chinese characters

The Stroop paradigm was used to examine the role of phonological activation in semantic access and its development in reading Chinese characters. Subjects (age 7-23 years) of different reading ability were asked to name the display color of Chinese characters. The characters were displayed in four different colors: red, yellow, blue and green. There were five types of relationships between a character and its display color: semantically congruent, phonologically congruent, semantically incongruent, phonologically incongruent and neutral. In addition to the classical Stroop effects, interference and facilitation effects from the homophones of color characters were also observed. The younger children and those with lower reading ability exhibited stronger Stroop effects. These findings suggest that phonological codes are activated automatically in Chinese character recognition. Furthermore, there is more phonological activation in the semantic retrieval of children in lower grades and those with lower reading ability.

Lexical activation during the recognition of Chinese characters: evidence against early phonological activation

In two primed-naming experiments involving Chinese character recognition, one with native Mandarin-speaking subjects and another with native Cantonese-speaking subjects, we varied both the stimulus onset asynchrony (SOA) and the prime-target similarity along various lexical dimensions. Across both experiments, the results were as follows: (1) Relatively strong and reliable semantic priming appeared very early across various SOAs, and its onset was not affected by meaning precision, (2) either homophonic priming had negligible effects on target naming or the effects appeared relatively late (only at 57 msec), and (3) graphic inhibition was found across different SOAs. Since the same set of stimuli and procedure were adopted as those in the study of Perfetti and Tan (1998), the present findings raise questions about the reliability and validity of the results from their study that have been used to support the notion that phonology is a constitutive element of character recognition and precedes meaning access in the identification process. Instead, the present results suggest that phonology is optional for accessing meaning in Chinese character recognition among skilled adult readers.

Rowed to recovery: the use of phonological and orthographic information in reading Chinese and English

To examine how readers of Chinese and English take advantage of orthographic and phonological features in reading, the authors investigated the effects of spelling errors on reading text in Chinese and English using the error disruption paradigm of M. Daneman and E. Reingold (1993). Skilled readers in China and the United States read passages in their native language that contained occasional spelling errors. Results showed that under some circumstances very early phonological activation can be identified in English, but no evidence for early phonology was found in Chinese. In both languages, homophone errors showed a benefit in measures of later processing, suggesting that phonology helps readers recover from the disruptive effects of errors. These results suggest that skilled readers take advantage of the special features of particular orthographies but that these orthographic effects may be most pronounced in the early stages of lexical access.

Reading Chinese characters for meaning: the role of phonological information

Two experiments with the Stroop paradigm were conducted to investigate the role of phonological codes in access to the meaning of Chinese characters. Subjects named the ink color of viewed characters or color patches. Key items were color characters, their homophones with the same tone, homophones with different tones, and semantic associates. Apart from finding the usual Stroop interference effect, homophones produced significant interference in the incongruent condition, provided that they had the same tone as the color characters. The interference effect from homophones, however, was significantly smaller than that from color characters. Semantic associates generated an interference effect in the incongruent condition, an effect of the same magnitude as the effect from the same-tone homophones. Finally, in the congruent conditions, all the key items yielded facilitations compared to neutral controls, though the facilitation from color characters was larger than the facilitations from other types of characters. These findings suggest that phonological codes in Chinese are activated obligatorily and provide early sources of constraint in access to meaning.