The time course of semantic and syntactic processing in Chinese sentence comprehension: Evidence from eye movements

Skipping the structural particle de () in reading Chinese: The role of word frequency and sentential fit

Previous studies suggested that readers were more likely to skip a word when it was previewed by a very-high-frequency word, like "the" in English and "de ()" in Chinese, and they suggested that readers based skipping decisions on parafoveal word information rather than on sentence context. However, in these studies, the very-high-frequency preview word (the or de) was always implausible given the sentence context. It is an open question whether parafoveal word information interacts with sentence context to influence skipping decisions. Therefore, the current experiment orthogonally manipulated the preview information of the target character (identical or de preview) and the plausibility of de (plausible or implausible) to examine this question. The major results indicated that readers were more likely to skip the target character and made longer outgoing saccade length across the boundary in the de preview condition than in the identical preview condition. What is more important, the interaction between the plausibility of de and preview condition was significant: Readers' higher probability of skipping the target character and longer outgoing saccade length in the de preview condition than in the identical preview condition was only significant when de was plausible, suggesting that parafoveal word information and context information can act as a joint constraint on skipping decision in reading Chinese.

Syntactic and Semantic Processing in Japanese Sentence Reading: A Research Using Functional Near-Infrared Spectroscopy (fNIRS)

In order to examine whether syntactic processing is a necessary prerequisite for semantic integration in Japanese, cortical activation was monitored while participants engaged in silent reading task. Congruous sentences (CON), semantic violation sentences (V-SEM), and syntactic violation sentences (V-SYN) were presented in the experiment. The participants' oxygenated hemoglobin concentration changes during the reading task were measured using functional near-infrared spectroscopy. The results suggest that the CON sentences did not require additional cognitive load on syntactic processing or semantic processing. The V-SEM sentences demanded great cognitive load on semantic processing. Besides, it also elicited great cognitive load on syntactic processing. The V-SYN sentences induced great cognitive load on syntactic processing, but it did not induce additional load on semantic processing. These evidence demonstrates that, in Japanese language processing, the difficultness of semantic processing could influence the difficultness of syntactic processing, while the difficultness of syntactic processing would not influence the difficultness of semantic processing. Our findings are suggestive of the possibility that in Japanese language reading, semantic processing precedes syntactic processing, or semantic processing and syntactic processing are in parallel.

Semantic plausibility preferentially affects the semantic preview benefit in Chinese reading: evidence from an eye-movement study

Background

Numerous studies have confirmed that skilled readers can benefit from a semantically related preview word (i.e., semantic preview benefit, SPB), suggesting that readers can extract semantic information from the parafovea to achieve efficient reading. It is still under debate whether the occurrence of this benefit is because of the semantic association between the preview and target words or because of the contextual fit of the preview word in the sentence context.

Methods

Two independent factors, preview plausibility (preview plausible/implausible) and semantic relatedness (semantically related/unrelated), were manipulated, and we further strictly controlled for syntactic plausibility in the present study.

Results

The results showed that the first-pass reading times of the target words were significantly shorter in the plausible preview condition than in the implausible preview condition. However, the main effect of semantic relatedness was found only in the gaze duration measure.

Discussion

The pattern of results revealed that semantic plausibility affects the semantic preview benefit preferentially in Chinese reading, supporting the contextual fit account. Our findings have implications for a better understanding of parafoveal processing and provide empirical support for the eye-movement control model.

The Brain Connectome for Chinese Reading

Chinese, as a logographic language, fundamentally differs from alphabetic languages like English. Previous neuroimaging studies have mainly focused on alphabetic languages, while the exploration of Chinese reading is still an emerging and fast-growing research field. Recently, a growing number of neuroimaging studies have explored the neural circuit of Chinese reading. Here, we summarize previous research on Chinese reading from a connectomic perspective. Converging evidence indicates that the left middle frontal gyrus is a specialized hub region that connects the ventral with dorsal pathways for Chinese reading. Notably, the orthography-to-phonology and orthography-to-semantics mapping, mainly processed in the ventral pathway, are more specific during Chinese reading. Besides, in addition to the left-lateralized language-related regions, reading pathways in the right hemisphere also play an important role in Chinese reading. Throughout, we comprehensively review prior findings and emphasize several challenging issues to be explored in future work.

Application of Visitor Eye Movement Information to Museum Exhibit Analysis

The motivation of this study is that after the COVID-19 epidemic, museum exhibition visits have also been significantly affected. The purpose of this research is to better understand the visual cognition of visitors, so as to improve the application of physical field or online exhibitions. Currently, no research is available on the differences in the visitor’s viewing and cognitive process with eye movements sequence analysis that stem from the exhibition planning and design of different museums. This study tracks and analyzes the eye movement trajectories of visitors and studies its relation to learning and cognition and finds the key to influencing cognition through behavioral sequence analysis of displayed content. The results show that those interested in the displayed content have better cognitive performance, are immersed in reading text, and have a substantial shift in eye movement. Contrarily, those not interested in the displayed content are distracted and often turn their attention back to the title of the content. In this study, eye movement and fixation are indicators that can be used as a reference for the future design of displays to improve the effectiveness of presenting information to a visitor. Furthermore, this research can also provide future applications in integrating the virtual world and cognitive information, in the application of AR, VR, or metaverse environment, to provide people’s cognition of rapid information in the virtual environment.

Spanish L2 Chinese Learners' Awareness of Morpho-Syntactic Structures in the Reading Comprehension of Splittable Compounds

Reading comprehension is never considered a simple task in linguists' views as it requires a full set of linguistic knowledge, such as word decoding, understanding syntactic and morphological structures, and deriving proper meanings from these structures in a given context. Bearing the simple view of reading, the primary goal of this study is to explore whether the split presentation of Chinese splittable compounds influences the recognition of the compounds in second language (L2) Chinese reading comprehension, and how the reading skills, i.e., word decoding and linguistic comprehension, cooperate to complete this reading comprehension task. Splittable compounds (SCs) in Chinese are typically verbs composed of two constituents with limited separability. The separable property of SCs and their vague morpho-syntactic status are supposed to cause difficulties for L2 Chinese learners in recognizing the compounds. Especially for those whose native language manifests lexical integrity, the split presentation of the compounds may invite the L2 Chinese readers to process them with a mechanism different from that for their non-split forms. To the best of our knowledge, the efforts on investigating this issue are insufficient. In this study, 27 Spanish speaking L2 Chinese learners were invited to complete tasks including reading and interpreting 6 selected SCs in the split and non-split forms, rating their familiarities with each SC and reporting the syntactic category of the SCs based on their existing linguistic knowledge. The results, showed that the split presentation of SCs did cause challenges for L2 Chinese learners in recognizing the compounds in the reading process, regardless of their Chinese proficiencies. The L2 Chinese participants performed significantly worse in recognizing split SCs in salient Verb-Object structures than recognizing those in unsalient Verb-Object structures. These findings underscore the importance of linguistic comprehension in L2 Chinese in-text word reading comprehension and suggest words as the basic processing units.

Predictability eliminates neighborhood effects during Chinese sentence reading

Previous research has demonstrated effects of both orthographic neighborhood size and neighbor frequency in word recognition in Chinese. A large neighborhood-where neighborhood size is defined by the number of words that differ from a target word by a single character-appears to facilitate word recognition, while the presence of a higher-frequency neighbor has an inhibitory effect. The present study investigated modulation of these effects by a word's predictability in context. In two eye-movement experiments, the predictability of a target word in each sentence was manipulated. Target words differed in their neighborhood size (Experiment 1) and in whether they had a higher-frequency neighbor (Experiment 2). The study replicated the previously observed effects of neighborhood size and neighbor frequency when the target word was unpredictable, but in both experiments neighborhood effects were absent when the target was predictable. These results suggest that when a word is preactivated by context, the activation of its neighbors may be diminished to such an extent that these neighbors do not effectively compete for selection.

Context but not reading speed modulates transposed-word effects in Chinese reading

Recent research using a speeded grammaticality decision revealed novel transposed-word effects when reading alphabetic languages such as French (Mirault, Snell, & Grainger, 2018), and nonalphabetic languages such as Chinese (Liu, Li, Paterson, & Wang, 2020). Transposed-word effects are considered to reflect flexibility in word order processing, but the factors that might modulate such effects remain unknown. The present study investigated this issue by using a within-subjects design in Chinese reading. In experiment 1, the participants were asked to read sentences at their normal and speeded reading speed and to make grammaticality decisions as accurately as possible. No significant interaction between transposed-word effects and reading speed was found, suggesting that transposed-word effects are not modulated by reading speed and that they are similar regardless of whether the participants read slowly or quickly. In experiment 2, we manipulated the context before the transposed words and used a speeded grammaticality decision task. We observed significant interactive effects between transposed-word effects and context, and analyses revealed that transposed-word effects decreased when the first and second words were transposed in a sentence. We conclude that context rather than reading speed modulates transposed-word effects in Chinese reading and discuss these findings with regard to the noisy bottom-up allocation of word identities and top-down sentence-level constraints.

Re-examination of Chinese semantic processing and syntactic processing: evidence from conventional ERPs and reconstructed ERPs by residue iteration decomposition (RIDE)

A number of studies have explored the time course of Chinese semantic and syntactic processing. However, whether syntactic processing occurs earlier than semantics during Chinese sentence reading is still under debate. To further explore this issue, an event-related potentials (ERPs) experiment was conducted on 21 native Chinese speakers who read individually-presented Chinese simple sentences (NP1+VP+NP2) word-by-word for comprehension and made semantic plausibility judgments. The transitivity of the verbs was manipulated to form three types of stimuli: congruent sentences (CON), sentences with a semantically violated NP2 following a transitive verb (semantic violation, SEM), and sentences with a semantically violated NP2 following an intransitive verb (combined semantic and syntactic violation, SEM+SYN). The ERPs evoked from the target NP2 were analyzed by using the Residue Iteration Decomposition (RIDE) method to reconstruct the ERP waveform blurred by trial-to-trial variability, as well as by using the conventional ERP method based on stimulus-locked averaging. The conventional ERP analysis showed that, compared with the critical words in CON, those in SEM and SEM+SYN elicited an N400–P600 biphasic pattern. The N400 effects in both violation conditions were of similar size and distribution, but the P600 in SEM+SYN was bigger than that in SEM. Compared with the conventional ERP analysis, RIDE analysis revealed a larger N400 effect and an earlier P600 effect (in the time window of 500–800 ms instead of 570–810ms). Overall, the combination of conventional ERP analysis and the RIDE method for compensating for trial-to-trial variability confirmed the non-significant difference between SEM and SEM+SYN in the earlier N400 time window. Converging with previous findings on other Chinese structures, the current study provides further precise evidence that syntactic processing in Chinese does not occur earlier than semantic processing.

Encoding the target or the plausible preview word? The nature of the plausibility preview benefit in reading Chinese

Previous studies have shown that a plausible preview word can facilitate the processing of a target word as compared to an implausible preview word (a plausibility preview benefit effect) when reading Chinese (Yang, Wang, Tong, & Rayner, 2012; Yang, 2013). Regarding the nature of this effect, it is possible that readers processed the meaning of the plausible preview word and did not actually encode the target word (given that the parafoveal preview word lies close to the fovea). The current experiment examined this possibility with three conditions wherein readers received a preview of a target word that was either (1) identical to the target word (identical preview), (2) a plausible continuation of the pre-target text, but the post-target text in the sentence was incompatible with it (initially plausible preview), or (3) not a plausible continuation of the pre-target text, nor compatible with the post-target text (implausible preview). Gaze durations on target words were longer in the initially plausible condition than the identical condition. Overall, the results showed a typical preview benefit, but also implied that readers did not encode the initially plausible preview. Also, a plausibility preview benefit was replicated: gaze durations were longer with implausible previews than the initially plausible ones. Furthermore, late eye movement measures did not reveal differences between the initially plausible and the implausible preview conditions, which argues against the possibility of misreading the plausible preview word as the target word. In sum, these results suggest that a plausible preview word provides benefit in processing the target word as compared to an implausible preview word, and this benefit is only present in early but not late eye movement measures.

Syntax does not necessarily precede semantics in sentence processing: ERP evidence from Chinese

Two event-related potential experiments were conducted to examine whether the processing of syntactic category or syntactic subcategorization frame always needs to temporally precede semantic processing during the reading of Chinese sentences of object-subject-verb construction. The sentences contained (a) no anomalies, (b) semantic only anomalies, (c) syntactic category plus semantic anomalies, or (d) transitivity plus semantic anomalies. In both experiments, all three types of anomalies elicited a broad negativity between 300 and 500 ms. This negativity included an N400 effect, given its distribution. Moreover, syntactic category plus semantic anomalies elicited a P600 response, whereas the other two types of anomalies did not. The finding of N400 effects suggests that semantic integration can be attempted even when the processing of syntactic category or syntactic subcategorization frame is unsuccessful. Thus, syntactic processing is not a necessary prerequisite for the initiation of semantic integration in Chinese.

Plausibility effects when reading one- and two-character words in Chinese: evidence from eye movements

Eye movements of Chinese readers were monitored as they read sentences containing a critical character that was either a 1-character word or the initial character of a 2-character word. Due to manipulation of the verb prior to the target word, the 1-character target word (or the first character of the 2-character target word) was either plausible or implausible, as an independent word, at the point at which it appeared, whereas the 2-character word was always plausible. The eye movement data showed that the plausibility manipulation did not exert an influence on the reading of the 2-character word or its component characters. However, plausibility significantly influenced reading of the 1-character target word. These results suggest that processes of semantic integration in reading Chinese are performed at a word level, instead of a character level, and that word segmentation must take place very early in the course of processing.

Processing coordinate structures in Chinese: evidence from eye movements

This article reports the results of an eye-tracking experiment that investigated the processing of coordinate structures in Chinese sentence comprehension. The study tracked the eye movements of native Chinese readers as they read sentences consisting of two independent clauses connected by the word huo zhe. The data strongly confirmed readers' preference for an initial noun phrase (NP)-coordination parsing in Chinese coordination structure. When huo zhe was absent from the beginning of a sentence, we identified a cost associated with abandoning the NP-coordination analysis, which was evident with regard to the second NP when the coordination was unambiguous. Otherwise, this cost was evident with regard to the verb, the syntactically disambiguating region, when the coordination was ambiguous. However, the presence of a sentence-initial huo zhe reduced reading times and regressions in the huo zhe NP and the verb regions. We believe that the word huo zhe at the beginning of a sentence helps the reader predict that the sentence contains a parallel structure. Before the corresponding phrases appear, the readers can use the word huo zhe and the language structure thereafter to predicatively construct the syntactic structure. Such predictive capability can eliminate the reader's preference for NP-coordination analysis. Implications for top-down parsing theory and models of initial syntactic analysis and reanalysis are discussed.

Semantic and plausibility effects on preview benefit during eye fixations in Chinese reading

The boundary paradigm (Rayner, 1975) was used to examine whether high level information affects preview benefit during Chinese reading. In two experiments, readers read sentences with a 1-character target word while their eye movements were monitored. In Experiment 1, the semantic relatedness between the target word and the preview word was manipulated so that there were semantically related and unrelated preview words, both of which were not plausible in the sentence context. No significant differences between these two preview conditions were found, indicating no effect of semantic preview. In Experiment 2, we further examined semantic preview effects with plausible preview words. There were four types of previews: identical, related & plausible, unrelated & plausible, and unrelated & implausible. The results revealed a significant effect of plausibility as single fixation and gaze duration on the target region were shorter in the two plausible conditions than in the implausible condition. Moreover, there was some evidence for a semantic preview benefit as single fixation duration on the target region was shorter in the related & plausible condition than the unrelated & plausible condition. Implications of these results for processing of high level information during Chinese reading are discussed.