Semantic information mediates visual attention during spoken word recognition in Chinese: Evidence from the printed-word version of the visual-world paradigm

The phonological congruency modulated long-term form priming of Chinese characters

Elucidating the interaction between lexical processing and word learning is essential for a complete understanding of the underlying mechanisms of each of them. Long-term priming for words reflects an interplay between lexical processing and word learning. Although robust long-term priming effects have been found between two occurrences of the same word and between semantically similar words, it remains unclear whether long-term priming between orthographically similar words (i.e., long-term form priming) is a reliable effect. Following the theoretical analysis based on the connectionist framework, we articulated the possibility that long-term form priming might be modulated by the phonological congruency between the prime and target words, and that if this modulator was under control, reliable effects of long-term form priming would emerge. However, this hypothesis has not been adequately tested empirically. The present study tested this hypothesis by using Chinese phonograms and the phonetic radicals embedded in them as the prime and target items. In three experiments that varied in the types of stimuli and testing tasks, we consistently found that when the prime and target had the same phonology, naming the prime facilitated later processing of the target, while when they had different phonologies, the priming effect was inhibitory. These observations were consistent with the connectionist account of long-term priming for words. Our findings help confirm the reliability, generalizability, and robustness of long-term form priming and elucidate its underlying mechanisms, and suggesting promising future directions on the interactions between lexical processing and word learning.

Segmentation of Spoken Overlapping Ambiguity Strings in Chinese: An Eye-Tracking Study

PURPOSE

Using the printed-word paradigm with eye tracking, this study conducted three experiments to examine (a) how multiple words in spoken overlapping ambiguity strings (OASs) are activated, (b) how word frequency influences the word segmentation of spoken OASs, and (c) whether the multiple words in spoken OASs are activated competitively or independently.

METHOD

In this study, participants listened to a four-character spoken OAS (ABCD) and were presented with a visual display composed of a semantic associate of the "middle word" (BC; Experiments 1 and 2) or the "left word" (AB; Experiment 3) and two distractors. In Experiment 1, the word frequency of the middle words was manipulated to be higher than that of the neighbor words. In Experiment 2, the word frequency of the middle words was manipulated to be either higher or lower than that of the neighbor words. In Experiment 3, participants listened to either spoken OASs (ABCD) or spoken unambiguous strings (ABEF).

RESULTS

In Experiment 1, we observed a significant semantic competition effect; that is, more fixations fell on the semantic competitors than on distractors, suggesting that the semantic information of the middle words in the spoken OASs was activated. In Experiment 2, the semantic competition effect was only observed in the high-frequency condition and was absent in the low-frequency condition. In Experiment 3, the results showed significant semantic competition effects for the left words under both conditions, and the observed effect was similar between the ambiguity condition and the control condition.

CONCLUSIONS

These findings show that multiple words in spoken OASs are all activated and the activation level is modulated by word frequency. In addition, multiple words in the spoken OASs may be processed independently during spoken comprehension.

Analysing data from the psycholinguistic visual-world paradigm: Comparison of different analysis methods

In this paper, we discuss key characteristics and typical experimental designs of the visual-world paradigm and compare different methods of analysing eye-movement data. We discuss the nature of the eye-movement data from a visual-world study and provide data analysis tutorials on ANOVA, t-tests, linear mixed-effects model, growth curve analysis, cluster-based permutation analysis, bootstrapped differences of timeseries, generalised additive modelling, and divergence point analysis to enable psycholinguists to apply each analytical method to their own data. We discuss advantages and disadvantages of each method and offer recommendations about how to select an appropriate method depending on the research question and the experimental design.

The role of tonal information during spoken-word recognition in Chinese: Evidence from a printed-word eye-tracking study

Two experiments were conducted to investigate the extent to which the lexical tone can affect spoken-word recognition in Chinese using a printed-word paradigm. Participants were presented with a visual display of four words-namely, a target word (e.g., , xiang4xian4, "quadrant"), a tone-consistent phonological competitor (e.g., , xiang4ce4, "photo album"), or a tone-inconsistent phonological competitor (e.g., , xiang1cai4, "coriander"), and two unrelated distractors. Simultaneously, they were asked to listen to a spoken target word presented in isolation (Experiment 1) or embedded in neutral/predictive sentence contexts (Experiment 2), and then click on the target word on the screen. Results showed significant phonological competitor effects (i.e., the fixation proportion on the phonological competitor was higher than that on the distractors) under both tone conditions. Specifically, a larger phonological competitor effect was observed in the tone-consistent condition than in the tone-inconsistent condition when the spoken word was presented in isolation and the neutral sentence contexts. This finding suggests a partial role of lexical tone in constraining spoken-word recognition. However, when embedded in a predictive sentence context, the phonological competitor effect was only observed in the tone-consistent condition and absent in the tone-inconsistent condition. This result indicates that the predictive sentence context can strengthen the role of lexical tone.

Inhibitory control is associated with the activation of output-driven competitors in a spoken word recognition task

Although lexical competition has been ubiquitously observed in spoken word recognition, less has been known about whether the lexical competitors interfere with the recognition of the target and how lexical interference is resolved. The present study examined whether lexical competitors overlapping in output with the target would interfere with its recognition, and tested an underestimated hypothesis that the domain-general inhibitory control contributes to the resolution of lexical interference. Specifically, in this study, a Visual World Paradigm was used to access the temporal dynamics of lexical activations when participants were moving the mouse cursor to the written word form of the spoken word they heard. By using Chinese characters, the orthographic similarity between the lexical competitor and target was manipulated independently of their phonological overlap. The results demonstrated that behavioral performance in the similar condition was poorer compared to that in the control condition, and that individuals with better inhibitory control (having smaller Stroop interference effect) exhibited weaker activation of orthographic competitors (mouse trajectories less attracted by the orthographic competitors). The implications of these findings for our understanding of lexical interference and its resolution in spoken word recognition were discussed.

The Effect of Salience on Chinese Pun Comprehension: A Visual World Paradigm Study

The present study adopted the printed-word visual world paradigm to investigate the salience effect on Chinese pun comprehension. In such an experiment, participants listen to a spoken sentence while looking at a visual display of four printed words (including a semantic competitor, a phonological competitor, and two unrelated distractors). Previous studies based on alphabetic languages have found robust phonological effects (participants fixated more at phonological competitors than distractors during the unfolding of the spoken target words), while controversy remains regarding the existence of a similar semantic effect. A recent Chinese study reported reliable semantic effects in two experiments using this paradigm, suggesting that Chinese participants could actively map the semantic input from the auditory modality with the semantic information retrieved from printed words. In light of their study, we designed an experiment with two conditions: a replication condition to test the validity of using the printed-word world paradigm in Chinese semantic research, and a pun condition to assess the role played by salience during pun comprehension. Indeed, global analyses have revealed robust semantic effects in both experimental conditions, where participants were found more attracted to the semantic competitors than to the distractors with the emergence of target words. More importantly, the local analyses from the pun condition have shown that the participants were more attracted to the semantic competitors related to the salient meaning of the ambiguous word in a pun than to those related to the less salient meanings within 200 ms after target word offset. This finding suggests that the salient meaning of the ambiguous word in a pun is activated and assessed faster than its less salient counterpart. The initial advantage observed in the present study is consistent with the prediction of the graded salience hypothesis rather than the direct access model.

Time Course of the Second Morpheme Processing During Spoken Disyllabic Compound Word Recognition in Chinese

PURPOSE

This study aimed to investigate the time course of meaning activation of the 2nd morpheme processing of compound words during Chinese spoken word recognition using eye tracking technique with the printed-word paradigm.

METHOD

In the printed-word paradigm, participants were instructed to listen to a spoken target word (e.g., "", /da4fang1/, generous) while presented with a visual display composed of 3 words: a morphemic competitor (e.g., "", /yuan2xing2/, circle), which was semantically related to the 2nd morpheme (e.g., "", /fang1/, square) of the spoken target word; a whole-word competitor (e.g., "", /lin4se4/, stingy), which was semantically related to the spoken target word at the whole-word level; and a distractor, which was semantically related to neither the morpheme or the whole target word. Participants were asked to respond whether the spoken target word was on the visual display or not, and their eye movements were recorded.

RESULTS

The logit mixed-model analysis showed both the morphemic competitor and the whole-word competitor effects. Both the morphemic and whole-word competitors attracted more fixations than the distractor. More importantly, the 2nd-morphemic competitor effect occurred at a relatively later time window (i.e., 1000-1500 ms) compared with the whole-word competitor effect (i.e., 200-1000 ms).

CONCLUSION

Findings in this study suggest that semantic information of both the 2nd morpheme and the whole word of a compound was activated in spoken word recognition and that the meaning activation of the 2nd morpheme followed the activation of the whole word.

Visual attention shift to printed words during spoken word recognition in Chinese: The role of phonological information

The aim of this study was to investigate the extent to which phonological information mediates the visual attention shift to printed Chinese words in spoken word recognition by using an eye-movement technique with a printed-word paradigm. In this paradigm, participants are visually presented with four printed words on a computer screen, which include a target word, a phonological competitor, and two distractors. Participants are then required to select the target word using a computer mouse, and the eye movements are recorded. In Experiment 1, phonological information was manipulated at the full-phonological overlap; in Experiment 2, phonological information at the partial-phonological overlap was manipulated; and in Experiment 3, the phonological competitors were manipulated to share either fulloverlap or partial-overlap with targets directly. Results of the three experiments showed that the phonological competitor effects were observed at both the full-phonological overlap and partial-phonological overlap conditions. That is, phonological competitors attracted more fixations than distractors, which suggested that phonological information mediates the visual attention shift during spoken word recognition. More importantly, we found that the mediating role of phonological information varies as a function of the phonological similarity between target words and phonological competitors.

The time course of morphological processing during spoken word recognition in Chinese

We investigated the time course of morphological processing during spoken word recognition using the printed-word paradigm. Chinese participants were asked to listen to a spoken disyllabic compound word while simultaneously viewing a printed-word display. Each visual display consisted of three printed words: a semantic associate of the first constituent of the compound word (morphemic competitor), a semantic associate of the whole compound word (whole-word competitor), and an unrelated word (distractor). Participants were directed to detect whether the spoken target word was on the visual display. Results indicated that both the morphemic and whole-word competitors attracted more fixations than the distractor. More importantly, the morphemic competitor began to diverge from the distractor immediately at the acoustic offset of the first constituent, which was earlier than the whole-word competitor. These results suggest that lexical access to the auditory word is incremental and morphological processing (i.e., semantic access to the first constituent) that occurs at an early processing stage before access to the representation of the whole word in Chinese.