Chinese readers utilize emotion information for word segmentation

We reported a large-scale Internet-based experiment to investigate the impact of emotion information on Chinese word segmentation, in which participants completed an overlapping ambiguous string (OAS) segmentation task and the Chinese version of Beck Depression Inventory-II in a counterbalanced order. OAS is a three-character string (ABC) in which the middle character can form a distinct word with both the character on its left side (word AB) and the character on its right side (word BC). Participants were presented with isolated OASs and were asked to report the word they identified first. Emotional OAS was constructed by a combination of a neutral word and an emotional word, with the neutral and emotional words sharing character B. We orthogonally manipulated the valence of the emotional words (positive vs. negative) and their position in the OAS (left-side vs. right-side). The results showed that compared with neutral words, both positive and negative words were more likely to be segmented, and this segmentation outcome was not affected by readers with different depression tendencies. These findings suggest that emotion information can influence word segmentation, and that both positive and negative words take precedence over neutral words in the word segmentation process. This study provides a new perspective and evidence to understand the impact of emotion information on word processing.

Efficiency of spoken word recognition slows across the adult lifespan

Spoken word recognition is a critical hub during language processing, linking hearing and perception to meaning and syntax. Words must be recognized quickly and efficiently as speech unfolds to be successfully integrated into conversation. This makes word recognition a computationally challenging process even for young, normal hearing adults. Older adults often experience declines in hearing and cognition, which could be linked by age-related declines in the cognitive processes specific to word recognition. However, it is unclear whether changes in word recognition across the lifespan can be accounted for by hearing or domain-general cognition. Participants (N = 107) responded to spoken words in a Visual World Paradigm task while their eyes were tracked to assess the real-time dynamics of word recognition. We examined several indices of word recognition from early adolescence through older adulthood (ages 11-78). The timing and proportion of eye fixations to target and competitor images reveals that spoken word recognition became more efficient through age 25 and began to slow in middle age, accompanied by declines in the ability to resolve competition (e.g., suppressing sandwich to recognize sandal). There was a unique effect of age even after accounting for differences in inhibitory control, processing speed, and hearing thresholds. This suggests a limited age range where listeners are peak performers.

The development of spoken word recognition in informative and uninformative sentence contexts

Although there is ample evidence documenting the development of spoken word recognition from infancy to adolescence, it is still unclear how development of word-level processing interacts with higher-level sentence processing, such as the use of lexical-semantic cues, to facilitate word recognition. We investigated how the ability to use an informative verb (e.g., draws) to predict an upcoming word (picture) and suppress competition from similar-sounding words (pickle) develops throughout the school-age years. Eye movements of children from two age groups (5-6 years and 9-10 years) were recorded while the children heard a sentence with an informative or neutral verb (The brother draws/gets the small picture) in which the final word matched one of a set of four pictures, one of which was a cohort competitor (pickle). Both groups demonstrated use of the informative verb to more quickly access the target word and suppress cohort competition. Although the age groups showed similar ability to use semantic context to facilitate processing, the older children demonstrated faster lexical access and more robust cohort suppression in both informative and uninformative contexts. This suggests that development of word-level processing facilitates access of top-down linguistic cues that support more efficient spoken language processing. Whereas developmental differences in the use of semantic context to facilitate lexical access were not explained by vocabulary knowledge, differences in the ability to suppress cohort competition were explained by vocabulary. This suggests a potential role for vocabulary knowledge in the resolution of lexical competition and perhaps the influence of lexical competition dynamics on vocabulary development.

The psychological reality of picture name agreement

Picture name agreement is commonly used as both a control variable and independent variable in studies of language production. It describes the proportion of participants who volunteer a picture's modal name in a norming study-a population-level descriptor-but researchers often assume that name agreement also indexes cognitive processes that occur within individuals. For instance, if norms show that 50% of speakers name a picture as couch, then each time a person tries to name the picture, they might have a 50% chance of selecting couch. An alternative, however, is that name agreement may simply reflect population-level sampling of more stable individual preferences (e.g., 50% of speakers prefer the name couch), continually developed through experience. One way to distinguish between these possibilities - and assess the psychological reality of name agreement - is simply to re-norm pictures with the same individuals. In Experiment 1, we therefore collected timed naming norms for a large set of line drawings from the same 25 native British English speakers twice, 1-2 weeks apart. Results show participants' name choices in Session 2 are jointly predicted by population-level name agreement, from our previous norms, and individuals' own productions in Session 1. Experiment 2 replicated this result and further showed that prior selections predicted Session 3 outcomes better than those in Session 2, in line with an incremental learning account. This is the first direct demonstration that picture name agreement has some psychological validity, but also reveals that it does not directly index within-participant lexical competition as previously assumed.

Pupillometry reveals cognitive demands of lexical competition during spoken word recognition in young and older adults

In most contemporary activation-competition frameworks for spoken word recognition, candidate words compete against phonological "neighbors" with similar acoustic properties (e.g., "cap" vs. "cat"). Thus, recognizing words with more competitors should come at a greater cognitive cost relative to recognizing words with fewer competitors, due to increased demands for selecting the correct item and inhibiting incorrect candidates. Importantly, these processes should operate even in the absence of differences in accuracy. In the present study, we tested this proposal by examining differences in processing costs associated with neighborhood density for highly intelligible items presented in quiet. A second goal was to examine whether the cognitive demands associated with increased neighborhood density were greater for older adults compared with young adults. Using pupillometry as an index of cognitive processing load, we compared the cognitive demands associated with spoken word recognition for words with many or fewer neighbors, presented in quiet, for young (n = 67) and older (n = 69) adult listeners. Growth curve analysis of the pupil data indicated that older adults showed a greater evoked pupil response for spoken words than did young adults, consistent with increased cognitive load during spoken word recognition. Words from dense neighborhoods were marginally more demanding to process than words from sparse neighborhoods. There was also an interaction between age and neighborhood density, indicating larger effects of density in young adult listeners. These results highlight the importance of assessing both cognitive demands and accuracy when investigating the mechanisms underlying spoken word recognition.

Cognitive processes underlying spoken word recognition during soft speech

In two eye-tracking experiments using the Visual World Paradigm, we examined how listeners recognize words when faced with speech at lower intensities (40, 50, and 65 dBA). After hearing the target word, participants (n = 32) clicked the corresponding picture from a display of four images - a target (e.g., money), a cohort competitor (e.g., mother), a rhyme competitor (e.g., honey) and an unrelated item (e.g., whistle) - while their eye-movements were tracked. For slightly soft speech (50 dBA), listeners demonstrated an increase in cohort activation, whereas for rhyme competitors, activation started later and was sustained longer in processing. For very soft speech (40 dBA), listeners waited until later in processing to activate potential words, as illustrated by a decrease in activation for cohorts, and an increase in activation for rhymes. Further, the extent to which words were considered depended on word length (mono- vs. bi-syllabic words), and speech-extrinsic factors such as the surrounding listening environment. These results advance current theories of spoken word recognition by considering a range of speech levels more typical of everyday listening environments. From an applied perspective, these results motivate models of how individuals who are hard of hearing approach the task of recognizing spoken words.

Microstructural plasticity in the bilingual brain

The human brain has been uniquely equipped with the remarkable ability to acquire more than one language, as in bilingual individuals. Previous neuroimaging studies have indicated that learning a second language (L2) induced neuroplasticity at the macrostructural level. In this study, using the quantitative MRI (qMRI) combined with functional MRI (fMRI) techniques, we quantified the microstructural properties and tested whether second language learning modulates the microstructure in the bilingual brain. We found significant microstructural variations related to age of acquisition of second language in the left inferior frontal region and the left fusiform gyrus that are crucial for resolving lexical competition of bilinguals' two languages. Early second language acquisition contributes to enhance cortical development at the microstructural level.

Bedding down new words: Sleep promotes the emergence of lexical competition in visual word recognition

Lexical competition processes are widely viewed as the hallmark of visual word recognition, but little is known about the factors that promote their emergence. This study examined for the first time whether sleep may play a role in inducing these effects. A group of 27 participants learned novel written words, such as banara, at 8 am and were tested on their learning at 8 pm the same day (AM group), while 29 participants learned the words at 8 pm and were tested at 8 am the following day (PM group). Both groups were retested after 24 hours. Using a semantic categorization task, we showed that lexical competition effects, as indexed by slowed responses to existing neighbor words such as banana, emerged 12 h later in the PM group who had slept after learning but not in the AM group. After 24 h the competition effects were evident in both groups. These findings have important implications for theories of orthographic learning and broader neurobiological models of memory consolidation.

From sublexical facilitation to lexical competition: ERP effects of masked neighbor priming

Interactive-activation models posit that visual word recognition involves co-activation of orthographic neighbors (e.g., note, node) and competition among them via lateral inhibitory connections. Behavioral evidence of this lexical competition comes from masked priming paradigms, in which target words elicit slower responses when preceded by a neighbor (e.g., note-NODE) than when preceded by an unrelated word (e.g., kiss-NODE). In the present study, we used ERPs to investigate how masked high frequency word primes influence processing of low frequency word and pseudoword targets. Word targets preceded by a neighbor prime elicited larger negativities within the N400 window than those preceded by an unrelated prime across bilateral anterior sites, which we call a reversed N400 priming effect. Consistent with the behavioral literature, the size of the reversed N400 priming effect was larger for targets from high-density orthographic neighborhoods and for participants who scored higher on a behavioral measure of spelling recognition. Indeed, the opposite effect (i.e., smaller negativities within the N400 window for word targets preceded by a neighbor) was observed for words from low-density orthographic neighborhoods and for less-skilled spellers. Traditional priming was also observed within the N250 window for word targets and within both the N250 or N400 windows for pseudoword targets. The specificity of the reversed N400 priming effect to situations in which both words have precise lexical representations suggests that it, like the behavioral interference effect, indexes lexical competition during visual word recognition.

Consolidating new words from repetitive versus multiple stories: Prior knowledge matters

Prior knowledge is proposed to support the consolidation of newly acquired material. The current study examined whether children with superior vocabulary knowledge show enhanced overnight consolidation, particularly when new words are encountered in varying stories. Children aged 10 and 11 years (N = 42) were exposed to two sets of eight spoken novel words (e.g., "crocodol"), with one set embedded in the same story presented twice and the other presented in two different stories. Children with superior vocabulary knowledge showed larger overnight gains in explicit phonological and semantic knowledge when novel words had been encountered in multiple stories. However, when novel words had been encountered in repetitive stories, existing knowledge exerted no influence on the consolidation of explicit phonological knowledge and had a negative impact on the consolidation of semantic knowledge. One full day (24 h) after story exposure, only very weak evidence of lexical integration (i.e., slower animacy decisions toward the basewords [e.g., "crocodile"] than toward the control words) was observed for novel words learned via repetitive (but not multiple) stories. These data suggest that although the consolidation of explicit new word knowledge learned through multiple contexts is supported by prior knowledge, lexical integration might benefit more from repetition.

Localizing semantic interference from distractor sounds in picture naming: A dual-task study

In this study we explored the locus of semantic interference in a novel picture-sound interference task in which participants name pictures while ignoring environmental distractor sounds. In a previous study using this task (Mädebach, Wöhner, Kieseler, & Jescheniak, in Journal of Experimental Psychology: Human Perception and Performance, 43, 1629-1646, 2017), we showed that semantically related distractor sounds (e.g., BARKING_dog) interfere with a picture-naming response (e.g., "horse") more strongly than unrelated distractor sounds do (e.g., DRUMMING_drum). In the experiment reported here, we employed the psychological refractory period (PRP) approach to explore the locus of this effect. We combined a geometric form classification task (square vs. circle; Task 1) with the picture-sound interference task (Task 2). The stimulus onset asynchrony (SOA) between the tasks was systematically varied (0 vs. 500 ms). There were three central findings. First, the semantic interference effect from distractor sounds was replicated. Second, picture naming (in Task 2) was slower with the short than with the long task SOA. Third, both effects were additive-that is, the semantic interference effects were of similar magnitude at both task SOAs. This suggests that the interference arises during response selection or later stages, not during early perceptual processing. This finding corroborates the theory that semantic interference from distractor sounds reflects a competitive selection mechanism in word production.

Age-related differences in resolving semantic and phonological competition during receptive language tasks

Receptive language (e.g., reading) is largely preserved in the aging brain, and semantic processes in particular may continue to develop throughout the lifespan. We investigated the neural underpinnings of phonological and semantic retrieval in older and younger adults during receptive language tasks (rhyme and semantic similarity judgments). In particular, we were interested in the role of competition on language retrieval and varied the similarities between a cue, target, and distractor that were hypothesized to affect the mental process of competition. Behaviorally, all participants responded faster and more accurately during the rhyme task compared to the semantic task. Moreover, older adults demonstrated higher response accuracy than younger adults during the semantic task. Although there were no overall age-related differences in the neuroimaging results, an Age×Task interaction was found in left inferior frontal gyrus (IFG), with older adults producing greater activation than younger adults during the semantic condition. These results suggest that at lower levels of task difficulty, older and younger adults engaged similar neural networks that benefited behavioral performance. As task difficulty increased during the semantic task, older adults relied more heavily on largely left hemisphere language regions, as well as regions involved in perception and internal monitoring. Our results are consistent with the stability of language comprehension across the adult lifespan and illustrate how the preservation of semantic representations with aging may influence performance under conditions of increased task difficulty.

The Temporal Dynamics of Spoken Word Recognition in Adverse Listening Conditions

This study examined the temporal dynamics of spoken word recognition in noise and background speech. In two visual-world experiments, English participants listened to target words while looking at four pictures on the screen: a target (e.g. candle), an onset competitor (e.g. candy), a rhyme competitor (e.g. sandal), and an unrelated distractor (e.g. lemon). Target words were presented in quiet, mixed with broadband noise, or mixed with background speech. Results showed that lexical competition changes throughout the observation window as a function of what is presented in the background. These findings suggest that, rather than being strictly sequential, stream segregation and lexical competition interact during spoken word recognition.

Toddlers' sensitivity to within-word coarticulation during spoken word recognition: Developmental differences in lexical competition

To understand speech, listeners need to be able to decode the speech stream into meaningful units. However, coarticulation causes phonemes to differ based on their context. Because coarticulation is an ever-present component of the speech stream, it follows that listeners may exploit this source of information for cues to the identity of the words being spoken. This research investigates the development of listeners' sensitivity to coarticulation cues below the level of the phoneme in spoken word recognition. Using a looking-while-listening paradigm, adults and 2- and 3-year-old children were tested on coarticulation cues that either matched or mismatched the target. Both adults and children predicted upcoming phonemes based on anticipatory coarticulation to make decisions about word identity. The overall results demonstrate that coarticulation cues are a fundamental component of children's spoken word recognition system. However, children did not show the same resolution as adults of the mismatching coarticulation cues and competitor inhibition, indicating that children's processing systems are still developing.

Lexical inhibition of neighbors during visual word recognition: an unmasked priming investigation

Two experiments investigated the lexical inhibitory effect of orthographic neighbors relative to identity priming effects in an unmasked priming paradigm combined with a lexical decision task on word targets. Targets were preceded either by the same word, by a lower frequency orthographic word neighbor, by an orthographic pseudoword neighbor or by an unrelated prime. Experiment 1 showed a standard facilitatory effect from identity primes, whereas inhibitory priming effects were observed for both types of neighbor primes. Experiment 2 examined the time-course of these effects by using event-related potential recordings. A generalized relatedness effect was found in the 200-400 ms time-window, with smaller negativities generated by related primes than unrelated primes regardless of prime type. In contrast, at 400 ms, while identity primes were associated with smaller negativities than unrelated primes, word neighbor primes were associated with greater negativities than unrelated primes. Additionally, pseudoword neighbor primes produce null effects as compared to unrelated primes. These results are discussed in terms of competition between activated lexical representations and revealed that such a mechanism is modulated by the lexical status of the prime.

Developmental differences in the influence of phonological similarity on spoken word processing in Mandarin Chinese

The developmental trajectory of spoken word recognition has been well established in Indo-European languages, but to date remains poorly characterized in Mandarin Chinese. In this study, typically developing children (N=17; mean age 10; 5) and adults (N=17; mean age 24) performed a picture-word matching task in Mandarin while we recorded ERPs. Mismatches diverged from expectations in different components of the Mandarin syllable; namely, word-initial phonemes, word-final phonemes, and tone. By comparing responses to different mismatch types, we uncovered evidence suggesting that both children and adults process words incrementally. However, we also observed key developmental differences in how subjects treated onset and rime mismatches. This was taken as evidence for a stronger influence of top-down processing on spoken word recognition in adults compared to children. This work therefore offers an important developmental component to theories of Mandarin spoken word recognition.

Infant word recognition: Insights from TRACE simulations

The TRACE model of speech perception (McClelland & Elman, 1986) is used to simulate results from the infant word recognition literature, to provide a unified, theoretical framework for interpreting these findings. In a first set of simulations, we demonstrate how TRACE can reconcile apparently conflicting findings suggesting, on the one hand, that consonants play a pre-eminent role in lexical acquisition (Nespor, Peña & Mehler, 2003; Nazzi, 2005), and on the other, that there is a symmetry in infant sensitivity to vowel and consonant mispronunciations of familiar words (Mani & Plunkett, 2007). In a second series of simulations, we use TRACE to simulate infants' graded sensitivity to mispronunciations of familiar words as reported by White and Morgan (2008). An unexpected outcome is that TRACE fails to demonstrate graded sensitivity for White and Morgan's stimuli unless the inhibitory parameters in TRACE are substantially reduced. We explore the ramifications of this finding for theories of lexical development. Finally, TRACE mimics the impact of phonological neighbourhoods on early word learning reported by Swingley and Aslin (2007). TRACE offers an alternative explanation of these findings in terms of mispronunciations of lexical items rather than imputing word learning to infants. Together these simulations provide an evaluation of Developmental (Jusczyk, 1993) and Familiarity (Metsala, 1999) accounts of word recognition by infants and young children. The findings point to a role for both theoretical approaches whereby vocabulary structure and content constrain infant word recognition in an experience-dependent fashion, and highlight the continuity in the processes and representations involved in lexical development during the second year of life.

Semantic interference in language production is due to graded similarity, not response relevance

There is an ongoing debate on the question whether semantic interference effects in language production reflect competitive processes at the level of lexical selection or whether they reflect a post-lexical bottleneck, occupied in particular by response-relevant distractor words. To disentangle item-inherent categorical relatedness and task-related response relevance effects, we combined the picture-word interference task with the conditional naming paradigm in an orthogonal design, varying categorical relatedness and task-related response relevance independent of each other. Participants were instructed to name only objects that are typically seen in or on the water (e.g. canoe) and refrain from naming objects that are typically located outside the water (e.g. bike), and vice versa. Semantic relatedness and the response relevance of superimposed distractor words were manipulated orthogonally. The pattern of results revealed no evidence for response relevance as a major source of semantic interference effects in the PWI paradigm. In contrast, our data demonstrate that semantic similarity beyond categorical relations is critical for interference effects to be observed. Together, these findings provide support for the assumption that lexical selection is competitive and that semantic interference effects in the PWI paradigm reflect this competition.

An fMRI examination of the effects of acoustic-phonetic and lexical competition on access to the lexical-semantic network

The current study explored how factors of acoustic-phonetic and lexical competition affect access to the lexical-semantic network during spoken word recognition. An auditory semantic priming lexical decision task was presented to subjects while in the MR scanner. Prime-target pairs consisted of prime words with the initial voiceless stop consonants /p/, /t/, and /k/ followed by word and nonword targets. To examine the neural consequences of lexical and sound structure competition, primes either had voiced minimal pair competitors or they did not, and they were either acoustically modified to be poorer exemplars of the voiceless phonetic category or not. Neural activation associated with semantic priming (Unrelated-Related conditions) revealed a bilateral fronto-temporo-parietal network. Within this network, clusters in the left insula/inferior frontal gyrus (IFG), left superior temporal gyrus (STG), and left posterior middle temporal gyrus (pMTG) showed sensitivity to lexical competition. The pMTG also demonstrated sensitivity to acoustic modification, and the insula/IFG showed an interaction between lexical competition and acoustic modification. These findings suggest the posterior lexical-semantic network is modulated by both acoustic-phonetic and lexical structure, and that the resolution of these two sources of competition recruits frontal structures.