Recognizing non-native spoken words in background noise increases interference from the native language

Listeners frequently recognize spoken words in the presence of background noise. Previous research has shown that noise reduces phoneme intelligibility and hampers spoken-word recognition - especially for non-native listeners. In the present study, we investigated how noise influences lexical competition in both the non-native and the native language, reflecting the degree to which both languages are co-activated. We recorded the eye movements of native Dutch participants as they listened to English sentences containing a target word while looking at displays containing four objects. On target-present trials, the visual referent depicting the target word was present, along with three unrelated distractors. On target-absent trials, the target object (e.g., wizard) was absent. Instead, the display contained an English competitor, overlapping with the English target in phonological onset (e.g., window), a Dutch competitor, overlapping with the English target in phonological onset (e.g., wimpel, pennant), and two unrelated distractors. Half of the sentences was masked by speech-shaped noise; the other half was presented in quiet. Compared to speech in quiet, noise delayed fixations to the target objects on target-present trials. For target-absent trials, we observed that the likelihood for fixation biases towards the English and Dutch onset competitors (over the unrelated distractors) was larger in noise than in quiet. Our data thus show that the presence of background noise increases lexical competition in the task-relevant non-native (English) and in the task-irrelevant native (Dutch) language. The latter reflects stronger interference of one's native language during non-native spoken-word recognition under adverse conditions.

First Language Matters: Event-Related Potentials Show Crosslinguistic Influence on the Processing of Placement Verb Semantics

Second language (L2) learners experience challenges when word meanings differ across L1 and L2, and often display crosslinguistic influence (CLI) in speech production. In contrast, studies of online comprehension show more mixed results. Therefore, this study explored how L2 learners process fine-grained L2 verb semantics in the domain of caused motion (placement) and specifically the impact of having similar vs. non-similar semantics in the L1 and L2. Specifically, we examined English (20) and German (21) L2 learners of Swedish and native Swedish speakers (16) and their online neurophysiological processing and offline appropriateness ratings of three Swedish placement verbs obligatory for placement supported from below: sätta "set," ställa "stand," and lägga "lay." The learners' L1s differed from Swedish in that their placement verbs either shared or did not share semantic characteristics with the target language. English has a general placement verb put, whereas German has specific verbs similar but not identical to Swedish, stellen "set/stand" and legen "lay." Event-related potentials (ERPs) were recorded while participants watched still frames (images) of objects being placed on a table and listened to sentences describing the event with verbs that either matched the image or not. Participants also performed an offline appropriateness rating task. Both tasks suggested CLI. English learners' appropriateness ratings of atypical verb use differed from those of both native Swedish speakers' and German learners, with no difference in the latter pair. Similarly, German learners' ERP effects were more similar to those of the native Swedish speakers (increased lateral negativity to atypical verb use) than to those of the English learners (increased positivity to atypical verb use). The results of this explorative study thus suggest CLI both offline and online with similarity between L1 and L2 indicating more similar processing and judgments, in line with previous production findings, but in contrast to previous ERP work on semantic L2 processing.

Visual word recognition in bilinguals: Eye-tracking evidence that L2 proficiency impacts access of L1 phonotactics

A bilingual's language system is highly interactive. When hearing a second language (L2), bilinguals access native-language (L1) words that share sounds across languages. In the present study, we examine whether input modality and L2 proficiency moderate the extent to which bilinguals activate L1 phonotactic constraints (i.e., rules for combining speech sounds) during L2 processing. Eye-movements of English monolinguals and Spanish-English bilinguals were tracked as they searched for a target English word in a visual display. On critical trials, displays included a target that conflicted with the Spanish vowel-onset rule (e.g., sp a), as well as a competitor containing the potentially-activated 'e' onset (e.g., e gg). The rule violation was processed either in the visual modality (Experiment 1) or audio-visually (Experiment 2). In both experiments, bilinguals with lower L2 proficiency made more eye movements to competitors than fillers. Findings suggest that bilinguals who have lower L2 proficiency access L1 phonotactic constraints during L2 visual word processing with and without auditory input of the constraint-conflicting structure (e.g., spa). We conclude that the interactivity between a bilingual's two languages is not limited to words that share form across languages, but also extends to sub-lexical, rule-based structures.

Do Age and Linguistic Status Alter the Effect of Sound Source Diffuseness on Speech Recognition in Noise?

One aspect of auditory scenes that has received very little attention is the level of diffuseness of sound sources. This aspect has increasing importance due to growing use of amplification systems. When an auditory stimulus is amplified and presented over multiple, spatially-separated loudspeakers, the signal's timbre is altered due to comb filtering. In a previous study we examined how increasing the diffuseness of the sound sources might affect listeners' ability to recognize speech presented in different types of background noise. Listeners performed similarly when both the target and the masker were presented via a similar number of loudspeakers. However, performance improved when the target was presented using a single speaker (compact) and the masker from three spatially separate speakers (diffuse) but worsened when the target was diffuse, and the masker was compact. In the current study, we extended our research to examine whether the effects of timbre changes with age and linguistic experience. Twenty-four older adults whose first language was English (Old-EFLs) and 24 younger adults whose second language was English (Young-ESLs) were asked to repeat non-sense sentences masked by either Noise, Babble, or Speech and their results were compared with those of the Young-EFLs previously tested. Participants were divided into two experimental groups: (1) A Compact-Target group where the target sentences were presented over a single loudspeaker, while the masker was either presented over three loudspeakers or over a single loudspeaker; (2) A Diffuse-Target group, where the target sentences were diffuse while the masker was either compact or diffuse. The results indicate that the Target Timbre has a negligible effect on thresholds when the timbre of the target matches the timbre of the masker in all three groups. When there is a timbre contrast between target and masker, thresholds are significantly lower when the target is compact than when it is diffuse for all three listening groups in a Noise background. However, while this difference is maintained for the Young and Old-EFLs when the masker is Babble or Speech, speech reception thresholds in the Young-ESL group tend to be equivalent for all four combinations of target and masker timbre.

Biliteracy and acquisition of novel written words: the impact of phonological conflict between L1 and L2 scripts

The acquisition of new orthographic representations is a rapid and accurate process in proficient monolingual readers. The present study used biliterate and bialphabetic population to address the impact of phonological inconsistencies across the native (L1) and second (L2) alphabets. Naming latencies were collected from 50 Russian-English biliterates through a reading-aloud task with familiar and novel word forms repeated across 10 blocks. There were three Script conditions: (1) native Cyrillic, (2) non-native Roman, and (3) Ambiguous (with graphically identical, but phonologically inconsistent graphemes shared by both alphabets). Our analysis revealed the main effect of Script on both reading and orthographic learning: naming latencies during training were longer for the ambiguous stimuli, particularly for the novel ones. Nonetheless, novel word forms in the ambiguous condition approached the latencies for the familiar words along the exposures, although this effect was faster in the phonologically consistent trials. Post-training tests revealed similarly successful performance patterns for previously familiar and newly trained forms, indicating successful rapid acquisition of the latter. Furthermore, we found the highest free recall rates for the ambiguous stimuli. Overall, our results indicate that phonological inconsistency initially interferes with the efficiency of novel word encoding. Nevertheless, it does not prevent efficient attribution of orthographic representations; instead, the knowledge of two distinct alphabets supports a more efficient learning and a better memory for ambiguous stimuli via enhancing their encoding and retrieval.

Context Effect on L2 Word Recognition: Visual Versus Auditory Modalities

This study tested the effect of constraining sentence context on word recognition time (RT) in the first and second language. Native (L1) and nonnative (L2) speakers of English performed self-paced reading and listening tasks to see whether a semantically-rich preceding context would lead to the activation of a probable upcoming word prior to encountering it. The pre-access prediction model (e.g., Altmann and Kamide in Cognition 73(3):247-264, 1999; McClelland and Rumelhart in Psychol Rev 88:375-407, 1981) posits that when the preceding context is semantically high-constraining, the perceptual system anticipates a probable upcoming word prior to encountering it. In contrast, the post-access model (e.g., Fodor in The modularity of mind, MIT Press, Cambridge, 1983; Forster in Q J Exp Psychol Sect A 33(4):465-495, 1981; Traxler et al. in J Psycholinguist Res 29(6):581-595, 2000; Van Petten and Luka in Int J Psychophysiol 83(2): 176-190, 2012) suggests that it is only after a word is encountered that a subsequent process integrates it into the preceding context. The integration process is easier and faster when the word is more congruent with the preceding context. In line with these two models of visual word recognition, auditory word recognition is modeled by the TRACE model (McClelland and Elman in Cogn Psychol 18(1):1-86, 1986), which suggests that a spoken word is influenced by the preceding sentence context, whereas models such as the cohort model (Marslen-Wilson in Cognition 25(1-2):71-102, 1987) support a post-access integration process. Some studies observe a facilitative effect of sentence context on L2 word recognition (e.g., Kamide et al. in J Mem Lang 49(1):133-156, 2003), while others find no effect of sentence context in L2 (e.g., Ito et al. in Lang Cogn Neurosci 32(8):954-965, 2017; Martin et al. in J Mem Lang 69(4):574-588, 2013). In the present experiments, the RTs of native English speakers (L1) and non-native English speakers (L2) were collected in both visual and auditory word recognition in semantically high-constraint sentences and semantically low-constraint sentences. A linear, mixed-effects model shows that both groups of participants are faster to recognize a word when it is preceded by a semantically high-constraining context. This result is observed in both the visual and the auditory modalities, lending some support for a mechanism facilitating the access of target words based on sentence context in both L1 and L2.

Zooming in on zooming out: Partial selectivity and dynamic tuning of bilingual language control during reading

Prominent models of bilingual visual word recognition posit a bottom-up nonselective view of lexical processing with parallel access to lexical candidates of both languages. However, these accounts do not accommodate recent findings of top-down effects on the relative global activation level of each language during bilingual reading. We conducted two eye-tracking experiments to systematically assess the degree of accessibility of each language in different global language contexts. When critical words were presented overtly in Experiment 1, code switches disrupted reading early during lexical processing, but not as much as pseudowords did. Participants zoomed out of the target language with increasing exposure to language switches. In Experiment 2, a monolingual language context was created by presenting critical words covertly as parafoveal previews. Here, code-switched words were treated like pseudowords, and participants remained zoomed in to the target language throughout the experiment. Switch direction analyses confirmed and extended these interpretations to provide further support for the role of global language control on lexical access, above and beyond effects due to proficiency differences across languages. Together, these data provide strong evidence for dynamic top-down adjustment of the degree of language selectivity during bilingual reading.

Item Bias: Predictors of Accuracy on Peabody Picture Vocabulary Test-Fourth Edition Items for Spanish-English-Speaking Children

Purpose This study examines the response patterns of 278 Spanish-English dual language learners (DLLs) on a standardized test of receptive English vocabulary. Method Investigators analyzed responses to 131 items on the Peabody Picture Vocabulary Test-Fourth Edition ( Dunn & Dunn, 2007 ) focusing on differential accuracy on items influenced by (a) cross-linguistic overlap in phonology, (b) part of speech, and (c) word frequency. Results The differential response patterns showed cross-linguistic overlap, part of speech, and word frequency were significant predictors of the likelihood of obtaining a correct response above and beyond the expected difficulty level of the item. Conclusions All 3 factors predicted DLLs' response patterns beyond expected difficulty. Items with the highest likelihood of error included words with few or no shared features between Spanish and English translation equivalents, verbs or modifiers, and words with low frequency of occurrence. Implications Researchers should consider a cross-linguistic overlap in addition to part of speech and word frequency when designing vocabulary assessments for DLLs or utilizing such tests in research and clinical practice. Recognizing potential bias, clinicians should triangulate the appraisal of DLLs' language skills across multiple sources or measures and use caution when interpreting vocabulary assessments.

Confusing similar words: ERP correlates of lexical-semantic processing in first language attrition and late second language acquisition

First language (L1) attrition is a socio-linguistic circumstance where second language (L2) learning coincides with changes in exposure and use of the native-L1. Attriters often report experiencing a decline in automaticity or proficiency in their L1 after a prolonged period in the L2 environment, while their L2 proficiency continues to strengthen. Investigating the neurocognitive correlates of attrition alongside those of late L2 acquisition addresses the question of whether the brain mechanisms underlying both L1 and L2 processing are strongly determined by proficiency, irrespective of whether the language was acquired from birth or in adulthood. Using event-related-potentials (ERPs), we examined lexical-semantic processing in Italian L1 attriters, compared to adult Italian L2 learners and to Italian monolingual native speakers. We contrasted the processing of classical lexical-semantic violations (Mismatch condition) with sentences that were equally semantically implausible but arguably trickier, as the target-noun was "swapped" with an orthographic neighbor that differed only in its final vowel and gender-marking morpheme (e.g., cappello (hat) vs. cappella (chapel)). Our aim was to determine whether sentences with such "confusable nouns" (Swap condition) would be processed as semantically correct by late L2 learners and L1 attriters, especially for those individuals with lower Italian proficiency scores. We found that lower-proficiency Italian speakers did not show significant N400 effects for Swap violations relative to correct sentences, regardless of whether Italian was the L1 or the L2. Crucially, N400 response profiles followed a continuum of "nativelikeness" predicted by Italian proficiency scores - high-proficiency attriters and high-proficiency Italian learners were indistinguishable from native controls, whereas attriters and L2 learners in the lower-proficiency range showed significantly reduced N400 effects for "Swap" errors. Importantly, attriters and late L2 learners did not differ in their N400 responses when they belonged to the same proficiency subgroup. Attriters also showed an enhanced P600 response to both kinds of lexical-semantic anomalies, which we discuss as reflecting increased conflict-monitoring and conscious "second thought" processes specifically in attriters. Our findings provide some of the first ERP evidence of attrition effects, and are compatible with accounts of ongoing neuroplasticity for language in adulthood. Proficiency, rather than age-of-acquisition, seems to be the key factor in modulating certain neurocognitive responses, not only within L2 learners but also in L1 attriters.

Bilinguals implicitly name objects in both their languages: an ERP study

Upon being presented with a familiar name-known image, monolingual infants and adults implicitly generate the image's label (Meyer et al., 2007; Mani and Plunkett, 2010, 2011; Mani et al., 2012a). Although the cross-linguistic influences on overt bilingual production are well studied (for a summary see Colomé and Miozzo, 2010), evidence that bilinguals implicitly generate the label for familiar objects in both languages remains mixed. For example, bilinguals implicitly generate picture labels in both of their languages, but only when tested in L2 and not L1 (Wu and Thierry, 2011) or when immersed in their L2 (Spivey and Marian, 1999; Marian and Spivey, 2003a,b) but not when immersed in their L1 (Weber and Cutler, 2004). The current study tests whether bilinguals implicitly generate picture labels in both of their languages when tested in their L1 with a cross-modal ERP priming paradigm. The results extend previous findings by showing that not just do bilinguals implicitly generate the labels for visually fixated images in both of their languages when immersed in their L1, but also that these implicitly generated labels in one language can prime recognition of subsequently presented auditory targets across languages (i.e., L2–L1). The current study provides support for cascaded models of lexical access during speech production, as well as a new priming paradigm for the study of bilingual language processing.

The Bilingual Language Interaction Network for Comprehension of Speech

During speech comprehension, bilinguals co-activate both of their languages, resulting in cross-linguistic interaction at various levels of processing. This interaction has important consequences for both the structure of the language system and the mechanisms by which the system processes spoken language. Using computational modeling, we can examine how cross-linguistic interaction affects language processing in a controlled, simulated environment. Here we present a connectionist model of bilingual language processing, the Bilingual Language Interaction Network for Comprehension of Speech (BLINCS), wherein interconnected levels of processing are created using dynamic, self-organizing maps. BLINCS can account for a variety of psycholinguistic phenomena, including cross-linguistic interaction at and across multiple levels of processing, cognate facilitation effects, and audio-visual integration during speech comprehension. The model also provides a way to separate two languages without requiring a global language-identification system. We conclude that BLINCS serves as a promising new model of bilingual spoken language comprehension.

How reading in a second language protects your heart

Reading words in a second language spontaneously activates native language translations in the human bilingual mind. Here, we show that the emotional valence of a word presented in English constrains unconscious access to its Chinese translation. We asked native speakers of Chinese fluent with English to indicate whether or not pairs of English words were related in meaning while monitoring their brain electrical activity. Unbeknownst to the participants, some of the word pairs hid a sound repetition if translated into Chinese. Remarkably, English words with a negative valence such as "violence" did not automatically activate their Chinese translation, even though we observed the expected sound repetition priming effect for positive and neutral words, such as "holiday" and "theory." These findings show that emotion conveyed by words determines language activation in bilinguals, where potentially disturbing stimuli trigger inhibitory mechanisms that block access to the native language.

Introducing LexTALE: a quick and valid Lexical Test for Advanced Learners of English

The increasing number of experimental studies on second language (L2) processing, frequently with English as the L2, calls for a practical and valid measure of English vocabulary knowledge and proficiency. In a large-scale study with Dutch and Korean speakers of L2 English, we tested whether LexTALE, a 5-min vocabulary test, is a valid predictor of English vocabulary knowledge and, possibly, even of general English proficiency. Furthermore, the validity of LexTALE was compared with that of self-ratings of proficiency, a measure frequently used by L2 researchers. The results showed the following in both speaker groups: (1) LexTALE was a good predictor of English vocabulary knowledge; 2) it also correlated substantially with a measure of general English proficiency; and 3) LexTALE was generally superior to self-ratings in its predictions. LexTALE, but not self-ratings, also correlated highly with previous experimental data on two word recognition paradigms. The test can be carried out on or downloaded from www.lextale.com .