Once is Enough: N400 Indexes Semantic Integration of Novel Word Meanings from a Single Exposure in Context

Auditory associative word learning in adults: The effects of musical experience and stimulus ordering

Evidence for sequential associative word learning in the auditory domain has been identified in infants, while adults have shown difficulties. To better understand which factors may facilitate adult auditory associative word learning, we assessed the role of auditory expertise as a learner-related property and stimulus order as a stimulus-related manipulation in the association of auditory objects and novel labels. We tested in the first experiment auditorily-trained musicians versus athletes (high-level control group) and in the second experiment stimulus ordering, contrasting object-label versus label-object presentation. Learning was evaluated from Event-Related Potentials (ERPs) during training and subsequent testing phases using a cluster-based permutation approach, as well as accuracy-judgement responses during test. Results revealed for musicians a late positive component in the ERP during testing, but neither an N400 (400-800 ms) nor behavioral effects were found at test, while athletes did not show any effect of learning. Moreover, the object-label-ordering group only exhibited emerging association effects during training, while the label-object-ordering group showed a trend-level late ERP effect (800-1200 ms) during test as well as above chance accuracy-judgement scores. Thus, our results suggest the learner-related property of auditory expertise and stimulus-related manipulation of stimulus ordering modulate auditory associative word learning in adults.

The Neural Correlates of Embodied L2 Learning: Does Embodied L2 Verb Learning Affect Representation and Retention?

We investigated how naturalistic actions in a highly immersive, multimodal, interactive 3D virtual reality (VR) environment may enhance word encoding by recording EEG in a pre/post-test learning paradigm. While behavior data have shown that coupling word encoding with gestures congruent with word meaning enhances learning, the neural underpinnings of this effect have yet to be elucidated. We coupled EEG recording with VR to examine whether embodied learning improves learning and creates linguistic representations that produce greater motor resonance. Participants learned action verbs in an L2 in two different conditions: specific action (observing and performing congruent actions on virtual objects) and pointing (observing actions and pointing to virtual objects). Pre- and post-training participants performed a match-mismatch task as we measured EEG (variation in the N400 response as a function of match between observed actions and auditory verbs) and a passive listening task while we measured motor activation (mu [8-13 Hz] and beta band [13-30 Hz] desynchronization during auditory verb processing) during verb processing. Contrary to our expectations, post-training results revealed neither semantic nor motor effects in either group when considered independently of learning success. Behavioral results showed a great deal of variability in learning success. When considering performance, low performance learners showed no semantic effect and high performance learners exhibited an N400 effect for mismatch versus match trials post-training, independent of the type of learning. Taken as a whole, our results suggest that embodied processes can play an important role in L2 learning.

New in, old out: Does learning a new language make you forget previously learned foreign languages?

Anecdotal evidence suggests that learning a new foreign language (FL) makes you forget previously learned FLs. To seek empirical evidence for this claim, we tested whether learning words in a previously unknown L3 hampers subsequent retrieval of their L2 translation equivalents. In two experiments, Dutch native speakers with knowledge of English (L2), but not Spanish (L3), first completed an English vocabulary test, based on which 46 participant-specific, known English words were chosen. Half of those were then learned in Spanish. Finally, participants' memory for all 46 English words was probed again in a picture naming task. In Experiment 1, all tests took place within one session. In Experiment 2, we separated the English pre-test from Spanish learning by a day and manipulated the timing of the English post-test (immediately after learning vs. 1 day later). By separating the post-test from Spanish learning, we asked whether consolidation of the new Spanish words would increase their interference strength. We found significant main effects of interference in naming latencies and accuracy: Participants speeded up less and were less accurate to recall words in English for which they had learned Spanish translations, compared with words for which they had not. Consolidation time did not significantly affect these interference effects. Thus, learning a new language indeed comes at the cost of subsequent retrieval ability in other FLs. Such interference effects set in immediately after learning and do not need time to emerge, even when the other FL has been known for a long time.

Neural manifestation of L2 novel concept acquisition from multi-contexts via both episodic memory and semantic memory systems

This study aims to examine the process of L2 novel word learning through the combination of episodic and semantic memory, and how the process differs between the formation of thematic and taxonomic relations. The major approach adopted was observing the neural effects of word learning, which is manifested in the N400 from event-related potentials (ERPs). Eighty-eight participants were recruited for the experiment. In the learning session, L2 contextual discourses related to novel words were learned by participants. In the testing session, discourses embedded with incongruous and congruous novel words in the final position were used for participants to judge the congruency which affected the N400 neural activity. The results showed that both recurrent and new-theme discourses elicited significant N400 effects, while taxonomic sentences did not. These results confirmed the formation of episodic and semantic memory during L2 new word learning, in which semantic memory was mainly supported by thematic relations.

Nuances of knowing: Brain potentials reveal implicit effects of domain knowledge on word processing in the absence of sentence-level knowledge

In previous work investigating the relationship between domain knowledge (of the fictional world of Harry Potter) and sentence comprehension, domain knowledge had a greater impact on electrical brain potentials to words which completed sentences about fictional "facts" participants reported they did not know compared to facts they did. This suggests that individuals use domain knowledge continuously to activate relevant/related concepts as they process sentences, even with only partial knowledge. As that study relied on subjective reports, it may have resulted in response bias related to an individual's overall domain knowledge. In the present study, we therefore asked participants with varying degrees of domain knowledge to complete sentences describing fictional "facts" as an objective measure of sentence-level knowledge. We then recorded EEG as the same individuals (re-)read the same sentences, including their appropriate final words, and sorted these according to their objective knowledge scores. Replicating and extending Troyer et al., domain knowledge immediately facilitated access to meaning for unknown words; greater domain knowledge was associated with reduced N400 amplitudes for unknown words. These findings constitute novel evidence for graded preactivation of conceptual knowledge (e.g., at the level of semantic features and/or relations) in the absence of lexical prediction. Knowledge also influenced post-N400 memory/integration processes for these same unknown words; greater domain knowledge was associated with enhanced late positive components (LPCs), suggesting that deeper encoding during language processing may be engendered when knowledgeable individuals encounter an apparent gap in their knowledge.

No frills: Simple regularities in language can go a long way in the development of word knowledge

Recent years have seen a flourishing of Natural Language Processing models that can mimic many aspects of human language fluency. These models harness a simple, decades-old idea: It is possible to learn a lot about word meanings just from exposure to language, because words similar in meaning are used in language in similar ways. The successes of these models raise the intriguing possibility that exposure to word use in language also shapes the word knowledge that children amass during development. However, this possibility is strongly challenged by the fact that models use language input and learning mechanisms that may be unavailable to children. Across three studies, we found that unrealistically complex input and learning mechanisms are unnecessary. Instead, simple regularities of word use in children's language input that they have the capacity to learn can foster knowledge about word meanings. Thus, exposure to language may play a simple but powerful role in children's growing word knowledge. A video abstract of this article can be viewed at https://youtu.be/dT83dmMffnM. RESEARCH HIGHLIGHTS: Natural Language Processing (NLP) models can learn that words are similar in meaning from higher-order statistical regularities of word use. Unlike NLP models, infants and children may primarily learn only simple co-occurrences between words. We show that infants' and children's language input is rich in simple co-occurrence that can support learning similarities in meaning between words. We find that simple co-occurrences can explain infants' and children's knowledge that words are similar in meaning.

The influence of conceptual concreteness on the reading acquisition and integration of novel words into semantic memory via thematic relations

Plenty of studies have been conducted to reveal neurocognitive underpinnings of conceptual representation. Compared with that of concrete concepts, the neurocognitive correlates of abstract concepts remain elusive. The current study aimed to investigate the influence of conceptual concreteness on the reading acquisition and integration of novel words into semantic memory. We constructed two-sentence contexts in which two-character pseudowords were embedded as novel words. Participants read the contexts to infer the meaning of novel words which were either concrete or abstract, and then performed a lexical decision task and a cued-recall memory task. In lexical decision task, primed by the learned novel words, their corresponding concepts, thematically related or unrelated words as well as unlearned pseudowords were judged whether they were words or not. In memory task, participants were presented with the novel words and asked to write down their meaning. The contextual reading and memory test can demonstrate the modulation of conceptual concreteness on novel word learning and the lexical decision task can reveal whether concrete and abstract novel words are integrated into semantic memory similarly or not. During contextual reading, abstract novel words presented for the first time elicited a larger N400 than concrete ones. In memory task, the meaning of concrete novel words was recollected better than abstract novel words. These results indicate that abstract novel words are more difficult to acquire during contextual reading, and to retain afterwards. For lexical decision task behavioral and ERPs were graded, with the longest reaction time, the lowest accuracy and the largest N400s for the unrelated words, then the thematically related words and finally the corresponding concepts of the novel words, regardless of conceptual concreteness. The results suggest that both concrete and abstract novel words can be integrated into semantic memory via thematic relations. These findings are discussed in terms of differential representational framework which posits that concrete words connect with each other via semantic similarities, and abstract ones via thematic relations.

Readers scrutinize lexical familiarity only in the absence of expectations: Evidence from lexicality effects on event-related potentials

Readers generate predictions about the meaning of upcoming words while reading constraining sentences. These predictions feed down to predictions about orthographic form. For example, orthographic neighbors of predicted words yield reduced N400 amplitudes compared to non-neighbors regardless of lexical status (Laszlo & Federmeier, 2009). We investigated whether readers are sensitive to lexicality in low constraint sentences when they must scrutinize the perceptual input more closely for word recognition. In a replication and extension of Laszlo and Federmeier (2009), we observed similar patterns as the original study in high constraint sentences, but found a lexicality effect in low constraint sentences that was not present when the sentence was highly constraining. This suggests that, in the absence of strong expectations, readers adopt a different reading strategy to scrutinize the structure of words more in depth to make sense of what they have read compared to when they encounter a supportive sentence context.

Cascades in language acquisition: Re-thinking the linear model of development

The first 5 years of life are characterized by incredible growth across domains of child development. Drawing from over 50 years of seminal research, this chapter contextualizes recent advances in language sciences through the lens of developmental cascades to explore complexities and connections in acquisition. Converging evidence-both classic and contemporary-points to the many ways in which advances in one learning system can pose significant and lasting impacts on the advances in other learning systems. This chapter reviews evidence in developmental literature from multiple domains and disciplines (i.e., cognitive, social, motor, bilingual language learning, and communication sciences and disorders) to examine the phenomenon of developmental cascades in language acquisition.

Developmental differences in EEG oscillations supporting the identification of novel word meaning from context

Implicit learning about new words by picking up on associative information in the contexts they appear in is an important aspect of vocabulary growth. The current study investigated the neural correlates that underlie how school-aged children and adolescents identify the meaning of novel words embedded within sentence contexts. Importantly, we examine how differences in the brain response to novel words and their context differ as a function of 1) explicit learning success, i.e., whether novel word meanings can be correctly estimated in isolation after a learning opportunity, and 2) individual differences in offline language aptitude as well as age across our cohort (N = 82; 8-16 years). Using a regression-based analysis, we identified the unique influence of these individuals difference metrics by using both measures within the same series of models. The most notable finding from our analysis was a frequency-specific dissociation between the way age and language abilities held relationships with task-relevant oscillatory activity during the novel word meaning task: language abilities associated with task-relevant changes in beta band activity during sentence processing, while age associated with task-relevant changes in theta band activity during pseudoword processing. These effects reflect the how the neural correlates of mapping semantic meaning from sentence contexts-an important skill for word learning-is uniquely influenced by the maturity of language abilities as well as age.

Learning new meanings for known L2 words: Long‐term semantic representation is updated to integrate new information after consolidation

Previous research about learning new meanings for known words in second language (L2) has found that semantic relatedness, i.e., congruency, between new and existing meanings benefits encoding and explicit memory of new meanings, and reduces instant interference on accessing existing meanings. However, they did not take the memory consolidation process into account. Thus, integration of new meaning into long-term semantic memory, update of existing meaning representation, and the impact of semantic relatedness between new and existing meanings in this process remain unclear. The present study used the event-related potential (ERP) technique to explore these questions. We asked Chinese students to learn English known words' subdominant meanings variedly related to existing meanings and probed semantic representations with EEG recorded in primed lexical decision tasks four times before and after consolidation. We found that new meaning needs to go through offline consolidation to get integrated. Semantic relatedness/congruency boosted new meaning integration, not by directly expediting it during encoding or preliminary offline consolidation, but by promoting the update of existing meaning representation first, which presumably paved the way for better incorporation of new meaning in the long run. The whole pattern of results implies that long-term semantic representation of existing meaning is updated to integrate related new meaning after consolidation, which not only draws a clearer picture of L2 ambiguous word acquisition but also bears broader implications for research on memory updating.

The electrophysiological correlates of word pre-activation during associative word learning

Human beings continuously make use of learned associations to generate predictions about future occurrences in the environment. Such memory-related predictive processes provide a scaffold for learning in that mental representations of foreseeable events can be adjusted or strengthened based on a specific outcome. Learning the meaning of novel words through picture-word associations constitutes a prime example of associative learning because pictures preceding words can trigger word prediction through the pre-activation of the related mnemonic representations. In the present electroencephalography (EEG) study, we used event-related potentials (ERPs) to compare neural indices of word pre-activation between a word learning condition with maximal prediction likelihood and a non-learning control condition with low prediction. Results revealed that prediction-related N400 amplitudes in response to pictures decreased over time at central electrodes as a function of word learning, whereas late positive component (LPC) amplitudes increased. Notably, N400 but not LPC changes were also predictive of word learning performance, suggesting that the N400 component constitutes a sensitive marker of word pre-activation during associative word learning.

Acquisition of novel word meaning via cross situational word learning: An event-related potential study

Cross-situational statistical word learning (CSWL) refers to the process whereby participants learn new words by tracking ambiguous word-object co-occurrences across time. This study used event-related potentials to explore the acquisition of novel word meanings via CSWL in healthy adults. After learning to associate novel auditory words (e.g., 'ket') with familiar objects (e.g., sword), participants performed a semantic judgement task where the learned novel words were paired with a familiar word belonging to either the same (e.g., dagger) or a different (e.g., harp) semantic category. As a comparison, the task also included word pairs comprising two familiar words. The analyses revealed that the unrelated novel word pairs elicited a similar N400 to that of the unrelated familiar word pairs, but with a different hemispheric distribution (left hemisphere for novel words, right hemisphere for familiar words). These findings demonstrate rapid meaning acquisition via CSWL, which is reflected at a neurophysiological level.

Age-related differences in expectation-based novel word learning

Adult language users can infer the meaning of a previously unfamiliar word from a single exposure to this word in a semantically and thematically constrained context, henceforth, predictive context (Borovsky et al., 2010 Cognition, 116(2), 289-296; Borovsky et al., 2012 Language Learning and Development, 8(3), 278-302). Children use predictive contexts to anticipate upcoming stimuli (Borovsky et al., 2012 Language Learning and Development, 8(3), 278-302; Mani & Huettig, 2012 Journal of Experimental Psychology: Human Perception and Performance, 38(4), 843-847), but the extent to which they rely on prediction to learn novel word forms is unclear (Gambi et al., 2021 Cognition, 211, 104650). Here, we examine children's one-shot learning from predictive contexts using a modified version of the one-shot learning ERP paradigm for children aged 7-13 years. In a first learning phase, we presented audio recordings of expected words and unexpected novel pseudowords in strongly and weakly constraining sentence contexts. In the following priming phase, the same recorded words and pseudowords were used as primes to identical/synonymous, related, and unrelated target words. We measured N400 modulations to the word and pseudoword continuations in the learning phase and to the identical/synonymous, related, or unrelated target words in the priming phase. When initially presented in strongly constraining sentences, novel pseudowords primed synonymous targets equally well as word primes of the same intended meaning. This pattern was particularly pronounced in older children. Our findings suggest that, around early adolescence, children can use single exposures to constraining contexts to infer the meaning of novel words and to integrate these novel words in their lexicons.

ERP Evidences of Rapid Semantic Learning in Foreign Language Word Comprehension

The event-related potential (ERP) of electroencephalography (EEG) signals has been well studied in the case of native language speech comprehension using semantically matched and mis-matched end-words. The presence of semantic incongruity in the audio stimulus elicits a N400 component in the ERP waveform. However, it is unclear whether the semantic dissimilarity effects in ERP also appear for foreign language words that were learned in a rapid language learning task. In this study, we introduced the semantics of Japanese words to subjects who had no prior exposure to Japanese language. Following this language learning task, we performed ERP analysis using English sentences of semantically matched and mis-matched nature where the end-words were replaced with their Japanese counterparts. The ERP analysis revealed that, even with a short learning cycle, the semantically matched and mis-matched end-words elicited different EEG patterns (similar to the native language case). However, the patterns seen for the newly learnt word stimuli showed the presence of P600 component (delayed and opposite in polarity to those seen in the known language). A topographical analysis revealed that P600 responses were pre-dominantly observed in the parietal region and in the left hemisphere. The absence of N400 component in this rapid learning task can be considered as evidence for its association with long-term memory processing. Further, the ERP waveform for the Japanese end-words, prior to semantic learning, showed a P3a component owing to the subject's reaction to a novel stimulus. These differences were more pronounced in the centro-parietal scalp electrodes.

Age-related changes in sleep-dependent novel word consolidation

Learning new words is a vital, life-long process that benefits from memory consolidation during sleep in young adults. In aging populations, promoting vocabulary learning is an attractive strategy to improve quality of life and workplace longevity by improving the integration of new technology and the associated terminology. Decreases in sleep quality and quantity with aging may diminish sleep-dependent memory consolidation for word learning. Alternatively, given that older adults outperform young adults on vocabulary-based tasks, and that strength of memory encoding (how well older adults learn) predicts sleep-dependent memory consolidation, word learning may uniquely benefit from sleep in older adults. We assessed age-related changes in memory for novel English word-definition pairs recalled following intervals spent asleep and awake. While sleep was shown to fully preserve memory for word/definition pairs in young adults (N = 53, asleep = 32, awake = 21, 18-30 years), older adults (N = 45, asleep = 21, awake = 24, 58-75 years) forgot items equally over wake and sleep intervals but preserved the accuracy of typed responses better following sleep. However, this was modulated by the strength of encoded memories: the proportion of high strength items consolidated increased for older adults following sleep compared to wake. Older adults consolidated a lower proportion of medium strength items across both sleep and wake intervals compared to young adults. Our results contribute to growing evidence that encoding strength is crucially important to understand the expression of sleep-dependent benefits in older adults and assert the need for sufficiently sensitive performance metrics in aging research.

Evidence from ERP and Eye Movements as Markers of Language Dysfunction in Dyslexia

Developmental dyslexia is a complex reading disorder involving genetic and environmental factors. After more than a century of research, its etiology remains debated. Two hypotheses are often put forward by scholars to account for the causes of dyslexia. The most common one, the linguistic hypothesis, postulates that dyslexia is due to poor phonological awareness. The alternative hypothesis considers that dyslexia is caused by visual-attentional deficits and abnormal eye movement patterns. This article reviews a series of selected event-related brain potential (ERP) and eye movement studies on the reading ability of dyslexic individuals to provide an informed state of knowledge on the etiology of dyslexia. Our purpose is to show that the two abovementioned hypotheses are not necessarily mutually exclusive, and that dyslexia should rather be considered as a multifactorial deficit.

Transcutaneous Auricular Vagus Nerve Stimulation Strengthens Semantic Representations of Foreign Language Tone Words during Initial Stages of Learning

Difficulty perceiving phonological contrasts in a second language (L2) can impede initial L2 lexical learning. Such is the case for English speakers learning tonal languages, like Mandarin Chinese. Given the hypothesized role of reduced neuroplasticity in adulthood limiting L2 phonological perception, the current study examined whether transcutaneous auricular vagus nerve stimulation (taVNS), a relatively new neuromodulatory technique, can facilitate L2 lexical learning for English speakers learning Mandarin Chinese over 2 days. Using a double-blind design, one group of participants received 10 min of continuous priming taVNS before lexical training and testing each day, a second group received 500 msec of peristimulus (peristim) taVNS preceding each to-be-learned item in the same tasks, and a third group received passive sham stimulation. Results of the lexical recognition test administered at the end of each day revealed evidence of learning for all groups, but a higher likelihood of accuracy across days for the peristim group and a greater improvement in response time between days for the priming group. Analyses of N400 ERP components elicited during the same tasks indicate behavioral advantages for both taVNS groups coincided with stronger lexico-semantic encoding for target words. Comparison of these findings to pupillometry results for the same study reported in Pandža, Phillips, Karuzis, O'Rourke, and Kuchinsky (2020) suggest that positive effects of priming taVNS (but not peristim taVNS) on lexico-semantic encoding are related to sustained attentional effort.

The N400 ERP component reflects an error-based implicit learning signal during language comprehension

The functional significance of the N400 evoked-response component is still actively debated. An increasing amount of theoretical and computational modelling work is built on the interpretation of the N400 as a prediction error. In neural network modelling work, it was proposed that the N400 component can be interpreted as the change in a probabilistic representation of meaning that drives the continuous adaptation of an internal model of the statistics of the environment. These results imply that increased N400 amplitudes should correspond to greater adaptation, which can be measured via implicit memory. To investigate this model derived hypothesis, the current study manipulated expectancy in a sentence reading task to influence N400 amplitudes and subsequently presented the previously expected vs. unexpected words in a perceptual identification task to measure implicit memory. As predicted, reaction times in the perceptual identification task were significantly faster for previously unexpected words that induced larger N400 amplitudes in the previous sentence reading task. Additionally, it could be demonstrated that this adaptation seems to specifically depend on the process underlying N400 amplitudes, as participants with larger N400 differences during sentence reading also exhibited a larger implicit memory benefit in the perceptual identification task. These findings support the interpretation of the N400 as an implicit learning signal driving adaptation in language processing.

Unexpected words or unexpected languages? Two ERP effects of code-switching in naturalistic discourse

Bilingual speakers often switch between languages in conversation without any advance notice. Psycholinguistic research has found that these language shifts (or code-switches) can be costly for comprehenders in certain situations. The present study explores the nature of these costs by comparing code-switches to other types of unexpected linguistic material. To do this, we used a novel EEG paradigm, the Storytime task, in which we record readings of natural texts, and then experimentally manipulate their properties by splicing in words. In this study, we manipulated the language of our target words (English, Spanish) and their fit with the preceding context (strong-fit, weak-fit). If code-switching incurs a unique cost beyond that incurred by an unexpected word, then we should see an additive pattern in our ERP indices. If an effect is driven by lexical expectation alone, then there should be a non-additive interaction such that all unexpected forms incur a similar cost. We found three effects: a general prediction effect (a non-additive N400), a post-lexical recognition of the switch in languages (an LPC for code-switched words), and a prolonged integration difficulty associated with weak-fitting words regardless of language (a sustained negativity). We interpret these findings as suggesting that the processing difficulties experienced by bilinguals can largely be understood within more general frameworks for understanding language comprehension. Our findings are consistent with the broader literature demonstrating that bilinguals do not have two wholly separate language systems but rather a single language system capable of using two coding systems.

Evidence for Enhanced Long-term Memory in Professional Musicians and Its Contribution to Novel Word Learning

Previous studies evidenced transfer effects from professional music training to novel word learning. However, it is unclear whether such an advantage is driven by cascading, bottom-up effects from better auditory perception to semantic processing or by top-down influences from cognitive functions on perception. Moreover, the long-term effects of novel word learning remain an open issue. To address these questions, we used a word learning design, with four different sets of novel words, and we neutralized the potential perceptive and associative learning advantages in musicians. Under such conditions, we did not observe any advantage in musicians on the day of learning (Day 1 [D1]), at neither a behavioral nor an electrophysiological level; this suggests that the previously reported advantages in musicians are likely to be related to bottom-up processes. Nevertheless, 1 month later (Day 30 [D30]) and for all types of novel words, the error increase from D1 to D30 was lower in musicians compared to nonmusicians. In addition, for the set of words that were perceptually difficult to discriminate, only musicians showed typical N400 effects over parietal sites on D30. These results demonstrate that music training improved long-term memory and that transfer effects from music training to word learning (i.e., semantic levels of speech processing) benefit from reinforced (long-term) memory functions. Finally, these findings highlight the positive impact of music training on the acquisition of foreign languages.

Neural representation of linguistic feature hierarchy reflects second-language proficiency

Acquiring a new language requires individuals to simultaneously and gradually learn linguistic attributes on multiple levels. Here, we investigated how this learning process changes the neural encoding of natural speech by assessing the encoding of the linguistic feature hierarchy in second-language listeners. Electroencephalography (EEG) signals were recorded from native Mandarin speakers with varied English proficiency and from native English speakers while they listened to audio-stories in English. We measured the temporal response functions (TRFs) for acoustic, phonemic, phonotactic, and semantic features in individual participants and found a main effect of proficiency on linguistic encoding. This effect of second-language proficiency was particularly prominent on the neural encoding of phonemes, showing stronger encoding of “new” phonemic contrasts (i.e., English contrasts that do not exist in Mandarin) with increasing proficiency. Overall, we found that the nonnative listeners with higher proficiency levels had a linguistic feature representation more similar to that of native listeners, which enabled the accurate decoding of language proficiency. This result advances our understanding of the cortical processing of linguistic information in second-language learners and provides an objective measure of language proficiency.

Rapid acquisition of novel written word-forms: ERP evidence

Background

Novel word acquisition is generally believed to be a rapid process, essential for ensuring a flexible and efficient communication system; at least in spoken language, learners are able to construct memory traces for new linguistic stimuli after just a few exposures. However, such rapid word learning has not been systematically found in visual domain, with different confounding factors obscuring the orthographic learning of novel words. This study explored the changes in human brain activity occurring online, during a brief training with novel written word-forms using a silent reading task

Results

Single-trial, cluster-based random permutation analysis revealed that training caused an extremely fast (after just one repetition) and stable facilitation in novel word processing, reflected in the modulation of P200 and N400 components, possibly indicating rapid dynamics at early and late stages of the lexical processing. Furthermore, neural source estimation of these effects revealed the recruitment of brain areas involved in orthographic and lexico-semantic processing, respectively.

Conclusions

These results suggest the formation of neural memory traces for novel written word-forms after a minimal exposure to them even in the absence of a semantic reference, resembling the rapid learning processes known to occur in spoken language.

The N400 indexes acquisition of novel emotion concepts via conceptual combination

The ability to learn new emotion concepts is adaptive and socially valuable as it communicates culturally held understandings about values, goals, and experiences. Yet, little work has examined the underlying mechanisms that allow for new emotion concepts and words to be integrated into the conceptual system. One such mechanism may be conceptual combination, or the ability to form novel concepts by dynamically combining previously acquired conceptual knowledge. In this study, we used event-related potentials (ERPs) to investigate the electrophysiological correlates of novel emotion concept acquisition via conceptual combination. Participants were briefly trained on 30 novel emotion combinations, each consisting of two English emotion words (the components; e.g., "sadness + fatigue") and a pseudoword (the target; e.g., "despip"). Participants then completed a semantic congruency task while ERPs were recorded. On each trial, two components were presented serially, followed by a target; participants judged whether the target was a valid combination of the preceding components. Targets could be correct or incorrect trained pseudowords, or new untrained pseudowords. Furthermore, components could be presented in reversed order (e.g., "fatigue" then "sadness") or as synonyms (e.g., "exhaustion" for "fatigue"). Consistent with our main hypotheses, we found a main effect of target, such that the correct combinations showed reduced N400 amplitudes when compared to both incorrect and untrained pseudowords. Critically, this effect held regardless of how the preceding components were presented, suggesting deeper semantic learning. These results extend prior findings on conceptual combination and novel word learning, and are congruent with predictive processing accounts of brain function.

Meaning before grammar: A review of ERP experiments on the neurodevelopmental origins of semantic processing

According to traditional linguistic theories, the construction of complex meanings relies firmly on syntactic structure-building operations. Recently, however, new models have been proposed in which semantics is viewed as being partly autonomous from syntax. In this paper, we discuss some of the developmental implications of syntax-based and autonomous models of semantics. We review event-related brain potential (ERP) studies on semantic processing in infants and toddlers, focusing on experiments reporting modulations of N400 amplitudes using visual or auditory stimuli and different temporal structures of trials. Our review suggests that infants can relate or integrate semantic information from temporally overlapping stimuli across modalities by 6 months of age. The ability to relate or integrate semantic information over time, within and across modalities, emerges by 9 months. The capacity to relate or integrate information from spoken words in sequences and sentences appears by 18 months. We also review behavioral and ERP studies showing that grammatical and syntactic processing skills develop only later, between 18 and 32 months. These results provide preliminary evidence for the availability of some semantic processes prior to the full developmental emergence of syntax: non-syntactic meaning-building operations are available to infants, albeit in restricted ways, months before the abstract machinery of grammar is in place. We discuss this hypothesis in light of research on early language acquisition and human brain development.

N400 amplitude, latency, and variability reflect temporal integration of beat gesture and pitch accent during language processing

This study examines how across-trial (average) and trial-by-trial (variability in) amplitude and latency of the N400 event-related potential (ERP) reflect temporal integration of pitch accent and beat gesture. Thirty native English speakers viewed videos of a talker producing sentences with beat gesture co-occurring with a pitch accented focus word (synchronous), beat gesture co-occurring with the onset of a subsequent non-focused word (asynchronous), or the absence of beat gesture (no beat). Across trials, increased amplitude and earlier latency were observed when beat gesture was temporally asynchronous with pitch accenting than when it was temporally synchronous with pitch accenting or absent. Moreover, temporal asynchrony of beat gesture relative to pitch accent increased trial-by-trial variability of N400 amplitude and latency and influenced the relationship between across-trial and trial-by-trial N400 latency. These results indicate that across-trial and trial-by-trial amplitude and latency of the N400 ERP reflect temporal integration of beat gesture and pitch accent during language comprehension, supporting extension of the integrated systems hypothesis of gesture-speech processing and neural noise theories to focus processing in typical adult populations.

From Psychoacoustics to Brain Waves: A Longitudinal Approach to Novel Word Learning

Musical expertise has been shown to positively influence high-level speech abilities such as novel word learning. This study addresses the question whether low-level enhanced perceptual skills causally drives successful novel word learning. We used a longitudinal approach with psychoacoustic procedures to train 2 groups of nonmusicians either on pitch discrimination or on intensity discrimination, using harmonic complex sounds. After short (approximately 3 hr) psychoacoustic training, discrimination thresholds were lower on the specific feature (pitch or intensity) that was trained. Moreover, compared to the intensity group, participants trained on pitch were faster to categorize words varying in pitch. Finally, although the N400 components in both the word learning phase and in the semantic task were larger in the pitch group than in the intensity group, no between-group differences were found at the behavioral level in the semantic task. Thus, these results provide mixed evidence that enhanced perception of relevant features through a few hours of acoustic training with harmonic sounds causally impacts the categorization of speech sounds as well as novel word learning. These results are discussed within the framework of near and far transfer effects from music training to speech processing.

Toward an Individualized Neural Assessment of Receptive Language in Children

Purpose We aimed to develop a noninvasive neural test of language comprehension to use with nonspeaking children for whom standard behavioral testing is unreliable (e.g., minimally verbal autism). Our aims were threefold. First, we sought to establish the sensitivity of two auditory paradigms to elicit neural responses in individual neurotypical children. Second, we aimed to validate the use of a portable and accessible electroencephalography (EEG) system, by comparing its recordings to those of a research-grade system. Third, in light of substantial interindividual variability in individuals' neural responses, we assessed whether multivariate decoding methods could improve sensitivity. Method We tested the sensitivity of two child-friendly covert N400 paradigms. Thirty-one typically developing children listened to identical spoken words that were either strongly predicted by the preceding context or violated lexical-semantic expectations. Context was given by a cue word (Experiment 1) or sentence frame (Experiment 2), and participants either made an overall judgment on word relatedness or counted lexical-semantic violations. We measured EEG concurrently from a research-grade system, Neuroscan's SynAmps2, and an adapted gaming system, Emotiv's EPOC+. Results We found substantial interindividual variability in the timing and topology of N400-like effects. For both paradigms and EEG systems, traditional N400 effects at the expected sensors and time points were statistically significant in around 50% of individuals. Using multivariate analyses, detection rate increased to 88% of individuals for the research-grade system in the sentences paradigm, illustrating the robustness of this method in the face of interindividual variations in topography. Conclusions There was large interindividual variability in neural responses, suggesting interindividual variation in either the cognitive response to lexical-semantic violations and/or the neural substrate of that response. Around half of our neurotypical participants showed the expected N400 effect at the expected location and time points. A low-cost, accessible EEG system provided comparable data for univariate analysis but was not well suited to multivariate decoding. However, multivariate analyses with a research-grade EEG system increased our detection rate to 88% of individuals. This approach provides a strong foundation to establish a neural index of language comprehension in children with limited communication. Supplemental Material https://doi.org/10.23641/asha.12606311.

Unconstrained multivariate EEG decoding can help detect lexical-semantic processing in individual children

In conditions such as minimally-verbal autism, standard assessments of language comprehension are often unreliable. Given the known heterogeneity within the autistic population, it is crucial to design tests of semantic comprehension that are sensitive in individuals. Recent efforts to develop neural signals of language comprehension have focused on the N400, a robust marker of lexical-semantic violation at the group level. However, homogeneity of response in individual neurotypical children has not been established. Here, we presented 20 neurotypical children with congruent and incongruent visual animations and spoken sentences while measuring their neural response using electroencephalography (EEG). Despite robust group-level responses, we found high inter-individual variability in response to lexico-semantic anomalies. To overcome this, we analysed our data using temporally and spatially unconstrained multivariate pattern analyses (MVPA), supplemented by descriptive analyses to examine the timecourse, topography, and strength of the effect. Our results show that neurotypical children exhibit heterogenous responses to lexical-semantic violation, implying that any application to heterogenous disorders such as autism spectrum disorder will require individual-subject analyses that are robust to variation in topology and timecourse of neural responses.

Cortical encoding of melodic expectations in human temporal cortex

Humans engagement in music rests on underlying elements such as the listeners' cultural background and interest in music. These factors modulate how listeners anticipate musical events, a process inducing instantaneous neural responses as the music confronts these expectations. Measuring such neural correlates would represent a direct window into high-level brain processing. Here we recorded cortical signals as participants listened to Bach melodies. We assessed the relative contributions of acoustic versus melodic components of the music to the neural signal. Melodic features included information on pitch progressions and their tempo, which were extracted from a predictive model of musical structure based on Markov chains. We related the music to brain activity with temporal response functions demonstrating, for the first time, distinct cortical encoding of pitch and note-onset expectations during naturalistic music listening. This encoding was most pronounced at response latencies up to 350 ms, and in both planum temporale and Heschl's gyrus.

The neurocognitive basis of metamemory: Using the N400 to study the contribution of fluency to judgments of learning

Metamemory is crucial for monitoring, evaluating, and optimizing memory performance. The basis of metamemory, however, is a matter of considerable debate. In the present study, we examined the contribution of processing fluency-the ease of processing information during learning-to metamemory judgments. We recorded event-related potentials (ERPs) while participants studied related and unrelated word pairs across two study-test cycles in a judgment of learning (JOL) task. In the first study-test cycle, related pairs were associated with better cued recall, higher JOLs, and a reduced N400 amplitude than unrelated pairs. Crucially, between- and within subject correlational analyses indicated that reduced N400 amplitudes, indexing more fluent processing, were associated with higher JOLs. Furthermore, single-trial N400 mediated a small but significant portion of the relatedness effect on JOLs. In the second study-test cycle, relatedness still increased recall and JOLs. However, related and unrelated pairs did not differ in N400 amplitude. Rather, unrelated pairs elicited a parietal positivity in a later time window that partially mediated the relatedness effect on JOLs. Together, these results suggest that processing fluency, indexed by the N400, contributes to the relatedness effect on JOLs when novel word pairs are learned, but not when previously studied pairs are relearned. Our results also imply that aspects of fluency not captured by the N400 and/or explicit beliefs about memory contribute to JOLs. This study demonstrates the utility of ERPs in gaining new insights into the neurocognitive mechanisms of metamemory.

An historical perspective on Endel Tulving's episodic-semantic distinction

The distinction between episodic and semantic memory, proposed by Endel Tulving in 1972, remains a key concept in contemporary Cognitive Neuroscience. Here we review how this distinction evolved in Tulving's writings over the years. Crucially, from 1972 onward, he argued that the two forms of memory were inter-dependent and that their interaction was an essential feature of normal episodic memory function. Moreover, later elaborations of the theory clearly proposed that these interactions formed the basis of normal declarative memory functioning. A later but crucial aspect of Tulving's contribution was his stress on the importance of subjective experience, which, according to him, "should be the ultimate object of interest, the central aspect of remembering that is to be explained and understood". We relate these and his numerous other ideas to current perspectives about the organization and function of human memory.

Using the N400 event-related potential to study word learning from context in children from low- and higher-socioeconomic status homes

Children from low-socioeconomic status (SES) homes have significantly smaller vocabularies than their higher-SES peers, a gap that increases over the course of the school years. One reason for the increase in this vocabulary gap during the school years is that children from low-SES homes learn fewer words from context than their higher-SES peers. To better understand how the process of word learning from context might differ in children related to SES, we investigated changes in the N400 event-related potential (ERP) as children from low- and higher-SES homes learned new words using only the surrounding linguistic context. There were no differences in the N400 response to known words related to SES. In response to the target word being learned, children from higher-SES homes, like adults in previous studies, exhibited an attenuation of the N400 across exposures as they attached meaning to it. Children from low-SES homes did not show this same attenuation. These findings support previous work showing that children from low-SES homes may have differences or more variability in the neural components supporting language processing, and they extend previous work to illustrate how this variability may relate to word learning and, ultimately, vocabulary growth.

White noise facilitates new-word learning from context

Listening to white noise may facilitate cognitive performance, including new word learning, for some individuals. This study investigated whether auditory white noise facilitates the learning of novel written words from context in healthy young adults. Sixty-nine participants were required to determine the meaning of novel words placed within sentence contexts during a silent reading task. Learning was performed either with or without white noise, and recognition of novel word meanings was tested immediately after learning and after a short delay. Immediate recognition accuracy for learned novel word meanings was higher in the noise group relative to the no noise group, however this effect was no longer evident at the delayed recognition test. These findings suggest that white noise has the capacity to facilitate meaning acquisition from context, however further research is needed to clarify its capacity to improve longer-term retention of meaning.

Neural dynamics of the production of newly acquired words relative to well-known words

An adult continues acquiring new lexical entries in everyday life. Brain networks and processes at play when producing newly learnt words might be similar to well-known words, yet some processes are bound to be slower. Here, we compared the neural dynamics of producing newly acquired words with those of well-known frequent words, both qualitatively and quantitatively, using event-related potentials (ERPs) associated to high-density microstate analyses. ERPs revealed several temporal windows with differences in waveform amplitudes, which correspond to enhanced duration of similar microstates for newly acquired words compared to well-known words. The time-periods of these ERP modulations converged to suggest that both lexical processes and word form encoding are slowed down for words that have been learned recently, but that the same brain processes are implemented as for well-known words.

Testing the influence of musical expertise on novel word learning across the lifespan using a cross-sectional approach in children, young adults and older adults

Word learning is a multifaceted perceptual and cognitive task that is omnipresent in everyday life. Currently, it is unclear whether this ability is influenced by age, musical expertise or both variables. Accordingly, we used EEG and compared behavioral and electrophysiological indices of word learning between older adults with and without musical expertise (older adults' perspective) as well as between musically trained and untrained children, young adults, and older adults (lifespan perspective). Results of the older adults' perspective showed that the ability to learn new words is preserved in elderly, however, without a beneficial influence of musical expertise. Otherwise, results of the lifespan perspective revealed lower error rates and faster reaction times in young adults compared to children and older adults. Furthermore, musically trained children and young adults outperformed participants without musical expertise, and this advantage was accompanied by EEG manifestations reflecting faster learning and neural facilitation in accessing lexical-semantic representations.

Dynamic cognitive processes of text-picture integration revealed by event-related potentials

The integration of text and picture is the core of multimedia information processing. Relevant theories suggest that text and picture are processed through different channels in the early stage, and integrated in the late stage of processing. Based on these theories, the current study adopted measures of event-related potentials to examine the cognitive and neural processes of text-picture integration. The results showed that in the early stage of text-picture integration, picture processing evoked a more negative N1 over the occipital area and a N300 over the prefrontal area, which might reflect the discrimination process of visual stimuli and the imagery representation of the picture, respectively; in the late stage, the text-picture induced a N400 in the central area and an LPC over the central, parietal and temporal areas, which might be associated with the semantic activation and integration of text and picture, respectively. These results not only provide support for existing theories, but also further elucidate the dynamic neural processing of text-picture integration in terms of its temporal and spatial characteristics.

Disentangling semantic and response learning effects in color-word contingency learning

It is easier to indicate the ink color of a color-neutral noun when it is presented in the color in which it has frequently been shown before, relative to print colors in which it has been shown less often. This phenomenon is known as color-word contingency learning. It remains unclear whether participants actually learn semantic (word-color) associations and/or response (word-button) associations. We present a novel variant of the paradigm that can disentangle semantic and response learning, because word-color and word-button associations are manipulated independently. In four experiments, each involving four daily sessions, pseudowords—such as enas, fatu or imot—were probabilistically associated with either a particular color, a particular response-button position, or both. Neutral trials without color-pseudoword association were also included, and participants’ awareness of the contingencies was manipulated. The data showed no influence of explicit contingency awareness, but clear evidence both for response learning and for semantic learning, with effects emerging swiftly. Deeper processing of color information, with color words presented in black instead of color patches to indicate response-button positions, resulted in stronger effects, both for semantic and response learning. Our data add a crucial piece of evidence lacking so far in color-word contingency learning studies: Semantic learning effectively takes place even when associations are learned in an incidental way.

Toward a Neurobiologically Plausible Model of Language-Related, Negative Event-Related Potentials

Language-related event-related potential (ERP) components such as the N400 have traditionally been associated with linguistic or cognitive functional interpretations. By contrast, it has been considerably more difficult to relate these components to neurobiologically grounded accounts of language. Here, we propose a theoretical framework based on a predictive coding architecture, within which negative language-related ERP components such as the N400 can be accounted for in a neurobiologically plausible manner. Specifically, we posit that the amplitude of negative language-related ERP components reflects precision-weighted prediction error signals, i.e., prediction errors weighted by the relevance of the information source leading to the error. From this perspective, precision has a direct link to cue validity in a particular language and, thereby, to relevance of individual linguistic features for internal model updating. We view components such as the N400 and LAN as members of a family with similar functional characteristics and suggest that latency and topography differences between these components reflect the locus of prediction errors and model updating within a hierarchically organized cortical predictive coding architecture. This account has the potential to unify findings from the full range of the N400 literature, including word-level, sentence-, and discourse-level results as well as cross-linguistic differences.

Electrophysiological study of action-affordance priming between object names

If our central representation of an object is defined through embodied experience, we might expect access to action affordances to be privileged over more abstract concepts. We used event-related potentials to examine the relative time course of access to affordances. Written object names were primed with the name of an object sharing the same affordance as the target (e.g. precision-grip: "grape" primed by "tweezers") or the same taxonomic category (e.g. fruit: "grape" primed by "apple"). N200 latencies, related to go/nogo semantic category decisions on target words, revealed no difference in facilitation provided by affordance and semantic priming. However, separate analyses of ERPs for go and nogo trials showed that semantic priming led to earlier activation during go trials (around 430 ms), and affordance priming led to earlier activation during nogo trials (around 180 ms). While affordances appear to be peripheral to the conceptual representation of objects, they do lead to direct motor preparation.

People Searching for Meaning in Their Lives Find Literature More Engaging

Why are some people interested in complex literature and others not? This study experimentally investigated this question by assessing what cognitive traits moderated responses to literary and less-literary fictional vignettes. Specifically, participants were exposed to two variants of a celebrated literary text, one altered so as to remove overtly literary elements. A moderation analysis was performed on responses with respect to three variables: need for cognition (NC); meaning in life (measured in two subscales, search for meaning [SM] and presence of meaning [PM]); and intentionality/mentalizing ability (IM). Results showed that SM moderated interpretive response to the textual variation, such that those with increasing scores on the SM scale were increasingly more likely to rate the literary vignettes as worthy of appreciation. This result, in turn, gave grounds for a second study that investigated the role played by cloze values in identifying a text as “literary.” The latter study showed that the literary and less-literary vignettes exhibited significant differences in cloze values. Taken together, these studies suggest that differences in responsiveness to literary materials may well be driven by preexisting cognitive factors.

Effect of word association on linguistic event-related potentials in moderately to mildly constraining sentences

The processing of word associations in sentence context depends on several factors. EEG studies have shown that when the expectation of the upcoming word is high (high semantic constraint), the within-sentence word association plays a negligible role, whereas in the opposite case, when there is no expectation (as in pseudo-sentences), the role of word association becomes more pronounced. However, what happens when the expectations are not high (mild to moderate semantic constraint) is not yet clear. By adopting a cross-factorial design, crossing sentence congruity with within-sentence word association, our EEG recordings show that association comes into play during semantic processing of the word only when the sentence is meaningless. We also performed an exploratory source localization analysis of our EEG recordings to chart the brain regions putatively implicated in processing the said factors and showed its complementarity to EEG temporal analysis. This study furthers our knowledge on sentence processing and the brain networks involved in it.