Understanding in an instant: neurophysiological evidence for mechanistic language circuits in the brain

Temporal neural dynamics of understanding communicative intentions from speech prosody

Understanding the correct intention of a speaker is critical for social interaction. Speech prosody is an important source for understanding speakers' intentions during verbal communication. However, the neural dynamics by which the human brain translates the prosodic cues into a mental representation of communicative intentions in real time remains unclear. Here, we recorded EEG (electroencephalograph) while participants listened to dialogues. The prosodic features of the critical words at the end of sentences were manipulated to signal either suggestion, warning, or neutral intentions. The results showed that suggestion and warning intentions evoked enhanced late positive event-related potentials (ERPs) compared to the neutral condition. Linear mixed-effects model (LMEM) regression and representational similarity analysis (RSA) analyses revealed that these ERP effects were distinctively correlated with prosodic acoustic analysis, emotional valence evaluation, and intention interpretation in different time windows; The onset latency significantly increased as the processing level of abstractness and communicative intentionality increased. Neural representations of intention and emotional information emerged and parallelly persisted over a long time window, guiding the correct identification of communicative intention. These results provide new insights into understanding the structural components of intention processing and their temporal neural dynamics underlying communicative intention comprehension from speech prosody in online social interactions.

Unpleasant words can affect the detection of morphosyntactic errors: An ERP study on individual differences

In recent years, several ERP studies have investigated whether the early computation of agreement is permeable to the emotional content of words. Some studies have reported interactive effects of grammaticality and emotionality in the left anterior negativity (LAN) component, while others have failed to replicate these results. Furthermore, novel findings suggest that grammatical processing can elicit different neural patterns across individuals. In this study, we aim to investigate whether the interaction between grammaticality and emotionality is restricted to participants with a specific neural profile. Sixty-one female native speakers of Spanish performed an agreement judgment task in noun phrases composed of a determiner, a noun, and an unpleasant or neutral adjective that could agree or disagree in gender with the preceding noun. Our results support the existence of two different brain profiles: negative and positive dominance (individuals showing either larger LAN or larger P600 amplitudes in ungrammatical stimuli than in grammatical ones, respectively). Interestingly, the neural pattern of these two groups diverged at different points along the time course. Thus, the negative dominance group showed grammaticality effects as early as 200 ms, along with parallel and autonomous processing of grammaticality and emotionality at the LAN/N400 time window. Instead, for the positive dominance group an early interaction was found at around 200 ms, evidencing a grammaticality effect that emerged only for unpleasant words. Our findings confirm the role of individual differences in the interplay between grammar and emotion at the neural level and call for the inclusion of this perspective in studies on syntactic processing.

Learning to Listen: Changes in Children's Brain Activity Following a Listening Comprehension Intervention

"Are you LISTENING?" may be one of the most frequent questions preschoolers hear from their parents and teachers, but can children be taught to listen carefully-and thus better comprehend language-and if so, what changes occur in their brains? Twenty-seven four- and five-year-old children were taught a language simulation strategy to use while listening to stories: first, they practiced moving graphics on an iPad to correspond to the story actions, and then they practiced imagining the movements. Compared to a control condition, children in the intervention answered comprehension questions more accurately when imagining moving the graphics and on a measure of transfer using a new story without any instruction and with only immovable graphics. Importantly, for children in the intervention, the change in comprehension from the first to the sixth day was strongly correlated with changes in EEG mu and alpha desynchronization, suggesting changes in motor and visual processing following the intervention. Thus, the data are consistent with our hypothesis that a language simulation listening comprehension intervention can improve children's listening comprehension by teaching children to align visual and motor processing with language comprehension.

Spatiotemporal Properties of Common Semantic Categories for Words and Pictures

The timing of semantic processing during object recognition in the brain is a topic of ongoing discussion. One way of addressing this question is by applying multivariate pattern analysis to human electrophysiological responses to object images of different semantic categories. However, although multivariate pattern analysis can reveal whether neuronal activity patterns are distinct for different stimulus categories, concerns remain on whether low-level visual features also contribute to the classification results. To circumvent this issue, we applied a cross-decoding approach to magnetoencephalography data from stimuli from two different modalities: images and their corresponding written words. We employed items from three categories and presented them in a randomized order. We show that if the classifier is trained on words, pictures are classified between 150 and 430 msec after stimulus onset, and when training on pictures, words are classified between 225 and 430 msec. The topographical map, identified using a searchlight approach for cross-modal activation in both directions, showed left lateralization, confirming the involvement of linguistic representations. These results point to semantic activation of pictorial stimuli occurring at ∼150 msec, whereas for words, the semantic activation occurs at ∼230 msec.

Negation mitigates rather than inverts the neural representations of adjectives

Combinatoric linguistic operations underpin human language processes, but how meaning is composed and refined in the mind of the reader is not well understood. We address this puzzle by exploiting the ubiquitous function of negation. We track the online effects of negation ("not") and intensifiers ("really") on the representation of scalar adjectives (e.g., "good") in parametrically designed behavioral and neurophysiological (MEG) experiments. The behavioral data show that participants first interpret negated adjectives as affirmative and later modify their interpretation towards, but never exactly as, the opposite meaning. Decoding analyses of neural activity further reveal significant above chance decoding accuracy for negated adjectives within 600 ms from adjective onset, suggesting that negation does not invert the representation of adjectives (i.e., "not bad" represented as "good"); furthermore, decoding accuracy for negated adjectives is found to be significantly lower than that for affirmative adjectives. Overall, these results suggest that negation mitigates rather than inverts the neural representations of adjectives. This putative suppression mechanism of negation is supported by increased synchronization of beta-band neural activity in sensorimotor areas. The analysis of negation provides a steppingstone to understand how the human brain represents changes of meaning over time.

Hemispheric engagement during the processing of affective adjectives-an ERP divided visual field study

The study looked into the hemispheres' involvement in emotional word encoding. It combined brain activity measures (ERPs) with behavioural data during the affective categorization task in the divided visual field presentation paradigm. Forty healthy right-handed student volunteers took part in the study, in which they viewed and evaluated 33 positive and 33 negative emotional adjectives presented to either the left or right visual field. We observed a marginally significant effect on the earlier time window (220-250 ms, the P2 component) with higher mean amplitudes evoked to the words presented to the right hemisphere, and then a strong effect on the 340-400 ms (the P3) with a reversed pattern (higher amplitudes for words presented to the left hemisphere). The latter effect was also visible in the error rates and RTs, with better overall performance for adjectives presented to the left hemisphere. There was also an effect on behavioural data of positive words only (higher error rates, shorter RTs). Thus, the study showed a particular "progression" pattern of hemispheric engagement: dependence of the initial stages of affective lexico-semantic processing on the right hemisphere, replaced by the left-hemispheric dominance for content evaluation and response programming stages.

Episodic long-term memory formation during slow-wave sleep

We are unresponsive during slow-wave sleep but continue monitoring external events for survival. Our brain wakens us when danger is imminent. If events are non-threatening, our brain might store them for later consideration to improve decision-making. To test this hypothesis, we examined whether novel vocabulary consisting of simultaneously played pseudowords and translation words are encoded/stored during sleep, and which neural-electrical events facilitate encoding/storage. An algorithm for brain-state-dependent stimulation selectively targeted word pairs to slow-wave peaks or troughs. Retrieval tests were given 12 and 36 hr later. These tests required decisions regarding the semantic category of previously sleep-played pseudowords. The sleep-played vocabulary influenced awake decision-making 36 hr later, if targeted to troughs. The words' linguistic processing raised neural complexity. The words' semantic-associative encoding was supported by increased theta power during the ensuing peak. Fast-spindle power ramped up during a second peak likely aiding consolidation. Hence, new vocabulary played during slow-wave sleep was stored and influenced decision-making days later.

The Self-reference Effect Can Modulate Language Syntactic Processing Even Without Explicit Awareness: An Electroencephalography Study

Although it is well established that self-related information can rapidly capture our attention and bias cognitive functioning, whether this self-bias can affect language processing remains largely unknown. In addition, there is an ongoing debate as to the functional independence of language processes, notably regarding the syntactic domain. Hence, this study investigated the influence of self-related content on syntactic speech processing. Participants listened to sentences that could contain morphosyntactic anomalies while the masked face identity (self, friend, or unknown faces) was presented for 16 msec preceding the critical word. The language-related ERP components (left anterior negativity [LAN] and P600) appeared for all identity conditions. However, the largest LAN effect followed by a reduced P600 effect was observed for self-faces, whereas a larger LAN with no reduction of the P600 was found for friend faces compared with unknown faces. These data suggest that both early and late syntactic processes can be modulated by self-related content. In addition, alpha power was more suppressed over the left inferior frontal gyrus only when self-faces appeared before the critical word. This may reflect higher semantic demands concomitant to early syntactic operations (around 150-550 msec). Our data also provide further evidence of self-specific response, as reflected by the N250 component. Collectively, our results suggest that identity-related information is rapidly decoded from facial stimuli and may impact core linguistic processes, supporting an interactive view of syntactic processing. This study provides evidence that the self-reference effect can be extended to syntactic processing.

Embodied Processing at Six Linguistic Granularity Levels: A Consensus Paper

Language processing is influenced by sensorimotor experiences. Here, we review behavioral evidence for embodied and grounded influences in language processing across six linguistic levels of granularity. We examine (a) sub-word features, discussing grounded influences on iconicity (systematic associations between word form and meaning); (b) words, discussing boundary conditions and generalizations for the simulation of color, sensory modality, and spatial position; (c) sentences, discussing boundary conditions and applications of action direction simulation; (d) texts, discussing how the teaching of simulation can improve comprehension in beginning readers; (e) conversations, discussing how multi-modal cues improve turn taking and alignment; and (f) text corpora, discussing how distributional semantic models can reveal how grounded and embodied knowledge is encoded in texts. These approaches are converging on a convincing account of the psychology of language, but at the same time, there are important criticisms of the embodied approach and of specific experimental paradigms. The surest way forward requires the adoption of a wide array of scientific methods. By providing complimentary evidence, a combination of multiple methods on various levels of granularity can help us gain a more complete understanding of the role of embodiment and grounding in language processing.

Cortical networks for recognition of speech with simultaneous talkers

The relative contributions of superior temporal vs. inferior frontal and parietal networks to recognition of speech in a background of competing speech remain unclear, although the contributions themselves are well established. Here, we use fMRI with spectrotemporal modulation transfer function (ST-MTF) modeling to examine the speech information represented in temporal vs. frontoparietal networks for two speech recognition tasks with and without a competing talker. Specifically, 31 listeners completed two versions of a three-alternative forced choice competing speech task: "Unison" and "Competing", in which a female (target) and a male (competing) talker uttered identical or different phrases, respectively. Spectrotemporal modulation filtering (i.e., acoustic distortion) was applied to the two-talker mixtures and ST-MTF models were generated to predict brain activation from differences in spectrotemporal-modulation distortion on each trial. Three cortical networks were identified based on differential patterns of ST-MTF predictions and the resultant ST-MTF weights across conditions (Unison, Competing): a bilateral superior temporal (S-T) network, a frontoparietal (F-P) network, and a network distributed across cortical midline regions and the angular gyrus (M-AG). The S-T network and the M-AG network responded primarily to spectrotemporal cues associated with speech intelligibility, regardless of condition, but the S-T network responded to a greater range of temporal modulations suggesting a more acoustically driven response. The F-P network responded to the absence of intelligibility-related cues in both conditions, but also to the absence (presence) of target-talker (competing-talker) vocal pitch in the Competing condition, suggesting a generalized response to signal degradation. Task performance was best predicted by activation in the S-T and F-P networks, but in opposite directions (S-T: more activation = better performance; F-P: vice versa). Moreover, S-T network predictions were entirely ST-MTF mediated while F-P network predictions were ST-MTF mediated only in the Unison condition, suggesting an influence from non-acoustic sources (e.g., informational masking) in the Competing condition. Activation in the M-AG network was weakly positively correlated with performance and this relation was entirely superseded by those in the S-T and F-P networks. Regarding contributions to speech recognition, we conclude: (a) superior temporal regions play a bottom-up, perceptual role that is not qualitatively dependent on the presence of competing speech; (b) frontoparietal regions play a top-down role that is modulated by competing speech and scales with listening effort; and (c) performance ultimately relies on dynamic interactions between these networks, with ancillary contributions from networks not involved in speech processing per se (e.g., the M-AG network).

Attentional biases toward auditory weight-related information among females with weight dissatisfaction

Although there is substantial evidence of visual attentional biases in processing weight-related information among individuals with weight dissatisfaction, few studies have examined auditory attentional biases in these individuals. The identification of attentional biases may provide an impetus for interventions to reduce distress, negative body image, and pathological eating patterns among weight-dissatisfied individuals. Therefore, the present study aimed to investigate the attentional biases, as well as the neural consequences, toward auditory weight-related information among weight-dissatisfied young females. In this experiment, young female participants were assigned to an experimental group with high weight dissatisfaction (HWD) and a control group with low weight dissatisfaction (LWD) according to the levels of weight dissatisfaction. Using a spatial cueing paradigm, auditory fatness-related, thinness-related, and neutral household words were presented laterally as cue stimuli, followed by visual stimuli presented at either the cued or uncued location. The results revealed that auditory fatness-related words elicited significantly larger N2ac amplitudes than auditory thinness-related and neutral words in the HWD group. However, for the LWD group, thinness-related words elicited a significantly larger N2ac than fatness-related and neutral words. These results suggest an orienting attentional bias toward auditory fatness-related body words among females with HWD and an orienting attentional bias toward auditory thinness-related words among females with LWD.

How to not induce SNAs: The insufficiency of directional force

People respond faster to smaller numbers in their left space and to larger numbers in their right space. Here we argue that movements in space contribute to the formation of spatial-numerical associations (SNAs). We studied the impact of continuous isometric forces along the horizontal or vertical cardinal axes on SNAs while participants performed random number production and arithmetic verification tasks. Our results suggest that such isometric directional force do not suffice to induce SNAs.

Early lexical processing of Chinese one-character words and Mongolian words: A comparative study using event-related potentials

Logographic language and alphabetic language differ significantly in orthography. Investigating the commonality and particularity of visual word recognition between the two distinct writing systems is informative for understating the neural mechanisms underlying visual word recognition. In the present study, we compared the chronometry of early lexical processing and the brain regions involved in early lexical processing between Chinese (logographic language) and Mongolian (alphabetic language) by recording event-related potentials (ERPs) using both implicit and explicit reading tasks. Familiar Chinese one-character words (lexical) and unknown Chinese one-character words (non-lexical) were pseudorandomly presented to native Chinese readers in Experiment 1. Mongolian words (lexical) and pseudowords (non-lexical) were pseudorandomly presented to native Mongolian readers in Experiment 2. In the color decision task, participants were asked to decide the color (black or blue) of each stimulus. In the lexical recognition task, participants were asked to report whether they could recognize each stimulus. The results showed that in both experiments and both tasks, ERPs to lexical items differed significantly from those to non-lexical items in the parietooccipital scalp region approximately 250 ms after stimulus onset, reflecting the early lexical processing, which likely originated from the ventral occipitotemporal cortex as revealed by source analysis. These results indicated that although Chinese and Mongolian differed markedly in orthographic features, the neural mechanisms underlying early lexical processing are similar between the two languages.

Multiple functions of the angular gyrus at high temporal resolution

Here, the functions of the angular gyrus (AG) are evaluated in the light of current evidence from transcranial magnetic/electric stimulation (TMS/TES) and EEG/MEG studies. 65 TMS/TES and 52 EEG/MEG studies were examined in this review. TMS/TES literature points to a causal role in semantic processing, word and number processing, attention and visual search, self-guided movement, memory, and self-processing. EEG/MEG studies reported AG effects at latencies varying between 32 and 800 ms in a wide range of domains, with a high probability to detect an effect at 300-350 ms post-stimulus onset. A three-phase unifying model revolving around the process of sensemaking is then suggested: (1) early AG involvement in defining the current context, within the first 200 ms, with a bias toward the right hemisphere; (2) attention re-orientation and retrieval of relevant information within 200-500 ms; and (3) cross-modal integration at late latencies with a bias toward the left hemisphere. This sensemaking process can favour accuracy (e.g. for word and number processing) or plausibility (e.g. for comprehension and social cognition). Such functions of the AG depend on the status of other connected regions. The much-debated semantic role is also discussed as follows: (1) there is a strong TMS/TES evidence for a causal semantic role, (2) current EEG/MEG evidence is however weak, but (3) the existing arguments against a semantic role for the AG are not strong. Some outstanding questions for future research are proposed. This review recognizes that cracking the role(s) of the AG in cognition is possible only when its exact contributions within the default mode network are teased apart.

Linguistic signs in action: The neuropragmatics of speech acts

What makes human communication exceptional is the ability to grasp speaker's intentions beyond what is said verbally. How the brain processes communicative functions is one of the central concerns of the neurobiology of language and pragmatics. Linguistic-pragmatic theories define these functions as speech acts, and various pragmatic traits characterise them at the levels of propositional content, action sequence structure, related commitments and social aspects. Here I discuss recent neurocognitive studies, which have shown that the use of identical linguistic signs in conveying different communicative functions elicits distinct and ultra-rapid neural responses. Interestingly, cortical areas show differential involvement underlying various pragmatic features related to theory-of-mind, emotion and action for specific speech acts expressed with the same utterances. Drawing on a neurocognitive model, I posit that understanding speech acts involves the expectation of typical partner follow-up actions and that this predictive knowledge is immediately reflected in mind and brain.

Taxonomically-related Word Pairs Evoke both N400 and LPC at Long SOA in Turkish

Semantic priming in Turkish was examined in 36 right-handed healthy participants in a delayed lexical decision task via taxonomic relations using EEG. Prime-target relations included related- unrelated- and pseudo-words. Taxonomically related words at long stimulus onset asynchrony (SOA) were shown to modulate N400 and late positive component (LPC) amplitudes. N400 semantic priming effect in the time window of 300-500 ms was the largest for pseudo-words, intermediate for semantically-unrelated targets, and smallest for semantically-related targets as a reflection of lexical-semantic retrieval. This finding contributes to the ERP literature showing how remarkably universal the N400 brain potential is, with similar effects across languages and orthography. The ERP data also revealed different influences of related, unrelated, and pseudo-word conditions on the amplitude of the LPC. Attention scores and mean LPC amplitudes of related words in parietal region showed a moderate correlation, indicating LPC may be related to "relationship-detection process".

Very early and late form-to-meaning computations during visual word recognition as revealed by electrophysiology

We used a large-scale data-driven approach to investigate the role of word form in accessing semantics. By using distributional semantic methods and taking advantage of an ERP lexical decision mega-study, we investigated the exact time dynamic of semantic access from printed words as driven by orthography-semantics consistency (OSC) and phonology-semantics consistency (PSC). Generalized Additive Models revealed very early and late OSC-by-PSC interactions, visible at 100 and 400 msec, respectively. This pattern suggests that, during visual word recognition: a) meaning is accessed by means of two distinct and interactive paths - the orthography-to-meaning and the orthography-to-phonology-to-meaning path -, which mutually contribute to recognition since early stages; b) the system may exploit a dual mechanism for semantic access, with early and late effects associated to a fast-coarse and a slow-fine grained semantic analysis, respectively. The results also highlight the high sensitivity of the visual word recognition system to arbitrary form-meaning relations.

Brain correlates of action word memory revealed by fMRI

Understanding language semantically related to actions activates the motor cortex. This activation is sensitive to semantic information such as the body part used to perform the action (e.g. arm-/leg-related action words). Additionally, motor movements of the hands/feet can have a causal effect on memory maintenance of action words, suggesting that the involvement of motor systems extends to working memory. This study examined brain correlates of verbal memory load for action-related words using event-related fMRI. Seventeen participants saw either four identical or four different words from the same category (arm-/leg-related action words) then performed a nonmatching-to-sample task. Results show that verbal memory maintenance in the high-load condition produced greater activation in left premotor and supplementary motor cortex, along with posterior-parietal areas, indicating that verbal memory circuits for action-related words include the cortical action system. Somatotopic memory load effects of arm- and leg-related words were observed, but only at more anterior cortical regions than was found in earlier studies employing passive reading tasks. These findings support a neurocomputational model of distributed action-perception circuits (APCs), according to which language understanding is manifest as full ignition of APCs, whereas working memory is realized as reverberant activity receding to multimodal prefrontal and lateral temporal areas.

Catch the star! Spatial information activates the manual motor system

Previous research demonstrated a close bidirectional relationship between spatial attention and the manual motor system. However, it is unclear whether an explicit hand movement is necessary for this relationship to appear. A novel method with high temporal resolution–bimanual grip force registration–sheds light on this issue. Participants held two grip force sensors while being presented with lateralized stimuli (exogenous attentional shifts, Experiment 1), left- or right-pointing central arrows (endogenous attentional shifts, Experiment 2), or the words "left" or "right" (endogenous attentional shifts, Experiment 3). There was an early interaction between the presentation side or arrow direction and grip force: lateralized objects and central arrows led to a larger increase of the ipsilateral force and a smaller increase of the contralateral force. Surprisingly, words led to the opposite pattern: larger force increase in the contralateral hand and smaller force increase in the ipsilateral hand. The effect was stronger and appeared earlier for lateralized objects (60 ms after stimulus presentation) than for arrows (100 ms) or words (250 ms). Thus, processing visuospatial information automatically activates the manual motor system, but the timing and direction of this effect vary depending on the type of stimulus.

Lexical Frequency and Sentence Context Influence the Brain's Response to Single Words

Typical adults read remarkably quickly. Such fast reading is facilitated by brain processes that are sensitive to both word frequency and contextual constraints. It is debated as to whether these attributes have additive or interactive effects on language processing in the brain. We investigated this issue by analysing existing magnetoencephalography data from 99 participants reading intact and scrambled sentences. Using a cross-validated model comparison scheme, we found that lexical frequency predicted the word-by-word elicited MEG signal in a widespread cortical network, irrespective of sentential context. In contrast, index (ordinal word position) was more strongly encoded in sentence words, in left front-temporal areas. This confirms that frequency influences word processing independently of predictability, and that contextual constraints affect word-by-word brain responses. With a conservative multiple comparisons correction, only the interaction between lexical frequency and surprisal survived, in anterior temporal and frontal cortex, and not between lexical frequency and entropy, nor between lexical frequency and index. However, interestingly, the uncorrected index × frequency interaction revealed an effect in left frontal and temporal cortex that reversed in time and space for intact compared to scrambled sentences. Finally, we provide evidence to suggest that, in sentences, lexical frequency and predictability may independently influence early (<150 ms) and late stages of word processing, but also interact during late stages of word processing (>150-250 ms), thus helping to converge previous contradictory eye-tracking and electrophysiological literature. Current neurocognitive models of reading would benefit from accounting for these differing effects of lexical frequency and predictability on different stages of word processing.

The interplay between respectfulness and lexical-semantic in reading Chinese: evidence from ERPs

Language comprehension requires the processing of both linguistic and extra-linguistic information, such as syntax, semantics, and pragmatic information. Previous studies have systematically examined the interplay between syntactic and semantic processing. However, there is a lack of data on how pragmatic processing proceeds and its interaction with semantic processing. Using event-related potentials (ERPs), the present study manipulated the semantic coherence of a verb phrase (VP) and the respect consistency of the object noun phrase in the VP, resulting in four types of critical sentences. Participants read 160 critical Chinese sentences and 220 filler sentences. After electroencephalogram recordings, they completed the Autism Quotient Communication (AQ-Comm) subscale and a sentence acceptability rating task. The ERP results showed that respect violation elicited a larger N400 response and a late negative activity in the pragmatically less-skilled subgroup (as indexed by higher scores on the AQ-Comm subscale). In contrast, respect violation elicited a P600 response in the pragmatically skilled subgroup (as indexed by lower scores on the AQ-Comm subscale). The double violation condition elicited an ERP pattern that was similar to that of the semantic violation condition in both subgroups, suggesting that respect violation effects were present only when the VP was semantically coherent. These results suggest that semantic violation can preclude readers from engaging in pragmatic inferencing, regardless of the participants' pragmatic skills. Strategies for resolving respect violation and corresponding brain activities vary according to participants' pragmatic abilities.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s11571-021-09700-2.

Task modulation of spatiotemporal dynamics in semantic brain networks: An EEG/MEG study

How does brain activity in distributed semantic brain networks evolve over time, and how do these regions interact to retrieve the meaning of words? We compared spatiotemporal brain dynamics between visual lexical and semantic decision tasks (LD and SD), analysing whole-cortex evoked responses and spectral functional connectivity (coherence) in source-estimated electroencephalography and magnetoencephalography (EEG and MEG) recordings. Our evoked analysis revealed generally larger activation for SD compared to LD, starting in primary visual area (PVA) and angular gyrus (AG), followed by left posterior temporal cortex (PTC) and left anterior temporal lobe (ATL). The earliest activation effects in ATL were significantly left-lateralised. Our functional connectivity results showed significant connectivity between left and right ATL, PTC and right ATL in an early time window, as well as between left ATL and IFG in a later time window. The connectivity of AG was comparatively sparse. We quantified the limited spatial resolution of our source estimates via a leakage index for careful interpretation of our results. Our findings suggest that the different demands on semantic information retrieval in lexical and semantic decision tasks first modulate visual and attentional processes, then multimodal semantic information retrieval in the ATLs and finally control regions (PTC and IFG) in order to extract task-relevant semantic features for response selection. Whilst our evoked analysis suggests a dominance of left ATL for semantic processing, our functional connectivity analysis also revealed significant involvement of right ATL in the more demanding semantic task. Our findings demonstrate the complementarity of evoked and functional connectivity analysis, as well as the importance of dynamic information for both types of analyses.

OUP accepted manuscript

During conversations, speech prosody provides important clues about the speaker’s communicative intentions. In many languages, a rising vocal pitch at the end of a sentence typically expresses a question function, whereas a falling pitch suggests a statement. Here, the neurophysiological basis of intonation and speech act understanding were investigated with high-density electroencephalography (EEG) to determine whether prosodic features are reflected at the neurophysiological level. Already approximately 100 ms after the sentence-final word differing in prosody, questions, and statements expressed with the same sentences led to different neurophysiological activity recorded in the event-related potential. Interestingly, low-pass filtered sentences and acoustically matched nonvocal musical signals failed to show any neurophysiological dissociations, thus suggesting that the physical intonation alone cannot explain this modulation. Our results show rapid neurophysiological indexes of prosodic communicative information processing that emerge only when pragmatic and lexico-semantic information are fully expressed. The early enhancement of question-related activity compared with statements was due to sources in the articulatory-motor region, which may reflect the richer action knowledge immanent to questions, namely the expectation of the partner action of answering the question. The present findings demonstrate a neurophysiological correlate of prosodic communicative information processing, which enables humans to rapidly detect and understand speaker intentions in linguistic interactions.

Visual event-related potentials reveal the early lexical processing of Chinese characters

Logographic scripts such as Chinese differ markedly from alphabetic scripts. The time-course of the lexical processing of alphabetic words was widely studied by recording event-related potentials (ERPs), and the results indicated that alphabetic words are rapidly and automatically processed. This study investigated whether there is also rapid and automatic lexical processing of Chinese characters by recording ERPs. High-frequency (HF) characters and orthographically similar low-frequency (LF) characters were pseudo-randomly presented to proficient Chinese readers. The color of half of the characters was blue and the color of the other half was black. In the color decision task, participants were asked to determine the color of each character. In the lexical recognition task, participants were asked to report whether s/he knew each character (the LF characters in this study were very rare characters which were usually not recognized by proficient Chinese readers). In both tasks, the N170 elicited by HF characters peaked earlier than the N170 elicited by LF characters in the right parieto-occipital area (PO8), and the ERPs to HF characters diverged from the ERPs to LF characters around 210-222 ms after the stimulus onset. These results reflected the rapid and automatic lexical processing of Chinese characters. Source analysis results suggested that the left and the right occipitotemporal cortices and the right visual cortex were the neural origins of the early lexical processing of Chinese characters, and the peak activation was in the right visual cortex.

Noun-phrase production as a window to language selection: An ERP study

Characterising the time course of non-native language production is critical in understanding the mechanisms behind successful communication. Yet, little is known about the modulating role of cross-linguistic influence (CLI) on the temporal unfolding of non-native production and the locus of target language selection. In this study, we explored CLI effects on non-native noun phrase production with behavioural and neural methods. We were particularly interested in the modulation of the P300 as an index for inhibitory control, and the N400 as an index for co-activation and CLI. German late learners of Spanish overtly named pictures while their EEG was monitored. Our results indicate traceable CLI effects at the behavioural and neural level in both early and late production stages. This suggests that speakers faced competition between the target and non-target language until advanced production stages. Our findings add important behavioural and neural evidence to the underpinnings of non-native production processes, in particular for late learners.

Feel Thine Own Self – Mood Congruency Evaluation of Emotional State Adjectives

Abstract. The goal of the study was to explore event-related potential (ERP) differences during the processing of emotional adjectives that were evaluated as congruent or incongruent with the current mood. We hypothesized that the first effects of congruence evaluation would be evidenced during the earliest stages of semantic analysis. Sixty mood adjectives were presented separately for 1,000 ms each during two sessions of mood induction. After each presentation, participants evaluated to what extent the word described their mood. The results pointed to incongruence marking of adjective’s meaning with current mood during early attention orientation and semantic access stages (the P150 component time window). This was followed by enhanced processing of congruent words at later stages. As a secondary goal the study also explored word valence effects and their relation to congruence evaluation. In this regard, no significant effects were observed on the ERPs; however, a negativity bias (enhanced responses to negative adjectives) was noted on the behavioral data (RTs), which could correspond to the small differences traced on the late positive potential.

First Language Attrition: What It Is, What It Isn't, and What It Can Be

This review aims at clarifying the concept of first language attrition by tracing its limits, identifying its phenomenological and contextual constraints, discussing controversies associated with its definition, and suggesting potential directions for future research. We start by reviewing different definitions of attrition as well as associated inconsistencies. We then discuss the underlying mechanisms of first language attrition and review available evidence supporting different background hypotheses. Finally, we attempt to provide the groundwork to build a unified theoretical framework allowing for generalizable results. To this end, we suggest the deployment of a rigorous neuroscientific approach, in search of neural markers of first language attrition in different linguistic domains, putting forward hypothetical experimental ways to identify attrition's neural traces and formulating predictions for each of the proposed experimental paradigms.

When politeness processing encounters failed syntactic/semantic processing

Previous studies have elucidated the neural mechanism of syntactic/semantic processing and pragmatic processing. However, the exact mechanisms by which these two aspects of processing interact during language comprehension remain unknown. In this event-related brain potential study, we examined the interaction between politeness processing and local syntactic/semantic processing of a phrase. We used a full factorial design that crossed politeness consistency with local syntactic/semantic coherence. Politeness violations elicited a P200 effect in the 190-320 ms range, centro-parietally distributed positivity in the 360-866 ms range, and pure local syntactic/semantic violation elicited a broad distributed positivity in the 362-868 ms range. Crucially, we found that event-related potential responses elicited by combined politeness and syntactic/semantic violations resemble those elicited by separate syntactic/semantic violations. These results indicated that local syntactic/semantic processing has a functional primacy over politeness processing. Furthermore, our results support the blocking hypothesis from a politeness processing perspective instead of the independent hypothesis.

Neural correlates of phonology-to-orthography mapping consistency effects on Chinese spoken word recognition

Previous studies have shown that reading experience reshapes speech processing. The orthography can be implemented in the brain by restructuring the phonological representations or being co-activated during spoken word recognition. This study utilized event-related functional magnetic resonance imaging and functional connectivity analysis to examine the neural mechanism underlying two types of orthographic effects in the Chinese auditory semantic category task, namely phonology-to-orthography consistency (POC) and homophone density (HD). We found that the POC effects originated from the speech network, suggesting that sublexical orthographic information could change the organization of preexisting phonological representations when learning to read. Meanwhile, the HD effects were localized to the left fusiform and lingual gyrus, suggesting that lexical orthographic knowledge may be activated online during spoken word recognition. These results demonstrated the different natures and neural mechanisms for the POC and HD effects on Chinese spoken word recognition.

The Same Ultra-Rapid Parallel Brain Dynamics Underpin the Production and Perception of Speech

The temporal dynamics by which linguistic information becomes available is one of the key properties to understand how language is organized in the brain. An unresolved debate between different brain language models is whether words, the building blocks of language, are activated in a sequential or parallel manner. In this study, we approached this issue from a novel perspective by directly comparing the time course of word component activation in speech production versus perception. In an overt object naming task and a passive listening task, we analyzed with mixed linear models at the single-trial level the event-related brain potentials elicited by the same lexico-semantic and phonological word knowledge in the two language modalities. Results revealed that both word components manifested simultaneously as early as 75 ms after stimulus onset in production and perception; differences between the language modalities only became apparent after 300 ms of processing. The data provide evidence for ultra-rapid parallel dynamics of language processing and are interpreted within a neural assembly framework where words recruit the same integrated cell assemblies across production and perception. These word assemblies ignite early on in parallel and only later on reverberate in a behavior-specific manner.

Electrophysiological Evidence of Dissociation Between Explicit Encoding and Fast Mapping of Novel Spoken Words

Existing behavioral, neuropsychological and functional neuroimaging data suggest that at least two major cognitive strategies are used for new word learning: fast mapping (FM) via context-dependent inference and explicit encoding (EE) via direct instruction. However, these distinctions remain debated at both behavioral and neurophysiological levels, not least due to confounds related to diverging experimental settings. Furthermore, the neural dynamics underpinning these two putative processes remain poorly understood. To tackle this, we designed a paradigm presenting 20 new spoken words in association with pictures in either FM or EE settings, closely matched for auditory and visual features and overall task demands. We tested word acquisition using a range of behavioral measures as well as passive event-related potential (ERP) responses, an established measure of word memory trace activation, and compared brain activity elicited by novel FM and EE words before and after the learning session. Behavioral data obtained in free recall, recognition and semantic word-picture matching tasks indicated successful acquisition of new words after just 10 exposures. Crucially, we found no behavioral evidence of different acquisition outcomes between FM and EE learning. ERP data, which exhibited the main response peaks at ~170, 250, and 520 ms, also indicated successful learning, with statistically different responses between novel and familiar words present only before, but not after the training, suggesting rapid formation of new neural memory circuits matching in activation those for previously known words. Furthermore, already at the earliest peak, we found different topographic distributions for the two learning types, with left-lateralized FM dynamics, suggestive of core language system involvement, and more diffuse activity for EE items, possibly suggesting the role of attention/executive control network. A similar effect also manifested later, at ~520 ms. Our data suggest that while both EE and FM learning can be successful for rapid word acquisition at the behavioral level, the diverging electrophysiological patterns suggest a dissociation between the neural systems underpinning these learning strategies.

The Force of Numbers: Investigating Manual Signatures of Embodied Number Processing

The study has two objectives: (1) to introduce grip force recording as a new technique for studying embodied numerical processing; and (2) to demonstrate how three competing accounts of numerical magnitude representation can be tested by using this new technique: the Mental Number Line (MNL), A Theory of Magnitude (ATOM) and Embodied Cognition (finger counting-based) account. While 26 healthy adults processed visually presented single digits in a go/no-go n-back paradigm, their passive holding forces for two small sensors were recorded in both hands. Spontaneous and unconscious grip force changes related to number magnitude occurred in the left hand already 100–140 ms after stimulus presentation and continued systematically. Our results support a two-step model of number processing where an initial stage is related to the automatic activation of all stimulus properties whereas a later stage consists of deeper conscious processing of the stimulus. This interpretation generalizes previous work with linguistic stimuli and elaborates the timeline of embodied cognition. We hope that the use of grip force recording will advance the field of numerical cognition research.

Rapid acquisition of novel written word-forms: ERP evidence

Background

Novel word acquisition is generally believed to be a rapid process, essential for ensuring a flexible and efficient communication system; at least in spoken language, learners are able to construct memory traces for new linguistic stimuli after just a few exposures. However, such rapid word learning has not been systematically found in visual domain, with different confounding factors obscuring the orthographic learning of novel words. This study explored the changes in human brain activity occurring online, during a brief training with novel written word-forms using a silent reading task

Results

Single-trial, cluster-based random permutation analysis revealed that training caused an extremely fast (after just one repetition) and stable facilitation in novel word processing, reflected in the modulation of P200 and N400 components, possibly indicating rapid dynamics at early and late stages of the lexical processing. Furthermore, neural source estimation of these effects revealed the recruitment of brain areas involved in orthographic and lexico-semantic processing, respectively.

Conclusions

These results suggest the formation of neural memory traces for novel written word-forms after a minimal exposure to them even in the absence of a semantic reference, resembling the rapid learning processes known to occur in spoken language.

Visual mismatch negativity elicited by semantic violations in visual words

The remarkable rapidity and effortlessness of speech perception and word reading by skilled listeners or readers suggest implicit or automatic mechanisms underlying language processing. In speech perception, the implicit mechanisms are reflected by the auditory mismatch negativity (MMN) response, suggesting that phonemic, lexical, semantic, and syntactic information are automatically and rapidly processed in the absence of focused attention. In visual word reading, implicit orthographic and lexical processing are reflected by visual mismatch negativity (vMMN), the visual counterpart of auditory MMN. The semantic processing of spoken words is reflected by MMN. This study investigated whether semantic processing is also reflected by vMMN. For this purpose, visual Chinese words belonging to different semantic categories (color, taste, and action) were presented to participants in oddball paradigms. A set of words belonging to the same semantic category was frequently presented as standards; a word belonging to a different semantic category was presented sporadically as deviant. Participants were instructed to perform a visual cross-change detection task and ignore the words. Significant vMMN was elicited in Experiments 1 to 3, in which the deviant word carried a semantic radical that overtly indicated the word's semantic category information. The vMMNs were most prominent around 260 ms after word onset, were parieto-occipital distributed, and were significantly left-hemisphere lateralized, suggesting rapid semantic processing of the visual words' category-related information. No significant vMMN was elicited in Experiment 4, in which the deviant word did not carry any semantic radicals. Thus, the semantic radical, which has a high frequency of occurrence because it is carried by many words, may be critical for the elicitation of vMMN.

Lexical processing in sign language: A visual mismatch negativity study

Event-related potential studies of spoken and written language show the automatic access of auditory and visual words, as indexed by mismatch negativity (MMN) or visual MMN (vMMN). The present study examined whether the same automatic lexical processing occurs in a visual-gestural language, i.e., Hong Kong Sign Language (HKSL). Using a classic visual oddball paradigm, deaf signers and hearing non-signers were presented with a sequence of static images representing HKSL lexical signs and non-signs. When compared with hearing non-signers, deaf signers exhibited an enhanced vMMN elicited by the lexical signs at around 230 ms, and a larger P1-N170 complex evoked by both lexical sign and non-sign standards at the parieto-occipital area in the early time window between 65 ms and 170 ms. These findings indicate that deaf signers implicitly process the lexical sign and that neural response differences between deaf signers and hearing non-signers occur at the early stage of sign processing.

The sensitivity of event-related potentials/fields to logopedic interventions in patients with stroke-related aphasia

Recovery of stroke-related aphasia can be affected by language therapy in the early and chronic stage. Objectively monitoring therapy-induced neuroplasticity is possible by several measurement techniques including electro- and magneto-encephalography. The obtained event-related potentials (ERPs) and fields (ERFs) provide insights into the neural basis of intact or deficient language processing with milliseconds precision. In this literature review, we highlight the sensitivity of ERPs and ERFs to logopedic interventions by providing an overview of therapy-induced changes in the amplitude, latency and topography of early and mid-to-late components.

The oscillatory mechanisms associated with syntactic binding in healthy ageing

Older adults frequently display differential patterns of brain activity compared to young adults in the same task, alongside widespread neuroanatomical changes. Differing functional activity patterns in older adults are commonly interpreted as being compensatory (e.g., Cabeza et al., 2002). We examined the oscillatory activity in the EEG during syntactic binding in young and older adults, as well as the relationship between oscillatory activity and behavioural performance on a syntactic judgement task within the older adults. 19 young and 41 older adults listened to two-word sentences that differentially load onto morpho-syntactic binding: correct syntactic binding (morpho-syntactically correct, e.g., "I dotch"); incorrect syntactic binding (morpho-syntactic agreement violation, e.g., "they dotches") and no syntactic binding (minimizing morpho-syntactic binding, e.g., "dotches spuff"). Behavioural performance, assessed in a syntactic judgement task, was characterized by inter-individual variability especially in older adults, with accuracy ranging from 76 to 100% in young adults and 58-100% in older adults. Compared to young adults, older adults were slower, but not less accurate. Functional neural signatures for syntactic binding were assessed as the difference in oscillatory power between the correct and no syntactic binding condition. In older adults, syntactic binding was associated with a smaller increase in theta (4-7 Hz), alpha (8-12 Hz) and beta (15-20 Hz) power in a time window surrounding the second word. There was a significant difference between the older and young adults: in the alpha range, the condition difference seemed to be in the opposite direction for older versus young adults. Our findings thus suggest that the neural signature associated with syntactic binding in older adults is different from young adults. However, we found no evidence of a significant association between behavioural performance and the neural signatures of syntactic binding for older adults, which does not readily support the predictions of compensatory models of language and ageing.

Referent's Lexical Frequency Predicts Mismatch Negativity Responses to New Words Following Semantic Training

Lexical ERPs (event-related potentials) obtained in an oddball paradigm were suggested to be an index of the formation of new word representations in the brain in the learning process: with increased exposure to new lexemes, the ERP amplitude grows, which is interpreted as a signature of a new memory-trace build-up and activation. Previous learning studies using this approach have, however, mostly used meaningless novel word forms; it therefore remains uncertain whether the increased amplitude simply reflects increased familiarity with the new stimulus or is indeed a reflection of a complete word representation. Here, we used the oddball paradigm to measure the mismatch negativity (MMN) responses to novel word forms before and after semantic training, during which they were associated with previously familiar words of either high or low frequency of occurrence. Following training, the amplitude of the MMN to novel words was enhanced. Furthermore, these changes were dependent on the frequency of the reference which novel items became associated with: namely, the MMN amplitude became greater and the latency shorter for the item which was assigned the high-frequency meaning. Even though the amount of training was the same for both types of items, the low-frequency stimulus did not achieve similar significant changes. Our results suggest that the new surface form becomes linked to the existing representation, which then automatically activates in full when the respective stimulus is present at the input. This finding indicates that the learning-related MMN dynamics, manifest as a response increase after learning, likely reflects the formation and activation of a complete lexicosemantic memory circuits for words.

Concurrent affective and linguistic prosody with the same emotional valence elicits a late positive ERP response

Change in linguistic prosody generates a mismatch negativity response (MMN), indicating neural representation of linguistic prosody, while change in affective prosody generates a positive response (P3a), reflecting its motivational salience. However, the neural response to concurrent affective and linguistic prosody is unknown. The present paper investigates the integration of these two prosodic features in the brain by examining the neural response to separate and concurrent processing by electroencephalography (EEG). A spoken pair of Swedish words—[ˈfɑ́ːsɛn] phase and [ˈfɑ̀ːsɛn] damn—that differed in emotional semantics due to linguistic prosody was presented to 16 subjects in an angry and neutral affective prosody using a passive auditory oddball paradigm. Acoustically matched pseudowords—[ˈvɑ́ːsɛm] and [ˈvɑ̀ːsɛm]—were used as controls. Following the constructionist concept of emotions, accentuating the conceptualization of emotions based on language, it was hypothesized that concurrent affective and linguistic prosody with the same valence—angry [ˈfɑ̀ːsɛn] damn—would elicit a unique late EEG signature, reflecting the temporal integration of affective voice with emotional semantics of prosodic origin. In accordance, linguistic prosody elicited an MMN at 300–350 ms, and affective prosody evoked a P3a at 350–400 ms, irrespective of semantics. Beyond these responses, concurrent affective and linguistic prosody evoked a late positive component (LPC) at 820–870 ms in frontal areas, indicating the conceptualization of affective prosody based on linguistic prosody. This study provides evidence that the brain does not only distinguish between these two functions of prosody but also integrates them based on language and experience.

Prediction and Mismatch Negativity Responses Reflect Impairments in Action Semantic Processing in Adults With Autism Spectrum Disorders

The neurophysiological mechanisms underlying motor and language difficulties in autism spectrum disorders (ASD) are still largely unclear. The present work investigates biological indicators of sound processing, (action-) semantic understanding and predictive coding and their correlation with clinical symptoms of ASD. Twenty-two adults with high-functioning ASD and 25 typically developed (TD) participants engaged in an auditory, passive listening, Mismatch Negativity (MMN) task while high-density electroencephalography (EEG) was recorded. Action and non-action words were presented in the context of sounds, which were either semantically congruent with regard to the body part they relate to or semantically incongruent or unrelated. The anticipatory activity before sound onset, the Prediction Potential (PP), was significantly reduced in the ASD group specifically for action, but not for non-action sounds. The early-MMN-like responses to words (latency: 120 ms) were differentially modulated across groups: controls showed larger amplitudes for words in action-sound compared to non-action contexts, whereas ASD participants demonstrated enlarged early-MMN-like responses only in a pure tone context, with no other modulation dependent on action sound context. Late-MMN-like responses around 560 ms post-stimulus onset revealed body-part-congruent action-semantic priming for words in control participants, but not in the ASD group. Importantly, neurophysiological indices of semantic priming in ASD participants correlated with the extent of autistic traits as revealed by the Autism Spectrum Quotient (AQ). The data suggest that high-functioning adults with ASD show a specific deficit in semantic processing and predictive coding of sounds and words related to action, which is absent for neutral, non-action, sounds.

Neurophysiological evidence for rapid processing of verbal and gestural information in understanding communicative actions

During everyday social interaction, gestures are a fundamental part of human communication. The communicative pragmatic role of hand gestures and their interaction with spoken language has been documented at the earliest stage of language development, in which two types of indexical gestures are most prominent: the pointing gesture for directing attention to objects and the give-me gesture for making requests. Here we study, in adult human participants, the neurophysiological signatures of gestural-linguistic acts of communicating the pragmatic intentions of naming and requesting by simultaneously presenting written words and gestures. Already at ~150 ms, brain responses diverged between naming and request actions expressed by word-gesture combination, whereas the same gestures presented in isolation elicited their earliest neurophysiological dissociations significantly later (at ~210 ms). There was an early enhancement of request-evoked brain activity as compared with naming, which was due to sources in the frontocentral cortex, consistent with access to action knowledge in request understanding. In addition, an enhanced N400-like response indicated late semantic integration of gesture-language interaction. The present study demonstrates that word-gesture combinations used to express communicative pragmatic intentions speed up the brain correlates of comprehension processes – compared with gesture-only understanding – thereby calling into question current serial linguistic models viewing pragmatic function decoding at the end of a language comprehension cascade. Instead, information about the social-interactive role of communicative acts is processed instantaneously.

Error-based learning and lexical competition in word production: Evidence from multilingual naming

We tested whether learning associated to lexical selection is error-based, and whether lexical selection is competitive by assessing the after-effects of producing words on subsequent production of semantic competitors differing in degree of error (translation equivalents). Speakers named pictures or words in one language (part A), and then named the same set of pictures (old set) and a new set in another language (part B). RTs for the old set (i.e., translation equivalents) were larger than for the new set (i.e., items which not have been named previously in another language). Supporting that learning is error-based, this cost was mostly larger after naming in a language with a higher degree of error (L2 vs. L1). Supporting that lexical selection is competitive, after naming in a language with a high degree of error (L3), the cost was larger for naming in another language with a high degree of error (L2 vs. L1).

Processing of task-irrelevant words of different frequency values: a visual mismatch negativity study

This study examined electrophysiological correlates of early and automatic word access. Chinese single-character words of high frequency and low frequency were peripherally presented in an oddball paradigm. Participants were instructed to carry out a centrally presented nonlinguistic colour-tracking task and ignore the lexical stimuli presented on both sides. Early visual mismatch negativity (vMMN) effects at 120-150 and 200-300 ms were elicited only by high-frequency characters, whereas low-frequency characters yielded vMMN only after 300 ms. This contrast of vMMN effects indicating lexical processing in an attention-deprived condition is suggested to result from stronger memory traces for high-frequency characters in comparison with low-frequency characters.

Grammatical class modulates the (left) inferior frontal gyrus within 100 milliseconds when syntactic context is predictive

The current study set out to examine the spatiotemporal dynamics of predictive processing during syntactic processing. To do so, we conducted an MEG experiment in which we contrasted MRI-constrained sources elicited by nouns and verbs when they were preceded by a predictive syntactic context (i.e., possessive pronouns for nouns, and personal pronouns for verbs) versus a non-predictive syntactic context (visually matched symbols). The results showed rapid (from ~80 ms onwards) noun-verb differences in the left and (to a lesser extent) right inferior frontal gyri (IFG), but only when those nouns and verbs were preceded by the syntactically predictive context (i.e. their corresponding pronoun). Furthermore, the contrast between possessive and personal pronouns that preceded the rapid noun-verb modulations in the (L)IFG also produced differences in source activation in various regions of the prefrontal cortex (the superior frontal and orbitofrontal cortex). We suggest the data show that syntactic unification manifests very early on during processing in the LIFG. The speed of such syntactic unification operations is hypothesized to be driven by predictive top-down activations stemming from a domain-general network in the prefrontal cortex.

Toward a Neurobiologically Plausible Model of Language-Related, Negative Event-Related Potentials

Language-related event-related potential (ERP) components such as the N400 have traditionally been associated with linguistic or cognitive functional interpretations. By contrast, it has been considerably more difficult to relate these components to neurobiologically grounded accounts of language. Here, we propose a theoretical framework based on a predictive coding architecture, within which negative language-related ERP components such as the N400 can be accounted for in a neurobiologically plausible manner. Specifically, we posit that the amplitude of negative language-related ERP components reflects precision-weighted prediction error signals, i.e., prediction errors weighted by the relevance of the information source leading to the error. From this perspective, precision has a direct link to cue validity in a particular language and, thereby, to relevance of individual linguistic features for internal model updating. We view components such as the N400 and LAN as members of a family with similar functional characteristics and suggest that latency and topography differences between these components reflect the locus of prediction errors and model updating within a hierarchically organized cortical predictive coding architecture. This account has the potential to unify findings from the full range of the N400 literature, including word-level, sentence-, and discourse-level results as well as cross-linguistic differences.

Differential effects of learned associations with words and pseudowords on event-related brain potentials

Associated stimulus valence affects neural responses at an early processing stage. However, in the field of written language processing, it is unclear whether semantics of a word or low-level visual features affect early neural processing advantages. The current study aimed to investigate the role of semantic content on reward and loss associations. Participants completed a learning session to associate either words (Experiment 1, N = 24) or pseudowords (Experiment 2, N = 24) with different monetary outcomes (gain-associated, neutral or loss-associated). Gain-associated stimuli were learned fastest. Behavioural and neural response changes based on the associated outcome were further investigated in separate test sessions. Responses were faster towards gain- and loss-associated than neutral stimuli if they were words, but not pseudowords. Early P1 effects of associated outcome occurred for both pseudowords and words. Specifically, loss-association resulted in increased P1 amplitudes to pseudowords, compared to decreased amplitudes to words. Although visual features are likely to explain P1 effects for pseudowords, the inversed effect for words suggests that semantic content affects associative learning, potentially leading to stronger associations.

Written-Word Concreteness Effects in Non-attend Conditions: Evidence From Mismatch Responses and Cortical Oscillations

It has been widely reported that concrete words have processing advantages over abstract words in terms of speed and efficiency of processing, a phenomenon known as the concreteness effect. However, little is still known about the early time-course of processing concrete and abstract words and whether this concreteness effect can still persist in conditions where attention is not focused on the words presented (automatic processing). This study aimed to shed light on these issues by examining the electrophysiological brain responses to concrete and abstract words. While participants were engaged in a non-linguistic color tracking task presented in the center of the monitor screen, matched Chinese concrete and abstract single-character words appeared within a passive oddball paradigm, out of the focus of attention. In calculating visual Mismatch Negativity (vMMN), Event-related potentials (ERPs) to words of the same semantic category were compared when these words were presented as deviants and standards. Before 320 ms, both abstract and concrete words yielded vMMN with left-lateralized distribution, suggesting similar verbal processing at an initial processing stage. After 320 ms, only concrete words additionally elicited vMMN with a central distribution. Time frequency (TF) analysis of the results also revealed larger theta power increase (200–300 ms) and theta power phase locking (200–450 ms) for concrete than for abstract words. Interestingly, there was more alpha power decrease for abstract than for concrete words from 300 to 450 ms. This may reflect the greater difficulty in processing abstract meaning. Taken together, our ERP and TF results point to the existence of different neural mechanisms underlying non-attentive processing of abstract and concrete words.