Neural localization of semantic context effects in electromagnetic and hemodynamic studies

Understanding words in context: A naturalistic EEG study of children's lexical processing

When listening to speech, adults rely on context to anticipate upcoming words. Evidence for this comes from studies demonstrating that the N400, an event-related potential (ERP) that indexes ease of lexical-semantic processing, is influenced by the predictability of a word in context. We know far less about the role of context in children's speech comprehension. The present study explored lexical processing in adults and 5-10-year-old children as they listened to a story. ERPs time-locked to the onset of every word were recorded. Each content word was coded for frequency, semantic association, and predictability. In both children and adults, N400s reflect word predictability, even when controlling for frequency and semantic association. These findings suggest that both adults and children use top-down constraints from context to anticipate upcoming words when listening to stories.

The Costs (and Benefits?) of Effortful Listening for Older Adults: Insights from Simultaneous Electrophysiology, Pupillometry, and Memory

Although the impact of acoustic challenge on speech processing and memory increases as a person ages, older adults may engage in strategies that help them compensate for these demands. In the current preregistered study, older adults (n = 48) listened to sentences-presented in quiet or in noise-that were high constraint with either expected or unexpected endings or were low constraint with unexpected endings. Pupillometry and EEG were simultaneously recorded, and subsequent sentence recognition and word recall were measured. Like young adults in prior work, we found that noise led to increases in pupil size, delayed and reduced ERP responses, and decreased recall for unexpected words. However, in contrast to prior work in young adults where a larger pupillary response predicted a recovery of the N400 at the cost of poorer memory performance in noise, older adults did not show an associated recovery of the N400 despite decreased memory performance. Instead, we found that in quiet, increases in pupil size were associated with delays in N400 onset latencies and increased recognition memory performance. In conclusion, we found that transient variation in pupil-linked arousal predicted trade-offs between real-time lexical processing and memory that emerged at lower levels of task demand in aging. Moreover, with increased acoustic challenge, older adults still exhibited costs associated with transient increases in arousal without the corresponding benefits.

Magnetoencephalography Language Mapping Using Auditory Memory Retrieval and Silent Repeating Task

PURPOSE

The study aims to (1) examine the spatiotemporal map of magnetoencephalography-evoked responses during an Auditory Memory Retrieval and Silent Repeating (AMRSR) task, and determine the hemispheric dominance for language, and (2) evaluate the accuracy of the AMRSR task in Wernicke and Broca area localization.

METHODS

In 30 patients with brain tumors and/or epilepsies, the AMRSR task was used to evoke magnetoencephalography responses. We applied Fast VEctor-based Spatial-Temporal Analyses with minimum L1-norm source imaging method to the magnetoencephalography responses for localizing the brain areas evoked by the AMRSR task.

RESULTS

The Fast-VEctor-based Spatial-Temporal Analysis found consistent activation in the posterior superior temporal gyrus around 300 to 500 ms, and another activation in the frontal cortex (pars opercularis and/or pars triangularis) around 600 to 900 ms, which were localized to the Wernicke area (BA 22) and Broca area (BA 44 and BA 45), respectively. The language-dominant hemispheric laterization elicited by the AMRSR task was comparable with the result from an Auditory Dichotic task result given to the same patient, with the exception that AMRSR is more sensitive on bilateral language laterization cases on finding the Wernicke and Broca areas.

CONCLUSIONS

For all patients who successfully finished the AMRSR task, Fast-VEctor-based Spatial-Temporal Analysis could establish accurate and robust localizations of Broca and Wernicke area and determine hemispheric dominance. For subjects with normal auditory functionality, the AMRSR paradigm evaluation showed significant promise in providing reliable assessments of cerebral language dominance and language network localization.

Insights from simultaneous EEG-fMRI and patient data illuminate the role of the anterior medial temporal lobe in N400 generation

The N400, a negative event-related potential (ERP) peaking approximately 400 ms after stimulus onset, is known to reflect the processing of semantic information. While scalp recordings have contributed to understanding the psychological processes underlying the N400, they have been limited in identifying its neural basis. However, recent intracranial ERP recordings and fMRI studies have shed light on the crucial role of the anterior medial temporal lobe (AMTL) in semantic information processing. These findings suggest that the N400 partially represents activity in the AMTL structures. To investigate the neural underpinnings of the N400 effect, we simultaneously recorded ERPs and event-related fMRI during a semantic priming paradigm in a sample of 12 young, healthy subjects. Additionally, we collected ERPs and structural brain data from older healthy adults and patients with amnestic mild cognitive impairment (aMCI), a population characterized by neurodegenerative changes in the AMTL. In our fMRI results, we identified bilateral loci in the AMTL as the global maxima. Employing an EEG-informed fMRI analysis, we explored trial-to-trial fluctuations in semantic processing by linking single-trial N400 amplitudes to the Blood Oxygen Level Dependent (BOLD) signal. This approach provided the first direct evidence linking the N400 recorded at the scalp level to the corresponding BOLD signal in the AMTL. Consistent with these findings, patients with aMCI exhibited a diminished N400 effect compared to healthy older adults. Furthermore, voxel-based morphometry analysis revealed a correlation between the magnitude of the N400 effect and the integrity of the AMTL. By integrating data from simultaneous EEG-fMRI, and patient studies, our research advances our understanding of the neural substrate of the N400 and highlights the critical involvement of the AMTL in semantic processing.

Causal evidence for a coordinated temporal interplay within the language network

Recent neurobiological models on language suggest that auditory sentence comprehension is supported by a coordinated temporal interplay within a left-dominant brain network, including the posterior inferior frontal gyrus (pIFG), posterior superior temporal gyrus and sulcus (pSTG/STS), and angular gyrus (AG). Here, we probed the timing and causal relevance of the interplay between these regions by means of concurrent transcranial magnetic stimulation and electroencephalography (TMS-EEG). Our TMS-EEG experiments reveal region- and time-specific causal evidence for a bidirectional information flow from left pSTG/STS to left pIFG and back during auditory sentence processing. Adapting a condition-and-perturb approach, our findings further suggest that the left pSTG/STS can be supported by the left AG in a state-dependent manner.

Mapping access to meaning in adolescents with autism: Atypical lateralization and spatiotemporal patterns as a function of language ability

Individuals with autism spectrum disorders (ASD) vary in their language abilities, associated with atypical patterns of brain activity. However, few studies have examined the spatiotemporal profiles of lexico-semantic processing in ASD, particularly as a function of language heterogeneity. Thirty-nine high-functioning adolescents with ASD and 21 typically developing (TD) peers took part in a lexical decision task that combined semantic access with demands on cognitive control. Spatiotemporal characteristics of the processing stages were examined with a multimodal anatomically-constrained magnetoencephalography (aMEG) approach, which integrates MEG with structural MRI. Additional EEG data were acquired from a limited montage simultaneously with MEG. TD adolescents showed the canonical left-dominant activity in frontotemporal regions during both early (N250m) and late (N400m) stages of lexical access and semantic integration. In contrast, the ASD participants showed bilateral engagement of the frontotemporal language network, indicative of compensatory recruitment of the right hemisphere. The left temporal N400m was prominent in both groups, confirming preserved attempts to access meaning. In contrast, the left prefrontal N400m was reduced in ASD participants, consistent with impaired semantic/contextual integration and inhibitory control. To further investigate the impact of language proficiency, the ASD sample was stratified into high- and low-performing (H-ASD and L-ASD) subgroups based on their task accuracy. The H-ASD subgroup performed on par with the TD group and showed greater activity in the right prefrontal and bilateral temporal cortices relative to the L-ASD subgroup, suggesting compensatory engagement. The L-ASD subgroup additionally showed reduced and delayed left prefrontal N400m, consistent with more profound semantic and executive impairments in this subgroup. These distinct spatiotemporal activity profiles reveal the neural underpinnings of the ASD-specific access to meaning and provide insight into the phenotypic heterogeneity of language in ASD, which may be a result of different neurodevelopmental trajectories and adoption of compensatory strategies.

Effects of Healthy Aging and Gender on the Electrophysiological Correlates of Semantic Sentence Comprehension: The Development of Dutch Normative Data

PURPOSE

The clinical use of event-related potentials in patients with language disorders is increasingly acknowledged. For this purpose, normative data should be available. Within this context, healthy aging and gender effects on the electrophysiological correlates of semantic sentence comprehension were investigated.

METHOD

One hundred and ten healthy subjects (55 men and 55 women), divided among three age groups (young, middle aged, and elderly), performed a semantic sentence congruity task in the visual modality during electroencephalographic recording.

RESULTS

The early visual complex was affected by increasing age as shown by smaller P2 amplitudes in the elderly compared to the young. Moreover, the N400 effect in the elderly was smaller than in the young and was delayed compared to latency measures in both middle-aged and young subjects. The topography of age-related amplitude changes of the N400 effect appeared to be gender specific. The late positive complex effect was increased at frontal electrode sites from middle age on, but this was not statistically significant. No gender effects were detected regarding the early P1, N1, and P2, or the late positive complex effect.

CONCLUSION

Especially aging effects were found during semantic sentence comprehension, and this from the level of perceptual processing on. Normative data are now available for clinical use.

When a Sunny Day Gives You Butterflies: An Electrophysiological Investigation of Concreteness and Context Effects in Semantic Word Processing

Theories on controlled semantic cognition assume that word concreteness and linguistic context interact during semantic word processing. Methodological approaches and findings on how this interaction manifests at the electrophysiological and behavioral levels are heterogeneous. We measured ERPs and RTs applying a validated cueing paradigm with 19 healthy participants, who performed similarity judgments on concrete or abstract words (e.g., "butterfly" or "tolerance") after reading contextual and irrelevant sentential cues. Data-driven analyses showed that concreteness increased and context decreased negative-going deflections in broadly distributed bilateral clusters covering the N400 and N700/late positive component time range, whereas both reduced RTs. Crucially, within a frontotemporal cluster in the N400 time range, contextual (vs. irrelevant) information reduced negative-going amplitudes in response to concrete but not abstract words, whereas a contextual cue reduced RTs only in response to abstract but not concrete words. The N400 amplitudes did not explain additional variance in the RT data, which showed a stronger contextual facilitation for abstract than concrete words. Our results support separate but interacting effects of concreteness and context on automatic and controlled stages of contextual semantic processing and suggest that effects on the electrophysiological versus behavioral level obtained with this paradigm are dissociated.

Speech comprehension in noisy environments: Evidence from the predictability effects on the N400 and LPC

Introduction

Speech comprehension involves context-based lexical predictions for efficient semantic integration. This study investigated how noise affects the predictability effect on event-related potentials (ERPs) such as the N400 and late positive component (LPC) in speech comprehension.

Methods

Twenty-seven listeners were asked to comprehend sentences in clear and noisy conditions (hereinafter referred to as "clear speech" and "noisy speech," respectively) that ended with a high-or low-predictability word during electroencephalogram (EEG) recordings.

Results

The study results regarding clear speech showed the predictability effect on the N400, wherein low-predictability words elicited a larger N400 amplitude than did high-predictability words in the centroparietal and frontocentral regions. Noisy speech showed a reduced and delayed predictability effect on the N400 in the centroparietal regions. Additionally, noisy speech showed a predictability effect on the LPC in the centroparietal regions.

Discussion

These findings suggest that listeners achieve comprehension outcomes through different neural mechanisms according to listening conditions. Noisy speech may be comprehended with a second-pass process that possibly functions to recover the phonological form of degraded speech through phonetic reanalysis or repair, thus compensating for decreased predictive efficiency.

ERP Analysis Using a Multi-Channel Matching Pursuit Algorithm

In this study, we propose a new algorithm for analysing event-related components observed in EEG signals in psychological experiments. We investigate its capabilities and limitations. The algorithm is based on multivariate matching pursuit and clustering. It is aimed to find patterns in EEG signals which are similar across different experimental conditions, but it allows for variations in amplitude and slight variability in topography. The method proved to yield expected results in numerical simulations. For the real data coming from an emotional categorisation task experiment, we obtained two indications. First, the method can be used as a specific filter that reduces the variability of components, as defined classically, within each experimental condition. Second, equivalent dipoles fitted to items of the activity clusters identified by the algorithm localise in compact brain areas related to the task performed by the subjects across experimental conditions. Thus this activity may be studied as candidates for hypothetical latent components. The proposed algorithm is a promising new tool in ERP studies, which deserves further experimental evaluations.

Evoking the N400 Event-related Potential (ERP) Component Using a Publicly Available Novel Set of Sentences with Semantically Incongruent or Congruent Eggplants (Endings)

During speech comprehension, the ongoing context of a sentence is used to predict sentence outcome by limiting subsequent word likelihood. Neurophysiologically, violations of context-dependent predictions result in amplitude modulations of the N400 event-related potential (ERP) component. While N400 is widely used to measure semantic processing and integration, no publicly-available auditory stimulus set is available to standardize approaches across the field. Here, we developed an auditory stimulus set of 442 sentences that utilized the semantic anomaly paradigm, provided cloze probability for all stimuli, and was developed for both children and adults. With 20 neurotypical adults, we validated that this set elicits robust N400′s, as well as two additional semantically-related ERP components: the recognition potential (~250 ms) and the late positivity component (~600 ms). This stimulus set (https://doi.org/10.5061/dryad.9ghx3ffkg) and the 20 high-density (128-channel) electrophysiological datasets (https://doi.org/10.5061/dryad.6wwpzgmx4) are made publicly available to promote data sharing and reuse. Future studies that use this stimulus set to investigate sentential semantic comprehension in both control and clinical populations may benefit from the increased comparability and reproducibility within this field of research.

Neurophysiological correlates of automatic integration of voice and gender information during grammatical processing

During verbal communication, interlocutors rely on both linguistic (e.g., words, syntax) and extralinguistic (e.g., voice quality) information. The neural mechanisms of extralinguistic information processing are particularly poorly understood. To address this, we used EEG and recorded event-related brain potentials while participants listened to Russian pronoun-verb phrases presented in either male or female voice. Crucially, we manipulated congruency between the grammatical gender signaled by the verbs' ending and the speakers' apparent gender. To focus on putative automatic integration of extralinguistic information into syntactic processing and avoid confounds arising from secondary top-down processes, we used passive non-attend auditory presentation with visual distraction and no stimulus-related task. Most expressed neural responses were found at both early (150 ms, ELAN-like) and late (400 ms, N400-like) phrase processing stages. Crucially, both of these brain responses exhibited sensitivity to extralinguistic information and were significantly enhanced for phrases whose voice and grammatical gender were incongruent, similar to what is known for ERPs effects related to overt grammatical violations. Our data suggest a high degree of automaticity in processing extralinguistic information during spoken language comprehension which indicates existence of a rapid automatic syntactic integration mechanism sensitive to both linguistic and extralinguistic information.

Agents Strongly Preferred: ERP Evidence from Natives and Non-Natives Processing Intransitive Sentences in Spanish

Are non-native speakers able to process their second language in a native-like way? The present study used the Event-Related Potentials’ (ERPs) method to address this issue by focusing (1) on agent vs. agentless intransitive sentences and (2) on person vs. number agreement morphology. For that purpose, native and high proficiency and early non-native speakers of Spanish were tested while processing intransitive sentences containing grammatical and ungrammatical subject–verb agreement. Results reveal greater accuracy in the agent (unergative) condition as compared with the agentless (unaccusative) condition and different ERP patterns for both types of verbs in all participants, suggesting a larger processing cost for the agentless sentences than for the agentive ones. These effects were more pronounced in the native group as compared with the non-native one in the early time window (300–500 ms). Differences between person and number agreement processing were also found at both behavioral and electrophysiological levels, indicating that those morphological features are distinctively processed. Importantly, this pattern of results held for both native and non-native speakers, thus suggesting that native-like competence is attainable given early Age of Acquisition (AoA), frequent use and high proficiency.

Aging-Related Dissociation of Spatial and Temporal N400 in Sentence-Level Semantic Processing: Evidence From Source Analyses

Age-related differences in sentence-level lexical-semantic processes have been extensively studied, based on the N400 component of event-related potential (ERP). However, there is still a lack of understanding in this regard at the brain-region level. This study explores aging effects on sentence-level semantic processing by comparing the characteristics of the N400 ERP component and brain engagement patterns within individual N400 time windows for two age groups (16 younger adults aged 24.38 ± 3.88 years and 15 older adults aged 67.00 ± 5.04 years) during sentence processing with different plausibility conditions. Our results demonstrated that the N400 effect according to the plausibility condition occurred in different temporal windows in the two age groups, with a delay in the older group. Moreover, it was identified that there was a distinct difference between the groups in terms of the source location of the condition-dependent N400 effect even though no significant difference was derived in its magnitude itself at the sensor-level. Interestingly, the source analysis results indicated that the two groups involved different functional networks to resolve the same semantic violations: the younger group activated the regions corresponding to the typical lexical-semantic network more, whereas the older group recruited the regions belonging to the multiple-demand network more. The findings of this study could be used as a basis for understanding the aging brain in a linguistic context.

Context-based facilitation of semantic access follows both logarithmic and linear functions of stimulus probability

Stimuli are easier to process when context makes them predictable, but does context-based facilitation arise from preactivation of a limited set of relatively probable upcoming stimuli (with facilitation then linearly related to probability) or, instead, because the system maintains and updates a probability distribution across all items (with facilitation logarithmically related to probability)? We measured the N400, an index of semantic access, to words of varying probability, including unpredictable words. Word predictability was measured using both cloze probabilities and a state-of-the-art machine learning language model (GPT-2). We reanalyzed five datasets (n = 138) to demonstrate and then replicate that context-based facilitation on the N400 is graded, even among unpredictable words. Furthermore, we established that the relationship between word predictability and context-based facilitation combines linear and logarithmic functions. We argue that this composite function reveals properties of the mapping between words and semantic features and how feature- and word-related information is activated on-line.

Semantic systems are mentalistically activated for and by social partners

A recently discovered electrophysiological response, the social N400, suggests that we use our language system to track how social partners comprehend language. Listeners show an increased N400 response, when themselves not, only a communicative partner experiences a semantic incongruity. Does the N400 reflect purely semantic or mentalistic computations as well? Do we attribute language comprehension to communicative partners using our semantic systems? In five electrophysiological experiments we identified two subcomponents of the social N400. First, we manipulated the presence-absence of an Observer during object naming: the semantic memory system was activated by the presence of a social partner in addition to semantic predictions for the self. Next, we induced a false belief—and a consequent miscomprehension—in the Observer. Participants showed the social N400, over and above the social presence effect, to labels that were incongruent for the Observer, even though they were congruent for them. This effect appeared only if participants received explicit instructions to track the comprehension of the Observer. These findings suggest that the semantic systems of the brain are not merely sensitive to social information and contribute to the attribution of comprehension, but they appear to be mentalistic in nature.

Does the character-based dimension of stories impact narrative processing? An event-related potentials (ERPs) study

This event-related potentials (ERPs) study investigated online processes of integration of information relating to characters in narrative comprehension. The final sample included twenty-nine participants who read short third-person stories in which the plausibility of the characters' actions was manipulated. Stories were administered in three conditions: a character-based congruent condition including a target word that was consistent with the character's job; a character-based incongruent condition with a target word inconsistent with the character's job; a character-based neutral condition, narrating the action of a character presented by his/her proper name without information about his/her job. Results comparing the ERPs elicited by the experimental conditions revealed a greater negative amplitude of the N400 in the right temporal regions in response to the character-based incongruent compared to the character-based congruent narratives. This finding shows that implicit background character-based information affects the N400, with readers rapidly using this information to comprehend narratives.

First Language Attrition: What It Is, What It Isn't, and What It Can Be

This review aims at clarifying the concept of first language attrition by tracing its limits, identifying its phenomenological and contextual constraints, discussing controversies associated with its definition, and suggesting potential directions for future research. We start by reviewing different definitions of attrition as well as associated inconsistencies. We then discuss the underlying mechanisms of first language attrition and review available evidence supporting different background hypotheses. Finally, we attempt to provide the groundwork to build a unified theoretical framework allowing for generalizable results. To this end, we suggest the deployment of a rigorous neuroscientific approach, in search of neural markers of first language attrition in different linguistic domains, putting forward hypothetical experimental ways to identify attrition's neural traces and formulating predictions for each of the proposed experimental paradigms.

The costs (and benefits) of effortful listening on context processing: A simultaneous electrophysiology, pupillometry, and behavioral study

There is an apparent disparity between the fields of cognitive audiology and cognitive electrophysiology as to how linguistic context is used when listening to perceptually challenging speech. To gain a clearer picture of how listening effort impacts context use, we conducted a pre-registered study to simultaneously examine electrophysiological, pupillometric, and behavioral responses when listening to sentences varying in contextual constraint and acoustic challenge in the same sample. Participants (N = 44) listened to sentences that were highly constraining and completed with expected or unexpected sentence-final words ("The prisoners were planning their escape/party") or were low-constraint sentences with unexpected sentence-final words ("All day she thought about the party"). Sentences were presented either in quiet or with +3 dB SNR background noise. Pupillometry and EEG were simultaneously recorded and subsequent sentence recognition and word recall were measured. While the N400 expectancy effect was diminished by noise, suggesting impaired real-time context use, we simultaneously observed a beneficial effect of constraint on subsequent recognition memory for degraded speech. Importantly, analyses of trial-to-trial coupling between pupil dilation and N400 amplitude showed that when participants' showed increased listening effort (i.e., greater pupil dilation), there was a subsequent recovery of the N400 effect, but at the same time, higher effort was related to poorer subsequent sentence recognition and word recall. Collectively, these findings suggest divergent effects of acoustic challenge and listening effort on context use: while noise impairs the rapid use of context to facilitate lexical semantic processing in general, this negative effect is attenuated when listeners show increased effort in response to noise. However, this effort-induced reliance on context for online word processing comes at the cost of poorer subsequent memory.

An EEG Analysis of Honorification in Japanese: Human Hierarchical Relationships Coded in Language

This study examines the neural substrate of the understanding of human relationships in verbal communication with Japanese honorific sentences as experimental materials. We manipulated two types of Japanese verbs specifically used to represent respect for others, i.e., exalted and humble verbs, which represent respect for the person in the subject and the person in the object, respectively. We visually presented appropriate and anomalous sentences containing the two types of verbs and analyzed the electroencephalogram elicited by the verbs. We observed significant parietal negativity at a latency of approximately 400 ms for anomalous verbs compared with appropriate verbs. This parietal negativity could be a manifestation of the pragmatic process used to integrate the linguistic forms with the human relationships represented in the sentences. The topographies of these event-related potentials (ERPs) corresponded well with those of ERPs for two second-person pronouns in Chinese (plain ni and respectful nin). This correspondence suggests that the pragmatic integration process in honorific expressions is cross-linguistically common in part. Furthermore, we assessed the source localization by means of independent component (IC) analysis and dipole fitting and observed a significant difference in ERP between the honorific and control sentences in the IC cluster centered in the precentral gyrus and in the cluster centered in the medial part of the occipital lobe, which corresponded well with the functional magnetic resonance imaging findings for Japanese honorification. We also found several significant differences in the time-frequency analyses for the medial occipital cluster. These significant differences in the medial occipital cluster suggested that the circuit of the theory of mind was involved in the processing of Japanese honorification. Our results suggest that pragmatic and syntactic processing are performed in parallel because the person to be respected must fulfill the grammatical function appropriate for the honorific verb.

Measuring implicit mental representations related to ethnic stereotypes with ERPs: An exploratory study

The present investigation used ERPs to detect the activation of implicit stereotypical representations associated to different ethnic groups, by means of an implicit paradigm. 285 sentences were presented to 20 Italian Caucasian participants while EEG signals were recorded from 128 scalp sites. Sentences could either violate (Incongruent condition), non-violate (Congruent condition) or be neutral (Neutral condition) with regard to stereotypical concepts concerning non-Caucasian ethnic groups (e.g. Asians, Africans, Arabs). No awareness or judgment about stereotypes was required. Participants were engaged in a fictitious task, ignoring the overall study's purpose. The results showed that Incongruent terminal words elicited a greater anterior N400 response (300-500 ms) compared to Congruent and Neutral words, reflecting a difficulty in integrating the information incongruent with pre-existing stereotypical knowledge. The participant's individual amplitude values of the N400-Difference Wave (Incongruent - Congruent), showed a direct correlation with the individual racism scores obtained at the Subtle and Blatant Prejudice Scale, administered at the end of the experimental session. Intra-cortical sources explaining the N400 involved areas of the social cognition network such as the medial frontal cortex (BA10) and the inferior temporal gyrus (BA20) which are known to support processing of information about other people and impression formation. Moreover, Congruent terminal words evoked a greater P300 response (500-600 ms) compared to the other conditions, possibly reflecting the merging of incoming inputs with anticipated semantic information. A late post-N400 frontal positivity (650-800 ms) was found to be larger to sentences concerning other-race characters (ether congruent or incongruent) compared to sentences involving own-race characters (neutral). The study corroborated the effectiveness of neurophysiological measures to assess implicit complex semantic representations and circumventing social desirability-related problems.

Students’ Behavior and Perceptions Regarding Complementary Videos for Introductory Physics Courses in an Online Environment

Digital videos have an important and increasing presence in student learning. They play a key role especially in subjects with high mathematical content, such as physics. However, creating videos is a time-consuming activity for teachers, who are usually not experts in video creation. Therefore, it is important to know which kinds of videos are perceived as more useful by students and why. In this paper we analyze students’ perception of videos in an introductory physics course of engineering with over 200 first year students in a 100% online university, Universitat Oberta de Catalunya (UOC). Students had 142 videos available of several types. We followed a qualitative methodology from a ground theory perspective and performed semi-structured interviews. Results show that students found videos as the most valued resource, although they considered that videos cannot substitute text documents. Students valued human elements and found them in videos where the hands of the professor appear. Finally, students consumed videos according to the course schedule, visualized the whole video the first time, and consumed it later according to further deliveries and exams. The main contributions of this paper were analyzing the perception of students from a qualitative perspective in an introductory course of physics in engineering, obtaining the main elements that make videos useful for students and showing that videos with hands are valued by students.

MEG Theta during Lexico-Semantic and Executive Processing Is Altered in High-Functioning Adolescents with Autism

Neuroimaging studies have revealed atypical activation during language and executive tasks in individuals with autism spectrum disorders (ASD). However, the spatiotemporal stages of processing associated with these dysfunctions remain poorly understood. Using an anatomically constrained magnetoencephalography approach, we examined event-related theta oscillations during a double-duty lexical decision task that combined demands on lexico-semantic processing and executive functions. Relative to typically developing peers, high-functioning adolescents with ASD had lower performance accuracy on trials engaging selective semantic retrieval and cognitive control. They showed an early overall theta increase in the left fusiform cortex followed by greater activity in the left-lateralized temporal (starting at ~250 ms) and frontal cortical areas (after ~450 ms) known to contribute to language processing. During response preparation and execution, the ASD group exhibited elevated theta in the anterior cingulate cortex, indicative of greater engagement of cognitive control. Simultaneously increased activity in the ipsilateral motor cortex may reflect a less lateralized and suboptimally organized motor circuitry. Spanning early sensory-specific and late response selection stages, the higher event-related theta responsivity in ASD may indicate compensatory recruitment to offset inefficient lexico-semantic retrieval under cognitively demanding conditions. Together, these findings provide further support for atypical language and executive functions in high-functioning ASD.

Complex Time-Dependent ERP Hemispheric Asymmetries during Word Matching in Phonological, Semantic and Orthographical Matching Judgment Tasks

Language-induced asymmetry to single word reading has been well investigated in past research. Less known are the complex processes and related asymmetries occurring when a word is compared with the previous one, according to specific tasks. To this end, we used a paradigm based on 80 sequential word pair comparisons and three blocked tasks: phonological, semantic and orthographical matching judgment. Participants had to decide whether the target word (W2) did or did not match the prime word (W1), presented 2 sec before, according to the task. The event-related potentials (ERPs) evoked by W2 in 20 participants have been analyzed. The first negative wave, the Recognition Potential (RP), peaking at about 120 ms over parietal sites, showed greater amplitude at left sites in all tasks, thus revealing the typical left-lateralization. At frontal sites, only the phonological task showed left lateralization. The following N400 (300–450 ms) showed an interesting interaction: Match trials elicited greater left asymmetry on frontal regions to phonological than to semantic than to visual-perceptual tasks, whereas mismatch trials induced an inverted asymmetry, marked by greater amplitude over right frontal sites, regardless of the task. Concerning the late N400 (450–600 ms), phonological and semantic tasks showed an overlapping pattern, with left lateralization in match and right lateralization in mismatch conditions. Results point to complex task- and time-dependent hemispheric asymmetries in word matching.

Cloze enough? Hemodynamic effects of predictive processing during natural reading

Evidence accrues that readers form multiple hypotheses about upcoming words. The present study investigated the hemodynamic effects of predictive processing during natural reading by means of combining fMRI and eye movement recordings. In particular, we investigated the neural and behavioral correlates of precision-weighted prediction errors, which are thought to be indicative of subsequent belief updating. Participants silently read sentences in which we manipulated the cloze probability and the semantic congruency of the final word that served as an index for precision and prediction error respectively. With respect to the neural correlates, our findings indicate an enhanced activation within the left inferior frontal and middle temporal gyrus suggesting an effect of precision on prediction update in higher (lexico-)semantic levels. Despite being evident at the neural level, we did not observe any evidence that this mechanism resulted in disproportionate reading times on participants' eye movements. The results speak against discrete predictions, but favor the notion that multiple words are activated in parallel during reading.

Rapid acquisition of novel written word-forms: ERP evidence

Background

Novel word acquisition is generally believed to be a rapid process, essential for ensuring a flexible and efficient communication system; at least in spoken language, learners are able to construct memory traces for new linguistic stimuli after just a few exposures. However, such rapid word learning has not been systematically found in visual domain, with different confounding factors obscuring the orthographic learning of novel words. This study explored the changes in human brain activity occurring online, during a brief training with novel written word-forms using a silent reading task

Results

Single-trial, cluster-based random permutation analysis revealed that training caused an extremely fast (after just one repetition) and stable facilitation in novel word processing, reflected in the modulation of P200 and N400 components, possibly indicating rapid dynamics at early and late stages of the lexical processing. Furthermore, neural source estimation of these effects revealed the recruitment of brain areas involved in orthographic and lexico-semantic processing, respectively.

Conclusions

These results suggest the formation of neural memory traces for novel written word-forms after a minimal exposure to them even in the absence of a semantic reference, resembling the rapid learning processes known to occur in spoken language.

Electrical brain activity and facial electromyography responses to irony in dysphoric and non-dysphoric participants

We studied irony comprehension and emotional reactions to irony in dysphoric and control participants. Electroencephalography (EEG) and facial electromyography (EMG) were measured when spoken conversations were presented with pictures that provided either congruent (non-ironic) or incongruent (ironic) contexts. In a separate session, participants evaluated the congruency and valence of the stimuli. While both groups rated ironic stimuli funnier than non-ironic stimuli, the control group rated all the stimuli funnier than the dysphoric group. N400-like activity, P600, and EMG activity indicating smiling were larger after the ironic stimuli than the non-ironic stimuli for both groups. Further, in the dysphoric group the irony modulation was evident in the electrode cluster over the right hemisphere, while no such difference in lateralization was observed in the control group. The results suggest a depression-related alteration in the P600 response associated to irony comprehension, but no alterations were found in emotional reactivity specifically related to irony.

Meaning before grammar: A review of ERP experiments on the neurodevelopmental origins of semantic processing

According to traditional linguistic theories, the construction of complex meanings relies firmly on syntactic structure-building operations. Recently, however, new models have been proposed in which semantics is viewed as being partly autonomous from syntax. In this paper, we discuss some of the developmental implications of syntax-based and autonomous models of semantics. We review event-related brain potential (ERP) studies on semantic processing in infants and toddlers, focusing on experiments reporting modulations of N400 amplitudes using visual or auditory stimuli and different temporal structures of trials. Our review suggests that infants can relate or integrate semantic information from temporally overlapping stimuli across modalities by 6 months of age. The ability to relate or integrate semantic information over time, within and across modalities, emerges by 9 months. The capacity to relate or integrate information from spoken words in sequences and sentences appears by 18 months. We also review behavioral and ERP studies showing that grammatical and syntactic processing skills develop only later, between 18 and 32 months. These results provide preliminary evidence for the availability of some semantic processes prior to the full developmental emergence of syntax: non-syntactic meaning-building operations are available to infants, albeit in restricted ways, months before the abstract machinery of grammar is in place. We discuss this hypothesis in light of research on early language acquisition and human brain development.

Catecholaminergic Modulation of Semantic Processing in Sentence Comprehension

Catecholamine (CA) function has been widely implicated in cognitive functions that are tied to the prefrontal cortex and striatal areas. The present study investigated the effects of methylphenidate, which is a CA agonist, on the electroencephalogram (EEG) response related to semantic processing using a double-blind, placebo-controlled, randomized, crossover, within-subject design. Forty-eight healthy participants read semantically congruent or incongruent sentences after receiving 20-mg methylphenidate or a placebo while their brain activity was monitored with EEG. To probe whether the catecholaminergic modulation is task-dependent, in one condition participants had to focus on comprehending the sentences, while in the other condition, they only had to attend to the font size of the sentence. The results demonstrate that methylphenidate has a task-dependent effect on semantic processing. Compared to placebo, when semantic processing was task-irrelevant, methylphenidate enhanced the detection of semantic incongruence as indexed by a larger N400 amplitude in the incongruent sentences; when semantic processing was task-relevant, methylphenidate induced a larger N400 amplitude in the semantically congruent condition, which was followed by a larger late positive complex effect. These results suggest that CA-related neurotransmitters influence language processing, possibly through the projections between the prefrontal cortex and the striatum, which contain many CA receptors.

Visual and Verbal Narrative Comprehension in Children and Adolescents with Autism Spectrum Disorders: An ERP Study

We examined semantic processing in ASD children by presenting sentences with congruent or incongruent final words and visual narratives with congruent or incongruent final panels. An N400 effect to incongruent words appeared as compared to congruent ones, which was attenuated for the ASD children. We observed a negativity sustained to incongruous than congruous words, but only for the TD children. Incongruent panels evoked a greater fronto-central N400 amplitude than congruent panels in both groups. In addition, incongruent panels evoked a centro-parietal late positivity, only in controls. In conclusion, ASD children face processing deficits in both verbal and visual materials when integrating meaning across information, though such impairments may arise in different parts of the interpretive process, depending on the modality.

Semantic Processing in Healthy Aging and Alzheimer's Disease: A Systematic Review of the N400 Differences

Semantic deficits are common in individuals with Alzheimer’s disease (AD). These deficits notably impact the ability to understand words. In healthy aging, semantic knowledge increases but semantic processing (i.e., the ability to use this knowledge) may be impaired. This systematic review aimed to investigate semantic processing in healthy aging and AD through behavioral responses and the N400 brain event-related potential. The results of the quantitative and qualitative analyses suggested an overall decrease in accuracy and increase in response times in healthy elderly as compared to young adults, as well as in individuals with AD as compared to age-matched controls. The influence of semantic association, as measured by N400 effect amplitudes, appears smaller in healthy aging and even more so in AD patients. Thus, semantic processing differences may occur in both healthy and pathological aging. The establishment of norms of healthy aging for these outcomes that vary between normal and pathological aging could eventually help early detection of AD.

The Consistency Effects of the Clean Metaphor of Moral Concept and Dirty Metaphor of Immoral Concept

Abstract. Morality is clean, while immorality is dirty, and these metaphors use concrete clean and dirty experiences to express moral and immoral concepts; specifically, they are the clean metaphor of moral concept and dirty metaphor of immoral concept. The present study used event-related potentials (ERPs) to explore the consistency effects of the clean metaphor of moral concept and dirty metaphor of immoral concept, the experiment recorded the reaction times (RTs) and ERP waves in a metaphor consistency condition and a metaphor inconsistency condition. The behavioral results showed that the RTs in the metaphor consistency condition were significantly faster than the RTs in the metaphor inconsistency condition. The ERP results showed that the P300, N400, and late negative component (LNC) amplitudes were higher in the metaphor inconsistency condition than in the metaphor consistency condition.

(Not so) Great Expectations: Listening to Foreign-Accented Speech Reduces the Brain's Anticipatory Processes

This study examines the effect of foreign-accented speech on the predictive ability of our brain. Listeners actively anticipate upcoming linguistic information in the speech signal so as to facilitate and reduce processing load. However, it is unclear whether or not listeners also do this when they are exposed to speech from non-native speakers. In the present study, we exposed native Dutch listeners to sentences produced by native and non-native speakers while measuring their brain activity using electroencephalography. We found that listeners’ brain activity differed depending on whether they listened to native or non-native speech. However, participants’ overall performance as measured by word recall rate was unaffected. We discussed the results in relation to previous findings as well as the automaticity of anticipation.

Combined Brain-Perfusion SPECT and EEG Measurements Suggest Distinct Strategies for Speech Comprehension in CI Users With Higher and Lower Performance

Cochlear implantation constitutes a successful therapy of inner ear deafness, with the majority of patients showing good outcomes. There is, however, still some unexplained variability in outcomes with a number of cochlear-implant (CI) users, showing major limitations in speech comprehension. The current study used a multimodal diagnostic approach combining single-photon emission computed tomography (SPECT) and electroencephalography (EEG) to examine the mechanisms underlying speech processing in postlingually deafened CI users (N = 21). In one session, the participants performed a speech discrimination task, during which a 96-channel EEG was recorded and the perfusions marker 99mTc-HMPAO was injected intravenously. The SPECT scan was acquired 1.5 h after injection to measure the cortical activity during the speech task. The second session included a SPECT scan after injection without stimulation at rest. Analysis of EEG and SPECT data showed N400 and P600 event-related potentials (ERPs) particularly evoked by semantic violations in the sentences, and enhanced perfusion in a temporo-frontal network during task compared to rest, involving the auditory cortex bilaterally and Broca's area. Moreover, higher performance in testing for word recognition and verbal intelligence strongly correlated to the activation in this network during the speech task. However, comparing CI users with lower and higher speech intelligibility [median split with cutoff + 7.6 dB signal-to-noise ratio (SNR) in the Göttinger sentence test] revealed for CI users with higher performance additional activations of parietal and occipital regions and for those with lower performance stronger activation of superior frontal areas. Furthermore, SPECT activity was tightly coupled with EEG and cognitive abilities, as indicated by correlations between (1) cortical activation and the amplitudes in EEG, N400 (temporal and occipital areas)/P600 (parietal and occipital areas) and (2) between cortical activation in left-sided temporal and bilateral occipital/parietal areas and working memory capacity. These results suggest the recruitment of a temporo-frontal network in CI users during speech processing and a close connection between ERP effects and cortical activation in CI users. The observed differences in speech-evoked cortical activation patterns for CI users with higher and lower speech intelligibility suggest distinct processing strategies during speech rehabilitation with CI.

Design and evaluation of the effectiveness of a corpus of congruent and incongruent English sentences for the study of event related potentials

OBJECTIVE

To design and evaluate the effectiveness of a stimulus material in eliciting the N400 event related potential (ERP).

DESIGN

A set of 700 semantically congruent and incongruent sentences was developed in accordance with current linguistic norms, and validated with an electroencephalography (EEG) study, in which the influence of age and gender on the N400 ERP magnitude was analysed.

STUDY SAMPLE

Forty-five normal-hearing subjects (19-57 years, 21 females) participated in the EEG study.

RESULTS

The stimulus material used in the EEG study elicited a robust N400 ERP, with a morphology consistent with the literature. Results also showed no statistically significant effect of age or gender on the N400 magnitude.

CONCLUSIONS

The material presented in this paper constitutes the largest complete stimulus set suitable for both auditory and text-based N400 experiments. This material may help facilitate the efficient implementation of future N400 ERP studies, as well as promote standardisation and consistency across studies.

Interhemispheric compensation: A hypothesis of TMS-induced effects on language-related areas

Repetitive transcranial magnetic stimulation (rTMS) applied over brain regions responsible for language processing is used to curtail potentially auditory hallucinations in schizophrenia patients and to investigate the functional organisation of language-related areas. Variability of effects is, however, marked across studies and between subjects. Furthermore, the mechanisms of action of rTMS are poorly understood.

Here, we reviewed different factors related to the structural and functional organisation of the brain that might influence rTMS-induced effects. Then, by analogy with aphasia studies, and the plastic-adaptive changes in both the left and right hemispheres following aphasia recovery, a hypothesis is proposed about rTMS mechanisms over language-related areas (e.g. Wernicke, Broca). We proposed that the local interference induced by rTMS in language-related areas might be analogous to aphasic stroke and might lead to a functional reorganisation in areas connected to the virtual lesion for language recovery.

Functional Linking Between Negative and Positive ERPs for Syntactic Processing in Japanese: Mutual Enhancement, Syntactic Prediction, and Working Memory Constraints

This study attempts to detect the differences in event-related potentials (ERPs) associated with two syntactic processes: the syntactic integration of discontinuous dependency and the detection of a violation of the syntactic island constraint. We recorded the electroencephalogram elicited by complex sentences in Japanese that included a dependency between a quantifier and its head noun, in which we changed the word order of the two words to manipulate the presence and absence of a syntactic integration and a syntactic island violation while keeping the lexical items and construction unchanged. We found significant negative and positive deflections for the syntactic integration only when a quantifier preceded its head noun. We also observed significant negative and positive deflections for the syntactic island violation, for which the negativity was more salient when a quantifier preceded its head noun. This study is the first to report a late positive ERP for a violation of the syntactic island constraints in Japanese, and the results showed that the ERP elicited by syntactic integration and that by syntactic island violation were different in terms of their latency, topography, and duration. More importantly, the ERPs elicited by the two syntactic processes were biphasic, and the amplitudes of the negative ERP and of the positive ERP were positively correlated. This positive correlation could be a characteristic of syntactic processing because it contrasted with the negative correlation reported for the ERP elicited by semantic anomalies in English. Furthermore, the amplitude of the ERP for syntactic integration was negatively correlated with the individual capacity of working memory (WM). That is, a reader with greater WM capacity showed smaller negativity and positivity for the syntactic integration, whereas the amplitude for the syntactic island violation showed no significant correlation with the individual capacity of WM. Our results suggested that linguistic ERPs functionally interacted with each other and that the ERP involving the retention and the retrieval of a distant word could be constrained by the individual differences in WM capacity. We discuss the possible reasons for the contrast between English and Japanese on the basis of the cross-linguistic differences in the two languages.

Cortical Tracking of Surprisal during Continuous Speech Comprehension

Speech comprehension requires rapid online processing of a continuous acoustic signal to extract structure and meaning. Previous studies on sentence comprehension have found neural correlates of the predictability of a word given its context, as well as of the precision of such a prediction. However, they have focused on single sentences and on particular words in those sentences. Moreover, they compared neural responses to words with low and high predictability, as well as with low and high precision. However, in speech comprehension, a listener hears many successive words whose predictability and precision vary over a large range. Here, we show that cortical activity in different frequency bands tracks word surprisal in continuous natural speech and that this tracking is modulated by precision. We obtain these results through quantifying surprisal and precision from naturalistic speech using a deep neural network and through relating these speech features to EEG responses of human volunteers acquired during auditory story comprehension. We find significant cortical tracking of surprisal at low frequencies, including the delta band as well as in the higher frequency beta and gamma bands, and observe that the tracking is modulated by the precision. Our results pave the way to further investigate the neurobiology of natural speech comprehension.

fMRI evidence that left posterior temporal cortex contributes to N400 effects of predictability independent of congruity

Previous electrophysiological work argues that predictability and semantic incongruity rapidly impact comprehension, as indicated by modulation of the N400 component between ~300 and 500 ms. An ongoing question is whether effects of predictability in fact reflect pre-activation in long-term memory as opposed to modulating the kind of integration processes triggered by incongruity. Using fMRI, we compared the impact of predictability and incongruity in adjective-noun phrases, in regions identified with lexical and phrasal localizer scans. We found that predictability impacted activity in left posterior middle temporal gyrus (pMTG), while incongruity impacted activity in left precentral gyrus. Together with parallel data from ERP, these data are consistent with the hypothesis that left pMTG activity is a key contributor to N400 effects of predictability and that the relevant mechanism is reduced activation of stored lexical representations. We tentatively suggest that the left precentral region may play a role in reanalysis when incongruity is encountered.

Individual Differences in Reading Speed are Linked to Variability in the Processing of Lexical and Contextual Information: Evidence from Single-trial Event-related Brain Potentials

In the current paper, we examined the effects of lexical (e.g. word frequency, orthographic neighborhood density) and contextual (e.g. word predictability in the form of cloze probability) features on single-trial event-related brain potentials in a self-paced reading paradigm. Critically, we examined whether individual differences in reading speed modulated single-trial effects on the N400, an ERP component linked to semantic memory access. Consistent with past work, we found that word frequency effects on the N400 were attenuated with increasing predictability. However, effects of orthographic neighborhood density were robust across all levels of predictability. Importantly, individual differences in reading speed moderated the influence of both frequency and predictability (but not orthographic neighborhood density) on the N400, such that slower readers showed reduced effects compared to faster readers. These data show that different lexical factors influence word processing through dissociable mechanisms. Our findings support a dynamic semantic-memory access model of the N400, in which information at multiple levels (lexical, sentential, individual) simultaneously contributes to the unfolding neural dynamics of comprehension.

Behind the Scenes of Noninvasive Brain-Computer Interfaces: A Review of Electroencephalography Signals, How They Are Recorded, and Why They Matter

Purpose

Brain-computer interface (BCI) techniques may provide computer access for individuals with severe physical impairments. However, the relatively hidden nature of BCI control obscures how BCI systems work behind the scenes, making it difficult to understand how electroencephalography (EEG) records the BCI related brain signals, what brain signals are recorded by EEG, and why these signals are targeted for BCI control. Furthermore, in the field of speech-language-hearing, signals targeted for BCI application have been of primary interest to clinicians and researchers in the area of augmentative and alternative communication (AAC). However, signals utilized for BCI control reflect sensory, cognitive and motor processes, which are of interest to a range of related disciplines including speech science.

Method

This tutorial was developed by a multidisciplinary team emphasizing primary and secondary BCI-AAC related signals of interest to speech-language-hearing.

Results

An overview of BCI-AAC related signals are provided discussing 1) how BCI signals are recorded via EEG, 2) what signals are targeted for non-invasive BCI control, including the P300, sensorimotor rhythms, steady state evoked potentials, contingent negative variation, and the N400, and 3) why these signals are targeted. During tutorial creation, attention was given to help support EEG and BCI understanding for those without an engineering background.

Conclusion

Tutorials highlighting how BCI-AAC signals are elicited and recorded can help increase interest and familiarity with EEG and BCI techniques and provide a framework for understanding key principles behind BCI-AAC design and implementation.

Inferior Longitudinal Fasciculus' Role in Visual Processing and Language Comprehension: A Combined MEG-DTI Study

The inferior longitudinal fasciculus (ILF) is a white matter tract that connects the occipital and the temporal lobes. ILF abnormalities have been associated with deficits in visual processing and language comprehension in dementia patients, thus suggesting that its integrity is important for semantic processing. However, it remains elusive whether ILF microstructural organization per se impacts the visual semantic processing efficiency in the healthy brain. The present study aims to investigate whether there is an association between ILF’s microstructural organization and visual semantic processing at the individual level. We hypothesized that the efficiency of visual semantic processing positively correlates with the degree of anisotropy of the ILF. We studied 10 healthy right-handed subjects. We determined fractional anisotropy (FA) of the ILF using diffusion tensor imaging (DTI). We extracted N400m latency and amplitude from magnetoencephalography (MEG) signals during a visual semantic decision task. N400m and mean FA of the ILF were left lateralized with the higher FA value in the left hemisphere. Inter-individual analysis showed that FA of the ILF negatively correlated with the N400m latency and amplitude, which suggests that high ILF anisotropy is associated with more efficient semantic processing. In summary, our findings provide supporting evidence for a role of the ILF in language comprehension.

Understanding associative vs. abstract pictorial relations: An ERP study

One of the most remarkable human abilities is extracting relations between objects, words or ideas - a process that underlies perception, learning and reasoning. Yet, perhaps due to its complexity, surprisingly little is known about the neural basis of this fundamental ability. Here, we examined EEG waveforms evoked by different types of relations, conveyed by pairs of images. Subjects were presented with the pairs, that were either associatively related, abstractly related or unrelated, and judged if they were related or not. Evidence for a gradual modulation of the amplitude of the N400 and late negativity was found, such that unrelated pairs elicited the most negative amplitude, followed by abstractly-related pairs and lastly associatively-related ones. However, this was confined to first encounter with the pairs, and a different, more dichotomous pattern was observed when the pairs were viewed for the second time. Then, no difference was found between associatively and abstractly related pairs, while both differed from unrelated pairs. Notably, when the pairs were sequentially presented, this pattern was found mostly in right electrodes, while it appeared both in left and right sites during simultaneous presentation of the pairs. This suggests that while two different mechanisms may be involved in generating predictions about an upcoming related/unrelated stimulus, online processing of associative and abstract semantic relations might be mediated by a single mechanism. Our results further support claims that the N400 component indexes multiple cognitive processes that overlap in time, yet not necessarily in neural generators.

Semantic prediction-errors are context-dependent: An ERP study

The human brain is an efficient, adaptive, and predictive machine, constructing a generative model of the environment that we then perceive and become conscious of. Here, we show that different types of prediction-errors - the discrepancies between top-down expectations and bottom-up sensory input - are integrated across processing levels and sensory modalities of the cortical hierarchy. We designed a novel, hybrid protocol in which five prediction-establishing sounds were played in rapid succession (e.g., "meow", "meow", "meow", etc.), followed by either a standard (e.g., "meow") or a deviant (e.g., "woof") prime sound, then a visual target word that was either congruent or incongruent (e.g., "cat" or "dog") with the prime sound. We found that the deviants elicited a more negative voltage than the standards at about 150 ms - the mismatch negativity (MMN), an event-related potential (ERP) sensitive to low-level perceptual violations - and that the incongruent words elicited a more negative voltage than the congruent words at about 350 ms - the N400, an ERP sensitive to high-level semantic violations. We also found that the N400 was context-dependent: the N400 was larger when the target words were preceded by a standard than a deviant. Our results suggest that perceptual prediction-errors modulate subsequent semantic prediction-errors. We conclude that our results are consistent with one of the most important assumptions of predictive coding theories: hierarchical prediction-error processing.

Theta/delta coupling across cortical laminae contributes to semantic cognition

Rhythmic activity in populations of neurons is associated with cognitive and motor function. Our understanding of the neuronal mechanisms underlying these core brain functions has benefitted from demonstrations of cellular, synaptic, and network phenomena, leading to the generation of discrete rhythms at the local network level. However, discrete frequencies of rhythmic activity rarely occur alone. Despite this, little is known about why multiple rhythms are generated together or what mechanisms underlie their interaction to promote brain function. One overarching theory is that different temporal scales of rhythmic activity correspond to communication between brain regions separated by different spatial scales. To test this, we quantified the cross-frequency interactions between two dominant rhythms-theta and delta activity-manifested during magnetoencephalography recordings of subjects performing a word-pair semantic decision task. Semantic processing has been suggested to involve the formation of functional links between anatomically disparate neuronal populations over a range of spatial scales, and a distributed network was manifest in the profile of theta-delta coupling seen. Furthermore, differences in the pattern of theta-delta coupling significantly correlated with semantic outcome. Using an established experimental model of concurrent delta and theta rhythms in neocortex, we show that these outcome-dependent dynamics could be reproduced in a manner determined by the strength of cholinergic neuromodulation. Theta-delta coupling correlated with discrete neuronal activity motifs segregated by the cortical layer, neuronal intrinsic properties, and long-range axonal targets. Thus, the model suggested that local, interlaminar neocortical theta-delta coupling may serve to coordinate both cortico-cortical and cortico-subcortical computations during distributed network activity. NEW & NOTEWORTHY Here, we show, for the first time, that a network of spatially distributed brain regions can be revealed by cross-frequency coupling between delta and theta frequencies in subjects using magnetoencephalography recording during a semantic decision task. A biological model of this cross-frequency coupling suggested an interlaminar, cell-specific division of labor within the neocortex may serve to route the flow of cortico-cortical and cortico-subcortical information to promote such spatially distributed, functional networks.

Distinct Functional Network Connectivity for Abstract and Concrete Mental Imagery

In several behavioral psycholinguistic studies, it has been shown that concrete words are processed more efficiently. They can be remembered faster, recognized better, and can be learned easier than abstract words. This fact is called concreteness effect. There are fMRI studies which compared the neural representations of concrete and abstract concepts in terms of activated regions. In the present study, a comparison has been made between the condition-specific connectivity of functional networks (obtained by group ICA) during imagery of abstract and concrete words. The obtained results revealed that the functional network connectivity between three pairs of networks during concrete imagery is significantly different from that of abstract imagery (FDR correction at the significance level of 0.05). These results suggest that abstract and concrete concepts have different representations in terms of functional network connectivity pattern. Remarkably, in all of these network pairs, the connectivity during concrete imagery is significantly higher than that of abstract imagery. These more coherent networks include both linguistic and visual regions with a higher engagement of the right hemisphere, so the results are in line with dual coding theory. Additionally, these three pairs of networks include the contrasting regions which have shown stronger activation either in concrete or abstract word processing in former studies. The findings imply that the brain is more integrated and synchronized at the time of concrete imagery and it may explain the reason of faster concrete words processing. In order to validate the results, we used functional network connectivity distributions (FNCD). Wilcoxon rank-sum test was used to check if the abstract and concrete FNCDs extracted from whole subjects are the same. The result revealed that the corresponding distributions are different which indicates two different patterns of connectivity for abstract and concrete word processing. Also, the mean of FNCD is significantly higher at the time of concrete imagery than that of abstract imagery. Furthermore, FNCDs at the single-subject level are significantly more left-skewed or equally, include more strong connectivity for concrete imagery.