Frequency-based Segregation of Syntactic and Semantic Unification during Online Sentence Level Language Comprehension

Hierarchical neural processing in γ oscillations for syntactic and semantic operations accounts for first- and second-language epistemology

Introduction

We discuss event-related power differences (ERPDs) in low- and broadband-γ oscillations as the embedded-clause edge is processed in wh-dependencies such as Which decision regarding/about him/her did Paul say that Lydie rejected without hesitation? in first (L1) and second language (L2) French speakers.

Methods

The experimental conditions manipulated whether pronouns appeared in modifiers (Mods; regarding him/her) or in noun complements (Comps; about him/her) and whether they matched or mismatched a matrix-clause subject in gender.

Results

Across L1 and L2 speakers, we found that anaphora-linked ERPDs for Mods vs. Comps in evoked power first arose in low γ and then in broadband γ. Referential elements first seem to be retrieved from working memory by narrowband processes in low γ and then referential identification seems to be computed in broadband-γ output. Interactions between discourse- and syntax-based referential processes for the Mods vs. Comps in these ERPDs furthermore suggest that multidomain γ-band processing enables a range of elementary operations for discourse and semantic interpretation.

Discussion

We argue that a multidomain mechanism enabling operations conditioned by the syntactic and semantic nature of the elements processed interacts with local brain microcircuits representing features and feature sets that have been established in L1 or L2 acquisition, accounting for a single language epistemology across learning contexts.

Co-learning companionship benefits word learning in a new language: Evidence from a dual-brain EEG examination

Companionship refers to one's being in the presence of another individual. For adults, acquiring a new language is a highly social activity that often involves learning in the context of companionship. However, the effects of companionship on new language learning have gone relatively underexplored, particularly with respect to word learning. Using a within-subject design, the current study employs electroencephalography to examine how two types of companionship (monitored and co-learning) affect word learning (semantic and lexical) in a new language. Dyads of Chinese speakers of English as a second language participated in a pseudo-word-learning task during which they were placed in monitored and co-learning companionship contexts. The results showed that exposure to co-learning companionship affected the early attention stage of word learning. Moreover, in this early stage, evidence of a higher representation similarity between co-learners showed additional support that co-learning companionship influenced attention. Observed increases in delta and theta interbrain synchronization further revealed that co-learning companionship facilitated semantic access. In all, the similar neural representations and interbrain synchronization between co-learners suggest that co-learning companionship offers important benefits for learning words in a new language.

Neural oscillations during predictive sentence processing in young children

The neural correlates of predictive processing in language, critical for efficient sentence comprehension, is well documented in adults. Specifically, adults exhibit alpha power (9-12 Hz) suppression when processing high versus low predictability sentences. This study explores whether young children exhibit similar neural mechanisms. We analyzed EEG data from 29 children aged 3-5 years listening to sentences of varying predictability. Our results revealed significant neural oscillation differences in the 5-12 Hz range between high and low predictability sentences, similar to adult patterns. Crucially, the degree of these differences correlated with children's language abilities. These findings are the first to demonstrate the neural basis of predictive processing in young children and its association with language development.

The Interaction of Context Constraints and Predictive Validity during Sentence Reading

Words are not processed in isolation; instead, they are commonly embedded in phrases and sentences. The sentential context influences the perception and processing of a word. However, how this is achieved by brain processes and whether predictive mechanisms underlie this process remain a debated topic. Here, we employed an experimental paradigm in which we orthogonalized sentence context constraints and predictive validity, which was defined as the ratio of congruent to incongruent sentence endings within the experiment. While recording electroencephalography, participants read sentences with three levels of sentential context constraints (high, medium, and low). Participants were also separated into two groups that differed in their ratio of valid congruent to incongruent target words that could be predicted from the sentential context. For both groups, we investigated modulations of alpha power before, and N400 amplitude modulations after target word onset. The results reveal that the N400 amplitude gradually decreased with higher context constraints and cloze probability. In contrast, alpha power was not significantly affected by context constraint. Neither the N400 nor alpha power were significantly affected by changes in predictive validity.

Neural consequences of binaural beat stimulation on auditory sentence comprehension: an EEG study

A growing literature has shown that binaural beat (BB)-generated by dichotic presentation of slightly mismatched pure tones-improves cognition. We recently found that BB stimulation of either beta (18 Hz) or gamma (40 Hz) frequencies enhanced auditory sentence comprehension. Here, we used electroencephalography (EEG) to characterize neural oscillations pertaining to the enhanced linguistic operations following BB stimulation. Sixty healthy young adults were randomly assigned to one of three listening groups: 18-Hz BB, 40-Hz BB, or pure-tone baseline, all embedded in music. After listening to the sound for 10 min (stimulation phase), participants underwent an auditory sentence comprehension task involving spoken sentences that contained either an object or subject relative clause (task phase). During the stimulation phase, 18-Hz BB yielded increased EEG power in a beta frequency range, while 40-Hz BB did not. During the task phase, only the 18-Hz BB resulted in significantly higher accuracy and faster response times compared with the baseline, especially on syntactically more complex object-relative sentences. The behavioral improvement by 18-Hz BB was accompanied by attenuated beta power difference between object- and subject-relative sentences. Altogether, our findings demonstrate beta oscillations as a neural correlate of improved syntactic operation following BB stimulation.

Combining EEG and 3D-eye-tracking to study the prediction of upcoming speech in naturalistic virtual environments: A proof of principle

EEG and eye-tracking provide complementary information when investigating language comprehension. Evidence that speech processing may be facilitated by speech prediction comes from the observation that a listener's eye gaze moves towards a referent before it is mentioned if the remainder of the spoken sentence is predictable. However, changes to the trajectory of anticipatory fixations could result from a change in prediction or an attention shift. Conversely, N400 amplitudes and concurrent spectral power provide information about the ease of word processing the moment the word is perceived. In a proof-of-principle investigation, we combined EEG and eye-tracking to study linguistic prediction in naturalistic, virtual environments. We observed increased processing, reflected in theta band power, either during verb processing - when the verb was predictive of the noun - or during noun processing - when the verb was not predictive of the noun. Alpha power was higher in response to the predictive verb and unpredictable nouns. We replicated typical effects of noun congruence but not predictability on the N400 in response to the noun. Thus, the rich visual context that accompanied speech in virtual reality influenced language processing compared to previous reports, where the visual context may have facilitated processing of unpredictable nouns. Finally, anticipatory fixations were predictive of spectral power during noun processing and the length of time fixating the target could be predicted by spectral power at verb onset, conditional on the object having been fixated. Overall, we show that combining EEG and eye-tracking provides a promising new method to answer novel research questions about the prediction of upcoming linguistic input, for example, regarding the role of extralinguistic cues in prediction during language comprehension.

Development of Gamma Oscillation during Sentence Processing in Early Adolescence: Insights into the Maturation of Semantic Processing

Children's ability to retrieve word meanings and incorporate them into sentences, along with the neural structures that support these skills, continues to evolve throughout adolescence. Theta (4-8 Hz) activity that corresponds to word retrieval in children decreases in power and becomes more localized with age. This bottom-up word retrieval is often paired with changes in gamma (31-70 Hz), which are thought to reflect semantic unification in adults. Here, we studied gamma engagement during sentence processing using EEG time-frequency in children (ages 8-15) to unravel the developmental trajectory of the gamma network during sentence processing. Children heavily rely on semantic integration for sentence comprehension, but as they mature, semantic and syntactic processing units become distinct and localized. We observed a similar developmental shift in gamma oscillation around age 11, with younger groups (8-9 and 10-11) exhibiting broadly distributed gamma activity with higher amplitudes, while older groups (12-13 and 14-15) exhibited smaller and more localized gamma activity, especially over the left central and posterior regions. We interpret these findings as support for the argument that younger children rely more heavily on semantic processes for sentence comprehension than older children. And like adults, semantic processing in children is associated with gamma activity.

Beta and gamma binaural beats enhance auditory sentence comprehension

Binaural beats-an auditory illusion produced when two pure tones of slightly different frequencies are dichotically presented-have been shown to modulate various cognitive and psychological states. Here, we investigated the effects of binaural beat stimulation on auditory sentence processing that required interpretation of syntactic relations (Experiment 1) or an evaluation of syntactic well formedness (Experiment 2) with a large cohort of healthy young adults (N = 200). In both experiments, participants performed a language task after listening to one of four sounds (i.e., between-subject design): theta (7 Hz), beta (18 Hz), and gamma (40 Hz) binaural beats embedded in music, or the music only (baseline). In Experiment 1, 100 participants indicated the gender of a noun linked to a transitive action verb in spoken sentences containing either a subject or object-relative center-embedded clause. We found that both beta and gamma binaural beats yielded better performance, compared to the baseline, especially for syntactically more complex object-relative sentences. To determine if the binaural beat effect can be generalized to another type of syntactic analysis, we conducted Experiment 2 in which another 100 participants indicated whether or not there was a grammatical error in spoken sentences. However, none of the binaural beats yielded better performance for this task indicating that the benefit of beta and gamma binaural beats may be specific to the interpretation of syntactic relations. Together, we demonstrate, for the first time, the positive impact of binaural beats on auditory language comprehension. Both theoretical and practical implications are discussed.

Is beta in agreement with the relatives? Using relative clause sentences to investigate MEG beta power dynamics during sentence comprehension

There remains some debate about whether beta power effects observed during sentence comprehension reflect ongoing syntactic unification operations (beta-syntax hypothesis), or instead reflect maintenance or updating of the sentence-level representation (beta-maintenance hypothesis). In this study, we used magnetoencephalography to investigate beta power neural dynamics while participants read relative clause sentences that were initially ambiguous between a subject- or an object-relative reading. An additional condition included a grammatical violation at the disambiguation point in the relative clause sentences. The beta-maintenance hypothesis predicts a decrease in beta power at the disambiguation point for unexpected (and less preferred) object-relative clause sentences and grammatical violations, as both signal a need to update the sentence-level representation. While the beta-syntax hypothesis also predicts a beta power decrease for grammatical violations due to a disruption of syntactic unification operations, it instead predicts an increase in beta power for the object-relative clause condition because syntactic unification at the point of disambiguation becomes more demanding. We observed decreased beta power for both the agreement violation and object-relative clause conditions in typical left hemisphere language regions, which provides compelling support for the beta-maintenance hypothesis. Mid-frontal theta power effects were also present for grammatical violations and object-relative clause sentences, suggesting that violations and unexpected sentence interpretations are registered as conflicts by the brain's domain-general error detection system.

Frequency-specific directed interactions between whole-brain regions during sentence processing using multimodal stimulus

Neural oscillations subserve a broad range of speech processing and language comprehension functions. Using an electroencephalogram (EEG), we investigated the frequency-specific directed interactions between whole-brain regions while the participants processed Chinese sentences using different modality stimuli (i.e., auditory, visual, and audio-visual). The results indicate that low-frequency responses correspond to the process of information flow aggregation in primary sensory cortices in different modalities. Information flow dominated by high-frequency responses exhibited characteristics of bottom-up flow from left posterior temporal to left frontal regions. The network pattern of top-down information flowing out of the left frontal lobe was presented by the joint dominance of low- and high-frequency rhythms. Overall, our results suggest that the brain may be modality-independent when processing higher-order language information.

Age and vocabulary knowledge differentially influence the N400 and theta responses during semantic retrieval

Using electroencephalography (EEG) to study the neural oscillations supporting language development is increasingly common; however, a clear understanding of the relationship between neural oscillations and traditional Event Related Potentials (ERPs) is needed to disentangle how maturation of language-related neural networks supports semantic processing throughout grade school. Theta and the N400 are both thought to index semantic retrieval but, in adults, are only weakly correlated with one another indicating they may measure somewhat unique aspects of retrieval. Here, we studied the relationship between the N400 amplitude and theta power during semantic retrieval with key indicators of language abilities including age, vocabulary, reading comprehension and phonological memory in 226 children ages 8-15 years. The N400 and theta responses were positively correlated over posterior areas, but negatively correlated over frontal areas. When controlling for the N400 amplitude, the amplitude of the theta response was predicted by age, but not by language measures. On the other hand, when controlling theta amplitude, the amplitude of the N400 was predicted by both vocabulary knowledge and age. These findings indicate that while there is a clear relationship between the N400 and theta responses, they may each index unique aspects of development related to semantic retrieval.

Impact of social knowledge about the speaker on irony understanding: Evidence from neural oscillations

The aim of the present study was to explore neuronal oscillatory activity during a task of irony understanding. In this task, we manipulated implicit information about the speaker such as occupation stereotypes (i.e., sarcastic versus non-sarcastic). These stereotypes are social knowledge that influence the extent to which the speaker's ironic intent is understood. Time-frequency analyses revealed an early effect of speaker occupation stereotypes, as evidenced by greater synchronization in the upper gamma band (in the 150-250 ms time window) when the speaker had a sarcastic occupation, by a greater desynchronization for ironic context compared to literal context in the alpha1 band and by a greater synchronization in the theta band when the speaker had a non-sarcastic occupation. When the speaker occupation did not constrain the ironic interpretation, the interpretation of the sentence as ironic was revealed as resource-demanding and requiring pragmatic reanalysis, as shown mainly by the synchronization in the theta band and the desynchronization in the alpha1 band (in the 500-800 ms time window). These results support predictions of the constraint satisfaction model suggesting that during irony understanding, extra-linguistic information such as information on the speaker is used as soon as it is available, in the early stage of processing.

Delta-band neural tracking primarily reflects rule-based chunking instead of semantic relatedness between words

It is debated whether cortical responses matching the time scales of phrases and sentences mediate the mental construction of the syntactic chunks or are simply caused by the semantic properties of words. Here, we investigate to what extent delta-band neural responses to speech can be explained by semantic relatedness between words. To dissociate the contribution of semantic relatedness from sentential structures, participants listened to sentence sequences and paired-word sequences in which semantically related words repeated at 1 Hz. Semantic relatedness in the 2 types of sequences was quantified using a word2vec model that captured the semantic relation between words without considering sentential structure. The word2vec model predicted comparable 1-Hz responses with paired-word sequences and sentence sequences. However, empirical neural activity, recorded using magnetoencephalography, showed a weaker 1-Hz response to paired-word sequences than sentence sequences in a word-level task that did not require sentential processing. Furthermore, when listeners applied a task-related rule to parse paired-word sequences into multi-word chunks, 1-Hz response was stronger than that in word-level task on the same sequences. Our results suggest that cortical activity tracks multi-word chunks constructed by either syntactic rules or task-related rules, whereas the semantic relatedness between words contributes only in a minor way.

The timing versus resource problem in nonnative sentence processing: Evidence from a time-frequency analysis of anaphora resolution in successive wh-movement in native and nonnative speakers of French

Nonnative processing has been argued to reflect either reduced processing capacity or delayed timing of structural analysis compared to the extraction of lexical/semantic information. The current study simultaneously investigates timing and resource allocation through a time-frequency analysis of the intrinsic neural activity during syntactic processing in native and English-speaking nonnative speakers of French. It involved structurally constrained anaphora resolution in bi-clausal wh-filler-gap dependencies such as Quelle décision à propos de lui est-ce que Paul a dit que Lydie avait rejetée sans hésitation? 'Which decision about him did Paul say that Lydie rejected without hesitation?'. We tested the hypothesis that nonnative speakers may allocate greater resources than native speakers to the computation of syntactic representations based on the grammatical specifications encoded in lexical entries, though both native and nonnative processing involves the immediate application of structural constraints. This distinct resource allocation is likely to arise in response to higher activation thresholds for nonnative knowledge acquired after the first language grammar has been fully acquired. To examine this bias in nonnative neurocognitive processing, we manipulated the wh-filler to contain either a lexically specified noun complement such as à propos de lui 'about him' or a non-lexcially specified noun phrase modifier such as le concernant 'concerning him'. We focused on processing at the intermediate gap site, that is, the point of information exchange between the matrix and the embedded clauses by adopting a measurement window corresponding to the bridge verb dit 'said' and subordinator que 'that' introducing the embedded clause. Our results showed that structural constraints on anaphora produced event-related spectral perturbations at 13-14Hz early into the presentation of the bridge verb across groups. An interaction of structural constraints on anaphora with group was found at 18-19Hz early into the presentation of the bridge verb. In this interaction, the nonnative-speaker activity at 18-19Hz echoed the concurrent general patterns at 13-14Hz, whereas the native-speaker activity revealed distinct power at 18-19Hz and at 13-14Hz. There was no evidence of delay of structural constraints on intermediate gaps with respect to lexical access to the bridge verb and subordinator. However, nonnative speakers' allocation of power in cell assembly synchronizations of fillers and gaps at the intermediate gap site reflected the grammatical specifications lexically encoded in the fillers.

Oscillatory brain responses to processing code-switches in the presence of others

Code-switching, i.e. the alternation between languages in a conversation, is a typical, yet socially-constrained practice in bilingual communities. For instance, code-switching is permissible only when other conversation partners are fluent in both languages. Studying code-switching provides insight in the cognitive and neural mechanisms underlying language control, and their modulation by linguistic and non-linguistic factors. Using time-frequency representations, we analyzed brain oscillation changes in EEG data recorded in a prior study (Kaan et al., 2020). In this study, Spanish-English bilinguals read sentences with and without switches in the presence of a bilingual or monolingual partner. Consistent with prior studies, code-switches were associated with a power decrease in the lower beta band (15-18 Hz). In addition, code-switches were associated with a power decrease in the upper gamma band (40-50 Hz), but only when a bilingual partner was present, suggesting the semantic/pragmatic processing of code-switches differs depending on who is present.

Effects of Structure and Meaning on Cortical Tracking of Linguistic Units in Naturalistic Speech

Recent research has established that cortical activity "tracks" the presentation rate of syntactic phrases in continuous speech, even though phrases are abstract units that do not have direct correlates in the acoustic signal. We investigated whether cortical tracking of phrase structures is modulated by the extent to which these structures compositionally determine meaning. To this end, we recorded electroencephalography (EEG) of 38 native speakers who listened to naturally spoken Dutch stimuli in different conditions, which parametrically modulated the degree to which syntactic structure and lexical semantics determine sentence meaning. Tracking was quantified through mutual information between the EEG data and either the speech envelopes or abstract annotations of syntax, all of which were filtered in the frequency band corresponding to the presentation rate of phrases (1.1-2.1 Hz). Overall, these mutual information analyses showed stronger tracking of phrases in regular sentences than in stimuli whose lexical-syntactic content is reduced, but no consistent differences in tracking between sentences and stimuli that contain a combination of syntactic structure and lexical content. While there were no effects of compositional meaning on the degree of phrase-structure tracking, analyses of event-related potentials elicited by sentence-final words did reveal meaning-induced differences between conditions. Our findings suggest that cortical tracking of structure in sentences indexes the internal generation of this structure, a process that is modulated by the properties of its input, but not by the compositional interpretation of its output.

Task-Modulated Oscillation Differences in Auditory and Spoken Chinese-English Bilingual Processing: An Electroencephalography Study

Neurophysiological research on the bilingual activity of interpretation or interpreting has been very fruitful in understanding the bilingual brain and has gained increasing popularity recently. Issues like word interpreting and the directionality of interpreting have been attended to by many researchers, mainly with localizing techniques. Brain structures such as the dorsolateral prefrontal cortex have been repeatedly identified during interpreting. However, little is known about the oscillation and synchronization features of interpreting, especially sentence-level overt interpreting. In this study we implemented a Chinese-English sentence-level overt interpreting experiment with electroencephalography on 43 Chinese-English bilinguals and compared the oscillation and synchronization features of interpreting with those of listening, speaking and shadowing. We found significant time-frequency power differences in the delta-theta (1–7 Hz) and gamma band (above 30 Hz) between motor and silent tasks. Further theta-gamma coupling analysis revealed different synchronization networks in between speaking, shadowing and interpreting, indicating an idea-formulation dependent mechanism. Moreover, interpreting incurred robust right frontotemporal gamma coactivation network compared with speaking and shadowing, which we think may reflect the language conversion process inherent in interpreting.

Evoked responses to note onsets and phrase boundaries in Mozart's K448

Understanding the neural correlates of perception of hierarchical structure in music presents a direct window into auditory organization. To examine the hypothesis that high-level and low-level structures—i.e. phrases and notes—elicit different neural responses, we collected intracranial electroencephalography (iEEG) data from eight subjects during exposure to Mozart’s K448 and directly compared Event-related potentials (ERPs) due to note onsets and those elicited by phrase boundaries. Cluster-level permutation tests revealed that note-onset-related ERPs and phrase-boundary-related ERPs were significantly different at \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$-150$$\end{document}-150, 200, and 450 ms relative to note onset and phrase markers. We also observed increased activity in frontal brain regions when processing phrase boundaries. We relate these observations to (1) a process which syntactically binds notes together hierarchically to form larger phrases; (2) positive emotions induced by successful prediction of forthcoming phrase boundaries and violations of melodic expectations at phrase boundaries.

Minimal Phrase Composition Revealed by Intracranial Recordings

The ability to comprehend phrases is an essential integrative property of the brain. Here, we evaluate the neural processes that enable the transition from single-word processing to a minimal compositional scheme. Previous research has reported conflicting timing effects of composition, and disagreement persists with respect to inferior frontal and posterior temporal contributions. To address these issues, 19 patients (10 male, 9 female) implanted with penetrating depth or surface subdural intracranial electrodes, heard auditory recordings of adjective-noun, pseudoword-noun, and adjective-pseudoword phrases and judged whether the phrase matched a picture. Stimulus-dependent alterations in broadband gamma activity, low-frequency power, and phase-locking values across the language-dominant left hemisphere were derived. This revealed a mosaic located on the lower bank of the posterior superior temporal sulcus (pSTS), in which closely neighboring cortical sites displayed exclusive sensitivity to either lexicality or phrase structure, but not both. Distinct timings were found for effects of phrase composition (210-300 ms) and pseudoword processing (∼300-700 ms), and these were localized to neighboring electrodes in pSTS. The pars triangularis and temporal pole encoded anticipation of composition in broadband low frequencies, and both regions exhibited greater functional connectivity with pSTS during phrase composition. Our results suggest that the pSTS is a highly specialized region composed of sparsely interwoven heterogeneous constituents that encodes both lower and higher level linguistic features. This hub in pSTS for minimal phrase processing may form the neural basis for the human-specific computational capacity for forming hierarchically organized linguistic structures.SIGNIFICANCE STATEMENT Linguists have claimed that the integration of multiple words into a phrase demands a computational procedure distinct from single-word processing. Here, we provide intracranial recordings from a large patient cohort, with high spatiotemporal resolution, to track the cortical dynamics of phrase composition. Epileptic patients volunteered to participate in a task in which they listened to phrases (red boat), word-pseudoword or pseudoword-word pairs (e.g., red fulg). At the onset of the second word in phrases, greater broadband high gamma activity was found in posterior superior temporal sulcus in electrodes that exclusively indexed phrasal meaning and not lexical meaning. These results provide direct, high-resolution signatures of minimal phrase composition in humans, a potentially species-specific computational capacity.

Temporal and topographical changes in theta power between middle childhood and adolescence during sentence comprehension

Time frequency analysis of the EEG is increasingly used to study the neural oscillations supporting language comprehension. Although this method holds promise for developmental research, most existing work focuses on adults. Theta power (4–8 Hz) in particular often corresponds to semantic processing of words in isolation and in ongoing text. Here we investigated how the timing and topography of theta engagement to individual words during written sentence processing changes between childhood and adolescence (8–15 years). Results show that topographically, the theta response is broadly distributed in children, occurring over left and right central-posterior and midline frontal areas, and localizes to left central-posterior areas by adolescence. There were two notable developmental shifts. First, in response to each word, early (150–300 msec) theta engagement over frontal areas significantly decreases between 8 and 9 years and 10–11 years. Second, throughout the sentence, theta engagement over the right parietal areas significantly decreases between 10 and 11 years and 12–13 years with younger children’s theta response remaining significantly elevated between words compared to adolescents’. We found no significant differences between 12 and 13 years and 14–15 years. These findings indicate that children’s engagement of the language network during sentence processing continues to change through middle childhood but stabilizes into adolescence.

How the healthy ageing brain supports semantic binding during language comprehension

Semantic binding refers to constructing complex meaning based on elementary building blocks. Using electroencephalography (EEG), we investigated the age-related changes in modulations of oscillatory brain activity supporting lexical retrieval and semantic binding. Young and older adult participants were visually presented two-word phrases, which for the first word revealed a lexical retrieval signature (e.g., swift vs. swrfeq) and for the second word revealed a semantic binding signature (e.g., horse in a semantic binding "swift horse" vs. no binding "swrfeq horse" context). The oscillatory brain activity associated with lexical retrieval as well as semantic binding significantly differed between healthy older and young adults. Specifically for lexical retrieval, we found that different age groups exhibited opposite patterns of theta and alpha modulation, which as a combined picture suggest that lexical retrieval is associated with different and delayed signatures in older compared with young adults. For semantic binding, in young adults, we found a signature in the low-beta range centred around the target word onset (i.e., a smaller low-beta increase for binding relative to no binding), whereas in healthy older adults, we found an opposite binding signature about ~500 ms later in the low- and high-beta range (i.e., a smaller low- and high-beta decrease for binding relative to no binding). The novel finding of a different and delayed oscillatory signature for semantic binding in healthy older adults reflects that the integration of word meaning into the semantic context takes longer and relies on different mechanisms in healthy older compared with young adults.

Dissecting the neurobiology of linguistic disorganisation and impoverishment in schizophrenia

Schizophrenia provides a quintessential disease model of how disturbances in the molecular mechanisms of neurodevelopment lead to disruptions in the emergence of cognition. The central and often persistent feature of this illness is the disorganisation and impoverishment of language and related expressive behaviours. Though clinically more prominent, the periodic perceptual distortions characterised as psychosis are non-specific and often episodic. While several insights into psychosis have been gained based on study of the dopaminergic system, the mechanistic basis of linguistic disorganisation and impoverishment is still elusive. Key findings from cellular to systems-level studies highlight the role of ubiquitous, inhibitory processes in language production. Dysregulation of these processes at critical time periods, in key brain areas, provides a surprisingly parsimonious account of linguistic disorganisation and impoverishment in schizophrenia. This review links the notion of excitatory/inhibitory (E/I) imbalance at cortical microcircuits to the expression of language behaviour characteristic of schizophrenia, through the building blocks of neurochemistry, neurophysiology, and neurocognition.

Comparing predictors of sentence self-paced reading times: Syntactic complexity versus transitional probability metrics

When estimating the influence of sentence complexity on reading, researchers typically opt for one of two main approaches: Measuring syntactic complexity (SC) or transitional probability (TP). Comparisons of the predictive power of both approaches have yielded mixed results. To address this inconsistency, we conducted a self-paced reading experiment. Participants read sentences of varying syntactic complexity. From two alternatives, we selected the set of SC and TP measures, respectively, that provided the best fit to the self-paced reading data. We then compared the contributions of the SC and TP measures to self-paced reading times when entered into the same model. Our results showed that while both measures explained significant portions of variance in reading times (over and above control variables: word/sentence length, word frequency and word position) when included in independent models, their contributions changed drastically when SC and TP were entered into the same model. Specifically, we only observed significant effects of TP. We conclude that in our experiment the control variables explained the bulk of variance. When comparing the small effects of SC and TP, the effects of TP appear to be more robust.

How Visual Word Decoding and Context-Driven Auditory Semantic Integration Contribute to Reading Comprehension: A Test of Additive vs. Multiplicative Models

Theories of reading comprehension emphasize decoding and listening comprehension as two essential components. The current study aimed to investigate how Chinese character decoding and context-driven auditory semantic integration contribute to reading comprehension in Chinese middle school students. Seventy-five middle school students were tested. Context-driven auditory semantic integration was assessed with speech-in-noise tests in which the fundamental frequency (F₀) contours of spoken sentences were either kept natural or acoustically flattened, with the latter requiring a higher degree of contextual information. Statistical modeling with hierarchical regression was conducted to examine the contributions of Chinese character decoding and context-driven auditory semantic integration to reading comprehension. Performance in Chinese character decoding and auditory semantic integration scores with the flattened (but not natural) F₀ sentences significantly predicted reading comprehension. Furthermore, the contributions of these two factors to reading comprehension were better fitted with an additive model instead of a multiplicative model. These findings indicate that reading comprehension in middle schoolers is associated with not only character decoding but also the listening ability to make better use of the sentential context for semantic integration in a severely degraded speech-in-noise condition. The results add to our better understanding of the multi-faceted reading comprehension in children. Future research could further address the age-dependent development and maturation of reading skills by examining and controlling other important cognitive variables, and apply neuroimaging techniques such as functional magmatic resonance imaging and electrophysiology to reveal the neural substrates and neural oscillatory patterns for the contribution of auditory semantic integration and the observed additive model to reading comprehension.

EEG theta responses induced by emoji semantic violations

This study investigated emoji semantic processing by measuring changes in event-related electroencephalogram (EEG) power. The last segment of experimental sentences was designed as either words or emojis consistent or inconsistent with the sentential context. The results showed that incongruent emojis led to a conspicuous increase of theta power (4–7 Hz), while incongruent words induced a decrease. Furthermore, the theta power increase was observed at midfrontal, occipital and bilateral temporal lobes with emojis. This suggests a higher working memory load for monitoring errors, difficulty of form recognition and concept retrieval in emoji semantic processing. It implies different neuro-cognitive processes involved in the semantic processing of emojis and words.

Functional brain plasticity during L1 training on complex sentences: Changes in gamma-band oscillatory activity

The adult human brain remains plastic even after puberty. However, whether first language (L1) training in adults can alter the language network is yet largely unknown. Thus, we conducted a longitudinal training experiment on syntactically complex German sentence comprehension. Sentence complexity was varied by the depth of the center embedded relative clauses (i.e., single or double embedded). Comprehension was tested after each sentence with a question on the thematic role assignment. Thirty adult, native German speakers were recruited for 4 days of training. Magnetoencephalography (MEG) data were recorded and subjected to spectral power analysis covering the classical frequency bands (i.e., theta, alpha, beta, low gamma, and gamma). Normalized spectral power, time‐locked to the final closure of the relative clause, was subjected to a two‐factor analysis (“sentence complexity” and “training days”). Results showed that for the more complex sentences, the interaction of sentence complexity and training days was observed in Brodmann area 44 (BA 44) as a decrease of gamma power with training. Moreover, in the gamma band (55–95 Hz) functional connectivity between BA 44 and other brain regions such as the inferior frontal sulcus and the inferior parietal cortex were correlated with behavioral performance increase due to training. These results show that even for native speakers, complex L1 sentence training improves language performance and alters neural activities of the left hemispheric language network. Training strengthens the use of the dorsal processing stream with working‐memory‐related brain regions for syntactically complex sentences, thereby demonstrating the brain's functional plasticity for L1 training.

Left posterior temporal cortex is sensitive to syntax within conceptually matched Arabic expressions

During language comprehension, the brain processes not only word meanings, but also the grammatical structure-the "syntax"-that strings words into phrases and sentences. Yet the neural basis of syntax remains contentious, partly due to the elusiveness of experimental designs that vary structure independently of meaning-related variables. Here, we exploit Arabic's grammatical properties, which enable such a design. We collected magnetoencephalography (MEG) data while participants read the same noun-adjective expressions with zero, one, or two contiguously-written definite articles (e.g., 'chair purple'; 'the-chair purple'; 'the-chair the-purple'), representing equivalent concepts, but with different levels of syntactic complexity (respectively, indefinite phrases: 'a purple chair'; sentences: 'The chair is purple.'; definite phrases: 'the purple chair'). We expected regions processing syntax to respond differently to simple versus complex structures. Single-word controls ('chair'/'purple') addressed definiteness-based accounts. In noun-adjective expressions, syntactic complexity only modulated activity in the left posterior temporal lobe (LPTL), ~ 300 ms after each word's onset: indefinite phrases induced more MEG-measured positive activity. The effects disappeared in single-word tokens, ruling out non-syntactic interpretations. In contrast, left anterior temporal lobe (LATL) activation was driven by meaning. Overall, the results support models implicating the LPTL in structure building and the LATL in early stages of conceptual combination.

Referential vs. Non-referential World-Language Relations: How Do They Modulate Language Comprehension in 4 to 5-Year-Olds, Younger, and Older Adults?

Age has been shown to influence language comprehension, with delays, for instance, in older adults' expectations about upcoming information. We examined to what extent expectations about upcoming event information (who-does-what-to-whom) change across the lifespan (in 4- to 5-year-old children, younger, and older adults) and as a function of different world-language relations. In a visual-world paradigm, participants in all three age groups inspected a speaker whose facial expression was either smiling or sad. Next they inspected two clipart agents (e.g., a smiling cat and a grumpy rat) depicted as acting upon a patient (e.g., a ladybug tickled by the cat and arrested by the rat). Control scenes featured the same three characters without the action depictions. While inspecting the depictions, comprehenders listened to a German sentence [e.g., Den Marienkäfer kitzelt vergnügt der Kater; literally: “The ladybug (object/patient) tickles happily the cat (subject/agent)”]. Referential verb-action relations (i.e., when the actions were present) could, in principle, cue the cat-agent and so could non-referential relations via links from the speaker's smile to “happily” and the cat's smile. We examined variation in participants' visual anticipation of the agent (the cat) before it was mentioned depending on (a) participant age and (b) whether the referentially mediated action depiction or the non-referentially associated speaker smile cued the agent. The action depictions rapidly boosted participants' visual anticipation of the agent, facilitating thematic role assignment in all age groups. By contrast, effects of the non-referentially cued speaker smile emerged in the younger adults only. We outline implications of these findings for processing accounts of the temporally coordinated interplay between listeners' age-dependent language comprehension, their interrogation of the visual context, and visual context influences.

Mini Pinyin: A modified miniature language for studying language learning and incremental sentence processing

Artificial grammar learning (AGL) paradigms are used extensively to characterise (neuro)cognitive bases of language learning. However, despite their effectiveness in characterising the capacity to learn complex structured sequences, AGL paradigms lack ecological validity and typically do not account for cross-linguistic differences in sentence comprehension. Here, we describe a new modified miniature language paradigm - Mini Pinyin - that mimics natural language as it is based on an existing language (Mandarin Chinese) and includes both structure and meaning. Mini Pinyin contains a number of cross-linguistic elements, including varying word orders and classifier-noun rules. To evaluate the effectiveness of Mini Pinyin, 76 (mean age = 24.9; 26 female) monolingual native English speakers completed a learning phase followed by a sentence acceptability judgement task. Generalised mixed effects modelling revealed that participants attained a moderate degree of accuracy on the judgement task, with performance scores ranging from 25% to 100% accuracy depending on the word order of the sentence. Further, sentences compatible with the canonical English word order were learned more efficiently than non-canonical word orders. We controlled for inter-individual differences in statistical learning ability, which accounted for ~20% of the variance in performance on the sentence judgement task. We provide stimuli and statistical analysis scripts as open-source resources and discuss how future research can utilise this paradigm to study the neurobiological basis of language learning. Mini Pinyin affords a convenient tool for improving the future of language learning research by building on the parameters of traditional AGL or existing miniature language paradigms.

No evidence for differences among language regions in their temporal receptive windows

The "core language network" consists of left frontal and temporal regions that are selectively engaged in linguistic processing. Whereas functional differences among these regions have long been debated, many accounts propose distinctions in terms of representational grain-size-e.g., words vs. phrases/sentences-or processing time-scale, i.e., operating on local linguistic features vs. larger spans of input. Indeed, the topography of language regions appears to overlap with a cortical hierarchy reported by Lerner et al. (2011) wherein mid-posterior temporal regions are sensitive to low-level features of speech, surrounding areas-to word-level information, and inferior frontal areas-to sentence-level information and beyond. However, the correspondence between the language network and this hierarchy of "temporal receptive windows" (TRWs) is difficult to establish because the precise anatomical locations of language regions vary across individuals. To directly test this correspondence, we first identified language regions in each participant with a well-validated task-based localizer, which confers high functional resolution to the study of TRWs (traditionally based on stereotactic coordinates); then, we characterized regional TRWs with the naturalistic story listening paradigm of Lerner et al. (2011), which augments task-based characterizations of the language network by more closely resembling comprehension "in the wild". We find no region-by-TRW interactions across temporal and inferior frontal regions, which are all sensitive to both word-level and sentence-level information. Therefore, the language network as a whole constitutes a unique stage of information integration within a broader cortical hierarchy.

The Cortical Maps of Hierarchical Linguistic Structures during Speech Perception

The hierarchical nature of language requires human brain to internally parse connected-speech and incrementally construct abstract linguistic structures. Recent research revealed multiple neural processing timescales underlying grammar-based configuration of linguistic hierarchies. However, little is known about where in the whole cerebral cortex such temporally scaled neural processes occur. This study used novel magnetoencephalography source imaging techniques combined with a unique language stimulation paradigm to segregate cortical maps synchronized to 3 levels of linguistic units (i.e., words, phrases, and sentences). Notably, distinct ensembles of cortical loci were identified to feature structures at different levels. The superior temporal gyrus was found to be involved in processing all 3 linguistic levels while distinct ensembles of other brain regions were recruited to encode each linguistic level. Neural activities in the right motor cortex only followed the rhythm of monosyllabic words which have clear acoustic boundaries, whereas the left anterior temporal lobe and the left inferior frontal gyrus were selectively recruited in processing phrases or sentences. Our results ground a multi-timescale hierarchical neural processing of speech in neuroanatomical reality with specific sets of cortices responsible for different levels of linguistic units.

Oscillatory dynamics of perception of emotional sentences in healthy subjects with different severity of depressive symptoms

The aim of the study was to investigate the characteristics of the oscillatory dynamics of brain activity during the perception of negative, positive, and neutral sentences in healthy individuals with differing severity of depressive symptoms at the preclinical stage. The study involved 34 healthy people (22 women). The severity of the symptoms of depression was assessed using Beck's Depression Inventory (BDI II). Using independent component analysis and the function of dipfit in the EEGlab software, the EEG was divided into components and their localizations were calculated. To assess the induced responses, event-related spectral perturbations were calculated. The perception of emotional sentences was accompanied by a more pronounced increase in theta rhythm in the group with lower severity of depressive symptoms. The perception of all types of sentences was accompanied by a decrease in beta rhythm in the group with lower severity of depressive symptoms. The effects were localized to the precuneus. The decrease of oscillatory responses in the theta and beta ranges in individuals with a high severity of depressive symptoms suggests a reduction of attention to the emotional content and meaning of the sentences.

Converging intracortical signatures of two separated processing timescales in human early auditory cortex

Neural oscillations in auditory cortex are argued to support parsing and representing speech constituents at their corresponding temporal scales. Yet, how incoming sensory information interacts with ongoing spontaneous brain activity, what features of the neuronal microcircuitry underlie spontaneous and stimulus-evoked spectral fingerprints, and what these fingerprints entail for stimulus encoding, remain largely open questions. We used a combination of human invasive electrophysiology, computational modeling and decoding techniques to assess the information encoding properties of brain activity and to relate them to a plausible underlying neuronal microarchitecture. We analyzed intracortical auditory EEG activity from 10 patients while they were listening to short sentences. Pre-stimulus neural activity in early auditory cortical regions often exhibited power spectra with a shoulder in the delta range and a small bump in the beta range. Speech decreased power in the beta range, and increased power in the delta-theta and gamma ranges. Using multivariate machine learning techniques, we assessed the spectral profile of information content for two aspects of speech processing: detection and discrimination. We obtained better phase than power information decoding, and a bimodal spectral profile of information content with better decoding at low (delta-theta) and high (gamma) frequencies than at intermediate (beta) frequencies. These experimental data were reproduced by a simple rate model made of two subnetworks with different timescales, each composed of coupled excitatory and inhibitory units, and connected via a negative feedback loop. Modeling and experimental results were similar in terms of pre-stimulus spectral profile (except for the iEEG beta bump), spectral modulations with speech, and spectral profile of information content. Altogether, we provide converging evidence from both univariate spectral analysis and decoding approaches for a dual timescale processing infrastructure in human auditory cortex, and show that it is consistent with the dynamics of a simple rate model.

EEG phase synchronization during semantic unification relates to individual differences in children's vocabulary skill

As we listen to speech, our ability to understand what was said requires us to retrieve and bind together individual word meanings into a coherent discourse representation. This so-called semantic unification is a fundamental cognitive skill, and its development relies on the integration of neural activity throughout widely distributed functional brain networks. In this proof-of-concept study, we examine, for the first time, how these functional brain networks develop in children. Twenty-six children (ages 4-17) listened to well-formed sentences and sentences containing a semantic violation, while EEG was recorded. Children with stronger vocabulary showed N400 effects that were more concentrated to centroparietal electrodes and greater EEG phase synchrony (phase lag index; PLI) between right centroparietal and bilateral frontocentral electrodes in the delta frequency band (1-3 Hz) 1.27-1.53 s after listening to well-formed sentences compared to sentences containing a semantic violation. These effects related specifically to individual differences in receptive vocabulary, perhaps pointing to greater recruitment of functional brain networks important for top-down semantic unification with development. Less skilled children showed greater delta phase synchrony for violation sentences 3.41-3.64 s after critical word onset. This later effect was partly driven by individual differences in nonverbal reasoning, perhaps pointing to non-verbal compensatory processing to extract meaning from speech in children with less developed vocabulary. We suggest that functional brain network communication, as measured by momentary changes in the phase synchrony of EEG oscillations, develops throughout the school years to support language comprehension in different ways depending on children's verbal and nonverbal skill levels.

Frequency-based Dissociation of Symbolic and Nonsymbolic Numerical Processing during Numerical Comparison

Recent evidence suggests that during numerical calculation, symbolic and nonsymbolic processing are functionally distinct operations. Nevertheless, both roughly recruit the same brain areas (spatially overlapping networks in the parietal cortex) and happen at the same time (roughly 250 msec poststimulus onset). We tested the hypothesis that symbolic and nonsymbolic processing are segregated by means of functionally relevant networks in different frequency ranges: high gamma (above 50 Hz) for symbolic processing and lower beta (12–17 Hz) for nonsymbolic processing. EEG signals were quantified as participants compared either symbolic numbers or nonsymbolic quantities. Larger EEG gamma-band power was observed for more difficult symbolic comparisons (ratio of 0.8 between the two numbers) than for easier comparisons (ratio of 0.2) over frontocentral regions. Similarly, beta-band power was larger for more difficult nonsymbolic comparisons than for easier ones over parietal areas. These results confirm the existence of a functional dissociation in EEG oscillatory dynamics during numerical processing that is compatible with the notion of distinct linguistic processing of symbolic numbers and approximation of nonsymbolic numerical information.

Embodied time and the out-of-body experience of the self

Using an out-of-body paradigm, the present study provided further empirical evidence for the theory of embodied time by suggesting that the body-self plays a key role in time judgments. Looking through virtual reality glasses, the participants saw the arm of a mannequin instead of their own arm. They had to judge the duration of the interval between two (perceived) touches applied to the mannequin's body after a series of strokes had been viewed being made to the mannequin and tactile strokes had been administered to the participants themselves. These strokes were administered either synchronously or asynchronously. During the interval, a pleasant (touch with a soft paintbrush) or an unpleasant stimulation (touch with a pointed knife) was applied to the mannequin. The results showed that the participants felt the perceived tactile stimulations in their own bodies more strongly after the synchronous than the asynchronous stroking condition, a finding which is consistent with the out-of-body illusion. In addition, the interval duration was judged longer in the synchronous than in the asynchronous condition. This time distortion increased the greater the individual out-of-body experience was. Our results therefore highlight the importance of the awareness of the body-self in the processing of time, i.e., the significance of embodied time.

The Relation between Alpha/Beta Oscillations and the Encoding of Sentence induced Contextual Information

Pre-stimulus alpha (8-12 Hz) and beta (16-20 Hz) oscillations have been frequently linked to the prediction of upcoming sensory input. Do these frequency bands serve as a neural marker of linguistic prediction as well? We hypothesized that if pre-stimulus alpha and beta oscillations index language predictions, their power should monotonically relate to the degree of predictability of incoming words based on past context. We expected that the more predictable the last word of a sentence, the stronger the alpha and beta power modulation. To test this, we measured neural responses with magnetoencephalography of healthy individuals during exposure to a set of linguistically matched sentences featuring three levels of sentence context constraint (high, medium and low constraint). We observed fluctuations in alpha and beta power before last word onset, and modulations in M400 amplitude after last word onset. The M400 amplitude was monotonically related to the degree of context constraint, with a high constraining context resulting in the strongest amplitude decrease. In contrast, pre-stimulus alpha and beta power decreased more strongly for intermediate constraints, followed by high and low constraints. Therefore, unlike the M400, pre-stimulus alpha and beta dynamics were not indexing the degree of word predictability from sentence context.

THE POWER OF NEURAL OSCILLATIONS TO INFORM SENTENCE COMPREHENSION: A LINGUISTIC PERSPECTIVE

The field of psycholinguistics is currently experiencing an explosion of interest in the analysis of neural oscillations - rhythmic brain activity synchronized at different temporal and spatial levels. Given that language comprehension relies on a myriad of processes, which are carried out in parallel in distributed brain networks, there is hope that this methodology might bring the field closer to understanding some of the more basic (spatially and temporally distributed, yet at the same time often overlapping) neural computations that support language function. In this review we discuss existing proposals linking oscillatory dynamics in different frequency bands to basic neural computations, and review relevant theories suggesting associations between band-specific oscillations and higher-level cognitive processes. More or less consistent patterns of oscillatory activity related to certain types of linguistic processing can already be derived from the evidence that has accumulated over the past few decades. The centerpiece of the current review is a synthesis of such patterns grouped by linguistic phenomenon. We restrict our review to evidence linking measures of oscillatory power to the comprehension of sentences, as well as linguistically (and/or pragmatically) more complex structures. For each grouping, we provide a brief summary and a table of associated oscillatory signatures that a psycholinguist might expect to find when employing a particular linguistic task. Summarizing across different paradigms, we conclude that a handful of basic neural oscillatory mechanisms are likely recruited in different ways and at different times for carrying out a variety of linguistic computations.

Age Differences in Encoding-Related Alpha Power Reflect Sentence Comprehension Difficulties

When sentence processing taxes verbal working memory, comprehension difficulties arise. This is specifically the case when processing resources decline with advancing adult age. Such decline likely affects the encoding of sentences into working memory, which constitutes the basis for successful comprehension. To assess age differences in encoding-related electrophysiological activity, we recorded the electroencephalogram from three age groups (24, 43, and 65 years). Using an auditory sentence comprehension task, age differences in encoding-related oscillatory power were examined with respect to the accuracy of the given response. That is, the difference in oscillatory power between correctly and incorrectly encoded sentences, yielding subsequent memory effects (SME), was compared across age groups. Across age groups, we observed an age-related SME inversion in the alpha band from a power decrease in younger adults to a power increase in older adults. We suggest that this SME inversion underlies age-related comprehension difficulties. With alpha being commonly linked to inhibitory processes, this shift may reflect a change in the cortical inhibition-disinhibition balance. A cortical disinhibition may imply enriched sentence encoding in younger adults. In contrast, resource limitations in older adults may necessitate an increase in cortical inhibition during sentence encoding to avoid an information overload. Overall, our findings tentatively suggest that age-related comprehension difficulties are associated with alterations to the electrophysiological dynamics subserving general higher cognitive functions.

Lingering expectations: A pseudo-repetition effect for words previously expected but not presented

Prediction can help support rapid language processing. However, it is unclear whether prediction has downstream consequences, beyond processing in the moment. In particular, when a prediction is disconfirmed, does it linger, or is it suppressed? This study manipulated whether words were actually seen or were only expected, and probed their fate in memory by presenting the words (again) a few sentences later. If disconfirmed predictions linger, subsequent processing of the previously expected (but never presented) word should be similar to actual word repetition. At initial presentation, electrophysiological signatures of prediction disconfirmation demonstrated that participants had formed expectations. Further downstream, relative to unseen words, repeated words elicited a strong N400 decrease, an enhanced late positive complex (LPC), and late alpha band power decreases. Critically, like repeated words, words previously expected but not presented also attenuated the N400. This "pseudo-repetition effect" suggests that disconfirmed predictions can linger at some stages of processing, and demonstrates that prediction has downstream consequences beyond rapid on-line processing.

Addressing the Language Binding Problem With Dynamic Functional Connectivity During Meaningful Spoken Language Comprehension

During speech, how does the brain integrate information processed on different timescales and in separate brain areas so we can understand what is said? This is the language binding problem. Dynamic functional connectivity (brief periods of synchronization in the phase of EEG oscillations) may provide some answers. Here we investigate time and frequency characteristics of oscillatory power and phase synchrony (dynamic functional connectivity) during speech comprehension. Twenty adults listened to meaningful English sentences and non-sensical “Jabberwocky” sentences in which pseudo-words replaced all content words, while EEG was recorded. Results showed greater oscillatory power and global connectivity strength (mean phase lag index) in the gamma frequency range (30–80 Hz) for English compared to Jabberwocky. Increased power and connectivity relative to baseline was also seen in the theta frequency range (4–7 Hz), but was similar for English and Jabberwocky. High-frequency gamma oscillations may reflect a mechanism by which the brain transfers and integrates linguistic information so we can extract meaning and understand what is said. Slower frequency theta oscillations may support domain-general processing of the rhythmic features of speech. Our findings suggest that constructing a meaningful representation of speech involves dynamic interactions among distributed brain regions that communicate through frequency-specific functional networks.

Differences in Neurocognitive Mechanisms Underlying the Processing of Center-Embedded and Non–embedded Musical Structures

In music, chords are organized into hierarchical structures based on recursive or embedded syntax. How the brain extracts recursive grammar is a central question in musical cognition and other cognitive neuroscience, but the precise mechanism remains unclear. By analyzing event related potentials (ERPs) and neural oscillatory activity, the present study investigated neurocognitive mechanisms underlying the processing of center-embedded structure in music by examining the differences in center-embedded and non-embedded structure processing and evaluating how these differences are affected by musical proficiency. Based on Western musical proficiency, the subjects were divided into two groups, non-experts and experts. The results revealed that for non-experts, the processing of center-embedded structure elicited greater early right-anterior negativity (ERAN) and N5 components as well as, reduced alpha and gamma activities than did the non-embedded structure. For experts, no significant difference in the ERP response was observed between the processing of non-embedded and center-embedded structures; however, the processing of center-embedded structure elicited increased beta activity compared to non-embedded structure. These findings indicate that listeners different in proficiency would rely on different cognitive neural mechanisms in music processing with the syntactic complexity increases.

The Role of Gamma Oscillations During Integration of Metaphoric Gestures and Abstract Speech

Metaphoric (MP) co-speech gestures are commonly used during daily communication. They communicate about abstract information by referring to gestures that are clearly concrete (e.g., raising a hand for “the level of the football game is high”). To understand MP co-speech gestures, a multisensory integration at semantic level is necessary between abstract speech and concrete gestures. While semantic gesture-speech integration has been extensively investigated using functional magnetic resonance imaging, evidence from electroencephalography (EEG) is rare. In the current study, we set out an EEG experiment, investigating the processing of MP vs. iconic (IC) co-speech gestures in different contexts, to reveal the oscillatory signature of MP gesture integration. German participants (n = 20) viewed video clips with an actor performing both types of gestures, accompanied by either comprehensible German or incomprehensible Russian (R) speech, or speaking German sentences without any gestures. Time-frequency analysis of the EEG data showed that, when gestures were accompanied by comprehensible German speech, MP gestures elicited decreased gamma band power (50–70 Hz) between 500 and 700 ms in the parietal electrodes when compared to IC gestures, and the source of this effect was localized to the right middle temporal gyrus. This difference is likely to reflect integration processes, as it was reduced in the R language and no-gesture conditions. Our findings provide the first empirical evidence suggesting the functional relationship between gamma band oscillations and higher-level semantic processes in a multisensory setting.