Brain dynamics sustaining rapid rule extraction from speech

Vigilant attention mediates the association between resting EEG alpha oscillations and word learning ability

Individuals exhibit considerable variability in their capacity to learn and retain new information, including novel vocabulary. Prior research has established the importance of vigilance and electroencephalogram (EEG) alpha rhythm in the learning process. However, the interplay between vigilant attention, EEG alpha oscillations, and an individual's word learning ability (WLA) remains elusive. To address this knowledge gap, here we conducted two experiments with a total of 140 young and middle-aged adults who underwent resting EEG recordings prior to completing a paired-associate word learning task and a psychomotor vigilance test (PVT). The results of both experiments consistently revealed significant positive correlations between WLA and resting EEG alpha oscillations in the occipital and frontal regions. Furthermore, the association between resting EEG alpha oscillations and WLA was mediated by vigilant attention, as measured by the PVT. These findings provide compelling evidence supporting the crucial role of vigilant attention in linking EEG alpha oscillations to an individual's learning ability.

Oscillatory and Aperiodic Neural Activity Jointly Predict Language Learning

Memory formation involves the synchronous firing of neurons in task-relevant networks, with recent models postulating that a decrease in low-frequency oscillatory activity underlies successful memory encoding and retrieval. However, to date, this relationship has been investigated primarily with face and image stimuli; considerably less is known about the oscillatory correlates of complex rule learning, as in language. Furthermore, recent work has shown that nonoscillatory (1/ƒ) activity is functionally relevant to cognition, yet its interaction with oscillatory activity during complex rule learning remains unknown. Using spectral decomposition and power-law exponent estimation of human EEG data (17 females, 18 males), we show for the first time that 1/ƒ and oscillatory activity jointly influence the learning of word order rules of a miniature artificial language system. Flexible word-order rules were associated with a steeper 1/ƒ slope, whereas fixed word-order rules were associated with a shallower slope. We also show that increased theta and alpha power predicts fixed relative to flexible word-order rule learning and behavioral performance. Together, these results suggest that 1/ƒ activity plays an important role in higher-order cognition, including language processing, and that grammar learning is modulated by different word-order permutations, which manifest in distinct oscillatory profiles.

Integrating when and what information in the left parietal lobe allows language rule generalization

A crucial aspect when learning a language is discovering the rules that govern how words are combined in order to convey meanings. Because rules are characterized by sequential co-occurrences between elements (e.g., “These cupcakes are unbelievable”), tracking the statistical relationships between these elements is fundamental. However, purely bottom-up statistical learning alone cannot fully account for the ability to create abstract rule representations that can be generalized, a paramount requirement of linguistic rules. Here, we provide evidence that, after the statistical relations between words have been extracted, the engagement of goal-directed attention is key to enable rule generalization. Incidental learning performance during a rule-learning task on an artificial language revealed a progressive shift from statistical learning to goal-directed attention. In addition, and consistent with the recruitment of attention, functional MRI (fMRI) analyses of late learning stages showed left parietal activity within a broad bilateral dorsal frontoparietal network. Critically, repetitive transcranial magnetic stimulation (rTMS) on participants’ peak of activation within the left parietal cortex impaired their ability to generalize learned rules to a structurally analogous new language. No stimulation or rTMS on a nonrelevant brain region did not have the same interfering effect on generalization. Performance on an additional attentional task showed that this rTMS on the parietal site hindered participants’ ability to integrate “what” (stimulus identity) and “when” (stimulus timing) information about an expected target. The present findings suggest that learning rules from speech is a two-stage process: following statistical learning, goal-directed attention—involving left parietal regions—integrates “what” and “when” stimulus information to facilitate rapid rule generalization.

This study uses repetitive transcranial stimulation to show that learning language rules from speech is a two-stage process; following statistical learning, goal-directed attention (involving left parietal regions) integrates "what" and "when" stimulus information to facilitate rapid rule generalization.

Mini Pinyin: A modified miniature language for studying language learning and incremental sentence processing

Artificial grammar learning (AGL) paradigms are used extensively to characterise (neuro)cognitive bases of language learning. However, despite their effectiveness in characterising the capacity to learn complex structured sequences, AGL paradigms lack ecological validity and typically do not account for cross-linguistic differences in sentence comprehension. Here, we describe a new modified miniature language paradigm - Mini Pinyin - that mimics natural language as it is based on an existing language (Mandarin Chinese) and includes both structure and meaning. Mini Pinyin contains a number of cross-linguistic elements, including varying word orders and classifier-noun rules. To evaluate the effectiveness of Mini Pinyin, 76 (mean age = 24.9; 26 female) monolingual native English speakers completed a learning phase followed by a sentence acceptability judgement task. Generalised mixed effects modelling revealed that participants attained a moderate degree of accuracy on the judgement task, with performance scores ranging from 25% to 100% accuracy depending on the word order of the sentence. Further, sentences compatible with the canonical English word order were learned more efficiently than non-canonical word orders. We controlled for inter-individual differences in statistical learning ability, which accounted for ~20% of the variance in performance on the sentence judgement task. We provide stimuli and statistical analysis scripts as open-source resources and discuss how future research can utilise this paradigm to study the neurobiological basis of language learning. Mini Pinyin affords a convenient tool for improving the future of language learning research by building on the parameters of traditional AGL or existing miniature language paradigms.

Interhemispheric and Intrahemispheric Connectivity From the Left Pars Opercularis Within the Language Network Is Modulated by Transcranial Stimulation in Healthy Subjects

Neural activity related to language can be modulated within widespread networks following learning or in response to disruption—including the experimental application of noninvasive brain stimulation. However, the spatiotemporal characteristics of such modulation remain insufficiently explored. The present study combined transcranial magnetic stimulation (TMS) and electroencephalography (EEG) to explore the modulation of activity across the language network following continuous theta-burst stimulation (cTBS) of the left pars opercularis. In 10 healthy subjects (21 ± 2 years old, four females), neuronavigated cTBS was delivered over the left pars opercularis of the frontal operculum (part of the traditional Broca’s area) at 80% of active motor threshold (AMT) stimulation intensity. Real cTBS and sham cTBS were performed in two different visits separated by at least 48 h. Before, immediately, and 10 min after cTBS, 30 single pulses of TMS were delivered to the left pars opercularis at 80% of the resting motor threshold (RMT), whereas EEG was simultaneously recorded. We examined the cTBS-induced modulation of phase locking values (PLVs) between the TMS-evoked potentials (TEPs) recorded over the pars opercularis and those recorded over its right-hemispheric homolog area, the left supramarginal area, and the left superior temporal area in different EEG frequency bands and different time windows following cTBS. cTBS to the left pars opercularis induced within the gamma band: (1) a significant increase in TEP phase synchronization between the left and right pars opercularis at an early time window (250–350 ms) following cTBS; and (2) significantly increased PLV with the left supramarginal area and the left superior temporal area at a later time window (600–700 ms). In the theta and delta band, cTBS to the left pars opercularis induced significantly increased phase synchronization of TEPs between the left pars opercularis and the posterior left hemispheric language areas at a late time window. In sham condition, there was a significant decrease in TEP phase synchronization of the high beta band between left pars opercularis and left superior temporal area at 200–300 ms. These results contribute to characterize the dynamics of the language network and may have implications in the development of noninvasive stimulation protocols to promote the language rehabilitation in aphasia patients.

Individual Differences in Resting-state Brain Rhythms Uniquely Predict Second Language Learning Rate and Willingness to Communicate in Adults

The current study used quantitative electroencephalography (qEEG) to characterize individual differences in neural rhythms at rest and to relate them to fluid reasoning ability, to first language proficiency, and to subsequent second language (L2) learning ability, with the goal of obtaining a better understanding of the neurocognitive bases of L2 aptitude. Mean spectral power, laterality, and coherence metrics were extracted across theta, alpha, beta, and gamma frequency bands obtained from eyes-closed resting-state qEEG data from 41 adults aged 18–34 years. Participants then completed 8 weeks of French training using a virtual language and cultural immersion software. Results replicate and extend previous studies showing that faster learners have higher beta power recorded over right hemisphere (RH) electrode sites, greater laterality (RH − LH/RH + LH) of alpha and beta bands, and greater coherence between RH frontotemporal sites across all frequencies, although only coherence measures survived multiple comparisons. Increased coherence within and between RH networks was also associated with greater posttest declarative memory scores and with more accurate speech during learning. Total speech attempts, in contrast, correlated with bilaterally distributed small-world network configurations, as indexed by lower power and coherence over high-frequency (beta and gamma) bands recorded over frontotemporal networks in both hemispheres. Results from partial correlations and regression analyses suggest that the neural predictors of L2 learning rate, posttest proficiency, and total speech attempts varied in their degree of overlap with qEEG correlates of first language proficiency and fluid reasoning abilities, but that neural predictors alone explained 26–60% of the variance in L2 outcomes.

Theta Coherence Asymmetry in the Dorsal Stream of Musicians Facilitates Word Learning

Word learning constitutes a human faculty which is dependent upon two anatomically distinct processing streams projecting from posterior superior temporal (pST) and inferior parietal (IP) brain regions toward the prefrontal cortex (dorsal stream) and the temporal pole (ventral stream). The ventral stream is involved in mapping sensory and phonological information onto lexical-semantic representations, whereas the dorsal stream contributes to sound-to-motor mapping, articulation, complex sequencing in the verbal domain, and to how verbal information is encoded, stored, and rehearsed from memory. In the present source-based EEG study, we evaluated functional connectivity between the IP lobe and Broca's area while musicians and non-musicians learned pseudowords presented in the form of concatenated auditory streams. Behavioral results demonstrated that musicians outperformed non-musicians, as reflected by a higher sensitivity index (d'). This behavioral superiority was paralleled by increased left-hemispheric theta coherence in the dorsal stream, whereas non-musicians showed stronger functional connectivity in the right hemisphere. Since no between-group differences were observed in a passive listening control condition nor during rest, results point to a task-specific intertwining between musical expertise, functional connectivity, and word learning.

Sleep-Dependent Memory Consolidation and Incremental Sentence Comprehension: Computational Dependencies during Language Learning as Revealed by Neuronal Oscillations

We hypothesize a beneficial influence of sleep on the consolidation of the combinatorial mechanisms underlying incremental sentence comprehension. These predictions are grounded in recent work examining the effect of sleep on the consolidation of linguistic information, which demonstrate that sleep-dependent neurophysiological activity consolidates the meaning of novel words and simple grammatical rules. However, the sleep-dependent consolidation of sentence-level combinatorics has not been studied to date. Here, we propose that dissociable aspects of sleep neurophysiology consolidate two different types of combinatory mechanisms in human language: sequence-based (order-sensitive) and dependency-based (order-insensitive) combinatorics. The distinction between the two types of combinatorics is motivated both by cross-linguistic considerations and the neurobiological underpinnings of human language. Unifying this perspective with principles of sleep-dependent memory consolidation, we posit that a function of sleep is to optimize the consolidation of sequence-based knowledge (the when) and the establishment of semantic schemas of unordered items (the what) that underpin cross-linguistic variations in sentence comprehension. This hypothesis builds on the proposal that sleep is involved in the construction of predictive codes, a unified principle of brain function that supports incremental sentence comprehension. Finally, we discuss neurophysiological measures (EEG/MEG) that could be used to test these claims, such as the quantification of neuronal oscillations, which reflect basic mechanisms of information processing in the brain.

Neural oscillatory mechanisms during novel grammar learning underlying language analytical abilities

The goal of the present study was to investigate the initial phases of novel grammar learning on a neural level, concentrating on mechanisms responsible for individual variability between learners. Two groups of participants, one with high and one with average language analytical abilities, performed an Artificial Grammar Learning (AGL) task consisting of learning and test phases. During the task, EEG signals from 32 cap-mounted electrodes were recorded and epochs corresponding to the learning phases were analysed. We investigated spectral power modulations over time, and functional connectivity patterns by means of a bivariate, frequency-specific index of phase synchronization termed Phase Locking Value (PLV). Behavioural data showed learning effects in both groups, with a steeper learning curve and higher ultimate attainment for the highly skilled learners. Moreover, we established that cortical connectivity patterns and profiles of spectral power modulations over time differentiated L2 learners with various levels of language analytical abilities. Over the course of the task, the learning process seemed to be driven by whole-brain functional connectivity between neuronal assemblies achieved by means of communication in the beta band frequency. On a shorter time-scale, increasing proficiency on the AGL task appeared to be supported by stronger local synchronisation within the right hemisphere regions. Finally, we observed that the highly skilled learners might have exerted less mental effort, or reduced attention for the task at hand once the learning was achieved, as evidenced by the higher alpha band power.

Functional connectivity of the cortical network supporting statistical learning in musicians and non-musicians: an MEG study

Statistical learning is a cognitive process of great importance for the detection and representation of environmental regularities. Complex cognitive processes such as statistical learning usually emerge as a result of the activation of widespread cortical areas functioning in dynamic networks. The present study investigated the cortical large-scale network supporting statistical learning of tone sequences in humans. The reorganization of this network related to musical expertise was assessed via a cross-sectional comparison of a group of musicians to a group of non-musicians. The cortical responses to a statistical learning paradigm incorporating an oddball approach were measured via Magnetoencephalographic (MEG) recordings. Large-scale connectivity of the cortical activity was calculated via a statistical comparison of the estimated transfer entropy in the sources' activity. Results revealed the functional architecture of the network supporting the processing of statistical learning, highlighting the prominent role of informational processing pathways that bilaterally connect superior temporal and intraparietal sources with the left IFG. Musical expertise is related to extensive reorganization of this network, as the group of musicians showed a network comprising of more widespread and distributed cortical areas as well as enhanced global efficiency and increased contribution of additional temporal and frontal sources in the information processing pathway.

Possible neural oscillatory mechanisms underlying learning

In response to Voelker et al. (this issue), we argue for a wide array of neural oscillatory mechanisms underlying learning and practice. While the authors propose frontal theta power as the basis for learning-induced neuroplasticity, we believe that the temporal dynamics of other frequency bands, together with their synchronization properties can offer a fuller account of the neurophysiological changes occurring in the brain during cognitive tasks.

Words, rules, and mechanisms of language acquisition

We review recent artificial language learning studies, especially those following Endress and Bonatti (Endress AD, Bonatti LL. Rapid learning of syllable classes from a perceptually continuous speech stream. Cognition 2007, 105:247-299), suggesting that humans can deploy a variety of learning mechanisms to acquire artificial languages. Several experiments provide evidence for multiple learning mechanisms that can be deployed in fluent speech: one mechanism encodes the positions of syllables within words and can be used to extract generalization, while the other registers co-occurrence statistics of syllables and can be used to break a continuum into its components. We review dissociations between these mechanisms and their potential role in language acquisition. We then turn to recent criticisms of the multiple mechanisms hypothesis and show that they are inconsistent with the available data. Our results suggest that artificial and natural language learning is best understood by dissecting the underlying specialized learning abilities, and that these data provide a rare opportunity to link important language phenomena to basic psychological mechanisms. For further resources related to this article, please visit the WIREs website.

Prosodic cues enhance rule learning by changing speech segmentation mechanisms

Prosody has been claimed to have a critical role in the acquisition of grammatical information from speech. The exact mechanisms by which prosodic cues enhance learning are fully unknown. Rules from language often require the extraction of non-adjacent dependencies (e.g., he plays, he sings, he speaks). It has been proposed that pauses enhance learning because they allow computing non-adjacent relations helping word segmentation by removing the need to compute adjacent computations. So far only indirect evidence from behavioral and electrophysiological measures comparing learning effects after exposure to speech with and without pauses support this claim. By recording event-related potentials during the acquisition process of artificial languages with and without pauses between words with embedded non-adjacent rules we provide direct evidence on how the presence of pauses modifies the way speech is processed during learning to enhance segmentation and rule generalization. The electrophysiological results indicate that pauses as short as 25 ms attenuated the N1 component irrespective of whether learning was possible or not. In addition, a P2 enhancement was present only when learning of non-adjacent dependencies was possible. The overall results support the claim that the simple presence of subtle pauses changed the segmentation mechanism used reflected in an exogenously driven N1 component attenuation and improving segmentation at the behavioral level. This effect can be dissociated from the endogenous P2 enhancement that is observed irrespective of the presence of pauses whenever non-adjacent dependencies are learned.

Finding words and word structure in artificial speech: the development of infants' sensitivity to morphosyntactic regularities

To achieve language proficiency, infants must find the building blocks of speech and master the rules governing their legal combinations. However, these problems are linked: words are also built according to rules. Here, we explored early morphosyntactic sensitivity by testing when and how infants could find either words or within-word structure in artificial speech snippets embodying properties of morphological constructions. We show that 12-month-olds use statistical relationships between syllables to extract words from continuous streams, but find word-internal regularities only if the streams are segmented. Seven-month-olds fail both tasks. Thus, 12-month-olds infants possess the resources to analyze the internal composition of words if the speech contains segmentation information. However, 7-month-old infants may not possess them, although they can track several statistical relations. This developmental difference suggests that morphosyntactic sensitivity may require computational resources extending beyond the detection of simple statistics.

ERPs recorded during early second language exposure predict syntactic learning

Millions of adults worldwide are faced with the task of learning a second language (L2). Understanding the neural mechanisms that support this learning process is an important area of scientific inquiry. However, most previous studies on the neural mechanisms underlying L2 acquisition have focused on characterizing the results of learning, relying upon end-state outcome measures in which learning is assessed after it has occurred, rather than on the learning process itself. In this study, we adopted a novel and more direct approach to investigate neural mechanisms engaged during L2 learning, in which we recorded ERPs from beginning adult learners as they were exposed to an unfamiliar L2 for the first time. Learners' proficiency in the L2 was then assessed behaviorally using a grammaticality judgment task, and ERP data acquired during initial L2 exposure were sorted as a function of performance on this task. High-proficiency learners showed a larger N100 effect to open-class content words compared with closed-class function words, whereas low-proficiency learners did not show a significant N100 difference between open- and closed-class words. In contrast, amplitude of the N400 word category effect correlated with learners' L2 comprehension, rather than predicting syntactic learning. Taken together, these results indicate that learners who spontaneously direct greater attention to open- rather than closed-class words when processing L2 input show better syntactic learning, suggesting a link between selective attention to open-class content words and acquisition of basic morphosyntactic rules. These findings highlight the importance of selective attention mechanisms for L2 acquisition.

Conscious auditory perception related to long-range synchrony of gamma oscillations

While the role of synchronized oscillatory activity in the gamma-band frequency range for conscious perception is well established in the visual domain, there is limited evidence concerning neurophysiological mechanisms in conscious auditory perception. In the current study, we addressed this issue with 64-channel EEG and a dichotic listening (DL) task in twenty-five healthy participants. The typical finding of DL is a more frequent conscious perception of the speech syllable presented to the right ear (RE), which is attributed to the supremacy of the contralateral pathways running from the RE to the speech-dominant left hemisphere. In contrast, the left ear (LE) input initially accesses the right hemisphere and needs additional transfer via interhemispheric pathways before it is processed in the left hemisphere. Using lagged phase synchronization (LPS) analysis and eLORETA source estimation we examined the functional connectivity between right and left primary and secondary auditory cortices in the main frequency bands (delta, theta, alpha, beta, gamma) during RE/LE-reports. Interhemispheric LPS between right and left primary and secondary auditory cortices was specifically increased in the gamma-band range, when participants consciously perceived the syllable presented to the LE. Our results suggest that synchronous gamma oscillations are involved in interhemispheric transfer of auditory information.

Words and possible words in early language acquisition

In order to acquire language, infants must extract its building blocks-words-and master the rules governing their legal combinations from speech. These two problems are not independent, however: words also have internal structure. Thus, infants must extract two kinds of information from the same speech input. They must find the actual words of their language. Furthermore, they must identify its possible words, that is, the sequences of sounds that, being morphologically well formed, could be words. Here, we show that infants' sensitivity to possible words appears to be more primitive and fundamental than their ability to find actual words. We expose 12- and 18-month-old infants to an artificial language containing a conflict between statistically coherent and structurally coherent items. We show that 18-month-olds can extract possible words when the familiarization stream contains marks of segmentation, but cannot do so when the stream is continuous. Yet, they can find actual words from a continuous stream by computing statistical relationships among syllables. By contrast, 12-month-olds can find possible words when familiarized with a segmented stream, but seem unable to extract statistically coherent items from a continuous stream that contains minimal conflicts between statistical and structural information. These results suggest that sensitivity to word structure is in place earlier than the ability to analyze distributional information. The ability to compute nontrivial statistical relationships becomes fully effective relatively late in development, when infants have already acquired a considerable amount of linguistic knowledge. Thus, mechanisms for structure extraction that do not rely on extensive sampling of the input are likely to have a much larger role in language acquisition than general-purpose statistical abilities.

Emergence in the central nervous system

"Emergence" is an idea that has received much attention in consciousness literature, but it is difficult to find characterizations of that concept which are both specific and useful. I will precisely define and characterize a type of epistemic ("weak") emergence and show that it is a property of some neural circuits throughout the CNS, on micro-, meso- and macroscopic levels. I will argue that possession of this property can result in profoundly altered neural dynamics on multiple levels in cortex and other systems. I will first describe emergent neural entities (ENEs) abstractly. I will then show how ENEs function specifically and concretely, and demonstrate some implications of this type of emergence for the CNS.

Different brain potentials evoked at distinct phases of rule learning

The neural mechanisms of rule learning are of interest to cognitive neuroscientists, but the time course of rule induction and the related brain potential remain unclear. In this study, event-related brain potentials (ERPs) were measured during the distinct phases of rule induction. Participants in two experiments were presented with a series of Arabic numbers and were asked to detect the hidden rules. The ERP results revealed that (a) the rule-discovery trials elicited a larger P3 component than the nondiscovery trials, reflecting the initial identification of the regularity of number series, and (b) when a new instance was incongruent with the previously acquired rule, a larger N2 and enhanced late positive component were elicited, reflecting the process of mismatch detection and the updating of working memory context.

Theta-modulated gamma-band synchronization among activated regions during a verb generation task

Expressive language is complex and involves processing within a distributed network of cortical regions. Functional MRI and magnetoencephalography (MEG) have identified brain areas critical for expressive language, but how these regions communicate across the network remains poorly understood. It is thought that synchronization of oscillations between neural populations, particularly at a gamma rate (>30 Hz), underlies functional integration within cortical networks. Modulation of gamma rhythms by theta-band oscillations (4–8 Hz) has been proposed as a mechanism for the integration of local cell coalitions into large-scale networks underlying cognition and perception. The present study tested the hypothesis that these oscillatory mechanisms of functional integration were present within the expressive language network. We recorded MEG while subjects performed a covert verb generation task. We localized activated cortical regions using beamformer analysis, calculated inter-regional phase locking between activated areas, and measured modulation of inter-regional gamma synchronization by theta phase. The results show task-dependent gamma-band synchronization among regions activated during the performance of the verb generation task, and we provide evidence that these transient and periodic instances of high-frequency connectivity were modulated by the phase of cortical theta oscillations. These findings suggest that oscillatory synchronization and cross-frequency interactions are mechanisms for functional integration among distributed brain areas supporting expressive language processing.

Musical expertise and statistical learning of musical and linguistic structures

Adults and infants can use the statistical properties of syllable sequences to extract words from continuous speech. Here we present a review of a series of electrophysiological studies investigating (1) Speech segmentation resulting from exposure to spoken and sung sequences (2) The extraction of linguistic versus musical information from a sung sequence (3) Differences between musicians and non-musicians in both linguistic and musical dimensions. The results show that segmentation is better after exposure to sung compared to spoken material and moreover, that linguistic structure is better learned than the musical structure when using sung material. In addition, musical expertise facilitates the learning of both linguistic and musical structures. Finally, an electrophysiological approach, which directly measures brain activity, appears to be more sensitive than a behavioral one.