Clinical neurophysiology of language: The MEG approach

Spectrotemporal cortical dynamics and semantic control during sentence completion

OBJECTIVE

To investigate cortical oscillations during a sentence completion task (SC) using magnetoencephalography (MEG), focusing on the semantic control network (SCN), its leftward asymmetry, and the effects of semantic control load.

METHODS

Twenty right-handed adults underwent MEG while performing SC, consisting of low cloze (LC: multiple responses) and high cloze (HC: single response) stimuli. Spectrotemporal power modulations as event-related synchronizations (ERS) and desynchronizations (ERD) were analyzed: first, at the whole-brain level; second, in key SCN regions, posterior middle/inferior temporal gyri (pMTG/ITG) and inferior frontal gyri (IFG), under different semantic control loads.

RESULTS

Three cortical response patterns emerged: early (0-200 ms) theta-band occipital ERS; intermediate (200-700 ms) semantic network alpha/beta-band ERD; late (700-3000 ms) dorsal language stream alpha/beta/gamma-band ERD. Under high semantic control load (LC), pMTG/ITG showed prolonged left-sided engagement (ERD) and right-sided inhibition (ERS). Left IFG exhibited heightened late (2500-2550 ms) beta-band ERD with increased semantic control load (LC vs. HC).

CONCLUSIONS

SC involves distinct cortical responses and depends on the left IFG and asymmetric engagement of the pMTG/ITG for semantic control.

SIGNIFICANCE

Future use of SC in neuromagnetic preoperative language mapping and for understanding the pathophysiology of language disorders in neurological conditions.

Clinical recommendations for conducting pediatric functional language and memory mapping during the phase I epilepsy presurgical workup

Objective: Pediatric epilepsy surgery effectively controls seizures but may risk cognitive, language, or memory decline. Historically, the intra-carotid anesthetic procedure (IAP or Wada Test) was pivotal for language and memory function. However, advancements in noninvasive mapping, notably functional magnetic resonance imaging (fMRI), have transformed clinical practice, reducing IAP's role in presurgical evaluations. Method: We conducted a critical narrative review on mapping technologies, including factors to consider for discordance. Results: Neuropsychological findings suggest that if pre-surgery function remains intact and the surgery targets the eloquent cortex, there is a high chance for decline. Memory and language decline are particularly pronounced post-left anterior temporal lobe resection (ATL), making presurgical cognitive assessment crucial for predicting postoperative outcomes. However, the risk of functional decline is not always clear - particularly with higher rates of atypical organization in pediatric epilepsy patients and discordant findings from cognitive mapping. We found little research to date on the use of IAP and other newer technologies for lateralization/localization in pediatric epilepsy. Based on this review, we introduce an IAP decision tree to systematically navigate discordance in IAP decisions for epilepsy presurgical workup. Conclusions: Future research should be aimed at pediatric populations to improve the precision of functional mapping, determine which methods predict post-surgical deficits and then create evidence-based practice guidelines to standardize mapping procedures. Explicit directives are needed for resolving conflicts between developing mapping procedures and established clinical measures. The proposed decision tree is the first step to standardize when to consider IAP or invasive mapping, in coordination with the multidisciplinary epilepsy surgical team.

Characterizing directional dynamics of semantic prediction based on inter-regional temporal generalization

The event-related potential/field component N400(m) has been widely used as a neural index for semantic prediction. It has long been hypothesized that feedback information from inferior frontal areas plays a critical role in generating the N400. However, due to limitations in causal connectivity estimation, direct testing of this hypothesis has remained difficult. Here, magnetoencephalography (MEG) data was obtained during a classic N400 paradigm where the semantic predictability of a fixed target noun was manipulated in simple German sentences. To estimate causality, we implemented a novel approach based on machine learning and temporal generalization to estimate the effect of inferior frontal gyrus (IFG) on temporal areas. In this method, a support vector machine (SVM) classifier is trained on each time point of the neural activity in IFG to classify less predicted (LP) and highly predicted (HP) nouns and then tested on all time points of superior/middle temporal sub-regions activity (and vice versa, to establish spatio-temporal evidence for or against causality). The decoding accuracy was significantly above chance level when the classifier was trained on IFG activity and tested on future activity in superior and middle temporal gyrus (STG/MTG). The results present new evidence for a model predictive speech comprehension where predictive IFG activity is fed back to shape subsequent activity in STG/MTG, implying a feedback mechanism in N400 generation. In combination with the also observed strong feedforward effect from left STG/MTG to IFG, our findings provide evidence of dynamic feedback and feedforward influences between IFG and temporal areas during N400 generation.

Magnetoencephalography Language Mapping Using Auditory Memory Retrieval and Silent Repeating Task

PURPOSE

The study aims to (1) examine the spatiotemporal map of magnetoencephalography-evoked responses during an Auditory Memory Retrieval and Silent Repeating (AMRSR) task, and determine the hemispheric dominance for language, and (2) evaluate the accuracy of the AMRSR task in Wernicke and Broca area localization.

METHODS

In 30 patients with brain tumors and/or epilepsies, the AMRSR task was used to evoke magnetoencephalography responses. We applied Fast VEctor-based Spatial-Temporal Analyses with minimum L1-norm source imaging method to the magnetoencephalography responses for localizing the brain areas evoked by the AMRSR task.

RESULTS

The Fast-VEctor-based Spatial-Temporal Analysis found consistent activation in the posterior superior temporal gyrus around 300 to 500 ms, and another activation in the frontal cortex (pars opercularis and/or pars triangularis) around 600 to 900 ms, which were localized to the Wernicke area (BA 22) and Broca area (BA 44 and BA 45), respectively. The language-dominant hemispheric laterization elicited by the AMRSR task was comparable with the result from an Auditory Dichotic task result given to the same patient, with the exception that AMRSR is more sensitive on bilateral language laterization cases on finding the Wernicke and Broca areas.

CONCLUSIONS

For all patients who successfully finished the AMRSR task, Fast-VEctor-based Spatial-Temporal Analysis could establish accurate and robust localizations of Broca and Wernicke area and determine hemispheric dominance. For subjects with normal auditory functionality, the AMRSR paradigm evaluation showed significant promise in providing reliable assessments of cerebral language dominance and language network localization.

Language MEG predicts postoperative verbal memory change in left mesial temporal lobe epilepsy

OBJECTIVE

To clarify whether preoperative language magnetoencephalography (MEG) predicts postoperative verbal memory (VM) changes in left mesial temporal lobe epilepsy (LMTLE).

METHODS

We reviewed 18 right-handed patients with LMTLE who underwent anterior temporal lobectomy or selective amygdala hippocampectomy, 12 with (HS+) and 6 without hippocampal sclerosis (HS-). Patients underwent neuropsychological assessment before and after surgery. MEG was measured with an auditory verbal learning task in patients preoperatively and in 15 right-handed controls. Dynamic statistical parametric mapping (dSPM) was used for source imaging of task-related activity. Language laterality index (LI) was calculated by z-score of dSPM in language-related regions. LI in the region of HS+ and HS- was compared to controls. The correlation between LI and postoperative VM change was assessed in HS+ and HS-.

RESULTS

Preoperative LI in supramarginal gyrus showed greater right-shifted lateralization in both HS+ and HS- than in controls. Right-shifted LI in supramarginal gyrus was correlated with postoperative VM increase in HS+ (p = 0.019), but not in HS-.

CONCLUSIONS

Right-shifted language lateralization in dSPM of MEG signals may predict favorable VM outcome in HS+ of LMTLE.

SIGNIFICANCE

Findings warrant further investigation of the relation between regional language laterality index and postoperative verbal memory changes.

Audiotactile Stimulation Can Improve Syllable Discrimination through Multisensory Integration in the Theta Frequency Band

Syllables are an essential building block of speech. We recently showed that tactile stimuli linked to the perceptual centers of syllables in continuous speech can improve speech comprehension. The rate of syllables lies in the theta frequency range, between 4 and 8 Hz, and the behavioral effect appears linked to multisensory integration in this frequency band. Because this neural activity may be oscillatory, we hypothesized that a behavioral effect may also occur not only while but also after this activity has been evoked or entrained through vibrotactile pulses. Here, we show that audiotactile integration regarding the perception of single syllables, both on the neural and on the behavioral level, is consistent with this hypothesis. We first stimulated participants with a series of vibrotactile pulses and then presented them with a syllable in background noise. We show that, at a delay of 200 msec after the last vibrotactile pulse, audiotactile integration still occurred in the theta band and syllable discrimination was enhanced. Moreover, the dependence of both the neural multisensory integration as well as of the behavioral discrimination on the delay of the audio signal with respect to the last tactile pulse was consistent with a damped oscillation. In addition, the multisensory gain is correlated with the syllable discrimination score. Our results therefore evidence the role of the theta band in audiotactile integration and provide evidence that these effects may involve oscillatory activity that still persists after the tactile stimulation.

Language lateralization mapping (reversibly) masked by non-dominant focal epilepsy: a case report

Language lateralization in patients with focal epilepsy frequently diverges from the left-lateralized pattern that prevails in healthy right-handed people, but the mechanistic explanations are still a matter of debate. Here, we debate the complex interaction between focal epilepsy, language lateralization, and functional neuroimaging techniques by introducing the case of a right-handed patient with unaware focal seizures preceded by aphasia, in whom video-EEG and PET examination suggested the presence of focal cortical dysplasia in the right superior temporal gyrus, despite a normal structural MRI. The functional MRI for language was inconclusive, and the neuropsychological evaluation showed mild deficits in language functions. A bilateral stereo-EEG was proposed confirming the right superior temporal gyrus origin of seizures, revealing how ictal aphasia emerged only once seizures propagated to the left superior temporal gyrus and confirming, by cortical mapping, the left lateralization of the posterior language region. Stereo-EEG-guided radiofrequency thermocoagulations of the (right) focal cortical dysplasia not only reduced seizure frequency but led to the normalization of the neuropsychological assessment and the "restoring" of a classical left-lateralized functional MRI pattern of language. This representative case demonstrates that epileptiform activity in the superior temporal gyrus can interfere with the functioning of the contralateral homologous cortex and its associated network. In the case of presurgical evaluation in patients with epilepsy, this interference effect must be carefully taken into consideration. The multimodal language lateralization assessment reported for this patient further suggests the sensitivity of different explorations to this interference effect. Finally, the neuropsychological and functional MRI changes after thermocoagulations provide unique cues on the network pathophysiology of focal cortical dysplasia and the role of diverse techniques in indexing language lateralization in complex scenarios.

The effects of speech masking on neural tracking of acoustic and semantic features of natural speech

Listening environments contain background sounds that mask speech and lead to communication challenges. Sensitivity to slow acoustic fluctuations in speech can help segregate speech from background noise. Semantic context can also facilitate speech perception in noise, for example, by enabling prediction of upcoming words. However, not much is known about how different degrees of background masking affect the neural processing of acoustic and semantic features during naturalistic speech listening. In the current electroencephalography (EEG) study, participants listened to engaging, spoken stories masked at different levels of multi-talker babble to investigate how neural activity in response to acoustic and semantic features changes with acoustic challenges, and how such effects relate to speech intelligibility. The pattern of neural response amplitudes associated with both acoustic and semantic speech features across masking levels was U-shaped, such that amplitudes were largest for moderate masking levels. This U-shape may be due to increased attentional focus when speech comprehension is challenging, but manageable. The latency of the neural responses increased linearly with increasing background masking, and neural latency change associated with acoustic processing most closely mirrored the changes in speech intelligibility. Finally, tracking responses related to semantic dissimilarity remained robust until severe speech masking (-3 dB SNR). The current study reveals that neural responses to acoustic features are highly sensitive to background masking and decreasing speech intelligibility, whereas neural responses to semantic features are relatively robust, suggesting that individuals track the meaning of the story well even in moderate background sound.

Test-retest reliability of electroencephalographic and magnetoencephalographic measures elicited during language tasks: A literature review

Electroencephalographic (EEG) and magnetoencephalographic (MEG) recordings during language processing can provide relevant insights on neuroplasticity in clinical populations (including patients with aphasia). To use EEG and MEG in a longitudinal way, the outcome measures should be consistent across time in healthy individuals. Therefore, the current study provides a review on the test-retest reliability of EEG and MEG measures elicited during language paradigms in healthy adults. PubMed, Web of Science and Embase were searched for relevant articles based on specific eligibility criteria. In total, 11 articles were included in this literature review. The test-retest reliability of the P1, N1 and P2 is systematically considered to be satisfactory, whereas findings are more variable for event-related potentials/fields occurring later in time. The within subject consistency of EEG and MEG measures during language processing can be influenced by multiple variables such as the stimulus presentation mode, the offline reference choice and the required amount of cognitive resources during the task. To conclude, most of the available results are favourable regarding the longitudinal use of EEG and MEG measures elicited during language paradigms in healthy young individuals. In view to the use of these techniques in patients with aphasia, future research should focus on whether the same findings apply to different age groups.

A multimodal imaging approach to foreign accent syndrome. A case report

This article describes a case of Foreign accent syndrome (FAS) in an Italian woman who developed a Canadian-like foreign accent without brain damage (functional FAS). The patient underwent an in-depth neuroimaging and (neuro)psychological evaluation. Language networks in the frontotemporal-parietal areas were typically activated bilaterally through fMRI and MEG assessments based on task-based data. Resting-state fMRI showed preserved connectivity between language areas. An obsessive-compulsive personality profile and mild anxiety were found, suggesting psychological and psychiatric factors may be relevant. Accordingly with our findings, multimodal imaging is beneficial to understand FAS neurological and functional etiologies.

Common Neuroanatomical Substrate of Cholinergic Pathways and Language-Related Brain Regions as an Explanatory Framework for Evaluating the Efficacy of Cholinergic Pharmacotherapy in Post-Stroke Aphasia: A Review

Despite the relative scarcity of studies focusing on pharmacotherapy in aphasia, there is evidence in the literature indicating that remediation of language disorders via pharmaceutical agents could be a promising aphasia treatment option. Among the various agents used to treat chronic aphasic deficits, cholinergic drugs have provided meaningful results. In the current review, we focused on published reports investigating the impact of acetylcholine on language and other cognitive disturbances. It has been suggested that acetylcholine plays an important role in neuroplasticity and is related to several aspects of cognition, such as memory and attention. Moreover, cholinergic input is diffused to a wide network of cortical areas, which have been associated with language sub-processes. This could be a possible explanation for the positive reported outcomes of cholinergic drugs in aphasia recovery, and specifically in distinct language processes, such as naming and comprehension, as well as overall communication competence. However, evidence with regard to functional alterations in specific brain areas after pharmacotherapy is rather limited. Finally, despite the positive results derived from the relevant studies, cholinergic pharmacotherapy treatment in post-stroke aphasia has not been widely implemented. The present review aims to provide an overview of the existing literature in the common neuroanatomical substrate of cholinergic pathways and language related brain areas as a framework for interpreting the efficacy of cholinergic pharmacotherapy interventions in post-stroke aphasia, following an integrated approach by converging evidence from neuroanatomy, neurophysiology, and neuropsychology.

Brainprints: identifying individuals from magnetoencephalograms

Magnetoencephalography (MEG) is used to study a wide variety of cognitive processes. Increasingly, researchers are adopting principles of open science and releasing their MEG data. While essential for reproducibility, sharing MEG data has unforeseen privacy risks. Individual differences may make a participant identifiable from their anonymized recordings. However, our ability to identify individuals based on these individual differences has not yet been assessed. Here, we propose interpretable MEG features to characterize individual difference. We term these features brainprints (brain fingerprints). We show through several datasets that brainprints accurately identify individuals across days, tasks, and even between MEG and Electroencephalography (EEG). Furthermore, we identify consistent brainprint components that are important for identification. We study the dependence of identifiability on the amount of data available. We also relate identifiability to the level of preprocessing and the experimental task. Our findings reveal specific aspects of individual variability in MEG. They also raise concerns about unregulated sharing of brain data, even if anonymized.

Evaluating the Use of Cortical Entrainment to Measure Atypical Speech Processing: A Systematic Review

BACKGROUND

Cortical entrainment has emerged as promising means for measuring continuous speech processing in young, neurotypical adults. However, its utility for capturing atypical speech processing has not been systematically reviewed.

OBJECTIVES

Synthesize evidence regarding the merit of measuring cortical entrainment to capture atypical speech processing and recommend avenues for future research.

METHOD

We systematically reviewed publications investigating entrainment to continuous speech in populations with auditory processing differences.

RESULTS

In the 25 publications reviewed, most studies were conducted on older and/or hearing-impaired adults, for whom slow-wave entrainment to speech was often heightened compared to controls. Research conducted on populations with neurodevelopmental disorders, in whom slow-wave entrainment was often reduced, was less common. Across publications, findings highlighted associations between cortical entrainment and speech processing performance differences.

CONCLUSIONS

Measures of cortical entrainment offer useful means of capturing speech processing differences and future research should leverage them more extensively when studying populations with neurodevelopmental disorders.

Intracranial recording in patients with aphasia using nanomaterial-based flexible electronics: promises and challenges

In recent years, researchers have studied how nanotechnology could enhance neuroimaging techniques. The application of nanomaterial-based flexible electronics has the potential to advance conventional intracranial electroencephalography (iEEG) by utilising brain-compatible soft nanomaterials. The resultant technique has significantly high spatial and temporal resolution, both of which enhance the localisation of brain functions and the mapping of dynamic language processing. This review presents findings on aphasia, an impairment in language and communication, and discusses how different brain imaging techniques, including positron emission tomography, magnetic resonance imaging, and iEEG, have advanced our understanding of the neural networks underlying language and reading processing. We then outline the strengths and weaknesses of iEEG in studying human cognition and the development of intracranial recordings that use brain-compatible flexible electrodes. We close by discussing the potential advantages and challenges of future investigations adopting nanomaterial-based flexible electronics for intracranial recording in patients with aphasia.

Children at risk for dyslexia show deficient left-hemispheric memory representations for new spoken word forms

Developmental dyslexia is a specific learning disorder with impairments in reading and spelling acquisition. Apart from literacy problems, dyslexics show inefficient speech encoding and deficient novel word learning, with underlying problems in phonological processing and learning. These problems have been suggested to be related to deficient specialization of the left hemisphere for language processing. To examine this possibility, we tracked with magnetoencephalography (MEG) the activation of the bilateral temporal cortices during formation of neural memory traces for new spoken word forms in 7-8-year-old children with high familial dyslexia risk and in controls. The at-risk children improved equally to their peers in overt repetition of recurring new word forms, but were poorer in explicit recognition of the recurring word forms. Both groups showed reduced activation for the recurring word forms 400-1200 ms after word onset in the right auditory cortex, replicating the results of our previous study on typically developing children (Nora et al., 2017, Children show right-lateralized effects of spoken word-form learning. PLoS ONE 12(2): e0171034). However, only the control group consistently showed a similar reduction of activation for recurring word forms in the left temporal areas. The results highlight the importance of left-hemispheric phonological processing for efficient phonological representations and its disruption in dyslexia.

Dynamic Time-Locking Mechanism in the Cortical Representation of Spoken Words

Human speech has a unique capacity to carry and communicate rich meanings. However, it is not known how the highly dynamic and variable perceptual signal is mapped to existing linguistic and semantic representations. In this novel approach, we used the natural acoustic variability of sounds and mapped them to magnetoencephalography (MEG) data using physiologically-inspired machine-learning models. We aimed at determining how well the models, differing in their representation of temporal information, serve to decode and reconstruct spoken words from MEG recordings in 16 healthy volunteers. We discovered that dynamic time-locking of the cortical activation to the unfolding speech input is crucial for the encoding of the acoustic-phonetic features of speech. In contrast, time-locking was not highlighted in cortical processing of non-speech environmental sounds that conveyed the same meanings as the spoken words, including human-made sounds with temporal modulation content similar to speech. The amplitude envelope of the spoken words was particularly well reconstructed based on cortical evoked responses. Our results indicate that speech is encoded cortically with especially high temporal fidelity. This speech tracking by evoked responses may partly reflect the same underlying neural mechanism as the frequently reported entrainment of the cortical oscillations to the amplitude envelope of speech. Furthermore, the phoneme content was reflected in cortical evoked responses simultaneously with the spectrotemporal features, pointing to an instantaneous transformation of the unfolding acoustic features into linguistic representations during speech processing.

Taking the sublexical route: brain dynamics of reading in the semantic variant of primary progressive aphasia

Reading aloud requires mapping an orthographic form to a phonological one. The mapping process relies on sublexical statistical regularities (e.g. 'oo' to |uː|) or on learned lexical associations between a specific visual form and a series of sounds (e.g. yacht to/jɑt/). Computational, neuroimaging, and neuropsychological evidence suggest that sublexical, phonological and lexico-semantic processes rely on partially distinct neural substrates: a dorsal (occipito-parietal) and a ventral (occipito-temporal) route, respectively. Here, we investigated the spatiotemporal features of orthography-to-phonology mapping, capitalizing on the time resolution of magnetoencephalography and the unique clinical model offered by patients with semantic variant of primary progressive aphasia (svPPA). Behaviourally, patients with svPPA manifest marked lexico-semantic impairments including difficulties in reading words with exceptional orthographic to phonological correspondence (irregular words). Moreover, they present with focal neurodegeneration in the anterior temporal lobe, affecting primarily the ventral, occipito-temporal, lexical route. Therefore, this clinical population allows for testing of specific hypotheses on the neural implementation of the dual-route model for reading, such as whether damage to one route can be compensated by over-reliance on the other. To this end, we reconstructed and analysed time-resolved whole-brain activity in 12 svPPA patients and 12 healthy age-matched control subjects while reading irregular words (e.g. yacht) and pseudowords (e.g. pook). Consistent with previous findings that the dorsal route is involved in sublexical, phonological processes, in control participants we observed enhanced neural activity over dorsal occipito-parietal cortices for pseudowords, when compared to irregular words. This activation was manifested in the beta-band (12-30 Hz), ramping up slowly over 500 ms after stimulus onset and peaking at ∼800 ms, around response selection and production. Consistent with our prediction, svPPA patients did not exhibit this temporal pattern of neural activity observed in controls this contrast. Furthermore, a direct comparison of neural activity between patients and controls revealed a dorsal spatiotemporal cluster during irregular word reading. These findings suggest that the sublexical/phonological route is involved in processing both irregular and pseudowords in svPPA. Together these results provide further evidence supporting a dual-route model for reading aloud mediated by the interplay between lexico-semantic and sublexical/phonological neurocognitive systems. When the ventral route is damaged, as in the case of neurodegeneration affecting the anterior temporal lobe, partial compensation appears to be possible by over-recruitment of the slower, serial attention-dependent, dorsal one.

Pearl and pitfalls in brain functional analysis by event-related potentials: a narrative review by the Italian Psychophysiology and Cognitive Neuroscience Society on methodological limits and clinical reliability-part II

This review focuses on new and/or less standardized event-related potentials methods, in order to improve their knowledge for future clinical applications. The olfactory event-related potentials (OERPs) assess the olfactory functions in time domain, with potential utility in anosmia and degenerative diseases. The transcranial magnetic stimulation-electroencephalography (TMS-EEG) could support the investigation of the intracerebral connections with very high temporal discrimination. Its application in the diagnosis of disorders of consciousness has achieved recent confirmation. Magnetoencephalography (MEG) and event-related fields (ERF) could improve spatial accuracy of scalp signals, with potential large application in pre-surgical study of epileptic patients. Although these techniques have methodological limits, such as high inter- and intraindividual variability and high costs, their diffusion among researchers and clinicians is hopeful, pending their standardization.

Neural dynamics of sentiment processing during naturalistic sentence reading

When we read, our eyes move through the text in a series of fixations and high-velocity saccades to extract visual information. This process allows the brain to obtain meaning, e.g., about sentiment, or the emotional valence, expressed in the written text. How exactly the brain extracts the sentiment of single words during naturalistic reading is largely unknown. This is due to the challenges of naturalistic imaging, which has previously led researchers to employ highly controlled, timed word-by-word presentations of custom reading materials that lack ecological validity. Here, we aimed to assess the electrical neural correlates of word sentiment processing during naturalistic reading of English sentences. We used a publicly available dataset of simultaneous electroencephalography (EEG), eye-tracking recordings, and word-level semantic annotations from 7129 words in 400 sentences (Zurich Cognitive Language Processing Corpus; Hollenstein et al., 2018). We computed fixation-related potentials (FRPs), which are evoked electrical responses time-locked to the onset of fixations. A general linear mixed model analysis of FRPs cleaned from visual- and motor-evoked activity showed a topographical difference between the positive and negative sentiment condition in the 224-304 ​ms interval after fixation onset in left-central and right-posterior electrode clusters. An additional analysis that included word-, phrase-, and sentence-level sentiment predictors showed the same FRP differences for the word-level sentiment, but no additional FRP differences for phrase- and sentence-level sentiment. Furthermore, decoding analysis that classified word sentiment (positive or negative) from sentiment-matched 40-trial average FRPs showed a 0.60 average accuracy (95% confidence interval: [0.58, 0.61]). Control analyses ruled out that these results were based on differences in eye movements or linguistic features other than word sentiment. Our results extend previous research by showing that the emotional valence of lexico-semantic stimuli evoke a fast electrical neural response upon word fixation during naturalistic reading. These results provide an important step to identify the neural processes of lexico-semantic processing in ecologically valid conditions and can serve to improve computer algorithms for natural language processing.

The visual speech head start improves perception and reduces superior temporal cortex responses to auditory speech

Visual information about speech content from the talker's mouth is often available before auditory information from the talker's voice. Here we examined perceptual and neural responses to words with and without this visual head start. For both types of words, perception was enhanced by viewing the talker's face, but the enhancement was significantly greater for words with a head start. Neural responses were measured from electrodes implanted over auditory association cortex in the posterior superior temporal gyrus (pSTG) of epileptic patients. The presence of visual speech suppressed responses to auditory speech, more so for words with a visual head start. We suggest that the head start inhibits representations of incompatible auditory phonemes, increasing perceptual accuracy and decreasing total neural responses. Together with previous work showing visual cortex modulation (Ozker et al., 2018b) these results from pSTG demonstrate that multisensory interactions are a powerful modulator of activity throughout the speech perception network.

Top-Down Predictions of Familiarity and Congruency in Audio-Visual Speech Perception at Neural Level

During speech perception, listeners rely on multimodal input and make use of both auditory and visual information. When presented with speech, for example syllables, the differences in brain responses to distinct stimuli are not, however, caused merely by the acoustic or visual features of the stimuli. The congruency of the auditory and visual information and the familiarity of a syllable, that is, whether it appears in the listener's native language or not, also modulates brain responses. We investigated how the congruency and familiarity of the presented stimuli affect brain responses to audio-visual (AV) speech in 12 adult Finnish native speakers and 12 adult Chinese native speakers. They watched videos of a Chinese speaker pronouncing syllables (/pa/, /pha/, /ta/, /tha/, /fa/) during a magnetoencephalography (MEG) measurement where only /pa/ and /ta/ were part of Finnish phonology while all the stimuli were part of Chinese phonology. The stimuli were presented in audio-visual (congruent or incongruent), audio only, or visual only conditions. The brain responses were examined in five time-windows: 75-125, 150-200, 200-300, 300-400, and 400-600 ms. We found significant differences for the congruency comparison in the fourth time-window (300-400 ms) in both sensor and source level analysis. Larger responses were observed for the incongruent stimuli than for the congruent stimuli. For the familiarity comparisons no significant differences were found. The results are in line with earlier studies reporting on the modulation of brain responses for audio-visual congruency around 250-500 ms. This suggests a much stronger process for the general detection of a mismatch between predictions based on lip movements and the auditory signal than for the top-down modulation of brain responses based on phonological information.

Toward Decoding Selective Attention From Single-Trial EEG Data in Cochlear Implant Users

Previous results showed that it is possible to decode an attended speech source from EEG data via the reconstruction of the speech envelope in normal hearing (NH) listeners. However, so far it is unknown that how the performance of such a decoder is affected by the decrease in spectral resolution and the electrical artifacts introduced by a cochlear implant (CI) in users of these prostheses. NH listeners and bilateral CI users participated in the present study. Speeches from two audio books, one uttered by a male voice and one by a female voice, were presented to NH listeners and CI users. Participants were instructed to attend to one of the two speech streams presented dichotically while a 96-channel EEG was recorded. Speech envelope reconstruction from the EEG data was obtained by training decoders using a regularized least square estimation method. Decoding accuracy was defined as the percentage of accurately reconstructed trials for each subject. For NH listeners, the experiment was repeated using a vocoder to reduce spectral resolution and simulate speech perception with a CI in NH listeners. The results showed a decoding accuracy of 80.9 % using the original sound files in NH listeners. The performance dropped to 73.2 % in the vocoder condition and to 71.5 % in the group of CI users. In sum, although the accuracy drops when the spectral resolution becomes worse, the results show the feasibility to decode the attended sound source in NH listeners with a vocoder simulation, and even in CI users, albeit more training data are needed.

The Functional Neuroanatomy of Letter-Speech Sound Integration and Its Relation to Brain Abnormalities in Developmental Dyslexia

This mini-review provides a comparison of the brain systems associated with developmental dyslexia and the brain systems associated with letter-speech sound (LSS) integration. First, the findings on the functional neuroanatomy of LSS integration are summarized in order to obtain a comprehensive overview of the brain regions involved in this process. To this end, neurocognitive studies investigating LSS integration in both normal and abnormal reading development are taken into account. The neurobiological basis underlying LSS integration is consequently compared with existing neurocognitive models of functional and structural brain abnormalities in developmental dyslexia-focusing on superior temporal and occipito-temporal (OT) key regions. Ultimately, the commonalities and differences between the brain systems engaged by LSS integration and the brain systems identified with abnormalities in developmental dyslexia are investigated. This comparison will add to our understanding of the relation between LSS integration and normal and abnormal reading development.

Investigating the fit between phonological feature systems and brain responses to speech using EEG

This paper describes a technique to assess the correspondence between patterns of similarity in the brain's response to speech sounds and the patterns of similarity encoded in phonological feature systems, by quantifying the recoverability of phonological features from the neural data using supervised learning. The technique is applied to EEG recordings collected during passive listening to consonant-vowel syllables. Three published phonological feature systems are compared, and are shown to differ in their ability to recover certain speech sound contrasts from the neural data. For the phonological feature system that best reflects patterns of similarity in the neural data, a leave-one-out analysis indicates some consistency across subjects in which features have greatest impact on the fit, but considerable across-subject heterogeneity remains in the rank ordering of features in this regard.

MEG imaging of recurrent gliomas reveals functional plasticity of hemispheric language specialization

In patients with gliomas, changes in hemispheric specialization for language determined by magnetoencephalography (MEG) were analyzed to elucidate the impact of treatment and tumor recurrence on language networks. Demonstration of reorganization of language networks in these patients has significant implications on the prevention of postoperative functional loss and recovery. Whole-brain activity during an auditory verb generation task was estimated from MEG recordings in a group of 73 patients with recurrent gliomas. Hemisphere of language dominance was estimated using the language laterality index (LI), a measure derived from the task. The initial scan was performed prior to resection; patients subsequently underwent surgery and adjuvant treatment. A second scan was performed upon recurrence prior to repeat resection. The relationship between the shift in LI between scans and demographics, anatomic location, pathology, and adjuvant treatment was analyzed. Laterality shifts were observed between scans; the median percent change was 29.1% across all patients. Laterality shift magnitude and relative direction were associated with the initial position of language dominance; patients with increased lateralization experienced greater shifts than those presenting more bilateral representation. A change in LI from left or right to bilateral (or vice versa) occurred in 23.3% of patients; complete switch occurred in 5.5% of patients. Patients with tumors within the language-dominant hemisphere experienced significantly greater shifts than those with contralateral tumors. The majority of patients with glioma experience shifts in language network organization over time which correlate with the relative position of language lateralization and tumor location.

An interactive model of auditory-motor speech perception

Mounting evidence indicates a role in perceptual decoding of speech for the dorsal auditory stream connecting between temporal auditory and frontal-parietal articulatory areas. The activation time course in auditory, somatosensory and motor regions during speech processing is seldom taken into account in models of speech perception. We critically review the literature with a focus on temporal information, and contrast between three alternative models of auditory-motor speech processing: parallel, hierarchical, and interactive. We argue that electrophysiological and transcranial magnetic stimulation studies support the interactive model. The findings reveal that auditory and somatomotor areas are engaged almost simultaneously, before 100 ms. There is also evidence of early interactions between auditory and motor areas. We propose a new interactive model of auditory-motor speech perception in which auditory and articulatory somatomotor areas are connected from early stages of speech processing. We also discuss how attention and other factors can affect the timing and strength of auditory-motor interactions and propose directions for future research.

IFCN-endorsed practical guidelines for clinical magnetoencephalography (MEG)

Magnetoencephalography (MEG) records weak magnetic fields outside the human head and thereby provides millisecond-accurate information about neuronal currents supporting human brain function. MEG and electroencephalography (EEG) are closely related complementary methods and should be interpreted together whenever possible. This manuscript covers the basic physical and physiological principles of MEG and discusses the main aspects of state-of-the-art MEG data analysis. We provide guidelines for best practices of patient preparation, stimulus presentation, MEG data collection and analysis, as well as for MEG interpretation in routine clinical examinations. In 2017, about 200 whole-scalp MEG devices were in operation worldwide, many of them located in clinical environments. Yet, the established clinical indications for MEG examinations remain few, mainly restricted to the diagnostics of epilepsy and to preoperative functional evaluation of neurosurgical patients. We are confident that the extensive ongoing basic MEG research indicates potential for the evaluation of neurological and psychiatric syndromes, developmental disorders, and the integrity of cortical brain networks after stroke. Basic and clinical research is, thus, paving way for new clinical applications to be identified by an increasing number of practitioners of MEG.

A simple magnetoencephalographic auditory paradigm may aid in confirming left-hemispheric language dominance in epilepsy patients

OBJECTIVE

The intracarotid amobarbital procedure (IAP) is the current "gold standard" in the preoperative assessment of language lateralization in epilepsy surgery candidates. It is, however, invasive and has several limitations. Here we tested a simple noninvasive language lateralization test performed with magnetoencephalography (MEG).

METHODS

We recorded auditory MEG responses to pairs of vowels and pure tones in 16 epilepsy surgery candidates who had undergone IAP. For each individual, we selected the pair of planar gradiometer sensors with the strongest N100m response to vowels in each hemisphere and-from the vector sum of signals of this gradiometer pair-calculated the vowel/tone amplitude ratio in the left (L) and right (R) hemisphere and, subsequently, the laterality index: LI = (L-R)/(L+R). In addition to the analysis using a single sensor pair, an alternative analysis was performed using averaged responses over 18 temporal sensor pairs in both hemispheres.

RESULTS

The laterality index did not correlate significantly with the lateralization data obtained from the IAP. However, an MEG pattern of stronger responses to vowels than tones in the left hemisphere and stronger responses to tones than vowels in the right hemisphere was associated with left-hemispheric language dominance in the IAP in all the six patients who showed this pattern. This results in a specificity of 100% and a sensitivity of 67% of this MEG pattern in predicting left-hemispheric language dominance (p = 0.01, Fisher's exact test). In the analysis using averaged responses over temporal channels, one additional patient who was left-dominant in IAP showed this particular MEG pattern, increasing the sensitivity to 78% (p = 0.003).

SIGNIFICANCE

This simple MEG paradigm shows promise in feasibly and noninvasively confirming left-hemispheric language dominance in epilepsy surgery candidates. It may aid in reducing the need for the IAP, if the results are confirmed in larger patient samples.

Large-scale functional networks connect differently for processing words and symbol strings

Reconfigurations of synchronized large-scale networks are thought to be central neural mechanisms that support cognition and behavior in the human brain. Magnetoencephalography (MEG) recordings together with recent advances in network analysis now allow for sub-second snapshots of such networks. In the present study, we compared frequency-resolved functional connectivity patterns underlying reading of single words and visual recognition of symbol strings. Word reading emphasized coherence in a left-lateralized network with nodes in classical perisylvian language regions, whereas symbol processing recruited a bilateral network, including connections between frontal and parietal regions previously associated with spatial attention and visual working memory. Our results illustrate the flexible nature of functional networks, whereby processing of different form categories, written words vs. symbol strings, leads to the formation of large-scale functional networks that operate at distinct oscillatory frequencies and incorporate task-relevant regions. These results suggest that category-specific processing should be viewed not so much as a local process but as a distributed neural process implemented in signature networks. For words, increased coherence was detected particularly in the alpha (8-13 Hz) and high gamma (60-90 Hz) frequency bands, whereas increased coherence for symbol strings was observed in the high beta (21-29 Hz) and low gamma (30-45 Hz) frequency range. These findings attest to the role of coherence in specific frequency bands as a general mechanism for integrating stimulus-dependent information across brain regions.

Converging Evidence From Electrocorticography and BOLD fMRI for a Sharp Functional Boundary in Superior Temporal Gyrus Related to Multisensory Speech Processing

Although humans can understand speech using the auditory modality alone, in noisy environments visual speech information from the talker’s mouth can rescue otherwise unintelligible auditory speech. To investigate the neural substrates of multisensory speech perception, we compared neural activity from the human superior temporal gyrus (STG) in two datasets. One dataset consisted of direct neural recordings (electrocorticography, ECoG) from surface electrodes implanted in epilepsy patients (this dataset has been previously published). The second dataset consisted of indirect measures of neural activity using blood oxygen level dependent functional magnetic resonance imaging (BOLD fMRI). Both ECoG and fMRI participants viewed the same clear and noisy audiovisual speech stimuli and performed the same speech recognition task. Both techniques demonstrated a sharp functional boundary in the STG, spatially coincident with an anatomical boundary defined by the posterior edge of Heschl’s gyrus. Cortex on the anterior side of the boundary responded more strongly to clear audiovisual speech than to noisy audiovisual speech while cortex on the posterior side of the boundary did not. For both ECoG and fMRI measurements, the transition between the functionally distinct regions happened within 10 mm of anterior-to-posterior distance along the STG. We relate this boundary to the multisensory neural code underlying speech perception and propose that it represents an important functional division within the human speech perception network.

Mapping of language brain areas in patients with brain tumors

Language cortex in the human brain shows high variability among normal individuals and may exhibit a considerable shift from its original position due to tumor growth. Mapping the precise location of language areas is important before surgery to avoid postoperative language deficits. In this paper, the Magnetoencephalography (MEG) recording and the MRI scanning of six brain tumorous subjects are used to localize the language specific areas. MEG recordings were performed during two silent reading tasks; silent word reading and silent picture naming. MEG source imaging is performed using distributed source modeling technique called CLARA ("Classical LORETA Analysis Recursively Applied"). Estimated MEG sources are overlaid on individual MRI of each patient to improve interpretation of MEG source imaging results. The results show successful identification of the essential language areas and clear definition of the time course of neural activation connecting them.

Information properties of morphologically complex words modulate brain activity during word reading

Neuroimaging studies of the reading process point to functionally distinct stages in word recognition. Yet, current understanding of the operations linked to those various stages is mainly descriptive in nature. Approaches developed in the field of computational linguistics may offer a more quantitative approach for understanding brain dynamics. Our aim was to evaluate whether a statistical model of morphology, with well‐defined computational principles, can capture the neural dynamics of reading, using the concept of surprisal from information theory as the common measure. The Morfessor model, created for unsupervised discovery of morphemes, is based on the minimum description length principle and attempts to find optimal units of representation for complex words. In a word recognition task, we correlated brain responses to word surprisal values derived from Morfessor and from other psycholinguistic variables that have been linked with various levels of linguistic abstraction. The magnetoencephalography data analysis focused on spatially, temporally and functionally distinct components of cortical activation observed in reading tasks. The early occipital and occipito‐temporal responses were correlated with parameters relating to visual complexity and orthographic properties, whereas the later bilateral superior temporal activation was correlated with whole‐word based and morphological models. The results show that the word processing costs estimated by the statistical Morfessor model are relevant for brain dynamics of reading during late processing stages.

Predicting postoperative language outcome using presurgical fMRI, MEG, TMS, and high gamma ECoG

OBJECTIVE

To predict the postoperative language outcome using the support vector regression (SVR) and results of multimodal presurgical language mapping.

METHODS

Eleven patients with epilepsy received presurgical language mapping using functional MRI (fMRI), magnetoencephalography (MEG), transcranial magnetic stimulation (TMS), and high-gamma electrocorticography (hgECoG), as well as pre- and postoperative neuropsychological evaluation of language. We constructed 15 (2⁴-1) SVR models by considering the extent of resected language areas identified by all subsets of four modalities as input feature vector and the postoperative language outcome as output. We trained and cross-validated SVR models, and compared the cross-validation (CV) errors of all models for prediction of language outcome.

RESULTS

Seven patients had some level of postoperative language decline and two of them had significant postoperative decline in naming. Some parts of language areas identified by four modalities were resected in these patients. We found that an SVR model consisting of fMRI, MEG, and hgECoG provided minimum CV error, although an SVR model consisting of fMRI and MEG was the optimal model that facilitated the best trade-off between model complexity and prediction accuracy.

CONCLUSIONS

A multimodal SVR can be used to predict the language outcome.

SIGNIFICANCE

The developed multimodal SVR models in this study can be utilized to calculate the language outcomes of different resection plans prior to surgery and select the optimal surgical plan.

A functional near-infrared spectroscopic investigation of speech production during reading

This study was designed to test the extent to which speaking processes related to articulation and voicing influence Functional Near Infrared Spectroscopy (fNIRS) measures of cortical hemodynamics and functional connectivity. Participants read passages in three conditions (oral reading, silent mouthing, and silent reading) while undergoing fNIRS imaging. Area under the curve (AUC) analyses of the oxygenated and deoxygenated hemodynamic response function concentration values were compared for each task across five regions of interest. There were significant region main effects for both oxy and deoxy AUC analyses, and a significant region × task interaction for deoxy AUC favoring the oral reading condition over the silent reading condition for two nonmotor regions. Assessment of functional connectivity using Granger Causality revealed stronger networks between motor areas during oral reading and stronger networks between language areas during silent reading. There was no evidence that the hemodynamic flow from motor areas during oral reading compromised measures of language-related neural activity in nonmotor areas. However, speech movements had small, but measurable effects on fNIRS measures of neural connections between motor and nonmotor brain areas across the perisylvian region, even after wavelet filtering. Therefore, researchers studying speech processes with fNIRS should use wavelet filtering during preprocessing to reduce speech motion artifacts, incorporate a nonspeech communication or language control task into the research design, and conduct a connectivity analysis to adequately assess the impact of functional speech on the hemodynamic response across the perisylvian region.

Numerical value biases sound localization

Speech recognition starts with representations of basic acoustic perceptual features and ends by categorizing the sound based on long-term memory for word meaning. However, little is known about whether the reverse pattern of lexical influences on basic perception can occur. We tested for a lexical influence on auditory spatial perception by having subjects make spatial judgments of number stimuli. Four experiments used pointing or left/right 2-alternative forced choice tasks to examine perceptual judgments of sound location as a function of digit magnitude (1–9). The main finding was that for stimuli presented near the median plane there was a linear left-to-right bias for localizing smaller-to-larger numbers. At lateral locations there was a central-eccentric location bias in the pointing task, and either a bias restricted to the smaller numbers (left side) or no significant number bias (right side). Prior number location also biased subsequent number judgments towards the opposite side. Findings support a lexical influence on auditory spatial perception, with a linear mapping near midline and more complex relations at lateral locations. Results may reflect coding of dedicated spatial channels, with two representing lateral positions in each hemispace, and the midline area represented by either their overlap or a separate third channel.

Eye Can Hear Clearly Now: Inverse Effectiveness in Natural Audiovisual Speech Processing Relies on Long-Term Crossmodal Temporal Integration

Speech comprehension is improved by viewing a speaker's face, especially in adverse hearing conditions, a principle known as inverse effectiveness. However, the neural mechanisms that help to optimize how we integrate auditory and visual speech in such suboptimal conversational environments are not yet fully understood. Using human EEG recordings, we examined how visual speech enhances the cortical representation of auditory speech at a signal-to-noise ratio that maximized the perceptual benefit conferred by multisensory processing relative to unisensory processing. We found that the influence of visual input on the neural tracking of the audio speech signal was significantly greater in noisy than in quiet listening conditions, consistent with the principle of inverse effectiveness. Although envelope tracking during audio-only speech was greatly reduced by background noise at an early processing stage, it was markedly restored by the addition of visual speech input. In background noise, multisensory integration occurred at much lower frequencies and was shown to predict the multisensory gain in behavioral performance at a time lag of ∼250 ms. Critically, we demonstrated that inverse effectiveness, in the context of natural audiovisual (AV) speech processing, relies on crossmodal integration over long temporal windows. Our findings suggest that disparate integration mechanisms contribute to the efficient processing of AV speech in background noise.

SIGNIFICANCE STATEMENT

The behavioral benefit of seeing a speaker's face during conversation is especially pronounced in challenging listening environments. However, the neural mechanisms underlying this phenomenon, known as inverse effectiveness, have not yet been established. Here, we examine this in the human brain using natural speech-in-noise stimuli that were designed specifically to maximize the behavioral benefit of audiovisual (AV) speech. We find that this benefit arises from our ability to integrate multimodal information over longer periods of time. Our data also suggest that the addition of visual speech restores early tracking of the acoustic speech signal during excessive background noise. These findings support and extend current mechanistic perspectives on AV speech perception.

MEG language lateralization in partial epilepsy using dSPM of auditory event-related fields

OBJECTIVE

Methods employed to determine hemispheric language dominance using magnetoencephalography (MEG) have differed significantly across studies in the choice of language-task, the nature of the physiological response studied, recording hardware, and source modeling methods. Our goal was to determine whether an analysis based on distributed source modeling can replicate the results of prior studies that have used dipole-modeling of event-related fields (ERFs) generated by an auditory word-recognition task to determine language dominance in patients with epilepsy.

METHODS

We analyzed data from 45 adult patients with drug-resistant partial epilepsy who performed an auditory word-recognition task during MEG recording and also completed a language fMRI study as part of their evaluation for epilepsy surgery. Source imaging of auditory ERFs was performed using dynamic statistical parametric mapping (dSPM). Language laterality indices (LIs) were calculated for four regions of interest (ROIs) by counting above-threshold activations within a 300-600ms time window after stimulus onset. Language laterality (LL) classifications based on these LIs were compared to the results from fMRI.

RESULTS

The most lateralized MEG responses to language stimuli were observed in a parietal region that included the angular and supramarginal gyri (AngSmg). In this region, using a half-maximal threshold, source activations were left dominant in 32 (71%) patients, right dominant in 8 (18%), and symmetric in 5 patients (11%). The best agreement between MEG and fMRI on the ternary classification of regional language dominance into left, right, or symmetric groups was also found at the AngSmg ROI (69%). This was followed by the whole-hemisphere and temporal ROIs (both 62%). The frontal ROI showed the least agreement with fMRI (51%). Gross discordances between MEG and FMRI findings were disproportionately of the type where MEG favored atypical right-hemispheric language in a patient with right-hemispheric seizure origin (p<0.05 at three of the four ROIs).

SIGNIFICANCE

In a parietal region that includes the angular and supramarginal gyri, language laterality estimates based on dSPM of ERFs during auditory word-recognition shows a degree of MEG-fMRI concordance that is comparable to previously published estimates for MEG-Wada concordance using dipole counting methods and the same task. Our data also suggest that MEG language laterality estimates based on this task may be influenced by the laterality of epileptic networks in some patients. This has not been reported previously and deserves further study.

The neuro-cognitive representations of symbols: the case of concrete words

We live our lives surrounded by symbols (e.g., road signs, logos, but especially words and numbers), and throughout our life we use them to evoke, communicate and reflect upon ideas and things that are not currently present to our senses. Symbols are represented in our brains at different levels of complexity: at the first and most simple level, as physical entities, in the corresponding primary and secondary sensory cortices. The crucial property of symbols, however, is that, despite the simplicity of their surface forms, they have the power of evoking higher order multifaceted representations that are implemented in distributed neural networks spanning a large portion of the cortex. The rich internal states that reflect our knowledge of the meaning of symbols are what we call semantic representations. In this review paper, we summarize our current knowledge of both the cognitive and neural substrates of semantic representations, focusing on concrete words (i.e., nouns or verbs referring to concrete objects and actions), which, together with numbers, are the most-studied and well defined classes of symbols. Following a systematic descriptive approach, we will organize this literature review around two key questions: what is the content of semantic representations? And, how are semantic representations implemented in the brain, in terms of localization and dynamics? While highlighting the main current opposing perspectives on these topics, we propose that a fruitful way to make substantial progress in this domain would be to adopt a geometrical view of semantic representations as points in high dimensional space, and to operationally partition the space of concrete word meaning into motor-perceptual and conceptual dimensions. By giving concrete examples of the kinds of research that can be done within this perspective, we illustrate how we believe this framework will foster theoretical speculations as well as empirical research.

Simultaneous Processing of Noun Cue and to-be-Produced Verb in Verb Generation Task: Electromagnetic Evidence

A long-standing but implicit assumption is that words strongly associated with a presented cue are automatically activated in the memory through rapid spread of activation within brain semantic networks. The current study was aimed to provide direct evidence of such rapid access to words’ semantic representations and to investigate its neural sources using magnetoencephalography (MEG) and distributed source localization technique. Thirty-three neurotypical subjects underwent the MEG recording during verb generation task, which was to produce verbs related to the presented noun cues. Brain responses evoked by the noun cues were examined while manipulating the strength of association between the noun and the potential verb responses. The strong vs. weak noun-verb association led to a greater noun-related neural response at 250–400 ms after cue onset, and faster verb production. The cortical sources of the differential response were localized in left temporal pole, previously implicated in semantic access, and left ventrolateral prefrontal cortex (VLPFC), thought to subserve controlled semantic retrieval. The strength of the left VLPFC’s response to the nouns with strong verb associates was positively correlated to the speed of verbs production. Our findings empirically validate the theoretical expectation that in case of a strongly connected noun-verb pair, successful access to target verb representation may occur already at the stage of lexico-semantic analysis of the presented noun. Moreover, the MEG results suggest that contrary to the previous conclusion derived from fMRI studies left VLPFC supports selection of the target verb representations, even if they were retrieved from semantic memory rapidly and effortlessly. The discordance between MEG and fMRI findings in verb generation task may stem from different modes of neural activation captured by phase-locked activity in MEG and slow changes of blood-oxygen-level-dependent (BOLD) signal in fMRI.

The Role of the Primary Sensory Cortices in Early Language Processing

The results of this magnetoencephalography study challenge two long-standing assumptions regarding the brain mechanisms of language processing: First, that linguistic processing proper follows sensory feature processing effected by bilateral activation of the primary sensory cortices that lasts about 100 msec from stimulus onset. Second, that subsequent linguistic processing is effected by left hemisphere networks outside the primary sensory areas, including Broca's and Wernicke's association cortices. Here we present evidence that linguistic analysis begins almost synchronously with sensory, prelinguistic verbal input analysis and that the primary cortices are also engaged in these linguistic analyses and become, consequently, part of the left hemisphere language network during language tasks. These findings call for extensive revision of our conception of linguistic processing in the brain.

Cortical Mechanisms of Tongue Sensorimotor Functions in Humans: A Review of the Magnetoencephalography Approach

The tongue plays important roles in a variety of critical human oral functions, including speech production, swallowing, mastication and respiration. These sophisticated tongue movements are in part finely regulated by cortical entrainment. Many studies have examined sensorimotor processing in the limbs using magnetoencephalography (MEG), which has high spatiotemporal resolution. Such studies have employed multiple methods of analysis, including somatosensory evoked fields (SEFs), movement-related cortical fields (MRCFs), event-related desynchronization/synchronization (ERD/ERS) associated with somatosensory stimulation or movement and cortico-muscular coherence (CMC) during sustained movement. However, the cortical mechanisms underlying the sensorimotor functions of the tongue remain unclear, as contamination artifacts induced by stimulation and/or muscle activity within the orofacial region complicates MEG analysis in the oral region. Recently, several studies have obtained MEG recordings from the tongue region using improved stimulation methods and movement tasks. In the present review, we provide a detailed overview of tongue sensorimotor processing in humans, based on the findings of recent MEG studies. In addition, we review the clinical applications of MEG for sensory disturbances of the tongue caused by damage to the lingual nerve. Increased knowledge of the physiological and pathophysiological mechanisms underlying tongue sensorimotor processing may improve our understanding of the cortical entrainment of human oral functions.

Indexing cortical entrainment to natural speech at the phonemic level: Methodological considerations for applied research

Speech is central to human life. As such, any delay or impairment in receptive speech processing can have a profoundly negative impact on the social and professional life of a person. Thus, being able to assess the integrity of speech processing in different populations is an important goal. Current standardized assessment is mostly based on psychometric measures that do not capture the full extent of a person's speech processing abilities and that are difficult to administer in some subjects groups. A potential alternative to these tests would be to derive "direct", objective measures of speech processing from cortical activity. One such approach was recently introduced and showed that it is possible to use electroencephalography (EEG) to index cortical processing at the level of phonemes from responses to continuous natural speech. However, a large amount of data was required for such analyses. This limits the usefulness of this approach for assessing speech processing in particular cohorts for whom data collection is difficult. Here, we used EEG data from 10 subjects to assess whether measures reflecting phoneme-level processing could be reliably obtained using only 10 min of recording time from each subject. This was done successfully using a generic modeling approach wherein the data from a training group composed of 9 subjects were combined to derive robust predictions of the EEG signal for new subjects. This allowed the derivation of indices of cortical activity at the level of phonemes and the disambiguation of responses to specific phonetic features (e.g., stop, plosive, and nasal consonants) with limited data. This objective approach has the potential to complement psychometric measures of speech processing in a wide variety of subjects.

Impact of Audio-Visual Asynchrony on Lip-Reading Effects -Neuromagnetic and Psychophysical Study

The effects of asynchrony between audio and visual (A/V) stimuli on the N100m responses of magnetoencephalography in the left hemisphere were compared with those on the psychophysical responses in 11 participants. The latency and amplitude of N100m were significantly shortened and reduced in the left hemisphere by the presentation of visual speech as long as the temporal asynchrony between A/V stimuli was within 100 ms, but were not significantly affected with audio lags of -500 and +500 ms. However, some small effects were still preserved on average with audio lags of 500 ms, suggesting similar asymmetry of the temporal window to that observed in psychophysical measurements, which tended to be more robust (wider) for audio lags; i.e., the pattern of visual-speech effects as a function of A/V lag observed in the N100m in the left hemisphere grossly resembled that in psychophysical measurements on average, although the individual responses were somewhat varied. The present results suggest that the basic configuration of the temporal window of visual effects on auditory-speech perception could be observed from the early auditory processing stage.

Fluency tasks generate beta-gamma activity in language-related cortical areas of patients during stereo-EEG monitoring

A quantitative method was developed to map cortical areas responsive to cognitive tasks during intracerebral stereo-EEG recording sessions in drug-resistant patients candidate for epilepsy surgery. Frequency power changes were evaluated with a computer-assisted analysis in 7 patients during phonemic fluency tasks. All patients were right-handed and were explored with depth electrodes in the dominant frontal lobe. We demonstrate that fluency tasks enhance beta-gamma frequencies and reduce background activities in language network regions of the dominant hemisphere. Non-reproducible changes were observed in other explored brain areas during cognitive tests execution.

The Multivariate Temporal Response Function (mTRF) Toolbox: A MATLAB Toolbox for Relating Neural Signals to Continuous Stimuli

Understanding how brains process sensory signals in natural environments is one of the key goals of twenty-first century neuroscience. While brain imaging and invasive electrophysiology will play key roles in this endeavor, there is also an important role to be played by noninvasive, macroscopic techniques with high temporal resolution such as electro- and magnetoencephalography. But challenges exist in determining how best to analyze such complex, time-varying neural responses to complex, time-varying and multivariate natural sensory stimuli. There has been a long history of applying system identification techniques to relate the firing activity of neurons to complex sensory stimuli and such techniques are now seeing increased application to EEG and MEG data. One particular example involves fitting a filter—often referred to as a temporal response function—that describes a mapping between some feature(s) of a sensory stimulus and the neural response. Here, we first briefly review the history of these system identification approaches and describe a specific technique for deriving temporal response functions known as regularized linear regression. We then introduce a new open-source toolbox for performing this analysis. We describe how it can be used to derive (multivariate) temporal response functions describing a mapping between stimulus and response in both directions. We also explain the importance of regularizing the analysis and how this regularization can be optimized for a particular dataset. We then outline specifically how the toolbox implements these analyses and provide several examples of the types of results that the toolbox can produce. Finally, we consider some of the limitations of the toolbox and opportunities for future development and application.