Evaluating signal-correlated noise as a control task with language-related gamma activity on electrocorticography

A quantitative comparison of atlas parcellations on the human superior temporal sulcus

The superior temporal sulcus (STS) has a functional topography that has been difficult to characterize through traditional approaches. Automated atlas parcellations may be one solution while also being beneficial for both dimensional reduction and standardizing regions of interest, but they yield very different boundary definitions along the STS. Here we evaluate how well machine learning classifiers can correctly identify six social cognitive tasks from STS activation patterns dimensionally reduced using four popular atlases (Glasser et al., 2016; Gordon et al., 2016; Power et al., 2011 as projected onto the surface by Arslan et al., 2018; Schaefer et al., 2018). Functional data was summarized within each STS parcel in one of four ways, then subjected to leave-one-subject-out cross-validation SVM classification. We found that the classifiers could readily label conditions when data was parcellated using any of the four atlases, evidence that dimensional reduction to parcels did not compromise functional fingerprints. Mean activation for the social conditions was the most effective metric for classification in the right STS, whereas all the metrics classified equally well in the left STS. Interestingly, even atlases constructed from random parcellation schemes (null atlases) classified the conditions with high accuracy. We therefore conclude that the complex activation maps on the STS are readily differentiated at a coarse granular level, despite a strict topography having not yet been identified. Further work is required to identify what features have greatest potential to improve the utility of atlases in replacing functional localizers.

Developmental organization of neural dynamics supporting auditory perception

Purpose:

A prominent view of language acquisition involves learning to ignore irrelevant auditory signals through functional reorganization, enabling more efficient processing of relevant information. Yet, few studies have characterized the neural spatiotemporal dynamics supporting rapid detection and subsequent disregard of irrelevant auditory information, in the developing brain. To address this unknown, the present study modeled the developmental acquisition of cost-efficient neural dynamics for auditory processing, using intracranial electrocorticographic responses measured in individuals receiving standard-of-care treatment for drug-resistant, focal epilepsy. We also provided evidence demonstrating the maturation of an anterior-to-posterior functional division within the superior-temporal gyrus (STG), which is known to exist in the adult STG.

Methods:

We studied 32 patients undergoing extraoperative electrocorticography (age range: eight months to 28 years) and analyzed 2,039 intracranial electrode sites outside the seizure onset zone, interictal spike-generating areas, and MRI lesions. Patients were given forward (normal) speech sounds, backward-played speech sounds, and signal-correlated noises during a task-free condition. We then quantified sound processing-related neural costs at given time windows using high-gamma amplitude at 70–110 Hz and animated the group-level high-gamma dynamics on a spatially normalized three-dimensional brain surface. Finally, we determined if age independently contributed to high-gamma dynamics across brain regions and time windows.

Results:

Group-level analysis of noise-related neural costs in the STG revealed developmental enhancement of early high-gamma augmentation and diminution of delayed augmentation. Analysis of speech-related high-gamma activity demonstrated an anterior-to-posterior functional parcellation in the STG. The left anterior STG showed sustained augmentation throughout stimulus presentation, whereas the left posterior STG showed transient augmentation after stimulus onset. We found a double dissociation between the locations and developmental changes in speech sound-related high-gamma dynamics. Early left anterior STG high-gamma augmentation (i.e., within 200 ms post-stimulus onset) showed developmental enhancement, whereas delayed left posterior STG high-gamma augmentation declined with development.

Conclusions:

Our observations support the model that, with age, the human STG refines neural dynamics to rapidly detect and subsequently disregard uninformative acoustic noises. Our study also supports the notion that the anterior-to-posterior functional division within the left STG is gradually strengthened for efficient speech sound perception after birth.

Speech-related auditory salience detection in the posterior superior temporal region

Processing auditory human speech requires both detection (early and transient) and analysis (sustained). We analyzed high gamma (70-110 Hz) activity of intracranial electroencephalography waveforms acquired during an auditory task that paired forward speech, reverse speech, and signal correlated noise. We identified widespread superior temporal sites with sustained activity responding only to forward and reverse speech regardless of paired order. More localized superior temporal auditory onset sites responded to all stimulus types when presented first in a pair and responded in recurrent fashion to the second paired stimulus in select conditions even in the absence of interstimulus silence; a novel finding. Auditory onset activity to a second paired sound recurred according to relative salience, with evidence of partial suppression during linguistic processing. We propose that temporal lobe auditory onset sites facilitate a salience detector function with hysteresis of 200 ms and are influenced by cortico-cortical feedback loops involving linguistic processing and articulation.

The Benefit of Cross-Modal Reorganization on Speech Perception in Pediatric Cochlear Implant Recipients Revealed Using Functional Near-Infrared Spectroscopy

Cochlear implants (CIs) are the most successful treatment for severe-to-profound deafness in children. However, speech outcomes with a CI often lag behind those of normally-hearing children. Some authors have attributed these deficits to the takeover of the auditory temporal cortex by vision following deafness, which has prompted some clinicians to discourage the rehabilitation of pediatric CI recipients using visual speech. We studied this cross-modal activity in the temporal cortex, along with responses to auditory speech and non-speech stimuli, in experienced CI users and normally-hearing controls of school-age, using functional near-infrared spectroscopy. Strikingly, CI users displayed significantly greater cortical responses to visual speech, compared with controls. Importantly, in the same regions, the processing of auditory speech, compared with non-speech stimuli, did not significantly differ between the groups. This suggests that visual and auditory speech are processed synergistically in the temporal cortex of children with CIs, and they should be encouraged, rather than discouraged, to use visual speech.

In Vivo Femtosecond Laser Subsurface Cortical Microtransections Attenuate Acute Rat Focal Seizures

Recent evidence shows that seizures propagate primarily through supragranular cortical layers. To selectively modify these circuits, we developed a new technique using tightly focused, femtosecond infrared laser pulses to make as small as ~100 µm-wide subsurface cortical incisions surrounding an epileptic focus. We use this "laser scalpel" to produce subsurface cortical incisions selectively to supragranular layers surrounding an epileptic focus in an acute rodent seizure model. Compared with sham animals, these microtransections completely blocked seizure initiation and propagation in 1/3 of all animals. In the remaining animals, seizure frequency was reduced by 2/3 and seizure propagation reduced by 1/3. In those seizures that still propagated, it was delayed and reduced in amplitude. When the recording electrode was inside the partially isolated cube and the seizure focus was on the outside, the results were even more striking. In spite of these microtransections, somatosensory responses to tail stimulation were maintained but with reduced amplitude. Our data show that just a single enclosing wall of laser cuts limited to supragranular layers led to a significant reduction in seizure initiation and propagation with preserved cortical function. Modification of this concept may be a useful treatment for human epilepsy.

Evaluating time-reversed speech and signal-correlated noise as auditory baselines for isolating speech-specific processing using fNIRS

Evidence using well-established imaging techniques, such as functional magnetic resonance imaging and electrocorticography, suggest that speech-specific cortical responses can be functionally localised by contrasting speech responses with an auditory baseline stimulus, such as time-reversed (TR) speech or signal-correlated noise (SCN). Furthermore, these studies suggest that SCN is a more effective baseline than TR speech. Functional near-infrared spectroscopy (fNIRS) is a relatively novel, optically-based imaging technique with features that make it ideal for investigating speech and language function in paediatric populations. However, it is not known which baseline is best at isolating speech activation when imaging using fNIRS. We presented normal speech, TR speech and SCN in an event-related format to 25 normally-hearing children aged 6-12 years. Brain activity was measured across frontal and temporal brain areas in both cerebral hemispheres whilst children passively listened to the auditory stimuli. In all three conditions, significant activation was observed bilaterally in channels targeting superior temporal regions when stimuli were contrasted against silence. Unlike previous findings in infants, we found no significant activation in the region of interest over superior temporal cortex in school-age children when normal speech was contrasted against either TR speech or SCN. Although no statistically significant lateralisation effects were observed in the region of interest, a left-sided channel targeting posterior temporal regions showed significant activity in response to normal speech only, and was investigated further. Significantly greater activation was observed in this left posterior channel compared to the corresponding channel on the right side under the normal speech vs SCN contrast only. Our findings suggest that neither TR speech nor SCN are suitable auditory baselines for functionally isolating speech-specific processing in an experimental set up involving fNIRS with 6-12 year old children.

Whole-Brain Network Connectivity Underlying the Human Speech Articulation as Emerged Integrating Direct Electric Stimulation, Resting State fMRI and Tractography

Production of fluent speech in humans is based on a precise and coordinated articulation of sounds. A speech articulation network (SAN) has been observed in multiple brain studies typically using either neuroimaging or direct electrical stimulation (DES), thus giving limited knowledge about the whole brain structural and functional organization of this network. In this study, seven right-handed patients underwent awake surgery resection of low-grade gliomas (4) and cavernous angiomas. We combined pre-surgical resting state fMRI (rs-fMRI) and diffusion MRI together with speech arrest sites obtained intra-operatively with DES to address the following goals: (i) determine the cortical areas contributing to the intrinsic functional SAN using the speech arrest sites as functional seeds for rs-fMRI; (ii) evaluate the relative contribution of gray matter terminations from the two major language dorsal stream bundles, the superior longitudinal fasciculus (SLF III) and the arcuate fasciculus (AF); and (iii) evaluate the possible pre-surgical prediction of SAN with rs-fMRI. In all these right-handed patients the intrinsic functional SAN included frontal, inferior parietal, temporal, and insular regions symmetrically and bilaterally distributed across the two hemispheres regardless of the side (four right) of speech arrest evocation. The SLF III provided a much higher density of terminations in the cortical regions of SAN in respect to AF. Pre-surgical rs-fMRI data demonstrated moderate ability to predict the SAN. The set of functional and structural data provided in this multimodal study characterized, at a whole-brain level, a distributed and bi-hemispherical network subserving speech articulation.

Brain network dynamics in the human articulatory loop

OBJECTIVE

The articulatory loop is a fundamental component of language function, involved in the short-term buffer of auditory information followed by its vocal reproduction. We characterized the network dynamics of the human articulatory loop, using invasive recording and stimulation.

METHODS

We measured high-gamma activity_{70-110 Hz} recorded intracranially when patients with epilepsy either only listened to, or listened to and then reproduced two successive tones by humming. We also conducted network analyses, and analyzed behavioral responses to cortical stimulation.

RESULTS

Presentation of the initial tone elicited high-gamma augmentation bilaterally in the superior-temporal gyrus (STG) within 40ms, and in the precentral and inferior-frontal gyri (PCG and IFG) within 160ms after sound onset. During presentation of the second tone, high-gamma augmentation was reduced in STG but enhanced in IFG. The task requiring tone reproduction further enhanced high-gamma augmentation in PCG during and after sound presentation. Event-related causality (ERC) analysis revealed dominant flows within STG immediately after sound onset, followed by reciprocal interactions involving PCG and IFG. Measurement of cortico-cortical evoked-potentials (CCEPs) confirmed connectivity between distant high-gamma sites in the articulatory loop. High-frequency stimulation of precentral high-gamma sites in either hemisphere induced speech arrest, inability to control vocalization, or forced vocalization. Vocalization of tones was accompanied by high-gamma augmentation over larger extents of PCG.

CONCLUSIONS

Bilateral PCG rapidly and directly receives feed-forward signals from STG, and may promptly initiate motor planning including sub-vocal rehearsal for short-term buffering of auditory stimuli. Enhanced high-gamma augmentation in IFG during presentation of the second tone may reflect high-order processing of the tone sequence.

SIGNIFICANCE

The articulatory loop employs sustained reciprocal propagation of neural activity across a network of cortical sites with strong neurophysiological connectivity.

Spatio-temporal dynamics of working memory maintenance and scanning of verbal information

OBJECTIVE

During verbal communication, humans briefly maintain mental representations of speech sounds conveying verbal information, and constantly scan these representations for comparison to incoming information. We determined the spatio-temporal dynamics of such short-term maintenance and subsequent scanning of verbal information, by intracranially measuring high-gamma activity at 70-110Hz during a working memory task.

METHODS

Patients listened to a stimulus set of two or four spoken letters and were instructed to remember those letters over a two-second interval, following which they were asked to determine if a subsequent target letter had been presented earlier in that trial's stimulus set.

RESULTS

Auditory presentation of letter stimuli sequentially elicited high-gamma augmentation bilaterally in the superior-temporal and pre-central gyri. During the two-second maintenance period, high-gamma activity was augmented in the left pre-central gyrus, and this effect was larger during the maintenance of stimulus sets consisting of four compared to two letters. During the scanning period following target presentation, high-gamma augmentation involved the left inferior-frontal and supra-marginal gyri.

CONCLUSIONS

Short-term maintenance of verbal information is, at least in part, supported by the left pre-central gyrus, whereas scanning by the left inferior-frontal and supra-marginal gyri.

SIGNIFICANCE

The cortical structures involved in short-term maintenance and scanning of speech stimuli were segregated with an excellent temporal resolution.

ECoG high gamma activity reveals distinct cortical representations of lyrics passages, harmonic and timbre-related changes in a rock song

Listening to music moves our minds and moods, stirring interest in its neural underpinnings. A multitude of compositional features drives the appeal of natural music. How such original music, where a composer's opus is not manipulated for experimental purposes, engages a listener's brain has not been studied until recently. Here, we report an in-depth analysis of two electrocorticographic (ECoG) data sets obtained over the left hemisphere in ten patients during presentation of either a rock song or a read-out narrative. First, the time courses of five acoustic features (intensity, presence/absence of vocals with lyrics, spectral centroid, harmonic change, and pulse clarity) were extracted from the audio tracks and found to be correlated with each other to varying degrees. In a second step, we uncovered the specific impact of each musical feature on ECoG high-gamma power (70-170 Hz) by calculating partial correlations to remove the influence of the other four features. In the music condition, the onset and offset of vocal lyrics in ongoing instrumental music was consistently identified within the group as the dominant driver for ECoG high-gamma power changes over temporal auditory areas, while concurrently subject-individual activation spots were identified for sound intensity, timbral, and harmonic features. The distinct cortical activations to vocal speech-related content embedded in instrumental music directly demonstrate that song integrated in instrumental music represents a distinct dimension in complex music. In contrast, in the speech condition, the full sound envelope was reflected in the high gamma response rather than the onset or offset of the vocal lyrics. This demonstrates how the contributions of stimulus features that modulate the brain response differ across the two examples of a full-length natural stimulus, which suggests a context-dependent feature selection in the processing of complex auditory stimuli.