Adaptation of high-gamma responses in human auditory association cortex

Two stages of speech envelope tracking in human auditory cortex modulated by speech intelligibility

The envelope is essential for speech perception. Recent studies have shown that cortical activity can track the acoustic envelope. However, whether the tracking strength reflects the extent of speech intelligibility processing remains controversial. Here, using stereo-electroencephalogram technology, we directly recorded the activity in human auditory cortex while subjects listened to either natural or noise-vocoded speech. These 2 stimuli have approximately identical envelopes, but the noise-vocoded speech does not have speech intelligibility. According to the tracking lags, we revealed 2 stages of envelope tracking: an early high-γ (60-140 Hz) power stage that preferred the noise-vocoded speech and a late θ (4-8 Hz) phase stage that preferred the natural speech. Furthermore, the decoding performance of high-γ power was better in primary auditory cortex than in nonprimary auditory cortex, consistent with its short tracking delay, while θ phase showed better decoding performance in right auditory cortex. In addition, high-γ responses with sustained temporal profiles in nonprimary auditory cortex were dominant in both envelope tracking and decoding. In sum, we suggested a functional dissociation between high-γ power and θ phase: the former reflects fast and automatic processing of brief acoustic features, while the latter correlates to slow build-up processing facilitated by speech intelligibility.

Distinct interacting cortical networks for stimulus-response and repetition-suppression

Non-invasive studies consider the initial neural stimulus response (SR) and repetition suppression (RS) - the decreased response to repeated sensory stimuli - as engaging the same neurons. That is, RS is a suppression of the SR. We challenge this conjecture using electrocorticographic (ECoG) recordings with high spatial resolution in ten patients listening to task-irrelevant trains of auditory stimuli. SR and RS were indexed by high-frequency activity (HFA) across temporal, parietal, and frontal cortices. HFASR and HFARS were temporally and spatially distinct, with HFARS emerging later than HFASR and showing only a limited spatial intersection with HFASR: most HFASR sites did not demonstrate HFARS, and HFARS was found where no HFASR could be recorded. β activity was enhanced in HFARS compared to HFASR cortical sites. θ activity was enhanced in HFASR compared to HFARS sites. Furthermore, HFASR sites propagated information to HFARS sites via transient θ:β phase-phase coupling. In contrast to predictive coding (PC) accounts our results indicate that HFASR and HFARS are functionally linked but have minimal spatial overlap. HFASR might enable stable and rapid perception of environmental stimuli across extended temporal intervals. In contrast HFARS might support efficient generation of an internal model based on stimulus history.

Temporally and functionally distinct large-scale brain network dynamics supporting task switching

Objective:

Our daily activities require frequent switches among competing responses at the millisecond time scale. We determined the spatiotemporal characteristics and functional significance of rapid, large-scale brain network dynamics during task switching.

Methods:

This cross-sectional study investigated patients with drug-resistant focal epilepsy who played a Lumosity cognitive flexibility training game during intracranial electroencephalography (iEEG) recording. According to a given task rule, unpredictably switching across trials, participants had to swipe the screen in the direction the stimulus was pointing or moving. Using this data, we described the spatiotemporal characteristics of iEEG high-gamma augmentation occurring more intensely during switch than repeat trials, unattributable to the effect of task rule (pointing or moving), within-stimulus congruence (the direction of stimulus pointing and moving was same or different in a given trial), or accuracy of an immediately preceding response. Diffusion-weighted imaging (DWI) tractography determined whether distant cortical regions showing enhanced activation during task switch trials were directly connected by white matter tracts. Trial-by-trial iEEG analysis deduced whether the intensity of task switch-related high-gamma augmentation was altered through practice and whether high-gamma amplitude predicted the accuracy of an upcoming response among switch trials.

Results:

The average number of completed trials during five-minute gameplay was 221.4 per patient (range: 171–285). Task switch trials increased the response times, whereas later trials reduced them. Analysis of iEEG signals sampled from 860 brain sites effectively elucidated the distinct spatiotemporal characteristics of task switch, task rule, and post-error-specific high-gamma modulations. Post-cue, task switch-related high-gamma augmentation was initiated in the right calcarine cortex after 260 ms, right precuneus after 330 ms, right entorhinal after 420 ms, and bilateral anterior middle-frontal gyri after 450 ms. DWI tractography successfully showed the presence of direct white matter tracts connecting the right visual areas to the precuneus and anterior middle-frontal regions but not between the right precuneus and anterior middle-frontal regions. Task-related high-gamma amplitudes in later trials were reduced in the calcarine, entorhinal and anterior middle-frontal regions, but increased in the precuneus. Functionally, enhanced post-cue precuneus high-gamma augmentation improved the accuracy of subsequent responses among switch trials.

Conclusions:

Our multimodal analysis uncovered two temporally and functionally distinct network dynamics supporting task switching. High-gamma augmentation in the visual-precuneus pathway may reflect the neural process facilitating an attentional shift to a given updated task rule. High-gamma activity in the visual-dorsolateral prefrontal pathway, rapidly reduced through practice, may reflect the cost of executing appropriate stimulus-response translation.

Broadband Dynamics Rather than Frequency-Specific Rhythms Underlie Prediction Error in the Primate Auditory Cortex

Detection of statistical irregularities, measured as a prediction error response, is fundamental to the perceptual monitoring of the environment. We studied whether prediction error response is associated with neural oscillations or asynchronous broadband activity. Electrocorticography was conducted in three male monkeys, who passively listened to the auditory roving oddball stimuli. Local field potentials (LFPs) recorded over the auditory cortex underwent spectral principal component analysis, which decoupled broadband and rhythmic components of the LFP signal. We found that the broadband component captured the prediction error response, whereas none of the rhythmic components were associated with statistical irregularities of sounds. The broadband component displayed more stochastic, asymmetrical multifractal properties than the rhythmic components, which revealed more self-similar dynamics. We thus conclude that the prediction error response is captured by neuronal populations generating asynchronous broadband activity, defined by irregular dynamic states, which, unlike oscillatory rhythms, appear to enable the neural representation of auditory prediction error response.SIGNIFICANCE STATEMENT This study aimed to examine the contribution of oscillatory and asynchronous components of auditory local field potentials in the generation of prediction error responses to sensory irregularities, as this has not been directly addressed in the previous studies. Here, we show that mismatch negativity-an auditory prediction error response-is driven by the asynchronous broadband component of potentials recorded in the auditory cortex. This finding highlights the importance of nonoscillatory neural processes in the predictive monitoring of the environment. At a more general level, the study demonstrates that stochastic neural processes, which are often disregarded as neural noise, do have a functional role in the processing of sensory information.

Neuronal phase consistency tracks dynamic changes in acoustic spectral regularity

The brain parses the auditory environment into distinct sounds by identifying those acoustic features in the environment that have common relationships (e.g., spectral regularities) with one another and then grouping together the neuronal representations of these features. Although there is a large literature that tests how the brain tracks spectral regularities that are predictable, it is not known how the auditory system tracks spectral regularities that are not predictable and that change dynamically over time. Furthermore, the contribution of brain regions downstream of the auditory cortex to the coding of spectral regularity is unknown. Here, we addressed these two issues by recording electrocorticographic activity, while human patients listened to tone-burst sequences with dynamically varying spectral regularities, and identified potential neuronal mechanisms of the analysis of spectral regularities throughout the brain. We found that the degree of oscillatory stimulus phase consistency (PC) in multiple neuronal-frequency bands tracked spectral regularity. In particular, PC in the delta-frequency band seemed to be the best indicator of spectral regularity. We also found that these regularity representations existed in multiple regions throughout cortex. This widespread reliable modulation in PC - both in neuronal-frequency space and in cortical space - suggests that phase-based modulations may be a general mechanism for tracking regularity in the auditory system specifically and other sensory systems more generally. Our findings also support a general role for the delta-frequency band in processing the regularity of auditory stimuli.

Complex Modulation Method for Measuring Cross-Frequency Coupling of Neural Oscillations

There is growing evidence from human intracranial electrocorticography (ECoG) studies that interactions between cortical frequencies are important for sensory perception, cognition and inter-regional neuronal communication. Recent studies have focused mainly on the strength of phase-amplitude coupling in cross-frequency interactions. Here, we introduce a complex modulation method based on measures of coherence to investigate cross-frequency coupling in the neural time series. This novel approach uses complex demodulation transform and coherence measures from the transformed signals. We used this method to quantify power coupling between two cortical frequency bands: theta (47 Hz) and high gamma (70-150 Hz) in ECoG signals recorded during an auditory task. We compared complex modulation results with traditional phase-amplitude coupling measures (PAC) derived from the same ECoG dataset. Our results suggest that cross-frequency coupling may involve changes in both phase-amplitude and power relationships between frequencies, reflecting the complexity of neuronal oscillatory interactions.

Modeling Neural Adaptation in Auditory Cortex

Neural responses recorded from auditory cortex exhibit adaptation, a stimulus-specific decrease that occurs when the same sound is presented repeatedly. Stimulus-specific adaptation is thought to facilitate perception in noisy environments. Although adaptation is assumed to arise independently from cortex, this has been difficult to validate directly in vivo. In this study, we used a neural network model of auditory cortex with multicompartmental cell modeling to investigate cortical adaptation. We found that repetitive, non-adapted inputs to layer IV neurons in the model elicited frequency-specific decreases in simulated single neuron, population-level and local field potential (LFP) activity, consistent with stimulus-specific cortical adaptation. Simulated recordings of LFPs, generated solely by excitatory post-synaptic inputs and recorded from layers II/III in the model, showed similar waveform morphologies and stimulus probability effects as auditory evoked responses recorded from human cortex. We tested two proposed mechanisms of cortical adaptation, neural fatigue and neural sharpening, by varying the strength and type of inter- and intra-layer synaptic connections (excitatory, inhibitory). Model simulations showed that synaptic depression modeled in excitatory (AMPA) synapses was sufficient to elicit a reduction in neural firing rate, consistent with neural fatigue. However, introduction of lateral inhibition from local layer II/III interneurons resulted in a reduction in the number of responding neurons, but not their firing rates, consistent with neural sharpening. These modeling results demonstrate that adaptation can arise from multiple neural mechanisms in auditory cortex.

Processing of auditory novelty across the cortical hierarchy: An intracranial electrophysiology study

Under the predictive coding hypothesis, specific spatiotemporal patterns of cortical activation are postulated to occur during sensory processing as expectations generate feedback predictions and prediction errors generate feedforward signals. Establishing experimental evidence for this information flow within cortical hierarchy has been difficult, especially in humans, due to spatial and temporal limitations of non-invasive measures of cortical activity. This study investigated cortical responses to auditory novelty using the local/global deviant paradigm, which engages the hierarchical network underlying auditory predictive coding over short ('local deviance'; LD) and long ('global deviance'; GD) time scales. Electrocorticographic responses to auditory stimuli were obtained in neurosurgical patients from regions of interest (ROIs) including auditory, auditory-related and prefrontal cortex. LD and GD effects were assayed in averaged evoked potential (AEP) and high gamma (70-150 Hz) signals, the former likely dominated by local synaptic currents and the latter largely reflecting local spiking activity. AEP LD effects were distributed across all ROIs, with greatest percentage of significant sites in core and non-core auditory cortex. High gamma LD effects were localized primarily to auditory cortex in the superior temporal plane and on the lateral surface of the superior temporal gyrus (STG). LD effects exhibited progressively longer latencies in core, non-core, auditory-related and prefrontal cortices, consistent with feedforward signaling. The spatial distribution of AEP GD effects overlapped that of LD effects, but high gamma GD effects were more restricted to non-core areas. High gamma GD effects had shortest latencies in STG and preceded AEP GD effects in most ROIs. This latency profile, along with the paucity of high gamma GD effects in the superior temporal plane, suggest that the STG plays a prominent role in initiating novelty detection signals over long time scales. Thus, the data demonstrate distinct patterns of information flow in human cortex associated with auditory novelty detection over multiple time scales.

Neurons along the auditory pathway exhibit a hierarchical organization of prediction error

Perception is characterized by a reciprocal exchange of predictions and prediction error signals between neural regions. However, the relationship between such sensory mismatch responses and hierarchical predictive processing has not yet been demonstrated at the neuronal level in the auditory pathway. We recorded single-neuron activity from different auditory centers in anaesthetized rats and awake mice while animals were played a sequence of sounds, designed to separate the responses due to prediction error from those due to adaptation effects. Here we report that prediction error is organized hierarchically along the central auditory pathway. These prediction error signals are detectable in subcortical regions and increase as the signals move towards auditory cortex, which in turn demonstrates a large-scale mismatch potential. Finally, the predictive activity of single auditory neurons underlies automatic deviance detection at subcortical levels of processing. These results demonstrate that prediction error is a fundamental component of singly auditory neuron responses.

Deep brain stimulation of the nucleus basalis of Meynert attenuates early EEG components associated with defective sensory gating in patients with Alzheimer disease - a two-case study

Alzheimer's disease (AD) is associated with deterioration of memory and cognitive function and a degeneration of neurons of the nucleus basalis of Meynert (NBM). The NBM is the major input source of acetylcholine (ACh) to the cortex. The decreasing cholinergic innervation of the cortex due to degeneration of the NBM might be the cause of loss of memory function. NBM-Deep brain stimulation (NBM-DBS) is considered to serve as a potential therapeutic option for patients with AD by supporting residual cholinergic transmission to stabilize oscillatory activity in memory-relevant circuits. However, whether DBS could improve sensory memory functions in patients with AD is not clear. Here, in a passive auditory oddball paradigm, patients with AD (N = 2) listened to repetitive background tones (standard tones) randomly interrupted by frequency deviants in two blocks with NBM-DBS OFF and then NBM-DBS ON, while age-matched healthy controls (N = 6) repeated the experiment twice. The mismatch negativity in NBM-DBS OFF significantly differed from controls in both blocks, but not under NBM-DBS, which was likely due to a pronounced P50 increase overlapping with the N1 in NBM-DBS OFF. This early complex of EEG components recovered under stimulation to a normal level as defined by responses in controls. In this temporal interval, we found in patients with NBM-DBS ON (but not with NBM-DBS OFF) and in controls a strong repetition suppression effect to standard tones - with more attenuated responses to frequently repeated standard tones. This highlights the role of NBM-DBS for sensory gating of familiar auditory information into sensory memory.

Cross-frequency coupling during auditory perception in human cortex

Cross-frequency coupling plays an important role in coordinating neuronal computations underlying human perception, learning and memory. Here we compared four methods for measuring phase/amplitude coupling (PAC) of theta (4-7 Hz) and high-gamma (70-150 Hz) in intracranial electrocorticographic (ECoG) recordings. Time-frequency spectral and time-domain evoked responses were derived for comparison. All four methods showed significant increases in theta/high-gamma PAC in auditory cortex at sites where significant event-related increases in high-gamma power were also observed. Similarly, all PAC methods revealed stimulus effects (type, probability). However, the patterns of PAC increases differed across methods. Results suggest that PAC measures may be differentially sensitive to the underlying neural activity, including high-gamma amplitude, phase locking, and response timing.

Electrocorticographic delineation of human auditory cortical fields based on effects of propofol anesthesia

The functional organization of human auditory cortex remains incompletely characterized. While the posteromedial two thirds of Heschl's gyrus (HG) is generally considered to be part of core auditory cortex, additional subdivisions of HG remain speculative. To further delineate the hierarchical organization of human auditory cortex, we investigated regional heterogeneity in the modulation of auditory cortical responses under varying depths of anesthesia induced by propofol. Non-invasive studies have shown that propofol differentially affects auditory cortical activity, with a greater impact on non-core areas. Subjects were neurosurgical patients undergoing removal of intracranial electrodes placed to identify epileptic foci. Stimuli were 50Hz click trains, presented continuously during an awake baseline period, and subsequently, while propofol infusion was incrementally titrated to induce general anesthesia. Electrocorticographic recordings were made with depth electrodes implanted in HG and subdural grid electrodes implanted over superior temporal gyrus (STG). Depth of anesthesia was monitored using spectral entropy. Averaged evoked potentials (AEPs), frequency-following responses (FFRs) and high gamma (70-150Hz) event-related band power were used to characterize auditory cortical activity. Based on the changes in AEPs and FFRs during the induction of anesthesia, posteromedial HG could be divided into two subdivisions. In the most posteromedial aspect of the gyrus, the earliest AEP deflections were preserved and FFRs increased during induction. In contrast, the remainder of the posteromedial HG exhibited attenuation of both the AEP and the FFR. The anterolateral HG exhibited weaker activation characterized by broad, low-voltage AEPs and the absence of FFRs. Lateral STG exhibited limited activation by click trains, and FFRs there diminished during induction. Sustained high gamma activity was attenuated in the most posteromedial portion of HG, and was absent in all other regions. These differential patterns of auditory cortical activity during the induction of anesthesia may serve as useful physiological markers for field delineation. In this study, the posteromedial HG could be parcellated into at least two subdivisions. Preservation of the earliest AEP deflections and FFRs in the posteromedial HG likely reflects the persistence of feedforward synaptic activity generated by inputs from subcortical auditory pathways, including the medial geniculate nucleus.

Multi-Regional Adaptation in Human Auditory Association Cortex

In auditory cortex, neural responses decrease with stimulus repetition, known as adaptation. Adaptation is thought to facilitate detection of novel sounds and improve perception in noisy environments. Although it is well established that adaptation occurs in primary auditory cortex, it is not known whether adaptation also occurs in higher auditory areas involved in processing complex sounds, such as speech. Resolving this issue is important for understanding the neural bases of adaptation and to avoid potential post-operative deficits after temporal lobe surgery for treatment of focal epilepsy. Intracranial electrocorticographic recordings were acquired simultaneously from electrodes implanted in primary and association auditory areas of the right (non-dominant) temporal lobe in a patient with complex partial seizures originating from the inferior parietal lobe. Simple and complex sounds were presented in a passive oddball paradigm. We measured changes in single-trial high-gamma power (70–150 Hz) and in regional and inter-regional network-level activity indexed by cross-frequency coupling. Repetitive tones elicited the greatest adaptation and corresponding increases in cross-frequency coupling in primary auditory cortex. Conversely, auditory association cortex showed stronger adaptation for complex sounds, including speech. This first report of multi-regional adaptation in human auditory cortex highlights the role of the non-dominant temporal lobe in suppressing neural responses to repetitive background sounds (noise). These results underscore the clinical utility of functional mapping to avoid potential post-operative deficits including increased listening difficulties in noisy, real-world environments.

Neural Correlates of Auditory Perceptual Awareness and Release from Informational Masking Recorded Directly from Human Cortex: A Case Study

In complex acoustic environments, even salient supra-threshold sounds sometimes go unperceived, a phenomenon known as informational masking. The neural basis of informational masking (and its release) has not been well-characterized, particularly outside auditory cortex. We combined electrocorticography in a neurosurgical patient undergoing invasive epilepsy monitoring with trial-by-trial perceptual reports of isochronous target-tone streams embedded in random multi-tone maskers. Awareness of such masker-embedded target streams was associated with a focal negativity between 100 and 200 ms and high-gamma activity (HGA) between 50 and 250 ms (both in auditory cortex on the posterolateral superior temporal gyrus) as well as a broad P3b-like potential (between ~300 and 600 ms) with generators in ventrolateral frontal and lateral temporal cortex. Unperceived target tones elicited drastically reduced versions of such responses, if at all. While it remains unclear whether these responses reflect conscious perception, itself, as opposed to pre- or post-perceptual processing, the results suggest that conscious perception of target sounds in complex listening environments may engage diverse neural mechanisms in distributed brain areas.

Hierarchy of prediction errors for auditory events in human temporal and frontal cortex

Predictive coding theories posit that neural networks learn statistical regularities in the environment for comparison with actual outcomes, signaling a prediction error (PE) when sensory deviation occurs. PE studies in audition have capitalized on low-frequency event-related potentials (LF-ERPs), such as the mismatch negativity. However, local cortical activity is well-indexed by higher-frequency bands [high-γ band (Hγ): 80-150 Hz]. We compared patterns of human Hγ and LF-ERPs in deviance detection using electrocorticographic recordings from subdural electrodes over frontal and temporal cortices. Patients listened to trains of task-irrelevant tones in two conditions differing in the predictability of a deviation from repetitive background stimuli (fully predictable vs. unpredictable deviants). We found deviance-related responses in both frequency bands over lateral temporal and inferior frontal cortex, with an earlier latency for Hγ than for LF-ERPs. Critically, frontal Hγ activity but not LF-ERPs discriminated between fully predictable and unpredictable changes, with frontal cortex sensitive to unpredictable events. The results highlight the role of frontal cortex and Hγ activity in deviance detection and PE generation.

Facilitative effect of repetitive presentation of one stimulus on cortical responses to other stimuli in macaque monkeys--a possible neural mechanism for mismatch negativity

The event-related potential 'mismatch negativity' (MMN) is an indicator of a perceiver's ability to detect deviations in sensory signal streams. MMN and its homologue in animals, mismatch activity (MMA), are differential neural responses to a repeatedly presented stimulus and a subsequent deviant stimulus (oddball). Because neural mechanisms underlying MMN and MMA remain unclear, there is a controversy as to whether MMN and MMA arise solely from stimulus-specific adaptation (SSA), in which the response to a stimulus cumulatively attenuates with its repetitive presentation. To address this issue, we used electrocorticography and the auditory roving-oddball paradigm in two awake macaque monkeys. We examined the effect of stimulus repetition number on MMA and on responses to repeated stimuli and oddballs across the cerebral cortex in the time-frequency domain. As the repetition number increased, MMA spread across the temporal, frontal and parietal cortices, and each electrode yielded a larger MMA. Surprisingly, this increment in MMA largely depended on response augmentation to the oddball rather than on SSA to the repeated stimulus. Following sufficient repetition, the oddball evoked a spectral power increment in some electrodes on the frontal cortex that had shown no power increase to the stimuli with less or no preceding repetition. We thereby revealed that repetitive presentation of one stimulus not only leads to SSA but also facilitates the cortical response to oddballs involving a wide range of cortical regions. This facilitative effect might underlie the generation of MMN-like scalp potentials in macaques that potentially shares similar neural mechanisms with MMN in humans.

Dissociated roles of the inferior frontal gyrus and superior temporal sulcus in audiovisual processing: top-down and bottom-up mismatch detection

Visual inputs can distort auditory perception, and accurate auditory processing requires the ability to detect and ignore visual input that is simultaneous and incongruent with auditory information. However, the neural basis of this auditory selection from audiovisual information is unknown, whereas integration process of audiovisual inputs is intensively researched. Here, we tested the hypothesis that the inferior frontal gyrus (IFG) and superior temporal sulcus (STS) are involved in top-down and bottom-up processing, respectively, of target auditory information from audiovisual inputs. We recorded high gamma activity (HGA), which is associated with neuronal firing in local brain regions, using electrocorticography while patients with epilepsy judged the syllable spoken by a voice while looking at a voice-congruent or -incongruent lip movement from the speaker. The STS exhibited stronger HGA if the patient was presented with information of large audiovisual incongruence than of small incongruence, especially if the auditory information was correctly identified. On the other hand, the IFG exhibited stronger HGA in trials with small audiovisual incongruence when patients correctly perceived the auditory information than when patients incorrectly perceived the auditory information due to the mismatched visual information. These results indicate that the IFG and STS have dissociated roles in selective auditory processing, and suggest that the neural basis of selective auditory processing changes dynamically in accordance with the degree of incongruity between auditory and visual information.