Hierarchical Organization of Frontotemporal Networks for the Prediction of Stimuli across Multiple Dimensions

Altered hierarchical auditory predictive processing after lesions to the orbitofrontal cortex

Orbitofrontal cortex (OFC) is classically linked to inhibitory control, emotion regulation, and reward processing. Recent perspectives propose that the OFC also generates predictions about perceptual events, actions, and their outcomes. We tested the role of the OFC in detecting violations of prediction at two levels of abstraction (i.e., hierarchical predictive processing) by studying the event-related potentials (ERPs) of patients with focal OFC lesions (n = 12) and healthy controls (n = 14) while they detected deviant sequences of tones in a local-global paradigm. The structural regularities of the tones were controlled at two hierarchical levels by rules defined at a local (i.e., between tones within sequences) and at a global (i.e., between sequences) level. In OFC patients, ERPs elicited by standard tones were unaffected at both local and global levels compared to controls. However, patients showed an attenuated mismatch negativity (MMN) and P3a to local prediction violation, as well as a diminished MMN followed by a delayed P3a to the combined local and global level prediction violation. The subsequent P3b component to conditions involving violations of prediction at the level of global rules was preserved in the OFC group. Comparable effects were absent in patients with lesions restricted to the lateral PFC, which lends a degree of anatomical specificity to the altered predictive processing resulting from OFC lesion. Overall, the altered magnitudes and time courses of MMN/P3a responses after lesions to the OFC indicate that the neural correlates of detection of auditory regularity violation are impacted at two hierarchical levels of rule abstraction.

Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies

Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.

Probing Beat Perception with Event-Related Potentials (ERPs) in Human Adults, Newborns, and Nonhuman Primates

The aim of this chapter is to give an overview of how the perception of rhythmic temporal regularity such as a regular beat in music can be studied in human adults, human newborns, and nonhuman primates using event-related brain potentials (ERPs). First, we discuss different aspects of temporal structure in general, and musical rhythm in particular, and we discuss the possible mechanisms underlying the perception of regularity (e.g., a beat) in rhythm. Additionally, we highlight the importance of dissociating beat perception from the perception of other types of structure in rhythm, such as predictable sequences of temporal intervals, ordinal structure, and rhythmic grouping. In the second section of the chapter, we start with a discussion of auditory ERPs elicited by infrequent and frequent sounds: ERP responses to regularity violations, such as mismatch negativity (MMN), N2b, and P3, as well as early sensory responses to sounds, such as P1 and N1, have been shown to be instrumental in probing beat perception. Subsequently, we discuss how beat perception can be probed by comparing ERP responses to sounds in regular and irregular sequences, and by comparing ERP responses to sounds in different metrical positions in a rhythm, such as on and off the beat or on strong and weak beats. Finally, we will discuss previous research that has used the aforementioned ERPs and paradigms to study beat perception in human adults, human newborns, and nonhuman primates. In doing so, we consider the possible pitfalls and prospects of the technique, as well as future perspectives.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Time-resolved dynamic computational modeling of human EEG recordings reveals gradients of generative mechanisms for the MMN response

Despite attempts to unify the different theoretical accounts of the mismatch negativity (MMN), there is still an ongoing debate on the neurophysiological mechanisms underlying this complex brain response. On one hand, neuronal adaptation to recurrent stimuli is able to explain many of the observed properties of the MMN, such as its sensitivity to controlled experimental parameters. On the other hand, several modeling studies reported evidence in favor of Bayesian learning models for explaining the trial-to-trial dynamics of the human MMN. However, direct comparisons of these two main hypotheses are scarce, and previous modeling studies suffered from methodological limitations. Based on reports indicating spatial and temporal dissociation of physiological mechanisms within the timecourse of mismatch responses in animals, we hypothesized that different computational models would best fit different temporal phases of the human MMN. Using electroencephalographic data from two independent studies of a simple auditory oddball task (n = 82), we compared adaptation and Bayesian learning models' ability to explain the sequential dynamics of auditory deviance detection in a time-resolved fashion. We first ran simulations to evaluate the capacity of our design to dissociate the tested models and found that they were sufficiently distinguishable above a certain level of signal-to-noise ratio (SNR). In subjects with a sufficient SNR, our time-resolved approach revealed a temporal dissociation between the two model families, with high evidence for adaptation during the early MMN window (from 90 to 150-190 ms post-stimulus depending on the dataset) and for Bayesian learning later in time (170-180 ms or 200-220ms). In addition, Bayesian model averaging of fixed-parameter models within the adaptation family revealed a gradient of adaptation rates, resembling the anatomical gradient in the auditory cortical hierarchy reported in animal studies.

Pre-attentive representation of prediction certainty in autism: A mismatch negativity (MMN) study

According to predictive processing theories of perception, the brain generates predictions to prepare for sensory input, and calibrates certainty of predictions based on their likelihood. When an input doesn't match the prediction, an error signal leads to updating of the predictive model. Prior research suggests altered prediction certainty in autism, but predictive processing occurs across the cortical hierarchy, and the stage(s) of processing where prediction certainty breaks down is unknown. We therefore tested the integrity of prediction certainty in autism at pre-attentive and relatively automatic processing stages using the pre-attentive Mismatch Negativity (MMN) brain response. The MMN occurs in response to a "deviant" presented in a stream of "standards" and is measured while the participant performs an orthogonal task. Most critically, MMN amplitude typically varies with the level of certainty associated with the prediction. We recorded high-density EEG while presenting adolescents and young adults with and without autism with repetitive tones every half second (the standard) interspersed with infrequent pitch and inter-stimulus-interval (ISI) deviants. Pitch and ISI deviant probabilities were manipulated at 4, 8, or 16% within a block of trials to test whether MMN amplitude varied in a typical manner with respect to probability. For both groups, Pitch-MMN amplitude increased as the probability of deviance decreased. Unexpectedly, ISI-MMN amplitude did not reliably vary by probability in either group. Our Pitch-MMN findings suggest intact neural representation of pre-attentive prediction certainty in autism, addressing a critical knowledge gap in autism research. The implications of these findings are considered.

LAY SUMMARY

Our brains are always trying to predict what will happen next. For example, when you open your utensil drawer, it would be surprising to see books because your brain expected to see utensils. In our study, we looked at whether the brains of autistic individuals automatically and accurately recognize when something unexpected happens. Results showed similar brain patterns in individuals with and without autism, suggesting that responses to prediction violations are generated in a typical manner during early cortical information processing.

Computational Modeling of Oddball Sequence Processing Exposes Common and Differential Auditory Network Changes in First-Episode Schizophrenia-Spectrum Disorders and Schizophrenia

BACKGROUND AND HYPOTHESIS

Differences in sound relevance filtering in schizophrenia are proposed to represent a key index of biological changes in brain function in the illness. This study featured a computational modeling approach to test the hypothesis that processing differences might already be evident in first-episode, becoming more pronounced in the established illness.

STUDY DESIGN

Auditory event-related potentials to a typical oddball sequence (rare pitch deviations amongst regular sounds) were recorded from 90 persons with schizophrenia-spectrum disorders (40 first-episode schizophrenia-spectrum, 50 established illness) and age-matched healthy controls. The data were analyzed using dynamic causal modeling to identify the changes in effective connectivity that best explained group differences.

STUDY RESULTS

Group differences were linked to intrinsic (within brain region) connectivity changes. In activity-dependent measures these were restricted to the left auditory cortex in first-episode schizophrenia-spectrum but were more widespread in the established illness. Modeling suggested that both established illness and first-episode schizophrenia-spectrum groups expressed significantly lower inhibition of inhibitory interneuron activity and altered gain on superficial pyramidal cells with the data indicative of differences in both putative N-methyl-d-aspartate glutamate receptor activity-dependent plasticity and classic neuromodulation.

CONCLUSIONS

The study provides further support for the notion that examining the ability to alter responsiveness to structured sound sequences in schizophrenia and first-episode schizophrenia-spectrum could be informative to uncovering the nature and progression of changes in brain function during the illness. Furthermore, modeling suggested that limited differences present at first-episode schizophrenia-spectrum may become more expansive with illness progression.

Preterm neonates distinguish rhythm violation through a hierarchy of cortical processing

Rhythm is a fundamental component of the auditory world, present even during the prenatal life. While there is evidence that some auditory capacities are already present before birth, whether and how the premature neural networks process auditory rhythm is yet not known. We investigated the neural response of premature neonates at 30-34 weeks gestational age to violations from rhythmic regularities in an auditory sequence using high-resolution electroencephalography and event-related potentials. Unpredicted rhythm violations elicited a fronto-central mismatch response, indicating that the premature neonates detected the rhythmic regularities. Next, we examined the cortical effective connectivity underlying the elicited mismatch response using dynamic causal modeling. We examined the connectivity between cortical sources using a set of 16 generative models that embedded alternate hypotheses about the role of the frontal cortex as well as backward fronto-temporal connection. Our results demonstrated that the processing of rhythm violations was not limited to the primary auditory areas, and as in the case of adults, encompassed a hierarchy of temporo-frontal cortical structures. The result also emphasized the importance of top-down (backward) projections from the frontal cortex in explaining the mismatch response. Our findings demonstrate a sophisticated cortical structure underlying predictive rhythm processing at the onset of the thalamocortical and cortico-cortical circuits, two months before term.

Distinct roles for the anterior temporal lobe and angular gyrus in the spatiotemporal cortical semantic network

Semantic knowledge is supported by numerous brain regions, but the spatiotemporal configuration of the network that links these areas remains an open question. The hub-and-spokes model posits that a central semantic hub coordinates this network. In this study, we explored distinct aspects that define a semantic hub, as reflected in the spatiotemporal modulation of neural activity and connectivity by semantic variables, from the earliest stages of semantic processing. We used source-reconstructed electro/magnetoencephalography, and investigated the concreteness contrast across three tasks. In a whole-cortex analysis, the left anterior temporal lobe (ATL) was the only area that showed modulation of evoked brain activity from 100 ms post-stimulus. Furthermore, using Dynamic Causal Modeling of the evoked responses, we investigated effective connectivity amongst the candidate semantic hub regions, that is, left ATL, supramarginal/angular gyrus (SMG/AG), middle temporal gyrus, and inferior frontal gyrus. We found that models with a single semantic hub showed the highest Bayesian evidence, and the hub region was found to change from ATL (within 250 ms) to SMG/AG (within 450 ms) over time. Our results support a single semantic hub view, with ATL showing sustained modulation of neural activity by semantics, and both ATL and AG underlying connectivity depending on the stage of semantic processing.

The neurophysiological effect of NMDA-R antagonism of frontotemporal lobar degeneration is conditional on individual GABA concentration

There is a pressing need to accelerate therapeutic strategies against the syndromes caused by frontotemporal lobar degeneration, including symptomatic treatments. One approach is for experimental medicine, coupling neurophysiological studies of the mechanisms of disease with pharmacological interventions aimed at restoring neurochemical deficits. Here we consider the role of glutamatergic deficits and their potential as targets for treatment. We performed a double-blind placebo-controlled crossover pharmaco-magnetoencephalography study in 20 people with symptomatic frontotemporal lobar degeneration (10 behavioural variant frontotemporal dementia, 10 progressive supranuclear palsy) and 19 healthy age- and gender-matched controls. Both magnetoencephalography sessions recorded a roving auditory oddball paradigm: on placebo or following 10 mg memantine, an uncompetitive NMDA-receptor antagonist. Ultra-high-field magnetic resonance spectroscopy confirmed lower concentrations of GABA in the right inferior frontal gyrus of people with frontotemporal lobar degeneration. While memantine showed a subtle effect on early-auditory processing in patients, there was no significant main effect of memantine on the magnitude of the mismatch negativity (MMN) response in the right frontotemporal cortex in patients or controls. However, the change in the right auditory cortex MMN response to memantine (vs. placebo) in patients correlated with individuals' prefrontal GABA concentration. There was no moderating effect of glutamate concentration or cortical atrophy. This proof-of-concept study demonstrates the potential for baseline dependency in the pharmacological restoration of neurotransmitter deficits to influence cognitive neurophysiology in neurodegenerative disease. With changes to multiple neurotransmitters in frontotemporal lobar degeneration, we suggest that individuals' balance of excitation and inhibition may determine drug efficacy, with implications for drug selection and patient stratification in future clinical trials.

Causal Evidence for the Multiple Demand Network in Change Detection: Auditory Mismatch Magnetoencephalography across Focal Neurodegenerative Diseases

The multiple demand (MD) system is a network of fronto-parietal brain regions active during the organization and control of diverse cognitive operations. It has been argued that this activation may be a nonspecific signal of task difficulty. However, here we provide convergent evidence for a causal role for the MD network in the "simple task" of automatic auditory change detection, through the impairment of top-down control mechanisms. We employ independent structure-function mapping, dynamic causal modeling (DCM), and frequency-resolved functional connectivity analyses of MRI and magnetoencephalography (MEG) from 75 mixed-sex human patients across four neurodegenerative syndromes [behavioral variant fronto-temporal dementia (bvFTD), nonfluent variant primary progressive aphasia (nfvPPA), posterior cortical atrophy (PCA), and Alzheimer's disease mild cognitive impairment with positive amyloid imaging (ADMCI)] and 48 age-matched controls. We show that atrophy of any MD node is sufficient to impair auditory neurophysiological response to change in frequency, location, intensity, continuity, or duration. There was no similar association with atrophy of the cingulo-opercular, salience or language networks, or with global atrophy. MD regions displayed increased functional but decreased effective connectivity as a function of neurodegeneration, suggesting partially effective compensation. Overall, we show that damage to any of the nodes of the MD network is sufficient to impair top-down control of sensation, providing a common mechanism for impaired change detection across dementia syndromes.SIGNIFICANCE STATEMENT Previous evidence for fronto-parietal networks controlling perception is largely associative and may be confounded by task difficulty. Here, we use a preattentive measure of automatic auditory change detection [mismatch negativity (MMN) magnetoencephalography (MEG)] to show that neurodegeneration in any frontal or parietal multiple demand (MD) node impairs primary auditory cortex (A1) neurophysiological response to change through top-down mechanisms. This explains why the impaired ability to respond to change is a core feature across dementias, and other conditions driven by brain network dysfunction, such as schizophrenia. It validates theoretical frameworks in which neurodegenerating networks upregulate connectivity as partially effective compensation. The significance extends beyond network science and dementia, in its construct validation of dynamic causal modeling (DCM), and human confirmation of frequency-resolved analyses of animal neurodegeneration models.

Violation of rhythmic expectancies can elicit late frontal gamma activity nested in theta oscillations

Rhythm processing involves building expectations according to the hierarchical temporal structure of auditory events. Although rhythm processing has been addressed in the context of predictive coding, the properties of the oscillatory response in different cortical areas are still not clear. We explored the oscillatory properties of the neural response to rhythmic incongruence and the cross-frequency coupling between multiple frequencies to further investigate the mechanisms underlying rhythm perception. We designed an experiment to investigate the neural response to rhythmic deviations in which the tone either arrived earlier than expected or the tone in the same metrical position was omitted. These two manipulations modulate the rhythmic structure differently, with the former creating a larger violation of the general structure of the musical stimulus than the latter. Both deviations resulted in an MMN response, whereas only the rhythmic deviant resulted in a subsequent P3a. Rhythmic deviants due to the early occurrence of a tone, but not omission deviants, seemed to elicit a late high gamma response (60-80 Hz) at the end of the P3a over the left frontal region, which, interestingly, correlated with the P3a amplitude over the same region and was also nested in theta oscillations. The timing of the elicited high-frequency gamma oscillations related to rhythmic deviation suggests that it might be related to the update of the predictive neural model, corresponding to the temporal structure of the events in higher-level cortical areas.

Hierarchical Pathways from Sensory Processing to Cognitive, Clinical, and Functional Impairments in Schizophrenia

Cognitive impairment is a hallmark of schizophrenia and a robust predictor of functional outcomes. Impairments are found in all phases of the illness and are only moderately attenuated by currently approved therapeutics. Neurophysiological indices of sensory discrimination (ie, mismatch negativity (MMN) and P3a amplitudes) and gamma-band auditory steady-state response (ASSR; power and phase locking) are translational biomarkers widely used in the development of novel therapeutics for neuropsychiatric disorders. It is unclear whether laboratory-based EEG measures add explanatory power to well-established models that use only cognitive, clinical, and functional outcome measures. Moreover, it is unclear if measures of sensory discrimination and gamma-band ASSR uniquely contribute to putative causal pathways linking sensory discrimination, neurocognition, negative symptoms, and functional outcomes in schizophrenia. To answer these questions, hierarchical associations among sensory processing, neurocognition, clinical symptoms, and functional outcomes were assessed via structural equation modeling in a large sample of schizophrenia patients (n = 695) and healthy comparison subjects (n = 503). The results showed that the neurophysiologic indices of sensory discrimination and gamma-band ASSR both significantly contribute to and yield unique hierarchical, "bottom-up" effects on neurocognition, symptoms, and functioning. Measures of sensory discrimination showed direct effects on neurocognition and negative symptoms, while gamma-band ASSR had a direct effect on neurocognition in patients. Continued investigation of the neural mechanisms underlying abnormal networks of MMN/P3a and gamma-band ASSR is needed to clarify the pathophysiology of schizophrenia and the development of novel therapeutic interventions.

GABAergic cortical network physiology in frontotemporal lobar degeneration

The clinical syndromes caused by frontotemporal lobar degeneration are heterogeneous, including the behavioural variant frontotemporal dementia (bvFTD) and progressive supranuclear palsy. Although pathologically distinct, they share many behavioural, cognitive and physiological features, which may in part arise from common deficits of major neurotransmitters such as γ-aminobutyric acid (GABA). Here, we quantify the GABAergic impairment and its restoration with dynamic causal modelling of a double-blind placebo-controlled crossover pharmaco-magnetoencephalography study. We analysed 17 patients with bvFTD, 15 patients with progressive supranuclear palsy, and 20 healthy age- and gender-matched controls. In addition to neuropsychological assessment and structural MRI, participants undertook two magnetoencephalography sessions using a roving auditory oddball paradigm: once on placebo and once on 10 mg of the oral GABA reuptake inhibitor tiagabine. A subgroup underwent ultrahigh-field magnetic resonance spectroscopy measurement of GABA concentration, which was reduced among patients. We identified deficits in frontotemporal processing using conductance-based biophysical models of local and global neuronal networks. The clinical relevance of this physiological deficit is indicated by the correlation between top-down connectivity from frontal to temporal cortex and clinical measures of cognitive and behavioural change. A critical validation of the biophysical modelling approach was evidence from parametric empirical Bayes analysis that GABA levels in patients, measured by spectroscopy, were related to posterior estimates of patients’ GABAergic synaptic connectivity. Further evidence for the role of GABA in frontotemporal lobar degeneration came from confirmation that the effects of tiagabine on local circuits depended not only on participant group, but also on individual baseline GABA levels. Specifically, the phasic inhibition of deep cortico-cortical pyramidal neurons following tiagabine, but not placebo, was a function of GABA concentration. The study provides proof-of-concept for the potential of dynamic causal modelling to elucidate mechanisms of human neurodegenerative disease, and explains the variation in response to candidate therapies among patients. The laminar- and neurotransmitter-specific features of the modelling framework, can be used to study other treatment approaches and disorders. In the context of frontotemporal lobar degeneration, we suggest that neurophysiological restoration in selected patients, by targeting neurotransmitter deficits, could be used to bridge between clinical and preclinical models of disease, and inform the personalized selection of drugs and stratification of patients for future clinical trials.

In Vivo Assay of Cortical Microcircuitry in Frontotemporal Dementia: A Platform for Experimental Medicine Studies

The analysis of neural circuits can provide crucial insights into the mechanisms of neurodegeneration and dementias, and offer potential quantitative biological tools to assess novel therapeutics. Here we use behavioral variant frontotemporal dementia (bvFTD) as a model disease. We demonstrate that inversion of canonical microcircuit models to noninvasive human magnetoencephalography, using dynamic causal modeling, can identify the regional- and laminar-specificity of bvFTD pathophysiology, and their parameters can accurately differentiate patients from matched healthy controls. Using such models, we show that changes in local coupling in frontotemporal dementia underlie the failure to adequately establish sensory predictions, leading to altered prediction error responses in a cortical information-processing hierarchy. Using machine learning, this model-based approach provided greater case-control classification accuracy than conventional evoked cortical responses. We suggest that this approach provides an in vivo platform for testing mechanistic hypotheses about disease progression and pharmacotherapeutics.

Dysfunctional frontal activation of mismatch negativity in panic disorder: A magnetoencephalographic study

BACKGROUND

Mismatch negativity (MMN) or its magnetic counterpart (MMNm) is a neurophysiological signal to reflect the automatic change-detection ability. However, MMN studies in patients with panic disorder (PD) showed contrasting results using electroencephalographic (EEG) recordings. The present study attempted to overcome the limitations of EEG methodology by means of a whole-head magnetoencephalography (MEG) combined with the depth-weighted minimum norm estimate method to conduct an in-depth investigation on the MMNm at the cortical level in patients with PD.

METHODS

We recruited 22 healthy controls (HC) and 20 patients with PD to perform auditory oddball paradigm during MEG recordings. The cortical MMNm amplitudes and latencies in the superior temporal gyrus, inferior parietal lobule, and inferior frontal gyrus (IFG) were compared between the HC and PD groups. The correlations between MMNm responses and clinical measurement were also examined.

RESULTS

Compared with the HC group, the PD group demonstrated significantly reduced MMNm amplitudes in the IFG. Furthermore, higher trait scores of the State-Trait Anxiety Inventory were associated with lower MMNm amplitudes of the right IFG among patients with PD.

LIMITATIONS

Generalization of the current results to other settings or samples should be made cautiously due to the use of different medication regimens and presence of comorbidities in our patients.

CONCLUSIONS

Our data suggest dysfunctional pre-attentive change-detection ability in patients with PD, particularly in the IFG.

Do Auditory Mismatch Responses Differ Between Acoustic Features?

Mismatch negativity (MMN) is the electroencephalographic (EEG) waveform obtained by subtracting event-related potential (ERP) responses evoked by unexpected deviant stimuli from responses evoked by expected standard stimuli. While the MMN is thought to reflect an unexpected change in an ongoing, predictable stimulus, it is unknown whether MMN responses evoked by changes in different stimulus features have different magnitudes, latencies, and topographies. The present study aimed to investigate whether MMN responses differ depending on whether sudden stimulus change occur in pitch, duration, location or vowel identity, respectively. To calculate ERPs to standard and deviant stimuli, EEG signals were recorded in normal-hearing participants (N = 20; 13 males, 7 females) who listened to roving oddball sequences of artificial syllables. In the roving paradigm, any given stimulus is repeated several times to form a standard, and then suddenly replaced with a deviant stimulus which differs from the standard. Here, deviants differed from preceding standards along one of four features (pitch, duration, vowel or interaural level difference). The feature levels were individually chosen to match behavioral discrimination performance. We identified neural activity evoked by unexpected violations along all four acoustic dimensions. Evoked responses to deviant stimuli increased in amplitude relative to the responses to standard stimuli. A univariate (channel-by-channel) analysis yielded no significant differences between MMN responses following violations of different features. However, in a multivariate analysis (pooling information from multiple EEG channels), acoustic features could be decoded from the topography of mismatch responses, although at later latencies than those typical for MMN. These results support the notion that deviant feature detection may be subserved by a different process than general mismatch detection.

Sources of the frontocentral mismatch negativity and P3a responses in schizophrenia patients and healthy comparison subjects

BACKGROUND

Mismatch negativity (MMN) and P3a are event-related potential measures of early auditory information processing that are increasingly used as translational biomarkers in the development of treatments for neuropsychiatric disorders. These responses are reduced in schizophrenia patients over the frontocentral scalp electrodes and are associated with important domains of cognitive and psychosocial functioning. While MMN and P3a responses are generated by a dynamic network of cortical sources distributed across the temporal and frontal brain regions, it is not clear how these sources independently contribute to MMN and P3a at the primary frontocentral scalp electrode or to abnormalities observed in schizophrenia. This study aimed to determine the independent source contributions and characterize the magnitude of impairment in source-level MMN and P3a responses in schizophrenia patients.

METHODS

A novel method was applied to back-project the contributions of 11 independent cortical source components to Fz, the primary scalp sensor that is used in clinical studies, in n = 589 schizophrenia patients and n = 449 healthy comparison subjects.

RESULTS

The groups showed comparable individual source contributions underlying both MMN and P3a responses at Fz. Source-level responses revealed an increasing magnitude of impairment in schizophrenia patients from the temporal to more frontal sources.

CONCLUSIONS

Schizophrenia patients have a normal architecture of source contributions that are accompanied by widespread abnormalities in source resolved mismatch and P3a responses, with more prominent deficits detected from the frontal sources. Quantification of source contributions and source-level responses accelerates clarification of the neural networks underlying MMN reduction at Fz in schizophrenia patients.

Face-like configurations modulate electrophysiological mismatch responses

The human face is one of the most salient stimuli in the environment. It has been suggested that even basic face-like configurations (three dots composing a downward pointing triangle) may convey salience. Interestingly, stimulus salience can be signaled by mismatch detection phenomena, characterized by greater amplitudes of event-related potentials (ERPs) in response to relevant novel stimulation as compared to non-relevant repeated events. Here, we investigate whether basic face-like stimuli are salient enough to modulate mismatch detection phenomena. ERPs are elicited by a pair of sequentially presented visual stimuli (S1-S2), delivered at a constant 1-s interval, representing either a face-like stimulus (Upright configuration) or three neutral configurations (Inverted, Leftwards, and Rightwards configurations), that are obtained by rotating the Upright configuration along the three different axes. In pairs including a canonical face-like stimulus, we observe a more effective mismatch detection mechanism, with significantly larger N270 and P300 components when S2 is different from S1 as compared to when S2 is identical to S1. This ERP modulation, not significant in pairs excluding face-like stimuli, reveals that mismatch detection phenomena are significantly affected by basic face-like configurations. Even though further experiments are needed to ascertain whether this effect is specifically elicited by face-like configuration rather than by particular orientation changes, our findings suggest that face essential, structural attributes are salient enough to affect change detection processes.

Direct Evidence for Prediction Signals in Frontal Cortex Independent of Prediction Error

Predictive coding (PC) has been suggested as one of the main mechanisms used by brains to interact with complex environments. PC theories posit top-down prediction signals, which are compared with actual outcomes, yielding in turn prediction error (PE) signals, which are used, bottom-up, to modify the ensuing predictions. However, disentangling prediction from PE signals has been challenging. Critically, while many studies found indirect evidence for PC in the form of PE signals, direct evidence for the prediction signal is mostly lacking. Here, we provide clear evidence, obtained from intracranial cortical recordings in human surgical patients, that the human lateral prefrontal cortex evinces prediction signals while anticipating an event. Patients listened to task-irrelevant sequences of repetitive tones including infrequent predictable or unpredictable pitch deviants. The broadband high-frequency amplitude (HFA) was decreased prior to the onset of expected relative to unexpected deviants in the frontal cortex only, and its amplitude was sensitive to the increasing likelihood of deviants following longer trains of standards in the unpredictable condition. Single-trial HFA predicted deviations and correlated with poststimulus response to deviations. These results provide direct evidence for frontal cortex prediction signals independent of PE signals.

Glutamatergic modulation of auditory cortex connectivity with attentional brain networks in unpredictable perceptual environment

In a stable environment the brain can minimize processing required for sensory input by forming a predictive model of the surrounding world and suppressing neural response to predicted stimuli. Unpredicted stimuli lead to a prediction error signal propagation through the perceptual network, and resulting adjustment to the predictive model. The inter-regional plasticity which enables the model-building and model-adjustment is hypothesized to be mediated via glutamatergic receptors. While pharmacological challenge studies with glutamate receptor ligands have demonstrated impact on prediction-error indices, it is not clear how inter-individual differences in the glutamate system affect the prediction-error processing in non-medicated state. In the present study we examined 20 healthy young subjects with resting-state proton MRS spectroscopy to characterize glutamate + glutamine (rs-Glx) levels in their Heschl’s gyrus (HG), and related this to HG functional connectivity during a roving auditory oddball protocol. No rs-Glx effects were found within the frontotemporal prediction-error network. Larger rs-Glx signal was related to stronger connectivity between HG and bilateral inferior parietal lobule during unpredictable auditory stimulation. We also found effects of rs-Glx on the coherence of default mode network and frontoparietal network during unpredictable auditory stimulation. Our results demonstrate the importance of Glx in modulating long-range connections and wider networks in the brain during perceptual inference.

Sedation Modulates Frontotemporal Predictive Coding Circuits and the Double Surprise Acceleration Effect

Two important theories in cognitive neuroscience are predictive coding (PC) and the global workspace (GW) theory. A key research task is to understand how these two theories relate to one another, and particularly, how the brain transitions from a predictive early state to the eventual engagement of a brain-scale state (the GW). To address this question, we present a source-localization of EEG responses evoked by the local-global task—an experimental paradigm that engages a predictive hierarchy, which encompasses the GW. The results of our source reconstruction suggest three phases of processing. The first phase involves the sensory (here auditory) regions of the superior temporal lobe and predicts sensory regularities over a short timeframe (as per the local effect). The third phase is brain-scale, involving inferior frontal, as well as inferior and superior parietal regions, consistent with a global neuronal workspace (GNW; as per the global effect). Crucially, our analysis suggests that there is an intermediate (second) phase, involving modulatory interactions between inferior frontal and superior temporal regions. Furthermore, sedation with propofol reduces modulatory interactions in the second phase. This selective effect is consistent with a PC explanation of sedation, with propofol acting on descending predictions of the precision of prediction errors; thereby constraining access to the GNW.

Investigating cortico-subcortical circuits during auditory sensory attenuation: A combined magnetoencephalographic and dynamic causal modeling study

Sensory attenuation refers to the decreased intensity of a sensory percept when a sensation is self‐generated compared with when it is externally triggered. However, the underlying brain regions and network interactions that give rise to this phenomenon remain to be determined. To address this issue, we recorded magnetoencephalographic (MEG) data from 35 healthy controls during an auditory task in which pure tones were either elicited through a button press or passively presented. We analyzed the auditory M100 at sensor‐ and source‐level and identified movement‐related magnetic fields (MRMFs). Regression analyses were used to further identify brain regions that contributed significantly to sensory attenuation, followed by a dynamic causal modeling (DCM) approach to explore network interactions between generators. Attenuation of the M100 was pronounced in right Heschl's gyrus (HES), superior temporal cortex (ST), thalamus, rolandic operculum (ROL), precuneus and inferior parietal cortex (IPL). Regression analyses showed that right postcentral gyrus (PoCG) and left precentral gyrus (PreCG) predicted M100 sensory attenuation. In addition, DCM results indicated that auditory sensory attenuation involved bi‐directional information flow between thalamus, IPL, and auditory cortex. In summary, our data show that sensory attenuation is mediated by bottom‐up and top‐down information flow in a thalamocortical network, providing support for the role of predictive processing in sensory‐motor system.

Abnormal Effective Connectivity Underlying Auditory Mismatch Negativity Impairments in Schizophrenia

BACKGROUND

Auditory mismatch negativity (MMN) is a translatable event-related potential biomarker, and its reduction in schizophrenia is associated with the severity of clinical symptoms. While MMN recorded at the scalp is generated by a distributed network of temporofrontal neural sources, the primary contributing sources and the dynamic interactions among sources underlying MMN impairments in schizophrenia have not been previously characterized.

METHODS

A novel data-driven analytic framework was applied to large cohorts of healthy comparison subjects (n = 449) and patients with schizophrenia (n = 589) to identify the independent contributing sources of MMN, characterize the patterns of effective connectivity underlying reduced MMN in patients, and explore the clinical significance of these abnormal source dynamics in schizophrenia.

RESULTS

A network of 11 independent contributing sources underlying MMN distributed across temporofrontal cortices was identified. Orderly shifts in peak source activity were detected in a steplike manner, starting at temporal structures and progressing across frontal brain regions. MMN reduction in patients was predominantly associated with reduced contributions from 3 frontal midline sources: orbitofrontal, anterior cingulate, and middle cingulate cortices. Patients showed increased connectivity from temporal to prefrontal regions in conjunction with decreased cross-hemispheric connectivity to prefrontal regions. The decreased connectivity strength of precentral to prefrontal regions in patients with schizophrenia was associated with greater severity of negative symptoms.

CONCLUSIONS

Alterations in the dynamic interactions among temporofrontal sources underlie MMN abnormalities in schizophrenia. These results advance our understanding of the neural substrates and temporal dynamics of normal and impaired information processing with novel applications for translatable biomarkers of neuropsychiatric disorders.

Working Memory Load Modulates Neuronal Coupling

There is a severe limitation in the number of items that can be held in working memory. However, the neurophysiological limits remain unknown. We asked whether the capacity limit might be explained by differences in neuronal coupling. We developed a theoretical model based on Predictive Coding and used it to analyze Cross Spectral Density data from the prefrontal cortex (PFC), frontal eye fields (FEF), and lateral intraparietal area (LIP). Monkeys performed a change detection task. The number of objects that had to be remembered (memory load) was varied (1-3 objects in the same visual hemifield). Changes in memory load changed the connectivity in the PFC-FEF-LIP network. Feedback (top-down) coupling broke down when the number of objects exceeded cognitive capacity. Thus, impaired behavioral performance coincided with a break-down of Prediction signals. This provides new insights into the neuronal underpinnings of cognitive capacity and how coupling in a distributed working memory network is affected by memory load.

The brain tracks auditory rhythm predictability independent of selective attention

The brain responds to violations of expected rhythms, due to extraction- and prediction of the temporal structure in auditory input. Yet, it is unknown how probability of rhythm violations affects the overall rhythm predictability. Another unresolved question is whether predictive processes are independent of attention processes. In this study, EEG was recorded while subjects listened to rhythmic sequences. Predictability was manipulated by changing the stimulus-onset-asynchrony (SOA deviants) for given tones in the rhythm. When SOA deviants were inserted rarely, predictability remained high, whereas predictability was lower with more frequent SOA deviants. Dichotic tone-presentation allowed for independent manipulation of attention, as specific tones of the rhythm were presented to separate ears. Attention was manipulated by instructing subjects to attend to tones in one ear only, while keeping the rhythmic structure of tones constant. The analyses of event-related potentials revealed an attenuated N1 for tones when rhythm predictability was high, while the N1 was enhanced by attention to tones. Bayesian statistics revealed no interaction between predictability and attention. A right-lateralization of attention effects, but not predictability effects, suggested potentially different cortical processes. This is the first study to show that probability of rhythm violation influences rhythm predictability, independent of attention.

Incidental or Intentional? Different Brain Responses to One's Own Action Sounds in Hurdling vs. Tap Dancing

Most human actions produce concomitant sounds. Action sounds can be either part of the action goal (GAS, goal-related action sounds), as for instance in tap dancing, or a mere by-product of the action (BAS, by-product action sounds), as for instance in hurdling. It is currently unclear whether these two types of action sounds-incidental or intentional-differ in their neural representation and whether the impact on the performance evaluation of an action diverges between the two. We here examined whether during the observation of tap dancing compared to hurdling, auditory information is a more important factor for positive action quality ratings. Moreover, we tested whether observation of tap dancing vs. hurdling led to stronger attenuation in primary auditory cortex, and a stronger mismatch signal when sounds do not match our expectations. We recorded individual point-light videos of newly trained participants performing tap dancing and hurdling. In the subsequent functional magnetic resonance imaging (fMRI) session, participants were presented with the videos that displayed their own actions, including corresponding action sounds, and were asked to rate the quality of their performance. Videos were either in their original form or scrambled regarding the visual modality, the auditory modality, or both. As hypothesized, behavioral results showed significantly lower rating scores in the GAS condition compared to the BAS condition when the auditory modality was scrambled. Functional MRI contrasts between BAS and GAS actions revealed higher activation of primary auditory cortex in the BAS condition, speaking in favor of stronger attenuation in GAS, as well as stronger activation of posterior superior temporal gyri and the supplementary motor area in GAS. Results suggest that the processing of self-generated action sounds depends on whether we have the intention to produce a sound with our action or not, and action sounds may be more prone to be used as sensory feedback when they are part of the explicit action goal. Our findings contribute to a better understanding of the function of action sounds for learning and controlling sound-producing actions.

Auditory-vocal control system is object for predictive processing within seconds time range

Predictive processing across hierarchically organized time scales is one of the fundamental principles of neural computations in the cerebral cortex. We hypothesize that relatively complex aggregation of auditory and vocal brain systems that use auditory feedback for reflexive control of vocalizations can be an object for predictive processing. We used repetitive patterns of perturbations in auditory feedback during vocalizations to elicit implicit expectations that were violated by surprising direction of perturbations in one of the experimental conditions. Our results provide empirical support for the idea that formation of expectancy for integrated auditory-vocal brain systems, within the time range of seconds, resulted in two sequential neuronal processes. The first process reflects monitoring and error detection in prediction about perturbations in auditory feedback during vocalizations within the time range of seconds. The second neuronal process can be attributed to the optimization of brain predictions for sensory contingencies during vocalizations at separable and distinct timescales.

Cortical mapping of mismatch responses to independent acoustic features

Predictive coding is an influential theory of neural processing underlying perceptual inference. However, it is unknown to what extent prediction violations of different sensory features are mediated in different regions in auditory cortex, with different dynamics, and by different mechanisms. This study investigates the neural responses to synthesized acoustic syllables, which could be expected or unexpected, along several features. By using electrocorticography (ECoG) in rat auditory cortex (subjects: adult female Wistar rats with normal hearing), we aimed at mapping regional differences in mismatch responses to different stimulus features. Continuous streams of morphed syllables formed roving oddball sequences in which each stimulus was repeated several times (thereby forming a standard) and subsequently replaced with a deviant stimulus which differed from the standard along one of several acoustic features: duration, pitch, interaural level differences (ILD), or consonant identity. Each of these features could assume one of several different levels, and the resulting change from standard to deviant could be larger or smaller. The deviant stimuli were then repeated to form new standards. We analyzed responses to the first repetition of a new stimulus (deviant) and its last repetition in a stimulus train (standard). For the ECoG recording, we implanted urethane-anaesthetized rats with 8 × 8 surface electrode arrays covering a 3 × 3 mm cortical patch encompassing primary and higher-order auditory cortex. We identified the response topographies and latencies of population activity evoked by acoustic stimuli in the rat auditory regions, and mapped their sensitivity to expectation violations along different acoustic features. For all features, the responses to deviant stimuli increased in amplitude relative to responses to standard stimuli. Deviance magnitude did not further modulate these mismatch responses. Mismatch responses to different feature violations showed a heterogeneous distribution across cortical areas, with no evidence for systematic topographic gradients for any of the tested features. However, within rats, the spatial distribution of mismatch responses varied more between features than the spatial distribution of tone-evoked responses. This result supports the notion that prediction error signaling along different stimulus features is subserved by different cortical populations, albeit with substantial heterogeneity across individuals.

GABA-ergic Dynamics in Human Frontotemporal Networks Confirmed by Pharmaco-Magnetoencephalography

To bridge the gap between preclinical cellular models of disease and in vivo imaging of human cognitive network dynamics, there is a pressing need for informative biophysical models. Here we assess dynamic causal models (DCM) of cortical network responses, as generative models of magnetoencephalographic observations during an auditory oddball roving paradigm in healthy adults. This paradigm induces robust perturbations that permeate frontotemporal networks, including an evoked 'mismatch negativity' response and transiently induced oscillations. Here, we probe GABAergic influences in the networks using double-blind placebo-controlled randomized-crossover administration of the GABA reuptake inhibitor, tiagabine (oral, 10 mg) in healthy older adults. We demonstrate the facility of conductance-based neural mass mean-field models, incorporating local synaptic connectivity, to investigate laminar-specific and GABAergic mechanisms of the auditory response. The neuronal model accurately recapitulated the observed magnetoencephalographic data. Using parametric empirical Bayes for optimal model inversion across both drug sessions, we identify the effect of tiagabine on GABAergic modulation of deep pyramidal and interneuronal cell populations. We found a transition of the main GABAergic drug effects from auditory cortex in standard trials to prefrontal cortex in deviant trials. The successful integration of pharmaco- magnetoencephalography with dynamic causal models of frontotemporal networks provides a potential platform on which to evaluate the effects of disease and pharmacological interventions.SIGNIFICANCE STATEMENT Understanding human brain function and developing new treatments require good models of brain function. We tested a detailed generative model of cortical microcircuits that accurately reproduced human magnetoencephalography, to quantify network dynamics and connectivity in frontotemporal cortex. This approach identified the effect of a test drug (GABA-reuptake inhibitor, tiagabine) on neuronal function (GABA-ergic dynamics), opening the way for psychopharmacological studies in health and disease with the mechanistic precision afforded by generative models of the brain.

Neural Signal to Violations of Abstract Rules Using Speech-Like Stimuli

As the evidence of predictive processes playing a role in a wide variety of cognitive domains increases, the brain as a predictive machine becomes a central idea in neuroscience. In auditory processing, a considerable amount of progress has been made using variations of the Oddball design, but most of the existing work seems restricted to predictions based on physical features or conditional rules linking successive stimuli. To characterize the predictive capacity of the brain to abstract rules, we present here two experiments that use speech-like stimuli to overcome limitations and avoid common confounds. Pseudowords were presented in isolation, intermixed with infrequent deviants that contained unexpected phoneme sequences. As hypothesized, the occurrence of unexpected sequences of phonemes reliably elicited an early prediction error signal. These prediction error signals do not seemed to be modulated by attentional manipulations due to different task instructions, suggesting that the predictions are deployed even when the task at hand does not volitionally involve error detection. In contrast, the amount of syllables congruent with a standard pseudoword presented before the point of deviance exerted a strong modulation. Prediction error’s amplitude doubled when two congruent syllables were presented instead of one, despite keeping local transitional probabilities constant. This suggests that auditory predictions can be built integrating information beyond the immediate past. In sum, the results presented here further contribute to the understanding of the predictive capabilities of the human auditory system when facing complex stimuli and abstract rules.

Auditory deviance detection in the human insula: An intracranial EEG study

The human insula is known to be involved in auditory processing, but knowledge about its precise functional role and the underlying electrophysiology is limited. To assess its role in automatic auditory deviance detection we analyzed the EEG high frequency activity (HFA; 75-145 Hz) and ERPs from 90 intracranial insular channels across 16 patients undergoing pre-surgical intracranial monitoring for epilepsy treatment. Subjects passively listened to a stream of standard and deviant tones differing in four physical dimensions: intensity, frequency, location or time. HFA responses to auditory stimuli were found in the short and long gyri, and the anterior, superior, and inferior segments of the circular sulcus of the insular cortex. Only a subset of channels in the inferior segment of the circular sulcus of the insula showed HFA deviance detection responses, i.e., a greater and longer latency response to specific deviants relative to standards. Auditory deviancy processing was also later in the insula when compared with the superior temporal cortex. ERP results were more widespread and supported the HFA insular findings. These results provide evidence that the human insula is engaged during auditory deviance detection.

Young children integrate current observations, priors and agent information to predict others' actions

From early on in life, children are able to use information from their environment to form predictions about events. For instance, they can use statistical information about a population to predict the sample drawn from that population and infer an agent’s preferences from systematic violations of random sampling. We investigated whether and how young children infer an agent’s sampling biases. Moreover, we examined whether pupil data of toddlers follow the predictions of a computational model based on the causal Bayesian network formalization of predictive processing. We formalized three hypotheses about how different explanatory variables (i.e., prior probabilities, current observations, and agent characteristics) are used to predict others’ actions. We measured pupillary responses as a behavioral marker of ‘prediction errors’ (i.e., the perceived mismatch between what one’s model of an agent predicts and what the agent actually does). Pupillary responses of 24-month-olds, but not 18-month-olds, showed that young children integrated information about current observations, priors and agents to make predictions about agents and their actions. These findings shed light on the mechanisms behind toddlers’ inferences about agent-caused events. To our knowledge, this is the first study in which young children's pupillary responses are used as markers of prediction errors, which were qualitatively compared to the predictions by a computational model based on the causal Bayesian network formalization of predictive processing.

Altered neocortical tactile but preserved auditory early change detection responses in Friedreich ataxia

OBJECTIVE

To study using magnetoencephalography (MEG) the spatio-temporal dynamics of neocortical responses involved in sensory processing and early change detection in Friedreich ataxia (FRDA).

METHODS

Tactile (TERs) and auditory (AERs) evoked responses, and early neocortical change detection responses indexed by the mismatch negativity (MMN) were recorded using tactile and auditory oddballs in sixteen FRDA patients and matched healthy subjects. Correlations between the maximal amplitude of each response, genotype and clinical parameters were investigated.

RESULTS

Evoked responses were detectable in all FRDA patients but one. In patients, TERs were delayed and reduced in amplitude, while AERs were only delayed. Only tactile MMN responses at the contralateral secondary somatosensory cortex were altered in FRDA patients. Maximal amplitudes of TERs, AERs and tactile MMN correlated with genotype, but did not correlate with clinical parameters.

CONCLUSIONS

In FRDA, theamplitude of tactile MMN responses at SII cortex are reduced and correlate with the genotype, whileauditory MMN responses are not altered.

SIGNIFICANCE

Somatosensory pathways and tactile early change detection are selectively impaired in FRDA.

Deviance detection is the dominant component of auditory contextual processing in the lateral superior temporal gyrus: A human ECoG study

Auditory contextual processing has been assumed to be based on a hierarchical structure consisting of the primary auditory cortex, superior temporal gyrus (STG), and frontal lobe. Recent invasive studies on mismatch negativity (MMN) have revealed functional segregation for auditory contextual processing such as neural adaptation in the primary auditory cortex and prediction in the frontal lobe. However, the role of the STG remains unclear. We obtained induced activity in the high gamma band as mismatch response (MMR), an electrocorticographic (ECoG) counterpart to scalp MMN, and the components of MMR by analyzing ECoG data from patients with refractory epilepsy in an auditory oddball task paradigm. We found that MMR localized mainly in the bilateral posterior STGs, and that deviance detection largely accounted for MMR. Furthermore, adaptation was identified in a limited number of electrodes on the superior temporal plane. Our findings reveal a mixed contribution of deviance detection and adaptation depending on location in the STG. Such spatial considerations could lead to further understanding of the pathophysiology of relevant psychiatric disorders.

Not All Predictions Are Equal: "What" and "When" Predictions Modulate Activity in Auditory Cortex through Different Mechanisms

Using predictions based on environmental regularities is fundamental for adaptive behavior. While it is widely accepted that predictions across different stimulus attributes (e.g., time and content) facilitate sensory processing, it is unknown whether predictions across these attributes rely on the same neural mechanism. Here, to elucidate the neural mechanisms of predictions, we combine invasive electrophysiological recordings (human electrocorticography in 4 females and 2 males) with computational modeling while manipulating predictions about content ("what") and time ("when"). We found that "when" predictions increased evoked activity over motor and prefrontal regions both at early (∼180 ms) and late (430-450 ms) latencies. "What" predictability, however, increased evoked activity only over prefrontal areas late in time (420-460 ms). Beyond these dissociable influences, we found that "what" and "when" predictability interactively modulated the amplitude of early (165 ms) evoked responses in the superior temporal gyrus. We modeled the observed neural responses using biophysically realistic neural mass models, to better understand whether "what" and "when" predictions tap into similar or different neurophysiological mechanisms. Our modeling results suggest that "what" and "when" predictability rely on complementary neural processes: "what" predictions increased short-term plasticity in auditory areas, whereas "when" predictability increased synaptic gain in motor areas. Thus, content and temporal predictions engage complementary neural mechanisms in different regions, suggesting domain-specific prediction signaling along the cortical hierarchy. Encoding predictions through different mechanisms may endow the brain with the flexibility to efficiently signal different sources of predictions, weight them by their reliability, and allow for their encoding without mutual interference.SIGNIFICANCE STATEMENT Predictions of different stimulus features facilitate sensory processing. However, it is unclear whether predictions of different attributes rely on similar or different neural mechanisms. By combining invasive electrophysiological recordings of cortical activity with experimental manipulations of participants' predictions about content and time of acoustic events, we found that the two types of predictions had dissociable influences on cortical activity, both in terms of the regions involved and the timing of the observed effects. Further, our biophysical modeling analysis suggests that predictability of content and time rely on complementary neural processes: short-term plasticity in auditory areas and synaptic gain in motor areas, respectively. This suggests that predictions of different features are encoded with complementary neural mechanisms in different brain regions.

Selective Prefrontal Disinhibition in a Roving Auditory Oddball Paradigm Under N-Methyl-D-Aspartate Receptor Blockade

BACKGROUND

Disturbances in N-methyl-D-aspartate receptors (NMDARs)-as implicated in patients with schizophrenia-can cause regionally specific electrophysiological effects. Both animal models of NMDAR blockade and clinical studies in patients with schizophrenia have suggested that behavioral phenotypes are associated with reduction in inhibition within the frontal cortex.

METHODS

Here we investigate event-related potentials to a roving auditory oddball paradigm under ketamine in healthy human volunteers (N= 18; double-blind, placebo-controlled, crossover design). Using recent advances in Bayesian modeling of group effects in dynamic causal modeling, we fit biophysically plausible network models of the auditory processing hierarchy to whole-scalp event-related potential recordings. This allowed us to identify regionally specific effects of ketamine in a distributed network of interacting cortical sources.

RESULTS

We show that the effect of ketamine is best explained as a selective change in intrinsic inhibition, with a pronounced ketamine-induced reduction of inhibitory interneuron connectivity in frontal sources, compared with temporal sources. Simulations of these changes in an integrated microcircuit model shows that they are associated with a reduction in superficial pyramidal cell activity that can explain drug effects observed in the event-related potential.

CONCLUSIONS

These results are consistent with findings from invasive recordings in animal models exposed to NMDAR blockers, and provide evidence that inhibitory interneuron-specific NMDAR dysfunction may be sufficient to explain electrophysiological abnormalities induced by NMDAR blockade in human subjects.

Neurophysiological signatures of Alzheimer's disease and frontotemporal lobar degeneration: pathology versus phenotype

The disruption of brain networks is characteristic of neurodegenerative dementias. However, it is controversial whether changes in connectivity reflect only the functional anatomy of disease, with selective vulnerability of brain networks, or the specific neurophysiological consequences of different neuropathologies within brain networks. We proposed that the oscillatory dynamics of cortical circuits reflect the tuning of local neural interactions, such that different pathologies are selective in their impact on the frequency spectrum of oscillations, whereas clinical syndromes reflect the anatomical distribution of pathology and physiological change. To test this hypothesis, we used magnetoencephalography from five patient groups, representing dissociated pathological subtypes and distributions across frontal, parietal and temporal lobes: amnestic Alzheimer's disease, posterior cortical atrophy, and three syndromes associated with frontotemporal lobar degeneration. We measured effective connectivity with graph theory-based measures of local efficiency, using partial directed coherence between sensors. As expected, each disease caused large-scale changes of neurophysiological brain networks, with reductions in local efficiency compared to controls. Critically however, the frequency range of altered connectivity was consistent across clinical syndromes that shared a likely underlying pathology, whilst the localization of changes differed between clinical syndromes. Multivariate pattern analysis of the frequency-specific topographies of local efficiency separated the disorders from each other and from controls (accuracy 62% to 100%, according to the groups' differences in likely pathology and clinical syndrome). The data indicate that magnetoencephalography has the potential to reveal specific changes in neurophysiology resulting from neurodegenerative disease. Our findings confirm that while clinical syndromes have characteristic anatomical patterns of abnormal connectivity that may be identified with other methods like structural brain imaging, the different mechanisms of neurodegeneration also cause characteristic spectral signatures of physiological coupling that are not accessible with structural imaging nor confounded by the neurovascular signalling of functional MRI. We suggest that these spectral characteristics of altered connectivity are the result of differential disruption of neuronal microstructure and synaptic physiology by Alzheimer's disease versus frontotemporal lobar degeneration.

Monitoring the past and choosing the future: the prefrontal cortical influences on voluntary action

Choosing between equivalent response options requires the resolution of ambiguity. One could facilitate such decisions by monitoring previous actions and implementing transient or arbitrary rules to differentiate response options. This would reduce the entropy of chosen actions. We examined voluntary action decisions during magnetoencephalography, identifying the spatiotemporal correlates of stimulus- and choice-entropy. Negative correlations between frontotemporal activity and entropy of past trials were observed after participants’ responses, reflecting sequential monitoring of recent events. In contrast, choice entropy correlated negatively with prefrontal activity, before and after participants’ response, consistent with transient activation of latent response-sets ahead of a decision and updating the monitor of recent decisions after responding. Individual differences in current choices were related to the strength of the prefrontal signals that reflect monitoring of the statistical regularities in previous events. Together, these results explain individual expressions of voluntary action, through differential engagement of prefrontal areas to guide sequential decisions.

Association between mismatch negativity and global functioning is specific to duration deviance in early stages of psychosis

BACKGROUND

Mismatch negativity (MMN) is a candidate biomarker for early stages of psychosis. Although an association among duration MMN (dMMN), cognitive deficits, and functional outcome in chronic schizophrenia has been shown by a large-scale study, the effects of deviant type and clinical stages have not been investigated.

METHODS

We investigated the relationships among dMMN, frequency MMN (fMMN), global functioning, and cognitive function in early stages of psychosis. The participants included 26 individuals with recent-onset schizophrenia (ROSZ), 30 individuals with ultra-high risk (UHR), and 20 healthy controls.

RESULTS

The correlational analyses revealed that dMMN amplitude, which was impaired in the ROSZ group compared to the healthy controls, correlated with global functioning (Global Assessment of Functioning-Functioning scale) in the ROSZ (r=-0.45) and UHR (r=-0.37) groups. The amplitude of fMMN, which did not differ among the groups, correlated with working memory (r=-0.57) only in the ROSZ group. The path analyses indicated that dMMN had a direct effect on global functioning in the ROSZ and UHR groups while fMMN had a direct effect on working memory only in the ROSZ group.

CONCLUSIONS

Our findings suggested that the association between MMN and global functioning was specific to the duration deviant and was already present in early stages of psychosis. These findings confirm the usefulness of dMMN as a biological marker of early psychosis to guide treatment interventions.

Visual Mismatch and Predictive Coding: A Computational Single-Trial ERP Study

Predictive coding (PC) posits that the brain uses a generative model to infer the environmental causes of its sensory data and uses precision-weighted prediction errors (pwPEs) to continuously update this model. While supported by much circumstantial evidence, experimental tests grounded in formal trial-by-trial predictions are rare. One partial exception is event-related potential (ERP) studies of the auditory mismatch negativity (MMN), where computational models have found signatures of pwPEs and related model-updating processes. Here, we tested this hypothesis in the visual domain, examining possible links between visual mismatch responses and pwPEs. We used a novel visual "roving standard" paradigm to elicit mismatch responses in humans (of both sexes) by unexpected changes in either color or emotional expression of faces. Using a hierarchical Bayesian model, we simulated pwPE trajectories of a Bayes-optimal observer and used these to conduct a comprehensive trial-by-trial analysis across the time × sensor space. We found significant modulation of brain activity by both color and emotion pwPEs. The scalp distribution and timing of these single-trial pwPE responses were in agreement with visual mismatch responses obtained by traditional averaging and subtraction (deviant-minus-standard) approaches. Finally, we compared the Bayesian model to a more classical change model of MMN. Model comparison revealed that trial-wise pwPEs explained the observed mismatch responses better than categorical change detection. Our results suggest that visual mismatch responses reflect trial-wise pwPEs, as postulated by PC. These findings go beyond classical ERP analyses of visual mismatch and illustrate the utility of computational analyses for studying automatic perceptual processes.SIGNIFICANCE STATEMENT Human perception is thought to rely on a predictive model of the environment that is updated via precision-weighted prediction errors (pwPEs) when events violate expectations. This "predictive coding" view is supported by studies of the auditory mismatch negativity brain potential. However, it is less well known whether visual perception of mismatch relies on similar processes. Here we combined computational modeling and electroencephalography to test whether visual mismatch responses reflected trial-by-trial pwPEs. Applying a Bayesian model to series of face stimuli that violated expectations about color or emotional expression, we found significant modulation of brain activity by both color and emotion pwPEs. A categorical change detection model performed less convincingly. Our findings support the predictive coding interpretation of visual mismatch responses.

One wouldn't expect an expert bowler to hit only two pins: Hierarchical predictive processing of agent-caused events

Evidence is accumulating that our brains process incoming information using top-down predictions. If lower level representations are correctly predicted by higher level representations, this enhances processing. However, if they are incorrectly predicted, additional processing is required at higher levels to “explain away” prediction errors. Here, we explored the potential nature of the models generating such predictions. More specifically, we investigated whether a predictive processing model with a hierarchical structure and causal relations between its levels is able to account for the processing of agent-caused events. In Experiment 1, participants watched animated movies of “experienced” and “novice” bowlers. The results are in line with the idea that prediction errors at a lower level of the hierarchy (i.e., the outcome of how many pins fell down) slow down reporting of information at a higher level (i.e., which agent was throwing the ball). Experiments 2 and 3 suggest that this effect is specific to situations in which the predictor is causally related to the outcome. Overall, the study supports the idea that a hierarchical predictive processing model can account for the processing of observed action outcomes and that the predictions involved are specific to cases where action outcomes can be predicted based on causal knowledge.

Cardio-audio synchronization drives neural surprise response

Successful prediction of future events depends on the brain’s capacity to extract temporal regularities from sensory inputs. Neuroimaging studies mainly investigated regularity processing for exteroceptive sensory inputs (i.e. from outside the body). Here we investigated whether interoceptive signals (i.e. from inside the body) can mediate auditory regularity processing. Human participants passively listened to sound sequences presented in synchrony or asynchrony to their heartbeat while concomitant electroencephalography was recorded. We hypothesized that the cardio-audio synchronicity would induce a brain expectation of future sounds. Electrical neuroimaging analysis revealed a surprise response at 158–270 ms upon omission of the expected sounds in the synchronous condition only. Control analyses ruled out that this effect was trivially based on expectation from the auditory temporal structure or on differences in heartbeat physiological signals. Implicit neural monitoring of temporal regularities across interoceptive and exteroceptive signals drives prediction of future events in auditory sequences.

Great Expectations: Is there Evidence for Predictive Coding in Auditory Cortex?

Predictive coding is possibly one of the most influential, comprehensive, and controversial theories of neural function. While proponents praise its explanatory potential, critics object that key tenets of the theory are untested or even untestable. The present article critically examines existing evidence for predictive coding in the auditory modality. Specifically, we identify five key assumptions of the theory and evaluate each in the light of animal, human and modeling studies of auditory pattern processing. For the first two assumptions - that neural responses are shaped by expectations and that these expectations are hierarchically organized - animal and human studies provide compelling evidence. The anticipatory, predictive nature of these expectations also enjoys empirical support, especially from studies on unexpected stimulus omission. However, for the existence of separate error and prediction neurons, a key assumption of the theory, evidence is lacking. More work exists on the proposed oscillatory signatures of predictive coding, and on the relation between attention and precision. However, results on these latter two assumptions are mixed or contradictory. Looking to the future, more collaboration between human and animal studies, aided by model-based analyses will be needed to test specific assumptions and implementations of predictive coding - and, as such, help determine whether this popular grand theory can fulfill its expectations.

The Cumulative Effects of Predictability on Synaptic Gain in the Auditory Processing Stream

Stimulus predictability can lead to substantial modulations of brain activity, such as shifts in sustained magnetic field amplitude, measured with magnetoencephalography (MEG). Here, we provide a mechanistic explanation of these effects using MEG data acquired from healthy human volunteers (N = 13, 7 female). In a source-level analysis of induced responses, we established the effects of orthogonal predictability manipulations of rapid tone-pip sequences (namely, sequence regularity and alphabet size) along the auditory processing stream. In auditory cortex, regular sequences with smaller alphabets induced greater gamma activity. Furthermore, sequence regularity shifted induced activity in frontal regions toward higher frequencies. To model these effects in terms of the underlying neurophysiology, we used dynamic causal modeling for cross-spectral density and estimated slow fluctuations in neural (postsynaptic) gain. Using the model-based parameters, we accurately explain the sensor-level sustained field amplitude, demonstrating that slow changes in synaptic efficacy, combined with sustained sensory input, can result in profound and sustained effects on neural responses to predictable sensory streams.

SIGNIFICANCE STATEMENT Brain activity can be strongly modulated by the predictability of stimuli it is currently processing. An example of such a modulation is a shift in sustained magnetic field amplitude, measured with magnetoencephalography. Here, we provide a mechanistic explanation of these effects. First, we establish the oscillatory neural correlates of independent predictability manipulations in hierarchically distinct areas of the auditory processing stream. Next, we use a biophysically realistic computational model to explain these effects in terms of the underlying neurophysiology. Finally, using the model-based parameters describing neural gain modulation, we can explain the previously unexplained effects observed at the sensor level. This demonstrates that slow modulations of synaptic gain can result in profound and sustained effects on neural activity.

Expectation violation and attention to pain jointly modulate neural gain in somatosensory cortex

The neural processing and experience of pain are influenced by both expectations and attention. For example, the amplitude of event-related pain responses is enhanced by both novel and unexpected pain, and by moving the focus of attention towards a painful stimulus. Under predictive coding, this congruence can be explained by appeal to a precision-weighting mechanism, which mediates bottom-up and top-down attentional processes by modulating the influence of feedforward and feedback signals throughout the cortical hierarchy. The influence of expectation and attention on pain processing can be mapped onto changes in effective connectivity between or within specific neuronal populations, using a canonical microcircuit (CMC) model of hierarchical processing. We thus implemented a CMC within dynamic causal modelling for magnetoencephalography in human subjects, to investigate how expectation violation and attention to pain modulate intrinsic (within-source) and extrinsic (between-source) connectivity in the somatosensory hierarchy. This enabled us to establish whether both expectancy and attentional processes are mediated by a similar precision-encoding mechanism within a network of somatosensory, frontal and parietal sources. We found that both unexpected and attended pain modulated the gain of superficial pyramidal cells in primary and secondary somatosensory cortex. This modulation occurred in the context of increased lateralized recurrent connectivity between somatosensory and fronto-parietal sources, driven by unexpected painful occurrences. Finally, the strength of effective connectivity parameters in S1, S2 and IFG predicted individual differences in subjective pain modulation ratings. Our findings suggest that neuromodulatory gain control in the somatosensory hierarchy underlies the influence of both expectation violation and attention on cortical processing and pain perception.

Alteration of Duration Mismatch Negativity Induced by Transcranial Magnetic Stimulation Over the Left Parietal Lobe

Mismatch negativity (MMN) is generated by a comparison between an incoming sound and the memory trace of preceding sounds stored in sensory memory without any attention to the sound. N100 (N1) is associated with the afferent response to sound onset and reflects early analysis of stimulus characteristics. MMN generators are present in the temporal and frontal lobe, and N1 generators are present in the temporal lobe. The parietal lobe is involved in MMN generation elicited by a change in duration. The anatomical network connecting these areas, lateralization, and the effect of the side of ear stimulation on MMN remain unknown. Thus, we studied the effects of low-frequency repetitive transcranial magnetic stimulation (rTMS) over the left parietal lobe on MMN and N1 in 10 healthy subjects. Low-frequency rTMS over the left parietal lobe decreased the amplitude of MMN following right ear sound stimulation, but the amplitude was unaffected with left ear sound stimulation. We observed no significant changes in the amplitude of N1 or the latency of MMN or N1. These results suggest that low-frequency rTMS over the left parietal lobe modulates the detection of early auditory changes in duration in healthy subjects. Stimulation that is contralateral to the side of the ear experiencing sound may affect the generation of duration MMN more than ipsilateral stimulation.