Neurons along the auditory pathway exhibit a hierarchical organization of prediction error

High-performance wide-band open-source system for acoustic stimulation

The design and characterization of a low-cost, open-source auditory delivery system to deliver high performance auditory stimuli is presented. The system includes a high-fidelity sound card and audio amplifier devices with low-latency and wide bandwidth targeted for behavioral neuroscience research. The characterization of the individual devices and the entire system is performed, providing a thorough audio characterization data for varying frequencies and sound levels. The system implements the open-source Harp protocol, enabling the hardware timestamping of devices and seamless synchronization with other Harp devices.

Physiological properties of auditory neurons responding to omission deviants in the anesthetized rat

The detection of novel, low probability events in the environment is critical for survival. To perform this vital task, our brain is continuously building and updating a model of the outside world; an extensively studied phenomenon commonly referred to as predictive coding. Predictive coding posits that the brain is continuously extracting regularities from the environment to generate predictions. These predictions are then used to supress neuronal responses to redundant information, filtering those inputs, which then automatically enhances the remaining, unexpected inputs. We have recently described the ability of auditory neurons to generate predictions about expected sensory inputs by detecting their absence in an oddball paradigm using omitted tones as deviants. Here, we studied the responses of individual neurons to omitted tones by presenting individual sequences of repetitive pure tones, using both random and periodic omissions, presented at both fast and slow rates in the inferior colliculus and auditory cortex neurons of anesthetized rats. Our goal was to determine whether feature-specific dependence of these predictions exists. Results showed that omitted tones could be detected at both high (8 Hz) and slow repetition rates (2 Hz), with detection being more robust at the non-lemniscal auditory pathway.

Cortical-subcortical interactions underlie processing of auditory predictions measured with 7T fMRI

Perception integrates both sensory inputs and internal models of the environment. In the auditory domain, predictions play a critical role because of the temporal nature of sounds. However, the precise contribution of cortical and subcortical structures in these processes and their interaction remain unclear. It is also unclear whether these brain interactions are specific to abstract rules or if they also underlie the predictive coding of local features. We used high-field 7T functional magnetic resonance imaging to investigate interactions between cortical and subcortical areas during auditory predictive processing. Volunteers listened to tone sequences in an oddball paradigm where the predictability of the deviant was manipulated. Perturbations in periodicity were also introduced to test the specificity of the response. Results indicate that both cortical and subcortical auditory structures encode high-order predictive dynamics, with the effect of predictability being strongest in the auditory cortex. These predictive dynamics were best explained by modeling a top-down information flow, in contrast to unpredicted responses. No error signals were observed to deviations of periodicity, suggesting that these responses are specific to abstract rule violations. Our results support the idea that the high-order predictive dynamics observed in subcortical areas propagate from the auditory cortex.

Decoding contextual influences on auditory perception from primary auditory cortex

Perception can be highly dependent on stimulus context, but whether and how sensory areas encode the context remains uncertain. We used an ambiguous auditory stimulus - a tritone pair - to investigate the neural activity associated with a preceding contextual stimulus that strongly influenced the tritone pair's perception: either as an ascending or a descending step in pitch. We recorded single-unit responses from a population of auditory cortical cells in awake ferrets listening to the tritone pairs preceded by the contextual stimulus. We find that the responses adapt locally to the contextual stimulus, consistent with human MEG recordings from the auditory cortex under the same conditions. Decoding the population responses demonstrates that cells responding to pitch-class-changes are able to predict well the context-sensitive percept of the tritone pairs. Conversely, decoding the individual pitch-class representations and taking their distance in the circular Shepard tone space predicts the opposite of the percept. The various percepts can be readily captured and explained by a neural model of cortical activity based on populations of adapting, pitch-class and pitch-class-direction cells, aligned with the neurophysiological responses. Together, these decoding and model results suggest that contextual influences on perception may well be already encoded at the level of the primary sensory cortices, reflecting basic neural response properties commonly found in these areas.

Neural interactions in the human frontal cortex dissociate reward and punishment learning

How human prefrontal and insular regions interact while maximizing rewards and minimizing punishments is unknown. Capitalizing on human intracranial recordings, we demonstrate that the functional specificity toward reward or punishment learning is better disentangled by interactions compared to local representations. Prefrontal and insular cortices display non-selective neural populations to rewards and punishments. Non-selective responses, however, give rise to context-specific interareal interactions. We identify a reward subsystem with redundant interactions between the orbitofrontal and ventromedial prefrontal cortices, with a driving role of the latter. In addition, we find a punishment subsystem with redundant interactions between the insular and dorsolateral cortices, with a driving role of the insula. Finally, switching between reward and punishment learning is mediated by synergistic interactions between the two subsystems. These results provide a unifying explanation of distributed cortical representations and interactions supporting reward and punishment learning.

EVIDENCE FOR AUDITORY STIMULUS-SPECIFIC ADAPTATION BUT NOT DEVIANCE DETECTION IN LARVAL ZEBRAFISH BRAINS

Animals receive a constant stream of sensory input, and detecting changes in this sensory landscape is critical to their survival. One signature of change detection in humans is the auditory mismatch negativity (MMN), a neural response to unexpected stimuli that deviate from a predictable sequence. This process requires the auditory system to adapt to specific repeated stimuli while remaining sensitive to novel input (stimulus-specific adaptation). MMN was originally described in humans, and equivalent responses have been found in other mammals and birds, but it is not known to what extent this deviance detection circuitry is evolutionarily conserved. Here we present the first evidence for stimulus-specific adaptation in the brain of a teleost fish, using whole-brain calcium imaging of larval zebrafish at single-neuron resolution with selective plane illumination microscopy. We found frequency-specific responses across the brain with variable response amplitudes for frequencies of the same volume, and created a loudness curve to model this effect. We presented an auditory 'oddball' stimulus in an otherwise predictable train of pure tone stimuli, and did not find a population of neurons with specific responses to deviant tones that were not otherwise explained by stimulus-specific adaptation. Further, we observed no deviance responses to an unexpected omission of a sound in a repetitive sequence of white noise bursts. These findings extend the known scope of auditory adaptation and deviance responses across the evolutionary tree, and lay groundwork for future studies to describe the circuitry underlying auditory adaptation at the level of individual neurons.

Two Prediction Error Systems in the Nonlemniscal Inferior Colliculus: "Spectral" and "Nonspectral"

According to the predictive processing framework, perception emerges from the reciprocal exchange of predictions and prediction errors (PEs) between hierarchically organized neural circuits. The nonlemniscal division of the inferior colliculus (IC) is the earliest source of auditory PE signals, but their neuronal generators, properties, and functional relevance have remained mostly undefined. We recorded single-unit mismatch responses to auditory oddball stimulation at different intensities, together with activity evoked by two sequences of alternating tones to control frequency-specific effects. Our results reveal a differential treatment of the unpredictable "many-standards" control and the predictable "cascade" control by lemniscal and nonlemniscal IC neurons that is not present in the auditory thalamus or cortex. Furthermore, we found that frequency response areas of nonlemniscal IC neurons reflect their role in subcortical predictive processing, distinguishing three hierarchical levels: (1) nonlemniscal neurons with sharply tuned receptive fields exhibit mild repetition suppression without signaling PEs, thereby constituting the input level of the local predictive processing circuitry. (2) Neurons with broadly tuned receptive fields form the main, "spectral" PE signaling system, which provides dynamic gain compensation to near-threshold unexpected sounds. This early enhancement of saliency reliant on spectral features was not observed in the auditory thalamus or cortex. (3) Untuned neurons form an accessory, "nonspectral" PE signaling system, which reports all surprising auditory deviances in a robust and consistent manner, resembling nonlemniscal neurons in the auditory cortex. These nonlemniscal IC neurons show unstructured and unstable receptive fields that could result from inhibitory input controlled by corticofugal projections conveying top-down predictions.

Distributed representations of prediction error signals across the cortical hierarchy are synergistic

A relevant question concerning inter-areal communication in the cortex is whether these interactions are synergistic. Synergy refers to the complementary effect of multiple brain signals conveying more information than the sum of each isolated signal. Redundancy, on the other hand, refers to the common information shared between brain signals. Here, we dissociated cortical interactions encoding complementary information (synergy) from those sharing common information (redundancy) during prediction error (PE) processing. We analyzed auditory and frontal electrocorticography (ECoG) signals in five common awake marmosets performing two distinct auditory oddball tasks and investigated to what extent event-related potentials (ERP) and broadband (BB) dynamics encoded synergistic and redundant information about PE processing. The information conveyed by ERPs and BB signals was synergistic even at lower stages of the hierarchy in the auditory cortex and between auditory and frontal regions. Using a brain-constrained neural network, we simulated the synergy and redundancy observed in the experimental results and demonstrated that the emergence of synergy between auditory and frontal regions requires the presence of strong, long-distance, feedback, and feedforward connections. These results indicate that distributed representations of PE signals across the cortical hierarchy can be highly synergistic.

Visual omitted stimulus potentials are not retinotopic

Omitted stimulus potentials (OSPs) are elicited in response to the omission of expected stimuli and are thought to reflect prediction errors. If prediction errors are signaled in the sensory cortex, OSPs are expected to be generated in the sensory cortex. The present study investigated the involvement of the early visual cortex in the generation of OSPs by testing whether omitted visual stimuli elicit brain responses in a spatially specific manner. Checkerboard pattern stimuli were presented alternately in the upper and lower visual fields, and the stimuli were omitted in 10 % of the trials. Event-related potentials were recorded from 33 participants. While a retinotopic C1 component was evoked by real visual stimuli, omitted stimuli did not produce any response reflecting retinotopy but did elicit a visual mismatch negativity, which was larger for omitted stimuli expected in the lower visual field than for those in the upper visual field. These results suggest that omitted visual stimuli are processed in a different pathway than actual stimuli.

Population coding of time-varying sounds in the nonlemniscal inferior colliculus

The inferior colliculus (IC) of the midbrain is important for complex sound processing, such as discriminating conspecific vocalizations and human speech. The IC's nonlemniscal, dorsal "shell" region is likely important for this process, as neurons in these layers project to higher-order thalamic nuclei that subsequently funnel acoustic signals to the amygdala and nonprimary auditory cortices, forebrain circuits important for vocalization coding in a variety of mammals, including humans. However, the extent to which shell IC neurons transmit acoustic features necessary to discern vocalizations is less clear, owing to the technical difficulty of recording from neurons in the IC's superficial layers via traditional approaches. Here, we use two-photon Ca2+ imaging in mice of either sex to test how shell IC neuron populations encode the rate and depth of amplitude modulation, important sound cues for speech perception. Most shell IC neurons were broadly tuned, with a low neurometric discrimination of amplitude modulation rate; only a subset was highly selective to specific modulation rates. Nevertheless, neural network classifier trained on fluorescence data from shell IC neuron populations accurately classified amplitude modulation rate, and decoding accuracy was only marginally reduced when highly tuned neurons were omitted from training data. Rather, classifier accuracy increased monotonically with the modulation depth of the training data, such that classifiers trained on full-depth modulated sounds had median decoding errors of ∼0.2 octaves. Thus, shell IC neurons may transmit time-varying signals via a population code, with perhaps limited reliance on the discriminative capacity of any individual neuron.NEW & NOTEWORTHY The IC's shell layers originate a "nonlemniscal" pathway important for perceiving vocalization sounds. However, prior studies suggest that individual shell IC neurons are broadly tuned and have high response thresholds, implying a limited reliability of efferent signals. Using Ca2+ imaging, we show that amplitude modulation is accurately represented in the population activity of shell IC neurons. Thus, downstream targets can read out sounds' temporal envelopes from distributed rate codes transmitted by populations of broadly tuned neurons.

Functional Localization of the Human Auditory and Visual Thalamus Using a Thalamic Localizer Functional Magnetic Resonance Imaging Task

Functional magnetic resonance imaging (fMRI) of the auditory and visual sensory systems of the human brain is an active area of investigation in the study of human health and disease. The medial geniculate nucleus (MGN) and lateral geniculate nucleus (LGN) are key thalamic nuclei involved in the processing and relay of auditory and visual information, respectively, and are the subject of blood-oxygen-level-dependent (BOLD) fMRI studies of neural activation and functional connectivity in human participants. However, localization of BOLD fMRI signal originating from neural activity in MGN and LGN remains a technical challenge, due in part to the poor definition of boundaries of these thalamic nuclei in standard T1-weighted and T2-weighted magnetic resonance imaging sequences. Here, we report the development and evaluation of an auditory and visual sensory thalamic localizer (TL) fMRI task that produces participant-specific functionally-defined regions of interest (fROIs) of both MGN and LGN, using 3 Tesla multiband fMRI and a clustered-sparse temporal acquisition sequence, in less than 16 minutes of scan time. We demonstrate the use of MGN and LGN fROIs obtained from the TL fMRI task in standard resting-state functional connectivity (RSFC) fMRI analyses in the same participants. In RSFC analyses, we validated the specificity of MGN and LGN fROIs for signals obtained from primary auditory and visual cortex, respectively, and benchmark their performance against alternative atlas- and segmentation-based localization methods. The TL fMRI task and analysis code (written in Presentation and MATLAB, respectively) have been made freely available to the wider research community.

Spontaneously emerging internal models of visual sequences combine abstract and event-specific information in the prefrontal cortex

When exposed to sensory sequences, do macaque monkeys spontaneously form abstract internal models that generalize to novel experiences? Here, we show that neuronal populations in macaque ventrolateral prefrontal cortex jointly encode visual sequences by separate codes for the specific pictures presented and for their abstract sequential structure. We recorded prefrontal neurons while macaque monkeys passively viewed visual sequences and sequence mismatches in the local-global paradigm. Even without any overt task or response requirements, prefrontal populations spontaneously form representations of sequence structure, serial order, and image identity within distinct but superimposed neuronal subspaces. Representations of sequence structure rapidly update following single exposure to a mismatch sequence, while distinct populations represent mismatches for sequences of different complexity. Finally, those representations generalize across sequences following the same repetition structure but comprising different images. These results suggest that prefrontal populations spontaneously encode rich internal models of visual sequences reflecting both content-specific and abstract information.

Neural correlates of novelty detection in the primary auditory cortex of behaving monkeys

The neural mechanisms underlying novelty detection are not well understood, especially in relation to behavior. Here, we present single-unit responses from the primary auditory cortex (A1) from two monkeys trained to detect deviant tones amid repetitive ones. Results show that monkeys can detect deviant sounds, and there is a strong correlation between late neuronal responses (250-350 ms after deviant onset) and the monkeys' perceptual decisions. The magnitude and timing of both neuronal and behavioral responses are increased by larger frequency differences between the deviant and standard tones and by increasing the number of standard tones preceding the deviant. This suggests that A1 neurons encode novelty detection in behaving monkeys, influenced by stimulus relevance and expectations. This study provides evidence supporting aspects of predictive coding in the sensory cortex.

How 'hidden hearing loss' noise exposure affects neural coding in the inferior colliculus of rats

Exposure to brief, intense sound can produce profound changes in the auditory system, from the internal structure of inner hair cells to reduced synaptic connections between the auditory nerves and the inner hair cells. Moreover, noisy environments can also lead to alterations in the auditory nerve or to processing changes in the auditory midbrain, all without affecting hearing thresholds. This so-called hidden hearing loss (HHL) has been shown in tinnitus patients and has been posited to account for hearing difficulties in noisy environments. However, much of the neuronal research thus far has investigated how HHL affects the response characteristics of individual fibres in the auditory nerve, as opposed to higher stations in the auditory pathway. Human models show that the auditory nerve encodes sound stochastically. Therefore, a sufficient reduction in nerve fibres could result in lowering the sampling of the acoustic scene below the minimum rate necessary to fully encode the scene, thus reducing the efficacy of sound encoding. Here, we examine how HHL affects the responses to frequency and intensity of neurons in the inferior colliculus of rats, and the duration and firing rate of those responses. Finally, we examined how shorter stimuli are encoded less effectively by the auditory midbrain than longer stimuli, and how this could lead to a clinical test for HHL.

Somatosensory omissions reveal action-related predictive processing

The intricate relation between action and somatosensory perception has been studied extensively in the past decades. Generally, a forward model is thought to predict the somatosensory consequences of an action. These models propose that when an action is reliably coupled to a tactile stimulus, unexpected absence of the stimulus should elicit prediction error. Although such omission responses have been demonstrated in the auditory modality, it remains unknown whether this mechanism generalizes across modalities. This study therefore aimed to record action-induced somatosensory omission responses using EEG in humans. Self-paced button presses were coupled to somatosensory stimuli in 88% of trials, allowing a prediction, or in 50% of trials, not allowing a prediction. In the 88% condition, stimulus omission resulted in a neural response consisting of multiple components, as revealed by temporal principal component analysis. The oN1 response suggests similar sensory sources as stimulus-evoked activity, but an origin outside primary cortex. Subsequent oN2 and oP3 responses, as previously observed in the auditory domain, likely reflect modality-unspecific higher order processes. Together, findings straightforwardly demonstrate somatosensory predictions during action and provide evidence for a partially amodal mechanism of prediction error generation.

Auditory processing control by the medial prefrontal cortex: A review of the rodent functional organisation

Afferent inputs from the cochlea transmit auditory information to the central nervous system, where information is processed and passed up the hierarchy, ending in the auditory cortex. Through these brain pathways, spectral and temporal features of sounds are processed and sent to the cortex for perception. There are also many mechanisms in place for modulation of these inputs, with a major source of modulation being based in the medial prefrontal cortex (mPFC). Neurons of the rodent mPFC receive input from the auditory cortex and other regions such as thalamus, hippocampus and basal forebrain, allowing them to encode high-order information about sounds such as context, predictability and valence. The mPFC then exerts control over auditory perception via top-down modulation of the central auditory pathway, altering perception of and responses to sounds. The result is a higher-order control of auditory processing that produces such characteristics as deviance detection, attention, avoidance and fear conditioning. This review summarises connections between mPFC and the primary auditory pathway, responses of mPFC neurons to auditory stimuli, how mPFC outputs shape the perception of sounds, and how changes to these systems during hearing loss and tinnitus may contribute to these conditions.

Deviance Detection to Natural Stimuli in Population Responses of the Brainstem of Bats

Deviance detection describes an increase of neural response strength caused by a stimulus with a low probability of occurrence. This ubiquitous phenomenon has been reported for humans and multiple other species, from subthalamic areas to the auditory cortex. Cortical deviance detection has been well characterized by a range of studies using a variety of different stimuli, from artificial to natural, with and without a behavioral relevance. This allowed the identification of a broad variety of regularity deviations that are detected by the cortex. Moreover, subcortical deviance detection has been studied with simple stimuli that are not meaningful to the subject. Here, we aim to bridge this gap by using noninvasively recorded auditory brainstem responses (ABRs) to investigate deviance detection at population level in the lower stations of the auditory system of a highly vocal species: the bat Carollia perspicillata (of either sex). Our present approach uses behaviorally relevant vocalization stimuli that are similar to the animals' natural soundscape. We show that deviance detection in ABRs is significantly stronger for echolocation pulses than for social communication calls or artificial sounds, indicating that subthalamic deviance detection depends on the behavioral meaning of a stimulus. Additionally, complex physical sound features like frequency- and amplitude modulation affected the strength of deviance detection in the ABR. In summary, our results suggest that the brain can detect different types of deviants already in the brainstem, showing that subthalamic brain structures exhibit more advanced forms of deviance detection than previously known.

Cerebellar interpositus nucleus exhibits time-dependent errors and predictive responses

Learning is a functional state of the brain that should be understood as a continuous process, rather than being restricted to the very moment of its acquisition, storage, or retrieval. The cerebellum operates by comparing predicted states with actual states, learning from errors, and updating its internal representation to minimize errors. In this regard, we studied cerebellar interpositus nucleus (IPn) functional capabilities by recording its unitary activity in behaving rabbits during an associative learning task: the classical conditioning of eyelid responses. We recorded IPn neurons in rabbits during classical eyeblink conditioning using a delay paradigm. We found that IPn neurons reduce error signals across conditioning sessions, simultaneously increasing and transmitting spikes before the onset of the unconditioned stimulus. Thus, IPn neurons generate predictions that optimize in time and shape the conditioned eyeblink response. Our results are consistent with the idea that the cerebellum works under Bayesian rules updating the weights using the previous history.

Dynamic fading memory and expectancy effects in the monkey primary visual cortex

In order to investigate the involvement of the primary visual cortex (V1) in working memory (WM), parallel, multisite recordings of multi-unit activity were obtained from monkey V1 while the animals performed a delayed match-to-sample (DMS) task. During the delay period, V1 population firing rate vectors maintained a lingering trace of the sample stimulus that could be reactivated by intervening impulse stimuli that enhanced neuronal firing. This fading trace of the sample did not require active engagement of the monkeys in the DMS task and likely reflects the intrinsic dynamics of recurrent cortical networks in lower visual areas. This renders an active, attention-dependent involvement of V1 in the maintenance of WM contents unlikely. By contrast, population responses to the test stimulus depended on the probabilistic contingencies between sample and test stimuli. Responses to tests that matched expectations were reduced which agrees with concepts of predictive coding.

Altered hierarchical auditory predictive processing after lesions to the orbitofrontal cortex

Orbitofrontal cortex (OFC) is classically linked to inhibitory control, emotion regulation, and reward processing. Recent perspectives propose that the OFC also generates predictions about perceptual events, actions, and their outcomes. We tested the role of the OFC in detecting violations of prediction at two levels of abstraction (i.e., hierarchical predictive processing) by studying the event-related potentials (ERPs) of patients with focal OFC lesions (n = 12) and healthy controls (n = 14) while they detected deviant sequences of tones in a local-global paradigm. The structural regularities of the tones were controlled at two hierarchical levels by rules defined at a local (i.e., between tones within sequences) and at a global (i.e., between sequences) level. In OFC patients, ERPs elicited by standard tones were unaffected at both local and global levels compared to controls. However, patients showed an attenuated mismatch negativity (MMN) and P3a to local prediction violation, as well as a diminished MMN followed by a delayed P3a to the combined local and global level prediction violation. The subsequent P3b component to conditions involving violations of prediction at the level of global rules was preserved in the OFC group. Comparable effects were absent in patients with lesions restricted to the lateral PFC, which lends a degree of anatomical specificity to the altered predictive processing resulting from OFC lesion. Overall, the altered magnitudes and time courses of MMN/P3a responses after lesions to the OFC indicate that the neural correlates of detection of auditory regularity violation are impacted at two hierarchical levels of rule abstraction.

Learning within a sensory-motor circuit links action to expected outcome

The cortex integrates sound- and movement-related signals to predict the acoustic consequences of behavior and detect violations from expectations. Although expectation- and prediction-related activity has been observed in the auditory cortex of humans, monkeys, and mice during vocal and non-vocal acoustic behaviors, the specific cortical circuitry required for forming memories, recalling expectations, and making predictions remains unknown. By combining closed-loop behavior, electrophysiological recordings, longitudinal pharmacology, and targeted optogenetic circuit activation, we identify a cortical locus for the emergence of expectation and error signals. Movement-related expectation signals and sound-related error signals emerge in parallel in the auditory cortex and are concentrated in largely distinct neurons, consistent with a compartmentalization of different prediction-related computations. On a trial-by-trial basis, expectation and error signals are correlated in auditory cortex, consistent with a local circuit implementation of an internal model. Silencing the auditory cortex during motor-sensory learning prevents the emergence of expectation signals and error signals, revealing the auditory cortex as a necessary node for learning to make predictions. Prediction-like signals can be experimentally induced in the auditory cortex, even in the absence of behavioral experience, by pairing optogenetic motor cortical activation with sound playback, indicating that cortical circuits are sufficient for movement-like predictive processing. Finally, motor-sensory experience realigns the manifold dimensions in which auditory cortical populations encode movement and sound, consistent with predictive processing. These findings show that prediction-related signals reshape auditory cortex dynamics during behavior and reveal a cortical locus for the emergence of expectation and error.

Behavior-relevant top-down cross-modal predictions in mouse neocortex

Animals adapt to a constantly changing world by predicting their environment and the consequences of their actions. The predictive coding hypothesis proposes that the brain generates predictions and continuously compares them with sensory inputs to guide behavior. However, how the brain reconciles conflicting top-down predictions and bottom-up sensory information remains unclear. To address this question, we simultaneously imaged neuronal populations in the mouse somatosensory barrel cortex and posterior parietal cortex during an auditory-cued texture discrimination task. In mice that had learned the task with fixed tone-texture matching, the presentation of mismatched pairing induced conflicts between tone-based texture predictions and actual texture inputs. When decisions were based on the predicted rather than the actual texture, top-down information flow was dominant and texture representations in both areas were modified, whereas dominant bottom-up information flow led to correct representations and behavioral choice. Our findings provide evidence for hierarchical predictive coding in the mouse neocortex.

Auditory prediction and prediction error responses evoked through a novel cascade roving paradigm: a human ECoG study

Auditory sensory processing is assumed to occur in a hierarchical structure including the primary auditory cortex (A1), superior temporal gyrus, and frontal areas. These areas are postulated to generate predictions for incoming stimuli, creating an internal model of the surrounding environment. Previous studies on mismatch negativity have indicated the involvement of the superior temporal gyrus in this processing, whereas reports have been mixed regarding the contribution of the frontal cortex. We designed a novel auditory paradigm, the "cascade roving" paradigm, which incorporated complex structures (cascade sequences) into a roving paradigm. We analyzed electrocorticography data from six patients with refractory epilepsy who passively listened to this novel auditory paradigm and detected responses to deviants mainly in the superior temporal gyrus and inferior frontal gyrus. Notably, the inferior frontal gyrus exhibited broader distribution and sustained duration of deviant-elicited responses, seemingly differing in spatio-temporal characteristics from the prediction error responses observed in the superior temporal gyrus, compared with conventional oddball paradigms performed on the same participants. Moreover, we observed that the deviant responses were enhanced through stimulus repetition in the high-gamma range mainly in the superior temporal gyrus. These features of the novel paradigm may aid in our understanding of auditory predictive coding.

Short-Term Effect of Auditory Stimulation on Neural Activities: A Scoping Review of Longitudinal Electroencephalography and Magnetoencephalography Studies

Explored through EEG/MEG, auditory stimuli function as a suitable research probe to reveal various neural activities, including event-related potentials, brain oscillations and functional connectivity. Accumulating evidence in this field stems from studies investigating neuroplasticity induced by long-term auditory training, specifically cross-sectional studies comparing musicians and non-musicians as well as longitudinal studies with musicians. In contrast, studies that address the neural effects of short-term interventions whose duration lasts from minutes to hours are only beginning to be featured. Over the past decade, an increasing body of evidence has shown that short-term auditory interventions evoke rapid changes in neural activities, and oscillatory fluctuations can be observed even in the prestimulus period. In this scoping review, we divided the extracted neurophysiological studies into three groups to discuss neural activities with short-term auditory interventions: the pre-stimulus period, during stimulation, and a comparison of before and after stimulation. We show that oscillatory activities vary depending on the context of the stimuli and are greatly affected by the interplay of bottom-up and top-down modulational mechanisms, including attention. We conclude that the observed rapid changes in neural activitiesin the auditory cortex and the higher-order cognitive part of the brain are causally attributed to short-term auditory interventions.

Acetylcholine modulates the precision of prediction error in the auditory cortex

A fundamental property of sensory systems is their ability to detect novel stimuli in the ambient environment. The auditory brain contains neurons that decrease their response to repetitive sounds but increase their firing rate to novel or deviant stimuli; the difference between both responses is known as stimulus-specific adaptation or neuronal mismatch (nMM). Here, we tested the effect of microiontophoretic applications of ACh on the neuronal responses in the auditory cortex (AC) of anesthetized rats during an auditory oddball paradigm, including cascade controls. Results indicate that ACh modulates the nMM, affecting prediction error responses but not repetition suppression, and this effect is manifested predominantly in infragranular cortical layers. The differential effect of ACh on responses to standards, relative to deviants (in terms of averages and variances), was consistent with the representational sharpening that accompanies an increase in the precision of prediction errors. These findings suggest that ACh plays an important role in modulating prediction error signaling in the AC and gating the access of these signals to higher cognitive levels.

Sequential maturation of stimulus-specific adaptation in the mouse lemniscal auditory system

Stimulus-specific adaptation (SSA), the reduction of neural activity to a common stimulus that does not generalize to other, rare stimuli, is an essential property of our brain. Although well characterized in adults, it is still unknown how it develops during adolescence and what neuronal circuits are involved. Using in vivo electrophysiology and optogenetics in the lemniscal pathway of the mouse auditory system, we observed SSA to be stable from postnatal day 20 (P20) in the inferior colliculus, to develop until P30 in the auditory thalamus and even later in the primary auditory cortex (A1). We found this maturation process to be experience-dependent in A1 but not in thalamus and to be related to alterations in deep but not input layers of A1. We also identified corticothalamic projections to be implicated in thalamic SSA development. Together, our results reveal different circuits underlying the sequential SSA maturation and provide a unique perspective to understand predictive coding and surprise across sensory systems.

Effects of sensory modality and task relevance on omitted stimulus potentials

Omitted stimulus potentials (OSPs) occur when a sensory stimulus is unexpectedly omitted. They are thought to reflect predictions about upcoming sensory events. The present study examined how OSPs differ across the sensory modalities of predicted stimuli. Twenty-nine university students were asked to press a mouse button at a regular interval of 1-2 s, which was immediately followed by either a visual or auditory stimulus in different blocks. The stimuli were sometimes omitted (p = 0.2), to which event-related potentials (ERPs) were recorded. The results showed that stimulus omissions in both modalities elicited ERP waveforms consisting of three components, oN1, oN2, and oP3. The peak latencies of these components were shorter in the auditory modality than in the visual modality. The amplitudes of OSPs were larger when participants were told that the omission indicated their poor performance (i.e., they pressed a button at an irregular interval) than when it was irrelevant to their performance. These findings suggest that OSPs occur from around 100 ms in a modality-specific manner and increase in amplitude depending on the task relevance of stimulus omissions.

A multimodal cortical network of sensory expectation violation revealed by fMRI

The brain is subjected to multi-modal sensory information in an environment governed by statistical dependencies. Mismatch responses (MMRs), classically recorded with EEG, have provided valuable insights into the brain's processing of regularities and the generation of corresponding sensory predictions. Only few studies allow for comparisons of MMRs across multiple modalities in a simultaneous sensory stream and their corresponding cross-modal context sensitivity remains unknown. Here, we used a tri-modal version of the roving stimulus paradigm in fMRI to elicit MMRs in the auditory, somatosensory and visual modality. Participants (N = 29) were simultaneously presented with sequences of low and high intensity stimuli in each of the three senses while actively observing the tri-modal input stream and occasionally reporting the intensity of the previous stimulus in a prompted modality. The sequences were based on a probabilistic model, defining transition probabilities such that, for each modality, stimuli were more likely to repeat (p = .825) than change (p = .175) and stimulus intensities were equiprobable (p = .5). Moreover, each transition was conditional on the configuration of the other two modalities comprising global (cross-modal) predictive properties of the sequences. We identified a shared mismatch network of modality general inferior frontal and temporo-parietal areas as well as sensory areas, where the connectivity (psychophysiological interaction) between these regions was modulated during mismatch processing. Further, we found deviant responses within the network to be modulated by local stimulus repetition, which suggests highly comparable processing of expectation violation across modalities. Moreover, hierarchically higher regions of the mismatch network in the temporo-parietal area around the intraparietal sulcus were identified to signal cross-modal expectation violation. With the consistency of MMRs across audition, somatosensation and vision, our study provides insights into a shared cortical network of uni- and multi-modal expectation violation in response to sequence regularities.

Time-resolved dynamic computational modeling of human EEG recordings reveals gradients of generative mechanisms for the MMN response

Despite attempts to unify the different theoretical accounts of the mismatch negativity (MMN), there is still an ongoing debate on the neurophysiological mechanisms underlying this complex brain response. On one hand, neuronal adaptation to recurrent stimuli is able to explain many of the observed properties of the MMN, such as its sensitivity to controlled experimental parameters. On the other hand, several modeling studies reported evidence in favor of Bayesian learning models for explaining the trial-to-trial dynamics of the human MMN. However, direct comparisons of these two main hypotheses are scarce, and previous modeling studies suffered from methodological limitations. Based on reports indicating spatial and temporal dissociation of physiological mechanisms within the timecourse of mismatch responses in animals, we hypothesized that different computational models would best fit different temporal phases of the human MMN. Using electroencephalographic data from two independent studies of a simple auditory oddball task (n = 82), we compared adaptation and Bayesian learning models' ability to explain the sequential dynamics of auditory deviance detection in a time-resolved fashion. We first ran simulations to evaluate the capacity of our design to dissociate the tested models and found that they were sufficiently distinguishable above a certain level of signal-to-noise ratio (SNR). In subjects with a sufficient SNR, our time-resolved approach revealed a temporal dissociation between the two model families, with high evidence for adaptation during the early MMN window (from 90 to 150-190 ms post-stimulus depending on the dataset) and for Bayesian learning later in time (170-180 ms or 200-220ms). In addition, Bayesian model averaging of fixed-parameter models within the adaptation family revealed a gradient of adaptation rates, resembling the anatomical gradient in the auditory cortical hierarchy reported in animal studies.

Curiosity-driven exploration: foundations in neuroscience and computational modeling

Curiosity refers to the intrinsic desire of humans and animals to explore the unknown, even when there is no apparent reason to do so. Thus far, no single, widely accepted definition or framework for curiosity has emerged, but there is growing consensus that curious behavior is not goal-directed but related to seeking or reacting to information. In this review, we take a phenomenological approach and group behavioral and neurophysiological studies which meet these criteria into three categories according to the type of information seeking observed. We then review recent computational models of curiosity from the field of machine learning and discuss how they enable integrating different types of information seeking into one theoretical framework. Combinations of behavioral and neurophysiological studies along with computational modeling will be instrumental in demystifying the notion of curiosity.

Change detection in the primate auditory cortex through feedback of prediction error signals

Although cortical feedback signals are essential for modulating feedforward processing, no feedback error signal across hierarchical cortical areas has been reported. Here, we observed such a signal in the auditory cortex of awake common marmoset during an oddball paradigm to induce auditory duration mismatch negativity. Prediction errors to a deviant tone presentation were generated as offset calcium responses of layer 2/3 neurons in the rostral parabelt (RPB) of higher-order auditory cortex, while responses to non-deviant tones were strongly suppressed. Within several hundred milliseconds, the error signals propagated broadly into layer 1 of the primary auditory cortex (A1) and accumulated locally on top of incoming auditory signals. Blockade of RPB activity prevented deviance detection in A1. Optogenetic activation of RPB following tone presentation nonlinearly enhanced A1 tone response. Thus, the feedback error signal is critical for automatic detection of unpredicted stimuli in physiological auditory processing and may serve as backpropagation-like learning.

Effect of presentation rate on auditory processing in Rett syndrome: event-related potential study

BACKGROUND

Rett syndrome (RS) is a rare neurodevelopmental disorder characterized by mutations in the MECP2 gene. Patients with RS have severe motor abnormalities and are often unable to walk, use hands and speak. The preservation of perceptual and cognitive functions is hard to assess, while clinicians and care-givers point out that these patients need more time to process information than typically developing peers. Neurophysiological correlates of auditory processing have been also found to be distorted in RS, but sound presentation rates were relatively quick in these studies (stimulus onset asynchrony, SOA < 1000 ms). As auditory event-related potential (ERP) is typically increased with prolongation of SOA we aim to study if SOA prolongation might compensate for observed abnormalities.

METHODS

We presented a repetitive stimulus (1000 Hz) at three different SOAs of 900 ms, 1800 ms, and 3600 ms in children with RS (N = 24, Mean age = 9.0 ± 3.1) and their typical development (TD) peers (N = 27, Mean age = 9.7 ± 3.4) while recording 28-channels electroencephalogram, EEG. Some RS participants (n = 10) did not show clear ERP and were excluded from the analysis.

RESULTS

Major ERP components (here assessed as N1P1 and P2N1 peak-to-peak values) were smaller at SOA 900 than at longer SOAs in both groups, pointing out that the basic mechanism of adaptation in the auditory system is preserved in at least in RS patients with evident ERPs. At the same time the latencies of these components were significantly delayed in the RS than in TD. Moreover, late components (P2N1 and N2P2) were drastically reduced in Rett syndrome irrespective of the SOA, suggesting a largely affected mechanism of integration of upcoming sensory input with memory. Moreover, developmental stagnation of auditory ERP characterized patients with RS: absence of typical P2N1 enlargement and P1 and N1 shortening with age at least for shortest SOA.

LIMITATIONS

We could not figure out the cause for the high percentage of no-evident ERP RS participants and our final sample of the RS group was rather small. Also, our study did not include a control clinical group.

CONCLUSIONS

Thus, auditory ERPs inform us about abnormalities within auditory processing that cannot be fully overcomed by slowing presentation rate.

Stimulus-Specific Prediction Error Neurons in Mouse Auditory Cortex

Comparing expectation with experience is an important neural computation performed throughout the brain and is a hallmark of predictive processing. Experiments that alter the sensory outcome of an animal's behavior reveal enhanced neural responses to unexpected self-generated stimuli, indicating that populations of neurons in sensory cortex may reflect prediction errors (PEs), mismatches between expectation and experience. However, enhanced neural responses to self-generated stimuli could also arise through nonpredictive mechanisms, such as the movement-based facilitation of a neuron's inherent sound responses. If sensory prediction error neurons exist in sensory cortex, it is unknown whether they manifest as general error responses, or respond with specificity to errors in distinct stimulus dimensions. To answer these questions, we trained mice of either sex to expect the outcome of a simple sound-generating behavior and recorded auditory cortex activity as mice heard either the expected sound or sounds that deviated from expectation in one of multiple distinct dimensions. Our data reveal that the auditory cortex learns to suppress responses to self-generated sounds along multiple acoustic dimensions simultaneously. We identify a distinct population of auditory cortex neurons that are not responsive to passive sounds or to the expected sound but that encode prediction errors. These prediction error neurons are abundant only in animals with a learned motor-sensory expectation, and encode one or two specific violations rather than a generic error signal. Together, these findings reveal that cortical predictions about self-generated sounds have specificity in multiple simultaneous dimensions and that cortical prediction error neurons encode specific violations from expectation.SIGNIFICANCE STATEMENT Audette et. al record neural activity in the auditory cortex while mice perform a sound-generating forelimb movement and measure neural responses to sounds that violate an animal's expectation in different ways. They find that predictions about self-generated sounds are highly specific across multiple stimulus dimensions and that a population of typically nonsound-responsive neurons respond to sounds that violate an animal's expectation in a specific way. These results identify specific prediction error (PE) signals in the mouse auditory cortex and suggest that errors may be calculated early in sensory processing.

Novelty detection in an auditory oddball task on freely moving rats

The relative importance or saliency of sensory inputs depend on the animal's environmental context and the behavioural responses to these same inputs can vary over time. Here we show how freely moving rats, trained to discriminate between deviant tones embedded in a regular pattern of repeating stimuli and different variations of the classic oddball paradigm, can detect deviant tones, and this discriminability resembles the properties that are typical of neuronal adaptation described in previous studies. Moreover, the auditory brainstem response (ABR) latency decreases after training, a finding consistent with the notion that animals develop a type of plasticity to auditory stimuli. Our study suggests the existence of a form of long-term memory that may modulate the level of neuronal adaptation according to its behavioural relevance, and sets the ground for future experiments that will help to disentangle the functional mechanisms that govern behavioural habituation and its relation to neuronal adaptation.

Exploratory evidence for differences in GABAergic regulation of auditory processing in autism spectrum disorder

Altered reactivity and responses to auditory input are core to the diagnosis of autism spectrum disorder (ASD). Preclinical models implicate ϒ-aminobutyric acid (GABA) in this process. However, the link between GABA and auditory processing in humans (with or without ASD) is largely correlational. As part of a study of potential biosignatures of GABA function in ASD to inform future clinical trials, we evaluated the role of GABA in auditory repetition suppression in 66 adults (n = 28 with ASD). Neurophysiological responses (temporal and frequency domains) to repetitive standard tones and novel deviants presented in an oddball paradigm were compared after double-blind, randomized administration of placebo, 15 or 30 mg of arbaclofen (STX209), a GABA type B (GABAB) receptor agonist. We first established that temporal mismatch negativity was comparable between participants with ASD and those with typical development (TD). Next, we showed that temporal and spectral responses to repetitive standards were suppressed relative to responses to deviants in the two groups, but suppression was significantly weaker in individuals with ASD at baseline. Arbaclofen reversed weaker suppression of spectral responses in ASD but disrupted suppression in TD. A post hoc analysis showed that arbaclofen-elicited shift in suppression was correlated with autistic symptomatology measured using the Autism Quotient across the entire group, though not in the smaller sample of the ASD and TD group when examined separately. Thus, our results confirm: GABAergic dysfunction contributes to the neurophysiology of auditory sensory processing alterations in ASD, and can be modulated by targeting GABAB activity. These GABA-dependent sensory differences may be upstream of more complex autistic phenotypes.

Short-term neuronal and synaptic plasticity act in synergy for deviance detection in spiking networks

Sensory areas of cortex respond more strongly to infrequent stimuli when these violate previously established regularities, a phenomenon known as deviance detection (DD). Previous modeling work has mainly attempted to explain DD on the basis of synaptic plasticity. However, a large fraction of cortical neurons also exhibit firing rate adaptation, an underexplored potential mechanism. Here, we investigate DD in a spiking neuronal network model with two types of short-term plasticity, fast synaptic short-term depression (STD) and slower threshold adaptation (TA). We probe the model with an oddball stimulation paradigm and assess DD by evaluating the network responses. We find that TA is sufficient to elicit DD. It achieves this by habituating neurons near the stimulation site that respond earliest to the frequently presented standard stimulus (local fatigue), which diminishes the response and promotes the recovery (global fatigue) of the wider network. Further, we find a synergy effect between STD and TA, where they interact with each other to achieve greater DD than the sum of their individual effects. We show that this synergy is caused by the local fatigue added by STD, which inhibits the global response to the frequently presented stimulus, allowing greater recovery of TA-mediated global fatigue and making the network more responsive to the deviant stimulus. Finally, we show that the magnitude of DD strongly depends on the timescale of stimulation. We conclude that highly predictable information can be encoded in strong local fatigue, which allows greater global recovery and subsequent heightened sensitivity for DD.

Top-down input modulates visual context processing through an interneuron-specific circuit

Visual stimuli that deviate from the current context elicit augmented responses in the primary visual cortex (V1). These heightened responses, known as "deviance detection," require local inhibition in the V1 and top-down input from the anterior cingulate area (ACa). Here, we investigated the mechanisms by which the ACa and V1 interact to support deviance detection. Local field potential recordings in mice during an oddball paradigm showed that ACa-V1 synchrony peaks in the theta/alpha band (≈10 Hz). Two-photon imaging in the V1 revealed that mainly pyramidal neurons exhibited deviance detection, while contextually redundant stimuli increased vasoactive intestinal peptide (VIP)-positive interneuron (VIP) activity and decreased somatostatin-positive interneuron (SST) activity. Optogenetic drive of ACa-V1 inputs at 10 Hz activated V1-VIPs but inhibited V1-SSTs, mirroring the dynamics present during the oddball paradigm. Chemogenetic inhibition of V1-VIPs disrupted Aca-V1 synchrony and deviance detection in the V1. These results outline temporal and interneuron-specific mechanisms of top-down modulation that support visual context processing.

Robust multisensory deviance detection in the mouse parietal associative area

Context modulates how information is processed in the mammalian brain. For example, brain responses are amplified to contextually unusual stimuli. This phenomenon, known as "deviance detection,"1,2 is well documented in early, primary sensory cortex, where large responses are generated to simple stimuli that deviate from their context in low-order properties, such as line orientation, size, or pitch.2,3,4,5 However, the extent to which neural deviance detection manifests (1) in broader cortical networks and (2) to simple versus complex stimuli, which deviate only in their higher-order, multisensory properties, is not known. Consistent with a predictive processing framework,6,7 we hypothesized that deviance detection manifests in a hierarchical manner across cortical networks,8,9 emerging later and further downstream when stimulus deviance is complex. To test this, we examined brain responses of awake mice to simple unisensory deviants (e.g., visual line gratings, deviating from context in their orientation alone) versus complex multisensory deviants (i.e., audiovisual pairs, deviating from context only in their audiovisual pairing but not visual or auditory content alone). We find that mouse parietal associative area-a higher cortical region-displays robust multisensory deviance detection. In contrast, primary visual cortex exhibits strong unisensory visual deviance detection but weaker multisensory deviance detection. These results suggest that deviance detection signals in the cortex may be conceptualized as "prediction errors," which are primarily fed forward-or downstream-in cortical networks.6,7.

Mismatch negativity as a marker of auditory pattern separation

To what extent does incidental encoding of auditory stimuli influence subsequent episodic memory for the same stimuli? We examined whether the mismatch negativity (MMN), an event-related potential generated by auditory change detection, is correlated with participants' ability to discriminate those stimuli (i.e. targets) from highly similar lures and from dissimilar foils. We measured the MMN in 30 young adults (18-32 years, 18 females) using a passive auditory oddball task with standard and deviant 5-tone sequences differing in pitch contour. After exposure, all participants completed an incidental memory test for old targets, lures, and foils. As expected, participants at test exhibited high sensitivity in recognizing target items relative to foils and lower sensitivity in recognizing target items relative to lures. Notably, we found a significant correlation between MMN amplitude and lure discrimination, but not foil discrimination. Our investigation shows that our capacity to discriminate sensory inputs at encoding, as measured by the MMN, translates into precision in memory for those inputs.

Why mismatch negativity continues to hold potential in probing altered brain function in schizophrenia

The brain potential known as mismatch negativity (MMN) is one of the most studied indices of altered brain function in schizophrenia. This review looks at what has been learned about MMN in schizophrenia over the last three decades and why the level of interest and activity in this field of research remains strong. A diligent consideration of available evidence suggests that MMN can serve as a biomarker in schizophrenia, but perhaps not the kind of biomarker that early research supposed. This review concludes that MMN measurement is likely to be most useful as a monitoring and response biomarker enabling tracking of an underlying pathology and efficacy of interventions, respectively. The role of, and challenges presented by, pre-clinical models is discussed as well as the merits of different methodologies that can be brought to bear in pursuing a deeper understanding of pathophysiology that might explain smaller MMN in schizophrenia.

Population coding of time-varying sounds in the non-lemniscal Inferior Colliculus

The inferior colliculus (IC) of the midbrain is important for complex sound processing, such as discriminating conspecific vocalizations and human speech. The IC's non-lemniscal, dorsal "shell" region is likely important for this process, as neurons in these layers project to higher-order thalamic nuclei that subsequently funnel acoustic signals to the amygdala and non-primary auditory cortices; forebrain circuits important for vocalization coding in a variety of mammals, including humans. However, the extent to which shell IC neurons transmit acoustic features necessary to discern vocalizations is less clear, owing to the technical difficulty of recording from neurons in the IC's superficial layers via traditional approaches. Here we use 2-photon Ca2+ imaging in mice of either sex to test how shell IC neuron populations encode the rate and depth of amplitude modulation, important sound cues for speech perception. Most shell IC neurons were broadly tuned, with a low neurometric discrimination of amplitude modulation rate; only a subset were highly selective to specific modulation rates. Nevertheless, neural network classifier trained on fluorescence data from shell IC neuron populations accurately classified amplitude modulation rate, and decoding accuracy was only marginally reduced when highly tuned neurons were omitted from training data. Rather, classifier accuracy increased monotonically with the modulation depth of the training data, such that classifiers trained on full-depth modulated sounds had median decoding errors of ~0.2 octaves. Thus, shell IC neurons may transmit time-varying signals via a population code, with perhaps limited reliance on the discriminative capacity of any individual neuron.

Habituation, Adaptation and Prediction Processes in Neurodevelopmental Disorders: A Comprehensive Review

Habituation, the simplest form of learning preserved across species and evolution, is characterized by a response decrease as a stimulus is repeated. This adaptive function has been shown to be altered in some psychiatric and neurodevelopmental disorders such as autism spectrum disorder (ASD), attention-deficit/hyperactivity disorder (ADHD) or schizophrenia. At the brain level, habituation is characterized by a decrease in neural activity as a stimulation is repeated, referred to as neural adaptation. This phenomenon influences the ability to make predictions and to detect change, two processes altered in some neurodevelopmental and psychiatric disorders. In this comprehensive review, the objectives are to characterize habituation, neural adaptation, and prediction throughout typical development and in neurodevelopmental disorders; and to evaluate their implication in symptomatology, specifically in sensitivity to change or need for sameness. A summary of the different approaches to investigate adaptation will be proposed, in which we report the contribution of animal studies as well as electrophysiological studies in humans to understanding of underlying neuronal mechanisms.

Neuronal responses to omitted tones in the auditory brain: A neuronal correlate for predictive coding

Prediction provides key advantages for survival, and cognitive studies have demonstrated that the brain computes multilevel predictions. Evidence for predictions remains elusive at the neuronal level because of the complexity of separating neural activity into predictions and stimulus responses. We overcome this challenge by recording from single neurons from cortical and subcortical auditory regions in anesthetized and awake preparations, during unexpected stimulus omissions interspersed in a regular sequence of tones. We find a subset of neurons that responds reliably to omitted tones. In awake animals, omission responses are similar to anesthetized animals, but larger and more frequent, indicating that the arousal and attentional state levels affect the degree to which predictions are neuronally represented. Omission-sensitive neurons also responded to frequency deviants, with their omission responses getting emphasized in the awake state. Because omission responses occur in the absence of sensory input, they provide solid and empirical evidence for the implementation of a predictive process.

Omission responses in local field potentials in rat auditory cortex

BACKGROUND

Non-invasive recordings of gross neural activity in humans often show responses to omitted stimuli in steady trains of identical stimuli. This has been taken as evidence for the neural coding of prediction or prediction error. However, evidence for such omission responses from invasive recordings of cellular-scale responses in animal models is scarce. Here, we sought to characterise omission responses using extracellular recordings in the auditory cortex of anaesthetised rats. We profiled omission responses across local field potentials (LFP), analogue multiunit activity (AMUA), and single/multi-unit spiking activity, using stimuli that were fixed-rate trains of acoustic noise bursts where 5% of bursts were randomly omitted.

RESULTS

Significant omission responses were observed in LFP and AMUA signals, but not in spiking activity. These omission responses had a lower amplitude and longer latency than burst-evoked sensory responses, and omission response amplitude increased as a function of the number of preceding bursts.

CONCLUSIONS

Together, our findings show that omission responses are most robustly observed in LFP and AMUA signals (relative to spiking activity). This has implications for models of cortical processing that require many neurons to encode prediction errors in their spike output.

Modelling novelty detection in the thalamocortical loop

In complex natural environments, sensory systems are constantly exposed to a large stream of inputs. Novel or rare stimuli, which are often associated with behaviorally important events, are typically processed differently than the steady sensory background, which has less relevance. Neural signatures of such differential processing, commonly referred to as novelty detection, have been identified on the level of EEG recordings as mismatch negativity (MMN) and on the level of single neurons as stimulus-specific adaptation (SSA). Here, we propose a multi-scale recurrent network with synaptic depression to explain how novelty detection can arise in the whisker-related part of the somatosensory thalamocortical loop. The "minimalistic" architecture and dynamics of the model presume that neurons in cortical layer 6 adapt, via synaptic depression, specifically to a frequently presented stimulus, resulting in reduced population activity in the corresponding cortical column when compared with the population activity evoked by a rare stimulus. This difference in population activity is then projected from the cortex to the thalamus and amplified through the interaction between neurons of the primary and reticular nuclei of the thalamus, resulting in rhythmic oscillations. These differentially activated thalamic oscillations are forwarded to cortical layer 4 as a late secondary response that is specific to rare stimuli that violate a particular stimulus pattern. Model results show a strong analogy between this late single neuron activity and EEG-based mismatch negativity in terms of their common sensitivity to presentation context and timescales of response latency, as observed experimentally. Our results indicate that adaptation in L6 can establish the thalamocortical dynamics that produce signatures of SSA and MMN and suggest a mechanistic model of novelty detection that could generalize to other sensory modalities.

Multimodal mismatch responses in associative but not primary visual cortex support hierarchical predictive coding in cortical networks

A key function of the mammalian neocortex is to process sensory data in the context of current and past stimuli. Primary sensory cortices, such as V1, respond weakly to stimuli that typical in their context but strongly to novel stimuli, an effect known as "deviance detection". How deviance detection occurs in associative cortical regions that are downstream of V1 is not well-understood. Here we investigated parietal associative area (PTLp) responses to auditory, visual, and audio-visual mismatches with two-photon calcium imaging and local field potential recordings. We employed basic unisensory auditory and visual oddball paradigms as well as a novel multisensory oddball paradigm, involving typical parings (VaAc or VbAd) presented at p=.88 with rare "deviant" pairings (e.g. VaAd or VbAc) presented at p=.12. We found that PTLp displayed robust deviance detection responses to auditory-visual mismatches, both in individual neurons and in population theta and gamma-band oscillations. In contrast, V1 neurons displayed deviance detection only to visual deviants in a unisensory context, but not to auditory or auditory-visual mismatches. Taken together, these results accord with a predictive processing framework for cortical responses, wherein modality specific prediction errors (i.e. deviance detection responses) are computed in functionally specified cortical areas and feed-forward to update higher brain regions.

Principles of large-scale neural interactions

What mechanisms underlie flexible inter-areal communication in the cortex? We consider four mechanisms for temporal coordination and their contributions to communication: (1) Oscillatory synchronization (communication-through-coherence); (2) communication-through-resonance; (3) non-linear integration; and (4) linear signal transmission (coherence-through-communication). We discuss major challenges for communication-through-coherence based on layer- and cell-type-specific analyses of spike phase-locking, heterogeneity of dynamics across networks and states, and computational models for selective communication. We argue that resonance and non-linear integration are viable alternative mechanisms that facilitate computation and selective communication in recurrent networks. Finally, we consider communication in relation to cortical hierarchy and critically examine the hypothesis that feedforward and feedback communication use fast (gamma) and slow (alpha/beta) frequencies, respectively. Instead, we propose that feedforward propagation of prediction errors relies on the non-linear amplification of aperiodic transients, whereas gamma and beta rhythms represent rhythmic equilibrium states that facilitate sustained and efficient information encoding and amplification of short-range feedback via resonance.

Adaptation in auditory processing

Adaptation is an essential feature of auditory neurons, which reduces their responses to unchanging and recurring sounds and allows their response properties to be matched to the constantly changing statistics of sounds that reach the ears. As a consequence, processing in the auditory system highlights novel or unpredictable sounds and produces an efficient representation of the vast range of sounds that animals can perceive by continually adjusting the sensitivity and, to a lesser extent, the tuning properties of neurons to the most commonly encountered stimulus values. Together with attentional modulation, adaptation to sound statistics also helps to generate neural representations of sound that are tolerant to background noise and therefore plays a vital role in auditory scene analysis. In this review, we consider the diverse forms of adaptation that are found in the auditory system in terms of the processing levels at which they arise, the underlying neural mechanisms, and their impact on neural coding and perception. We also ask what the dynamics of adaptation, which can occur over multiple timescales, reveal about the statistical properties of the environment. Finally, we examine how adaptation to sound statistics is influenced by learning and experience and changes as a result of aging and hearing loss.

Analogous cognitive strategies for tactile learning in the rodent and human brain

Evolution has molded individual species' sensory capacities and abilities. In rodents, who mostly inhabit dark tunnels and burrows, the whisker-based somatosensory system has developed as the dominant sensory modality, essential for environmental exploration and spatial navigation. In contrast, humans rely more on visual and auditory inputs when collecting information from their surrounding sensory space in everyday life. As a result of such species-specific differences in sensory dominance, cognitive relevance and capacities, the evidence for analogous sensory-cognitive mechanisms across species remains sparse. However, recent research in rodents and humans yielded surprisingly comparable processing rules for detecting tactile stimuli, integrating touch information into percepts, and goal-directed rule learning. Here, we review how the brain, across species, harnesses such processing rules to establish decision-making during tactile learning, following canonical circuits from the thalamus and the primary somatosensory cortex up to the frontal cortex. We discuss concordances between empirical and computational evidence from micro- and mesoscopic circuit studies in rodents to findings from macroscopic imaging in humans. Furthermore, we discuss the relevance and challenges for future cross-species research in addressing mutual context-dependent evaluation processes underpinning perceptual learning.

Bayesian surprise shapes neural responses in somatosensory cortical circuits

Numerous psychophysical studies show that Bayesian inference governs sensory decision-making; however, the specific neural circuitry underlying this probabilistic mechanism remains unclear. We record extracellular neural activity along the somatosensory pathway of mice while delivering sensory stimulation paradigms designed to isolate the response to the surprise generated by Bayesian inference. Our results demonstrate that laminar cortical circuits in early sensory areas encode Bayesian surprise. Systematic sensitivity to surprise is not identified in the somatosensory thalamus, rather emerging in the primary (S1) and secondary (S2) somatosensory cortices. Multiunit spiking activity and evoked potentials in layer 6 of these regions exhibit the highest sensitivity to surprise. Gamma power in S1 layer 2/3 exhibits an NMDAR-dependent scaling with surprise, as does alpha power in layers 2/3 and 6 of S2. These results show a precise spatiotemporal neural representation of Bayesian surprise and suggest that Bayesian inference is a fundamental component of cortical processing.