Neurons along the auditory pathway exhibit a hierarchical organization of prediction error

Bayesian surprise shapes neural responses in somatosensory cortical circuits

Numerous psychophysical studies show that Bayesian inference governs sensory decision-making; however, the specific neural circuitry underlying this probabilistic mechanism remains unclear. We record extracellular neural activity along the somatosensory pathway of mice while delivering sensory stimulation paradigms designed to isolate the response to the surprise generated by Bayesian inference. Our results demonstrate that laminar cortical circuits in early sensory areas encode Bayesian surprise. Systematic sensitivity to surprise is not identified in the somatosensory thalamus, rather emerging in the primary (S1) and secondary (S2) somatosensory cortices. Multiunit spiking activity and evoked potentials in layer 6 of these regions exhibit the highest sensitivity to surprise. Gamma power in S1 layer 2/3 exhibits an NMDAR-dependent scaling with surprise, as does alpha power in layers 2/3 and 6 of S2. These results show a precise spatiotemporal neural representation of Bayesian surprise and suggest that Bayesian inference is a fundamental component of cortical processing.

A frontosensory circuit for visual context processing is synchronous in the theta/alpha band

Visual processing is strongly influenced by context. Stimuli that deviate from contextual regularities elicit augmented responses in primary visual cortex (V1). These heightened responses, known as "deviance detection," require both inhibition local to V1 and top-down modulation from higher areas of cortex. Here we investigated the spatiotemporal mechanisms by which these circuit elements interact to support deviance detection. Local field potential recordings in mice in anterior cingulate area (ACa) and V1 during a visual oddball paradigm showed that interregional synchrony peaks in the theta/alpha band (6-12 Hz). Two-photon imaging in V1 revealed that mainly pyramidal neurons exhibited deviance detection, while vasointestinal peptide-positive interneurons (VIPs) increased activity and somatostatin-positive interneurons (SSTs) decreased activity (adapted) to redundant stimuli (prior to deviants). Optogenetic drive of ACa-V1 inputs at 6-12 Hz activated V1-VIPs but inhibited V1-SSTs, mirroring the dynamics present during the oddball paradigm. Chemogenetic inhibition of VIP interneurons disrupted ACa-V1 synchrony and deviance detection responses in V1. These results outline spatiotemporal and interneuron-specific mechanisms of top-down modulation that support visual context processing.

Auditory memory of complex sounds in sparsely distributed, highly correlated neurons in the auditory cortex

Listening in complex sound environments requires rapid segregation of different sound sources e.g., speakers from each other, speakers from other sounds, or different instruments in an orchestra, and also adjust auditory processing on the prevailing sound conditions. Thus, fast encoding of inputs and identifying and adapting to reoccurring sounds are necessary for efficient and agile sound perception. This adaptation process represents an early phase of developing implicit learning of sound statistics and thus represents a form of auditory memory. The auditory cortex (ACtx) is known to play a key role in this encoding process but the underlying circuits and if hierarchical processing exists are not known. To identify ACtx regions and cells involved in this process, we simultaneously imaged population of neurons in different ACtx subfields using in vivo 2-photon imaging in awake mice. We used an experimental stimulus paradigm adapted from human studies that triggers rapid and robust implicit learning to passively present complex sounds and imaged A1 Layer 4 (L4), A1 L2/3, and A2 L2/3. In this paradigm, a frozen spectro-temporally complex 'Target' sound would be randomly re-occurring within a stream of random other complex sounds. We find distinct groups of cells that are specifically responsive to complex acoustic sequences across all subregions indicating that even the initial thalamocortical input layers (A1 L4) respond to complex sounds. Cells in all imaged regions showed decreased response amplitude for reoccurring Target sounds indicating that a memory signature is present even in the thalamocortical input layers. On the population level we find increased synchronized activity across cells to the Target sound and that this synchronized activity was more consistent across cells regardless of the duration of frozen token within Target sounds in A2, compared to A1. These findings suggest that ACtx and its input layers play a role in auditory memory for complex sounds and suggest a hierarchical structure of processes for auditory memory.

Temporal hierarchies in the predictive processing of melody - From pure tones to songs

Listening to musical melodies is a complex task that engages perceptual and memoryrelated processes. The processes underlying melody cognition happen simultaneously on different timescales, ranging from milliseconds to minutes. Although attempts have been made, research on melody perception is yet to produce a unified framework of how melody processing is achieved in the brain. This may in part be due to the difficulty of integrating concepts such as perception, attention and memory, which pertain to different temporal scales. Recent theories on brain processing, which hold prediction as a fundamental principle, offer potential solutions to this problem and may provide a unifying framework for explaining the neural processes that enable melody perception on multiple temporal levels. In this article, we review empirical evidence for predictive coding on the levels of pitch formation, basic pitch-related auditory patterns,more complex regularity processing extracted from basic patterns and long-term expectations related to musical syntax. We also identify areas that would benefit from further inquiry and suggest future directions in research on musical melody perception.

Hierarchical Deviant Processing in Auditory Cortex of Awake Mice

Detecting patterns, and noticing unexpected pattern changes, in the environment is a vital aspect of sensory processing. Adaptation and prediction error responses are two components of neural processing related to these tasks, and previous studies in the auditory system in rodents show that these two components are partially dissociable in terms of the topography and latency of neural responses to sensory deviants. However, many previous studies have focused on repetitions of single stimuli, such as pure tones, which have limited ecological validity. In this study, we tested whether the auditory cortical activity shows adaptation to repetition of more complex sound patterns (bisyllabic pairs). Specifically, we compared neural responses to violations of sequences based on single stimulus probability only, against responses to more complex violations based on stimulus order. We employed an auditory oddball paradigm and monitored the auditory cortex (ACtx) activity of awake mice (N=8) using wide-field calcium imaging. We found that cortical responses were sensitive both to single stimulus probabilities and to more global stimulus patterns, as mismatch signals were elicited following both substitution deviants and transposition deviants. Notably, A2 area elicited larger mismatch signaling to those deviants than primary ACtx (A1), which suggests a hierarchical gradient of prediction error signaling in the auditory cortex. Such a hierarchical gradient was observed for late but not early peaks of calcium transients to deviants, suggesting that the late part of the deviant response may reflect prediction error signaling in response to more complex sensory pattern violations.

Coupled Dynamics of Stimulus-Evoked Gustatory Cortical and Basolateral Amygdalar Activity

Gustatory cortical (GC) single-neuron taste responses reflect taste quality and palatability in successive epochs. Ensemble analyses reveal epoch-to-epoch firing-rate changes in these responses to be sudden, coherent transitions. Such nonlinear dynamics suggest that GC is part of a recurrent network, producing these dynamics in concert with other structures. Basolateral amygdala (BLA), which is reciprocally connected to GC and central to hedonic processing, is a strong candidate partner for GC, in that BLA taste responses evolve on the same general clock as GC and because inhibition of activity in the BLA→GC pathway degrades the sharpness of GC transitions. These facts motivate, but do not test, our overarching hypothesis that BLA and GC act as a single, comodulated network during taste processing. Here, we provide just this test of simultaneous (BLA and GC) extracellular taste responses in female rats, probing the multiregional dynamics of activity to directly test whether BLA and GC responses contain coupled dynamics. We show that BLA and GC response magnitudes covary across trials and within single responses, and that changes in BLA-GC local field potential phase coherence are epoch specific. Such classic coherence analyses, however, obscure the most salient facet of BLA-GC coupling: sudden transitions in and out of the epoch known to be involved in driving gaping behavior happen near simultaneously in the two regions, despite huge trial-to-trial variability in transition latencies. This novel form of inter-regional coupling, which we show is easily replicated in model networks, suggests collective processing in a distributed neural network.SIGNIFICANCE STATEMENT There has been little investigation into real-time communication between brain regions during taste processing, a fact reflecting the dominant belief that taste circuitry is largely feedforward. Here, we perform an in-depth analysis of real-time interactions between GC and BLA in response to passive taste deliveries, using both conventional coherence metrics and a novel methodology that explicitly considers trial-to-trial variability and fast single-trial dynamics in evoked responses. Our results demonstrate that BLA-GC coherence changes as the taste response unfolds, and that BLA and GC specifically couple for the sudden transition into (and out of) the behaviorally relevant neural response epoch, suggesting (although not proving) that: (1) recurrent interactions subserve the function of the dyad as (2) a putative attractor network.

Going down to go up: understanding human auditory cognition by investigating cortical-subcortical interactions

Human auditory cognition spans everything from detecting a creaking door in the night to enjoying beautiful music. Neurofunctional models of these processes tend to focus on cortical networks, but how do subcortical circuits contribute to auditory cognition? Answering this question will lead to a richer understanding of how we process the complex auditory world.

Predictive encoding of pure tones and FM-sweeps in the human auditory cortex

Expectations substantially influence perception, but the neural mechanisms underlying this influence are not fully understood. A prominent view is that sensory neurons encode prediction error with respect to expectations on upcoming sensory input. Although the encoding of prediction error has been previously demonstrated in the human auditory cortex (AC), previous studies often induced expectations using stimulus repetition, potentially confounding prediction error with neural habituation. These studies also measured AC as a single population, failing to consider possible predictive specializations of different AC fields. Moreover, the few studies that considered prediction error to stimuli other than pure tones yielded conflicting results. Here, we used functional magnetic resonance imaging (fMRI) to systematically investigate prediction error to subjective expectations in auditory cortical fields Te1.0, Te1.1, Te1.2, and Te3, and two types of stimuli: pure tones and frequency modulated (FM) sweeps. Our results show that prediction error is elicited with respect to the participants' expectations independently of stimulus repetition and similarly expressed across auditory fields. Moreover, despite the radically different strategies underlying the decoding of pure tones and FM-sweeps, both stimulus modalities were encoded as prediction error in most fields of AC. Altogether, our results provide unequivocal evidence that predictive coding is the general encoding mechanism in AC.

Spontaneous beat synchronization in rats: Neural dynamics and motor entrainment

Beat perception and synchronization within 120 to 140 beats/min (BPM) are common in humans and frequently used in music composition. Why beat synchronization is uncommon in some species and the mechanism determining the optimal tempo are unclear. Here, we examined physical movements and neural activities in rats to determine their beat sensitivity. Close inspection of head movements and neural recordings revealed that rats displayed prominent beat synchronization and activities in the auditory cortex within 120 to 140 BPM. Mathematical modeling suggests that short-term adaptation underlies this beat tuning. Our results support the hypothesis that the optimal tempo for beat synchronization is determined by the time constant of neural dynamics conserved across species, rather than the species-specific time constant of physical movements. Thus, latent neural propensity for auditory motor entrainment may provide a basis for human entrainment that is much more widespread than currently thought. Further studies comparing humans and animals will offer insights into the origins of music and dancing.

A quantitative model reveals a frequency ordering of prediction and prediction-error signals in the human brain

The human brain is proposed to harbor a hierarchical predictive coding neuronal network underlying perception, cognition, and action. In support of this theory, feedforward signals for prediction error have been reported. However, the identification of feedback prediction signals has been elusive due to their causal entanglement with prediction-error signals. Here, we use a quantitative model to decompose these signals in electroencephalography during an auditory task, and identify their spatio-spectral-temporal signatures across two functional hierarchies. Two prediction signals are identified in the period prior to the sensory input: a low-level signal representing the tone-to-tone transition in the high beta frequency band, and a high-level signal for the multi-tone sequence structure in the low beta band. Subsequently, prediction-error signals dependent on the prior predictions are found in the gamma band. Our findings reveal a frequency ordering of prediction signals and their hierarchical interactions with prediction-error signals supporting predictive coding theory.

Rule-based and stimulus-based cues bias auditory decisions via different computational and physiological mechanisms

Expectations, such as those arising from either learned rules or recent stimulus regularities, can bias subsequent auditory perception in diverse ways. However, it is not well understood if and how these diverse effects depend on the source of the expectations. Further, it is unknown whether different sources of bias use the same or different computational and physiological mechanisms. We examined how rule-based and stimulus-based expectations influenced behavior and pupil-linked arousal, a marker of certain forms of expectation-based processing, of human subjects performing an auditory frequency-discrimination task. Rule-based cues consistently biased choices and response times (RTs) toward the more-probable stimulus. In contrast, stimulus-based cues had a complex combination of effects, including choice and RT biases toward and away from the frequency of recently presented stimuli. These different behavioral patterns also had: 1) distinct computational signatures, including different modulations of key components of a novel form of a drift-diffusion decision model and 2) distinct physiological signatures, including substantial bias-dependent modulations of pupil size in response to rule-based but not stimulus-based cues. These results imply that different sources of expectations can modulate auditory processing via distinct mechanisms: one that uses arousal-linked, rule-based information and another that uses arousal-independent, stimulus-based information to bias the speed and accuracy of auditory perceptual decisions.

Prior information about upcoming stimuli can bias our perception of those stimuli. Whether different sources of prior information bias perception in similar or distinct ways is not well understood. We compared the influence of two kinds of prior information on tone-frequency discrimination: rule-based cues, in the form of explicit information about the most-likely identity of the upcoming tone; and stimulus-based cues, in the form of sequences of tones presented before the to-be-discriminated tone. Although both types of prior information biased auditory decision-making, they demonstrated distinct behavioral, computational, and physiological signatures. Our results suggest that the brain processes prior information in a form-specific manner rather than utilizing a general-purpose prior. Such form-specific processing has implications for understanding decision biases real-world contexts, in which prior information comes from many different sources and modalities.

More than the end: OFF response plasticity as a mnemonic signature of a sound’s behavioral salience

In studying how neural populations in sensory cortex code dynamically varying stimuli to guide behavior, the role of spiking after stimuli have ended has been underappreciated. This is despite growing evidence that such activity can be tuned, experience-and context-dependent and necessary for sensory decisions that play out on a slower timescale. Here we review recent studies, focusing on the auditory modality, demonstrating that this so-called OFF activity can have a more complex temporal structure than the purely phasic firing that has often been interpreted as just marking the end of stimuli. While diverse and still incompletely understood mechanisms are likely involved in generating phasic and tonic OFF firing, more studies point to the continuing post-stimulus activity serving a short-term, stimulus-specific mnemonic function that is enhanced when the stimuli are particularly salient. We summarize these results with a conceptual model highlighting how more neurons within the auditory cortical population fire for longer duration after a sound’s termination during an active behavior and can continue to do so even while passively listening to behaviorally salient stimuli. Overall, these studies increasingly suggest that tonic auditory cortical OFF activity holds an echoic memory of specific, salient sounds to guide behavioral decisions.

The neural response at the fundamental frequency of speech is modulated by word-level acoustic and linguistic information

Spoken language comprehension requires rapid and continuous integration of information, from lower-level acoustic to higher-level linguistic features. Much of this processing occurs in the cerebral cortex. Its neural activity exhibits, for instance, correlates of predictive processing, emerging at delays of a few 100 ms. However, the auditory pathways are also characterized by extensive feedback loops from higher-level cortical areas to lower-level ones as well as to subcortical structures. Early neural activity can therefore be influenced by higher-level cognitive processes, but it remains unclear whether such feedback contributes to linguistic processing. Here, we investigated early speech-evoked neural activity that emerges at the fundamental frequency. We analyzed EEG recordings obtained when subjects listened to a story read by a single speaker. We identified a response tracking the speaker's fundamental frequency that occurred at a delay of 11 ms, while another response elicited by the high-frequency modulation of the envelope of higher harmonics exhibited a larger magnitude and longer latency of about 18 ms with an additional significant component at around 40 ms. Notably, while the earlier components of the response likely originate from the subcortical structures, the latter presumably involves contributions from cortical regions. Subsequently, we determined the magnitude of these early neural responses for each individual word in the story. We then quantified the context-independent frequency of each word and used a language model to compute context-dependent word surprisal and precision. The word surprisal represented how predictable a word is, given the previous context, and the word precision reflected the confidence about predicting the next word from the past context. We found that the word-level neural responses at the fundamental frequency were predominantly influenced by the acoustic features: the average fundamental frequency and its variability. Amongst the linguistic features, only context-independent word frequency showed a weak but significant modulation of the neural response to the high-frequency envelope modulation. Our results show that the early neural response at the fundamental frequency is already influenced by acoustic as well as linguistic information, suggesting top-down modulation of this neural response.

Enhanced stability of complex sound representations relative to simple sounds in the auditory cortex

Typical everyday sounds, such as those of speech or running water, are spectrotemporally complex. The ability to recognize complex sounds (CxS) and their associated meaning is presumed to rely on their stable neural representations across time. The auditory cortex is critical for processing of CxS, yet little is known of the degree of stability of auditory cortical representations of CxS across days. Previous studies have shown that the auditory cortex represents CxS identity with a substantial degree of invariance to basic sound attributes such as frequency. We therefore hypothesized that auditory cortical representations of CxS are more stable across days than those of sounds that lack spectrotemporal structure such as pure tones (PTs). To test this hypothesis, we recorded responses of identified L2/3 auditory cortical excitatory neurons to both PTs and CxS across days using two-photon calcium imaging in awake mice. Auditory cortical neurons showed significant daily changes of responses to both types of sounds, yet responses to CxS exhibited significantly lower rates of daily change than those of PTs. Furthermore, daily changes in response profiles to PTs tended to be more stimulus-specific, reflecting changes in sound selectivity, as compared to changes of CxS responses. Lastly, the enhanced stability of responses to CxS was evident across longer time intervals as well. Together, these results suggest that spectrotemporally CxS are more stably represented in the auditory cortex across time than PTs. These findings support a role of the auditory cortex in representing CxS identity across time.Significance statementThe ability to recognize everyday complex sounds such as those of speech or running water is presumed to rely on their stable neural representations. Yet, little is known of the degree of stability of single-neuron sound responses across days. As the auditory cortex is critical for complex sound perception, we hypothesized that the auditory cortical representations of complex sounds are relatively stable across days. To test this, we recorded sound responses of identified auditory cortical neurons across days in awake mice. We found that auditory cortical responses to complex sounds are significantly more stable across days as compared to those of simple pure tones. These findings support a role of the auditory cortex in representing complex sound identity across time.

Decoding violated sensory expectations from the auditory cortex of anaesthetised mice: Hierarchical recurrent neural network depicts separate 'danger' and 'safety' units

The ability to respond appropriately to sensory information received from the external environment is among the most fundamental capabilities of central nervous systems. In the auditory domain, processes underlying this behaviour are studied by measuring auditory‐evoked electrophysiology during sequences of sounds with predetermined regularities. Identifying neural correlates of ensuing auditory novelty responses is supported by research in experimental animals. In the present study, we reanalysed epidural field potential recordings from the auditory cortex of anaesthetised mice during frequency and intensity oddball stimulation. Multivariate pattern analysis (MVPA) and hierarchical recurrent neural network (RNN) modelling were adopted to explore these data with greater resolution than previously considered using conventional methods. Time‐wise and generalised temporal decoding MVPA approaches revealed previously underestimated asymmetry between responses to sound‐level transitions in the intensity oddball paradigm, in contrast with tone frequency changes. After training, the cross‐validated RNN model architecture with four hidden layers produced output waveforms in response to simulated auditory inputs that were strongly correlated with grand‐average auditory‐evoked potential waveforms (r² > .9). Units in hidden layers were classified based on their temporal response properties and characterised using principal component analysis and sample entropy. These demonstrated spontaneous alpha rhythms, sound onset and offset responses and putative ‘safety’ and ‘danger’ units activated by relatively inconspicuous and salient changes in auditory inputs, respectively. The hypothesised existence of corresponding biological neural sources is naturally derived from this model. If proven, this could have significant implications for prevailing theories of auditory processing.

Context-Dependent Inhibitory Control of Stimulus-Specific Adaptation

Stimulus-specific adaptation (SSA) is the reduction in responses to frequent stimuli (standards) that does not generalize to rare stimuli (deviants). We investigated the contribution of inhibition in auditory cortex to SSA using two-photon targeted cell-attached recordings and optogenetic manipulations in male mice. We characterized the responses of parvalbumin (PV)-, somatostatin (SST)-, and vasoactive intestinal polypeptide (VIP)-expressing interneurons of layer 2/3, and of serotonin receptor 5HT3a-expressing interneurons of layer 1. All populations showed early-onset SSA. Unexpectedly, the PV, SST, and VIP populations exhibited a substantial late component of evoked activity, often stronger for standard than for deviant stimuli. Optogenetic suppression of PV neurons facilitated pyramidal neuron responses substantially more (approximately ×10) for deviants than for standards. VIP suppression decreased responses of putative PV neurons, specifically for standard but not for deviant stimuli. Thus, the inhibitory network does not generate cortical SSA, but powerfully controls its expression by differentially affecting the responses to deviants and to standards.SIGNIFICANCE STATEMENT Stimulus-specific adaptation (SSA) reflects the growing complexity of auditory processing along the ascending auditory system. In the presence of SSA, neuronal responses depend not only on the stimulus itself but also on the history of stimulation. Strong SSA in the fast, ascending auditory pathway first occurs in cortex. Here we studied the role of the cortical inhibitory network in shaping SSA, showing that while cortical inhibition does not generate SSA, it powerfully controls its expression. We deduce that the cortical network contributes in crucial ways to the properties of SSA.

Simultaneous mnemonic and predictive representations in the auditory cortex

Recent studies have shown that stimulus history can be decoded via the use of broadband sensory impulses to reactivate mnemonic representations.^1-4. However, memories of previous stimuli can also be used to form sensory predictions about upcoming stimuli.^5,6 Predictive mechanisms allow the brain to create a probable model of the outside world, which can be updated when errors are detected between the model predictions and external inputs. ^7-10 Direct recordings in the auditory cortex of awake mice established neural mechanisms for how encoding mechanisms might handle working memory and predictive processes without "overwriting" recent sensory events in instances where predictive mechanisms are triggered by oddballs within a sequence.¹¹ However, it remains unclear whether mnemonic and predictive information can be decoded from cortical activity simultaneously during passive, implicit sequence processing, even in anesthetized models. Here, we recorded neural activity elicited by repeated stimulus sequences using electrocorticography (ECoG) in the auditory cortex of anesthetized rats, where events within the sequence (referred to henceforth as "vowels," for simplicity) were occasionally replaced with a broadband noise burst or omitted entirely. We show that both stimulus history and predicted stimuli can be decoded from neural responses to broadband impulses, at overlapping latencies but based on independent and uncorrelated data features. We also demonstrate that predictive representations are dynamically updated over the course of stimulation.

Alzheimer's Disease, Hearing Loss, and Deviance Detection

Age-related hearing loss is a widespread condition among the elderly, affecting communication and social participation. Given its high incidence, it is not unusual that individuals suffering from age-related hearing loss also suffer from other age-related neurodegenerative diseases, a scenario which severely impacts their quality of life. Furthermore, recent studies have identified hearing loss as a relevant risk factor for the development of dementia due to Alzheimer's disease, although the underlying associations are still unclear. In order to cope with the continuous flow of auditory information, the brain needs to separate repetitive sounds from rare, unexpected sounds, which may be relevant. This process, known as deviance detection, is a key component of the sensory perception theory of predictive coding. According to this framework, the brain would use the available incoming information to make predictions about the environment and signal the unexpected stimuli that break those predictions. Such a system can be easily impaired by the distortion of auditory information processing that accompanies hearing loss. Changes in cholinergic neuromodulation have been found to alter auditory deviance detection both in humans and animal models. Interestingly, some theories propose a role for acetylcholine in the development of Alzheimer's disease, the most common type of dementia. Acetylcholine is involved in multiple neurobiological processes such as attention, learning, memory, arousal, sleep and/or cognitive reinforcement, and has direct influence on the auditory system at the levels of the inferior colliculus and auditory cortex. Here we comment on the possible links between acetylcholine, hearing loss, and Alzheimer's disease, and association that is worth further investigation.

Decreasing dorsal cochlear nucleus activity ameliorates noise-induced tinnitus perception in mice

Background

The dorsal cochlear nucleus (DCN) is a region known to integrate somatosensory and auditory inputs and is identified as a potential key structure in the generation of phantom sound perception, especially noise-induced tinnitus. Yet, how altered homeostatic plasticity of the DCN induces and maintains the sensation of tinnitus is not clear. Here, we chemogenetically decrease activity of a subgroup of DCN neurons, Ca²⁺/Calmodulin kinase 2 α (CaMKII α)-positive DCN neurons, using Gi-coupled human M4 Designer Receptors Exclusively Activated by Designer Drugs (hM4Di DREADDs), to investigate their role in noise-induced tinnitus.

Results

Mice were exposed to loud noise (9–11kHz, 90dBSPL, 1h, followed by 2h of silence), and auditory brainstem responses (ABRs) and gap prepulse inhibition of acoustic startle (GPIAS) were recorded 2 days before and 2 weeks after noise exposure to identify animals with a significantly decreased inhibition of startle, indicating tinnitus but without permanent hearing loss. Neuronal activity of CaMKII α+ neurons expressing hM4Di in the DCN was lowered by administration of clozapine-N-oxide (CNO). We found that acutely decreasing firing rate of CaMKII α+ DCN units decrease tinnitus-like responses (p = 3e −3, n = 11 mice), compared to the control group that showed no improvement in GPIAS (control virus; CaMKII α-YFP + CNO, p = 0.696, n = 7 mice). Extracellular recordings confirmed CNO to decrease unit firing frequency of CaMKII α-hM4Di+ mice and alter best frequency and tuning width of response to sound. However, these effects were not seen if CNO had been previously administered during the noise exposure (n = 6 experimental and 6 control mice).

Conclusion

We found that lowering DCN activity in mice displaying tinnitus-related behavior reduces tinnitus, but lowering DCN activity during noise exposure does not prevent noise-induced tinnitus. Our results suggest that CaMKII α-positive cells in the DCN are not crucial for tinnitus induction but play a significant role in maintaining tinnitus perception in mice.

Supplementary Information

The online version contains supplementary material available at (10.1186/s12915-022-01288-1).

The Neural Representation of a Repeated Standard Stimulus in Dyslexia

The neural representation of a repeated stimulus is the standard against which a deviant stimulus is measured in the brain, giving rise to the well-known mismatch response. It has been suggested that individuals with dyslexia have poor implicit memory for recently repeated stimuli, such as the train of standards in an oddball paradigm. Here, we examined how the neural representation of a standard emerges over repetitions, asking whether there is less sensitivity to repetition and/or less accrual of "standardness" over successive repetitions in dyslexia. We recorded magnetoencephalography (MEG) as adults with and without dyslexia were passively exposed to speech syllables in a roving-oddball design. We performed time-resolved multivariate decoding of the MEG sensor data to identify the neural signature of standard vs. deviant trials, independent of stimulus differences. This "multivariate mismatch" was equally robust and had a similar time course in the two groups. In both groups, standards generated by as few as two repetitions were distinct from deviants, indicating normal sensitivity to repetition in dyslexia. However, only in the control group did standards become increasingly different from deviants with repetition. These results suggest that many of the mechanisms that give rise to neural adaptation as well as mismatch responses are intact in dyslexia, with the possible exception of a putatively predictive mechanism that successively integrates recent sensory information into feedforward processing.

Separate Functional Subnetworks of Excitatory Neurons Show Preference to Periodic and Random Sound Structures

Auditory cortex (ACX) neurons are sensitive to spectro-temporal sound patterns and violations in patterns induced by rare stimuli embedded within streams of sounds. We investigate the auditory cortical representation of repeated presentations of sequences of sounds with standard stimuli (common) with an embedded deviant (rare) stimulus in two conditions, Periodic (Fixed deviant position) or Random (Random deviant position). We used extracellular single-unit and two-photon Ca2+ imaging recordings in layer 2/3 neurons of the mouse (Mus musculus) ACX of either sex. Population single-unit average responses increased over repetitions in the Random condition and were suppressed or did not change in the Periodic condition, showing general irregularity preference. A subset of neurons showed the opposite behavior, indicating regularity preference. Furthermore, pairwise noise correlations were higher in the Random condition than in the Periodic condition, suggesting a role of recurrent connections in the observed differential adaptation. Functional two-photon Ca2+ imaging showed that excitatory (EX), and inhibitory (IN) neurons [parvalbumin-positive (PV) and somatostatin-positive (SOM)] also had different categories of long-term adaptation as observed with single-units. However, examination of functional connectivity between pairs of neurons of different categories showed that EX-PV connected pairs behaved opposite to the EX-EX and EX-SOM pairs, with more connections outside category in Random condition than Periodic condition. Finally, considering Regularity, Irregularity, and no preference of connected pairs of neurons showed that EX-EX and EX-SOM pairs were in largely separate functional subnetworks with different preferences, not EX-PV pairs. Thus, separate subnetworks underlie coding of periodic and random sound sequences.SIGNIFICANCE STATEMENT Studying how the auditory cortex (ACX) neurons respond to streams of sound sequences help us understand the importance of changes in dynamic acoustic noisy scenes around us. Humans and animals are sensitive to regularity and its violations in sound sequences. Psychophysical tasks in humans show that the auditory brain differentially responds to Periodic and Random structures, independent of the listener's attentional states. Here, we show that mouse ACX L2/3 neurons detect changes and respond differently to patterns over long-time scales. The differential functional connectivity profile obtained in response to two different sound contexts suggests the vital role of recurrent connections in the auditory cortical network. Furthermore, the excitatory-inhibitory neuronal interactions can contribute to detecting the changing sound patterns.

Cortico-fugal regulation of predictive coding

Sensory systems must account for both contextual factors and prior experience to adaptively engage with the dynamic external environment. In the central auditory system, neurons modulate their responses to sounds based on statistical context. These response modulations can be understood through a hierarchical predictive coding lens: responses to repeated stimuli are progressively decreased, in a process known as repetition suppression, whereas unexpected stimuli produce a prediction error signal. Prediction error incrementally increases along the auditory hierarchy from the inferior colliculus (IC) to the auditory cortex (AC), suggesting that these regions may engage in hierarchical predictive coding. A potential substrate for top-down predictive cues is the massive set of descending projections from the auditory cortex to subcortical structures, although the role of this system in predictive processing has never been directly assessed. We tested the effect of optogenetic inactivation of the auditory cortico-collicular feedback in awake mice on responses of IC neurons to stimuli designed to test prediction error and repetition suppression. Inactivation of the cortico-collicular pathway led to a decrease in prediction error in IC. Repetition suppression was unaffected by cortico-collicular inactivation, suggesting that this metric may reflect fatigue of bottom-up sensory inputs rather than predictive processing. We also discovered populations of IC units that exhibit repetition enhancement, a sequential increase in firing with stimulus repetition. Cortico-collicular inactivation led to a decrease in repetition enhancement in the central nucleus of IC, suggesting that it is a top-down phenomenon. Negative prediction error, a stronger response to a tone in a predictable rather than unpredictable sequence, was suppressed in shell IC units during cortico-collicular inactivation. These changes in predictive coding metrics arose from bidirectional modulations in the response to the standard and deviant contexts, such that units in IC responded more similarly to each context in the absence of cortical input. We also investigated how these metrics compare between the anesthetized and awake states by recording from the same units under both conditions. We found that metrics of predictive coding and deviance detection differ depending on the anesthetic state of the animal, with negative prediction error emerging in the central IC and repetition enhancement and prediction error being more prevalent in the absence of anesthesia. Overall, our results demonstrate that the auditory cortex provides cues about the statistical context of sound to subcortical brain regions via direct feedback, regulating processing of both prediction and repetition.

Neurophysiology in psychosis: The quest for disease biomarkers

Psychotic disorders affect 3% of the population at some stage in life, are a leading cause of disability, and impose a great economic burden on society. Major breakthroughs in the genetics of psychosis have not yet been matched by an understanding of its neurobiology. Biomarkers of perception and cognition obtained through non-invasive neurophysiological tools, especially EEG, offer a unique opportunity to gain mechanistic insights. Techniques for measuring neurophysiological markers are inexpensive and ubiquitous, thus having the potential as an accessible tool for patient stratification towards early treatments leading to better outcomes. In this paper, we review the literature on neurophysiological markers for psychosis and their relevant disease mechanisms, mainly covering event-related potentials including P50/N100 sensory gating, mismatch negativity, and the N100 and P300 waveforms. While several neurophysiological deficits are well established in patients with psychosis, more research is needed to study neurophysiological markers in their unaffected relatives and individuals at clinical high risk. We need to harness EEG to investigate markers of disease risk as key steps to elucidate the aetiology of psychosis and facilitate earlier detection and treatment.

Mismatch Responses Evoked by Sound Pattern Violation in the Songbird Forebrain Suggest Common Auditory Processing With Human

Learning sound patterns in the natural auditory scene and detecting deviant patterns are adaptive behaviors that aid animals in predicting future events and behaving accordingly. Mismatch negativity (MMN) is a component of the event-related potential (ERP) that is reported in humans when they are exposed to unexpected or rare stimuli. MMN has been studied in several non-human animals using an oddball task by presenting deviant pure tones that were interspersed within a sequence of standard pure tones and comparing the neural responses. While accumulating evidence suggests the homology of non-human animal MMN-like responses (MMRs) and human MMN, it is still not clear whether the function and neural mechanisms of MMRs and MMN are comparable. The Java sparrow (Lonchura oryzivora) is a songbird that is a vocal learner, is highly social, and maintains communication with flock members using frequently repeated contact calls and song. We expect that the songbird is a potentially useful animal model that will broaden our understanding of the characterization of MMRs. Due to this, we chose this species to explore MMRs to the deviant sounds in the single sound oddball task using both pure tones and natural vocalizations. MMRs were measured in the caudomedial nidopallium (NCM), a higher-order auditory area. We recorded local field potentials under freely moving conditions. Significant differences were observed in the negative component between deviant and standard ERPs, both to pure tones and natural vocalizations in the oddball sequence. However, the subsequent experiments using the randomized standard sequence and regular pattern sequence suggest the possibility that MMR elicited in the oddball paradigm reflects the adaptation to a repeated standard sound but not the genuine deviance detection. Furthermore, we presented contact call triplet sequences and investigated MMR in the NCM in response to sound sequence order. We found a significant negative shift in response to a difference in sequence pattern. This demonstrates MMR elicited by violation of the pattern of the triplet sequence and the ability to extract sound sequence information in the songbird auditory forebrain. Our study sheds light on the electrophysiological properties of auditory sensory memory processing, expanding the scope of characterization of MMN-like responses beyond simple deviance detection, and provides a comparative perspective on syntax processing in human.

Constructing the hierarchy of predictive auditory sequences in the marmoset brain

Our brains constantly generate predictions of sensory input that are compared with actual inputs, propagate the prediction-errors through a hierarchy of brain regions, and subsequently update the internal predictions of the world. However, the essential feature of predictive coding, the notion of hierarchical depth and its neural mechanisms, remains largely unexplored. Here, we investigated the hierarchical depth of predictive auditory processing by combining functional magnetic resonance imaging (fMRI) and high-density whole-brain electrocorticography (ECoG) in marmoset monkeys during an auditory local-global paradigm in which the temporal regularities of the stimuli were designed at two hierarchical levels. The prediction-errors and prediction updates were examined as neural responses to auditory mismatches and omissions. Using fMRI, we identified a hierarchical gradient along the auditory pathway: midbrain and sensory regions represented local, shorter-time-scale predictive processing followed by associative auditory regions, whereas anterior temporal and prefrontal areas represented global, longer-time-scale sequence processing. The complementary ECoG recordings confirmed the activations at cortical surface areas and further differentiated the signals of prediction-error and update, which were transmitted via putative bottom-up γ and top-down β oscillations, respectively. Furthermore, omission responses caused by absence of input, reflecting solely the two levels of prediction signals that are unique to the hierarchical predictive coding framework, demonstrated the hierarchical top-down process of predictions in the auditory, temporal, and prefrontal areas. Thus, our findings support the hierarchical predictive coding framework, and outline how neural networks and spatiotemporal dynamics are used to represent and arrange a hierarchical structure of auditory sequences in the marmoset brain.

Neural Substrates and Models of Omission Responses and Predictive Processes

Predictive coding theories argue that deviance detection phenomena, such as mismatch responses and omission responses, are generated by predictive processes with possibly overlapping neural substrates. Molecular imaging and electrophysiology studies of mismatch responses and corollary discharge in the rodent model allowed the development of mechanistic and computational models of these phenomena. These models enable translation between human and non-human animal research and help to uncover fundamental features of change-processing microcircuitry in the neocortex. This microcircuitry is characterized by stimulus-specific adaptation and feedforward inhibition of stimulus-selective populations of pyramidal neurons and interneurons, with specific contributions from different interneuron types. The overlap of the substrates of different types of responses to deviant stimuli remains to be understood. Omission responses, which are observed both in corollary discharge and mismatch response protocols in humans, are underutilized in animal research and may be pivotal in uncovering the substrates of predictive processes. Omission studies comprise a range of methods centered on the withholding of an expected stimulus. This review aims to provide an overview of omission protocols and showcase their potential to integrate and complement the different models and procedures employed to study prediction and deviance detection.This approach may reveal the biological foundations of core concepts of predictive coding, and allow an empirical test of the framework's promise to unify theoretical models of attention and perception.

Novel stimuli evoke excess activity in the mouse primary visual cortex

Rapid detection and processing of stimulus novelty are key elements of adaptive behavior. Predictive coding theories postulate that novel stimuli should be encoded differently from familiar stimuli. Here, we show that the majority of neurons in layer 2/3 of the mouse primary visual cortex exhibit a significant excess response to novel visual stimuli. The distinction between novel and familiar images developed rapidly, requiring only a few repeated presentations. We show that this phenomenon can be described by a model of cascading adaptation. This ubiquitous mechanism makes it likely that similar computations could be carried out in many brain areas.

To explore how neural circuits represent novel versus familiar inputs, we presented mice with repeated sets of images with novel images sparsely substituted. Using two-photon calcium imaging to record from layer 2/3 neurons in the mouse primary visual cortex, we found that novel images evoked excess activity in the majority of neurons. This novelty response rapidly emerged, arising with a time constant of 2.6 ± 0.9 s. When a new image set was repeatedly presented, a majority of neurons had similarly elevated activity for the first few presentations, which decayed to steady state with a time constant of 1.4 ± 0.4 s. When we increased the number of images in the set, the novelty response’s amplitude decreased, defining a capacity to store ∼15 familiar images under our conditions. These results could be explained quantitatively using an adaptive subunit model in which presynaptic neurons have individual tuning and gain control. This result shows that local neural circuits can create different representations for novel versus familiar inputs using generic, widely available mechanisms.

Predictive Coding, Variational Autoencoders, and Biological Connections

We present a review of predictive coding, from theoretical neuroscience, and variational autoencoders, from machine learning, identifying the common origin and mathematical framework underlying both areas. As each area is prominent within its respective field, more firmly connecting these areas could prove useful in the dialogue between neuroscience and machine learning. After reviewing each area, we discuss two possible correspondences implied by this perspective: cortical pyramidal dendrites as analogous to (nonlinear) deep networks and lateral inhibition as analogous to normalizing flows. These connections may provide new directions for further investigations in each field.

Listening in the Moment: How Bilingualism Interacts With Task Demands to Shape Active Listening

While there is evidence for bilingual enhancements of inhibitory control and auditory processing, two processes that are fundamental to daily communication, it is not known how bilinguals utilize these cognitive and sensory enhancements during real-world listening. To test our hypothesis that bilinguals engage their enhanced cognitive and sensory processing in real-world listening situations, bilinguals and monolinguals performed a selective attention task involving competing talkers, a common demand of everyday listening, and then later passively listened to the same competing sentences. During the active and passive listening periods, evoked responses to the competing talkers were collected to understand how online auditory processing facilitates active listening and if this processing differs between bilinguals and monolinguals. Additionally, participants were tested on a separate measure of inhibitory control to see if inhibitory control abilities related with performance on the selective attention task. We found that although monolinguals and bilinguals performed similarly on the selective attention task, the groups differed in the neural and cognitive processes engaged to perform this task, compared to when they were passively listening to the talkers. Specifically, during active listening monolinguals had enhanced cortical phase consistency while bilinguals demonstrated enhanced subcortical phase consistency in the response to the pitch contours of the sentences, particularly during passive listening. Moreover, bilinguals’ performance on the inhibitory control test related with performance on the selective attention test, a relationship that was not seen for monolinguals. These results are consistent with the hypothesis that bilinguals utilize inhibitory control and enhanced subcortical auditory processing in everyday listening situations to engage with sound in ways that are different than monolinguals.

The Adaptation Model Offers a Challenge for the Predictive Coding Account of Mismatch Negativity

An unpredictable stimulus elicits a stronger event-related response than a high-probability stimulus. This differential in response magnitude is termed the mismatch negativity (MMN). Over the past decade, it has become increasingly popular to explain the MMN terms of predictive coding, a proposed general principle for the way the brain realizes Bayesian inference when it interprets sensory information. This perspective article is a reminder that the issue of MMN generation is far from settled, and that an alternative model in terms of adaptation continues to lurk in the wings. The adaptation model has been discounted because of the unrealistic and simplistic fashion in which it tends to be set up. Here, simulations of auditory cortex incorporating a modern version of the adaptation model are presented. These show that locally operating short-term synaptic depression accounts both for adaptation due to stimulus repetition and for MMN responses. This happens even in cases where adaptation has been ruled out as an explanation of the MMN (e.g., in the stimulus omission paradigm and the multi-standard control paradigm). Simulation models that would demonstrate the viability of predictive coding in a similarly multifaceted way are currently missing from the literature, and the reason for this is discussed in light of the current results.

Corticothalamic projections deliver enhanced responses to medial geniculate body as a function of the temporal reliability of the stimulus

Ageing and challenging signal-in-noise conditions are known to engage the use of cortical resources to help maintain speech understanding. Extensive corticothalamic projections are thought to provide attentional, mnemonic and cognitive-related inputs in support of sensory inferior colliculus (IC) inputs to the medial geniculate body (MGB). Here we show that a decrease in modulation depth, a temporally less distinct periodic acoustic signal, leads to a jittered ascending temporal code, changing MGB unit responses from adapting responses to responses showing repetition enhancement, posited to aid identification of important communication and environmental sounds. Young-adult male Fischer Brown Norway rats, injected with the inhibitory opsin archaerhodopsin T (ArchT) into the primary auditory cortex (A1), were subsequently studied using optetrodes to record single-units in MGB. Decreasing the modulation depth of acoustic stimuli significantly increased repetition enhancement. Repetition enhancement was blocked by optical inactivation of corticothalamic terminals in MGB. These data support a role for corticothalamic projections in repetition enhancement, implying that predictive anticipation could be used to improve neural representation of weakly modulated sounds. KEY POINTS: In response to a less temporally distinct repeating sound with low modulation depth, medial geniculate body (MGB) single units show a switch from adaptation towards repetition enhancement. Repetition enhancement was reversed by blockade of MGB inputs from the auditory cortex. Collectively, these data argue that diminished acoustic temporal cues such as weak modulation engage cortical processes to enhance coding of those cues in auditory thalamus.

What can we learn from inactivation studies? Lessons from auditory cortex

Inactivation experiments in auditory cortex (AC) produce widely varying results that complicate interpretations regarding the precise role of AC in auditory perception and ensuing behaviour. The advent of optogenetic methods in neuroscience offers previously unachievable insight into the mechanisms transforming brain activity into behaviour. With a view to aiding the design and interpretation of future studies in and outside AC, here we discuss the methodological challenges faced in manipulating neural activity. While considering AC’s role in auditory behaviour through the prism of inactivation experiments, we consider the factors that confound the interpretation of the effects of inactivation on behaviour, including the species, the type of inactivation, the behavioural task employed, and the exact location of the inactivation.

Wide variation in the outcome of auditory cortex inactivation has been an impediment to clear conclusions regarding the roles of the auditory cortex in behaviour.

Inactivation methods differ in their efficacy and specificity. The likelihood of observing a behavioural deficit is additionally influenced by factors such as the species being used, task design and reward.

A synthesis of previous results suggests that auditory cortex involvement is critical for tasks that require integrating across multiple stimulus features, and less likely to be critical for simple feature discriminations.

New methods of neural silencing provide opportunities for spatially and temporally precise manipulation of activity, allowing perturbation of individual subfields and specific circuits.

Correlates of deviance detection in auditory brainstem responses of bats

Identifying unexpected acoustic inputs, which allows to react appropriately to new situations, is of major importance for animals. Neural deviance detection describes a change of neural response strength to a stimulus solely caused by the stimulus' probability of occurrence. In the present study, we searched for correlates of deviance detection in auditory brainstem responses obtained in anaesthetised bats (Carollia perspicillata). In an oddball paradigm, we used two pure tone stimuli that represented the main frequencies used by the animal during echolocation (60 kHz) and communication (20 kHz). For both stimuli, we could demonstrate significant differences of response strength between deviant and standard response in slow and fast components of the auditory brainstem response. The data suggest the presence of correlates of deviance detection in brain stations below the IC, at the level of the cochlea nucleus and lateral lemniscus. Additionally, our results suggest that deviance detection is mainly driven by repetition suppression in the echolocation frequency band, while in the communication band, a deviant-related enhancement of the response plays a more important role. This finding suggests a contextual dependence of the mechanisms underlying subcortical deviance detection. The present study demonstrates the value of auditory brainstem responses for studying deviance detection and suggests that auditory specialists, such as bats, use different frequency-specific strategies to ensure an appropriate sensation of unexpected sounds.

Broadband Dynamics Rather than Frequency-Specific Rhythms Underlie Prediction Error in the Primate Auditory Cortex

Detection of statistical irregularities, measured as a prediction error response, is fundamental to the perceptual monitoring of the environment. We studied whether prediction error response is associated with neural oscillations or asynchronous broadband activity. Electrocorticography was conducted in three male monkeys, who passively listened to the auditory roving oddball stimuli. Local field potentials (LFPs) recorded over the auditory cortex underwent spectral principal component analysis, which decoupled broadband and rhythmic components of the LFP signal. We found that the broadband component captured the prediction error response, whereas none of the rhythmic components were associated with statistical irregularities of sounds. The broadband component displayed more stochastic, asymmetrical multifractal properties than the rhythmic components, which revealed more self-similar dynamics. We thus conclude that the prediction error response is captured by neuronal populations generating asynchronous broadband activity, defined by irregular dynamic states, which, unlike oscillatory rhythms, appear to enable the neural representation of auditory prediction error response.SIGNIFICANCE STATEMENT This study aimed to examine the contribution of oscillatory and asynchronous components of auditory local field potentials in the generation of prediction error responses to sensory irregularities, as this has not been directly addressed in the previous studies. Here, we show that mismatch negativity-an auditory prediction error response-is driven by the asynchronous broadband component of potentials recorded in the auditory cortex. This finding highlights the importance of nonoscillatory neural processes in the predictive monitoring of the environment. At a more general level, the study demonstrates that stochastic neural processes, which are often disregarded as neural noise, do have a functional role in the processing of sensory information.

Encoding of acquired sound-sequence salience by auditory cortical offset responses

Behaviorally relevant sounds are often composed of distinct acoustic units organized into specific temporal sequences. The meaning of such sound sequences can therefore be fully recognized only when they have terminated. However, the neural mechanisms underlying the perception of sound sequences remain unclear. Here, we use two-photon calcium imaging in the auditory cortex of behaving mice to test the hypothesis that neural responses to termination of sound sequences ("Off-responses") encode their acoustic history and behavioral salience. We find that auditory cortical Off-responses encode preceding sound sequences and that learning to associate a sound sequence with a reward induces enhancement of Off-responses relative to responses during the sound sequence ("On-responses"). Furthermore, learning enhances network-level discriminability of sound sequences by Off-responses. Last, learning-induced plasticity of Off-responses but not On-responses lasts to the next day. These findings identify auditory cortical Off-responses as a key neural signature of acquired sound-sequence salience.

Auditory, Visual, and Cross-Modal Mismatch Negativities in the Rat Auditory and Visual Cortices

When the brain tries to acquire an elaborate model of the world, multisensory integration should contribute to building predictions based on the various pieces of information, and deviance detection should repeatedly update these predictions by detecting “errors” from the actual sensory inputs. Accumulating evidence such as a hierarchical organization of the deviance-detection system indicates that the deviance-detection system can be interpreted in the predictive coding framework. Herein, we targeted mismatch negativity (MMN) as a type of prediction-error signal and investigated the relationship between multisensory integration and MMN. In particular, we studied whether and how cross-modal information processing affected MMN in rodents. We designed a new surface microelectrode array and simultaneously recorded visual and auditory evoked potentials from the visual and auditory cortices of rats under anesthesia. Then, we mapped MMNs for five types of deviant stimuli: single-modal deviants in (i) the visual oddball and (ii) auditory oddball paradigms, eliciting single-modal MMN; (iii) congruent audio-visual deviants, (iv) incongruent visual deviants, and (v) incongruent auditory deviants in the audio-visual oddball paradigm, eliciting cross-modal MMN. First, we demonstrated that visual MMN exhibited deviance detection properties and that the first-generation focus of visual MMN was localized in the visual cortex, as previously reported in human studies. Second, a comparison of MMN amplitudes revealed a non-linear relationship between single-modal and cross-modal MMNs. Moreover, congruent audio-visual MMN exhibited characteristics of both visual and auditory MMNs—its latency was similar to that of auditory MMN, whereas local blockage of N-methyl-D-aspartic acid receptors in the visual cortex diminished it as well as visual MMN. These results indicate that cross-modal information processing affects MMN without involving strong top-down effects, such as those of prior knowledge and attention. The present study is the first electrophysiological evidence of cross-modal MMN in animal models, and future studies on the neural mechanisms combining multisensory integration and deviance detection are expected to provide electrophysiological evidence to confirm the links between MMN and predictive coding theory.

Corticothalamic Pathways in Auditory Processing: Recent Advances and Insights From Other Sensory Systems

The corticothalamic (CT) pathways emanate from either Layer 5 (L5) or 6 (L6) of the neocortex and largely outnumber the ascending, thalamocortical pathways. The CT pathways provide the anatomical foundations for an intricate, bidirectional communication between thalamus and cortex. They act as dynamic circuits of information transfer with the ability to modulate or even drive the response properties of target neurons at each synaptic node of the circuit. L6 CT feedback pathways enable the cortex to shape the nature of its driving inputs, by directly modulating the sensory message arriving at the thalamus. L5 CT pathways can drive the postsynaptic neurons and initiate a transthalamic corticocortical circuit by which cortical areas communicate with each other. For this reason, L5 CT pathways place the thalamus at the heart of information transfer through the cortical hierarchy. Recent evidence goes even further to suggest that the thalamus via CT pathways regulates functional connectivity within and across cortical regions, and might be engaged in cognition, behavior, and perceptual inference. As descending pathways that enable reciprocal and context-dependent communication between thalamus and cortex, we venture that CT projections are particularly interesting in the context of hierarchical perceptual inference formulations such as those contemplated in predictive processing schemes, which so far heavily rely on cortical implementations. We discuss recent proposals suggesting that the thalamus, and particularly higher order thalamus via transthalamic pathways, could coordinate and contextualize hierarchical inference in cortical hierarchies. We will explore these ideas with a focus on the auditory system.

Automatic Sensory Predictions: A Review of Predictive Mechanisms in the Brain and Their Link to Conscious Processing

The human brain has the astonishing capacity of integrating streams of sensory information from the environment and forming predictions about future events in an automatic way. Despite being initially developed for visual processing, the bulk of predictive coding research has subsequently focused on auditory processing, with the famous mismatch negativity signal as possibly the most studied signature of a surprise or prediction error (PE) signal. Auditory PEs are present during various consciousness states. Intriguingly, their presence and characteristics have been linked with residual levels of consciousness and return of awareness. In this review we first give an overview of the neural substrates of predictive processes in the auditory modality and their relation to consciousness. Then, we focus on different states of consciousness - wakefulness, sleep, anesthesia, coma, meditation, and hypnosis - and on what mysteries predictive processing has been able to disclose about brain functioning in such states. We review studies investigating how the neural signatures of auditory predictions are modulated by states of reduced or lacking consciousness. As a future outlook, we propose the combination of electrophysiological and computational techniques that will allow investigation of which facets of sensory predictive processes are maintained when consciousness fades away.

The posterior auditory field is the chief generator of prediction error signals in the auditory cortex

The auditory cortex (AC) encompasses distinct fields subserving partly different aspects of sound processing. One essential function of the AC is the detection of unpredicted sounds, as revealed by differential neural activity to predictable and unpredictable sounds. According to the predictive coding framework, this effect can be explained by repetition suppression and/or prediction error signaling. The present study investigates functional specialization of the rat AC fields in repetition suppression and prediction error by combining a tone frequency oddball paradigm (involving high-probable standard and low-probable deviant tones) with two different control sequences (many-standards and cascade). Tones in the control sequences were comparable to deviant events with respect to neural adaptation but were not violating a regularity. Therefore, a difference in the neural activity between deviant and control tones indicates a prediction error effect, whereas a difference between control and standard tones indicates a repetition suppression effect. Single-unit recordings revealed by far the largest prediction error effects for the posterior auditory field, while the primary auditory cortex, the anterior auditory field, the ventral auditory field, and the suprarhinal auditory field were dominated by repetition suppression effects. Statistically significant repetition suppression effects occurred in all AC fields, whereas prediction error effects were less robust in the primary auditory cortex and the anterior auditory field. Results indicate that the non-lemniscal, posterior auditory field is more engaged in context-dependent processing underlying deviance-detection than the other AC fields, which are more sensitive to stimulus-dependent effects underlying differential degrees of neural adaptation.

Visual Influences on Auditory Behavioral, Neural, and Perceptual Processes: A Review

In a naturalistic environment, auditory cues are often accompanied by information from other senses, which can be redundant with or complementary to the auditory information. Although the multisensory interactions derived from this combination of information and that shape auditory function are seen across all sensory modalities, our greatest body of knowledge to date centers on how vision influences audition. In this review, we attempt to capture the state of our understanding at this point in time regarding this topic. Following a general introduction, the review is divided into 5 sections. In the first section, we review the psychophysical evidence in humans regarding vision's influence in audition, making the distinction between vision's ability to enhance versus alter auditory performance and perception. Three examples are then described that serve to highlight vision's ability to modulate auditory processes: spatial ventriloquism, cross-modal dynamic capture, and the McGurk effect. The final part of this section discusses models that have been built based on available psychophysical data and that seek to provide greater mechanistic insights into how vision can impact audition. The second section reviews the extant neuroimaging and far-field imaging work on this topic, with a strong emphasis on the roles of feedforward and feedback processes, on imaging insights into the causal nature of audiovisual interactions, and on the limitations of current imaging-based approaches. These limitations point to a greater need for machine-learning-based decoding approaches toward understanding how auditory representations are shaped by vision. The third section reviews the wealth of neuroanatomical and neurophysiological data from animal models that highlights audiovisual interactions at the neuronal and circuit level in both subcortical and cortical structures. It also speaks to the functional significance of audiovisual interactions for two critically important facets of auditory perception-scene analysis and communication. The fourth section presents current evidence for alterations in audiovisual processes in three clinical conditions: autism, schizophrenia, and sensorineural hearing loss. These changes in audiovisual interactions are postulated to have cascading effects on higher-order domains of dysfunction in these conditions. The final section highlights ongoing work seeking to leverage our knowledge of audiovisual interactions to develop better remediation approaches to these sensory-based disorders, founded in concepts of perceptual plasticity in which vision has been shown to have the capacity to facilitate auditory learning.

Impaired Adaptation and Laminar Processing of the Oddball Paradigm in the Primary Visual Cortex of Fmr1 KO Mouse

Both adaptation and novelty detection are an integral part of sensory processing. Recent animal oddball studies have advanced our understanding of circuitry underlying contextual processing in early sensory areas. However, it is unclear how adaptation and mismatch (MM) responses depend on the tuning properties of neurons and their laminar position. Furthermore, given that reduced habituation and sensory overload are among the hallmarks of altered sensory perception in autism, we investigated how oddball processing might be altered in a mouse model of fragile X syndrome (FX). Using silicon probe recordings and a novel spatial frequency (SF) oddball paradigm, we discovered that FX mice show reduced adaptation and enhanced MM responses compared to control animals. Specifically, we found that adaptation is primarily restricted to neurons with preferred oddball SF in FX compared to WT mice. Mismatch responses, on the other hand, are enriched in the superficial layers of WT animals but are present throughout lamina in FX animals. Last, we observed altered neural dynamics in FX mice in response to stimulus omissions. Taken together, we demonstrated that reduced feature adaptation coexists with impaired laminar processing of oddball responses, which might contribute to altered sensory perception in FX syndrome and autism.

A Critical Review of the Deviance Detection Theory of Mismatch Negativity

Mismatch negativity (MMN) is a component of the difference waveform derived from passive auditory oddball stimulation. Since its inception in 1978, this has become one of the most popular event-related potential techniques, with over two-thousand published studies using this method. This is a testament to the ingenuity and commitment of generations of researchers engaging in basic, clinical and animal research. Despite this intensive effort, high-level descriptions of the mechanisms theorized to underpin mismatch negativity have scarcely changed over the past four decades. The prevailing deviance detection theory posits that MMN reflects inattentive detection of difference between repetitive standard and infrequent deviant stimuli due to a mismatch between the unexpected deviant and a memory representation of the standard. Evidence for these mechanisms is inconclusive, and a plausible alternative sensory processing theory considers fundamental principles of sensory neurophysiology to be the primary source of differences between standard and deviant responses evoked during passive oddball stimulation. By frequently being restated without appropriate methods to exclude alternatives, the potentially flawed deviance detection theory has remained largely dominant, which could lead some researchers and clinicians to assume its veracity implicitly. It is important to have a more comprehensive understanding of the source(s) of MMN generation before its widespread application as a clinical biomarker. This review evaluates issues of validity concerning the prevailing theoretical account of mismatch negativity and the passive auditory oddball paradigm, highlighting several limitations regarding its interpretation and clinical application.