Stimulus-specific adaptation in the inferior colliculus of the anesthetized rat

Erroneous predictive coding across brain hierarchies in a non-human primate model of autism spectrum disorder

In autism spectrum disorder (ASD), atypical sensory experiences are often associated with irregularities in predictive coding, which proposes that the brain creates hierarchical sensory models via a bidirectional process of predictions and prediction errors. However, it remains unclear how these irregularities manifest across different functional hierarchies in the brain. To address this, we study a marmoset model of ASD induced by valproic acid (VPA) treatment. We record high-density electrocorticography (ECoG) during an auditory task with two layers of temporal control, and applied a quantitative model to quantify the integrity of predictive coding across two distinct hierarchies. Our results demonstrate a persistent pattern of sensory hypersensitivity and unstable predictions across two brain hierarchies in VPA-treated animals, and reveal the associated spatio-spectro-temporal neural signatures. Despite the regular occurrence of imprecise predictions in VPA-treated animals, we observe diverse configurations of underestimation or overestimation of sensory regularities within the hierarchies. Our results demonstrate the coexistence of the two primary Bayesian accounts of ASD: overly-precise sensory observations and weak prior beliefs, and offer a potential multi-layered biomarker for ASD, which could enhance our understanding of its diverse symptoms.

Two Prediction Error Systems in the Nonlemniscal Inferior Colliculus: "Spectral" and "Nonspectral"

According to the predictive processing framework, perception emerges from the reciprocal exchange of predictions and prediction errors (PEs) between hierarchically organized neural circuits. The nonlemniscal division of the inferior colliculus (IC) is the earliest source of auditory PE signals, but their neuronal generators, properties, and functional relevance have remained mostly undefined. We recorded single-unit mismatch responses to auditory oddball stimulation at different intensities, together with activity evoked by two sequences of alternating tones to control frequency-specific effects. Our results reveal a differential treatment of the unpredictable "many-standards" control and the predictable "cascade" control by lemniscal and nonlemniscal IC neurons that is not present in the auditory thalamus or cortex. Furthermore, we found that frequency response areas of nonlemniscal IC neurons reflect their role in subcortical predictive processing, distinguishing three hierarchical levels: (1) nonlemniscal neurons with sharply tuned receptive fields exhibit mild repetition suppression without signaling PEs, thereby constituting the input level of the local predictive processing circuitry. (2) Neurons with broadly tuned receptive fields form the main, "spectral" PE signaling system, which provides dynamic gain compensation to near-threshold unexpected sounds. This early enhancement of saliency reliant on spectral features was not observed in the auditory thalamus or cortex. (3) Untuned neurons form an accessory, "nonspectral" PE signaling system, which reports all surprising auditory deviances in a robust and consistent manner, resembling nonlemniscal neurons in the auditory cortex. These nonlemniscal IC neurons show unstructured and unstable receptive fields that could result from inhibitory input controlled by corticofugal projections conveying top-down predictions.

Tonotopic Ca2+ dynamics and sound processing in auditory interneurons of the bush-cricket Mecopoda elongata

Two auditory neurons, TN-1 and ON-1, in the bush-cricket, Mecopoda elongata, have large dendritic arborisations which receive excitatory synaptic inputs from tonotopically organised axonal terminals of auditory afferents in the prothoracic ganglion. By combining intracellular microelectrode recording with calcium imaging we demonstrate that the dendrites of both neurons show a clear Ca2+ signal in response to broad-frequency species-specific chirps. Due to the organisation of the afferents frequency specific auditory activation should lead to local Ca2+ increases in their dendrites. In response to 20 ms sound pulses the dendrites of both neurons showed tonotopically organised Ca2+ increases. In ON-1 we found no evidence for a tonotopic organisation of the Ca2+ signal related to axonal spike activity or for a Ca2+ response related to contralateral inhibition. The tonotopic organisation of the afferents may facilitate frequency-specific adaptation in these auditory neurons through localised Ca2+ increases in their dendrites. By combining 10 and 40 kHz test pulses and adaptation series, we provide evidence for frequency-specific adaptation in TN-1 and ON-1. By reversible deactivating of the auditory afferents and removing contralateral inhibition, we show that in ON-1 spike activity and Ca2+ responses increased but frequency-specific adaptation was not evident.

Neural correlates of novelty detection in the primary auditory cortex of behaving monkeys

The neural mechanisms underlying novelty detection are not well understood, especially in relation to behavior. Here, we present single-unit responses from the primary auditory cortex (A1) from two monkeys trained to detect deviant tones amid repetitive ones. Results show that monkeys can detect deviant sounds, and there is a strong correlation between late neuronal responses (250-350 ms after deviant onset) and the monkeys' perceptual decisions. The magnitude and timing of both neuronal and behavioral responses are increased by larger frequency differences between the deviant and standard tones and by increasing the number of standard tones preceding the deviant. This suggests that A1 neurons encode novelty detection in behaving monkeys, influenced by stimulus relevance and expectations. This study provides evidence supporting aspects of predictive coding in the sensory cortex.

How 'hidden hearing loss' noise exposure affects neural coding in the inferior colliculus of rats

Exposure to brief, intense sound can produce profound changes in the auditory system, from the internal structure of inner hair cells to reduced synaptic connections between the auditory nerves and the inner hair cells. Moreover, noisy environments can also lead to alterations in the auditory nerve or to processing changes in the auditory midbrain, all without affecting hearing thresholds. This so-called hidden hearing loss (HHL) has been shown in tinnitus patients and has been posited to account for hearing difficulties in noisy environments. However, much of the neuronal research thus far has investigated how HHL affects the response characteristics of individual fibres in the auditory nerve, as opposed to higher stations in the auditory pathway. Human models show that the auditory nerve encodes sound stochastically. Therefore, a sufficient reduction in nerve fibres could result in lowering the sampling of the acoustic scene below the minimum rate necessary to fully encode the scene, thus reducing the efficacy of sound encoding. Here, we examine how HHL affects the responses to frequency and intensity of neurons in the inferior colliculus of rats, and the duration and firing rate of those responses. Finally, we examined how shorter stimuli are encoded less effectively by the auditory midbrain than longer stimuli, and how this could lead to a clinical test for HHL.

Detection of a temporal salient object benefits from visual stimulus-specific adaptation in avian midbrain inhibitory nucleus

Food and predators are the most noteworthy objects for the basic survival of wild animals, and both are often deviant in both spatial and temporal domains and quickly attract an animal's attention. Although stimulus-specific adaptation (SSA) is considered a potential neural basis of salient sound detection in the temporal domain, related research on visual SSA is limited and its relationship with temporal saliency is uncertain. The avian nucleus isthmi pars magnocellularis (Imc), which is central to midbrain selective attention network, is an ideal site to investigate the neural correlate of visual SSA and detection of a salient object in the time domain. Here, the constant order paradigm was applied to explore the visual SSA in the Imc of pigeons. The results showed that the firing rates of Imc neurons gradually decrease with repetitions of motion in the same direction, but recover when a motion in a deviant direction is presented, implying visual SSA to the direction of a moving object. Furthermore, enhanced response for an object moving in other directions that were not presented ever in the paradigm is also observed. To verify the neural mechanism underlying these phenomena, we introduced a neural computation model involving a recoverable synaptic change with a "center-surround" pattern to reproduce the visual SSA and temporal saliency for the moving object. These results suggest that the Imc produces visual SSA to motion direction, allowing temporal salient object detection, which may facilitate the detection of the sudden appearance of a predator.

From psychophysiology to brain imaging: forty-five years MMN history of investigating acoustic change sensitivity

Forty-five years have passed since the first publication of the mismatch negativity (MMN) event-related brain potential (ERP) component. The first 10 years of research hardly gained any particular attention of the scientific community interested in acoustic perception. Debates on the nature of sensation versus perception were going on, and the technical possibilities to record ERPs, called in general evoked potentials, were very limited. Subtle changes in pure tone frequency or intensity giving rise to the MMN component were first investigated in humans. The background of the theoretical model developed by Risto Näätänen was the orientation reaction model of E.N. Sokolov published in 1963 so that the MMN was seen first as an electrophysiological correlate of auditory change detection. This fundamental ability of the auditory system seen as crucial for survival led to the development of the first animal model of the MMN (Csépe et al. in Clin Neurophysiol 66: 571-578, 1987). Indeed, it was confirmed that the MMN was the brain correlate of subtle changes detected that might alert to potential threats in the environment and direct the behavioral orientation. The investigations performed after 2000 introduced complex models and more sophisticated methods, both in animal and human studies, so that the MMN method was on the way to become a tool on the first place and not the main goal of research. This approach was further strengthened by the increasing number of studies on different clinical populations aiming at future applications. The aim of our review is to describe and redefine what the MMN may reflect in auditory perception and to show why and how this brain correlate of changes in the auditory scene can be used as a valuable tool in cognitive neuroscience research. We refer to publications selected to underly the argument the MMN cannot be classified anymore as a sign of simple change detection and not all the indicators used to confirm how genuine the MMN elicited by variations of tones are valid for those to  speech contrasts. We provide a fresh view on the broadly used MMN models, provided by some influential publications as well as on the unwritten history of MMN research aiming to give revised picture on what the MMN may truly reflect. We show how the focus and terminology of the MMN research have changed and what kind of misunderstandings and seemingly contradictive results prevent the MMN community to accept a generally usable cognitive model.

Acetylcholine modulates the precision of prediction error in the auditory cortex

A fundamental property of sensory systems is their ability to detect novel stimuli in the ambient environment. The auditory brain contains neurons that decrease their response to repetitive sounds but increase their firing rate to novel or deviant stimuli; the difference between both responses is known as stimulus-specific adaptation or neuronal mismatch (nMM). Here, we tested the effect of microiontophoretic applications of ACh on the neuronal responses in the auditory cortex (AC) of anesthetized rats during an auditory oddball paradigm, including cascade controls. Results indicate that ACh modulates the nMM, affecting prediction error responses but not repetition suppression, and this effect is manifested predominantly in infragranular cortical layers. The differential effect of ACh on responses to standards, relative to deviants (in terms of averages and variances), was consistent with the representational sharpening that accompanies an increase in the precision of prediction errors. These findings suggest that ACh plays an important role in modulating prediction error signaling in the AC and gating the access of these signals to higher cognitive levels.

Sequential maturation of stimulus-specific adaptation in the mouse lemniscal auditory system

Stimulus-specific adaptation (SSA), the reduction of neural activity to a common stimulus that does not generalize to other, rare stimuli, is an essential property of our brain. Although well characterized in adults, it is still unknown how it develops during adolescence and what neuronal circuits are involved. Using in vivo electrophysiology and optogenetics in the lemniscal pathway of the mouse auditory system, we observed SSA to be stable from postnatal day 20 (P20) in the inferior colliculus, to develop until P30 in the auditory thalamus and even later in the primary auditory cortex (A1). We found this maturation process to be experience-dependent in A1 but not in thalamus and to be related to alterations in deep but not input layers of A1. We also identified corticothalamic projections to be implicated in thalamic SSA development. Together, our results reveal different circuits underlying the sequential SSA maturation and provide a unique perspective to understand predictive coding and surprise across sensory systems.

Brainstem fMRI signaling of surprise across different types of deviant stimuli

Detection of deviant stimuli is crucial to orient and adapt our behavior. Previous work shows that deviant stimuli elicit phasic activation of the locus coeruleus (LC), which releases noradrenaline and controls central arousal. However, it is unclear whether the detection of behaviorally relevant deviant stimuli selectively triggers LC responses or other neuromodulatory systems (dopamine, serotonin, and acetylcholine). We combine human functional MRI (fMRI) recordings optimized for brainstem imaging with pupillometry to perform a mapping of deviant-related responses in subcortical structures. Participants have to detect deviant items in a "local-global" paradigm that distinguishes between deviance based on the stimulus probability and the sequence structure. fMRI responses to deviant stimuli are distributed in many cortical areas. Both types of deviance elicit responses in the pupil, LC, and other neuromodulatory systems. Our results reveal that the detection of task-relevant deviant items recruits the same multiple subcortical systems across computationally different types of deviance.

Novelty detection in an auditory oddball task on freely moving rats

The relative importance or saliency of sensory inputs depend on the animal's environmental context and the behavioural responses to these same inputs can vary over time. Here we show how freely moving rats, trained to discriminate between deviant tones embedded in a regular pattern of repeating stimuli and different variations of the classic oddball paradigm, can detect deviant tones, and this discriminability resembles the properties that are typical of neuronal adaptation described in previous studies. Moreover, the auditory brainstem response (ABR) latency decreases after training, a finding consistent with the notion that animals develop a type of plasticity to auditory stimuli. Our study suggests the existence of a form of long-term memory that may modulate the level of neuronal adaptation according to its behavioural relevance, and sets the ground for future experiments that will help to disentangle the functional mechanisms that govern behavioural habituation and its relation to neuronal adaptation.

Gradients of response latencies and temporal precision of auditory neurons extend across the whole inferior colliculus

Neural responses to acoustic stimulation have long been studied throughout the auditory system to understand how sound information is coded for perception. Within the inferior colliculus (IC), a majority of the studies have focused predominantly on characterizing neural responses within the central region (ICC), as it is viewed as part of the lemniscal system mainly responsible for auditory perception. In contrast, the responses of outer cortices (ICO) have largely been unexplored, though they also function in auditory perception tasks. Therefore, we sought to expand on previous work by completing a three-dimensional (3-D) functional mapping study of the whole IC. We analyzed responses to different pure tone and broadband noise stimuli across all IC subregions and correlated those responses with over 2,000 recording locations across the IC. Our study revealed there are well-organized trends for temporal response parameters across the full IC that do not show a clear distinction at the ICC and ICO border. These gradients span from slow, imprecise responses in the caudal-medial IC to fast, precise responses in the rostral-lateral IC, regardless of subregion, including the fastest responses located in the ICO. These trends were consistent at various acoustic stimulation levels. Weaker spatial trends could be found for response duration and spontaneous activity. Apart from tonotopic organization, spatial trends were not apparent for spectral response properties. Overall, these detailed acoustic response maps across the whole IC provide new insights into the organization and function of the IC.NEW & NOTEWORTHY Study of the inferior colliculus (IC) has largely focused on the central nucleus, with little exploration of the outer cortices. Here, we systematically assessed the acoustic response properties from over 2,000 locations in different subregions of the IC. The results revealed spatial trends in temporal response patterns that span all subregions. Furthermore, two populations of temporal response types emerged for neurons in the outer cortices that may contribute to their functional roles in auditory tasks.

The impact of spatial variance on precision estimates in an auditory oddball paradigm

Predictive processing theories suggest that a principal function of the brain is to reduce the surprise of incoming sensory information by creating accurate and precise models of the environment. These models are commonly explored by looking at the prediction errors elicited when experience departs from predictions. One such prediction error is the mismatch negativity (MMN). Using this component, it is possible to examine the effect of external noise on the precision of the developed model. Recent studies have shown that the brain may not update its model every time there is a change in the environment, rather it will only update it when doing so will increase precision and or accuracy of the model. The current study examined this process using oddball sound sequences with high and low spatial variability and examining how this affected the elicited MMN to a duration deviant sound. The results showed a strong null effect of spatial variance both at a local and sequence levels. These results indicate that variability in the sound sequence will not invariably affect model precision estimates and thus the amplitude of the MMN component.

Neuronal responses to omitted tones in the auditory brain: A neuronal correlate for predictive coding

Prediction provides key advantages for survival, and cognitive studies have demonstrated that the brain computes multilevel predictions. Evidence for predictions remains elusive at the neuronal level because of the complexity of separating neural activity into predictions and stimulus responses. We overcome this challenge by recording from single neurons from cortical and subcortical auditory regions in anesthetized and awake preparations, during unexpected stimulus omissions interspersed in a regular sequence of tones. We find a subset of neurons that responds reliably to omitted tones. In awake animals, omission responses are similar to anesthetized animals, but larger and more frequent, indicating that the arousal and attentional state levels affect the degree to which predictions are neuronally represented. Omission-sensitive neurons also responded to frequency deviants, with their omission responses getting emphasized in the awake state. Because omission responses occur in the absence of sensory input, they provide solid and empirical evidence for the implementation of a predictive process.

Modelling novelty detection in the thalamocortical loop

In complex natural environments, sensory systems are constantly exposed to a large stream of inputs. Novel or rare stimuli, which are often associated with behaviorally important events, are typically processed differently than the steady sensory background, which has less relevance. Neural signatures of such differential processing, commonly referred to as novelty detection, have been identified on the level of EEG recordings as mismatch negativity (MMN) and on the level of single neurons as stimulus-specific adaptation (SSA). Here, we propose a multi-scale recurrent network with synaptic depression to explain how novelty detection can arise in the whisker-related part of the somatosensory thalamocortical loop. The "minimalistic" architecture and dynamics of the model presume that neurons in cortical layer 6 adapt, via synaptic depression, specifically to a frequently presented stimulus, resulting in reduced population activity in the corresponding cortical column when compared with the population activity evoked by a rare stimulus. This difference in population activity is then projected from the cortex to the thalamus and amplified through the interaction between neurons of the primary and reticular nuclei of the thalamus, resulting in rhythmic oscillations. These differentially activated thalamic oscillations are forwarded to cortical layer 4 as a late secondary response that is specific to rare stimuli that violate a particular stimulus pattern. Model results show a strong analogy between this late single neuron activity and EEG-based mismatch negativity in terms of their common sensitivity to presentation context and timescales of response latency, as observed experimentally. Our results indicate that adaptation in L6 can establish the thalamocortical dynamics that produce signatures of SSA and MMN and suggest a mechanistic model of novelty detection that could generalize to other sensory modalities.

Adaptation in auditory processing

Adaptation is an essential feature of auditory neurons, which reduces their responses to unchanging and recurring sounds and allows their response properties to be matched to the constantly changing statistics of sounds that reach the ears. As a consequence, processing in the auditory system highlights novel or unpredictable sounds and produces an efficient representation of the vast range of sounds that animals can perceive by continually adjusting the sensitivity and, to a lesser extent, the tuning properties of neurons to the most commonly encountered stimulus values. Together with attentional modulation, adaptation to sound statistics also helps to generate neural representations of sound that are tolerant to background noise and therefore plays a vital role in auditory scene analysis. In this review, we consider the diverse forms of adaptation that are found in the auditory system in terms of the processing levels at which they arise, the underlying neural mechanisms, and their impact on neural coding and perception. We also ask what the dynamics of adaptation, which can occur over multiple timescales, reveal about the statistical properties of the environment. Finally, we examine how adaptation to sound statistics is influenced by learning and experience and changes as a result of aging and hearing loss.

A quantitative model reveals a frequency ordering of prediction and prediction-error signals in the human brain

The human brain is proposed to harbor a hierarchical predictive coding neuronal network underlying perception, cognition, and action. In support of this theory, feedforward signals for prediction error have been reported. However, the identification of feedback prediction signals has been elusive due to their causal entanglement with prediction-error signals. Here, we use a quantitative model to decompose these signals in electroencephalography during an auditory task, and identify their spatio-spectral-temporal signatures across two functional hierarchies. Two prediction signals are identified in the period prior to the sensory input: a low-level signal representing the tone-to-tone transition in the high beta frequency band, and a high-level signal for the multi-tone sequence structure in the low beta band. Subsequently, prediction-error signals dependent on the prior predictions are found in the gamma band. Our findings reveal a frequency ordering of prediction signals and their hierarchical interactions with prediction-error signals supporting predictive coding theory.

A computational framework can extract spatio-spectro-temporal neural signatures corresponding to hierarchical prediction and prediction errors in a local-global auditory task.

Absence of the Fragile X messenger ribonucleoprotein alters response patterns to sounds in the auditory midbrain

Among the different autism spectrum disorders, Fragile X syndrome (FXS) is the most common inherited cause of intellectual disability. Sensory and especially auditory hypersensitivity is a key symptom in patients, which is well mimicked in the Fmr1 -/- mouse model. However, the physiological mechanisms underlying FXS’s acoustic hypersensitivity in particular remain poorly understood. Here, we categorized spike response patterns to pure tones of different frequencies and intensities from neurons in the inferior colliculus (IC), a central integrator in the ascending auditory pathway. Based on this categorization we analyzed differences in response patterns between IC neurons of wild-type (WT) and Fmr1 -/- mice. Our results report broadening of frequency tuning, an increased firing in response to monaural as well as binaural stimuli, an altered balance of excitation-inhibition, and reduced response latencies, all expected features of acoustic hypersensitivity. Furthermore, we noticed that all neuronal response types in Fmr1 -/- mice displayed enhanced offset-rebound activity outside their excitatory frequency response area. These results provide evidence that the loss of Fmr1 not only increases spike responses in IC neurons similar to auditory brainstem neurons, but also changes response patterns such as offset spiking. One can speculate this to be an underlying aspect of the receptive language problems associated with Fragile X syndrome.

Object specific adaptation in the auditory cortex of bats

To identify behaviourally relevant sounds is an important function of the auditory system. Echolocating bats have to negotiate a wealth of sounds in the context of navigation and foraging. They must be able to detect relatively rare but behaviourally important echoes and segregate them from a large number of unimportant background echoes. For this, the bat auditory system might rely on neural deviance detection, a process influencing the excitability of a neuron depending on the frequency of occurrence of a stimulus. To investigate neural deviance detection in the auditory cortex (AC) of anaesthetised bats (Phyllostomus discolor), we designed sequences of repetitive naturalistic virtual echoes differing in spectro-temporal envelope, resembling those bats might perceive in their natural environment. In these sequences, one echo (standard) was repeated ten times and another echo (deviant) was presented at the end. Temporal intervals between echoes within the sequences varied. Our results show, that neurons in the AC of the bat P. discolor are sensitive to novel virtual echoes presented at the end of these repetitive sequences: In 49 % (62/126) of cortical neurons, extracellularly recorded responses adapted to the standard echo, but showed a strong response to the finally presented deviant echo. This effect depended strongly on the temporal intervals between echoes, with stronger adaptation at shorter intervals. This type of response behavior might represent a form of neuronal deviance detection in the AC that could help the bats to detect echoes of novel and potentially important objects within a stream of homogeneous background echoes.

Auditory cortex modelled as a dynamical network of oscillators: understanding event-related fields and their adaptation

Adaptation, the reduction of neuronal responses by repetitive stimulation, is a ubiquitous feature of auditory cortex (AC). It is not clear what causes adaptation, but short-term synaptic depression (STSD) is a potential candidate for the underlying mechanism. In such a case, adaptation can be directly linked with the way AC produces context-sensitive responses such as mismatch negativity and stimulus-specific adaptation observed on the single-unit level. We examined this hypothesis via a computational model based on AC anatomy, which includes serially connected core, belt, and parabelt areas. The model replicates the event-related field (ERF) of the magnetoencephalogram as well as ERF adaptation. The model dynamics are described by excitatory and inhibitory state variables of cell populations, with the excitatory connections modulated by STSD. We analysed the system dynamics by linearising the firing rates and solving the STSD equation using time-scale separation. This allows for characterisation of AC dynamics as a superposition of damped harmonic oscillators, so-called normal modes. We show that repetition suppression of the N1m is due to a mixture of causes, with stimulus repetition modifying both the amplitudes and the frequencies of the normal modes. In this view, adaptation results from a complete reorganisation of AC dynamics rather than a reduction of activity in discrete sources. Further, both the network structure and the balance between excitation and inhibition contribute significantly to the rate with which AC recovers from adaptation. This lifetime of adaptation is longer in the belt and parabelt than in the core area, despite the time constants of STSD being spatially homogeneous. Finally, we critically evaluate the use of a single exponential function to describe recovery from adaptation.

The influence of phoneme contexts on adaptation in vowel-evoked envelope following responses

Repeated stimulus presentation leads to neural adaptation and consequent amplitude reduction in vowel-evoked envelope following responses (EFRs)-a response that reflects neural activity phase-locked to envelope periodicity. EFRs are elicited by vowels presented in isolation or in the context of other phonemes such as in syllables. While context phonemes could exert some forward influence on vowel-evoked EFRs, they may reduce the degree of adaptation. Here, we evaluated whether the properties of context phonemes between consecutive vowel stimuli influence adaptation. EFRs were elicited by the low-frequency first formant (resolved harmonics) and mid-to-high frequency second and higher formants (unresolved harmonics) of a male-spoken/i/when the presence, number, and predictability of context phonemes (/s/, /a/, /∫/, /u/) between vowel repetitions varied. Monitored over four iterations of /i/, adaptation was evident only for EFRs elicited by the unresolved harmonics. EFRs elicited by the unresolved harmonics decreased in amplitude by ~16-20 nV (10-17%) after the first presentation of/i/and remained stable thereafter. EFR adaptation was reduced by the presence of a context phoneme, but the reduction did not change with their number or predictability. The presence of a context phoneme, however, attenuated EFRs by a degree similar to that caused by adaptation (~21-23 nV). Such a trade-off in the short- and long-term influence of context phonemes suggests that the benefit of interleaving EFR-eliciting vowels with other context phonemes depends on whether the use of consonant-vowel syllables is critical to improve the validity of EFR applications.

Long-Duration Sound-Induced Facilitation Changes Population Activity in the Inferior Colliculus

The inferior colliculus (IC) is at the midpoint of the auditory system and integrates virtually all information ascending from the auditory brainstem, organizes it, and transmits the results to the auditory forebrain. Its abundant, excitatory local connections are crucial for this task. This study describes a long duration sound (LDS)-induced potentiation in the IC that changes both subsequent tone-evoked responses and spontaneous activity. Afterdischarges, changes of spontaneous spiking following an LDS, were seen previously in single neurons. Here, we used multi-channel probes to record activity before and after a single, tetanic sound and describe the changes in a population of IC neurons. Following a 60 s narrowband-noise stimulation, a subset of recording channels (∼16%) showed afterdischarges. A facilitated response spike rate to tone pips following an LDS was also observed in ∼16% of channels. Both channels with an afterdischarge and channels with facilitated tone responses had higher firing rates in response to LDS, and the magnitude of the afterdischarges increased with increased responses to the LDS. This is the first study examining the effect of LDS stimulation on tone-evoked responses. This observed facilitation in vivo has similarities to post-tetanic potentiation in vitro as both manner of induction (strong stimulation for several seconds) as well as time-course of the facilitation (second to minute range) are comparable. Channels with and without facilitation appear to be intermixed and distributed widely in the central nucleus of IC, and this suggests a heretofore unknown property of some IC neurons or their circuits. Consequently, this sound-evoked facilitation may enhance the sound-evoked output of these neurons, while, simultaneously, most other IC neurons have reduced or unchanged output in response to the same stimulus.

Alzheimer's Disease, Hearing Loss, and Deviance Detection

Age-related hearing loss is a widespread condition among the elderly, affecting communication and social participation. Given its high incidence, it is not unusual that individuals suffering from age-related hearing loss also suffer from other age-related neurodegenerative diseases, a scenario which severely impacts their quality of life. Furthermore, recent studies have identified hearing loss as a relevant risk factor for the development of dementia due to Alzheimer’s disease, although the underlying associations are still unclear. In order to cope with the continuous flow of auditory information, the brain needs to separate repetitive sounds from rare, unexpected sounds, which may be relevant. This process, known as deviance detection, is a key component of the sensory perception theory of predictive coding. According to this framework, the brain would use the available incoming information to make predictions about the environment and signal the unexpected stimuli that break those predictions. Such a system can be easily impaired by the distortion of auditory information processing that accompanies hearing loss. Changes in cholinergic neuromodulation have been found to alter auditory deviance detection both in humans and animal models. Interestingly, some theories propose a role for acetylcholine in the development of Alzheimer’s disease, the most common type of dementia. Acetylcholine is involved in multiple neurobiological processes such as attention, learning, memory, arousal, sleep and/or cognitive reinforcement, and has direct influence on the auditory system at the levels of the inferior colliculus and auditory cortex. Here we comment on the possible links between acetylcholine, hearing loss, and Alzheimer’s disease, and association that is worth further investigation.

Context-Dependent Inhibitory Control of Stimulus-Specific Adaptation

Stimulus-specific adaptation (SSA) is the reduction in responses to frequent stimuli (standards) that does not generalize to rare stimuli (deviants). We investigated the contribution of inhibition in auditory cortex to SSA using two-photon targeted cell-attached recordings and optogenetic manipulations in male mice. We characterized the responses of parvalbumin (PV)-, somatostatin (SST)-, and vasoactive intestinal polypeptide (VIP)-expressing interneurons of layer 2/3, and of serotonin receptor 5HT3a-expressing interneurons of layer 1. All populations showed early-onset SSA. Unexpectedly, the PV, SST, and VIP populations exhibited a substantial late component of evoked activity, often stronger for standard than for deviant stimuli. Optogenetic suppression of PV neurons facilitated pyramidal neuron responses substantially more (approximately ×10) for deviants than for standards. VIP suppression decreased responses of putative PV neurons, specifically for standard but not for deviant stimuli. Thus, the inhibitory network does not generate cortical SSA, but powerfully controls its expression by differentially affecting the responses to deviants and to standards.SIGNIFICANCE STATEMENT Stimulus-specific adaptation (SSA) reflects the growing complexity of auditory processing along the ascending auditory system. In the presence of SSA, neuronal responses depend not only on the stimulus itself but also on the history of stimulation. Strong SSA in the fast, ascending auditory pathway first occurs in cortex. Here we studied the role of the cortical inhibitory network in shaping SSA, showing that while cortical inhibition does not generate SSA, it powerfully controls its expression. We deduce that the cortical network contributes in crucial ways to the properties of SSA.

Separate Functional Subnetworks of Excitatory Neurons Show Preference to Periodic and Random Sound Structures

Auditory cortex (ACX) neurons are sensitive to spectro-temporal sound patterns and violations in patterns induced by rare stimuli embedded within streams of sounds. We investigate the auditory cortical representation of repeated presentations of sequences of sounds with standard stimuli (common) with an embedded deviant (rare) stimulus in two conditions, Periodic (Fixed deviant position) or Random (Random deviant position). We used extracellular single-unit and two-photon Ca2+ imaging recordings in layer 2/3 neurons of the mouse (Mus musculus) ACX of either sex. Population single-unit average responses increased over repetitions in the Random condition and were suppressed or did not change in the Periodic condition, showing general irregularity preference. A subset of neurons showed the opposite behavior, indicating regularity preference. Furthermore, pairwise noise correlations were higher in the Random condition than in the Periodic condition, suggesting a role of recurrent connections in the observed differential adaptation. Functional two-photon Ca2+ imaging showed that excitatory (EX), and inhibitory (IN) neurons [parvalbumin-positive (PV) and somatostatin-positive (SOM)] also had different categories of long-term adaptation as observed with single-units. However, examination of functional connectivity between pairs of neurons of different categories showed that EX-PV connected pairs behaved opposite to the EX-EX and EX-SOM pairs, with more connections outside category in Random condition than Periodic condition. Finally, considering Regularity, Irregularity, and no preference of connected pairs of neurons showed that EX-EX and EX-SOM pairs were in largely separate functional subnetworks with different preferences, not EX-PV pairs. Thus, separate subnetworks underlie coding of periodic and random sound sequences.SIGNIFICANCE STATEMENT Studying how the auditory cortex (ACX) neurons respond to streams of sound sequences help us understand the importance of changes in dynamic acoustic noisy scenes around us. Humans and animals are sensitive to regularity and its violations in sound sequences. Psychophysical tasks in humans show that the auditory brain differentially responds to Periodic and Random structures, independent of the listener's attentional states. Here, we show that mouse ACX L2/3 neurons detect changes and respond differently to patterns over long-time scales. The differential functional connectivity profile obtained in response to two different sound contexts suggests the vital role of recurrent connections in the auditory cortical network. Furthermore, the excitatory-inhibitory neuronal interactions can contribute to detecting the changing sound patterns.

Cortico-fugal regulation of predictive coding

Sensory systems must account for both contextual factors and prior experience to adaptively engage with the dynamic external environment. In the central auditory system, neurons modulate their responses to sounds based on statistical context. These response modulations can be understood through a hierarchical predictive coding lens: responses to repeated stimuli are progressively decreased, in a process known as repetition suppression, whereas unexpected stimuli produce a prediction error signal. Prediction error incrementally increases along the auditory hierarchy from the inferior colliculus (IC) to the auditory cortex (AC), suggesting that these regions may engage in hierarchical predictive coding. A potential substrate for top-down predictive cues is the massive set of descending projections from the auditory cortex to subcortical structures, although the role of this system in predictive processing has never been directly assessed. We tested the effect of optogenetic inactivation of the auditory cortico-collicular feedback in awake mice on responses of IC neurons to stimuli designed to test prediction error and repetition suppression. Inactivation of the cortico-collicular pathway led to a decrease in prediction error in IC. Repetition suppression was unaffected by cortico-collicular inactivation, suggesting that this metric may reflect fatigue of bottom-up sensory inputs rather than predictive processing. We also discovered populations of IC units that exhibit repetition enhancement, a sequential increase in firing with stimulus repetition. Cortico-collicular inactivation led to a decrease in repetition enhancement in the central nucleus of IC, suggesting that it is a top-down phenomenon. Negative prediction error, a stronger response to a tone in a predictable rather than unpredictable sequence, was suppressed in shell IC units during cortico-collicular inactivation. These changes in predictive coding metrics arose from bidirectional modulations in the response to the standard and deviant contexts, such that units in IC responded more similarly to each context in the absence of cortical input. We also investigated how these metrics compare between the anesthetized and awake states by recording from the same units under both conditions. We found that metrics of predictive coding and deviance detection differ depending on the anesthetic state of the animal, with negative prediction error emerging in the central IC and repetition enhancement and prediction error being more prevalent in the absence of anesthesia. Overall, our results demonstrate that the auditory cortex provides cues about the statistical context of sound to subcortical brain regions via direct feedback, regulating processing of both prediction and repetition.

Secondary auditory cortex mediates a sensorimotor mechanism for action timing

The ability to accurately determine when to perform an action is a fundamental brain function and vital to adaptive behavior. The behavioral mechanism and neural circuit for action timing, however, remain largely unknown. Using a new, self-paced action timing task in mice, we found that deprivation of auditory, but not somatosensory or visual input, disrupts learned action timing. The hearing effect was dependent on the auditory feedback derived from the animal's own actions, rather than passive environmental cues. Neuronal activity in the secondary auditory cortex was found to be both correlated with and necessary for the proper execution of learned action timing. Closed-loop, action-dependent optogenetic stimulation of the specific task-related neuronal population within the secondary auditory cortex rescued the key features of learned action timing under auditory deprivation. These results unveil a previously underappreciated sensorimotor mechanism in which the secondary auditory cortex transduces self-generated audiomotor feedback to control action timing.

Cross-Modal Interaction and Integration Through Stimulus-Specific Adaptation in the Thalamic Reticular Nucleus of Rats

Stimulus-specific adaptation (SSA), defined as a decrease in responses to a common stimulus that only partially generalizes to other rare stimuli, is a widespread phenomenon in the brain that is believed to be related to novelty detection. Although cross-modal sensory processing is also a widespread phenomenon, the interaction between the two phenomena is not well understood. In this study, the thalamic reticular nucleus (TRN), which is regarded as a hub of the attentional system that contains multi-modal neurons, was investigated. The results showed that SSA existed in an interactive oddball stimulation, which mimics stimulation changes from one modality to another. In the bimodal integration, SSA to bimodal stimulation was stronger than to visual stimulation alone but similar to auditory stimulation alone, which indicated a limited integrative effect. Collectively, the present results provide evidence for independent cross-modal processing in bimodal TRN neurons.

Rapid Enhancement of Subcortical Neural Responses to Sine-Wave Speech

The efferent auditory nervous system may be a potent force in shaping how the brain responds to behaviorally significant sounds. Previous human experiments using the frequency following response (FFR) have shown efferent-induced modulation of subcortical auditory function online and over short- and long-term time scales; however, a contemporary understanding of FFR generation presents new questions about whether previous effects were constrained solely to the auditory subcortex. The present experiment used sine-wave speech (SWS), an acoustically-sparse stimulus in which dynamic pure tones represent speech formant contours, to evoke FFR_SWS. Due to the higher stimulus frequencies used in SWS, this approach biased neural responses toward brainstem generators and allowed for three stimuli (/bɔ/, /bu/, and /bo/) to be used to evoke FFR_SWSbefore and after listeners in a training group were made aware that they were hearing a degraded speech stimulus. All SWS stimuli were rapidly perceived as speech when presented with a SWS carrier phrase, and average token identification reached ceiling performance during a perceptual training phase. Compared to a control group which remained naïve throughout the experiment, training group FFR_SWS amplitudes were enhanced post-training for each stimulus. Further, linear support vector machine classification of training group FFR_SWS significantly improved post-training compared to the control group, indicating that training-induced neural enhancements were sufficient to bolster machine learning classification accuracy. These results suggest that the efferent auditory system may rapidly modulate auditory brainstem representation of sounds depending on their context and perception as non-speech or speech.

Listening in the Moment: How Bilingualism Interacts With Task Demands to Shape Active Listening

While there is evidence for bilingual enhancements of inhibitory control and auditory processing, two processes that are fundamental to daily communication, it is not known how bilinguals utilize these cognitive and sensory enhancements during real-world listening. To test our hypothesis that bilinguals engage their enhanced cognitive and sensory processing in real-world listening situations, bilinguals and monolinguals performed a selective attention task involving competing talkers, a common demand of everyday listening, and then later passively listened to the same competing sentences. During the active and passive listening periods, evoked responses to the competing talkers were collected to understand how online auditory processing facilitates active listening and if this processing differs between bilinguals and monolinguals. Additionally, participants were tested on a separate measure of inhibitory control to see if inhibitory control abilities related with performance on the selective attention task. We found that although monolinguals and bilinguals performed similarly on the selective attention task, the groups differed in the neural and cognitive processes engaged to perform this task, compared to when they were passively listening to the talkers. Specifically, during active listening monolinguals had enhanced cortical phase consistency while bilinguals demonstrated enhanced subcortical phase consistency in the response to the pitch contours of the sentences, particularly during passive listening. Moreover, bilinguals’ performance on the inhibitory control test related with performance on the selective attention test, a relationship that was not seen for monolinguals. These results are consistent with the hypothesis that bilinguals utilize inhibitory control and enhanced subcortical auditory processing in everyday listening situations to engage with sound in ways that are different than monolinguals.

Correlates of deviance detection in auditory brainstem responses of bats

Identifying unexpected acoustic inputs, which allows to react appropriately to new situations, is of major importance for animals. Neural deviance detection describes a change of neural response strength to a stimulus solely caused by the stimulus' probability of occurrence. In the present study, we searched for correlates of deviance detection in auditory brainstem responses obtained in anaesthetised bats (Carollia perspicillata). In an oddball paradigm, we used two pure tone stimuli that represented the main frequencies used by the animal during echolocation (60 kHz) and communication (20 kHz). For both stimuli, we could demonstrate significant differences of response strength between deviant and standard response in slow and fast components of the auditory brainstem response. The data suggest the presence of correlates of deviance detection in brain stations below the IC, at the level of the cochlea nucleus and lateral lemniscus. Additionally, our results suggest that deviance detection is mainly driven by repetition suppression in the echolocation frequency band, while in the communication band, a deviant-related enhancement of the response plays a more important role. This finding suggests a contextual dependence of the mechanisms underlying subcortical deviance detection. The present study demonstrates the value of auditory brainstem responses for studying deviance detection and suggests that auditory specialists, such as bats, use different frequency-specific strategies to ensure an appropriate sensation of unexpected sounds.

Sensitivity of neural responses in the inferior colliculus to statistical features of sound textures

Previous psychophysical studies have identified a hierarchy of time-averaged statistics which determine the identity of natural sound textures. However, it is unclear whether the neurons in the inferior colliculus (IC) are sensitive to each of these statistical features in the natural sound textures. We used 13 representative sound textures spanning the space of 3 statistics extracted from over 200 natural textures. The synthetic textures were generated by incorporating the statistical features in a step-by-step manner, in which a particular statistical feature was changed while the other statistical features remain unchanged. The extracellular activity in response to the synthetic texture stimuli was recorded in the IC of anesthetized rats. Analysis of the transient and sustained multiunit activity after each transition of statistical feature showed that the IC units were sensitive to the changes of all types of statistics, although to a varying extent. For example, we found that more neurons were sensitive to the changes in variance than that in the modulation correlations. Our results suggest that the sensitivity of the statistical features in the subcortical levels contributes to the identification and discrimination of natural sound textures.

Arousal State-Dependence of Interactions Between Short- and Long-Term Auditory Novelty Responses in Human Subjects

In everyday life, predictable sensory stimuli are generally not ecologically informative. By contrast, novel or unexpected stimuli signal ecologically salient changes in the environment. This idea forms the basis of the predictive coding hypothesis: efficient sensory encoding minimizes neural activity associated with predictable backgrounds and emphasizes detection of changes in the environment. In real life, the brain must resolve multiple unexpected sensory events occurring over different time scales. The local/global deviant experimental paradigm examines auditory predictive coding over multiple time scales. For short-term novelty [hundreds of milliseconds; local deviance (LD)], sequences of identical sounds (/xxxxx/) are interspersed with sequences that contain deviants (/xxxxy/). Long-term novelty [several seconds; global deviance (GD)] is created using either (a) frequent /xxxxx/ and infrequent /xxxxy/ sequences, or (b) frequent /xxxxy/ and infrequent /xxxxx/ sequences. In scenario (a), there is both an LD and a GD effect (LDGD, "double surprise"). In (b), the global deviant is a local standard, i.e., sequence of identical sounds (LSGD). Cortical responses reflecting LD and GD originate in different brain areas, have a different time course, and are differentially sensitive to general anesthesia. Neural processes underlying LD and GD have been shown to interact, reflecting overlapping networks subserving the detection of novel auditory stimuli. This study examined these interactions using intracranial electroencephalography in neurosurgical patients. Subjects performed a GD target detection task before and during induction of anesthesia with propofol. Recordings were made from the auditory cortex, surrounding auditory-related and prefrontal cortex in awake, sedated, and unresponsive states. High gamma activity was used to measure the neural basis of local-by-global novelty interactions. Positive interaction was defined as a greater response to the double surprise LDGD condition compared to LSGD. Negative interaction was defined as a weaker response to LDGD. Positive interaction was more frequent than negative interaction and was primarily found in auditory cortex. Negative interaction typically occurred in prefrontal cortex and was more sensitive to general anesthesia. Temporo-parietal auditory-related areas exhibited both types of interaction. These interactions may have relevance in a clinical setting as biomarkers of conscious perception in the assessment of depth of anesthesia and disorders of consciousness.

Neural Field Theory of Evoked Response Sequences and Mismatch Negativity With Adaptation

Physiologically based neural field theory of the corticothalamic system is used to calculate the responses evoked by trains of auditory stimuli that correspond to different cortical locations via the tonotopic map. The results are shown to account for standard and deviant evoked responses to frequent and rare stimuli, respectively, in the auditory oddball paradigms widely used in human cognitive studies, and the so-called mismatch negativity between them. It also reproduces a wide range of other effects and variants, including the mechanism by which a change in standard responses relative to deviants can develop through adaptation, different responses when two deviants are presented in a row or a standard is presented after two deviants, relaxation of standard responses back to deviant form after a stimulus-free period, and more complex sequences. Some cases are identified in which adaptation does not account for the whole difference between standard and deviant responses. The results thus provide a systematic means to determine how much of the response is due to adaptation in the system comprising the primary auditory cortex and medial geniculate nucleus, and how much requires involvement of higher-level processing.

Automatic Sensory Predictions: A Review of Predictive Mechanisms in the Brain and Their Link to Conscious Processing

The human brain has the astonishing capacity of integrating streams of sensory information from the environment and forming predictions about future events in an automatic way. Despite being initially developed for visual processing, the bulk of predictive coding research has subsequently focused on auditory processing, with the famous mismatch negativity signal as possibly the most studied signature of a surprise or prediction error (PE) signal. Auditory PEs are present during various consciousness states. Intriguingly, their presence and characteristics have been linked with residual levels of consciousness and return of awareness. In this review we first give an overview of the neural substrates of predictive processes in the auditory modality and their relation to consciousness. Then, we focus on different states of consciousness - wakefulness, sleep, anesthesia, coma, meditation, and hypnosis - and on what mysteries predictive processing has been able to disclose about brain functioning in such states. We review studies investigating how the neural signatures of auditory predictions are modulated by states of reduced or lacking consciousness. As a future outlook, we propose the combination of electrophysiological and computational techniques that will allow investigation of which facets of sensory predictive processes are maintained when consciousness fades away.

The posterior auditory field is the chief generator of prediction error signals in the auditory cortex

The auditory cortex (AC) encompasses distinct fields subserving partly different aspects of sound processing. One essential function of the AC is the detection of unpredicted sounds, as revealed by differential neural activity to predictable and unpredictable sounds. According to the predictive coding framework, this effect can be explained by repetition suppression and/or prediction error signaling. The present study investigates functional specialization of the rat AC fields in repetition suppression and prediction error by combining a tone frequency oddball paradigm (involving high-probable standard and low-probable deviant tones) with two different control sequences (many-standards and cascade). Tones in the control sequences were comparable to deviant events with respect to neural adaptation but were not violating a regularity. Therefore, a difference in the neural activity between deviant and control tones indicates a prediction error effect, whereas a difference between control and standard tones indicates a repetition suppression effect. Single-unit recordings revealed by far the largest prediction error effects for the posterior auditory field, while the primary auditory cortex, the anterior auditory field, the ventral auditory field, and the suprarhinal auditory field were dominated by repetition suppression effects. Statistically significant repetition suppression effects occurred in all AC fields, whereas prediction error effects were less robust in the primary auditory cortex and the anterior auditory field. Results indicate that the non-lemniscal, posterior auditory field is more engaged in context-dependent processing underlying deviance-detection than the other AC fields, which are more sensitive to stimulus-dependent effects underlying differential degrees of neural adaptation.

Neural auditory contrast enhancement in humans

The perception of sensory events can be enhanced or suppressed by the surrounding spatial and temporal context in ways that facilitate the detection of novel objects and contribute to the perceptual constancy of those objects under variable conditions. In the auditory system, the phenomenon known as auditory enhancement reflects a general principle of contrast enhancement, in which a target sound embedded within a background sound becomes perceptually more salient if the background is presented first by itself. This effect is highly robust, producing an effective enhancement of the target of up to 25 dB (more than two orders of magnitude in intensity), depending on the task. Despite the importance of the effect, neural correlates of auditory contrast enhancement have yet to be identified in humans. Here, we used the auditory steady-state response to probe the neural representation of a target sound under conditions of enhancement. The probe was simultaneously modulated in amplitude with two modulation frequencies to distinguish cortical from subcortical responses. We found robust correlates for neural enhancement in the auditory cortical, but not subcortical, responses. Our findings provide empirical support for a previously unverified theory of auditory enhancement based on neural adaptation of inhibition and point to approaches for improving sensory prostheses for hearing loss, such as hearing aids and cochlear implants.

Contributions of natural signal statistics to spectral context effects in consonant categorization

Speech perception, like all perception, takes place in context. Recognition of a given speech sound is influenced by the acoustic properties of surrounding sounds. When the spectral composition of earlier (context) sounds (e.g., a sentence with more energy at lower third formant [F₃] frequencies) differs from that of a later (target) sound (e.g., consonant with intermediate F₃ onset frequency), the auditory system magnifies this difference, biasing target categorization (e.g., towards higher-F₃-onset /d/). Historically, these studies used filters to force context stimuli to possess certain spectral compositions. Recently, these effects were produced using unfiltered context sounds that already possessed the desired spectral compositions (Stilp & Assgari, 2019, Attention, Perception, & Psychophysics, 81, 2037-2052). Here, this natural signal statistics approach is extended to consonant categorization (/g/-/d/). Context sentences were either unfiltered (already possessing the desired spectral composition) or filtered (to imbue specific spectral characteristics). Long-term spectral characteristics of unfiltered contexts were poor predictors of shifts in consonant categorization, but short-term characteristics (last 475 ms) were excellent predictors. This diverges from vowel data, where long-term and shorter-term intervals (last 1,000 ms) were equally strong predictors. Thus, time scale plays a critical role in how listeners attune to signal statistics in the acoustic environment.

Stimulus-Specific Adaptation in Auditory Thalamus Is Modulated by the Thalamic Reticular Nucleus

A striking property of the auditory system is its capacity for the stimulus-specific adaptation (SSA), which is the reduction of neural response to repeated stimuli but a recuperative response to novel stimuli. SSA is found in both the medial geniculate body (MGB) and thalamic reticular nucleus (TRN). However, it remains unknown whether the SSA of MGB neurons is modulated by inhibitory inputs from the TRN, as it is difficult to investigate using the extracellular recording method. In the present study, we performed intracellular recordings in the MGB of anesthetized guinea pigs and examined whether and how the TRN modulates the SSA of MGB neurons with inhibitory inputs. This was accomplished by using microinjection of lidocaine to inactivate the neural activity of the TRN. We found that (1) MGB neurons with hyperpolarized membrane potentials exhibited SSA at both the spiking and subthreshold levels; (2) SSA of MGB neurons depends on the interstimulus interval (ISI), where a shorter ISI results in stronger SSA; and (3) the long-lasting hyperpolarization of MGB neurons decreased after the burst firing of the TRN was inactivated. As a result, SSA of these MGB neurons was diminished after inactivation of the TRN. Taken together, our results revealed that the SSA of the MGB is strongly modulated by the neural activity of the TRN, which suggests an alternative circuit mechanism underlying the SSA of the auditory thalamus.

Emergence of abstract sound representations in the ascending auditory system

Auditory processing begins by decomposing sounds into their frequency components, raising the question of where the representation of sounds as wholes emerges in the auditory system. To address this question, we used stimulus-specific adaptation (SSA), the reduction in the responses of a neuron to a common sound (standard) which does not generalize to another, rare sound (deviant). SSA to tone frequency has been demonstrated in multiple stations of the auditory pathway, including the inferior colliculus (IC), medial geniculate body (MGB) and auditory cortex. We designed wideband stimuli (tone clouds) that have identical frequency components but are nevertheless distinct. Tone clouds evoked early and substantial SSA in primary auditory cortex (A1) but only late and minor SSA in IC and MGB. These results imply that while in IC and MGB sounds are largely represented in terms of their frequency components, in A1 they are represented as abstract entities.

Adjudicating Between Local and Global Architectures of Predictive Processing in the Subcortical Auditory Pathway

Predictive processing, a leading theoretical framework for sensory processing, suggests that the brain constantly generates predictions on the sensory world and that perception emerges from the comparison between these predictions and the actual sensory input. This requires two distinct neural elements: generative units, which encode the model of the sensory world; and prediction error units, which compare these predictions against the sensory input. Although predictive processing is generally portrayed as a theory of cerebral cortex function, animal and human studies over the last decade have robustly shown the ubiquitous presence of prediction error responses in several nuclei of the auditory, somatosensory, and visual subcortical pathways. In the auditory modality, prediction error is typically elicited using so-called oddball paradigms, where sequences of repeated pure tones with the same pitch are at unpredictable intervals substituted by a tone of deviant frequency. Repeated sounds become predictable promptly and elicit decreasing prediction error; deviant tones break these predictions and elicit large prediction errors. The simplicity of the rules inducing predictability make oddball paradigms agnostic about the origin of the predictions. Here, we introduce two possible models of the organizational topology of the predictive processing auditory network: (1) the global view, that assumes that predictions on the sensory input are generated at high-order levels of the cerebral cortex and transmitted in a cascade of generative models to the subcortical sensory pathways; and (2) the local view, that assumes that independent local models, computed using local information, are used to perform predictions at each processing stage. In the global view information encoding is optimized globally but biases sensory representations along the entire brain according to the subjective views of the observer. The local view results in a diminished coding efficiency, but guarantees in return a robust encoding of the features of sensory input at each processing stage. Although most experimental results to-date are ambiguous in this respect, recent evidence favors the global model.

Top-Down Inference in the Auditory System: Potential Roles for Corticofugal Projections

It has become widely accepted that humans use contextual information to infer the meaning of ambiguous acoustic signals. In speech, for example, high-level semantic, syntactic, or lexical information shape our understanding of a phoneme buried in noise. Most current theories to explain this phenomenon rely on hierarchical predictive coding models involving a set of Bayesian priors emanating from high-level brain regions (e.g., prefrontal cortex) that are used to influence processing at lower-levels of the cortical sensory hierarchy (e.g., auditory cortex). As such, virtually all proposed models to explain top-down facilitation are focused on intracortical connections, and consequently, subcortical nuclei have scarcely been discussed in this context. However, subcortical auditory nuclei receive massive, heterogeneous, and cascading descending projections at every level of the sensory hierarchy, and activation of these systems has been shown to improve speech recognition. It is not yet clear whether or how top-down modulation to resolve ambiguous sounds calls upon these corticofugal projections. Here, we review the literature on top-down modulation in the auditory system, primarily focused on humans and cortical imaging/recording methods, and attempt to relate these findings to a growing animal literature, which has primarily been focused on corticofugal projections. We argue that corticofugal pathways contain the requisite circuitry to implement predictive coding mechanisms to facilitate perception of complex sounds and that top-down modulation at early (i.e., subcortical) stages of processing complement modulation at later (i.e., cortical) stages of processing. Finally, we suggest experimental approaches for future studies on this topic.

Repetition of Computer Security Warnings Results in Differential Repetition Suppression Effects as Revealed With Functional MRI

Computer users are often the last line of defense in computer security. However, with repeated exposures to system messages and computer security warnings, neural and behavioral responses show evidence of habituation. Habituation has been demonstrated at a neural level as repetition suppression where responses are attenuated with subsequent repetitions. In the brain, repetition suppression to visual stimuli has been demonstrated in multiple cortical areas, including the occipital lobe and medial temporal lobe. Prior research into the repetition suppression effect has generally focused on a single repetition and has not examined the pattern of signal suppression with repeated exposures. We used complex, everyday stimuli, in the form of images of computer programs or security warning messages, to examine the repetition suppression effect across repeated exposures. The use of computer warnings as stimuli also allowed us to examine the activation of learned fearful stimuli. We observed widespread linear decreases in activation with repeated exposures, suggesting that repetition suppression continues after the first repetition. Further, we found greater activation for warning messages compared to neutral images in the anterior insula, pre-supplemental motor area, and inferior frontal gyrus, suggesting differential processing of security warning messages. However, the repetition suppression effect was similar in these regions for both warning messages and neutral images. Additionally, we observed an increase of activation in the default mode network with repeated exposures, suggestive of increased mind wandering with continuing habituation.

Abstract rules drive adaptation in the subcortical sensory pathway

The subcortical sensory pathways are the fundamental channels for mapping the outside world to our minds. Sensory pathways efficiently transmit information by adapting neural responses to the local statistics of the sensory input. The long-standing mechanistic explanation for this adaptive behaviour is that neural activity decreases with increasing regularities in the local statistics of the stimuli. An alternative account is that neural coding is directly driven by expectations of the sensory input. Here, we used abstract rules to manipulate expectations independently of local stimulus statistics. The ultra-high-field functional-MRI data show that abstract expectations can drive the response amplitude to tones in the human auditory pathway. These results provide first unambiguous evidence of abstract processing in a subcortical sensory pathway. They indicate that the neural representation of the outside world is altered by our prior beliefs even at initial points of the processing hierarchy.

Deficits in Glutamic Acid Decarboxylase 67 Immunoreactivity, Parvalbumin Interneurons, and Perineuronal Nets in the Inferior Colliculus of Subjects With Schizophrenia

Aberrant processing of auditory stimuli is a prominent feature of schizophrenia (SZ). Prior studies have chronicled histological abnormalities in the auditory cortex of SZ subjects, but whether deficits exist at upstream, subcortical levels has yet to be established. En route to the auditory cortex, ascending information is integrated in the inferior colliculus (IC), a highly gamma amino butyric acid (GABA) ergic midbrain structure that is critically involved in auditory processing. The IC contains a dense population of parvalbumin-immunoreactive interneurons (PVIs), a cell type characterized by increased metabolic demands and enhanced vulnerability to oxidative stress. During development, PVIs are preferentially surrounded by perineuronal nets (PNNs), specialized extracellular matrix structures that promote redox homeostasis and excitatory/inhibitory balance. Moreover, in SZ, deficits in PVIs, PNNs, and the GABA synthesizing enzyme, glutamic acid decarboxylase (Gad67), have been extensively documented in cortical regions. Yet, whether similar impairments exist in the IC is currently unknown. Thus, we compared IC samples of age- and sex-matched pairs of SZ and unaffected control subjects. SZ subjects exhibited lower levels of Gad67 immunoreactivity and a decreased density of PVIs and PNNs within the IC. These findings provide the first histological evidence of IC GABAergic abnormalities in SZ and suggest that SZ-related auditory dysfunction may stem, in part, from altered IC inhibitory tone.

Spatial Separation between Two Sounds of an Oddball Paradigm Affects Responses of Neurons in the Rat's Inferior Colliculus to the Sounds

The ability to sense occasionally occurring sounds in an environment is critical for animals. To understand this ability, we studied responses to acoustic oddball paradigms in the rat's midbrain auditory neurons. An oddball paradigm is a random sequence of stimuli created using two tone bursts, with one presented at a high probability (standard stimulus) and the other at a low probability (oddball stimulus). The sounds were either colocalized at the ear contralateral to a neuron under investigation (c90° azimuth) or separated with one at c90° while the other at another azimuth. We found that most neurons generated stronger responses to a sound at c90° when it was presented as an oddball than as a standard stimulus. Relocating one sound from c90° to another azimuth changed both responses to the relocated sound and the sound that remained at c90°. Most notably, the response to an oddball stimulus at c90° was increased when a standard stimulus was relocated from c90° to a location that was in front of the animal or on the ipsilateral side of recording. The increase was particularly large in neurons that displayed transient firing under contralateral stimulation but no firing under ipsilateral stimulation. These neurons likely play a particularly important role in using spatial cues to detect occasionally occurring sounds. Results suggest that effects of spatial separation between two sounds of an oddball paradigm on responses to the sounds were dependent on changes in the level of adaptation and binaural inhibition.

Adaptation Modulates Spike-Phase Coupling Tuning Curve in the Rat Primary Auditory Cortex

Adaptation is an important mechanism that causes a decrease in the neural response both in terms of local field potentials (LFP) and spiking activity. We previously showed this reduction effect in the tuning curve of the primary auditory cortex. Moreover, we revealed that a repeated stimulus reduces the neural response in terms of spike-phase coupling (SPC). In the current study, we examined the effect of adaptation on the SPC tuning curve. To this end, employing the phase-locking value (PLV) method, we estimated the spike-LFP coupling. The data was obtained by a simultaneous recording from four single-electrodes in the primary auditory cortex of 15 rats. We first investigated whether the neural system may use spike-LFP phase coupling in the primary auditory cortex to encode sensory information. Secondly, we investigated the effect of adaptation on this potential SPC tuning. Our data showed that the coupling between spikes’ times and the LFP phase in beta oscillations represents sensory information (different stimulus frequencies), with an inverted bell-shaped tuning curve. Furthermore, we showed that adaptation to a specific frequency modulates SPC tuning curve of the adapter and its neighboring frequencies. These findings could be useful for interpretation of feature representation in terms of SPC and the underlying neural mechanism of adaptation.

Dopamine modulates subcortical responses to surprising sounds

Dopamine guides behavior and learning through pleasure, according to classic understanding. Dopaminergic neurons are traditionally thought to signal positive or negative prediction errors (PEs) when reward expectations are, respectively, exceeded or not matched. These signed PEs are quite different from the unsigned PEs, which report surprise during sensory processing. But mounting theoretical accounts from the predictive processing framework postulate that dopamine, as a neuromodulator, could potentially regulate the postsynaptic gain of sensory neurons, thereby scaling unsigned PEs according to their expected precision or confidence. Despite ample modeling work, the physiological effects of dopamine on the processing of surprising sensory information are yet to be addressed experimentally. In this study, we tested how dopamine modulates midbrain processing of unexpected tones. We recorded extracellular responses from the rat inferior colliculus to oddball and cascade sequences, before, during, and after the microiontophoretic application of dopamine or eticlopride (a D₂-like receptor antagonist). Results demonstrate that dopamine reduces the net neuronal responsiveness exclusively to unexpected sensory input without significantly altering the processing of expected input. We conclude that dopaminergic projections from the thalamic subparafascicular nucleus to the inferior colliculus could encode the expected precision of unsigned PEs, attenuating via D₂-like receptors the postsynaptic gain of sensory inputs forwarded by the auditory midbrain neurons. This direct dopaminergic modulation of sensory PE signaling has profound implications for both the predictive coding framework and the understanding of dopamine function.

Information about unexpected stimuli is encoded in the form of prediction error signals. The earliest prediction error signals identified in the auditory brain emerge subcortically in the inferior colliculus. This study reveals the essential role of dopamine in encoding the precision of prediction errors at the auditory midbrain.

Neural Responses and Perceptual Sensitivity to Sound Depend on Sound-Level Statistics

Sensitivity to sound-level statistics is crucial for optimal perception, but research has focused mostly on neurophysiological recordings, whereas behavioral evidence is sparse. We use electroencephalography (EEG) and behavioral methods to investigate how sound-level statistics affect neural activity and the detection of near-threshold changes in sound amplitude. We presented noise bursts with sound levels drawn from distributions with either a low or a high modal sound level. One participant group listened to the stimulation while EEG was recorded (Experiment I). A second group performed a behavioral amplitude-modulation detection task (Experiment II). Neural activity depended on sound-level statistical context in two different ways. Consistent with an account positing that the sensitivity of neurons to sound intensity adapts to ambient sound level, responses for higher-intensity bursts were larger in low-mode than high-mode contexts, whereas responses for lower-intensity bursts did not differ between contexts. In contrast, a concurrent slow neural response indicated prediction-error processing: The response was larger for bursts at intensities that deviated from the predicted statistical context compared to those not deviating. Behavioral responses were consistent with prediction-error processing, but not with neural adaptation. Hence, neural activity adapts to sound-level statistics, but fine-tuning of perceptual sensitivity appears to involve neural prediction-error responses.