Proportional spike-timing precision and firing reliability underlie efficient temporal processing of periodicity and envelope shape cues

Hearing as adaptive cascaded envelope interpolation

The human auditory system is designed to capture and encode sounds from our surroundings and conspecifics. However, the precise mechanisms by which it adaptively extracts the most important spectro-temporal information from sounds are still not fully understood. Previous auditory models have explained sound encoding at the cochlear level using static filter banks, but this vision is incompatible with the nonlinear and adaptive properties of the auditory system. Here we propose an approach that considers the cochlear processes as envelope interpolations inspired by cochlear physiology. It unifies linear and nonlinear adaptive behaviors into a single comprehensive framework that provides a data-driven understanding of auditory coding. It allows simulating a broad range of psychophysical phenomena from virtual pitches and combination tones to consonance and dissonance of harmonic sounds. It further predicts the properties of the cochlear filters such as frequency selectivity. Here we propose a possible link between the parameters of the model and the density of hair cells on the basilar membrane. Cascaded Envelope Interpolation may lead to improvements in sound processing for hearing aids by providing a non-linear, data-driven, way to preprocessing of acoustic signals consistent with peripheral processes.

Responses to dichotic tone-in-noise stimuli in the inferior colliculus

Human listeners are more sensitive to tones embedded in diotic noise when the tones are out-of-phase at the two ears (N0Sπ) than when they are in-phase (N0S0). The difference between the tone-detection thresholds for these two conditions is referred to as the binaural masking level difference (BMLD) and reflects a benefit of binaural processing. Detection in the N0Sπ condition has been explained in modeling studies by changes in interaural correlation (IAC), but this model has only been directly tested physiologically for low frequencies. Here, the IAC-based hypothesis for binaural detection was examined across a wide range of frequencies and masker levels using recordings in the awake rabbit inferior colliculus (IC). IAC-based cues were strongly correlated with neural responses to N0Sπ stimuli. Additionally, average rate-based thresholds were calculated for both N0S0 and N0Sπ conditions. The rate-based neural BMLD at 500 Hz matched rabbit behavioral data, but the trend of neural BMLDs across frequency differed from that of humans.

Theoretical Relationship Between Two Measures of Spike Synchrony: Correlation Index and Vector Strength

Information processing in the nervous system critically relies on temporally precise spiking activity. In the auditory system, various degrees of phase-locking can be observed from the auditory nerve to cortical neurons. The classical metric for quantifying phase-locking is the vector strength (VS), which captures the periodicity in neuronal spiking. More recently, another metric, called the correlation index (CI), was proposed to quantify the temporally reproducible response characteristics of a neuron. The CI is defined as the peak value of a normalized shuffled autocorrelogram (SAC). Both VS and CI have been used to investigate how temporal information is processed and propagated along the auditory pathways. While previous analyses of physiological data in cats suggested covariation of these two metrics, general characterization of their connection has never been performed. In the present study, we derive a rigorous relationship between VS and CI. To model phase-locking, we assume Poissonian spike trains with a temporally changing intensity function following a von Mises distribution. We demonstrate that VS and CI are mutually related via the so-called concentration parameter that determines the degree of phase-locking. We confirm that these theoretical results are largely consistent with physiological data recorded in the auditory brainstem of various animals. In addition, we generate artificial phase-locked spike sequences, for which recording and analysis parameters can be systematically manipulated. Our analysis results suggest that mismatches between empirical data and the theoretical prediction can often be explained with deviations from the von Mises distribution, including skewed or multimodal period histograms. Furthermore, temporal relations of spike trains across trials can contribute to higher CI values than predicted mathematically based on the VS. We find that, for most applications, a SAC bin width of 50 ms seems to be a favorable choice, leading to an estimated error below 2.5% for physiologically plausible conditions. Overall, our results provide general relations between the two measures of phase-locking and will aid future analyses of different physiological datasets that are characterized with these metrics.

Rate and Temporal Coding of Regular and Irregular Pulse Trains in Auditory Midbrain of Normal-Hearing and Cochlear-Implanted Rabbits

Although pitch is closely related to temporal periodicity, stimuli with a degree of temporal irregularity can evoke a pitch sensation in human listeners. However, the neural mechanisms underlying pitch perception for irregular sounds are poorly understood. Here, we recorded responses of single units in the inferior colliculus (IC) of normal hearing (NH) rabbits to acoustic pulse trains with different amounts of random jitter in the inter-pulse intervals and compared with responses to electric pulse trains delivered through a cochlear implant (CI) in a different group of rabbits. In both NH and CI animals, many IC neurons demonstrated tuning of firing rate to the average pulse rate (APR) that was robust against temporal jitter, although jitter tended to increase the firing rates for APRs ≥ 1280 Hz. Strength and limiting frequency of spike synchronization to stimulus pulses were also comparable between periodic and irregular pulse trains, although there was a slight increase in synchronization at high APRs with CI stimulation. There were clear differences between CI and NH animals in both the range of APRs over which firing rate tuning was observed and the prevalence of synchronized responses. These results suggest that the pitches of regular and irregular pulse trains are coded differently by IC neurons depending on the APR, the degree of irregularity, and the mode of stimulation. In particular, the temporal pitch produced by periodic pulse trains lacking spectral cues may be based on a rate code rather than a temporal code at higher APRs.

Harmonic Cancellation-A Fundamental of Auditory Scene Analysis

This paper reviews the hypothesis of harmonic cancellation according to which an interfering sound is suppressed or canceled on the basis of its harmonicity (or periodicity in the time domain) for the purpose of Auditory Scene Analysis. It defines the concept, discusses theoretical arguments in its favor, and reviews experimental results that support it, or not. If correct, the hypothesis may draw on time-domain processing of temporally accurate neural representations within the brainstem, as required also by the classic equalization-cancellation model of binaural unmasking. The hypothesis predicts that a target sound corrupted by interference will be easier to hear if the interference is harmonic than inharmonic, all else being equal. This prediction is borne out in a number of behavioral studies, but not all. The paper reviews those results, with the aim to understand the inconsistencies and come up with a reliable conclusion for, or against, the hypothesis of harmonic cancellation within the auditory system.

Developmentally Regulated Rebound Depolarization Enhances Spike Timing Precision in Auditory Midbrain Neurons

The inferior colliculus (IC) is an auditory midbrain structure involved in processing biologically important temporal features of sounds. The responses of IC neurons to these temporal features reflect an interaction of synaptic inputs and neuronal biophysical properties. One striking biophysical property of IC neurons is the rebound depolarization produced following membrane hyperpolarization. To understand how the rebound depolarization is involved in spike timing, we made whole-cell patch clamp recordings from IC neurons in brain slices of P9-21 rats. We found that the percentage of rebound neurons was developmentally regulated. The precision of the timing of the first spike on the rebound increased when the neuron was repetitively injected with a depolarizing current following membrane hyperpolarization. The average jitter of the first spikes was only 0.5 ms. The selective T-type Ca²⁺ channel antagonist, mibefradil, significantly increased the jitter of the first spike of neurons in response to repetitive depolarization following membrane hyperpolarization. Furthermore, the rebound was potentiated by one to two preceding rebounds within a few hundred milliseconds. The first spike generated on the potentiated rebound was more precise than that on the non-potentiated rebound. With the addition of a calcium chelator, BAPTA, into the cell, the rebound potentiation no longer occurred, and the precision of the first spike on the rebound was not improved. These results suggest that the postinhibitory rebound mediated by T-type Ca²⁺ channel promotes spike timing precision in IC neurons. The rebound potentiation and precise spikes may be induced by increases in intracellular calcium levels.

Pitch of harmonic complex tones: rate and temporal coding of envelope repetition rate in inferior colliculus of unanesthetized rabbits

Harmonic complex tones (HCTs) found in speech, music, and animal vocalizations evoke strong pitch percepts at their fundamental frequencies. The strongest pitches are produced by HCTs that contain harmonics resolved by cochlear frequency analysis, but HCTs containing solely unresolved harmonics also evoke a weaker pitch at their envelope repetition rate (ERR). In the auditory periphery, neurons phase lock to the stimulus envelope, but this temporal representation of ERR degrades and gives way to rate codes along the ascending auditory pathway. To assess the role of the inferior colliculus (IC) in such transformations, we recorded IC neuron responses to HCT and sinusoidally modulated broadband noise (SAMN) with varying ERR from unanesthetized rabbits. Different interharmonic phase relationships of HCT were used to manipulate the temporal envelope without changing the power spectrum. Many IC neurons demonstrated band-pass rate tuning to ERR between 60 and 1,600 Hz for HCT and between 40 and 500 Hz for SAMN. The tuning was not related to the pure-tone best frequency of neurons but was dependent on the shape of the stimulus envelope, indicating a temporal rather than spectral origin. A phenomenological model suggests that the tuning may arise from peripheral temporal response patterns via synaptic inhibition. We also characterized temporal coding to ERR. Some IC neurons could phase lock to the stimulus envelope up to 900 Hz for either HCT or SAMN, but phase locking was weaker with SAMN. Together, the rate code and the temporal code represent a wide range of ERR, providing strong cues for the pitch of unresolved harmonics.NEW & NOTEWORTHY Envelope repetition rate (ERR) provides crucial cues for pitch perception of frequency components that are not individually resolved by the cochlea, but the neural representation of ERR for stimuli containing many harmonics is poorly characterized. Here we show that the pitch of stimuli with unresolved harmonics is represented by both a rate code and a temporal code for ERR in auditory midbrain neurons and propose possible underlying neural mechanisms with a computational model.

Rapid Brain Responses to Familiar vs. Unfamiliar Music - an EEG and Pupillometry study

Human listeners exhibit marked sensitivity to familiar music, perhaps most readily revealed by popular “name that tune” games, in which listeners often succeed in recognizing a familiar song based on extremely brief presentation. In this work, we used electroencephalography (EEG) and pupillometry to reveal the temporal signatures of the brain processes that allow differentiation between a familiar, well liked, and unfamiliar piece of music. In contrast to previous work, which has quantified gradual changes in pupil diameter (the so-called “pupil dilation response”), here we focus on the occurrence of pupil dilation events. This approach is substantially more sensitive in the temporal domain and allowed us to tap early activity with the putative salience network. Participants (N = 10) passively listened to snippets (750 ms) of a familiar, personally relevant and, an acoustically matched, unfamiliar song, presented in random order. A group of control participants (N = 12), who were unfamiliar with all of the songs, was also tested. We reveal a rapid differentiation between snippets from familiar and unfamiliar songs: Pupil responses showed greater dilation rate to familiar music from 100–300 ms post-stimulus-onset, consistent with a faster activation of the autonomic salience network. Brain responses measured with EEG showed a later differentiation between familiar and unfamiliar music from 350 ms post onset. Remarkably, the cluster pattern identified in the EEG response is very similar to that commonly found in the classic old/new memory retrieval paradigms, suggesting that the recognition of brief, randomly presented, music snippets, draws on similar processes.

Auditory temporal acuity improves with age in the male mouse auditory thalamus: A role for perineuronal nets?

The ability to perceive and interpret environmental sound accurately is conserved across many species and is fundamental for understanding communication via vocalizations. Auditory acuity and temporally controlled neuronal firing underpin this ability. Deterioration in neuronal firing precision likely contributes to poorer hearing performance, yet the role of neural processing by key nuclei in the central auditory pathways is not fully understood. Here, we record from the auditory thalamus (medial geniculate body [MGB]) of young and middle-aged, normally hearing male CBA/Ca mice. We report changes in temporal processing of auditory stimuli, with neurons recorded from ventral and medial MGB subdivisions of older animals more likely to synchronize to rapid temporally varying stimuli. MGB subdivisions also showed increased probability of neuronal firing and shorter response latencies to clicks in older animals. Histological investigation of neuronal extracellular specializations, perineuronal nets (PNNs) and axonal coats, in the MGB identified greater organization of PNNs around MGB neurons and the presence of axonal coats within older animals. This supports the observation that neural responses recorded from ventral and medial MGB of older mice were more likely to synchronize to temporally varying stimuli presented at faster repetition rates than those recorded from young adult animals. These changes are observed in animals with normal hearing thresholds, confirming that neural processing differs between the MGB subdivisions and such processing is associated with age-related changes to PNNs. Understanding these age-related changes and how they occur have important implications for the design of effective therapeutic interventions to improve speech intelligibility into later life.

Resurgent Na+ Current Offers Noise Modulation in Bursting Neurons

Neurons utilize bursts of action potentials as an efficient and reliable way to encode information. It is likely that the intrinsic membrane properties of neurons involved in burst generation may also participate in preserving its temporal features. Here we examined the contribution of the persistent and resurgent components of voltage-gated Na+ currents in modulating the burst discharge in sensory neurons. Using mathematical modeling, theory and dynamic-clamp electrophysiology, we show that, distinct from the persistent Na+ component which is important for membrane resonance and burst generation, the resurgent Na+ can help stabilize burst timing features including the duration and intervals. Moreover, such a physiological role for the resurgent Na+ offered noise tolerance and preserved the regularity of burst patterns. Model analysis further predicted a negative feedback loop between the persistent and resurgent gating variables which mediate such gain in burst stability. These results highlight a novel role for the voltage-gated resurgent Na+ component in moderating the entropy of burst-encoded neural information.

A Hierarchy of Time Scales for Discriminating and Classifying the Temporal Shape of Sound in Three Auditory Cortical Fields

Auditory cortex is essential for mammals, including rodents, to detect temporal "shape" cues in the sound envelope but it remains unclear how different cortical fields may contribute to this ability (Lomber and Malhotra, 2008; Threlkeld et al., 2008). Previously, we found that precise spiking patterns provide a potential neural code for temporal shape cues in the sound envelope in the primary auditory (A1), and ventral auditory field (VAF) and caudal suprarhinal auditory field (cSRAF) of the rat (Lee et al., 2016). Here, we extend these findings and characterize the time course of the temporally precise output of auditory cortical neurons in male rats. A pairwise sound discrimination index and a Naive Bayesian classifier are used to determine how these spiking patterns could provide brain signals for behavioral discrimination and classification of sounds. We find response durations and optimal time constants for discriminating sound envelope shape increase in rank order with: A1 < VAF < cSRAF. Accordingly, sustained spiking is more prominent and results in more robust sound discrimination in non-primary cortex versus A1. Spike-timing patterns classify 10 different sound envelope shape sequences and there is a twofold increase in maximal performance when pooling output across the neuron population indicating a robust distributed neural code in all three cortical fields. Together, these results support the idea that temporally precise spiking patterns from primary and non-primary auditory cortical fields provide the necessary signals for animals to discriminate and classify a large range of temporal shapes in the sound envelope.SIGNIFICANCE STATEMENT Functional hierarchies in the visual cortices support the concept that classification of visual objects requires successive cortical stages of processing including a progressive increase in classical receptive field size. The present study is significant as it supports the idea that a similar progression exists in auditory cortices in the time domain. We demonstrate for the first time that three cortices provide temporal spiking patterns for robust temporal envelope shape discrimination but only the ventral non-primary cortices do so on long time scales. This study raises the possibility that primary and non-primary cortices provide unique temporal spiking patterns and time scales for perception of sound envelope shape.

Envelope contributions to the representation of interaural time difference in the forebrain of barn owls

Birds and mammals use the interaural time difference (ITD) for azimuthal sound localization. While barn owls can use the ITD of the stimulus carrier frequency over nearly their entire hearing range, mammals have to utilize the ITD of the stimulus envelope to extend the upper frequency limit of ITD-based sound localization. ITD is computed and processed in a dedicated neural circuit that consists of two pathways. In the barn owl, ITD representation is more complex in the forebrain than in the midbrain pathway because of the combination of two inputs that represent different ITDs. We speculated that one of the two inputs includes an envelope contribution. To estimate the envelope contribution, we recorded ITD response functions for correlated and anticorrelated noise stimuli in the barn owl's auditory arcopallium. Our findings indicate that barn owls, like mammals, represent both carrier and envelope ITDs of overlapping frequency ranges, supporting the hypothesis that carrier and envelope ITD-based localization are complementary beyond a mere extension of the upper frequency limit.NEW & NOTEWORTHY The results presented in this study show for the first time that the barn owl is able to extract and represent the interaural time difference (ITD) information conveyed by the envelope of a broadband acoustic signal. Like mammals, the barn owl extracts the ITD of the envelope and the carrier of a signal from the same frequency range. These results are of general interest, since they reinforce a trend found in neural signal processing across different species.

Identified GABAergic and Glutamatergic Neurons in the Mouse Inferior Colliculus Share Similar Response Properties

GABAergic neurons in the inferior colliculus (IC) play a critical role in auditory information processing, yet their responses to sound are unknown. Here, we used optogenetic methods to characterize the response properties of GABAergic and presumed glutamatergic neurons to sound in the IC. We found that responses to pure tones of both inhibitory and excitatory classes of neurons were similar in their thresholds, response latencies, rate-level functions, and frequency tuning, but GABAergic neurons may have higher spontaneous firing rates. In contrast to their responses to pure tones, the inhibitory and excitatory neurons differed in their ability to follow amplitude modulations. The responses of both cell classes were affected by their location regardless of the cell type, especially in terms of their frequency tuning. These results show that the synaptic domain, a unique organization of local neural circuits in the IC, may interact with all types of neurons to produce their ultimate response to sound.SIGNIFICANCE STATEMENT Although the inferior colliculus (IC) in the auditory midbrain is composed of different types of neurons, little is known about how these specific types of neurons respond to sound. Here, for the first time, we characterized the response properties of GABAergic and glutamatergic neurons in the IC. Both classes of neurons had diverse response properties to tones but were overall similar, except for the spontaneous activity and their ability to follow amplitude-modulated sound. Both classes of neurons may compose a basic local circuit that is replicated throughout the IC. Within each local circuit, the inputs to the local circuit may have a greater influence in determining the response properties to sound than the specific neuron types.

Temporal Envelope Coding by Inferior Colliculus Neurons with Cochlear Implant Stimulation

Modulations in temporal envelopes are a ubiquitous property of natural sounds and are especially important for hearing with cochlear implants (CIs) because these devices typically discard temporal fine structure information. With few exceptions, neural temporal envelope processing has been studied in both normal hearing (NH) and CI animals using only pure sinusoidal amplitude modulation (SAM) which poorly represents the diversity of envelope shapes contained in natural sounds because it confounds repetition rate and the width of each modulation cycle. Here, we used stimuli that allow independent manipulation of the two parameters to characterize envelope processing by inferior colliculus (IC) neurons in barbiturate-anesthetized cats with CIs. Specifically, the stimuli were amplitude modulated, high rate pulse trains, where the envelope waveform interleaved single cycles ("bursts") of a sinusoid with silent intervals. We found that IC neurons vary widely with respect to the envelope parameters that maximize their firing rates. In general, pure SAM was a relatively ineffective stimulus. The majority of neurons (60 %) preferred a combination of short bursts and low repetition rates (long silent intervals). Others preferred low repetition rates with minimal dependence on envelope width (17 %), while the remainder responded most strongly to brief bursts with lesser sensitivity to repetition rate (23 %). A simple phenomenological model suggests that a combination of inhibitory and intrinsic cellular mechanisms suffices to account for the wide variation in optimal envelope shapes. In contrast to the strong dependence of firing rate on envelope shape, neurons tended to phase lock precisely to the envelope regardless of shape. Most neurons tended to fire specifically near the peak of the modulation cycle, with little phase dispersion within or across neurons. Such consistently precise timing degrades envelope coding compared to NH processing of real-world sounds, because it effectively eliminates spike timing as a cue to envelope shape.

Ageing affects dual encoding of periodicity and envelope shape in rat inferior colliculus neurons

Extracting temporal periodicities and envelope shapes of sounds is important for listening within complex auditory scenes but declines behaviorally with age. Here, we recorded local field potentials (LFPs) and spikes to investigate how ageing affects the neural representations of different modulation rates and envelope shapes in the inferior colliculus of rats. We specifically aimed to explore the input-output (LFP-spike) response transformations of inferior colliculus neurons. Our results show that envelope shapes up to 256-Hz modulation rates are represented in the neural synchronisation phase lags in younger and older animals. Critically, ageing was associated with (i) an enhanced gain in onset response magnitude from LFPs to spikes; (ii) an enhanced gain in neural synchronisation strength from LFPs to spikes for a low modulation rate (45 Hz); (iii) a decrease in LFP synchronisation strength for higher modulation rates (128 and 256 Hz) and (iv) changes in neural synchronisation strength to different envelope shapes. The current age-related changes are discussed in the context of an altered excitation-inhibition balance accompanying ageing.

Neural spike-timing patterns vary with sound shape and periodicity in three auditory cortical fields

Mammals perceive a wide range of temporal cues in natural sounds, and the auditory cortex is essential for their detection and discrimination. The rat primary (A1), ventral (VAF), and caudal suprarhinal (cSRAF) auditory cortical fields have separate thalamocortical pathways that may support unique temporal cue sensitivities. To explore this, we record responses of single neurons in the three fields to variations in envelope shape and modulation frequency of periodic noise sequences. Spike rate, relative synchrony, and first-spike latency metrics have previously been used to quantify neural sensitivities to temporal sound cues; however, such metrics do not measure absolute spike timing of sustained responses to sound shape. To address this, in this study we quantify two forms of spike-timing precision, jitter, and reliability. In all three fields, we find that jitter decreases logarithmically with increase in the basis spline (B-spline) cutoff frequency used to shape the sound envelope. In contrast, reliability decreases logarithmically with increase in sound envelope modulation frequency. In A1, jitter and reliability vary independently, whereas in ventral cortical fields, jitter and reliability covary. Jitter time scales increase (A1 < VAF < cSRAF) and modulation frequency upper cutoffs decrease (A1 > VAF > cSRAF) with ventral progression from A1. These results suggest a transition from independent encoding of shape and periodicity sound cues on short time scales in A1 to a joint encoding of these same cues on longer time scales in ventral nonprimary cortices.

Spike timing precision changes with spike rate adaptation in the owl's auditory space map

Spike rate adaptation (SRA) is a continuing change of responsiveness to ongoing stimuli, which is ubiquitous across species and levels of sensory systems. Under SRA, auditory responses to constant stimuli change over time, relaxing toward a long-term rate often over multiple timescales. With more variable stimuli, SRA causes the dependence of spike rate on sound pressure level to shift toward the mean level of recent stimulus history. A model based on subtractive adaptation (Benda J, Hennig RM. J Comput Neurosci 24: 113-136, 2008) shows that changes in spike rate and level dependence are mechanistically linked. Space-specific neurons in the barn owl's midbrain, when recorded under ketamine-diazepam anesthesia, showed these classical characteristics of SRA, while at the same time exhibiting changes in spike timing precision. Abrupt level increases of sinusoidally amplitude-modulated (SAM) noise initially led to spiking at higher rates with lower temporal precision. Spike rate and precision relaxed toward their long-term values with a time course similar to SRA, results that were also replicated by the subtractive model. Stimuli whose amplitude modulations (AMs) were not synchronous across carrier frequency evoked spikes in response to stimulus envelopes of a particular shape, characterized by the spectrotemporal receptive field (STRF). Again, abrupt stimulus level changes initially disrupted the temporal precision of spiking, which then relaxed along with SRA. We suggest that shifts in latency associated with stimulus level changes may differ between carrier frequency bands and underlie decreased spike precision. Thus SRA is manifest not simply as a change in spike rate but also as a change in the temporal precision of spiking.

Periodotopy in the gerbil inferior colliculus: local clustering rather than a gradient map

Periodicities in sound waveforms are widespread, and shape important perceptual attributes of sound including rhythm and pitch. Previous studies have indicated that, in the inferior colliculus (IC), a key processing stage in the auditory midbrain, neurons tuned to different periodicities might be arranged along a periodotopic axis which runs approximately orthogonal to the tonotopic axis. Here we map out the topography of frequency and periodicity tuning in the IC of gerbils in unprecedented detail, using pure tones and different periodic sounds, including click trains, sinusoidally amplitude modulated (SAM) noise and iterated rippled noise. We found that while the tonotopic map exhibited a clear and highly reproducible gradient across all animals, periodotopic maps varied greatly across different types of periodic sound and from animal to animal. Furthermore, periodotopic gradients typically explained only about 10% of the variance in modulation tuning between recording sites. However, there was a strong local clustering of periodicity tuning at a spatial scale of ca. 0.5 mm, which also differed from animal to animal.