Neural Processing of Acoustic and Electric Interaural Time Differences in Normal-Hearing Gerbils

Rate dependent neural responses of interaural-time-difference cues in fine-structure and envelope

Advancements in cochlear implants (CIs) have led to a significant increase in bilateral CI users, especially among children. Yet, most bilateral CI users do not fully achieve the intended binaural benefit due to potential limitations in signal processing and/or surgical implant positioning. One crucial auditory cue that normal hearing (NH) listeners can benefit from is the interaural time difference (ITD), i.e., the time difference between the arrival of a sound at two ears. The ITD sensitivity is thought to be heavily relying on the effective utilization of temporal fine structure (very rapid oscillations in sound). Unfortunately, most current CIs do not transmit such true fine structure. Nevertheless, bilateral CI users have demonstrated sensitivity to ITD cues delivered through envelope or interaural pulse time differences, i.e., the time gap between the pulses delivered to the two implants. However, their ITD sensitivity is significantly poorer compared to NH individuals, and it further degrades at higher CI stimulation rates, especially when the rate exceeds 300 pulse per second. The overall purpose of this research thread is to improve spatial hearing abilities in bilateral CI users. This study aims to develop electroencephalography (EEG) paradigms that can be used with clinical settings to assess and optimize the delivery of ITD cues, which are crucial for spatial hearing in everyday life. The research objective of this article was to determine the effect of CI stimulation pulse rate on the ITD sensitivity, and to characterize the rate-dependent degradation in ITD perception using EEG measures. To develop protocols for bilateral CI studies, EEG responses were obtained from NH listeners using sinusoidal-amplitude-modulated (SAM) tones and filtered clicks with changes in either fine structure ITD (ITDFS) or envelope ITD (ITDENV). Multiple EEG responses were analyzed, which included the subcortical auditory steady-state responses (ASSRs) and cortical auditory evoked potentials (CAEPs) elicited by stimuli onset, offset, and changes. Results indicated that acoustic change complex (ACC) responses elicited by ITDENV changes were significantly smaller or absent compared to those elicited by ITDFS changes. The ACC morphologies evoked by ITDFS changes were similar to onset and offset CAEPs, although the peak latencies were longest for ACC responses and shortest for offset CAEPs. The high-frequency stimuli clearly elicited subcortical ASSRs, but smaller than those evoked by lower carrier frequency SAM tones. The 40-Hz ASSRs decreased with increasing carrier frequencies. Filtered clicks elicited larger ASSRs compared to high-frequency SAM tones, with the order being 40 > 160 > 80> 320 Hz ASSR for both stimulus types. Wavelet analysis revealed a clear interaction between detectable transient CAEPs and 40-Hz ASSRs in the time-frequency domain for SAM tones with a low carrier frequency.

Asymmetric temporal envelope sensitivity: Within- and across-ear envelope comparisons in listeners with bilateral cochlear implants

For listeners with bilateral cochlear implants (BiCIs), patient-specific differences in the interface between cochlear implant (CI) electrodes and the auditory nerve can lead to degraded temporal envelope information, compromising the ability to distinguish between targets of interest and background noise. It is unclear how comparisons of degraded temporal envelope information across spectral channels (i.e., electrodes) affect the ability to detect differences in the temporal envelope, specifically amplitude modulation (AM) rate. In this study, two pulse trains were presented simultaneously via pairs of electrodes in different places of stimulation, within and/or across ears, with identical or differing AM rates. Results from 11 adults with BiCIs indicated that sensitivity to differences in AM rate was greatest when stimuli were paired between different places of stimulation in the same ear. Sensitivity from pairs of electrodes was predicted by the poorer electrode in the pair or the difference in fidelity between both electrodes in the pair. These findings suggest that electrodes yielding poorer temporal fidelity act as a bottleneck to comparisons of temporal information across frequency and ears, limiting access to the cues used to segregate sounds, which has important implications for device programming and optimizing patient outcomes with CIs.

Simulation of ITD-Dependent Single-Neuron Responses Under Electrical Stimulation and with Amplitude-Modulated Acoustic Stimuli

Interaural time difference (ITD) sensitivity with cochlear implant stimulation is remarkably similar to envelope ITD sensitivity using conventional acoustic stimulation. This holds true for human perception, as well as for neural response rates recorded in the inferior colliculus of several mammalian species. We hypothesize that robust excitatory-inhibitory (EI) interaction is the dominant mechanism. Therefore, we connected the same single EI-model neuron to either a model of the normal acoustic auditory periphery or to a model of the electrically stimulated auditory nerve. The model captured most features of the experimentally obtained response properties with electric stimulation, such as the shape of rate-ITD functions, the dependence on stimulation level, and the pulse rate or modulation-frequency dependence. Rate-ITD functions with high-rate, amplitude-modulated electric stimuli were very similar to their acoustic counterparts. Responses obtained with unmodulated electric pulse trains most resembled acoustic filtered clicks. The fairly rapid decline of ITD sensitivity at rates above 300 pulses or cycles per second is correctly simulated by the 3.1-ms time constant of the inhibitory post-synaptic conductance. As the model accounts for these basic properties, it is expected to help in understanding and quantifying the binaural hearing abilities with electric stimulation when integrated in bigger simulation frameworks.

Sound source localization patterns and bilateral cochlear implants: Age at onset of deafness effects

The ability to determine a sound’s location is critical in everyday life. However, sound source localization is severely compromised for patients with hearing loss who receive bilateral cochlear implants (BiCIs). Several patient factors relate to poorer performance in listeners with BiCIs, associated with auditory deprivation, experience, and age. Critically, characteristic errors are made by patients with BiCIs (e.g., medial responses at lateral target locations), and the relationship between patient factors and the type of errors made by patients has seldom been investigated across individuals. In the present study, several different types of analysis were used to understand localization errors and their relationship with patient-dependent factors (selected based on their robustness of prediction). Binaural hearing experience is required for developing accurate localization skills, auditory deprivation is associated with degradation of the auditory periphery, and aging leads to poorer temporal resolution. Therefore, it was hypothesized that earlier onsets of deafness would be associated with poorer localization acuity and longer periods without BiCI stimulation or older age would lead to greater amounts of variability in localization responses. A novel machine learning approach was introduced to characterize the types of errors made by listeners with BiCIs, making them simple to interpret and generalizable to everyday experience. Sound localization performance was measured in 48 listeners with BiCIs using pink noise trains presented in free-field. Our results suggest that older age at testing and earlier onset of deafness are associated with greater average error, particularly for sound sources near the center of the head, consistent with previous research. The machine learning analysis revealed that variability of localization responses tended to be greater for individuals with earlier compared to later onsets of deafness. These results suggest that early bilateral hearing is essential for best sound source localization outcomes in listeners with BiCIs.

Interaural time difference tuning in the rat inferior colliculus is predictive of behavioral sensitivity

While a large body of literature has examined the encoding of binaural spatial cues in the auditory midbrain, studies that ask how quantitative measures of spatial tuning in midbrain neurons compare with an animal's psychoacoustic performance remain rare. Researchers have tried to explain deficits in spatial hearing in certain patient groups, such as binaural cochlear implant users, in terms of declines in apparent reductions in spatial tuning of midbrain neurons of animal models. However, the quality of spatial tuning can be quantified in many different ways, and in the absence of evidence that a given neural tuning measure correlates with psychoacoustic performance, the interpretation of such finding remains very tentative. Here, we characterize ITD tuning in the rat inferior colliculus (IC) to acoustic pulse train stimuli with varying envelopes and at varying rates, and explore whether quality of tuning correlates behavioral performance. We quantified both mutual information (MI) and neural d' as measures of ITD sensitivity. Neural d' values paralleled behavioral ones, declining with increasing click rates or when envelopes changed from rectangular to Hanning windows, and they correlated much better with behavioral performance than MI. Meanwhile, MI values were larger in an older, more experienced cohort of animals than in naive animals, but neural d' did not differ between cohorts. However, the results obtained with neural d' and MI were highly correlated when ITD values were coded simply as left or right ear leading, rather than specific ITD values. Thus, neural measures of lateralization ability (e.g. d' or left/right MI) appear to be highly predictive of psychoacoustic performance in a two-alternative forced choice task.

Sensitivity to interaural time differences in the inferior colliculus of cochlear implanted rats with or without hearing experience

For deaf patients cochlear implants (CIs) can restore substantial amounts of functional hearing. However, binaural hearing, and in particular, the perception of interaural time differences (ITDs) with current CIs has been found to be notoriously poor, especially in the event of early hearing loss. One popular hypothesis for these deficits posits that a lack of early binaural experience may be a principal cause of poor ITD perception in pre-lingually deaf CI patients. This is supported by previous electrophysiological studies done in neonatally deafened, bilateral CI-stimulated animals showing reduced ITD sensitivity. However, we have recently demonstrated that neonatally deafened CI rats can quickly learn to discriminate microsecond ITDs under optimized stimulation conditions which suggests that the inability of human CI users to make use of ITDs is not due to lack of binaural hearing experience during development. In the study presented here, we characterized ITD sensitivity and tuning of inferior colliculus neurons under bilateral CI stimulation of neonatally deafened and hearing experienced rats. The hearing experienced rats were not deafened prior to implantation. Both cohorts were implanted bilaterally between postnatal days 64-77 and recorded immediately following surgery. Both groups showed comparably large proportions of ITD sensitive multi-units in the inferior colliculus (Deaf: 84.8%, Hearing: 82.5%), and the strength of ITD tuning, quantified as mutual information between response and stimulus ITD, was independent of hearing experience. However, the shapes of tuning curves differed substantially between both groups. We observed four main clusters of tuning curves - trough, contralateral, central, and ipsilateral tuning. Interestingly, over 90% of multi-units for hearing experienced rats showed predominantly contralateral tuning, whereas as many as 50% of multi-units in neonatally deafened rats were centrally tuned. However, when we computed neural d' scores to predict likely limits on performance in sound lateralization tasks, we did not find that these differences in tuning shapes predicted worse psychoacoustic performance for the neonatally deafened animals. We conclude that, at least in rats, substantial amounts of highly precise, "innate" ITD sensitivity can be found even after profound hearing loss throughout infancy. However, ITD tuning curve shapes appear to be strongly influenced by auditory experience although substantial lateralization encoding is present even in its absence.

Provision of interaural time difference information in chronic intracochlear electrical stimulation enhances neural sensitivity to these differences in neonatally deafened cats

Although performance with bilateral cochlear implants is superior to that with a unilateral implant, bilateral implantees have poor performance in sound localisation and in speech discrimination in noise compared to normal hearing subjects. Studies of the neural processing of interaural time differences (ITDs) in the inferior colliculus (IC) of long-term deaf animals, show substantial degradation compared to that in normal hearing animals. It is not known whether this degradation can be ameliorated by chronic cochlear electrical stimulation, but such amelioration is unlikely to be achieved using current clinical speech processors and cochlear implants, which do not provide good ITD cues. We therefore developed a custom sound processor to deliver salient ITDs for chronic bilateral intra-cochlear electrical stimulation in a cat model of neonatal deafness, to determine if long-term exposure to salient ITDs would prevent degradation of ITD processing. We compared the sensitivity to ITDs in cochlear electrical stimuli of neurons in the IC of cats chronically stimulated with our custom ITD-aware sound processor with sensitivity in acutely deafened cats with normal hearing development and in cats chronically stimulated with a clinical stimulator and sound processor. Animals that experienced stimulation with our custom ITD-aware sound processor had significantly higher neural sensitivity to ITDs than those that received stimulation from clinical sound processors. There was no significant difference between animals received no stimulation and those that received stimulation from clinical sound processors, consistent with findings from clinical cochlear implant users. This result suggests that development and use of clinical ITD-aware sound processing strategies from a young age may promote ITD sensitivity in the clinical population.

Neuroplastin expression is essential for hearing and hair cell PMCA expression

Hearing deficits impact on the communication with the external world and severely compromise perception of the surrounding. Deafness can be caused by particular mutations in the neuroplastin (Nptn) gene, which encodes a transmembrane recognition molecule of the immunoglobulin (Ig) superfamily and plasma membrane Calcium ATPase (PMCA) accessory subunit. This study investigates whether the complete absence of neuroplastin or the loss of neuroplastin in the adult after normal development lead to hearing impairment in mice analyzed by behavioral, electrophysiological, and in vivo imaging measurements. Auditory brainstem recordings from adult neuroplastin-deficient mice (Nptn^-/-) show that these mice are deaf. With age, hair cells and spiral ganglion cells degenerate in Nptn^-/- mice. Adult Nptn^-/- mice fail to behaviorally respond to white noise and show reduced baseline blood flow in the auditory cortex (AC) as revealed by single-photon emission computed tomography (SPECT). In adult Nptn^-/- mice, tone-evoked cortical activity was not detectable within the primary auditory field (A1) of the AC, although we observed non-persistent tone-like evoked activities in electrophysiological recordings of some young Nptn^-/- mice. Conditional ablation of neuroplastin in Nptn^{lox/loxEmx1Cre} mice reveals that behavioral responses to simple tones or white noise do not require neuroplastin expression by central glutamatergic neurons. Loss of neuroplastin from hair cells in adult Nptn^{Δlox/loxPrCreERT} mice after normal development is correlated with increased hearing thresholds and only high prepulse intensities result in effective prepulse inhibition (PPI) of the startle response. Furthermore, we show that neuroplastin is required for the expression of PMCA 2 in outer hair cells. This suggests that altered Ca²⁺ homeostasis underlies the observed hearing impairments and leads to hair cell degeneration. Our results underline the importance of neuroplastin for the development and the maintenance of the auditory system.

Microsecond interaural time difference discrimination restored by cochlear implants after neonatal deafness

Spatial hearing in cochlear implant (CI) patients remains a major challenge, with many early deaf users reported to have no measurable sensitivity to interaural time differences (ITDs). Deprivation of binaural experience during an early critical period is often hypothesized to be the cause of this shortcoming. However, we show that neonatally deafened (ND) rats provided with precisely synchronized CI stimulation in adulthood can be trained to lateralize ITDs with essentially normal behavioral thresholds near 50 μs. Furthermore, comparable ND rats show high physiological sensitivity to ITDs immediately after binaural implantation in adulthood. Our result that ND-CI rats achieved very good behavioral ITD thresholds, while prelingually deaf human CI patients often fail to develop a useful sensitivity to ITD raises urgent questions concerning the possibility that shortcomings in technology or treatment, rather than missing input during early development, may be behind the usually poor binaural outcomes for current CI patients.

High frequency sensitivity to interaural onset time differences in the bat inferior colliculus

Many neurons in the auditory midbrain are tuned to binaural cues. Two prominent binaural cues are the interaural level difference (ILD) and the interaural time difference (ITD). The ITD cue can further be subdivided into the ongoing envelope ITD cues and transient onset ITD cues. More is known about the sensitivity of single neurons to ongoing envelope ITDs compared to transient onset ITDs in the mammalian auditory system, particularly in bats. The current study examines the response properties of single neurons in the inferior colliculus (IC) of the big brown bat, Eptesicus fuscus, to onset ITDs in response to high frequency pure tones. Measures of neurons' dynamic ITD response revealed an average change of 36% of its maximum response within the behaviorally relevant range of ITDs (±50 µs). Across all IC neurons, we measured an average time-intensity trading ratio of 30 µs/dB in the sensitivity of the ITD response function to changing ILDs. Minimum and maximum ITD responses were clustered within a narrow range of ITDs. The average peak in the ITD response function was at 268 µs, a finding that is consistent with other non-echolocating mammals. Some ITD-sensitive neurons also showed weak facilitation of maximum response during binaural stimulation, compared to monaural stimulation. These results suggest that echolocating bats possess the potential to use onset ITD cues to assist in the azimuthal sound localization of ultrasonic frequencies.

Optimal Multichannel Artifact Prediction and Removal for Neural Stimulation and Brain Machine Interfaces

Neural implants that deliver multi-site electrical stimulation to the nervous systems are no longer the last resort but routine treatment options for various neurological disorders. Multi-site electrical stimulation is also widely used to study nervous system function and neural circuit transformations. These technologies increasingly demand dynamic electrical stimulation and closed-loop feedback control for real-time assessment of neural function, which is technically challenging since stimulus-evoked artifacts overwhelm the small neural signals of interest. We report a novel and versatile artifact removal method that can be applied in a variety of settings, from single- to multi-site stimulation and recording and for current waveforms of arbitrary shape and size. The method capitalizes on linear electrical coupling between stimulating currents and recording artifacts, which allows us to estimate a multi-channel linear Wiener filter to predict and subsequently remove artifacts via subtraction. We confirm and verify the linearity assumption and demonstrate feasibility in a variety of recording modalities, including in vitro sciatic nerve stimulation, bilateral cochlear implant stimulation, and multi-channel stimulation and recording between the auditory midbrain and cortex. We demonstrate a vast enhancement in the recording quality with a typical artifact reduction of 25-40 dB. The method is efficient and can be scaled to arbitrary number of stimulus and recording sites, making it ideal for applications in large-scale arrays, closed-loop implants, and high-resolution multi-channel brain-machine interfaces.

Evaluating the Impact of Age, Acoustic Exposure, and Electrical Stimulation on Binaural Sensitivity in Adult Bilateral Cochlear Implant Patients

Deafness in both ears is highly disruptive to communication in everyday listening situations. Many individuals with profound deafness receive bilateral cochlear implants (CIs) to gain access to spatial cues used in localization and speech understanding in noise. However, the benefit of bilateral CIs, in particular sensitivity to interaural time and level differences (ITD and ILDs), varies among patients. We measured binaural sensitivity in 46 adult bilateral CI patients to explore the relationship between binaural sensitivity and three classes of patient-related factors: age, acoustic exposure, and electric hearing experience. Results show that ILD sensitivity increased with shorter years of acoustic exposure, younger age at testing, or an interaction between these factors, moderated by the duration of bilateral hearing impairment. ITD sensitivity was impacted by a moderating effect between years of bilateral hearing impairment and CI experience. When age at onset of deafness was treated as two categories (<18 vs. >18 years of age), there was no clear effect for ILD sensitivity, but some differences were observed for ITD sensitivity. Our findings imply that maximal binaural sensitivity is obtained by listeners with a shorter bilateral hearing impairment, a longer duration of CI experience, and potentially a younger age at testing. 198/200.

Neural ITD Sensitivity and Temporal Coding with Cochlear Implants in an Animal Model of Early-Onset Deafness

Users of cochlear implant (CI) face challenges in everyday situations such as understanding conversations in noise, even with CIs in both ears. These challenges are related to difficulties with tasks that require fine temporal processing such as discrimination of pulse rates or interaural time differences (ITD), a major cue for sound localization. The degradation in temporal processing and ITD sensitivity are especially acute in those who lost hearing in early childhood. Here, we characterized temporal coding and ITD sensitivity of single neurons in a novel animal model of early-onset deafness. Rabbits were deafened as neonates and deprived of auditory stimulation until they reached adult age when single-unit recordings from the auditory midbrain were made chronically using an unanesthetized preparation. The results are compared to measurements from adult-deafened rabbits with normal auditory development to understand the effect of early-onset deafness on neural temporal coding and ITD sensitivity. Neurons in the inferior colliculus (IC) of early-deafened rabbits were less likely to show sustained, excitatory responses to pulse train stimulation and more likely to show suppressive responses compared to neurons in adult-deaf animals. Fewer neurons showed synchronized responses to pulse trains at any rate in the early-deaf group. In addition, fewer neurons showed significant ITD sensitivity in their overall firing rate in the early-deaf group compared to adult-deaf animals. Neural ITD discrimination thresholds in the early-deaf group were poorer than thresholds in adult-deaf group, especially at high pulse rates. The overall degradation in neural ITD sensitivity is consistent with the difficulties encountered by human CI users with early-onset hearing loss. These results lay the groundwork for investigating whether the degradations in temporal coding and ITD sensitivity observed in early-deaf animals can be reversed by appropriate CI stimulation during development.