Perception and coding of interaural time differences with bilateral cochlear implants

Objective measure of binaural processing: Acoustic change complex in response to interaural phase differences

Combining cochlear implants with binaural acoustic hearing via preserved hearing in the implanted ear(s) is commonly referred to as combined electric and acoustic stimulation (EAS). EAS fittings can provide patients with significant benefit for speech recognition in complex noise, perceived listening difficulty, and horizontal-plane localization as compared to traditional bimodal hearing conditions with contralateral and monaural acoustic hearing. However, EAS benefit varies across patients and the degree of benefit is not reliably related to the underlying audiogram. Previous research has indicated that EAS benefit for speech recognition in complex listening scenarios and localization is significantly correlated with the patients' binaural cue sensitivity, namely interaural time differences (ITD). In the context of pure tones, interaural phase differences (IPD) and ITD can be understood as two perspectives on the same phenomenon. Through simple mathematical conversion, one can be transformed into the other, illustrating their inherent interrelation for spatial hearing abilities. However, assessing binaural cue sensitivity is not part of a clinical assessment battery as psychophysical tasks are time consuming, require training to achieve performance asymptote, and specialized programming and software all of which render this clinically unfeasible. In this study, we investigated the possibility of using an objective measure of binaural cue sensitivity by the acoustic change complex (ACC) via imposition of an IPD of varying degrees at stimulus midpoint. Ten adult listeners with normal hearing were assessed on tasks of behavioral and objective binaural cue sensitivity for carrier frequencies of 250 and 1000 Hz. Results suggest that 1) ACC amplitude increases with IPD; 2) ACC-based IPD sensitivity for 250 Hz is significantly correlated with behavioral ITD sensitivity; 3) Participants were more sensitive to IPDs at 250 Hz as compared to 1000 Hz. Thus, this objective measure of IPD sensitivity may hold clinical application for pre- and post-operative assessment for individuals meeting candidacy indications for cochlear implantation with low-frequency acoustic hearing preservation as this relatively quick and objective measure may provide clinicians with information identifying patients most likely to derive benefit from EAS technology.

Rate dependent neural responses of interaural-time-difference cues in fine-structure and envelope

Advancements in cochlear implants (CIs) have led to a significant increase in bilateral CI users, especially among children. Yet, most bilateral CI users do not fully achieve the intended binaural benefit due to potential limitations in signal processing and/or surgical implant positioning. One crucial auditory cue that normal hearing (NH) listeners can benefit from is the interaural time difference (ITD), i.e., the time difference between the arrival of a sound at two ears. The ITD sensitivity is thought to be heavily relying on the effective utilization of temporal fine structure (very rapid oscillations in sound). Unfortunately, most current CIs do not transmit such true fine structure. Nevertheless, bilateral CI users have demonstrated sensitivity to ITD cues delivered through envelope or interaural pulse time differences, i.e., the time gap between the pulses delivered to the two implants. However, their ITD sensitivity is significantly poorer compared to NH individuals, and it further degrades at higher CI stimulation rates, especially when the rate exceeds 300 pulse per second. The overall purpose of this research thread is to improve spatial hearing abilities in bilateral CI users. This study aims to develop electroencephalography (EEG) paradigms that can be used with clinical settings to assess and optimize the delivery of ITD cues, which are crucial for spatial hearing in everyday life. The research objective of this article was to determine the effect of CI stimulation pulse rate on the ITD sensitivity, and to characterize the rate-dependent degradation in ITD perception using EEG measures. To develop protocols for bilateral CI studies, EEG responses were obtained from NH listeners using sinusoidal-amplitude-modulated (SAM) tones and filtered clicks with changes in either fine structure ITD (ITDFS) or envelope ITD (ITDENV). Multiple EEG responses were analyzed, which included the subcortical auditory steady-state responses (ASSRs) and cortical auditory evoked potentials (CAEPs) elicited by stimuli onset, offset, and changes. Results indicated that acoustic change complex (ACC) responses elicited by ITDENV changes were significantly smaller or absent compared to those elicited by ITDFS changes. The ACC morphologies evoked by ITDFS changes were similar to onset and offset CAEPs, although the peak latencies were longest for ACC responses and shortest for offset CAEPs. The high-frequency stimuli clearly elicited subcortical ASSRs, but smaller than those evoked by lower carrier frequency SAM tones. The 40-Hz ASSRs decreased with increasing carrier frequencies. Filtered clicks elicited larger ASSRs compared to high-frequency SAM tones, with the order being 40 > 160 > 80> 320 Hz ASSR for both stimulus types. Wavelet analysis revealed a clear interaction between detectable transient CAEPs and 40-Hz ASSRs in the time-frequency domain for SAM tones with a low carrier frequency.

A Mixed-Rate Strategy on a Bilaterally-Synchronized Cochlear Implant Processor Offering the Opportunity to Provide Both Speech Understanding and Interaural Time Difference Cues

Background/Objective: Bilaterally implanted cochlear implant (CI) users do not consistently have access to interaural time differences (ITDs). ITDs are crucial for restoring the ability to localize sounds and understand speech in noisy environments. Lack of access to ITDs is partly due to lack of communication between clinical processors across the ears and partly because processors must use relatively high rates of stimulation to encode envelope information. Speech understanding is best at higher stimulation rates, but sensitivity to ITDs in the timing of pulses is best at low stimulation rates. Methods: We implemented a practical "mixed rate" strategy that encodes ITD information using a low stimulation rate on some channels and speech information using high rates on the remaining channels. The strategy was tested using a bilaterally synchronized research processor, the CCi-MOBILE. Nine bilaterally implanted CI users were tested on speech understanding and were asked to judge the location of a sound based on ITDs encoded using this strategy. Results: Performance was similar in both tasks between the control strategy and the new strategy. Conclusions: We discuss the benefits and drawbacks of the sound coding strategy and provide guidelines for utilizing synchronized processors for developing strategies.

Review of Binaural Processing With Asymmetrical Hearing Outcomes in Patients With Bilateral Cochlear Implants

Bilateral cochlear implants (BiCIs) result in several benefits, including improvements in speech understanding in noise and sound source localization. However, the benefit bilateral implants provide among recipients varies considerably across individuals. Here we consider one of the reasons for this variability: difference in hearing function between the two ears, that is, interaural asymmetry. Thus far, investigations of interaural asymmetry have been highly specialized within various research areas. The goal of this review is to integrate these studies in one place, motivating future research in the area of interaural asymmetry. We first consider bottom-up processing, where binaural cues are represented using excitation-inhibition of signals from the left ear and right ear, varying with the location of the sound in space, and represented by the lateral superior olive in the auditory brainstem. We then consider top-down processing via predictive coding, which assumes that perception stems from expectations based on context and prior sensory experience, represented by cascading series of cortical circuits. An internal, perceptual model is maintained and updated in light of incoming sensory input. Together, we hope that this amalgamation of physiological, behavioral, and modeling studies will help bridge gaps in the field of binaural hearing and promote a clearer understanding of the implications of interaural asymmetry for future research on optimal patient interventions.

Pitch discrimination in electric hearing with inconsistent and consistent amplitude-modulation and inter-pulse rate cues

Users of cochlear implants (CIs) struggle in situations that require selective hearing to focus on a target source while ignoring other sources. One major reason for that is the limited access to timing cues such as temporal pitch or interaural time differences (ITDs). Various approaches to improve timing-cue sensitivity while maintaining speech understanding have been proposed, among them inserting extra pulses with short inter-pulse intervals (SIPIs) into amplitude-modulated (AM) high-rate pulse trains. Indeed, SIPI rates matching the naturally occurring AM rates improve pitch discrimination. For ITD, however, low SIPI rates are required, potentially mismatching the naturally occurring AM rates and thus creating unknown pitch effects. In this study, we investigated the perceptual contribution of AM and SIPI rate to pitch discrimination in five CI listeners and with two AM depths (0.1 and 0.5). Our results show that the SIPI-rate cue generally dominated the percept for both consistent and inconsistent cues. When tested with inconsistent cues, also the AM rate contributed, however, at the large AM depth only. These findings have implications when aiming at jointly improving temporal-pitch and ITD sensitivity in a future mixed-rate stimulation approach.

Lateralization of binaural envelope cues measured with a mobile cochlear-implant research processora)

Bilateral cochlear implant (BICI) listeners do not have full access to the binaural cues that normal hearing (NH) listeners use for spatial hearing tasks such as localization. When using their unsynchronized everyday processors, BICI listeners demonstrate sensitivity to interaural level differences (ILDs) in the envelopes of sounds, but interaural time differences (ITDs) are less reliably available. It is unclear how BICI listeners use combinations of ILDs and envelope ITDs, and how much each cue contributes to perceived sound location. The CCi-MOBILE is a bilaterally synchronized research processor with the untested potential to provide spatial cues to BICI listeners. In the present study, the CCi-MOBILE was used to measure the ability of BICI listeners to perceive lateralized sound sources when single pairs of electrodes were presented amplitude-modulated stimuli with combinations of ILDs and envelope ITDs. Young NH listeners were also tested using amplitude-modulated high-frequency tones. A cue weighting analysis with six BICI and ten NH listeners revealed that ILDs contributed more than envelope ITDs to lateralization for both groups. Moreover, envelope ITDs contributed to lateralization for NH listeners but had negligible contribution for BICI listeners. These results suggest that the CCi-MOBILE is suitable for binaural testing and developing bilateral processing strategies.

Structure and dynamics that specialize neurons for high-frequency coincidence detection in the barn owl nucleus laminaris

A principal cue for sound source localization is the difference in arrival times of sounds at an animal's two ears (interaural time difference, ITD). Neurons that process ITDs are specialized to compare the timing of inputs with submillisecond precision. In the barn owl, ITD processing begins in the nucleus laminaris (NL) region of the auditory brain stem. Remarkably, NL neurons are sensitive to ITDs in high-frequency sounds (kilohertz-range). This contrasts with ITD-based sound localization in analogous regions in mammals where ITD sensitivity is typically restricted to lower-frequency sounds. Guided by previous experiments and modeling studies of tone-evoked responses of NL neurons, we propose NL neurons achieve high-frequency ITD sensitivity if they respond selectively to the small-amplitude, high-frequency oscillations in their inputs, and remain relatively non-responsive to mean input level. We use a biophysically based model to study the effects of soma-axon coupling on dynamics and function in NL neurons. First, we show that electrical separation of the soma from the axon region in the neuron enhances high-frequency ITD sensitivity. This soma-axon coupling configuration promotes linear subthreshold dynamics and rapid spike initiation, making the model more responsive to input oscillations, rather than mean input level. Second, we provide new evidence for the essential role of phasic dynamics for high-frequency neural coincidence detection. Transforming our model to the phasic firing mode further tunes the model to respond selectively to the oscillating inputs that carry ITD information. Similar structural and dynamical mechanisms specialize mammalian auditory brain stem neurons for ITD sensitivity, and thus, our work identifies common principles of ITD processing and neural coincidence detection across species and for sounds at widely different frequencies.

Bilateral Cochlear Implant Processing of Coding Strategies With CCi-MOBILE, an Open-Source Research Platform

While speech understanding for cochlear implant (CI) users in quiet is relatively effective, listeners experience difficulty in identification of speaker and sound location. To assist for better residual hearing abilities and speech intelligibility support, bilateral and bimodal forms of assisted hearing is becoming popular among CI users. Effective bilateral processing calls for testing precise algorithm synchronization and fitting between both left and right ear channels in order to capture interaural time and level difference cues (ITD and ILDs). This work demonstrates bilateral implant algorithm processing using a custom-made CI research platform - CCi-MOBILE, which is capable of capturing precise source localization information and supports researchers in testing bilateral CI processing in real-time naturalistic environments. Simulation-based, objective, and subjective testing has been performed to validate the accuracy of the platform. The subjective test results produced an RMS error of ±8.66° for source localization, which is comparable to the performance of commercial CI processors.

Interaural time difference sensitivity under binaural cochlear implant stimulation persists at high pulse rates up to 900 pps

Spatial hearing remains one of the major challenges for bilateral cochlear implant (biCI) users, and early deaf patients in particular are often completely insensitive to interaural time differences (ITDs) delivered through biCIs. One popular hypothesis is that this may be due to a lack of early binaural experience. However, we have recently shown that neonatally deafened rats fitted with biCIs in adulthood quickly learn to discriminate ITDs as well as their normal hearing litter mates, and perform an order of magnitude better than human biCI users. Our unique behaving biCI rat model allows us to investigate other possible limiting factors of prosthetic binaural hearing, such as the effect of stimulus pulse rate and envelope shape. Previous work has indicated that ITD sensitivity may decline substantially at the high pulse rates often used in clinical practice. We therefore measured behavioral ITD thresholds in neonatally deafened, adult implanted biCI rats to pulse trains of 50, 300, 900 and 1800 pulses per second (pps), with either rectangular or Hanning window envelopes. Our rats exhibited very high sensitivity to ITDs at pulse rates up to 900 pps for both envelope shapes, similar to those in common clinical use. However, ITD sensitivity declined to near zero at 1800 pps, for both Hanning and rectangular windowed pulse trains. Current clinical cochlear implant (CI) processors are often set to pulse rates ≥ 900 pps, but ITD sensitivity in human CI listeners has been reported to decline sharply above ~ 300 pps. Our results suggest that the relatively poor ITD sensitivity seen at > 300 pps in human CI users may not reflect the hard upper limit of biCI ITD performance in the mammalian auditory pathway. Perhaps with training or better CI strategies good binaural hearing may be achievable at pulse rates high enough to allow good sampling of speech envelopes while delivering usable ITDs.

Lateralization of interaural time differences with mixed rates of stimulation in bilateral cochlear implant listeners

While listeners with bilateral cochlear implants (BiCIs) are able to access information in both ears, they still struggle to perform well on spatial hearing tasks when compared to normal hearing listeners. This performance gap could be attributed to the high stimulation rates used for speech representation in clinical processors. Prior work has shown that spatial cues, such as interaural time differences (ITDs), are best conveyed at low rates. Further, BiCI listeners are sensitive to ITDs with a mixture of high and low rates. However, it remains unclear whether mixed-rate stimuli are perceived as unitary percepts and spatially mapped to intracranial locations. Here, electrical pulse trains were presented on five, interaurally pitch-matched electrode pairs using research processors, at either uniformly high rates, low rates, or mixed rates. Eight post-lingually deafened adults were tested on perceived intracranial lateralization of ITDs ranging from 50 to 1600 μs. Extent of lateralization depended on the location of low-rate stimulation along the electrode array: greatest in the low- and mixed-rate configurations, and smallest in the high-rate configuration. All but one listener perceived a unitary auditory object. These findings suggest that a mixed-rate processing strategy can result in good lateralization and convey a unitary auditory object with ITDs.

Temporal hyper-precision of brainstem neurons alters spatial sensitivity of binaural auditory processing with cochlear implants

The ability to localize a sound source in complex environments is essential for communication and navigation. Spatial hearing relies predominantly on the comparison of differences in the arrival time of sound between the two ears, the interaural time differences (ITDs). Hearing impairments are highly detrimental to sound localization. While cochlear implants (CIs) have been successful in restoring many crucial hearing capabilities, sound localization via ITD detection with bilateral CIs remains poor. The underlying reasons are not well understood. Neuronally, ITD sensitivity is generated by coincidence detection between excitatory and inhibitory inputs from the two ears performed by specialized brainstem neurons. Due to the lack of electrophysiological brainstem recordings during CI stimulation, it is unclear to what extent the apparent deficits are caused by the binaural comparator neurons or arise already on the input level. Here, we use a bottom-up approach to compare response features between electric and acoustic stimulation in an animal model of CI hearing. Conducting extracellular single neuron recordings in gerbils, we find severe hyper-precision and moderate hyper-entrainment of both the excitatory and inhibitory brainstem inputs to the binaural comparator neurons during electrical pulse-train stimulation. This finding establishes conclusively that the binaural processing stage must cope with highly altered input statistics during CI stimulation. To estimate the consequences of these effects on ITD sensitivity, we used a computational model of the auditory brainstem. After tuning the model parameters to match its response properties to our physiological data during either stimulation type, the model predicted that ITD sensitivity to electrical pulses is maintained even for the hyper-precise inputs. However, the model exhibits severely altered spatial sensitivity during electrical stimulation compared to acoustic: while resolution of ITDs near midline was increased, more lateralized adjacent source locations became inseparable. These results directly resemble recent findings in rodent and human CI listeners. Notably, decreasing the phase-locking precision of inputs during electrical stimulation recovered a wider range of separable ITDs. Together, our findings suggest that a central problem underlying the diminished ITD sensitivity in CI users might be the temporal hyper-precision of inputs to the binaural comparator stage induced by electrical stimulation.

Neonatal Deafening Selectively Degrades the Sensitivity to Interaural Time Differences of Electrical Stimuli in Low-Frequency Pathways in Rats

We examined the effect of neonatal deafening on frequency-specific pathways for processing of interaural time differences (ITDs) in cochlear-implant stimuli. Animal studies have demonstrated differences in neural ITD sensitivity in the inferior colliculus (IC) depending on the intracochlear location of intracochlear stimulating electrodes. We used neonatally deafened (ND) rats of both sexes and recorded the responses of single neurons in the IC to electrical stimuli with ITDs delivered to the apical or basal cochlea and compared them with acutely deafened (AD) rats of both sexes with normal hearing (NH) during development. We found that neonatal deafness significantly impacted the ITD sensitivity and the ITD tuning patterns restricted to apically driven IC neurons. In ND rats, the ITD sensitivity of apically driven neurons is reduced to values similar to basally driven neurons. The prevalence of ITD-sensitive apical neurons with a peak-shaped ITD tuning curve, which may reflect predominant input from the medial superior olivary (MSO) complex, in ND rats was diminished compared with that in AD rats (67%, AD vs 40%, ND). Conversely, monotonic-type responses rarely occurred in AD rats (14%) but were approximately equally as prevalent as peak-type tuning curves in ND rats (42%). Nevertheless, in ND rats, the ITD at the maximum slope of the ITD tuning curve was still more concentrated within the physiological ITD range in apically driven than in basally driven neurons. These results indicate that the development of high ITD sensitivity processed by low-frequency pathways depends on normal auditory experience and associated biases in ITD tuning strategies.

Intensive Training of Spatial Hearing Promotes Auditory Abilities of Bilateral Cochlear Implant Adults: A Pilot Study

OBJECTIVE

The aim of this study was to evaluate the feasibility of a virtual reality-based spatial hearing training protocol in bilateral cochlear implant (CI) users and to provide pilot data on the impact of this training on different qualities of hearing.

DESIGN

Twelve bilateral CI adults aged between 19 and 69 followed an intensive 10-week rehabilitation program comprised eight virtual reality training sessions (two per week) interspersed with several evaluation sessions (2 weeks before training started, after four and eight training sessions, and 1 month after the end of training). During each 45-minute training session, participants localized a sound source whose position varied in azimuth and/or in elevation. At the start of each trial, CI users received no information about sound location, but after each response, feedback was given to enable error correction. Participants were divided into two groups: a multisensory feedback group (audiovisual spatial cue) and an unisensory group (visual spatial cue) who only received feedback in a wholly intact sensory modality. Training benefits were measured at each evaluation point using three tests: 3D sound localization in virtual reality, the French Matrix test, and the Speech, Spatial and other Qualities of Hearing questionnaire.

RESULTS

The training was well accepted and all participants attended the whole rehabilitation program. Four training sessions spread across 2 weeks were insufficient to induce significant performance changes, whereas performance on all three tests improved after eight training sessions. Front-back confusions decreased from 32% to 14.1% ( p = 0.017); speech recognition threshold score from 1.5 dB to -0.7 dB signal-to-noise ratio ( p = 0.029) and eight CI users successfully achieved a negative signal-to-noise ratio. One month after the end of structured training, these performance improvements were still present, and quality of life was significantly improved for both self-reports of sound localization (from 5.3 to 6.7, p = 0.015) and speech understanding (from 5.2 to 5.9, p = 0.048).

CONCLUSIONS

This pilot study shows the feasibility and potential clinical relevance of this type of intervention involving a sensorial immersive environment and could pave the way for more systematic rehabilitation programs after cochlear implantation.

Contextual Lateralization Based on Interaural Level Differences Is Preshaped by the Auditory Periphery and Predominantly Immune Against Sequential Segregation

The perceived azimuth of a target sound is determined by the interaural time difference and the interaural level difference (ILD) and is subject to contextual effects from precursor sounds. This study characterized ILD-based precursor effects (PEs) for high-frequency stimuli in a total of seven normal-hearing listeners. In Experiment 1, precursor and target were band-pass-filtered noises approximately centered at 4 kHz (1.2- and 1-octave bandwidth, respectively) separated by a 10-ms gap. The effects of precursor location (ipsilateral, contralateral, and central) on the perceived target azimuth were measured using a head-pointing task. Relative to control trials without a precursor, ipsilateral precursors biased the perceived target azimuth toward midline (medial bias) and contralateral precursors biased it contralaterally (lateral bias). Central precursors caused a symmetric lateral bias. An auditory periphery model that determines the "internal" ILD at the auditory nerve level, including either realistic efferent compression control or auditory nerve adaptation, explained about 50% of the variance in the PEs. These within-trial PEs were accompanied by an across-trial PE, inducing medial bias. Experiment 2 studied the role of sequential segregation in the within-trial PE by introducing a pitch difference between precursor and target. Segregation conditions caused increased PE for ipsilateral, no effect for contralateral, and either no effect or reduced PE for central precursors. Overall, the ILD-based within-trial PE appears to be preshaped already in the auditory periphery and the mechanism underlying at least the ipsilateral PE appears to be immune against sequential segregation.

Asymmetric temporal envelope sensitivity: Within- and across-ear envelope comparisons in listeners with bilateral cochlear implants

For listeners with bilateral cochlear implants (BiCIs), patient-specific differences in the interface between cochlear implant (CI) electrodes and the auditory nerve can lead to degraded temporal envelope information, compromising the ability to distinguish between targets of interest and background noise. It is unclear how comparisons of degraded temporal envelope information across spectral channels (i.e., electrodes) affect the ability to detect differences in the temporal envelope, specifically amplitude modulation (AM) rate. In this study, two pulse trains were presented simultaneously via pairs of electrodes in different places of stimulation, within and/or across ears, with identical or differing AM rates. Results from 11 adults with BiCIs indicated that sensitivity to differences in AM rate was greatest when stimuli were paired between different places of stimulation in the same ear. Sensitivity from pairs of electrodes was predicted by the poorer electrode in the pair or the difference in fidelity between both electrodes in the pair. These findings suggest that electrodes yielding poorer temporal fidelity act as a bottleneck to comparisons of temporal information across frequency and ears, limiting access to the cues used to segregate sounds, which has important implications for device programming and optimizing patient outcomes with CIs.

Development of Sound Localization in Infants and Young Children with Cochlear Implants

Cochlear implantation as a treatment for severe-to-profound hearing loss allows children to develop hearing, speech, and language in many cases. However, cochlear implants are generally provided beyond the infant period and outcomes are assessed after years of implant use, making comparison with normal development difficult. The aim was to study whether the rate of improvement of horizontal localization accuracy in children with bilateral implants is similar to children with normal hearing. A convenience sample of 20 children with a median age at simultaneous bilateral implantation = 0.58 years (0.42−2.3 years) participated in this cohort study. Longitudinal follow-up of sound localization accuracy for an average of ≈1 year generated 42 observations at a mean age = 1.5 years (0.58−3.6 years). The rate of development was compared to historical control groups including children with normal hearing and with relatively late bilateral implantation (≈4 years of age). There was a significant main effect of time with bilateral implants on localization accuracy (slope = 0.21/year, R2 = 0.25, F = 13.6, p < 0.001, n = 42). No differences between slopes (F = 0.30, p = 0.58) or correlation coefficients (Cohen’s q = 0.28, p = 0.45) existed when comparing children with implants and normal hearing (slope = 0.16/year since birth, p = 0.015, n = 12). The rate of development was identical to children implanted late. Results suggest that early bilateral implantation in children with severe-to-profound hearing loss allows development of sound localization at a similar age to children with normal hearing. Similar rates in children with early and late implantation and normal hearing suggest an intrinsic mechanism for the development of horizontal sound localization abilities.

The Relationship Between Interaural Insertion-Depth Differences, Scalar Location, and Interaural Time-Difference Processing in Adult Bilateral Cochlear-Implant Listeners

Sensitivity to interaural time differences (ITDs) in acoustic hearing involves comparison of interaurally frequency-matched inputs. Bilateral cochlear-implant arrays are, however, only approximately aligned in angular insertion depth and scalar location across the cochleae. Interaural place-of-stimulation mismatch therefore has the potential to impact binaural perception. ITD left-right discrimination thresholds were examined in 23 postlingually-deafened adult bilateral cochlear-implant listeners, using low-rate constant-amplitude pulse trains presented via direct stimulation to single electrodes in each ear. Angular insertion depth and scalar location measured from computed-tomography (CT) scans were used to quantify interaural mismatch, and their association with binaural performance was assessed. Number-matched electrodes displayed a median interaural insertion-depth mismatch of 18° and generally yielded best or near-best ITD discrimination thresholds. Two listeners whose discrimination thresholds did not show this pattern were confirmed via CT to have atypical array placement. Listeners with more number-matched electrode pairs located in the scala tympani displayed better thresholds than listeners with fewer such pairs. ITD tuning curves as a function of interaural electrode separation were broad; bandwidths at twice the threshold minimum averaged 10.5 electrodes (equivalent to 5.9 mm for a Cochlear-brand pre-curved array). Larger angular insertion-depth differences were associated with wider bandwidths. Wide ITD tuning curve bandwidths appear to be a product of both monopolar stimulation and angular insertion-depth mismatch. Cases of good ITD sensitivity with very wide bandwidths suggest that precise matching of insertion depth is not critical for discrimination thresholds. Further prioritizing scala tympani location at implantation should, however, benefit ITD sensitivity.

Effects of better-ear glimpsing, binaural unmasking, and spectral resolution on spatial release from masking in cochlear-implant users

Bilateral cochlear-implant (BICI) listeners obtain less spatial release from masking (SRM; speech-recognition improvement for spatially separated vs co-located conditions) than normal-hearing (NH) listeners, especially for symmetrically placed maskers that produce similar long-term target-to-masker ratios at the two ears. Two experiments examined possible causes of this deficit, including limited better-ear glimpsing (using speech information from the more advantageous ear in each time-frequency unit), limited binaural unmasking (using interaural differences to improve signal-in-noise detection), or limited spectral resolution. Listeners had NH (presented with unprocessed or vocoded stimuli) or BICIs. Experiment 1 compared natural symmetric maskers, idealized monaural better-ear masker (IMBM) stimuli that automatically performed better-ear glimpsing, and hybrid stimuli that added worse-ear information, potentially restoring binaural cues. BICI and NH-vocoded SRM was comparable to NH-unprocessed SRM for idealized stimuli but was 14%-22% lower for symmetric stimuli, suggesting limited better-ear glimpsing ability. Hybrid stimuli improved SRM for NH-unprocessed listeners but degraded SRM for BICI and NH-vocoded listeners, suggesting they experienced across-ear interference instead of binaural unmasking. In experiment 2, increasing the number of vocoder channels did not change NH-vocoded SRM. BICI SRM deficits likely reflect a combination of across-ear interference, limited better-ear glimpsing, and poorer binaural unmasking that stems from cochlear-implant-processing limitations other than reduced spectral resolution.

Computed-Tomography Estimates of Interaural Mismatch in Insertion Depth and Scalar Location in Bilateral Cochlear-Implant Users

HYPOTHESIS

Bilateral cochlear-implant (BI-CI) users will have a range of interaural insertion-depth mismatch because of different array placement or characteristics. Mismatch will be larger for electrodes located near the apex or outside scala tympani, or for arrays that are a mix of precurved and straight types.

BACKGROUND

Brainstem superior olivary-complex neurons are exquisitely sensitive to interaural-difference cues for sound localization. Because these neurons rely on interaurally place-of-stimulation-matched inputs, interaural insertion-depth or scalar-location differences for BI-CI users could cause interaural place-of-stimulation mismatch that impairs binaural abilities.

METHODS

Insertion depths and scalar locations were calculated from temporal-bone computed-tomography scans for 107 BI-CI users (27 Advanced Bionics, 62 Cochlear, 18 MED-EL).

RESULTS

Median interaural insertion-depth mismatch was 23.4 degrees or 1.3 mm. Mismatch in the estimated clinically relevant range expected to impair binaural processing (>75 degrees or 3 mm) occurred for 13 to 19% of electrode pairs overall, and for at least three electrode pairs for 23 to 37% of subjects. There was a significant three-way interaction between insertion depth, scalar location, and array type. Interaural insertion-depth mismatch was largest for apical electrodes, for electrode pairs in two different scala, and for arrays that were both-precurved.

CONCLUSION

Average BI-CI interaural insertion-depth mismatch was small; however, large interaural insertion-depth mismatch-with the potential to degrade spatial hearing-occurred frequently enough to warrant attention. For new BICI users, improved surgical techniques to avoid interaural insertion-depth and scalar mismatch are recommended. For existing BI-CI users with interaural insertion-depth mismatch, interaural alignment of clinical frequency tables might reduce negative spatial-hearing consequences.

Sound Source Localization by Cochlear Implant Recipients with Normal Hearing in the Contralateral Ear: Effects of Spectral Content and Duration of Listening Experience

INTRODUCTION

Cochlear implant (CI) recipients with normal hearing (NH) in the contralateral ear experience a significant improvement in sound source localization when listening with the CI in combination with their NH-ear (CI + NH) as compared to with the NH-ear alone. The improvement in localization is primarily due to sensitivity to interaural level differences (ILDs). Sensitivity to interaural timing differences (ITDs) may be limited by auditory aging, frequency-to-place mismatches, the signal coding strategy, and duration of CI use. The present report assessed the sensitivity of ILD and ITD cues in CI + NH listeners who were recipients of long electrode arrays that provide minimal frequency-to-place mismatches and were mapped with a coding strategy that presents fine structure cues on apical channels.

METHODS

Sensitivity to ILDs and ITDs for localization was assessed using broadband noise (BBN), as well as high-pass (HP) and low-pass (LP) filtered noise for adult CI + NH listeners. Stimuli were 200-ms noise bursts presented from 11 speakers spaced evenly over an 180° arc. Performance was quantified in root-mean-squared error and response patterns were analyzed to evaluate the consistency, accuracy, and side bias of the responses. Fifteen listeners completed the task at the 2-year post-activation visit; seven listeners repeated the task at a later annual visit.

RESULTS

Performance at the 2-year visit was best with the BBN and HP stimuli and poorer with the LP stimulus. Responses to the BBN and HP stimuli were significantly correlated, consistent with the idea that CI + NH listeners primarily use ILD cues for localization. For the LP stimulus, some listeners responded consistently and accurately and with limited side bias, which may indicate sensitivity to ITD cues. Two of the 7 listeners who repeated the task at a later annual visit experienced a significant improvement in performance with the LP stimulus, which may indicate that sensitivity to ITD cues may improve with long-term CI use.

CONCLUSIONS

CI recipients with a NH-ear primarily use ILD cues for sound source localization, though some may use ITD cues as well. Sensitivity to ITD cues may improve with long-term CI listening experience.

Modelling speech reception thresholds and their improvements due to spatial noise reduction algorithms in bimodal cochlear implant users

•

This paper compares two modelling approaches to predict the speech recognition ability of bimodal CI users and the benefit of using beamformers.

•

The modelling approaches vary in computational complexity and fitting requirements.

•

A complex cafeteria spatial scenario with three localized single noise source scenario and a diffuse multi-talker babble noise is used.

•

The automatic speech recognizer is more accurate across the different spatial scenarios and noise types and requires less fitting compared to the statistical modelling approach.

Spatial noise reduction algorithms (“beamformers”) can considerably improve speech reception thresholds (SRTs) for bimodal cochlear implant (CI) users. The goal of this study was to model SRTs and SRT-benefit due to beamformers for bimodal CI users. Two existing model approaches varying in computational complexity and binaural processing assumption were compared: (i) the framework of auditory discrimination experiments (FADE) and (ii) the binaural speech intelligibility model (BSIM), both with CI and aided hearing-impaired front-ends. The exact same acoustic scenarios, and open-access beamformers as in the comparison clinical study Zedan et al. (2021) were used to quantify goodness of prediction. FADE was capable of modeling SRTs ab-initio, i.e., no calibration of the model was necessary to achieve high correlations and low root-mean square errors (RMSE) to both, measured SRTs (r = 0.85, RMSE = 2.8 dB) and to measured SRT-benefits (r = 0.96). BSIM achieved somewhat poorer predictions to both, measured SRTs (r = 0.78, RMSE = 6.7 dB) and to measured SRT-benefits (r = 0.91) and needs to be calibrated for matching average SRTs in one condition. Greatest deviations in predictions of BSIM were observed in diffuse multi-talker babble noise, which were not found with FADE. SRT-benefit predictions of both models were similar to instrumental signal-to-noise ratio (iSNR) improvements due to the beamformers. This indicates that FADE is preferrable for modeling absolute SRTs. However, for prediction of SRT-benefit due to spatial noise reduction algorithms in bimodal CI users, the average iSNR is a much simpler approach with similar performance.

Simulation of ITD-Dependent Single-Neuron Responses Under Electrical Stimulation and with Amplitude-Modulated Acoustic Stimuli

Interaural time difference (ITD) sensitivity with cochlear implant stimulation is remarkably similar to envelope ITD sensitivity using conventional acoustic stimulation. This holds true for human perception, as well as for neural response rates recorded in the inferior colliculus of several mammalian species. We hypothesize that robust excitatory-inhibitory (EI) interaction is the dominant mechanism. Therefore, we connected the same single EI-model neuron to either a model of the normal acoustic auditory periphery or to a model of the electrically stimulated auditory nerve. The model captured most features of the experimentally obtained response properties with electric stimulation, such as the shape of rate-ITD functions, the dependence on stimulation level, and the pulse rate or modulation-frequency dependence. Rate-ITD functions with high-rate, amplitude-modulated electric stimuli were very similar to their acoustic counterparts. Responses obtained with unmodulated electric pulse trains most resembled acoustic filtered clicks. The fairly rapid decline of ITD sensitivity at rates above 300 pulses or cycles per second is correctly simulated by the 3.1-ms time constant of the inhibitory post-synaptic conductance. As the model accounts for these basic properties, it is expected to help in understanding and quantifying the binaural hearing abilities with electric stimulation when integrated in bigger simulation frameworks.

Sound source localization patterns and bilateral cochlear implants: Age at onset of deafness effects

The ability to determine a sound’s location is critical in everyday life. However, sound source localization is severely compromised for patients with hearing loss who receive bilateral cochlear implants (BiCIs). Several patient factors relate to poorer performance in listeners with BiCIs, associated with auditory deprivation, experience, and age. Critically, characteristic errors are made by patients with BiCIs (e.g., medial responses at lateral target locations), and the relationship between patient factors and the type of errors made by patients has seldom been investigated across individuals. In the present study, several different types of analysis were used to understand localization errors and their relationship with patient-dependent factors (selected based on their robustness of prediction). Binaural hearing experience is required for developing accurate localization skills, auditory deprivation is associated with degradation of the auditory periphery, and aging leads to poorer temporal resolution. Therefore, it was hypothesized that earlier onsets of deafness would be associated with poorer localization acuity and longer periods without BiCI stimulation or older age would lead to greater amounts of variability in localization responses. A novel machine learning approach was introduced to characterize the types of errors made by listeners with BiCIs, making them simple to interpret and generalizable to everyday experience. Sound localization performance was measured in 48 listeners with BiCIs using pink noise trains presented in free-field. Our results suggest that older age at testing and earlier onset of deafness are associated with greater average error, particularly for sound sources near the center of the head, consistent with previous research. The machine learning analysis revealed that variability of localization responses tended to be greater for individuals with earlier compared to later onsets of deafness. These results suggest that early bilateral hearing is essential for best sound source localization outcomes in listeners with BiCIs.

The effect of target and interferer frequency on across-frequency binaural interference of interaural-level-difference sensitivity

Across-frequency binaural interference occurs when the sensitivity to changes in interaural differences in a target sound is decreased by a spectrally remote diotic interfering sound. For interaural time differences (ITDs), low-frequency (e.g., 0.5 kHz) interferers cause more interference on high-frequency (e.g., 4 kHz) targets than vice versa. For interaural level differences (ILDs), however, it is unclear if a frequency dependence exists. Therefore, ILD discrimination thresholds and across-frequency binaural interference were measured for target and interferer frequencies between 0.5 and 8 kHz (for tones) or 12 kHz (for narrowband noises). For tones, 8-kHz targets experienced the least interference and 8-kHz interferers produced the most interference, suggesting that higher-frequency ILDs are a more heavily weighted localization cue than lower-frequency ILDs. For narrowband noises, the frequency-dependent interference patterns increased in complexity in comparison to tones. Low-frequency ITD dominance (from randomly varying onset ITDs) and grouping cues (e.g., envelope modulations) might explain some of the complexity in the interference patterns for the noises. These data contribute to a better understanding of across-frequency ILD processing, which remains poorly understood.

The Impact of Synchronized Cochlear Implant Sampling and Stimulation on Free-Field Spatial Hearing Outcomes: Comparing the ciPDA Research Processor to Clinical Processors

OBJECTIVES

Bilateral cochlear implant (BiCI) listeners use independent processors in each ear. This independence and lack of shared hardware prevents control of the timing of sampling and stimulation across ears, which precludes the development of bilaterally-coordinated signal processing strategies. As a result, these devices potentially reduce access to binaural cues and introduce disruptive artifacts. For example, measurements from two clinical processors demonstrate that independently-running processors introduce interaural incoherence. These issues are typically avoided in the laboratory by using research processors with bilaterally-synchronized hardware. However, these research processors do not typically run in real-time and are difficult to take out into the real-world due to their benchtop nature. Hence, the question of whether just applying hardware synchronization to reduce bilateral stimulation artifacts (and thereby potentially improve functional spatial hearing performance) has been difficult to answer. The CI personal digital assistant (ciPDA) research processor, which uses one clock to drive two processors, presented an opportunity to examine whether synchronization of hardware can have an impact on spatial hearing performance.

DESIGN

Free-field sound localization and spatial release from masking (SRM) were assessed in 10 BiCI listeners using both their clinical processors and the synchronized ciPDA processor. For sound localization, localization accuracy was compared within-subject for the two processor types. For SRM, speech reception thresholds were compared for spatially separated and co-located configurations, and the amount of unmasking was compared for synchronized and unsynchronized hardware. There were no deliberate changes of the sound processing strategy on the ciPDA to restore or improve binaural cues.

RESULTS

There was no significant difference in localization accuracy between unsynchronized and synchronized hardware (p = 0.62). Speech reception thresholds were higher with the ciPDA. In addition, although five of eight participants demonstrated improved SRM with synchronized hardware, there was no significant difference in the amount of unmasking due to spatial separation between synchronized and unsynchronized hardware (p = 0.21).

CONCLUSIONS

Using processors with synchronized hardware did not yield an improvement in sound localization or SRM for all individuals, suggesting that mere synchronization of hardware is not sufficient for improving spatial hearing outcomes. Further work is needed to improve sound coding strategies to facilitate access to spatial hearing cues. This study provides a benchmark for spatial hearing performance with real-time, bilaterally-synchronized research processors.

Novel Approaches to Measure Spatial Release From Masking in Children With Bilateral Cochlear Implants

OBJECTIVES

To investigate the role of auditory cues for spatial release from masking (SRM) in children with bilateral cochlear implants (BiCIs) and compare their performance with children with normal hearing (NH). To quantify the contribution to speech intelligibility benefits from individual auditory cues: head shadow, binaural redundancy, and interaural differences; as well as from multiple cues: SRM and binaural squelch. To assess SRM using a novel approach of adaptive target-masker angular separation, which provides a more functionally relevant assessment in realistic complex auditory environments.

DESIGN

Children fitted with BiCIs (N = 11) and with NH (N = 18) were tested in virtual acoustic space that was simulated using head-related transfer functions measured from individual children with BiCIs behind the ear and from a standard head and torso simulator for all NH children. In experiment I, by comparing speech reception thresholds across 4 test conditions that varied in target-masker spatial separation (colocated versus separated at 180°) and listening conditions (monaural versus binaural/bilateral listening), intelligibility benefits were derived for individual auditory cues for SRM. In experiment II, SRM was quantified using a novel measure to find the minimum angular separation (MAS) between the target and masker to achieve a fixed 20% intelligibility improvement. Target speech was fixed at either +90 or -90° azimuth on the side closer to the better ear (+90° for all NH children) and masker locations were adaptively varied.

RESULTS

In experiment I, children with BiCIs as a group had smaller intelligibility benefits from head shadow than NH children. No group difference was observed in benefits from binaural redundancy or interaural difference cues. In both groups of children, individuals who gained a larger benefit from interaural differences relied less on monaural head shadow, and vice versa. In experiment II, all children with BiCIs demonstrated measurable MAS thresholds <180° and on average larger than that from NH children. Eight of 11 children with BiCIs and all NH children had a MAS threshold <90°, requiring interaural differences only to gain the target intelligibility benefit; whereas the other 3 children with BiCIs had a MAS between 120° and 137°, requiring monaural head shadow for SRM.

CONCLUSIONS

When target and maskers were separated at 180° on opposing hemifields, children with BiCIs demonstrated greater intelligibility benefits from head shadow and interaural differences than previous literature showed with a smaller separation. Children with BiCIs demonstrated individual differences in using auditory cues for SRM. From the MAS thresholds, more than half of the children with BiCIs demonstrated robust access to interaural differences without needing additional monaural head shadow for SRM. Both experiments led to the conclusion that individualized fitting strategies in the bilateral devices may be warranted to maximize spatial hearing for children with BiCIs in complex auditory environments.

Considerations for Fitting Cochlear Implants Bimodally and to the Single-Sided Deaf

When listening with a cochlear implant through one ear and acoustically through the other, binaural benefits and spatial hearing abilities are generally poorer than in other bilaterally stimulated configurations. With the working hypothesis that binaural neurons require interaurally matched inputs, we review causes for mismatch, their perceptual consequences, and experimental methods for mismatch measurements. The focus is on the three primary interaural dimensions of latency, frequency, and level. Often, the mismatch is not constant, but rather highly stimulus-dependent. We report on mismatch compensation strategies, taking into consideration the specific needs of the respective patient groups. Practical challenges typically faced by audiologists in the proposed fitting procedure are discussed. While improvement in certain areas (e.g., speaker localization) is definitely achievable, a more comprehensive mismatch compensation is a very ambitious endeavor. Even in the hypothetical ideal fitting case, performance is not expected to exceed that of a good bilateral cochlear implant user.

Effects of place of stimulation on the interaural time difference sensitivity in bilateral electrical intracochlear stimulations: Neurophysiological study in a rat model

We examined the sensitivity of the neurons in the inferior colliculus (IC) in male and female rats to the interaural time differences (ITDs) conveyed in electrical pulse trains. Using bipolar pairs of electrodes that selectively activate the auditory nerve fibers at different intracochlear locations, we assessed whether the responses to electrical stimulation with ITDs in different frequency regions were processed differently. Most well-isolated single units responded to the electrical stimulation in only one of the apical or basal cochlear regions, and they were classified as either apical or basal units. Regardless of the cochlear stimulating location, more than 70% of both apical and basal units were sensitive to ITDs of electrical stimulation. However, the pulse rate dependence of neural ITD sensitivity differed significantly depending on the location of the stimulation. Moreover, ITD discrimination thresholds and the relative incidence of ITD tuning type markedly differed between units activated by apical and basal stimulations. With apical stimulation, IC neurons had a higher incidence of peak-type ITD function, which mostly exhibited the steepest position of the tuning curve within the rat's physiological ITD range of ±160 μs and, accordingly, had better ITD discrimination thresholds than those with basal stimulation. These results support the idea that ITD processing in the IC might be determined by functionally segregated frequency-specific pathways from the cochlea to the auditory midbrain.

Reweighting of Binaural Localization Cues in Bilateral Cochlear-Implant Listeners

Normal-hearing (NH) listeners rely on two binaural cues, the interaural time (ITD) and level difference (ILD), for azimuthal sound localization. Cochlear-implant (CI) listeners, however, rely almost entirely on ILDs. One reason is that present-day clinical CI stimulation strategies do not convey salient ITD cues. But even when presenting ITDs under optimal conditions using a research interface, ITD sensitivity is lower in CI compared to NH listeners. Since it has recently been shown that NH listeners change their ITD/ILD weighting when only one of the cues is consistent with visual information, such reweighting might add to CI listeners’ low perceptual contribution of ITDs, given their daily exposure to reliable ILDs but unreliable ITDs. Six bilateral CI listeners completed a multi-day lateralization training visually reinforcing ITDs, flanked by a pre- and post-measurement of ITD/ILD weights without visual reinforcement. Using direct electric stimulation, we presented 100- and 300-pps pulse trains at a single interaurally place-matched electrode pair, conveying ITDs and ILDs in various spatially consistent and inconsistent combinations. The listeners’ task was to lateralize the stimuli in a virtual environment. Additionally, ITD and ILD thresholds were measured before and after training. For 100-pps stimuli, the lateralization training increased the contribution of ITDs slightly, but significantly. Thresholds were neither affected by the training nor correlated with weights. For 300-pps stimuli, ITD weights were lower and ITD thresholds larger, but there was no effect of training. On average across test sessions, adding azimuth-dependent ITDs to stimuli containing ILDs increased the extent of lateralization for both 100- and 300-pps stimuli. The results suggest that low-rate ITD cues, robustly encoded with future CI systems, may be better exploitable for sound localization after increasing their perceptual weight via training.

Reweighting of Binaural Localization Cues Induced by Lateralization Training

Normal-hearing listeners adapt to alterations in sound localization cues. This adaptation can result from the establishment of a new spatial map of the altered cues or from a stronger relative weighting of unaltered compared to altered cues. Such reweighting has been shown for monaural vs. binaural cues. However, studies attempting to reweight the two binaural cues, interaural differences in time (ITD) and level (ILD), yielded inconclusive results. This study investigated whether binaural-cue reweighting can be induced by lateralization training in a virtual audio-visual environment. Twenty normal-hearing participants, divided into two groups, completed the experiment consisting of 7 days of lateralization training, preceded and followed by a test measuring the binaural-cue weights. Participants' task was to lateralize 500-ms bandpass-filtered (2-4 kHz) noise bursts containing various combinations of spatially consistent and inconsistent binaural cues. During training, additional visual cues reinforced the azimuth corresponding to ITDs in one group and ILDs in the other group and the azimuthal ranges of the binaural cues were manipulated group-specifically. Both groups showed a significant increase of the reinforced-cue weight from pre- to posttest, suggesting that participants reweighted the binaural cues in the expected direction. This reweighting occurred within the first training session. The results are relevant as binaural-cue reweighting likely occurs when normal-hearing listeners adapt to new acoustic environments. Reweighting might also be a factor underlying the low contribution of ITDs to sound localization of cochlear-implant listeners as they typically do not experience reliable ITD cues with clinical devices.

Transmission of Binaural Cues by Bilateral Cochlear Implants: Examining the Impacts of Bilaterally Independent Spectral Peak-Picking, Pulse Timing, and Compression

Acoustic hearing listeners use binaural cues—interaural time differences (ITDs) and interaural level differences (ILDs)—for localization and segregation of sound sources in the horizontal plane. Cochlear implant users now often receive two implants (bilateral cochlear implants [BiCIs]) rather than one, with the goal to provide access to these cues. However, BiCI listeners often experience difficulty with binaural tasks. Most BiCIs use independent sound processors at each ear; it has often been suggested that such independence may degrade the transmission of binaural cues, particularly ITDs. Here, we report empirical measurements of binaural cue transmission via BiCIs implementing a common “n-of-m” spectral peak-picking stimulation strategy. Measurements were completed for speech and nonspeech stimuli presented to an acoustic manikin “fitted” with BiCI sound processors. Electric outputs from the BiCIs and acoustic outputs from the manikin’s in-ear microphones were recorded simultaneously, enabling comparison of electric and acoustic binaural cues. For source locations away from the midline, BiCI binaural cues, particularly envelope ITD cues, were found to be degraded by asymmetric spectral peak-picking. In addition, pulse amplitude saturation due to nonlinear level mapping yielded smaller ILDs at higher presentation levels. Finally, while individual pulses conveyed a spurious “drifting” ITD, consistent with independent left and right processor clocks, such variation was not evident in transmitted envelope ITDs. Results point to avenues for improvement of BiCI technology and may prove useful in the interpretation of BiCI spatial hearing outcomes reported in prior and future studies.

Effects of temporal fine structure preservation on spatial hearing in bilateral cochlear implant users

Typically, the coding strategies of cochlear implant audio processors discard acoustic temporal fine structure information (TFS), which may be related to the poor perception of interaural time differences (ITDs) and the resulting reduced spatial hearing capabilities compared to normal-hearing individuals. This study aimed to investigate to what extent bilateral cochlear implant (BiCI) recipients can exploit ITD cues provided by a TFS preserving coding strategy (FS4) in a series of sound field spatial hearing tests. As a baseline, we assessed the sensitivity to ITDs and binaural beats of 12 BiCI subjects with a coding strategy disregarding fine structure (HDCIS) and the FS4 strategy. For 250 Hz pure-tone stimuli but not for broadband noise, the BiCI users had significantly improved ITD discrimination using the FS4 strategy. In the binaural beat detection task and the broadband sound localization, spatial discrimination, and tracking tasks, no significant differences between the two tested coding strategies were observed. These results suggest that ITD sensitivity did not generalize to broadband stimuli or sound field spatial hearing tests, suggesting that it would not be useful for real-world listening.

Sensitivity to interaural time differences in the inferior colliculus of cochlear implanted rats with or without hearing experience

For deaf patients cochlear implants (CIs) can restore substantial amounts of functional hearing. However, binaural hearing, and in particular, the perception of interaural time differences (ITDs) with current CIs has been found to be notoriously poor, especially in the event of early hearing loss. One popular hypothesis for these deficits posits that a lack of early binaural experience may be a principal cause of poor ITD perception in pre-lingually deaf CI patients. This is supported by previous electrophysiological studies done in neonatally deafened, bilateral CI-stimulated animals showing reduced ITD sensitivity. However, we have recently demonstrated that neonatally deafened CI rats can quickly learn to discriminate microsecond ITDs under optimized stimulation conditions which suggests that the inability of human CI users to make use of ITDs is not due to lack of binaural hearing experience during development. In the study presented here, we characterized ITD sensitivity and tuning of inferior colliculus neurons under bilateral CI stimulation of neonatally deafened and hearing experienced rats. The hearing experienced rats were not deafened prior to implantation. Both cohorts were implanted bilaterally between postnatal days 64-77 and recorded immediately following surgery. Both groups showed comparably large proportions of ITD sensitive multi-units in the inferior colliculus (Deaf: 84.8%, Hearing: 82.5%), and the strength of ITD tuning, quantified as mutual information between response and stimulus ITD, was independent of hearing experience. However, the shapes of tuning curves differed substantially between both groups. We observed four main clusters of tuning curves - trough, contralateral, central, and ipsilateral tuning. Interestingly, over 90% of multi-units for hearing experienced rats showed predominantly contralateral tuning, whereas as many as 50% of multi-units in neonatally deafened rats were centrally tuned. However, when we computed neural d' scores to predict likely limits on performance in sound lateralization tasks, we did not find that these differences in tuning shapes predicted worse psychoacoustic performance for the neonatally deafened animals. We conclude that, at least in rats, substantial amounts of highly precise, "innate" ITD sensitivity can be found even after profound hearing loss throughout infancy. However, ITD tuning curve shapes appear to be strongly influenced by auditory experience although substantial lateralization encoding is present even in its absence.

Head Shadow, Summation, and Squelch in Bilateral Cochlear-Implant Users With Linked Automatic Gain Controls

Speech understanding in noise is poorer in bilateral cochlear-implant (BICI) users compared to normal-hearing counterparts. Independent automatic gain controls (AGCs) may contribute to this because adjusting processor gain independently can reduce interaural level differences that BICI listeners rely on for bilateral benefits. Bilaterally linked AGCs may improve bilateral benefits by increasing the magnitude of interaural level differences. The effects of linked AGCs on bilateral benefits (summation, head shadow, and squelch) were measured in nine BICI users. Speech understanding for a target talker at 0° masked by a single talker at 0°, 90°, or −90° azimuth was assessed under headphones with sentences at five target-to-masker ratios. Research processors were used to manipulate AGC type (independent or linked) and test ear (left, right, or both). Sentence recall was measured in quiet to quantify individual interaural asymmetry in functional performance. The results showed that AGC type did not significantly change performance or bilateral benefits. Interaural functional asymmetries, however, interacted with ear such that greater summation and squelch benefit occurred when there was larger functional asymmetry, and interacted with interferer location such that smaller head shadow benefit occurred when there was larger functional asymmetry. The larger benefits for those with larger asymmetry were driven by improvements from adding a better-performing ear, rather than a true binaural-hearing benefit. In summary, linked AGCs did not significantly change bilateral benefits in cases of speech-on-speech masking with a single-talker masker, but there was also no strong detriment across a range of target-to-masker ratios, within a small and diverse BICI listener population.

Rate and Temporal Coding of Regular and Irregular Pulse Trains in Auditory Midbrain of Normal-Hearing and Cochlear-Implanted Rabbits

Although pitch is closely related to temporal periodicity, stimuli with a degree of temporal irregularity can evoke a pitch sensation in human listeners. However, the neural mechanisms underlying pitch perception for irregular sounds are poorly understood. Here, we recorded responses of single units in the inferior colliculus (IC) of normal hearing (NH) rabbits to acoustic pulse trains with different amounts of random jitter in the inter-pulse intervals and compared with responses to electric pulse trains delivered through a cochlear implant (CI) in a different group of rabbits. In both NH and CI animals, many IC neurons demonstrated tuning of firing rate to the average pulse rate (APR) that was robust against temporal jitter, although jitter tended to increase the firing rates for APRs ≥ 1280 Hz. Strength and limiting frequency of spike synchronization to stimulus pulses were also comparable between periodic and irregular pulse trains, although there was a slight increase in synchronization at high APRs with CI stimulation. There were clear differences between CI and NH animals in both the range of APRs over which firing rate tuning was observed and the prevalence of synchronized responses. These results suggest that the pitches of regular and irregular pulse trains are coded differently by IC neurons depending on the APR, the degree of irregularity, and the mode of stimulation. In particular, the temporal pitch produced by periodic pulse trains lacking spectral cues may be based on a rate code rather than a temporal code at higher APRs.

Provision of interaural time difference information in chronic intracochlear electrical stimulation enhances neural sensitivity to these differences in neonatally deafened cats

Although performance with bilateral cochlear implants is superior to that with a unilateral implant, bilateral implantees have poor performance in sound localisation and in speech discrimination in noise compared to normal hearing subjects. Studies of the neural processing of interaural time differences (ITDs) in the inferior colliculus (IC) of long-term deaf animals, show substantial degradation compared to that in normal hearing animals. It is not known whether this degradation can be ameliorated by chronic cochlear electrical stimulation, but such amelioration is unlikely to be achieved using current clinical speech processors and cochlear implants, which do not provide good ITD cues. We therefore developed a custom sound processor to deliver salient ITDs for chronic bilateral intra-cochlear electrical stimulation in a cat model of neonatal deafness, to determine if long-term exposure to salient ITDs would prevent degradation of ITD processing. We compared the sensitivity to ITDs in cochlear electrical stimuli of neurons in the IC of cats chronically stimulated with our custom ITD-aware sound processor with sensitivity in acutely deafened cats with normal hearing development and in cats chronically stimulated with a clinical stimulator and sound processor. Animals that experienced stimulation with our custom ITD-aware sound processor had significantly higher neural sensitivity to ITDs than those that received stimulation from clinical sound processors. There was no significant difference between animals received no stimulation and those that received stimulation from clinical sound processors, consistent with findings from clinical cochlear implant users. This result suggests that development and use of clinical ITD-aware sound processing strategies from a young age may promote ITD sensitivity in the clinical population.

Binaural summation, binaural unmasking and fluctuating masker benefit in bimodal and bilateral adult cochlear implant users

OBJECTIVES

The number of bilateral adult cochlear implant (CI) users and bimodal CI users is expanding worldwide. The addition of a hearing aid (HA) in the contralateral non-implanted ear (bimodal) or a second CI (bilateral) can provide CI users with some of the benefits associated with listening with two ears. Our was to examine whether bilateral and bimodal CI users demonstrate binaural summation, binaural unmasking and a fluctuating masker benefit.

METHODS

Direct audio input was used to present stimuli to 10 bilateral and 10 bimodal Cochlear^TM CI users. Speech recognition in noise (speech reception threshold, SRT) was assessed monaurally, diotically (identical signals in both devices) and dichotically (antiphasic speech) with different masking noises (steady-state and interrupted), using the digits-in-noise test.

RESULTS

Bilateral CI users demonstrated a trend towards better SRTs with both CIs than with one CI. Bimodal CI users showed no difference between the bimodal SRT and the SRT for CI alone. No significant differences in SRT were found between the diotic and dichotic conditions for either group. Analyses of electrodograms created from bilateral stimuli demonstrated that substantial parts of the interaural speech cues were preserved in the Advanced Combination Encoder, an n-of-m channel selection speech coding strategy, used by the CI users. Speech recognition in noise was significantly better with interrupted noise than with steady-state masking noise for both bilateral and bimodal CI users.

CONCLUSION

Bilateral CI users demonstrated a trend towards binaural summation, but bimodal CI users did not. No binaural unmasking was demonstrated for either group of CI users. A large fluctuating masker benefit was found in both bilateral and bimodal CI users.

Comparing Methods for Pairing Electrodes Across Ears With Cochlear Implants

OBJECTIVES

Currently, bilateral cochlear implants (CIs) are independently programmed in clinics using frequency allocations based on the relative location of a given electrode from the end of each electrode array. By pairing electrodes based on this method, bilateral CI recipients may have decreased sensitivity to interaural time differences (ITD) and/or interaural level differences (ILD), two cues critical for binaural tasks. There are multiple different binaural measures that can potentially be used to determine the optimal way to pair electrodes across the ears. Previous studies suggest that the optimal electrode pairing between the left and right ears may vary depending on the binaural task used. These studies, however, have only used one reference location or a single bilateral CI user. In both instances, it is difficult to determine if the results that were obtained reflect a measurement error or a systematic difference across binaural tasks. It is also difficult to determine from these studies if the differences between the three cues vary across electrode regions, which could result from differences in the availability of binaural cues across frequency regions. The purpose of this study was to determine if, after experience-dependent adaptation, there are systematic differences in the optimal pairing of electrodes at different points along the array for the optimal perception of ITD, ILD, and pitch.

DESIGN

Data from seven bilateral Nucleus users was collected and analyzed. Participants were tested with ITD, ILD, and pitch-matching tasks using five different reference electrodes in one ear, spaced across the array. Comparisons were conducted to determine if the optimal bilateral electrode pairs systematically differed in different regions depending on whether they were measured based on ITD sensitivity, ILD sensitivity, or pitch matching, and how those pairs differed from the pairing in the participants' clinical programs.

RESULTS

Results indicate that there was a significant difference in the optimal pairing depending on the cue measured, but only at the basal end of the array.

CONCLUSION

The results suggest that optimal electrode pairings differ depending on the cue measured to determine optimal pairing, at least for the basal end of the array. This also suggests that the improvements seen when using optimally paired electrodes may be tied to the particular percept being measured both to determine electrode pairing and to assess performance, at least for the basal end of the array.

Microsecond interaural time difference discrimination restored by cochlear implants after neonatal deafness

Spatial hearing in cochlear implant (CI) patients remains a major challenge, with many early deaf users reported to have no measurable sensitivity to interaural time differences (ITDs). Deprivation of binaural experience during an early critical period is often hypothesized to be the cause of this shortcoming. However, we show that neonatally deafened (ND) rats provided with precisely synchronized CI stimulation in adulthood can be trained to lateralize ITDs with essentially normal behavioral thresholds near 50 μs. Furthermore, comparable ND rats show high physiological sensitivity to ITDs immediately after binaural implantation in adulthood. Our result that ND-CI rats achieved very good behavioral ITD thresholds, while prelingually deaf human CI patients often fail to develop a useful sensitivity to ITD raises urgent questions concerning the possibility that shortcomings in technology or treatment, rather than missing input during early development, may be behind the usually poor binaural outcomes for current CI patients.

Spatial Release From Informational and Energetic Masking in Bimodal and Bilateral Cochlear Implant Users

Purpose Spatially separating speech and background noise improves speech understanding in normal-hearing listeners, an effect referred to as spatial release from masking (SRM). In cochlear implant (CI) users, SRM has often been demonstrated using asymmetric noise configurations, which maximize benefit from head shadow and the potential availability of binaural cues. In contrast, SRM in symmetrical configurations has been minimal to absent in CI users. We examined the interaction between two types of maskers (informational and energetic) and SRM in bimodal and bilateral CI users. We hypothesized that SRM would be absent or "negative" using symmetrically separated noise maskers. Second, we hypothesized that bimodal listeners would exhibit greater release from informational masking due to access to acoustic information in the non-CI ear. Method Participants included 10 bimodal and 10 bilateral CI users. Speech understanding in noise was tested in 24 conditions: 3 spatial configurations (S₀N₀, S₀N_45&315, S₀N_90&270) × 2 masker types (speech, signal-correlated noise) × 2 listening configurations (best-aided, CI-alone) × 2 talker gender conditions (different-gender, same-gender). Results In support of our first hypothesis, both groups exhibited negative SRM with increasing spatial separation. In opposition to our second hypothesis, both groups exhibited similar magnitudes of release from informational masking. The magnitude of release was greater for bimodal listeners, though this difference failed to reach statistical significance. Conclusions Both bimodal and bilateral CI recipients exhibited negative SRM. This finding is consistent with CI signal processing limitations, the audiologic factors associated with SRM, and known effects of behind-the-ear microphone technology. Though release from informational masking was not significantly different across groups, the magnitude of release was greater for bimodal listeners. This suggests that bimodal listeners may be at least marginally more susceptible to informational masking than bilateral CI users, though further research is warranted.

Effects of noise on integration of acoustic and electric hearing within and across ears

In bimodal listening, cochlear implant (CI) users combine electric hearing (EH) in one ear and acoustic hearing (AH) in the other ear. In electric-acoustic stimulation (EAS), CI users combine EH and AH in the same ear. In quiet, integration of EH and AH has been shown to be better with EAS, but with greater sensitivity to tonotopic mismatch in EH. The goal of the present study was to evaluate how external noise might affect integration of AH and EH within or across ears. Recognition of monosyllabic words was measured for normal-hearing subjects listening to simulations of unimodal (AH or EH alone), EAS, and bimodal listening in quiet and in speech-shaped steady noise (10 dB, 0 dB signal-to-noise ratio). The input/output frequency range for AH was 0.1–0.6 kHz. EH was simulated using an 8-channel noise vocoder. The output frequency range was 1.2–8.0 kHz to simulate a shallow insertion depth. The input frequency range was either matched (1.2–8.0 kHz) or mismatched (0.6–8.0 kHz) to the output frequency range; the mismatched input range maximized the amount of speech information, while the matched input resulted in some speech information loss. In quiet, tonotopic mismatch differently affected EAS and bimodal performance. In noise, EAS and bimodal performance was similarly affected by tonotopic mismatch. The data suggest that tonotopic mismatch may differently affect integration of EH and AH in quiet and in noise.

Increased Right Posterior STS Recruitment Without Enhanced Directional-Tuning During Tactile Motion Processing in Early Deaf Individuals

Upon early sensory deprivation, the remaining modalities often exhibit cross-modal reorganization, such as primary auditory cortex (PAC) recruitment for visual motion processing in early deafness (ED). Previous studies of compensatory plasticity in ED individuals have given less attention to tactile motion processing. In the current study, we aimed to examine the effects of early auditory deprivation on tactile motion processing. We simulated four directions of tactile motion on each participant's right index finger and characterized their tactile motion responses and directional-tuning profiles using population receptive field analysis. Similar tactile motion responses were found within primary (SI) and secondary (SII) somatosensory cortices between ED and hearing control groups, whereas ED individuals showed a reduced proportion of voxels with directionally tuned responses in SI contralateral to stimulation. There were also significant but minimal responses to tactile motion within PAC for both groups. While early deaf individuals show significantly larger recruitment of right posterior superior temporal sulcus (pSTS) region upon tactile motion stimulation, there was no evidence of enhanced directional tuning. Greater recruitment of right pSTS region is consistent with prior studies reporting reorganization of multimodal areas due to sensory deprivation. The absence of increased directional tuning within the right pSTS region may suggest a more distributed population of neurons dedicated to processing tactile spatial information as a consequence of early auditory deprivation.

Temporal quantization deteriorates the discrimination of interaural time differences

Cochlear implants (CIs) often replace acoustic temporal fine structure by a fixed-rate pulse train. If the pulse timing is arbitrary (that is, not based on the phase information of the acoustic signal), temporal information is quantized by the pulse period. This temporal quantization is probably imperceptible with current clinical devices. However, it could result in large temporal jitter for strategies that aim to improve bilateral and bimodal CI users' perception of interaural time differences (ITDs), such as envelope enhancement. In an experiment with 16 normal-hearing listeners, it is shown that such jitter could deteriorate ITD perception for temporal quantization that corresponds to the often-used stimulation rate of 900 pulses per second (pps): the just-noticeable difference in ITD with quantization was 177 μs as compared to 129 μs without quantization. For smaller quantization step sizes, no significant deterioration of ITD perception was found. In conclusion, the binaural system can only average out the effect of temporal quantization to some extent, such that pulse timing should be well-considered. As this psychophysical procedure was somewhat unconventional, different procedural parameters were compared by simulating a number of commonly used two-down one-up adaptive procedures in Appendix B.

The perception of the stereo effect in bilateral and bimodal cochlear implant users and its contribution to music enjoyment

Objectives

In this clinical study, stereo perception of music samples and its contribution to music enjoyment in CI users is investigated. It is studied in free field as well as direct audio presentation.

Methods

20 bilateral and 9 bimodal CI users performed stereo detection tests and music enjoyment ratings. Music was presented either in mono or in stereo in free field or with direct audio presentation. Stereo detection was assessed with a 3-AFC paradigm. Music enjoyment was studied with scale ratings.

Results

For bilateral CI users, stereo detection increased from 52% correct in free field to 86% with direct audio presentation. Increased music enjoyment with improved stereo detection was obtained. Bimodal CI users could not identify stereo sounds. Music enjoyment did not increase for stereo presentations in bimodal subjects.

Discussion

For bilateral CI users, improved stereo detection might increase music enjoyment with direct audio presentation, which is likely due to bypassing the room acoustics. In bimodal CI users, no clear improvement was found, which is likely attributed due to the different hearing losses and therefore individually different interaural frequency overlaps between the hearing aid and the cochlear implant.

Conclusion

Direct audio presentation is an efficient method to improve music enjoyment in bilateral CI users.

Evaluating the Impact of Age, Acoustic Exposure, and Electrical Stimulation on Binaural Sensitivity in Adult Bilateral Cochlear Implant Patients

Deafness in both ears is highly disruptive to communication in everyday listening situations. Many individuals with profound deafness receive bilateral cochlear implants (CIs) to gain access to spatial cues used in localization and speech understanding in noise. However, the benefit of bilateral CIs, in particular sensitivity to interaural time and level differences (ITD and ILDs), varies among patients. We measured binaural sensitivity in 46 adult bilateral CI patients to explore the relationship between binaural sensitivity and three classes of patient-related factors: age, acoustic exposure, and electric hearing experience. Results show that ILD sensitivity increased with shorter years of acoustic exposure, younger age at testing, or an interaction between these factors, moderated by the duration of bilateral hearing impairment. ITD sensitivity was impacted by a moderating effect between years of bilateral hearing impairment and CI experience. When age at onset of deafness was treated as two categories (<18 vs. >18 years of age), there was no clear effect for ILD sensitivity, but some differences were observed for ITD sensitivity. Our findings imply that maximal binaural sensitivity is obtained by listeners with a shorter bilateral hearing impairment, a longer duration of CI experience, and potentially a younger age at testing. 198/200.

Finite element analysis and three-dimensional reconstruction of tonotopically aligned human auditory fiber pathways: A computational environment for modeling electrical stimulation by a cochlear implant based on micro-CT

The application of cochlear implants can be studied with computational models. The electrical potential distribution induced by an implanted device is evaluated with a volume conductor model, which is used as input for neuron models to simulate the reaction of cochlear neurons to micro-stimulation. In order to reliably predict the complex excitation profiles it is vital to consider an accurate representation of the human cochlea geometry including detailed three-dimensional pathways of auditory neurons reaching from the organ of Corti through the cochlea-volume. In this study, high-resolution micro-CT imaging (Δx = Δy = Δz = 3 μm) was used to reconstruct the pathways of 30 tonotopically organized nerve fiber bundles, distributed over eight octaves (11500-40 Hz). Results of the computational framework predict: (i) the peripheral process is most sensitive to cathodic stimulation (CAT), (ii) in many cases CAT elicits spikes in the peripheral terminal at threshold but with larger stimuli there is a second spike initiation site within the peripheral process, (iii) anodic stimuli (ANO) can excite the central process even at threshold, (iv) the recruitment of fibers by electrodes located in the narrowing middle- and apical turn is complex and impedes focal excitation of low frequency fibers, (v) degenerated cells which lost the peripheral process are more sensitive to CAT when their somata are totally covered with 2 membranes of a glial cell but they become ANO sensitive when the myelin covering is reduced.

Spatial Speech-in-Noise Performance in Bimodal and Single-Sided Deaf Cochlear Implant Users

This study compared spatial speech-in-noise performance in two cochlear implant (CI) patient groups: bimodal listeners, who use a hearing aid contralaterally to support their impaired acoustic hearing, and listeners with contralateral normal hearing, i.e., who were single-sided deaf before implantation. Using a laboratory setting that controls for head movements and that simulates spatial acoustic scenes, speech reception thresholds were measured for frontal speech-in-stationary noise from the front, the left, or the right side. Spatial release from masking (SRM) was then extracted from speech reception thresholds for monaural and binaural listening. SRM was found to be significantly lower in bimodal CI than in CI single-sided deaf listeners. Within each listener group, the SRM extracted from monaural listening did not differ from the SRM extracted from binaural listening. In contrast, a normal-hearing control group showed a significant improvement in SRM when using two ears in comparison to one. Neither CI group showed a binaural summation effect; that is, their performance was not improved by using two devices instead of the best monaural device in each spatial scenario. The results confirm a "listening with the better ear" strategy in the two CI patient groups, where patients benefited from using two ears/devices instead of one by selectively attending to the better one. Which one is the better ear, however, depends on the spatial scenario and on the individual configuration of hearing loss.

Improving Interaural Time Difference Sensitivity Using Short Inter-pulse Intervals with Amplitude-Modulated Pulse Trains in Bilateral Cochlear Implants

Interaural time differences (ITDs) at low frequencies are important for sound localization and spatial speech unmasking. These ITD cues are not encoded in commonly used envelope-based stimulation strategies for cochlear implants (CIs) using high pulse rates. However, ITD sensitivity can be improved by adding extra pulses with short inter-pulse intervals (SIPIs) in unmodulated high-rate trains. Here, we investigated whether this improvement also applies to amplitude-modulated (AM) high-rate pulse trains. To this end, we systematically varied the temporal position of SIPI pulses within the envelope cycle (SIPI phase), the fundamental frequency (F0) of AM (125 Hz and 250 Hz), and AM depth (from 0.1 to 0.9). Stimuli were presented at an interaurally place-matched electrode pair at a reference pulse rate of 1000 pulses/s. Participants performed an ITD-based left/right discrimination task. SIPI insertion resulted in improved ITD sensitivity throughout the range of modulation depths and for both male and female F0s. The improvements were largest for insertion at and around the envelope peak. These results are promising for conveying salient ITD cues at high pulse rates commonly used to encode speech information.

Effects of rate and age in processing interaural time and level differences in normal-hearing and bilateral cochlear-implant listeners

Bilateral cochlear implants (BICIs) provide improved sound localization and speech understanding in noise compared to unilateral CIs. However, normal-hearing (NH) listeners demonstrate superior binaural processing abilities compared to BICI listeners. This investigation sought to understand differences between NH and BICI listeners' processing of interaural time differences (ITDs) and interaural level differences (ILDs) as a function of fine-structure and envelope rate using an intracranial lateralization task. The NH listeners were presented band-limited acoustical pulse trains and sinusoidally amplitude-modulated tones using headphones, and the BICI listeners were presented single-electrode electrical pulse trains using direct stimulation. Lateralization range increased as fine-structure rate increased for ILDs in BICI listeners. Lateralization range decreased for rates above 100 Hz for fine-structure ITDs, but decreased for rates lower or higher than 100 Hz for envelope ITDs in both groups. Lateralization ranges for ITDs were smaller for BICI listeners on average. After controlling for age, older listeners showed smaller lateralization ranges and BICI listeners had a more rapid decline for ITD sensitivity at 300 pulses per second. This work suggests that age confounds comparisons between NH and BICI listeners in temporal processing tasks and that some NH-BICI binaural processing differences persist even when age differences are adequately addressed.