Temporal processing in the auditory system: insights from cochlear and auditory midbrain implantees

High and low pitch sound stimuli effects on heart-brain coupling

This study aimed to explore the influence of sound stimulation on heart rate and the potential coupling between cardiac and cerebral activities. Thirty-one participants underwent exposure to periods of silence and two distinct continuous, non-repetitive pure tone stimuli: low pitch (110 Hz) and high pitch (880 Hz). Electroencephalography (EEG) data from electrodes F3, F4, F7, F8, Fp1, Fp2, T3, T4, T5, and T6 were recorded, along with R-R interval data for heart rate. Heart-brain connectivity was assessed using wavelet coherence between heart rate variability (HRV) and EEG envelopes (EEGE). Heart rates were significantly lower during high and low-pitch sound periods than in silence (p < 0.002). HRV-EEGE coherence was significantly lower during high-pitch intervals than silence and low-pitch sound intervals (p < 0.048), specifically between the EEG Beta band and the low-frequency HRV range. These results imply a differential involvement of the frontal and temporal brain regions in response to varying auditory stimuli. Our findings highlight the essential nature of discerning the complex interrelations between sound frequencies and their implications for heart-brain connectivity. Such insights could have ramifications for conditions like seizures and sleep disturbances. A deeper exploration is warranted to decipher specific sound stimuli's potential advantages or drawbacks in diverse clinical scenarios.

Postlingually Deafened Adult Cochlear Implant Users With Prolonged Recovery From Neural Adaptation at the Level of the Auditory Nerve Tend to Have Poorer Speech Perception Performance

OBJECTIVE

This study investigated the effects of two temporal response properties of the auditory nerve (i.e., neural adaptation and recovery from neural adaptation) on speech perception performance in postlingually deafened adult cochlear implant (CI) users.

DESIGN

Study participants included 18 postlingually deafened adults who were Cochlear Nucleus device users with a full electrode array insertion in the test ear(s). Neural adaptation and adaptation recovery of the auditory nerve (AN) were evaluated using electrophysiological measures of the electrically evoked compound action potential (eCAP). The amount of neural adaptation was quantified by the adaptation index within three time windows: 0 to 8.89 (window 1), 44.44 to 50.00 (window 2), and 94.44 to 100.00 ms (window 3). The speed of neural adaptation was estimated using a two-parameter power law function. To evaluate adaptation recovery of the AN, eCAPs to the last pulse of the 100-ms pulse train were recorded at masker-probe-intervals ranging from 1.054 to 256 ms in logarithmic steps. The amount of adaptation recovery was quantified by the adaptation recovery ratio. The time-constant of adaptation recovery was estimated using an exponential function with up to three components. Speech perception performance was evaluated by measuring consonant-nucleus-consonant (CNC) word scores presented in quiet and in speech-shaped noise at a signal-to-noise ratio (SNR) of +10 dB. One-tailed Pearson Product Moment correlation tests were used (1) to assess the associations among parameters of neural adaptation and adaptation recovery and (2) to evaluate the strength of association between these parameters and CNC word scores measured in quiet and in noise. The contributions of different parameters quantifying neural adaptation and adaptation recovery on speech perception scores were evaluated using multivariable linear regression analyses.

RESULTS

The Pearson Product Moment correlation coefficient demonstrated a moderate, negative correlation between the speed of adaptation recovery and CNC word scores measured in quiet and in noise. The speed of adaptation recovery accounted for 14.1% of variability in CNC word scores measured in quiet and 16.7% of variability in CNC word scores measured in noise. The correlation strengths between CNC word scores and the adaptation index, the adaptation recovery ratio and the speed of neural adaptation ranged from negligible to weak.

CONCLUSIONS

The speed of adaptation recovery plays a more important role than other features of neural adaptation and adaptation recovery of the AN in speech perception in postlingually deafened adult CI users. Patients with prolonged adaptation recovery tend to show poorer speech perception performance.

On mistuning detection and beat perception for harmonic complex tones at low and very high frequencies

This study assessed the detection of mistuning of a single harmonic in complex tones (CTs) containing either low-frequency harmonics or very high-frequency harmonics, for which phase locking to the temporal fine structure is weak or absent. CTs had F0s of either 280 or 1400 Hz and contained harmonics 6-10, the 8th of which could be mistuned. Harmonics were presented either diotically or dichotically (odd and even harmonics to different ears). In the diotic condition, mistuning-detection thresholds were very low for both F0s and consistent with detection of temporal interactions (beats) produced by peripheral interactions of components. In the dichotic condition, for which the components in each ear were more widely spaced and beats were not reported, the mistuned component was perceptually segregated from the complex for the low F0, but subjects reported no "popping out" for the high F0 and performance was close to chance. This is consistent with the idea that phase locking is required for perceptual segregation to occur. For diotic presentation, the perceived beat rate corresponded to the amount of mistuning (in Hz). It is argued that the beat percept cannot be explained solely by interactions between the mistuned component and its two closest harmonic neighbours.

The timecourse of multisensory speech processing in unilaterally stimulated cochlear implant users revealed by ERPs

•

Both normal-hearing (NH) and cochlear implant (CI) users show a clear benefit in multisensory speech processing.

•

Group differences in ERP topographies and cortical source activation suggest distinct audiovisual speech processing in CI users when compared to NH listeners.

•

Electrical neuroimaging, including topographic and ERP source analysis, provides a suitable tool to study the timecourse of multisensory speech processing in CI users.

A cochlear implant (CI) is an auditory prosthesis which can partially restore the auditory function in patients with severe to profound hearing loss. However, this bionic device provides only limited auditory information, and CI patients may compensate for this limitation by means of a stronger interaction between the auditory and visual system. To better understand the electrophysiological correlates of audiovisual speech perception, the present study used electroencephalography (EEG) and a redundant target paradigm. Postlingually deafened CI users and normal-hearing (NH) listeners were compared in auditory, visual and audiovisual speech conditions. The behavioural results revealed multisensory integration for both groups, as indicated by shortened response times for the audiovisual as compared to the two unisensory conditions. The analysis of the N1 and P2 event-related potentials (ERPs), including topographic and source analyses, confirmed a multisensory effect for both groups and showed a cortical auditory response which was modulated by the simultaneous processing of the visual stimulus. Nevertheless, the CI users in particular revealed a distinct pattern of N1 topography, pointing to a strong visual impact on auditory speech processing. Apart from these condition effects, the results revealed ERP differences between CI users and NH listeners, not only in N1/P2 ERP topographies, but also in the cortical source configuration. When compared to the NH listeners, the CI users showed an additional activation in the visual cortex at N1 latency, which was positively correlated with CI experience, and a delayed auditory-cortex activation with a reversed, rightward functional lateralisation. In sum, our behavioural and ERP findings demonstrate a clear audiovisual benefit for both groups, and a CI-specific alteration in cortical activation at N1 latency when auditory and visual input is combined. These cortical alterations may reflect a compensatory strategy to overcome the limited CI input, which allows the CI users to improve the lip-reading skills and to approximate the behavioural performance of NH listeners in audiovisual speech conditions. Our results are clinically relevant, as they highlight the importance of assessing the CI outcome not only in auditory-only, but also in audiovisual speech conditions.

Modulation Depth Discrimination by Cochlear Implant Users

Cochlear implants (CIs) convey the amplitude envelope of speech by modulating high-rate pulse trains. However, not all of the envelope may be necessary to perceive amplitude modulations (AMs); the effective envelope depth may be limited by forward and backward masking from the envelope peaks. Three experiments used modulated pulse trains to measure which portions of the envelope can be effectively processed by CI users as a function of AM frequency. Experiment 1 used a three-interval forced-choice task to test the ability of CI users to discriminate less-modulated pulse trains from a fully modulated standard, without controlling for loudness. The stimuli in experiment 2 were identical, but a two-interval task was used in which participants were required to choose the less-modulated interval, ignoring loudness. Catch trials, in which judgements based on level or modulation depth would give opposing answers, were included. Experiment 3 employed novel stimuli whose modulation envelope could be modified below a variable point in the dynamic range, without changing the loudness of the stimulus. Overall, results showed that substantial portions of the envelope are not accurately encoded by CI users. In experiment 1, where loudness cues were available, participants on average were insensitive to changes in the bottom 30% of their dynamic range. In experiment 2, where loudness was controlled, participants appeared insensitive to changes in the bottom 50% of the dynamic range. In experiment 3, participants were insensitive to changes in the bottom 80% of the dynamic range. We discuss potential reasons for this insensitivity and implications for CI speech-processing strategies.

The Perception of Ramped Pulse Shapes in Cochlear Implant Users

The electric stimulation provided by current cochlear implants (CI) is not power efficient. One underlying problem is the poor efficiency by which information from electric pulses is transformed into auditory nerve responses. A novel stimulation paradigm using ramped pulse shapes has recently been proposed to remedy this inefficiency. The primary motivation is a better biophysical fit to spiral ganglion neurons with ramped pulses compared to the rectangular pulses used in most contemporary CIs. Here, we tested the hypotheses that ramped pulses provide more efficient stimulation compared to rectangular pulses and that a rising ramp is more efficient than a declining ramp. Rectangular, rising ramped and declining ramped pulse shapes were compared in terms of charge efficiency and discriminability, and threshold variability in seven CI listeners. The tasks included single-channel threshold detection, loudness-balancing, discrimination of pulse shapes, and threshold measurement across the electrode array. Results showed that reduced charge, but increased peak current amplitudes, was required at threshold and most comfortable levels with ramped pulses relative to rectangular pulses. Furthermore, only one subject could reliably discriminate between equally-loud ramped and rectangular pulses, suggesting variations in neural activation patterns between pulse shapes in that participant. No significant difference was found between rising and declining ramped pulses across all tests. In summary, the present findings show some benefits of charge efficiency with ramped pulses relative to rectangular pulses, that the direction of a ramped slope is of less importance, and that most participants could not perceive a difference between pulse shapes.

Temporal integration of short-duration pulse trains in cochlear implant listeners: Psychophysical and electrophysiological measurements

While electrically-evoked auditory brainstem response (eABR) thresholds for low-rate pulse trains correlate well with behavioral thresholds measured at the same rate, the correlation is much weaker with behavioral thresholds measured at high rates, such as used clinically. This implies that eABRs to low-rate stimuli cannot be reliably used for objective programming of threshold levels in cochlear implant (CI) users. Here, we investigate whether the use of bunched-up pulses (BUPS), consisting of groups of closely-spaced pulses may be used as an alternative stimulus. Experiment 1 measured psychophysical detection thresholds for several stimuli having a period of 32 ms in nine CI subjects implanted with a Med-EL device. The stimuli differed in the number of pulses present in each period (from 1 to 32), the pulse rate within period (1000 pps and as high as possible for BUPS) and the electrode location (apical or basal). The correlation between psychophysical thresholds obtained for a high-rate (1000 pps) clinical stimulus and for the BUPS stimuli increased as the number of pulses per period of BUPS increased from 1 to 32. This first psychophysical experiment suggests that the temporal processes affecting the threshold of clinical stimuli are also present for BUPS. Experiment 2 measured eABRs on the apical electrode of eight CI subjects for BUPS having 1, 2, 4, 8, 16 or 32 pulses per period. For most subjects, wave V was visible for BUPS having up to 16 pulses per period. The latency of wave V at threshold increased as a function of the number of pulses per period, suggesting that the eABR reflects the integration of multiple pulses at such low levels or that the neural response to each individual pulse increases along the sequence due to facilitation processes. There was also a strong within-subject correlation between electrophysiological and behavioral thresholds for the different BUPS stimuli. This demonstrates that the drop in behavioral threshold obtained when increasing the number of pulses per period of the BUPS can be measured electrophysiologically using eABRs. In contrast, the across-subject correlation between eABR thresholds for BUPS and clinical thresholds remained relatively weak and did not increase with the number of pulses per period. Implications of the use of BUPS for objective programming of CIs are discussed.

Applications of Phenomenological Loudness Models to Cochlear Implants

Cochlear implants electrically stimulate surviving auditory neurons in the cochlea to provide severely or profoundly deaf people with access to hearing. Signal processing strategies derive frequency-specific information from the acoustic signal and code amplitude changes in frequency bands onto amplitude changes of current pulses emitted by the tonotopically arranged intracochlear electrodes. This article first describes how parameters of the electrical stimulation influence the loudness evoked and then summarizes two different phenomenological models developed by McKay and colleagues that have been used to explain psychophysical effects of stimulus parameters on loudness, detection, and modulation detection. The Temporal Model is applied to single-electrode stimuli and integrates cochlear neural excitation using a central temporal integration window analogous to that used in models of normal hearing. Perceptual decisions are made using decision criteria applied to the output of the integrator. By fitting the model parameters to a variety of psychophysical data, inferences can be made about how electrical stimulus parameters influence neural excitation in the cochlea. The Detailed Model is applied to multi-electrode stimuli, and includes effects of electrode interaction at a cochlear level and a transform between integrated excitation and specific loudness. The Practical Method of loudness estimation is a simplification of the Detailed Model and can be used to estimate the relative loudness of any multi-electrode pulsatile stimuli without the need to model excitation at the cochlear level. Clinical applications of these models to novel sound processing strategies are described.

Assessing temporal responsiveness of primary stimulated neurons in auditory brainstem and cochlear implant users

The reasons why clinical outcomes with auditory brainstem implants (ABIs) are generally poorer than with cochlear implants (CIs) are still somewhat elusive. Prior work has focused on differences in processing of spectral information due to possibly poorer tonotopic representation and higher channel interaction with ABIs than with CIs. In contrast, this study examines the hypothesis that a potential contributing reason for poor speech perception in ABI users may be the relative lack of temporal responsiveness of the primary neurons that are stimulated by the ABI. The cochlear nucleus, the site of ABI stimulation, consists of different neuron types, most of which have much more complex responses than the auditory nerve neurons stimulated by a CI. Temporal responsiveness of primary stimulated neurons was assessed in a group of ABI and CI users by measuring recovery of electrically evoked compound action potentials (ECAPs) from single-pulse forward masking. Slower ECAP recovery tended to be associated with poorer hearing outcomes in both groups. ABI subjects with the longest recovery time had no speech understanding or even no hearing sensation with their ABI device; speech perception for the one CI outlier with long ECAP recovery time was well below average. To the extent that ECAP recovery measures reveal temporal properties of the primary neurons that receive direct stimulation form neural prosthesis devices, they may provide a physiological underpinning for clinical outcomes of auditory implants. ECAP recovery measures may be used to determine which portions of the cochlear nucleus to stimulate, and possibly allow us to enhance the stimulation paradigms.

Effect of the Relative Timing between Same-Polarity Pulses on Thresholds and Loudness in Cochlear Implant Users

The effect of the relative timing between pairs of same-polarity monophasic pulses has been studied extensively in single-neuron animal studies and has revealed fundamental properties of the neurons. For human cochlear implant listeners, the requirement to use charge-balanced stimulation and the typical use of symmetric, biphasic pulses limits such measures, because currents of opposite polarities interact at the level of the neural membrane. Here, we propose a paradigm to study same-polarity summation of currents while keeping the stimulation charge-balanced within a short time window. We used pairs of mirrored pseudo-monophasic pulses (a long-low phase followed by a short-high phase for the first pulse and a short-high phase followed by a long-low phase for the second pulse). We assumed that most of the excitation would stem from the two adjacent short-high phases, which had the same polarity. The inter-pulse interval between the short-high phases was varied from 0 to 345 μs. The inter-pulse interval had a significant effect on the perceived loudness, and this effect was consistent with both passive (membrane-related) and active (ion-channel-related) neuronal mechanisms contributing to facilitation. Furthermore, the effect of interval interacted with the polarity of the pulse pairs. At threshold, there was an effect of polarity, but, surprisingly, no effect of interval nor an interaction between the two factors. We discuss possible peripheral origins of these results.

Perception and prediction of loudness in sound coding strategies using simultaneous electric stimulation

Cochlear Implant (CI) sound coding strategies based on simultaneous stimulation lead to an increased loudness percept when compared to sequential stimulation using the same current levels. This is due to loudness summation as a result of channel interactions. Studying the loudness perception evoked by dual-channels compared to single-channels can be useful to optimize sound coding strategies that use simultaneous current pulses. Fourteen users of HiRes90k implants and one user of a CII implant loudness balanced single-channel to dual-channel stimuli with varying distance between simultaneous channels. In this study each component of a dual channel was a virtual channel, which shared current across two adjacent electrodes. Balancing was performed at threshold and comfortable level, for two spatial references (apical and basal) and for dual-channels with different relative current ratios. Increasing distance between dual-channels decreased the amount of current compensation in the dual-channel required to reach equal loudness to a single channel component by an average of 0.24 dB / mm without a significant difference between threshold and most comfortable level. If the components of the dual-channels were not at equal loudness, the loudness summation was reduced with respect to the equal loudness case. The results were incorporated into an existing loudness model by McKay et al. (2003). The predictions from the adapted model were evaluated by comparing the loudness evoked by simultaneous and sequential sound coding strategies. The application of the adapted model resulted in a deviation between predicted and actual behavioral loudness balancing adjustments in electrical level between simultaneous and sequential processing strategies of 0.24 dB on average.

The effect of a coding strategy that removes temporally masked pulses on speech perception by cochlear implant users

Speech recognition in noisy environments remains a challenge for cochlear implant (CI) recipients. Unwanted charge interactions between current pulses, both within and between electrode channels, are likely to impair performance. Here we investigate the effect of reducing the number of current pulses on speech perception. This was achieved by implementing a psychoacoustic temporal-masking model where current pulses in each channel were passed through a temporal integrator to identify and remove pulses that were less likely to be perceived by the recipient. The decision criterion of the temporal integrator was varied to control the percentage of pulses removed in each condition. In experiment 1, speech in quiet was processed with a standard Continuous Interleaved Sampling (CIS) strategy and with 25, 50 and 75% of pulses removed. In experiment 2, performance was measured for speech in noise with the CIS reference and with 50 and 75% of pulses removed. Speech intelligibility in quiet revealed no significant difference between reference and test conditions. For speech in noise, results showed a significant improvement of 2.4 dB when removing 50% of pulses and performance was not significantly different between the reference and when 75% of pulses were removed. Further, by reducing the overall amount of current pulses by 25, 50, and 75% but accounting for the increase in charge necessary to compensate for the decrease in loudness, estimated average power savings of 21.15, 40.95, and 63.45%, respectively, could be possible for this set of listeners. In conclusion, removing temporally masked pulses may improve speech perception in noise and result in substantial power savings.

Independent component analysis for cochlear implant artifacts attenuation from electrically evoked auditory steady-state response measurements

OBJECTIVE

Electrically evoked auditory steady-state responses (EASSRs) are potentially useful for objective cochlear implant (CI) fitting and follow-up of the auditory maturation in infants and children with a CI. EASSRs are recorded in the electro-encephalogram (EEG) in response to electrical stimulation with continuous pulse trains, and are distorted by significant CI artifacts related to this electrical stimulation. The aim of this study is to evaluate a CI artifacts attenuation method based on independent component analysis (ICA) for three EASSR datasets.

APPROACH

ICA has often been used to remove CI artifacts from the EEG to record transient auditory responses, such as cortical evoked auditory potentials. Independent components (ICs) corresponding to CI artifacts are then often manually identified. In this study, an ICA based CI artifacts attenuation method was developed and evaluated for EASSR measurements with varying CI artifacts and EASSR characteristics. Artifactual ICs were automatically identified based on their spectrum.

MAIN RESULTS

For 40 Hz amplitude modulation (AM) stimulation at comfort level, in high SNR recordings, ICA succeeded in removing CI artifacts from all recording channels, without distorting the EASSR. For lower SNR recordings, with 40 Hz AM stimulation at lower levels, or 90 Hz AM stimulation, ICA either distorted the EASSR or could not remove all CI artifacts in most subjects, except for two of the seven subjects tested with low level 40 Hz AM stimulation. Noise levels were reduced after ICA was applied, and up to 29 ICs were rejected, suggesting poor ICA separation quality.

SIGNIFICANCE

We hypothesize that ICA is capable of separating CI artifacts and EASSR in case the contralateral hemisphere is EASSR dominated. For small EASSRs or large CI artifact amplitudes, ICA separation quality is insufficient to ensure complete CI artifacts attenuation without EASSR distortion.

Encoding speech in cochlear implants using simultaneous amplitude and rate modulation

To improve speech perception for cochlear implant (CI) users, it is essential to improve the transmission of temporal envelopes. The most common speech processors deliver temporal envelopes via the CI using fixed-rate amplitude modulated (AM) pulse trains. Psychophysical studies suggest that rate modulation (RM) and AM are perceived by a shared temporal integration mechanism, but the potential for them to constructively combine to encode temporal envelopes has yet to be explored. In this experiment, a speech processing strategy called amplitude and rate temporal modulation was developed to encode speech temporal envelopes with simultaneous AM and RM. The strategy was tested for perception of clean speech at 60 and 40 dBA, and 60 dBA speech in noise (+10 dB SNR). The amount of RM was varied and the amount of AM was held constant to determine whether the addition of RM could enhance the perception of temporal envelopes and improve speech understanding. At the lowest RM amount, speech scores were poorest for all speech conditions. For 60 dBA clean speech and speech in noise, speech scores were significantly better at the highest RM amounts, suggesting that RM combined with AM can be used to enhance perception of temporal envelopes.

Intensity Discrimination and Speech Recognition of Cochlear Implant Users

The relation between speech recognition and within-channel or across-channel (i.e., spectral tilt) intensity discrimination was measured in nine CI users (11 ears). Within-channel intensity difference limens (IDLs) were measured at four electrode locations across the electrode array. Spectral tilt difference limens were measured with (XIDL-J) and without (XIDL) level jitter. Only three subjects could perform the XIDL-J task with the amount of jitter required to limit use of within-channel cues. XIDLs (normalized to %DR) were correlated with speech recognition (r = 0.67, P = 0.019) and were highly correlated with IDLs. XIDLs were on average nearly 3 times larger than IDLs and did not vary consistently with the spatial separation of the two component electrodes. The overall pattern of results was consistent with a common underlying subject-dependent limitation in the two difference limen tasks, hypothesized to be perceptual variance (how the perception of a sound differs on different presentations), which may also underlie the correlation of XIDLs with speech recognition. Evidence that spectral tilt discrimination is more important for speech recognition than within-channel intensity discrimination was not unequivocally shown in this study. However, the results tended to support this proposition, with XIDLs more correlated with speech performance than IDLs, and the ratio XIDL/IDL also being correlated with speech recognition. If supported by further research, the importance of perceptual variance as a limiting factor in speech understanding for CI users has important implications for efforts to improve outcomes for those with poor speech recognition.

Electric-acoustic forward masking in cochlear implant users with ipsilateral residual hearing

In order to investigate the temporal mechanisms of the auditory system, psychophysical forward masking experiments were conducted in cochlear implant users who had preserved acoustic hearing in the ipsilateral ear. This unique electric-acoustic stimulation (EAS) population allowed the measurement of threshold recovery functions for acoustic or electric probes in the presence of electric or acoustic maskers, respectively. In the electric masking experiment, the forward masked threshold elevation of acoustic probes was measured as a function of the time interval after the offset of the electric masker, i.e. the masker-to-probe interval (MPI). In the acoustic masking experiment, the forward masked threshold elevation of electric probe stimuli was investigated under the influence of a preceding acoustic masker. Since electric pulse trains directly stimulate the auditory nerve, this novel experimental setup allowed the acoustic adaptation properties (attributed to the physiology of the hair cells) to be differentiated from the subsequent processing by more central mechanisms along the auditory pathway. For instance, forward electric masking patterns should result more from the auditory-nerve response to electrical stimulation, while forward acoustic masking patterns should primarily be the result of the recovery from adaptation at the hair-cell neuron interface. Electric masking showed prolonged threshold elevation of acoustic probes, which depended significantly on the masker-to-probe interval. Additionally, threshold elevation was significantly dependent on the similarity between acoustic stimulus frequency and electric place frequency, the electric-acoustic frequency difference (EAFD). Acoustic masking showed a reduced, but statistically significant effect of electric threshold elevation, which did not significantly depend on MPI. Lastly, acoustic masking showed longer decay times than electric masking and a reduced dependency on EAFD. In conclusion, the forward masking patterns observed for combined electric-acoustic stimulation provide further insights into the temporal mechanisms of the auditory system. For instance, the asymmetry in the amount of threshold elevation, the dependency on EAFD and the time constants for the recovery functions of acoustic and electric masking all indicate that there must be several processes with different latencies (e.g. neural adaptation, depression of spontaneous activity, efferent systems) that are involved in forward masking recovery functions.

Effect of Pulse Rate on Loudness Discrimination in Cochlear Implant Users

Stimulation pulse rate affects current amplitude discrimination by cochlear implant (CI) users, indicated by the evidence that the JND (just noticeable difference) in current amplitude delivered by a CI electrode becomes larger at higher pulse rates. However, it is not clearly understood whether pulse rate would affect discrimination of speech intensities presented acoustically to CI processors, or what the size of this effect might be. Intensity discrimination depends on two factors: the growth of loudness with increasing sound intensity and the loudness JND (or the just noticeable loudness increment). This study evaluated the hypothesis that stimulation pulse rate affects loudness JND. This was done by measuring current amplitude JNDs in an experiment design based on signal detection theory according to which loudness discrimination is related to internal noise (which is manifested by variability in loudness percept in response to repetitions of the same physical stimulus). Current amplitude JNDs were measured for equally loud pulse trains of 500 and 3000 pps (pulses per second) by increasing the current amplitude of the target pulse train until it was perceived just louder than a same-rate or different-rate reference pulse train. The JND measures were obtained at two presentation levels. At the louder level, the current amplitude JNDs were affected by the rate of the reference pulse train in a way that was consistent with greater noise or variability in loudness perception for the higher pulse rate. The results suggest that increasing pulse rate from 500 to 3000 pps can increase loudness JND by 60 % at the upper portion of the dynamic range. This is equivalent to a 38 % reduction in the number of discriminable steps for acoustic and speech intensities.

Rate modulation detection thresholds for cochlear implant users

The perception of temporal amplitude modulations is critical for speech understanding by cochlear implant (CI) users. The present study compared the ability of CI users to detect sinusoidal modulations of the electrical stimulation rate and current level, at different presentation levels (80% and 40% of the dynamic range) and modulation frequencies (10 and 100 Hz). Rate modulation detection thresholds (RMDTs) and amplitude modulation detection thresholds (AMDTs) were measured and compared to assess whether there was a perceptual advantage to either modulation method. Both RMDTs and AMDTs improved with increasing presentation level and decreasing modulation frequency. RMDTs and AMDTs were correlated, indicating that a common processing mechanism may underlie the perception of rate modulation and amplitude modulation, or that some subject-dependent factors affect both types of modulation detection.

Forward Masking in Cochlear Implant Users: Electrophysiological and Psychophysical Data Using Pulse Train Maskers

Electrical stimulation of auditory nerve fibers using cochlear implants (CI) shows psychophysical forward masking (pFM) up to several hundreds of milliseconds. By contrast, recovery of electrically evoked compound action potentials (eCAPs) from forward masking (eFM) was shown to be more rapid, with time constants no greater than a few milliseconds. These discrepancies suggested two main contributors to pFM: a rapid-recovery process due to refractory properties of the auditory nerve and a slow-recovery process arising from more central structures. In the present study, we investigate whether the use of different maskers between eCAP and psychophysical measures, specifically single-pulse versus pulse train maskers, may have been a source of confound.In experiment 1, we measured eFM using the following: a single-pulse masker, a 300-ms low-rate pulse train masker (LTM, 250 pps), and a 300-ms high-rate pulse train masker (HTM, 5000 pps). The maskers were presented either at same physical current (Φ) or at same perceptual (Ψ) level corresponding to comfortable loudness. Responses to a single-pulse probe were measured for masker-probe intervals ranging from 1 to 512 ms. Recovery from masking was much slower for pulse trains than for the single-pulse masker. When presented at Φ level, HTM produced more and longer-lasting masking than LTM. However, results were inconsistent when LTM and HTM were compared at Ψ level. In experiment 2, masked detection thresholds of single-pulse probes were measured using the same pulse train masker conditions. In line with our eFM findings, masked thresholds for HTM were higher than those for LTM at Φ level. However, the opposite result was found when the pulse trains were presented at Ψ level.Our results confirm the presence of slow-recovery phenomena at the level of the auditory nerve in CI users, as previously shown in animal studies. Inconsistencies between eFM and pFM results, despite using the same masking conditions, further underline the importance of comparing electrophysiological and psychophysical measures with identical stimulation paradigms.

Auditory and audio-visual processing in patients with cochlear, auditory brainstem, and auditory midbrain implants: An EEG study

There is substantial variability in speech recognition ability across patients with cochlear implants (CIs), auditory brainstem implants (ABIs), and auditory midbrain implants (AMIs). To better understand how this variability is related to central processing differences, the current electroencephalography (EEG) study compared hearing abilities and auditory-cortex activation in patients with electrical stimulation at different sites of the auditory pathway. Three different groups of patients with auditory implants (Hannover Medical School; ABI: n = 6, CI: n = 6; AMI: n = 2) performed a speeded response task and a speech recognition test with auditory, visual, and audio-visual stimuli. Behavioral performance and cortical processing of auditory and audio-visual stimuli were compared between groups. ABI and AMI patients showed prolonged response times on auditory and audio-visual stimuli compared with NH listeners and CI patients. This was confirmed by prolonged N1 latencies and reduced N1 amplitudes in ABI and AMI patients. However, patients with central auditory implants showed a remarkable gain in performance when visual and auditory input was combined, in both speech and non-speech conditions, which was reflected by a strong visual modulation of auditory-cortex activation in these individuals. In sum, the results suggest that the behavioral improvement for audio-visual conditions in central auditory implant patients is based on enhanced audio-visual interactions in the auditory cortex. Their findings may provide important implications for the optimization of electrical stimulation and rehabilitation strategies in patients with central auditory prostheses. Hum Brain Mapp 38:2206-2225, 2017. © 2017 Wiley Periodicals, Inc.

Electrode Selection and Speech Understanding in Patients With Auditory Brainstem Implants

OBJECTIVES

The objective of this study was to evaluate whether speech understanding in auditory brainstem implant (ABI) users who have a tumor pathology could be improved by the selection of a subset of electrodes that were appropriately pitch ranked and distinguishable. It was hypothesized that disordered pitch or spectral percepts and channel interactions may contribute significantly to the poor outcomes in most ABI users.

DESIGN

A single-subject design was used with five participants. Pitch ranking information for all electrodes in the patients' clinic maps was obtained using a pitch ranking task and previous pitch ranking information from clinic sessions. A multidimensional scaling task was used to evaluate the stimulus space evoked by stimuli on the same set of electrodes. From this information, a subset of four to six electrodes was chosen and a new map was created, using just this subset, that the subjects took home for 1 month's experience. Closed-set consonant and vowel perception and sentences in quiet were tested at three sessions: with the clinic map before the test map was given, after 1 month with the test map, and after an additional 2 weeks with their clinic map.

RESULTS

The results of the pitch ranking and multidimensional scaling procedures confirmed that the ABI users did not have a well-ordered set of percepts related to electrode position, thus supporting the proposal that difficulty in processing of spectral information may contribute to poor speech understanding. However, none of the subjects benefited from a map that reduced the stimulation electrode set to a smaller number of electrodes that were well ordered in place pitch.

CONCLUSIONS

Although poor spectral processing may contribute to poor understanding in ABI users, it is not likely to be the sole contributor to poor outcomes.

Effect of Pulse Rate and Polarity on the Sensitivity of Auditory Brainstem and Cochlear Implant Users to Electrical Stimulation

To further understand the response of the human brainstem to electrical stimulation, a series of experiments compared the effect of pulse rate and polarity on detection thresholds between auditory brainstem implant (ABI) and cochlear implant (CI) patients. Experiment 1 showed that for 400-ms pulse trains, ABI users’ thresholds dropped by about 2 dB as pulse rate was increased from 71 to 500 pps, but only by an average of 0.6 dB as rate was increased further to 3500 pps. This latter decrease was much smaller than the 7.7-dB observed for CI users. A similar result was obtained for pulse trains with a 40-ms duration. Furthermore, experiment 2 showed that the threshold difference between 500- and 3500-pps pulse trains remained much smaller for ABI than for CI users, even for durations as short as 2 ms, indicating the effect of a fast-acting mechanism. Experiment 3 showed that ABI users’ thresholds were lower for alternating-polarity than for fixed-polarity pulse trains, and that this difference was greater at 3500 pps than at 500 pps, consistent with the effect of pulse rate on ABI users’ thresholds being influenced by charge interactions between successive biphasic pulses. Experiment 4 compared thresholds and loudness between trains of asymmetric pulses of opposite polarity, in monopolar mode, and showed that in both cases less current was needed when the anodic, rather than the cathodic, current was concentrated into a short time interval. This finding is similar to that previously observed for CI users and is consistent with ABI users being more sensitive to anodic than cathodic current. We argue that our results constrain potential explanations for the differences in the perception of electrical stimulation by CI and ABI users, and have potential implications for future ABI stimulation strategies.

Integration of Pulse Trains in Humans and Guinea Pigs with Cochlear Implants

Temporal integration (TI; threshold versus stimulus duration) functions and multipulse integration (MPI; threshold versus pulse rate) functions were measured behaviorally in guinea pigs and humans with cochlear implants. Thresholds decreased with stimulus duration at a fixed pulse rate and with pulse rate at a fixed stimulus duration. The rates of threshold decrease (slopes) of the TI and MPI functions were not statistically different between the guinea pig and human subject groups. A characteristic of the integration functions that the two groups shared was that the slopes of the TI functions were similar in magnitude to slopes of the MPI function only at low pulse rates (< approximately 300 pulses per second). This is consistent with the notion that the TI functions and the MPI functions at the low rates are mediated by a mechanism of long-term integration described in the statistical "multiple looks" model. Histological analysis of the guinea pig cochleae suggested that the slopes of both the MPI and the TI functions were dependent on sensory and neural health near the stimulated regions. The strongest predictor for spiral ganglion cell densities measured near the stimulation sites was the slope of the MPI functions below 1,000 pps. Several mechanisms may be considered to account for the association of shallow integration functions with poor sensory and neural status. These mechanisms are related to abnormal across-fiber synchronization, increased refractoriness and adaptation with impaired neural function, and steep growth of neural excitation with current level associated with neural pathology. The slope of the integration functions can potentially be used as a non-invasive measure for identifying stimulation sites with poor neural health and selecting those sites for removal or rehabilitation, but these applications remain to be tested.

Importance of cochlear health for implant function

Amazing progress has been made in providing useful hearing to hearing-impaired individuals using cochlear implants, but challenges remain. One such challenge is understanding the effects of partial degeneration of the auditory nerve, the target of cochlear implant stimulation. Here we review studies from our human and animal laboratories aimed at characterizing the health of the implanted cochlea and the auditory nerve. We use the data on cochlear and neural health to guide rehabilitation strategies. The data also motivate the development of tissue-engineering procedures to preserve or build a healthy cochlea and improve performance obtained by cochlear implant recipients or eventually replace the need for a cochlear implant. This article is part of a Special Issue entitled .

Auditory midbrain implant: research and development towards a second clinical trial

The cochlear implant is considered one of the most successful neural prostheses to date, which was made possible by visionaries who continued to develop the cochlear implant through multiple technological and clinical challenges. However, patients without a functional auditory nerve or implantable cochlea cannot benefit from a cochlear implant. The focus of the paper is to review the development and translation of a new type of central auditory prosthesis for this group of patients that is known as the auditory midbrain implant (AMI) and is designed for electrical stimulation within the inferior colliculus. The rationale and results for the first AMI clinical study using a multi-site single-shank array will be presented initially. Although the AMI has achieved encouraging results in terms of safety and improvements in lip-reading capabilities and environmental awareness, it has not yet provided sufficient speech perception. Animal and human data will then be presented to show that a two-shank AMI array can potentially improve hearing performance by targeting specific neurons of the inferior colliculus. A new two-shank array, stimulation strategy, and surgical approach are planned for the AMI that are expected to improve hearing performance in the patients who will be implanted in an upcoming clinical trial funded by the National Institutes of Health. Positive outcomes from this clinical trial will motivate new efforts and developments toward improving central auditory prostheses for those who cannot sufficiently benefit from cochlear implants. This article is part of a Special Issue entitled <Lasker Award>.

Relationship between multipulse integration and speech recognition with cochlear implants

Comparisons of performance with cochlear implants and postmortem conditions in the cochlea in humans have shown mixed results. The limitations in those studies favor the use of within-subject designs and non-invasive measures to estimate cochlear conditions. One non-invasive correlate of cochlear health is multipulse integration, established in an animal model. The present study used this measure to relate neural health in human cochlear implant users to their speech recognition performance. The multipulse-integration slopes were derived based on psychophysical detection thresholds measured for two pulse rates (80 and 640 pulses per second). A within-subject design was used in eight subjects with bilateral implants where the direction and magnitude of ear differences in the multipulse-integration slopes were compared with those of the speech-recognition results. The speech measures included speech reception threshold for sentences and phoneme recognition in noise. The magnitude of ear difference in the integration slopes was significantly correlated with the magnitude of ear difference in speech reception thresholds, consonant recognition in noise, and transmission of place of articulation of consonants. These results suggest that multipulse integration predicts speech recognition in noise and perception of features that use dynamic spectral cues.

Effects of location and timing of co-activated neurons in the auditory midbrain on cortical activity: implications for a new central auditory prosthesis

OBJECTIVE

An increasing number of deaf individuals are being implanted with central auditory prostheses, but their performance has generally been poorer than for cochlear implant users. The goal of this study is to investigate stimulation strategies for improving hearing performance with a new auditory midbrain implant (AMI). Previous studies have shown that repeated electrical stimulation of a single site in each isofrequency lamina of the central nucleus of the inferior colliculus (ICC) causes strong suppressive effects in elicited responses within the primary auditory cortex (A1). Here we investigate if improved cortical activity can be achieved by co-activating neurons with different timing and locations across an ICC lamina and if this cortical activity varies across A1.

APPROACH

We electrically stimulated two sites at different locations across an isofrequency ICC lamina using varying delays in ketamine-anesthetized guinea pigs. We recorded and analyzed spike activity and local field potentials across different layers and locations of A1.

RESULTS

Co-activating two sites within an isofrequency lamina with short inter-pulse intervals (<5 ms) could elicit cortical activity that is enhanced beyond a linear summation of activity elicited by the individual sites. A significantly greater extent of normalized cortical activity was observed for stimulation of the rostral-lateral region of an ICC lamina compared to the caudal-medial region. We did not identify any location trends across A1, but the most cortical enhancement was observed in supragranular layers, suggesting further integration of the stimuli through the cortical layers.

SIGNIFICANCE

The topographic organization identified by this study provides further evidence for the presence of functional zones across an ICC lamina with locations consistent with those identified by previous studies. Clinically, these results suggest that co-activating different neural populations in the rostral-lateral ICC rather than the caudal-medial ICC using the AMI may improve or elicit different types of hearing capabilities.

Loudness of time-varying stimuli with electric stimulation

McKay, Henshall, Farrell, and McDermott [J. Acoust. Soc. Am. 113, 2054-2063 (2003)] developed a practical method to estimate the loudness of periodic electrical signals presented through a cochlear implant. In the present work, this method was extended to time-varying sounds based on two models of time-varying loudness for normal listeners. To fit the model parameters, loudness balancing data was collected with six cochlear implant listeners. The pulse rate of a modulated pulse train was adjusted to equalize its loudness to a reference stimulus. The stimuli were single-electrode time-limited pulse bursts, repeated at a rate of 50 Hz, with on-times varying between 2 and 20 ms. The parameters of two different models of time-varying loudness were fitted to the results. For each model, parameters defining the time windows over which the electrical pulses contribute to instantaneous loudness were optimized. In each case, a good fit was obtained with the loudness balancing results. Therefore, the practical method was successfully extended to time-varying sounds by combining it with existing models of time-varying loudness for acoustic stimulation.

Investigation of a new electrode array technology for a central auditory prosthesis

Ongoing clinical studies on patients recently implanted with the auditory midbrain implant (AMI) into the inferior colliculus (IC) for hearing restoration have shown that these patients do not achieve performance levels comparable to cochlear implant patients. The AMI consists of a single-shank array (20 electrodes) for stimulation along the tonotopic axis of the IC. Recent findings suggest that one major limitation in AMI performance is the inability to sufficiently activate neurons across the three-dimensional (3-D) IC. Unfortunately, there are no currently available 3-D array technologies that can be used for clinical applications. More recently, there has been a new initiative by the European Commission to fund and develop 3-D chronic electrode arrays for science and clinical applications through the NeuroProbes project that can overcome the bulkiness and limited 3-D configurations of currently available array technologies. As part of the NeuroProbes initiative, we investigated whether their new array technology could be potentially used for future AMI patients. Since the NeuroProbes technology had not yet been tested for electrical stimulation in an in vivo animal preparation, we performed experiments in ketamine-anesthetized guinea pigs in which we inserted and stimulated a NeuroProbes array within the IC and recorded the corresponding neural activation within the auditory cortex. We used 2-D arrays for this initial feasibility study since they were already available and were sufficient to access the IC and also demonstrate effective activation of the central auditory system. Based on these encouraging results and the ability to develop customized 3-D arrays with the NeuroProbes technology, we can further investigate different stimulation patterns across the ICC to improve AMI performance.

Neural representation in the auditory midbrain of the envelope of vocalizations based on a peripheral ear model

The auditory midbrain implant (AMI) consists of a single shank array (20 sites) for stimulation along the tonotopic axis of the central nucleus of the inferior colliculus (ICC) and has been safely implanted in deaf patients who cannot benefit from a cochlear implant (CI). The AMI improves lip-reading abilities and environmental awareness in the implanted patients. However, the AMI cannot achieve the high levels of speech perception possible with the CI. It appears the AMI can transmit sufficient spectral cues but with limited temporal cues required for speech understanding. Currently, the AMI uses a CI-based strategy, which was originally designed to stimulate each frequency region along the cochlea with amplitude-modulated pulse trains matching the envelope of the bandpass-filtered sound components. However, it is unclear if this type of stimulation with only a single site within each frequency lamina of the ICC can elicit sufficient temporal cues for speech perception. At least speech understanding in quiet is still possible with envelope cues as low as 50 Hz. Therefore, we investigated how ICC neurons follow the bandpass-filtered envelope structure of natural stimuli in ketamine-anesthetized guinea pigs. We identified a subset of ICC neurons that could closely follow the envelope structure (up to ß100 Hz) of a diverse set of species-specific calls, which was revealed by using a peripheral ear model to estimate the true bandpass-filtered envelopes observed by the brain. Although previous studies have suggested a complex neural transformation from the auditory nerve to the ICC, our data suggest that the brain maintains a robust temporal code in a subset of ICC neurons matching the envelope structure of natural stimuli. Clinically, these findings suggest that a CI-based strategy may still be effective for the AMI if the appropriate neurons are entrained to the envelope of the acoustic stimulus and can transmit sufficient temporal cues to higher centers.

Place specificity measured in forward and interleaved masking in cochlear implants

Interleaved masking in cochlear implants is analogous to acoustic simultaneous masking and is relevant to speech processing strategies that interleave pulses on concurrently activated electrodes. In this study, spatial decay of masking as the distance between masker and probe increases was compared between forward and interleaved masking in the same group of cochlear implant users. Spatial masking patterns and the measures of place specificity were similar between forward and interleaved masking. Unlike acoustic hearing where broader tuning curves are obtained in simultaneous masking, the type of masking experiment did not influence the measure of place specificity in cochlear implants.

Can ECAP measures be used for totally objective programming of cochlear implants?

An experiment was conducted with eight cochlear implant subjects to investigate the feasibility of using electrically evoked compound action potential (ECAP) measures other than ECAP thresholds to predict the way that behavioral thresholds change with rate of stimulation, and hence, whether they can be used without combination with behavioral measures to determine program stimulus levels for cochlear implants. Loudness models indicate that two peripheral neural response characteristics contribute to the slope of the threshold versus rate function: the way that neural activity to each stimulus pulse decreases as rate increases and the slope of the neural response versus stimulus current function. ECAP measures related to these two characteristics were measured: the way that ECAP amplitude decreases with stimulus rate and the ECAP amplitude growth function, respectively. A loudness model (incorporating temporal integration and the two neural response characteristics) and regression analyses were used to evaluate whether the ECAP measures could predict the average slope of the behavioral threshold versus current function and whether individual variation in the measures could predict individual variation in the slope of the threshold function. The average change of behavioral threshold with increasing rate was well predicted by the model when using the average ECAP data. However, the individual variations in the slope of the thresholds versus rate functions were not well predicted by individual variations in ECAP data. It was concluded that these ECAP measures are not useful for fully objective programming, possibly because they do not accurately reflect the neural response characteristics assumed by the model, or are measured at current levels much higher than threshold currents.

Neural integration and enhancement from the inferior colliculus up to different layers of auditory cortex

While the cochlear implant has successfully restored hearing to many deaf patients, it cannot benefit those without a functional auditory nerve or an implantable cochlea. As an alternative, the auditory midbrain implant (AMI) has been developed and implanted into deaf patients. Consisting of a single-shank array, the AMI is designed for stimulation along the tonotopic gradient of the inferior colliculus (ICC). Although the AMI can provide frequency cues, it appears to insufficiently transmit temporal cues for speech understanding because repeated stimulation of a single site causes strong suppressive and refractory effects. Applying the electrical stimulation to at least two sites within an isofrequency lamina can circumvent these refractory processes. Moreover, coactivation with short intersite delays (<5 ms) can elicit cortical activation which is enhanced beyond the summation of activity induced by the individual sites. The goal of our study was to further investigate the role of the auditory cortex in this enhancement effect. In guinea pigs, we electrically stimulated two locations within an ICC lamina or along different laminae with varying interpulse intervals (0-10 ms) and recorded activity in different locations and layers of primary auditory cortex (A1). Our findings reveal a neural mechanism that integrates activity only from neurons located within the same ICC lamina for short spiking intervals (<6 ms). This mechanism leads to enhanced activity into layers III-V of A1 that is further magnified in supragranular layers. This integration mechanism may contribute to perceptual coding of different sound features that are relevant for improving AMI performance.