Auditory steady-state responses in cochlear implant users: Effect of modulation frequency and stimulation artifacts

Psychoacoustic and electroencephalographic responses to changes in amplitude modulation depth and frequency in relation to speech recognition in cochlear implantees

Temporal envelope modulations (TEMs) are one of the most important features that cochlear implant (CI) users rely on to understand speech. Electroencephalographic assessment of TEM encoding could help clinicians to predict speech recognition more objectively, even in patients unable to provide active feedback. The acoustic change complex (ACC) and the auditory steady-state response (ASSR) evoked by low-frequency amplitude-modulated pulse trains can be used to assess TEM encoding with electrical stimulation of individual CI electrodes. In this study, we focused on amplitude modulation detection (AMD) and amplitude modulation frequency discrimination (AMFD) with stimulation of a basal versus an apical electrode. In twelve adult CI users, we (a) assessed behavioral AMFD thresholds and (b) recorded cortical auditory evoked potentials (CAEPs), AMD-ACC, AMFD-ACC, and ASSR in a combined 3-stimulus paradigm. We found that the electrophysiological responses were significantly higher for apical than for basal stimulation. Peak amplitudes of AMFD-ACC were small and (therefore) did not correlate with speech-in-noise recognition. We found significant correlations between speech-in-noise recognition and (a) behavioral AMFD thresholds and (b) AMD-ACC peak amplitudes. AMD and AMFD hold potential to develop a clinically applicable tool for assessing TEM encoding to predict speech recognition in CI users.

Artifact removal by template subtraction enables recordings of the frequency following response in cochlear-implant users

Electrically evoked frequency-following responses (eFFRs) provide insight in the phase-locking ability of brainstem of cochlear-implant (CI) users. eFFRs can potentially be used to gain insight in the individual differences in the biological limitation on temporal encoding of the electrically stimulated auditory pathway, which can be inherent to the electrical stimulation itself and/or the degenerative processes associated with hearing loss. One of the major challenge of measuring eFFRs in CI users is the process of isolating the stimulation artifact from the neural response, as both the response and the artifact overlap in time and have similar frequency characteristics. Here we introduce a new artifact removal method based on template subtraction that successfully removes the stimulation artifacts from the recordings when CI users are stimulated with pulse trains from 128 to 300 pulses per second in a monopolar configuration. Our results show that, although artifact removal was successful in all CI users, the phase-locking ability of the brainstem to the different pulse rates, as assessed with the eFFR differed substantially across participants. These results show that the eFFR can be measured, free from artifacts, in CI users and that they can be used to gain insight in individual differences in temporal processing of the electrically stimulated auditory pathway.

Effects of analysis window on 40-Hz auditory steady-state responses in cochlear implant users

Auditory steady-state responses (ASSRs) are phase-locked responses of the auditory system to the envelope of a stimulus. These responses can be used as an objective proxy to assess temporal envelope processing and its related functional outcomes such as hearing thresholds and speech perception, in normal-hearing listeners, in persons with hearing impairment, as well as in cochlear-implant (CI) users. While ASSRs are traditionally measured using a continuous stimulation paradigm, an alternative is the intermittent stimulation paradigm, whereby stimuli are presented with silence intervals in between. This paradigm could be more useful in a clinical setting as it allows for other neural responses to be analysed concurrently. One clinical use case of the intermittent paradigm is to objectively program CIs during an automatic fitting session whereby electrically evoked ASSRs (eASSRs) as well as other evoked potentials are used to predict behavioural thresholds. However, there is no consensus yet about the optimal analysis parameters for an intermittent paradigm in order to detect and measure eASSRs reliably. In this study, we used the intermittent paradigm to evoke eASSRs in adult CI users and investigated whether the early response buildup affects the response measurement outcomes. To this end, we varied the starting timepoint and length of the analysis window within which the responses were analysed. We used the amplitude, signal-to-noise ratio (SNR), phase, and pairwise phase consistency (PPC) to characterize the responses. Moreover, we set out to find the optimal stimulus duration for efficient and reliable eASSR measurements. These analyses were performed at two stimulation levels, i.e., 100% and 50% of the dynamic range of each participant. Results revealed that inclusion of the first 300 ms in the analysis window leads to overestimation of response amplitude and underestimation of response phase. Additionally, the response SNR and PPC were not affected by the inclusion of the first 300 ms in the analysis window. However, the latter two metrics were highly dependent on the stimulus duration which complicates comparisons across studies. Finally, the optimal stimulus duration for quick and reliable characterization of eASSRs was found to be around 800 ms for the stimulation level of 100% DR. These findings suggest that inclusion of the early onset period of eASSR recordings negatively influences the response measurement outcomes and that efficient and reliable eASSR measurements are possible using stimuli of around 800 ms long. This will pave the path for the development of a clinically feasible eASSR measurement in CI users.

Objective discrimination of bimodal speech using frequency following responses

Bimodal hearing, in which a contralateral hearing aid is combined with a cochlear implant (CI), provides greater speech recognition benefits than using a CI alone. Factors predicting individual bimodal patient success are not fully understood. Previous studies have shown that bimodal benefits may be driven by a patient's ability to extract fundamental frequency (f0) and/or temporal fine structure cues (e.g., F1). Both of these features may be represented in frequency following responses (FFR) to bimodal speech. Thus, the goals of this study were to: 1) parametrically examine neural encoding of f0 and F1 in simulated bimodal speech conditions; 2) examine objective discrimination of FFRs to bimodal speech conditions using machine learning; 3) explore whether FFRs are predictive of perceptual bimodal benefit. Three vowels (/ε/, /i/, and /ʊ/) with identical f0 were manipulated by a vocoder (right ear) and low-pass filters (left ear) to create five bimodal simulations for evoking FFRs: Vocoder-only, Vocoder +125 Hz, Vocoder +250 Hz, Vocoder +500 Hz, and Vocoder +750 Hz. Perceptual performance on the BKB-SIN test was also measured using the same five configurations. Results suggested that neural representation of f0 and F1 FFR components were enhanced with increasing acoustic bandwidth in the simulated "non-implanted" ear. As spectral differences between vowels emerged in the FFRs with increased acoustic bandwidth, FFRs were more accurately classified and discriminated using a machine learning algorithm. Enhancement of f0 and F1 neural encoding with increasing bandwidth were collectively predictive of perceptual bimodal benefit on a speech-in-noise task. Given these results, FFR may be a useful tool to objectively assess individual variability in bimodal hearing.

Using Interleaved Stimulation and EEG to Measure Temporal Smoothing and Growth of the Sustained Neural Response to Cochlear-Implant Stimulation

Two EEG experiments measured the sustained neural response to amplitude-modulated (AM) high-rate pulse trains presented to a single cochlear-implant (CI) electrode. Stimuli consisted of two interleaved pulse trains with AM rates F1 and F2 close to 80 and 120 Hz respectively, and where F2 = 1.5F1. Following Carlyon et al. (J Assoc Res Otolaryngol, 2021), we assume that such stimuli can produce a neural distortion response (NDR) at F0 = F2-F1 Hz if temporal dependencies ("smoothing") in the auditory system are followed by one or more neural nonlinearities. In experiment 1, the rate of each pulse train was 480 pps and the gap between pulses in the F1 and F2 pulse trains ranged from 0 to 984 µs. The NDR had a roughly constant amplitude for gaps between 0 and about 200-400 µs, and decreased for longer gaps. We argue that this result is consistent with a temporal dependency, such as facilitation, operating at the level of the auditory nerve and/or with co-incidence detection by cochlear-nucleus neurons. Experiment 2 first measured the NDR for stimuli at each listener's most comfortable level ("MCL") and for F0 = 37, 40, and 43 Hz. This revealed a group delay of about 42 ms, consistent with a thalamic/cortical source. We then showed that the NDR grew steeply with stimulus amplitude and, for most listeners, decreased by more than 12 dB between MCL and 75% of the listener's dynamic range. We argue that the NDR is a potentially useful objective estimate of MCL.

Recording EEG in Cochlear Implant Users: Guidelines for Experimental Design and Data Analysis for Optimizing Signal Quality and Minimizing Artifacts

Cochlear implants (CI) are neural prostheses that can restore hearing in individuals with severe to profound hearing loss. Although CIs significantly improve quality of life, clinical outcomes are still highly variable. An important part of this variability is explained by the brain reorganization following cochlear implantation. Therefore, clinicians and researchers are seeking objective measurements to investigate post-implantation brain plasticity. Electroencephalography (EEG) is a promising technique because it is objective, non-invasive, and implant-compatible, but is nonetheless susceptible to massive artifacts generated by the prosthesis's electrical activity. CI artifacts can blur and distort brain responses; thus, it is crucial to develop reliable techniques to remove them from EEG recordings. Despite numerous artifact removal techniques used in previous studies, there is a paucity of documentation and consensus on the optimal EEG procedures to reduce these artifacts. Herein, and through a comprehensive review process, we provide a guideline for designing an EEG-CI experiment minimizing the effect of the artifact. We provide some technical guidance for recording an accurate neural response from CI users and discuss the current challenges in detecting and removing CI-induced artifacts from a recorded signal. The aim of this paper is also to provide recommendations to better appraise and report EEG-CI findings.

Predicting speech intelligibility from a selective attention decoding paradigm in cochlear implant users

OBJECTIVES

Electroencephalography (EEG) can be used to decode selective attention in cochlear implant (CI) users. This work investigates if selective attention to an attended speech source in the presence of a concurrent speech source can predict speech understanding in CI users.

APPROACH

CI users were instructed to attend to one out of two speech streams while EEG was recorded. Both speech streams were presented to the same ear and at different signal to interference ratios (SIRs). Speech envelope reconstruction of the to-be-attended speech from EEG was obtained by training decoders using regularized least squares. The correlation coefficient between the reconstructed and the attended (ρ_(A_SIR )) or the unattended (ρ_(U_SIR )) speech stream at each SIR was computed. Additionally, we computed the difference correlation coefficient at the same 〖(ρ〗_Diff= ρ_(A_SIR )-ρ_(U_SIR )) and opposite SIR (ρ_DiffOpp= ρ_(A_SIR )-ρ_(U_(-SIR) )). ρ_Diff compares the attended and unattended correlation coefficient to speech sources presented at different presentation levels depending on SIR. In contrast, ρ_DiffOpp compares the attended and unattended correlation coefficients to speech sources presented at the same presentation level irrespective of SIR.

MAIN RESULTS

Selective attention decoding in CI users is possible even if both speech streams are presented monaurally. A significant effect of SIR on ρ_(A_SIR ), ρ_Diff and ρ_DiffOpp, but not on ρ_(U_SIR ), was observed. Finally, the results show a significant correlation between speech understanding performance and ρ_(A_SIR ) as well as with ρ_(U_SIR ) across subjects. Moreover, ρ_DiffOpp which is less affected by the CI artifact, also demonstrated a significant correlation with speech understanding.

SIGNIFICANCE

Selective attention decoding in CI users is possible, however care needs to be taken with the CI artifact and the speech material used to train the decoders. These results are important for future development of objective speech understanding measures for CI users.

Nonlinearity in bone-conducted amplitude-modulated cervical vestibular evoked myogenic potentials: Harmonic distortion products

Otolith organs of the balance system, the saccule and utricle, encode linear acceleration. Integrity of the saccule is commonly assessed using cervical vestibular evoked myogenic potentials (cVEMPs) arising from an inhibitory reflex along the vestibulospinal pathway. Conventional approaches to eliciting these responses use brief, transient sounds to elicit onset responses. Here we used long-duration amplitude-modulated (AM) tones to elicit cVEMPs (AMcVEMPs) and analyzed their spectral content for evidence of nonlinear processing consistent with known characteristics of vestibular hair cells. Twelve young adults (ages 21-25) with no hearing or vestibular pathologies participated in this study. AMcVEMPs were elicited by bone-conducted AM tones with a 500 Hz carrier frequency. Eighteen modulation frequencies were used between 7 and 403 Hz. All participants had robust distortion products at harmonics of the modulation frequency. Total harmonic distortion ranged from approximately 10 to 80%. AMcVEMPs contain harmonic distortion products consistent with vestibular hair cell nonlinearities, and this new approach to studying the otolith organs may provide a non-invasive, in vivo method to study nonlinearity of vestibular hair cells in humans.

The beta component of gamma-band auditory steady-state responses in patients with schizophrenia

The mechanisms underlying circuit dysfunctions in schizophrenia (SCZ) remain poorly understood. Auditory steady-state responses (ASSRs), especially in the gamma and beta band, have been suggested as a potential biomarker for SCZ. While the reduction of 40 Hz power for 40 Hz drive has been well established and replicated in SCZ patients, studies are inconclusive when it comes to an increase in 20 Hz power during 40 Hz drive. There might be several factors explaining the inconsistencies, including differences in the sensitivity of the recording modality (EEG vs MEG), differences in stimuli (click-trains vs amplitude-modulated tones) and large differences in the amplitude of the stimuli. Here, we used a computational model of ASSR deficits in SCZ and explored the effect of three SCZ-associated microcircuit alterations: reduced GABA activity, increased GABA decay times and NMDA receptor hypofunction. We investigated the effect of input strength on gamma (40 Hz) and beta (20 Hz) band power during gamma ASSR stimulation and saw that the pronounced increase in beta power during gamma stimulation seen experimentally could only be reproduced in the model when GABA decay times were increased and only for a specific range of input strengths. More specifically, when the input was in this specific range, the rhythmic drive at 40 Hz produced a strong 40 Hz rhythm in the control network; however, in the 'SCZ-like' network, the prolonged inhibition led to a so-called 'beat-skipping', where the network would only strongly respond to every other input. This mechanism was responsible for the emergence of the pronounced 20 Hz beta peak in the power spectrum. The other two microcircuit alterations were not able to produce a substantial 20 Hz component but they further narrowed the input strength range for which the network produced a beta component when combined with increased GABAergic decay times. Our finding that the beta component only existed for a specific range of input strengths might explain the seemingly inconsistent reporting in experimental studies and suggests that future ASSR studies should systematically explore different amplitudes of their stimuli. Furthermore, we provide a mechanistic link between a microcircuit alteration and an electrophysiological marker in schizophrenia and argue that more complex ASSR stimuli are needed to disentangle the nonlinear interactions of microcircuit alterations. The computational modelling approach put forward here is ideally suited to facilitate the development of such stimuli in a theory-based fashion.

Neural Modulation Transmission Is a Marker for Speech Perception in Noise in Cochlear Implant Users

OBJECTIVES

Cochlear implants (CIs) restore functional hearing in persons with a severe hearing impairment. Despite being one of the most successful bionic prosthesis, performance with CI (in particular speech understanding in noise) varies considerably across its users. The ability of the auditory pathway to encode temporal envelope modulations (TEMs) and the effect of degenerative processes associated with hearing loss on TEM encoding is assumed to be one of the reasons underlying the large intersubject differences in CI performance. The objective of the present study was to investigate how TEM encoding of the stimulated neural ensembles of human CI recipients is related to speech perception in noise (SPIN).

DESIGN

We used electroencephalography as a noninvasive electrophysiological measure to assess TEM encoding in the auditory pathway of CI users by means of the 40-Hz electrically evoked auditory steady state response (EASSR). Nine CI users with a wide range of SPIN outcome were included in the present study. TEM encoding was assessed for each stimulation electrode of each subject and new metrics; the CI neural modulation transmission difference (CIMTD) and the CI neural modulation transmission index (CIMTI) were developed to quantify the amount of variability in TEM encoding across the stimulated neural ensembles of the CI electrode array.

RESULTS

EASSR patterns varied across the CI electrode array and subjects. We found a strong correlation (r = 0.89, p = 0.001) between the SPIN outcomes and the variability in EASSR amplitudes across the array as assessed with CIMTD/CIMTI.

CONCLUSIONS

The results of the present study show that the 40-Hz EASSR can be used to objectively assess the neural encoding of TEMs in human CI recipients. Overall reduced or largely variable TEM encoding of the neural ensembles across the electrode array, as quantified with the CIMTD/CIMTI, is highly correlated with speech perception in noise outcome with a CI.

Free-Field Cortical Steady-State Evoked Potentials in Cochlear Implant Users

Auditory steady-state evoked potentials (SS-EPs) are phase-locked neural responses to periodic stimuli, believed to reflect specific neural generators. As an objective measure, steady-state responses have been used in different clinical settings, including measuring hearing thresholds of normal and hearing-impaired subjects. Recent studies are in favor of recording these responses as a part of the cochlear implant (CI) device-fitting procedure. Considering these potential benefits, the goals of the present study were to assess the feasibility of recording free-field SS-EPs in CI users and to compare their characteristics between CI users and controls. By taking advantage of a recently developed dual-frequency tagging method, we attempted to record subcortical and cortical SS-EPs from adult CI users and controls and measured reliable subcortical and cortical SS-EPs in the control group. Independent component analysis (ICA) was used to remove CI stimulation artifacts, yet subcortical responses of several CIs were heavily contaminated by these artifacts. Consequently, only cortical SS-EPs were compared between groups, which were found to be larger in the controls. The lower cortical SS-EPs' amplitude in CI users might indicate a reduction in neural synchrony evoked by the modulation rate of the auditory input across different neural assemblies in the auditory pathway. The brain topographies of cortical auditory SS-EPs, the time course of cortical responses, and the reconstructed cortical maps were highly similar between groups, confirming their neural origin and possibility to obtain such responses also in CI recipients. As for subcortical SS-EPs, our results highlight a need for sophisticated denoising algorithms to pinpoint and remove artifactual components from the biological response.

Frequency following responses and rate change complexes in cochlear implant users

The upper limit of rate-based pitch perception and rate discrimination can differ substantially across cochlear implant (CI) users. One potential reason for this difference is the presence of a biological limitation on temporal encoding in the electrically-stimulated auditory pathway, which can be inherent to the electrical stimulation itself and/or to the degenerative processes associated with hearing loss. Electrophysiological measures, like the electrically-evoked frequency following response (eFFR) and auditory change complex (eACC), could potentially provide valuable insights in the temporal processing limitations at the level of the brainstem and cortex in the electrically-stimulated auditory pathway. Obtaining these neural responses, free from stimulation artifacts, is challenging, especially when the neural response is phase-locked to the stimulation rate, as is the case for the eFFR. In this study we investigated the feasibility of measuring eFFRs, free from stimulation artifacts, to stimulation rates ranging from 94 to 196 pulses per second (pps) and eACCs to pulse rate changes ranging from 36 to 108%, when stimulating in a monopolar configuration. A high-sampling rate EEG system was used to measure the electrophysiological responses in five CI users, and linear interpolation was applied to remove the stimulation artifacts from the EEG. With this approach, we were able to measure eFFRs for pulse rates up to 162 pps and eACCs to the different rate changes. Our results show that it is feasible to measure electrophysiological responses, free from stimulation artifacts, that could potentially be used as neural correlates for rate and pitch processing in CI users.

Using Interleaved Stimulation to Measure the Size and Selectivity of the Sustained Phase-Locked Neural Response to Cochlear Implant Stimulation

We measured the sustained neural response to electrical stimulation by a cochlear implant (CI). To do so, we interleaved two stimuli with frequencies F1 and F2 Hz and recorded a neural distortion response (NDR) at F2-F1 Hz. We show that, because any one time point contains only the F1 or F2 stimulus, the instantaneous nonlinearities typical of electrical artefact should not produce distortion at this frequency. However, if the stimulus is smoothed, such as by charge integration at the nerve membrane, subsequent (neural) nonlinearities can produce a component at F2-F1 Hz. We stimulated a single CI electrode with interleaved sinusoids or interleaved amplitude-modulated pulse trains such that F2 = 1.5F1, and found no evidence for an NDR when F2-F1 was between 90 and 120 Hz. However, interleaved amplitude-modulated pulse trains with F2-F1~40 Hz revealed a substantial NDR with a group delay of about 45 ms, consistent with a thalamic and/or cortical response. The NDR could be measured even from recording electrodes adjacent to the implant and at the highest pulse rates (> 4000 pps) used clinically. We then measured the selectivity of this sustained response by presenting F1 and F2 to different electrodes and at different between-electrode distances. This revealed a broad tuning that, we argue, reflects the overlap between the excitation elicited by the two electrodes. Our results also provide a glimpse of the neural nonlinearity in the auditory system, unaffected by the biomechanical cochlear nonlinearities that accompany acoustic stimulation. Several potential clinical applications of our findings are discussed.

[Psychoacoustic tests for perceptual assessment of processor fitting in patients with cochlear implants]

THE AIM OF THE STUDY

Was to study the possibility of using a battery of psychoacoustic tests to assess the tuning of the cochlear implant processor (CI) in deaf patients.

METHODOLOGY

The study involved 60 prellingually deaf patients aged 10 to 23 years with oral speech skills. To assess the quality of the CI processor tuning, in addition to traditional methods, a special battery of psychoacoustic tests was used. The first block of tests assessed the perception of the basic characteristics of sound signals (duration, temporal structure, spectrum, timbre) and was used to assess the initial setting. The second block of tests, intended for patients with experience using CI, included tasks to distinguish acoustically similar and dynamically changing signals, etc.

RESULTS

At the end of the initial CI setup session, patients with short signal perception problems were identified. Adjusting the frequency of electrical stimulation in patients has increased their ability to distinguish between sounds. During the second tuning session of the CI processor, 6 months later, a group of patients with difficulties in perceiving acoustic information in the low-frequency range was identified - distinguishing melodic intervals, changing the pitch of sounds, highlighting the voice of the target speaker. The «problem» patients underwent additional correction of the CI processor setting and the corresponding auditory training, which improved the test performance and subjective perception of sounds.

CONCLUSION

The use of psychoacoustic tests expands the possibilities of fine tuning the CI processor, taking into account the individual characteristics of the patient's auditory perception at different stages of CI use, especially in «problem» patients.

Estimating multiple latencies in the auditory system from auditory steady-state responses on a single EEG channel

The latency of the auditory steady-state response (ASSR) may provide valuable information regarding the integrity of the auditory system, as it could potentially reveal the presence of multiple intracerebral sources. To estimate multiple latencies from high-order ASSRs, we propose a novel two-stage procedure that consists of a nonparametric estimation method, called apparent latency from phase coherence (ALPC), followed by a heuristic sequential forward selection algorithm (SFS). Compared with existing methods, ALPC-SFS requires few prior assumptions, and is straightforward to implement for higher-order nonlinear responses to multi-cosine sound complexes with their initial phases set to zero. It systematically evaluates the nonlinear components of the ASSRs by estimating multiple latencies, automatically identifies involved ASSR components, and reports a latency consistency index. To verify the proposed method, we performed simulations for several scenarios: two nonlinear subsystems with different or overlapping outputs. We compared the results from our method with predictions from existing, parametric methods. We also recorded the EEG from ten normal-hearing adults by bilaterally presenting superimposed tones with four frequencies that evoke a unique set of ASSRs. From these ASSRs, two major latencies were found to be stable across subjects on repeated measurement days. The two latencies are dominated by low-frequency (LF) (near 40 Hz, at around 41-52 ms) and high-frequency (HF) (> 80 Hz, at around 21-27 ms) ASSR components. The frontal-central brain region showed longer latencies on LF components, but shorter latencies on HF components, when compared with temporal-lobe regions. In conclusion, the proposed nonparametric ALPC-SFS method, applied to zero-phase, multi-cosine sound complexes is more suitable for evaluating embedded nonlinear systems underlying ASSRs than existing methods. It may therefore be a promising objective measure for hearing performance and auditory cortex (dys)function.

Stimulus-evoked phase-locked activity along the human auditory pathway strongly varies across individuals

Phase-locking to the temporal envelope of speech is associated with envelope processing and speech perception. The phase-locked activity of the auditory pathway, across modulation frequencies, is generally assessed at group level and shows a decrease in response magnitude with increasing modulation frequency. With the exception of increased activity around 40 and 80 to 100 Hz. Furthermore, little is known about the phase-locked response patterns to modulation frequencies ≤ 20 Hz, which are modulations predominately present in the speech envelope. In the present study we assess the temporal modulation transfer function (TMTF_ASSR) of the phase-locked activity of the auditory pathway, from 0.5 to 100 Hz at a high-resolution and by means of auditory steady-state responses. Although the group-averaged TMTF_ASSR corresponds well with those reported in the literature, the individual TMTF_ASSR shows a remarkable intersubject variability. This intersubject variability is especially present for ASSRs that originate from the cortex and are evoked with modulation frequencies ≤ 20 Hz. Moreover, we found that these cortical phase-locked activity patterns are robust over time. These results show the importance of the individual TMTF_ASSR when assessing phase-locked activity to envelope fluctuations, which can potentially be used as a marker for auditory processing.

Neural encoding of spectro-temporal cues at slow and near speech-rate in cochlear implant users

The ability to process rapid modulations in the spectro-temporal structure of sounds is critical for speech comprehension. For users of cochlear implants (CIs), spectral cues in speech are conveyed by differential stimulation of electrode contacts along the cochlea, and temporal cues in terms of the amplitude of stimulating electrical pulses, which track the amplitude-modulated (AM'ed) envelope of speech sounds. Whilst survival of inner-ear neurons and spread of electrical current are known factors that limit the representation of speech information in CI listeners, limitations in the neural representation of dynamic spectro-temporal cues common to speech are also likely to play a role. We assessed the ability of CI listeners to process spectro-temporal cues varying at rates typically present in human speech. Employing an auditory change complex (ACC) paradigm, and a slow (0.5Hz) alternating rate between stimulating electrodes, or different AM frequencies, to evoke a transient cortical ACC, we demonstrate that CI listeners-like normal-hearing listeners-are sensitive to transitions in the spectral- and temporal-domain. However, CI listeners showed impaired cortical responses when either spectral or temporal cues were alternated at faster, speech-like (6-7Hz), rates. Specifically, auditory change following responses-reliably obtained in normal-hearing listeners-were small or absent in CI users, indicating that cortical adaptation to alternating cues at speech-like rates is stronger under electrical stimulation. In CI listeners, temporal processing was also influenced by the polarity-behaviourally-and rate of presentation of electrical pulses-both neurally and behaviorally. Limitations in the ability to process dynamic spectro-temporal cues will likely impact speech comprehension in CI users.

Electrophysiological assessment of temporal envelope processing in cochlear implant users

Cochlear-implant (CI) users rely on temporal envelope modulations (TEMs) to understand speech, and clinical outcomes depend on the accuracy with which these TEMs are encoded by the electrically-stimulated neural ensembles. Non-invasive EEG measures of this encoding could help clinicians identify and disable electrodes that evoke poor neural responses so as to improve CI outcomes. However, recording EEG during CI stimulation reveals huge stimulation artifacts that are up to orders of magnitude larger than the neural response. Here we used a custom-built EEG system having an exceptionally high sample rate to accurately measure the artefact, which we then removed using linear interpolation so as to reveal the neural response during continuous electrical stimulation. In ten adult CI users, we measured the 40-Hz electrically evoked auditory steady-state response (eASSR) and electrically evoked auditory change complex (eACC) to amplitude-modulated 900-pulses-per-second pulse trains, stimulated in monopolar mode (i.e. the clinical default), and at different modulation depths. We successfully measured artifact-free 40-Hz eASSRs and eACCs. Moreover, we found that the 40-Hz eASSR, in contrast to the eACC, showed substantial responses even at shallow modulation depths. We argue that the 40-Hz eASSR is a clinically feasible objective measure to assess TEM encoding in CI users.

From modulated noise to natural speech: The effect of stimulus parameters on the envelope following response

Envelope following responses (EFRs) can be evoked by a wide range of auditory stimuli, but for many stimulus parameters the effect on EFR strength is not fully understood. This complicates the comparison of earlier studies and the design of new studies. Furthermore, the most optimal stimulus parameters are unknown. To help resolve this issue, we investigated the effects of four important stimulus parameters and their interactions on the EFR. Responses were measured in 16 normal hearing subjects evoked by stimuli with four levels of stimulus complexity (amplitude modulated noise, artificial vowels, natural vowels and vowel-consonant-vowel combinations), three fundamental frequencies (105 Hz, 185 Hz and 245 Hz), three fundamental frequency contours (upward sweeping, downward sweeping and flat) and three vowel identities (Flemish /a:/, /u:/, and /i:/). We found that EFRs evoked by artificial vowels were on average 4-6 dB SNR larger than responses evoked by the other stimulus complexities, probably because of (unnaturally) strong higher harmonics. Moreover, response amplitude decreased with fundamental frequency but response SNR remained largely unaffected. Thirdly, fundamental frequency variation within the stimulus did not impact EFR strength, but only when rate of change remained low (e.g. not the case for sweeping natural vowels). Finally, the vowel /i:/ appeared to evoke larger response amplitudes compared to /a:/ and /u:/, but analysis power was too small to confirm this statistically. Vowel-dependent differences in response strength have been suggested to stem from destructive interference between response components. We show how a model of the auditory periphery can simulate these interference patterns and predict response strength. Altogether, the results of this study can guide stimulus choice for future EFR research and practical applications.

Independent component analysis for cochlear implant artifacts attenuation from electrically evoked auditory steady-state response measurements

OBJECTIVE

Electrically evoked auditory steady-state responses (EASSRs) are potentially useful for objective cochlear implant (CI) fitting and follow-up of the auditory maturation in infants and children with a CI. EASSRs are recorded in the electro-encephalogram (EEG) in response to electrical stimulation with continuous pulse trains, and are distorted by significant CI artifacts related to this electrical stimulation. The aim of this study is to evaluate a CI artifacts attenuation method based on independent component analysis (ICA) for three EASSR datasets.

APPROACH

ICA has often been used to remove CI artifacts from the EEG to record transient auditory responses, such as cortical evoked auditory potentials. Independent components (ICs) corresponding to CI artifacts are then often manually identified. In this study, an ICA based CI artifacts attenuation method was developed and evaluated for EASSR measurements with varying CI artifacts and EASSR characteristics. Artifactual ICs were automatically identified based on their spectrum.

MAIN RESULTS

For 40 Hz amplitude modulation (AM) stimulation at comfort level, in high SNR recordings, ICA succeeded in removing CI artifacts from all recording channels, without distorting the EASSR. For lower SNR recordings, with 40 Hz AM stimulation at lower levels, or 90 Hz AM stimulation, ICA either distorted the EASSR or could not remove all CI artifacts in most subjects, except for two of the seven subjects tested with low level 40 Hz AM stimulation. Noise levels were reduced after ICA was applied, and up to 29 ICs were rejected, suggesting poor ICA separation quality.

SIGNIFICANCE

We hypothesize that ICA is capable of separating CI artifacts and EASSR in case the contralateral hemisphere is EASSR dominated. For small EASSRs or large CI artifact amplitudes, ICA separation quality is insufficient to ensure complete CI artifacts attenuation without EASSR distortion.

Speech-ABRs in cochlear implant recipients: feasibility study

Objective: The aim of this study was to assess the feasibility of recording speech-ABRs from cochlear implant (CI) recipients, and to remove the artefact using a clinically applicable single-channel approach. Design: Speech-ABRs were recorded to a 40 ms [da] presented via loudspeaker using a two-channel electrode montage. Additionally, artefacts were recorded using an artificial-head incorporating a MED-EL CI with stimulation parameters as similar as possible to those of three MED-EL participants. A single-channel artefact removal technique was applied to all responses. Study sample: A total of 12 adult CI recipients (6 Cochlear Nucleus and 6 MED-EL CIs). Results: Responses differed according to the CI type, artefact removal resulted in responses containing speech-ARB characteristics in two MED-EL CI participants; however, it was not possible to verify whether these were true responses or were modulated by artefacts, and artefact removal was successful from the artificial-head recordings. Conclusions: This is the first study that attempted to record speech-ABRs from CI recipients. Results suggest that there is a potential for application of a single-channel approach to artefact removal. However, a more robust and adaptive approach to artefact removal that includes a method to verify true responses is needed.

Functional near-infrared spectroscopy as a tool for assessing speech and spoken language processing in pediatric and adult cochlear implant users

Much of what is known about the course of auditory learning in following cochlear implantation is based on behavioral indicators that users are able to perceive sound. Both prelingually deafened children and postlingually deafened adults who receive cochlear implants display highly variable speech and language processing outcomes, although the basis for this is poorly understood. To date, measuring neural activity within the auditory cortex of implant recipients of all ages has been challenging, primarily because the use of traditional neuroimaging techniques is limited by the implant itself. Functional near-infrared spectroscopy (fNIRS) is an imaging technology that works with implant users of all ages because it is non-invasive, compatible with implant devices, and not subject to electrical artifacts. Thus, fNIRS can provide insight into processing factors that contribute to variations in spoken language outcomes in implant users, both children and adults. There are important considerations to be made when using fNIRS, particularly with children, to maximize the signal-to-noise ratio and to best identify and interpret cortical responses. This review considers these issues, recent data, and future directions for using fNIRS as a tool to understand spoken language processing in children and adults who hear through a cochlear implant.

Neural tracking of the speech envelope in cochlear implant users

OBJECTIVE

When listening to speech, the brain tracks the speech envelope. It is possible to reconstruct this envelope from EEG recordings. However, in people who hear using a cochlear implant (CI), the artifacts caused by electrical stimulation of the auditory nerve contaminate the EEG. The objective of this study is to develop and validate a method for assessing the neural tracking of speech envelope in CI users.

APPROACH

To obtain EEG recordings free of stimulus artifacts, the electrical stimulation is periodically interrupted. During these stimulation gaps, artifact-free EEG can be sampled and used to train a linear envelope decoder. EEG recordings obtained during audible and inaudible (i.e. sub-threshold) stimulation were used to characterize the artifacts and their influence on the envelope reconstruction.

MAIN RESULTS

The present study demonstrates for the first time that neural tracking of the speech envelope can be measured in response to ongoing electrical stimulation. The responses were validated to be truly neural and not affected by stimulus artifact.

SIGNIFICANCE

Besides applications in audiology and neuroscience, the characterization and elimination of stimulus artifacts will enable future EEG studies involving continuous speech in CI users. Measures of neural tracking of the speech envelope reflect interesting properties of the listener's perception of speech, such as speech intelligibility or attentional state. Successful decoding of neural envelope tracking will open new possibilities to investigate the neural mechanisms of speech perception with a CI.

A New Method to Test the Efficiency of Cochlear Implant Artifacts Removal From Auditory Evoked Potentials

Auditory evoked potentials are of great interest to objectively evaluate the audition in cochlear implant (CI) recipients. However, these measures are impeded by CI stimulation electrical artifacts present in the EEG. In the first part, this paper investigates the use of a hybrid model approximating CI patient data. This model gives access to both uncontaminated and denoised data, thus allowing for the evaluation of CI artifact removal methods. Here the efficiency of independent component analysis (ICA) is evaluated in the context of auditory steady-state responses (ASSRs). A dedicated experimental setup was developed to simultaneously record EEG data from a normal hearing (NH) participant and CI artifact data from a phantom equipped with a CI. Hybrid data were obtained as a linear mixture of both sources. Amplitude-modulated continuous tones were used as stimuli to elicit ASSRs. After denoising, the comparison of denoised hybrid data and original NH data showed high correlations between the two datasets, demonstrating the efficiency of ICA. In the second part, the ICA was applied to real clinical CI ASSR data. Results support the usefulness of the methodology as regards the performance evaluation of signal processing methods applied to CI patient data prior to clinical application.

New metric for optimizing Continuous Loop Averaging Deconvolution (CLAD) sequences under the 1/f noise model

Continuous loop averaging deconvolution (CLAD) is one of the proven methods for recovering transient auditory evoked potentials (AEPs) in rapid stimulation paradigms, which requires an elaborated stimulus sequence design to attenuate impacts from noise in data. The present study aimed to develop a new metric in gauging a CLAD sequence in terms of noise gain factor (NGF), which has been proposed previously but with less effectiveness in the presence of pink (1/f) noise. We derived the new metric by explicitly introducing the 1/f model into the proposed time-continuous sequence. We selected several representative CLAD sequences to test their noise property on typical EEG recordings, as well as on five real CLAD electroencephalogram (EEG) recordings to retrieve the middle latency responses. We also demonstrated the merit of the new metric in generating and quantifying optimized sequences using a classic genetic algorithm. The new metric shows evident improvements in measuring actual noise gains at different frequencies, and better performance than the original NGF in various aspects. The new metric is a generalized NGF measurement that can better quantify the performance of a CLAD sequence, and provide a more efficient mean of generating CLAD sequences via the incorporation with optimization algorithms. The present study can facilitate the specific application of CLAD paradigm with desired sequences in the clinic.

Auditory steady state responses and cochlear implants: Modeling the artifact-response mixture in the perspective of denoising

Auditory steady state responses (ASSRs) in cochlear implant (CI) patients are contaminated by the spread of a continuous CI electrical stimulation artifact. The aim of this work was to model the electrophysiological mixture of the CI artifact and the corresponding evoked potentials on scalp electrodes in order to evaluate the performance of denoising algorithms in eliminating the CI artifact in a controlled environment. The basis of the proposed computational framework is a neural mass model representing the nodes of the auditory pathways. Six main contributors to auditory evoked potentials from the cochlear level and up to the auditory cortex were taken into consideration. The simulated dynamics were then projected into a 3-layer realistic head model. 32-channel scalp recordings of the CI artifact-response were then generated by solving the electromagnetic forward problem. As an application, the framework’s simulated 32-channel datasets were used to compare the performance of 4 commonly used Independent Component Analysis (ICA) algorithms: infomax, extended infomax, jade and fastICA in eliminating the CI artifact. As expected, two major components were detectable in the simulated datasets, a low frequency component at the modulation frequency and a pulsatile high frequency component related to the stimulation frequency. The first can be attributed to the phase-locked ASSR and the second to the stimulation artifact. Among the ICA algorithms tested, simulations showed that infomax was the most efficient and reliable in denoising the CI artifact-response mixture. Denoising algorithms can induce undesirable deformation of the signal of interest in real CI patient recordings. The proposed framework is a valuable tool for evaluating these algorithms in a controllable environment ahead of experimental or clinical applications.

Vocal sequences suppress spiking in the bat auditory cortex while evoking concomitant steady-state local field potentials

The mechanisms by which the mammalian brain copes with information from natural vocalization streams remain poorly understood. This article shows that in highly vocal animals, such as the bat species Carollia perspicillata, the spike activity of auditory cortex neurons does not track the temporal information flow enclosed in fast time-varying vocalization streams emitted by conspecifics. For example, leading syllables of so-called distress sequences (produced by bats subjected to duress) suppress cortical spiking to lagging syllables. Local fields potentials (LFPs) recorded simultaneously to cortical spiking evoked by distress sequences carry multiplexed information, with response suppression occurring in low frequency LFPs (i.e. 2–15 Hz) and steady-state LFPs occurring at frequencies that match the rate of energy fluctuations in the incoming sound streams (i.e. >50 Hz). Such steady-state LFPs could reflect underlying synaptic activity that does not necessarily lead to cortical spiking in response to natural fast time-varying vocal sequences.

Source analysis of auditory steady-state responses in acoustic and electric hearing

Speech is a complex signal containing a broad variety of acoustic information. For accurate speech reception, the listener must perceive modulations over a range of envelope frequencies. Perception of these modulations is particularly important for cochlear implant (CI) users, as all commercial devices use envelope coding strategies. Prolonged deafness affects the auditory pathway. However, little is known of how cochlear implantation affects the neural processing of modulated stimuli. This study investigates and contrasts the neural processing of envelope rate modulated signals in acoustic and CI listeners. Auditory steady-state responses (ASSRs) are used to study the neural processing of amplitude modulated (AM) signals. A beamforming technique is applied to determine the increase in neural activity relative to a control condition, with particular attention paid to defining the accuracy and precision of this technique relative to other tomographies. In a cohort of 44 acoustic listeners, the location, activity and hemispheric lateralisation of ASSRs is characterised while systematically varying the modulation rate (4, 10, 20, 40 and 80Hz) and stimulation ear (right, left and bilateral). We demonstrate a complex pattern of laterality depending on both modulation rate and stimulation ear that is consistent with, and extends, existing literature. We present a novel extension to the beamforming method which facilitates source analysis of electrically evoked auditory steady-state responses (EASSRs). In a cohort of 5 right implanted unilateral CI users, the neural activity is determined for the 40Hz rate and compared to the acoustic cohort. Results indicate that CI users activate typical thalamic locations for 40Hz stimuli. However, complementary to studies of transient stimuli, the CI population has atypical hemispheric laterality, preferentially activating the contralateral hemisphere.

Template Subtraction to Remove CI Stimulation Artifacts in Auditory Steady-State Responses in CI Subjects

Cochlear implant (CI) stimulation artifacts are currently removed from electrically evoked steady-state response (EASSR) measurements based on a linear interpolation (LI) over the artifact-contaminated signal parts. LI is only successful if CI stimulation artifacts are shorter than the interpulse interval, i.e., for contralateral channels and stimulation pulse rates up to 500 pulses per second (pps). The objective of this paper is to develop and evaluate a template subtraction (TS) method to remove continuous CI stimulation artifacts in order to accurately measure EASSRs. The template construction (TC) is based on an EEG recording containing CI stimulation artifacts but no synchronous neural response. The constructed templates are subtracted from the recording of interest. Response amplitudes and latencies are compared for the TS and LI method, and for different TC durations. The response amplitudes and latencies in contralateral channels are the same after TS and LI, as expected. In ipsilateral channels, response amplitudes and latencies are within the expected range only after TS. The TC duration can be reduced from 5 min to 1 min without a significant effect on response latency. TS with a TC duration of only 1 min allows to remove all CI stimulation artifacts in individual contra- and ipsilateral EEG recording channels.