Characterization of Cochlear Implant Artifact and Removal Based on Multi-Channel Wiener Filter in Unilateral Child Patients

Cochlear implants (CI) allow deaf patients to improve language perception and improving their emotional valence assessment. Electroencephalographic (EEG) measures were employed so far to improve CI programming reliability and to evaluate listening effort in auditory tasks, which are particularly useful in conditions when subjective evaluations are scarcely appliable or reliable. Unfortunately, the presence of CI on the scalp introduces an electrical artifact coupled to EEG signals that masks physiological features recorded by electrodes close to the site of implant. Currently, methods for CI artifact removal have been developed for very specific EEG montages or protocols, while others require many scalp electrodes. In this study, we propose a method based on the Multi-channel Wiener filter (MWF) to overcome those shortcomings. Nine children with unilateral CI and nine age-matched normal hearing children (control) participated in the study. EEG data were acquired on a relatively low number of electrodes (n = 16) during resting condition and during an auditory task. The obtained results obtained allowed to characterize CI artifact on the affected electrode and to significantly reduce, if not remove it through MWF filtering. Moreover, the results indicate, by comparing the two sample populations, that the EEG data loss is minimal in CI users after filtering, and that data maintain EEG physiological characteristics.

Changes in visually and auditory attended audiovisual speech processing in cochlear implant users: A longitudinal ERP study

Limited auditory input, whether caused by hearing loss or by electrical stimulation through a cochlear implant (CI), can be compensated by the remaining senses. Specifically for CI users, previous studies reported not only improved visual skills, but also altered cortical processing of unisensory visual and auditory stimuli. However, in multisensory scenarios, it is still unclear how auditory deprivation (before implantation) and electrical hearing experience (after implantation) affect cortical audiovisual speech processing. Here, we present a prospective longitudinal electroencephalography (EEG) study which systematically examined the deprivation- and CI-induced alterations of cortical processing of audiovisual words by comparing event-related potentials (ERPs) in postlingually deafened CI users before and after implantation (five weeks and six months of CI use). A group of matched normal-hearing (NH) listeners served as controls. The participants performed a word-identification task with congruent and incongruent audiovisual words, focusing their attention on either the visual (lip movement) or the auditory speech signal. This allowed us to study the (top-down) attention effect on the (bottom-up) sensory cortical processing of audiovisual speech. When compared to the NH listeners, the CI candidates (before implantation) and the CI users (after implantation) exhibited enhanced lipreading abilities and an altered cortical response at the N1 latency range (90-150 ms) that was characterized by a decreased theta oscillation power (4-8 Hz) and a smaller amplitude in the auditory cortex. After implantation, however, the auditory-cortex response gradually increased and developed a stronger intra-modal connectivity. Nevertheless, task efficiency and activation in the visual cortex was significantly modulated in both groups by focusing attention on the visual as compared to the auditory speech signal, with the NH listeners additionally showing an attention-dependent decrease in beta oscillation power (13-30 Hz). In sum, these results suggest remarkable deprivation effects on audiovisual speech processing in the auditory cortex, which partially reverse after implantation. Although even experienced CI users still show distinct audiovisual speech processing compared to NH listeners, pronounced effects of (top-down) direction of attention on (bottom-up) audiovisual processing can be observed in both groups. However, NH listeners but not CI users appear to show enhanced allocation of cognitive resources in visually as compared to auditory attended audiovisual speech conditions, which supports our behavioural observations of poorer lipreading abilities and reduced visual influence on audition in NH listeners as compared to CI users.

Effects of noise and noise reduction on audiovisual speech perception in cochlear implant users: An ERP study

OBJECTIVE

Hearing with a cochlear implant (CI) is difficult in noisy environments, but the use of noise reduction algorithms, specifically ForwardFocus, can improve speech intelligibility. The current event-related potentials (ERP) study examined the electrophysiological correlates of this perceptual improvement.

METHODS

Ten bimodal CI users performed a syllable-identification task in auditory and audiovisual conditions, with syllables presented from the front and stationary noise presented from the sides. Brainstorm was used for spatio-temporal evaluation of ERPs.

RESULTS

CI users revealed an audiovisual benefit as reflected by shorter response times and greater activation in temporal and occipital regions at P2 latency. However, in auditory and audiovisual conditions, background noise hampered speech processing, leading to longer response times and delayed auditory-cortex-activation at N1 latency. Nevertheless, activating ForwardFocus resulted in shorter response times, reduced listening effort and enhanced superior-frontal-cortex-activation at P2 latency, particularly in audiovisual conditions.

CONCLUSIONS

ForwardFocus enhances speech intelligibility in audiovisual speech conditions by potentially allowing the reallocation of attentional resources to relevant auditory speech cues.

SIGNIFICANCE

This study shows for CI users that background noise and ForwardFocus differentially affect spatio-temporal cortical response patterns, both in auditory and audiovisual speech conditions.

Age effects on cognitive functions and speech-in-noise processing: An event-related potential study with cochlear-implant users and normal-hearing listeners

A cochlear implant (CI) can partially restore hearing in individuals with profound sensorineural hearing loss. However, electrical hearing with a CI is limited and highly variable. The current study aimed to better understand the different factors contributing to this variability by examining how age affects cognitive functions and cortical speech processing in CI users. Electroencephalography (EEG) was applied while two groups of CI users (young and elderly; N = 13 each) and normal-hearing (NH) listeners (young and elderly; N = 13 each) performed an auditory sentence categorization task, including semantically correct and incorrect sentences presented either with or without background noise. Event-related potentials (ERPs) representing earlier, sensory-driven processes (N1-P2 complex to sentence onset) and later, cognitive-linguistic integration processes (N400 to semantically correct/incorrect sentence-final words) were compared between the different groups and speech conditions. The results revealed reduced amplitudes and prolonged latencies of auditory ERPs in CI users compared to NH listeners, both at earlier (N1, P2) and later processing stages (N400 effect). In addition to this hearing-group effect, CI users and NH listeners showed a comparable background-noise effect, as indicated by reduced hit rates and reduced (P2) and delayed (N1/P2) ERPs in conditions with background noise. Moreover, we observed an age effect in CI users and NH listeners, with young individuals showing improved specific cognitive functions (working memory capacity, cognitive flexibility and verbal learning/retrieval), reduced latencies (N1/P2), decreased N1 amplitudes and an increased N400 effect when compared to the elderly. In sum, our findings extend previous research by showing that the CI users' speech processing is impaired not only at earlier (sensory) but also at later (semantic integration) processing stages, both in conditions with and without background noise. Using objective ERP measures, our study provides further evidence of strong age effects on cortical speech processing, which can be observed in both the NH listeners and the CI users. We conclude that elderly individuals require more effortful processing at sensory stages of speech processing, which however seems to be at the cost of the limited resources available for the later semantic integration processes.

A direct comparison of voice pitch processing in acoustic and electric hearing

In single-sided deafness patients fitted with a cochlear implant (CI) in the affected ear and preserved normal hearing in the other ear, acoustic and electric hearing can be directly compared without the need for an external control group. Although poor pitch perception is a crucial limitation when listening through CIs, it remains unclear how exactly the cortical processing of pitch information differs between acoustic and electric hearing. Hence, we separately presented both ears of 20 of these patients with vowel sequences in which the pitch contours were either repetitive or variable, while simultaneously recording functional near-infrared spectroscopy (fNIRS) and EEG data. Overall, the results showed smaller and delayed auditory cortex activity in electric hearing, particularly for the P2 event-related potential component, which appears to reflect the processing of voice pitch information. Both the fNIRS data and EEG source reconstructions furthermore showed that vowel sequences with variable pitch contours evoked additional activity in posterior right auditory cortex in electric but not acoustic hearing. This surprising discrepancy demonstrates, firstly, that the acoustic detail transmitted by CIs is sufficient to distinguish between speech sounds that only vary regarding their pitch information. Secondly, the absence of a condition difference when stimulating the normal-hearing ears suggests a saturation of cortical activity levels following unilateral deafness. Taken together, these results provide strong evidence in favour of using CIs in this patient group.

Side-of-Implantation Effect on Functional Asymmetry in the Auditory Cortex of Single-Sided Deaf Cochlear-Implant Users

Cochlear implants (CIs) allow to restore the hearing function in profoundly deaf individuals. Due to the degradation of the stimulus by CI signal processing, implanted individuals with single-sided deafness (SSD) have the specific challenge that the input highly differs between their ears. The present study compared normal-hearing (NH) listeners (N = 10) and left- and right-ear implanted SSD CI users (N = 10 left, N = 9 right), to evaluate cortical speech processing between CI- and NH-ears and to explore for side-of-implantation effects. The participants performed a two-deviant oddball task, separately with the left and the right ear. Auditory event-related potentials (ERPs) in response to syllables were compared between proficient and non-proficient CI users, as well as between CI and NH ears. The effect of the side of implantation was analysed on the sensor and the source level. CI proficiency could be distinguished based on the ERP amplitudes of the N1 and the P3b. Moreover, syllable processing via the CI ear, when compared to the NH ear, resulted in attenuated and delayed ERPs. In addition, the left-ear implanted SSD CI users revealed an enhanced functional asymmetry in the auditory cortex than right-ear implanted SSD CI users, regardless of whether the syllables were perceived via the CI or the NH ear. Our findings reveal that speech-discrimination proficiency in SSD CI users can be assessed by N1 and P3b ERPs. The results contribute to a better understanding of the rehabilitation success in SSD CI users by showing that cortical speech processing in SSD CI users is affected by CI-related stimulus degradation and experience-related functional changes in the auditory cortex.

The timecourse of multisensory speech processing in unilaterally stimulated cochlear implant users revealed by ERPs

•

Both normal-hearing (NH) and cochlear implant (CI) users show a clear benefit in multisensory speech processing.

•

Group differences in ERP topographies and cortical source activation suggest distinct audiovisual speech processing in CI users when compared to NH listeners.

•

Electrical neuroimaging, including topographic and ERP source analysis, provides a suitable tool to study the timecourse of multisensory speech processing in CI users.

A cochlear implant (CI) is an auditory prosthesis which can partially restore the auditory function in patients with severe to profound hearing loss. However, this bionic device provides only limited auditory information, and CI patients may compensate for this limitation by means of a stronger interaction between the auditory and visual system. To better understand the electrophysiological correlates of audiovisual speech perception, the present study used electroencephalography (EEG) and a redundant target paradigm. Postlingually deafened CI users and normal-hearing (NH) listeners were compared in auditory, visual and audiovisual speech conditions. The behavioural results revealed multisensory integration for both groups, as indicated by shortened response times for the audiovisual as compared to the two unisensory conditions. The analysis of the N1 and P2 event-related potentials (ERPs), including topographic and source analyses, confirmed a multisensory effect for both groups and showed a cortical auditory response which was modulated by the simultaneous processing of the visual stimulus. Nevertheless, the CI users in particular revealed a distinct pattern of N1 topography, pointing to a strong visual impact on auditory speech processing. Apart from these condition effects, the results revealed ERP differences between CI users and NH listeners, not only in N1/P2 ERP topographies, but also in the cortical source configuration. When compared to the NH listeners, the CI users showed an additional activation in the visual cortex at N1 latency, which was positively correlated with CI experience, and a delayed auditory-cortex activation with a reversed, rightward functional lateralisation. In sum, our behavioural and ERP findings demonstrate a clear audiovisual benefit for both groups, and a CI-specific alteration in cortical activation at N1 latency when auditory and visual input is combined. These cortical alterations may reflect a compensatory strategy to overcome the limited CI input, which allows the CI users to improve the lip-reading skills and to approximate the behavioural performance of NH listeners in audiovisual speech conditions. Our results are clinically relevant, as they highlight the importance of assessing the CI outcome not only in auditory-only, but also in audiovisual speech conditions.

Recording EEG in Cochlear Implant Users: Guidelines for Experimental Design and Data Analysis for Optimizing Signal Quality and Minimizing Artifacts

Cochlear implants (CI) are neural prostheses that can restore hearing in individuals with severe to profound hearing loss. Although CIs significantly improve quality of life, clinical outcomes are still highly variable. An important part of this variability is explained by the brain reorganization following cochlear implantation. Therefore, clinicians and researchers are seeking objective measurements to investigate post-implantation brain plasticity. Electroencephalography (EEG) is a promising technique because it is objective, non-invasive, and implant-compatible, but is nonetheless susceptible to massive artifacts generated by the prosthesis's electrical activity. CI artifacts can blur and distort brain responses; thus, it is crucial to develop reliable techniques to remove them from EEG recordings. Despite numerous artifact removal techniques used in previous studies, there is a paucity of documentation and consensus on the optimal EEG procedures to reduce these artifacts. Herein, and through a comprehensive review process, we provide a guideline for designing an EEG-CI experiment minimizing the effect of the artifact. We provide some technical guidance for recording an accurate neural response from CI users and discuss the current challenges in detecting and removing CI-induced artifacts from a recorded signal. The aim of this paper is also to provide recommendations to better appraise and report EEG-CI findings.

Distinct multisensory perceptual processes guide enhanced auditory recognition memory in older cochlear implant users

•

Congruent audio-visual encoding enhances later auditory processing in the elderly.

•

CI users benefit from additional congruent visual information, similar to controls.

•

CI users show distinct neurophysiological processes, compared to controls.

•

CI users show an earlier modulation of event-related topographies, compared to controls.

In naturalistic situations, sounds are often perceived in conjunction with matching visual impressions. For example, we see and hear the neighbor’s dog barking in the garden. Still, there is a good chance that we recognize the neighbor’s dog even when we only hear it barking, but do not see it behind the fence. Previous studies with normal-hearing (NH) listeners have shown that the audio-visual presentation of a perceptual object (like an animal) increases the probability to recognize this object later on, even if the repeated presentation of this object occurs in a purely auditory condition. In patients with a cochlear implant (CI), however, the electrical hearing of sounds is impoverished, and the ability to recognize perceptual objects in auditory conditions is significantly limited. It is currently not well understood whether CI users – as NH listeners – show a multisensory facilitation for auditory recognition. The present study used event-related potentials (ERPs) and a continuous recognition paradigm with auditory and audio-visual stimuli to test the prediction that CI users show a benefit from audio-visual perception. Indeed, the congruent audio-visual context resulted in an improved recognition ability of objects in an auditory-only condition, both in the NH listeners and the CI users. The ERPs revealed a group-specific pattern of voltage topographies and correlations between these ERP maps and the auditory recognition ability, indicating a different processing of congruent audio-visual stimuli in CI users when compared to NH listeners. Taken together, our results point to distinct cortical processing of naturalistic audio-visual objects in CI users and NH listeners, which however allows both groups to improve the recognition ability of these objects in a purely auditory context. Our findings are of relevance for future clinical research since audio-visual perception might also improve the auditory rehabilitation after cochlear implantation.

The Acoustic Change Complex in Response to Frequency Changes and Its Correlation to Cochlear Implant Speech Outcomes

One of the biggest challenges that face cochlear implant (CI) users is the highly variable hearing outcomes of implantation across patients. Since speech perception requires the detection of various dynamic changes in acoustic features (e.g., frequency, intensity, timing) in speech sounds, it is critical to examine the ability to detect the within-stimulus acoustic changes in CI users. The primary objective of this study was to examine the auditory event-related potential (ERP) evoked by the within-stimulus frequency changes (F-changes), one type of the acoustic change complex (ACC), in adult CI users, and its correlation to speech outcomes. Twenty-one adult CI users (29 individual CI ears) were tested with psychoacoustic frequency change detection tasks, speech tests including the Consonant-Nucleus-Consonant (CNC) word recognition, Arizona Biomedical Sentence Recognition in quiet and noise (AzBio-Q and AzBio-N), and the Digit-in-Noise (DIN) tests, and electroencephalographic (EEG) recordings. The stimuli for the psychoacoustic tests and EEG recordings were pure tones at three different base frequencies (0.25, 1, and 4 kHz) that contained a F-change at the midpoint of the tone. Results showed that the frequency change detection threshold (FCDT), ACC N1' latency, and P2' latency did not differ across frequencies (p > 0.05). ACC N1'-P2 amplitude was significantly larger for 0.25 kHz than for other base frequencies (p < 0.05). The mean N1' latency across three base frequencies was negatively correlated with CNC word recognition (r = -0.40, p < 0.05) and CNC phoneme (r = -0.40, p < 0.05), and positively correlated with mean FCDT (r = 0.46, p < 0.05). The P2' latency was positively correlated with DIN (r = 0.47, p < 0.05) and mean FCDT (r = 0.47, p < 0.05). There was no statistically significant correlation between N1'-P2' amplitude and speech outcomes (all ps > 0.05). Results of this study indicated that variability in CI speech outcomes assessed with the CNC, AzBio-Q, and DIN tests can be partially explained (approximately 16-21%) by the variability of cortical sensory encoding of F-changes reflected by the ACC.

Objective electroencephalography-based assessment for auditory rehabilitation of pediatric cochlear implant users

The cochlear implant (CI) has an effective habilitation modality for hearing-impaired children by promoting sound perception, vocalization, and language ability. However, the major challenge that remained was the lack of assessment standards for pediatric CI users, especially prelingually deaf children, to evaluate hearing rehabilitation effectiveness. In the present study, we conducted an oddball paradigm with stimuli varying in pure-tone, syllable, and tonal sounds. After implantation, we utilized cortical auditory evoked potential (CAEP) and mismatch negativity (MMN) to obtain time-domain analysis; meanwhile, the source localization was investigated to obtain spatial accuracy of the plasticity in the auditory cortex. P1 started to emerge at the third month after implantation, but its peak level was not significant until the sixth month. The temporal lobe was activated between the third and sixth months after implantation. The MMN waveform was basically normal approximately after 12 months. These results suggest that the auditory system goes through a critical period of rapid development between three and six months and enters a maturation period after 12 months. This work indicates that CAEPs are more suitable for assessing the early auditory system reconstruction, while MMN performs better in evaluating the advanced auditory function. Furthermore, source localization has proven to be an efficient tool in exploring auditory cortex plasticity, especially for pediatric CI users.

Neural Correlates of Vocal Auditory Feedback Processing: Unique Insights from Electrocorticography Recordings in a Human Cochlear Implant User

There is considerable interest in understanding cortical processing and the function of top-down and bottom-up human neural circuits that control speech production. Research efforts to investigate these circuits are aided by analysis of spectro-temporal response characteristics of neural activity recorded by electrocorticography (ECoG). Further, cortical processing may be altered in the case of hearing-impaired cochlear implant (CI) users, as electric excitation of the auditory nerve creates a markedly different neural code for speech compared with that of the functionally intact hearing system. Studies of cortical activity in CI users typically record scalp potentials and are hampered by stimulus artifact contamination and by spatiotemporal filtering imposed by the skull. We present a unique case of a CI user who required direct recordings from the cortical surface using subdural electrodes implanted for epilepsy assessment. Using experimental conditions where the subject vocalized in the presence (CIs ON) or absence (CIs OFF) of auditory feedback, or listened to playback of self-vocalizations without production, we observed ECoG activity primarily in γ (32–70 Hz) and high γ (70–150 Hz) bands at focal regions on the lateral surface of the superior temporal gyrus (STG). High γ band responses differed in their amplitudes across conditions and cortical sites, possibly reflecting different rates of stimulus presentation and differing levels of neural adaptation. STG γ responses to playback and vocalization with auditory feedback were not different from responses to vocalization without feedback, indicating this activity reflects not only auditory, but also attentional, efference-copy, and sensorimotor processing during speech production.

Combined Brain-Perfusion SPECT and EEG Measurements Suggest Distinct Strategies for Speech Comprehension in CI Users With Higher and Lower Performance

Cochlear implantation constitutes a successful therapy of inner ear deafness, with the majority of patients showing good outcomes. There is, however, still some unexplained variability in outcomes with a number of cochlear-implant (CI) users, showing major limitations in speech comprehension. The current study used a multimodal diagnostic approach combining single-photon emission computed tomography (SPECT) and electroencephalography (EEG) to examine the mechanisms underlying speech processing in postlingually deafened CI users (N = 21). In one session, the participants performed a speech discrimination task, during which a 96-channel EEG was recorded and the perfusions marker 99mTc-HMPAO was injected intravenously. The SPECT scan was acquired 1.5 h after injection to measure the cortical activity during the speech task. The second session included a SPECT scan after injection without stimulation at rest. Analysis of EEG and SPECT data showed N400 and P600 event-related potentials (ERPs) particularly evoked by semantic violations in the sentences, and enhanced perfusion in a temporo-frontal network during task compared to rest, involving the auditory cortex bilaterally and Broca's area. Moreover, higher performance in testing for word recognition and verbal intelligence strongly correlated to the activation in this network during the speech task. However, comparing CI users with lower and higher speech intelligibility [median split with cutoff + 7.6 dB signal-to-noise ratio (SNR) in the Göttinger sentence test] revealed for CI users with higher performance additional activations of parietal and occipital regions and for those with lower performance stronger activation of superior frontal areas. Furthermore, SPECT activity was tightly coupled with EEG and cognitive abilities, as indicated by correlations between (1) cortical activation and the amplitudes in EEG, N400 (temporal and occipital areas)/P600 (parietal and occipital areas) and (2) between cortical activation in left-sided temporal and bilateral occipital/parietal areas and working memory capacity. These results suggest the recruitment of a temporo-frontal network in CI users during speech processing and a close connection between ERP effects and cortical activation in CI users. The observed differences in speech-evoked cortical activation patterns for CI users with higher and lower speech intelligibility suggest distinct processing strategies during speech rehabilitation with CI.

A Neurophysiological Study of Musical Pitch Identification in Mandarin-Speaking Cochlear Implant Users

Music perception in cochlear implant (CI) users is far from satisfactory, not only because of the technological limitations of current CI devices but also due to the neurophysiological alterations that generally accompany deafness. Early behavioral studies revealed that similar mechanisms underlie musical and lexical pitch perception in CI-based electric hearing. Although neurophysiological studies of the musical pitch perception of English-speaking CI users are actively ongoing, little such research has been conducted with Mandarin-speaking CI users; as Mandarin is a tonal language, these individuals require pitch information to understand speech. The aim of this work was to study the neurophysiological mechanisms accounting for the musical pitch identification abilities of Mandarin-speaking CI users and normal-hearing (NH) listeners. Behavioral and mismatch negativity (MMN) data were analyzed to examine musical pitch processing performance. Moreover, neurophysiological results from CI users with good and bad pitch discrimination performance (according to the just-noticeable differences (JND) and pitch-direction discrimination (PDD) tasks) were compared to identify cortical responses associated with musical pitch perception differences. The MMN experiment was conducted using a passive oddball paradigm, with musical tone C4 (262 Hz) presented as the standard and tones D4 (294 Hz), E4 (330 Hz), G#4 (415 Hz), and C5 (523 Hz) presented as deviants. CI users demonstrated worse musical pitch discrimination ability than did NH listeners, as reflected by larger JND and PDD thresholds for pitch identification, and significantly increased latencies and reduced amplitudes in MMN responses. Good CI performers had better MMN results than did bad performers. Consistent with findings for English-speaking CI users, the results of this work suggest that MMN is a viable marker of cortical pitch perception in Mandarin-speaking CI users.

The Effect of Side of Implantation on the Cortical Processing of Frequency Changes in Adult Cochlear Implant Users

Cochlear implants (CI) are widely used in children and adults to restore hearing function. However, CI outcomes are vary widely. The affected factors have not been well understood. It is well known that the right and left hemispheres play different roles in auditory perception in adult normal hearing listeners. It is unknown how the implantation side may affect the outcomes of CIs. In this study, the effect of the implantation side on how the brain processes frequency changes within a sound was examined in 12 right-handed adult CI users. The outcomes of CIs were assessed with behaviorally measured frequency change detection threshold (FCDT), which has been reported to significantly affect CI speech performance. The brain activation and regions were also examined using acoustic change complex (ACC, a type of cortical potential evoked by acoustic changes within a stimulus), on which the waveform analysis and the standardized low-resolution brain electromagnetic tomography (sLORETA) were performed. CI users showed activation in the temporal lobe and non-temporal areas, such as the frontal lobe. Right-ear CIs could more efficiently activate the contralateral hemisphere compared to left-ear CIs. For right-ear CIs, the increased activation in the contralateral temporal lobe together with the decreased activation in the contralateral frontal lobe was correlated with good performance of frequency change detection (lower FCDTs). Such a trend was not found in left-ear CIs. These results suggest that the implantation side may significantly affect neuroplasticity patterns in adults.

Acoustic Change Responses to Amplitude Modulation in Cochlear Implant Users: Relationships to Speech Perception

Objectives

The ability to understand speech is highly variable in people with cochlear implants (CIs) and to date, there are no objective measures that identify the root of this discrepancy. However, behavioral measures of temporal processing such as the temporal modulation transfer function (TMTF) has previously found to be related to vowel and consonant identification in CI users. The acoustic change complex (ACC) is a cortical auditory-evoked potential response that can be elicited by a “change” in an ongoing stimulus. In this study, the ACC elicited by amplitude modulation (AM) change was related to measures of speech perception as well as the amplitude detection threshold in CI users.

Methods

Ten CI users (mean age: 50 years old) participated in this study. All subjects participated in behavioral tests that included both speech and amplitude modulation detection to obtain a TMTF. CI users were categorized as “good” (n = 6) or “poor” (n = 4) based on their speech-in noise score (<50%). 64-channel electroencephalographic recordings were conducted while CI users passively listened to AM change sounds that were presented in a free field setting. The AM change stimulus was white noise with four different AM rates (4, 40, 100, and 300 Hz).

Results

Behavioral results show that AM detection thresholds in CI users were higher compared to the normal-hearing (NH) group for all AM rates. The electrophysiological data suggest that N1 responses were significantly decreased in amplitude and their latencies were increased in CI users compared to NH controls. In addition, the N1 latencies for the poor CI performers were delayed compared to the good CI performers. The N1 latency for 40 Hz AM was correlated with various speech perception measures.

Conclusion

Our data suggest that the ACC to AM change provides an objective index of speech perception abilities that can be used to explain some of the variation in speech perception observed among CI users.

Neuronal activation in the human centromedian-parafascicular complex predicts cortical responses to behaviorally significant auditory events

Studies with non-human primates have suggested an excitatory influence of the thalamus on the cerebral cortex, with the centromedian-parafascicular complex (CM-Pf) being particularly involved in processes of sensory event-driven attention and arousal. To define the involvement of the human CM-Pf in bottom-up and top-down auditory attention, we simultaneously recorded cortical EEG activity and intracranial local field potentials (LFPs) via electrodes implanted for deep brain stimulation for the treatment of neuropathic pain. The patients (N ​= ​6) performed an auditory three-class oddball paradigm with frequent standard stimuli and two types of infrequent deviant stimuli (target and distractor). We found a parietal P3b to targets and a central P3a to distractors at the scalp level. Subcortical recordings in the CM-Pf revealed enhanced activation to targets compared to standards. Interarea-correlation analyses showed that activation in the CM-Pf predicted the generation of longer latency P3b scalp potentials specifically in the target condition. Our results provide first direct human evidence for a functional temporal relationship between target-related activation in the CM-Pf and an enhanced cortical target response. These results corroborate the hypothetical model of a cortico-basal ganglia loop system that switches from top-down to bottom-up mode in response to salient, task-relevant external events that are not predictable.

Independent component analysis for cochlear implant artifacts attenuation from electrically evoked auditory steady-state response measurements

OBJECTIVE

Electrically evoked auditory steady-state responses (EASSRs) are potentially useful for objective cochlear implant (CI) fitting and follow-up of the auditory maturation in infants and children with a CI. EASSRs are recorded in the electro-encephalogram (EEG) in response to electrical stimulation with continuous pulse trains, and are distorted by significant CI artifacts related to this electrical stimulation. The aim of this study is to evaluate a CI artifacts attenuation method based on independent component analysis (ICA) for three EASSR datasets.

APPROACH

ICA has often been used to remove CI artifacts from the EEG to record transient auditory responses, such as cortical evoked auditory potentials. Independent components (ICs) corresponding to CI artifacts are then often manually identified. In this study, an ICA based CI artifacts attenuation method was developed and evaluated for EASSR measurements with varying CI artifacts and EASSR characteristics. Artifactual ICs were automatically identified based on their spectrum.

MAIN RESULTS

For 40 Hz amplitude modulation (AM) stimulation at comfort level, in high SNR recordings, ICA succeeded in removing CI artifacts from all recording channels, without distorting the EASSR. For lower SNR recordings, with 40 Hz AM stimulation at lower levels, or 90 Hz AM stimulation, ICA either distorted the EASSR or could not remove all CI artifacts in most subjects, except for two of the seven subjects tested with low level 40 Hz AM stimulation. Noise levels were reduced after ICA was applied, and up to 29 ICs were rejected, suggesting poor ICA separation quality.

SIGNIFICANCE

We hypothesize that ICA is capable of separating CI artifacts and EASSR in case the contralateral hemisphere is EASSR dominated. For small EASSRs or large CI artifact amplitudes, ICA separation quality is insufficient to ensure complete CI artifacts attenuation without EASSR distortion.

Toward Decoding Selective Attention From Single-Trial EEG Data in Cochlear Implant Users

Previous results showed that it is possible to decode an attended speech source from EEG data via the reconstruction of the speech envelope in normal hearing (NH) listeners. However, so far it is unknown that how the performance of such a decoder is affected by the decrease in spectral resolution and the electrical artifacts introduced by a cochlear implant (CI) in users of these prostheses. NH listeners and bilateral CI users participated in the present study. Speeches from two audio books, one uttered by a male voice and one by a female voice, were presented to NH listeners and CI users. Participants were instructed to attend to one of the two speech streams presented dichotically while a 96-channel EEG was recorded. Speech envelope reconstruction from the EEG data was obtained by training decoders using a regularized least square estimation method. Decoding accuracy was defined as the percentage of accurately reconstructed trials for each subject. For NH listeners, the experiment was repeated using a vocoder to reduce spectral resolution and simulate speech perception with a CI in NH listeners. The results showed a decoding accuracy of 80.9 % using the original sound files in NH listeners. The performance dropped to 73.2 % in the vocoder condition and to 71.5 % in the group of CI users. In sum, although the accuracy drops when the spectral resolution becomes worse, the results show the feasibility to decode the attended sound source in NH listeners with a vocoder simulation, and even in CI users, albeit more training data are needed.

Neural tracking of the speech envelope in cochlear implant users

OBJECTIVE

When listening to speech, the brain tracks the speech envelope. It is possible to reconstruct this envelope from EEG recordings. However, in people who hear using a cochlear implant (CI), the artifacts caused by electrical stimulation of the auditory nerve contaminate the EEG. The objective of this study is to develop and validate a method for assessing the neural tracking of speech envelope in CI users.

APPROACH

To obtain EEG recordings free of stimulus artifacts, the electrical stimulation is periodically interrupted. During these stimulation gaps, artifact-free EEG can be sampled and used to train a linear envelope decoder. EEG recordings obtained during audible and inaudible (i.e. sub-threshold) stimulation were used to characterize the artifacts and their influence on the envelope reconstruction.

MAIN RESULTS

The present study demonstrates for the first time that neural tracking of the speech envelope can be measured in response to ongoing electrical stimulation. The responses were validated to be truly neural and not affected by stimulus artifact.

SIGNIFICANCE

Besides applications in audiology and neuroscience, the characterization and elimination of stimulus artifacts will enable future EEG studies involving continuous speech in CI users. Measures of neural tracking of the speech envelope reflect interesting properties of the listener's perception of speech, such as speech intelligibility or attentional state. Successful decoding of neural envelope tracking will open new possibilities to investigate the neural mechanisms of speech perception with a CI.

Auditory Event-Related Potentials Associated With Music Perception in Cochlear Implant Users

A short review of the literature on auditory event-related potentials and mismatch negativities (MMN) in cochlear implant users engaged in music-related auditory perception tasks is presented. Behavioral studies that have measured the fundamental aspects of music perception in CI users have found that they usually experience poor perception of melody, pitch, harmony as well as timbre (Limb and Roy, 2014). This is thought to occur not only because of the technological and acoustic limitations of the device, but also because of the biological alterations that usually accompany deafness. In order to improve music perception and appreciation in individuals with cochlear implants, it is essential to better understand how they perceive music. As suggested by recent studies, several different electrophysiological paradigms can be used to reliably and objectively measure normal-hearing individuals' perception of fundamental musical features. These techniques, when used with individuals with cochlear implants, might contribute to determine how their peripheral and central auditory systems analyze musical excerpts. The investigation of these cortical activations can moreover give important information on other aspects related to music appreciation, such as pleasantness and emotional perception. The studies reviewed suggest that cochlear implantation alters most fundamental musical features, including pitch, timbre, melody perception, complex rhythm, and duration (e.g., Koelsch et al., 2004b; Timm et al., 2012, 2014; Zhang et al., 2013a,b; Limb and Roy, 2014). A better understanding of how individuals with cochlear implants perform on these tasks not only makes it possible to compare their performance to that of their normal-hearing peers, but can also lead to better clinical intervention and rehabilitation.

Toward Automated Cochlear Implant Fitting Procedures Based on Event-Related Potentials

OBJECTIVES

Cochlear implants (CIs) restore hearing to the profoundly deaf by direct electrical stimulation of the auditory nerve. To provide an optimal electrical stimulation pattern the CI must be individually fitted to each CI user. To date, CI fitting is primarily based on subjective feedback from the user. However, not all CI users are able to provide such feedback, for example, small children. This study explores the possibility of using the electroencephalogram (EEG) to objectively determine if CI users are able to hear differences in tones presented to them, which has potential applications in CI fitting or closed loop systems.

DESIGN

Deviant and standard stimuli were presented to 12 CI users in an active auditory oddball paradigm. The EEG was recorded in two sessions and classification of the EEG data was performed with shrinkage linear discriminant analysis. Also, the impact of CI artifact removal on classification performance and the possibility to reuse a trained classifier in future sessions were evaluated.

RESULTS

Overall, classification performance was above chance level for all participants although performance varied considerably between participants. Also, artifacts were successfully removed from the EEG without impairing classification performance. Finally, reuse of the classifier causes only a small loss in classification performance.

CONCLUSIONS

Our data provide first evidence that EEG can be automatically classified on single-trial basis in CI users. Despite the slightly poorer classification performance over sessions, classifier and CI artifact correction appear stable over successive sessions. Thus, classifier and artifact correction weights can be reused without repeating the set-up procedure in every session, which makes the technique easier applicable. With our present data, we can show successful classification of event-related cortical potential patterns in CI users. In the future, this has the potential to objectify and automate parts of CI fitting procedures.

Thalamic and basal ganglia regions are involved in attentional processing of behaviorally significant events: evidence from simultaneous depth and scalp EEG

Extensive descriptions exist on cortical responses to change in the acoustic environment. However, the involvement of subcortical regions is not well understood. Here we present simultaneous recordings of cortical and subcortical event-related potentials (ERPs) to different pure tones in patients undergoing surgery for deep brain stimulation (DBS). These patients had externalized electrodes in the subthalamic nucleus (STN), the ventrolateral posterior thalamus (VLp) or the globus pallidus internus (GPi). Subcortical and cortical ERPs were analyzed upon presentation of one frequent non-target stimulus and two infrequent stimuli, either being a target or a distractor stimulus. The results revealed that amplitudes of scalp-recorded P3 and subcortical late attention-modulated responses (AMR) were largest upon presentation of target stimuli compared with distractor stimuli. This suggests that thalamic and basal ganglia regions are sensitive to behaviorally relevant auditory events. Comparison of the subcortical structures showed that responses in VLp have shorter latency than in GPi and STN. Further, the subcortical responses in VLp and STN emerged significantly prior to the cortical P3 response. Our findings point to higher-order cognitive functions already at a subcortical level. Auditory events are categorized as behaviorally relevant in subcortical loops involving basal ganglia and thalamic regions. This label is then distributed to cortical regions by ascending projections.

Perception of Iterated Rippled Noise Periodicity in Cochlear Implant Users

Pitch perception is more challenging for individuals with cochlear implants (CIs) than normal-hearing subjects because the signal processing by CIs is restricted. Processing and perceiving the periodicity of signals may contribute to pitch perception. Whether individuals with CIs can discern pitch within an iterated rippled noise (IRN) signal is still unclear. In a prospective controlled psychoacoustic study with 34 CI users and 15 normal-hearing control subjects, the difference limen between IRN signals with different numbers of iterations was measured. In 7 CI users and 15 normal-hearing control listeners with single-sided deafness, pitch matching between IRN and harmonic complex tones was measured. The pitch onset response (POR) following signal changes from white noise to IRN was measured electrophysiologically. The CI users could discriminate different numbers of iteration in IRN signals, but worse than normal-hearing listeners. A POR was measured for both normal-hearing subjects and CI users increasing with the pitch salience of the IRN. This indicates that the POR could serve as an objective measure to monitor progress during audioverbal therapy after CI surgery.

A New Method to Test the Efficiency of Cochlear Implant Artifacts Removal From Auditory Evoked Potentials

Auditory evoked potentials are of great interest to objectively evaluate the audition in cochlear implant (CI) recipients. However, these measures are impeded by CI stimulation electrical artifacts present in the EEG. In the first part, this paper investigates the use of a hybrid model approximating CI patient data. This model gives access to both uncontaminated and denoised data, thus allowing for the evaluation of CI artifact removal methods. Here the efficiency of independent component analysis (ICA) is evaluated in the context of auditory steady-state responses (ASSRs). A dedicated experimental setup was developed to simultaneously record EEG data from a normal hearing (NH) participant and CI artifact data from a phantom equipped with a CI. Hybrid data were obtained as a linear mixture of both sources. Amplitude-modulated continuous tones were used as stimuli to elicit ASSRs. After denoising, the comparison of denoised hybrid data and original NH data showed high correlations between the two datasets, demonstrating the efficiency of ICA. In the second part, the ICA was applied to real clinical CI ASSR data. Results support the usefulness of the methodology as regards the performance evaluation of signal processing methods applied to CI patient data prior to clinical application.

Human centromedian-parafascicular complex signals sensory cues for goal-oriented behavior selection

Experimental research has shown that the centromedian-parafascicular complex (CM-Pf) of the intralaminar thalamus is activated in attentional orienting and processing of behaviorally relevant stimuli. These observations resulted in the hypothesis that the CM-Pf plays a pivotal role in goal-oriented behavior selection. We here set out to test this hypothesis with electrophysiological recordings from patients with electrodes implanted in CM-Pf for deep brain stimulation (DBS) treatment of chronic neuropathic pain. Six patients participated in (1) an auditory three-class oddball experiment, which required a button press to target tones, but not to standard and deviant tones and in (2) a multi-speaker experiment with a target word that required attention selection and a target image that required response selection. Subjects showed transient neural responses (8-15Hz) to the target tone and the target word. Two subjects additionally showed transient neural responses (15-25Hz) to the target image. All sensory target stimuli were related to an internal goal and required a behavior selection (attention selection, response selection). In group analyses, neural responses were greater to target tones than deviant and standard tones and to target words than other task-relevant words that did not require attention selection. The transient neural responses occurred after the target stimuli but prior to the overt behavioral response. Our results demonstrate that in human subjects the CM-Pf is involved in signaling sensory inputs related to goal-oriented selection of behavior.

Auditory and audio-visual processing in patients with cochlear, auditory brainstem, and auditory midbrain implants: An EEG study

There is substantial variability in speech recognition ability across patients with cochlear implants (CIs), auditory brainstem implants (ABIs), and auditory midbrain implants (AMIs). To better understand how this variability is related to central processing differences, the current electroencephalography (EEG) study compared hearing abilities and auditory-cortex activation in patients with electrical stimulation at different sites of the auditory pathway. Three different groups of patients with auditory implants (Hannover Medical School; ABI: n = 6, CI: n = 6; AMI: n = 2) performed a speeded response task and a speech recognition test with auditory, visual, and audio-visual stimuli. Behavioral performance and cortical processing of auditory and audio-visual stimuli were compared between groups. ABI and AMI patients showed prolonged response times on auditory and audio-visual stimuli compared with NH listeners and CI patients. This was confirmed by prolonged N1 latencies and reduced N1 amplitudes in ABI and AMI patients. However, patients with central auditory implants showed a remarkable gain in performance when visual and auditory input was combined, in both speech and non-speech conditions, which was reflected by a strong visual modulation of auditory-cortex activation in these individuals. In sum, the results suggest that the behavioral improvement for audio-visual conditions in central auditory implant patients is based on enhanced audio-visual interactions in the auditory cortex. Their findings may provide important implications for the optimization of electrical stimulation and rehabilitation strategies in patients with central auditory prostheses. Hum Brain Mapp 38:2206-2225, 2017. © 2017 Wiley Periodicals, Inc.

When Hearing Is Tricky: Speech Processing Strategies in Prelingually Deafened Children and Adolescents with Cochlear Implants Having Good and Poor Speech Performance

Cochlear implants provide individuals who are deaf with access to speech. Although substantial advancements have been made by novel technologies, there still is high variability in language development during childhood, depending on adaptation and neural plasticity. These factors have often been investigated in the auditory domain, with the mismatch negativity as an index for sensory and phonological processing. Several studies have demonstrated that the MMN is an electrophysiological correlate for hearing improvement with cochlear implants. In this study, two groups of cochlear implant users, both with very good basic hearing abilities but with non-overlapping speech performance (very good or very poor speech performance), were matched according to device experience and age at implantation. We tested the perception of phonemes in the context of specific other phonemes from which they were very hard to discriminate (e.g., the vowels in /bu/ vs. /bo/). The most difficult pair was individually determined for each participant. Using behavioral measures, both cochlear implants groups performed worse than matched controls, and the good performers performed better than the poor performers. Cochlear implant groups and controls did not differ during time intervals typically used for the mismatch negativity, but earlier: source analyses revealed increased activity in the region of the right supramarginal gyrus (220-260 ms) in good performers. Poor performers showed increased activity in the left occipital cortex (220-290 ms), which may be an index for cross-modal perception. The time course and the neural generators differ from data from our earlier studies, in which the same phonemes were assessed in an easy-to-discriminate context. The results demonstrate that the groups used different language processing strategies, depending on the success of language development and the particular language context. Overall, our data emphasize the role of neural plasticity and use of adaptive strategies for successful language development with cochlear implants.

Consequences of Stimulus Type on Higher-Order Processing in Single-Sided Deaf Cochlear Implant Users

Single-sided deaf subjects with a cochlear implant (CI) provide the unique opportunity to compare central auditory processing of the electrical input (CI ear) and the acoustic input (normal-hearing, NH, ear) within the same individual. In these individuals, sensory processing differs between their two ears, while cognitive abilities are the same irrespectively of the sensory input. To better understand perceptual-cognitive factors modulating speech intelligibility with a CI, this electroencephalography study examined the central-auditory processing of words, the cognitive abilities, and the speech intelligibility in 10 postlingually single-sided deaf CI users. We found lower hit rates and prolonged response times for word classification during an oddball task for the CI ear when compared with the NH ear. Also, event-related potentials reflecting sensory (N1) and higher-order processing (N2/N4) were prolonged for word classification (targets versus nontargets) with the CI ear compared with the NH ear. Our results suggest that speech processing via the CI ear and the NH ear differs both at sensory (N1) and cognitive (N2/N4) processing stages, thereby affecting the behavioral performance for speech discrimination. These results provide objective evidence for cognition to be a key factor for speech perception under adverse listening conditions, such as the degraded speech signal provided from the CI.

Functional near-infrared spectroscopy for neuroimaging in cochlear implant recipients

Functional neuroimaging can provide insight into the neurobiological factors that contribute to the variations in individual hearing outcomes following cochlear implantation. To date, measuring neural activity within the auditory cortex of cochlear implant (CI) recipients has been challenging, primarily because the use of traditional neuroimaging techniques is limited in people with CIs. Functional near-infrared spectroscopy (fNIRS) is an emerging technology that offers benefits in this population because it is non-invasive, compatible with CI devices, and not subject to electrical artifacts. However, there are important considerations to be made when using fNIRS to maximize the signal to noise ratio and to best identify meaningful cortical responses. This review considers these issues, the current data, and future directions for using fNIRS as a clinical application in individuals with CIs. This article is part of a Special Issue entitled <Annual Reviews 2016>.

A neural-based vocoder implementation for evaluating cochlear implant coding strategies

Most simulations of cochlear implant (CI) coding strategies rely on standard vocoders that are based on purely signal processing techniques. However, these models neither account for various biophysical phenomena, such as neural stochasticity and refractoriness, nor for effects of electrical stimulation, such as spectral smearing as a function of stimulus intensity. In this paper, a neural model that accounts for stochastic firing, parasitic spread of excitation across neuron populations, and neuronal refractoriness, was developed and augmented as a preprocessing stage for a standard 22-channel noise-band vocoder. This model was used to subjectively and objectively assess consonant discrimination in commercial and experimental coding strategies. Stimuli consisting of consonant-vowel (CV) and vowel-consonant-vowel (VCV) tokens were processed by either the Advanced Combination Encoder (ACE) or the Excitability Controlled Coding (ECC) strategies, and later resynthesized to audio using the aforementioned vocoder model. Baseline performance was measured using unprocessed versions of the speech tokens. Behavioural responses were collected from seven normal hearing (NH) volunteers, while EEG data were recorded from five NH participants. Psychophysical results indicate that while there may be a difference in consonant perception between the two tested coding strategies, mismatch negativity (MMN) waveforms do not show any marked trends in CV or VCV contrast discrimination.

Auditory distraction transmitted by a cochlear implant alters allocation of attentional resources

Cochlear implants (CIs) are auditory prostheses which restore hearing via electrical stimulation of the auditory nerve. The successful adaptation of auditory cognition to the CI input depends to a substantial degree on individual factors. We pursued an electrophysiological approach toward an analysis of cortical responses that reflect perceptual processing stages and higher-level responses to CI input. Performance and event-related potentials on two cross-modal discrimination-following-distraction (DFD) tasks from CI users and normal-hearing (NH) individuals were compared. The visual-auditory distraction task combined visual distraction with following auditory discrimination performance. Here, we observed similar cortical responses to visual distractors (Novelty-N2) and slowed, less accurate auditory discrimination performance in CI users when compared to NH individuals. Conversely, the auditory-visual distraction task was used to combine auditory distraction with visual discrimination performance. In this task we found attenuated cortical responses to auditory distractors (Novelty-P3), slowed visual discrimination performance, and attenuated cortical P3-responses to visual targets in CI users compared to NH individuals. These results suggest that CI users process auditory distractors differently than NH individuals and that the presence of auditory CI input has an adverse effect on the processing of visual targets and the visual discrimination ability in implanted individuals. We propose that this attenuation of the visual modality occurs through the allocation of neural resources to the CI input.

Brain responses to musical feature changes in adolescent cochlear implant users

Cochlear implants (CIs) are primarily designed to assist deaf individuals in perception of speech, although possibilities for music fruition have also been documented. Previous studies have indicated the existence of neural correlates of residual music skills in postlingually deaf adults and children. However, little is known about the behavioral and neural correlates of music perception in the new generation of prelingually deaf adolescents who grew up with CIs. With electroencephalography (EEG), we recorded the mismatch negativity (MMN) of the auditory event-related potential to changes in musical features in adolescent CI users and in normal-hearing (NH) age mates. EEG recordings and behavioral testing were carried out before (T1) and after (T2) a 2-week music training program for the CI users and in two sessions equally separated in time for NH controls. We found significant MMNs in adolescent CI users for deviations in timbre, intensity, and rhythm, indicating residual neural prerequisites for musical feature processing. By contrast, only one of the two pitch deviants elicited an MMN in CI users. This pitch discrimination deficit was supported by behavioral measures, in which CI users scored significantly below the NH level. Overall, MMN amplitudes were significantly smaller in CI users than in NH controls, suggesting poorer music discrimination ability. Despite compliance from the CI participants, we found no effect of the music training, likely resulting from the brevity of the program. This is the first study showing significant brain responses to musical feature changes in prelingually deaf adolescent CI users and their associations with behavioral measures, implying neural predispositions for at least some aspects of music processing. Future studies should test any beneficial effects of a longer lasting music intervention in adolescent CI users.

Residual neural processing of musical sound features in adult cochlear implant users

Auditory processing in general and music perception in particular are hampered in adult cochlear implant (CI) users. To examine the residual music perception skills and their underlying neural correlates in CI users implanted in adolescence or adulthood, we conducted an electrophysiological and behavioral study comparing adult CI users with normal-hearing age-matched controls (NH controls). We used a newly developed musical multi-feature paradigm, which makes it possible to test automatic auditory discrimination of six different types of sound feature changes inserted within a musical enriched setting lasting only 20 min. The presentation of stimuli did not require the participants’ attention, allowing the study of the early automatic stage of feature processing in the auditory cortex. For the CI users, we obtained mismatch negativity (MMN) brain responses to five feature changes but not to changes of rhythm, whereas we obtained MMNs for all the feature changes in the NH controls. Furthermore, the MMNs to deviants of pitch of CI users were reduced in amplitude and later than those of NH controls for changes of pitch and guitar timber. No other group differences in MMN parameters were found to changes in intensity and saxophone timber. Furthermore, the MMNs in CI users reflected the behavioral scores from a respective discrimination task and were correlated with patients’ age and speech intelligibility. Our results suggest that even though CI users are not performing at the same level as NH controls in neural discrimination of pitch-based features, they do possess potential neural abilities for music processing. However, CI users showed a disrupted ability to automatically discriminate rhythmic changes compared with controls. The current behavioral and MMN findings highlight the residual neural skills for music processing even in CI users who have been implanted in adolescence or adulthood. Highlights: -

Automatic brain responses to musical feature changes reflect the limitations of central auditory processing in adult Cochlear Implant users.

-

The brains of adult CI users automatically process sound features changes even when inserted in a musical context.

-

CI users show disrupted automatic discriminatory abilities for rhythm in the brain.

-

Our fast paradigm demonstrate residual musical abilities in the brains of adult CI users giving hope for their future rehabilitation.

Accurate guitar tuning by cochlear implant musicians

Modern cochlear implant (CI) users understand speech but find difficulty in music appreciation due to poor pitch perception. Still, some deaf musicians continue to perform with their CI. Here we show unexpected results that CI musicians can reliably tune a guitar by CI alone and, under controlled conditions, match simultaneously presented tones to <0.5 Hz. One subject had normal contralateral hearing and produced more accurate tuning with CI than his normal ear. To understand these counterintuitive findings, we presented tones sequentially and found that tuning error was larger at ∼30 Hz for both subjects. A third subject, a non-musician CI user with normal contralateral hearing, showed similar trends in performance between CI and normal hearing ears but with less precision. This difference, along with electric analysis, showed that accurate tuning was achieved by listening to beats rather than discriminating pitch, effectively turning a spectral task into a temporal discrimination task.

An objective auditory measure to assess speech recognition in adult cochlear implant users

OBJECTIVE

To verify if a mismatch negativity (MMN) paradigm based on speech syllables can differentiate between good and poorer cochlear implant (CI) users on a speech recognition task.

METHODS

Twenty adults with a CI and 11 normal hearing adults participated in the study. Based on a speech recognition test, ten CI users were classified as good performers and ten as poor performers. We measured the MMN with /da/ as the standard stimulus and /ba/ and /ga/ as the deviants. Separate analyses were conducted on the amplitude and latency of the MMN.

RESULTS

A MMN was evoked by both deviant stimuli in all normal hearing participants and in well performing CI users, with similar amplitudes for both groups. However, the amplitude of the MMN was significantly reduced for the poorer CI users compared to the normal hearing group and the good CI users. The latency was longer for both groups of cochlear implant users. A bivariate correlation showed a significant positive correlation between the speech recognition score and the amplitude of the MMN.

CONCLUSIONS

The MMN can distinguish between CI users who have good versus poor speech recognition as assessed with conventional tasks.

SIGNIFICANCE

Our findings suggest that the MMN can be use to assess speech recognition proficiency in CI users who cannot be tested with regular speech recognition tasks, like infants and other non-verbal populations.

Beta-band activity in auditory pathways reflects speech localization and recognition in bilateral cochlear implant users

In normal-hearing listeners, localization of auditory speech involves stimulus processing in the postero-dorsal pathway of the auditory system. In quiet environments, bilateral cochlear implant (CI) users show high speech recognition performance, but localization of auditory speech is poor, especially when discriminating stimuli from the same hemifield. Whether this difficulty relates to the inability of the auditory system to translate binaural electrical cues into neural signals, or to a functional reorganization of auditory cortical pathways following long periods of binaural deprivation is unknown. In this electroencephalography study, we examined the processing of auditory syllables in postlingually deaf adults with bilateral CIs and in normal-hearing adults. Participants were instructed to either recognize ("recognition" task) or localize ("localization" task) the syllables. The analysis focused on event-related potentials and oscillatory brain responses. N1 amplitudes in CI users were larger in the localization compared with recognition task, suggesting an enhanced stimulus processing effort in the localization task. Linear beamforming of oscillatory activity in CI users revealed stronger suppression of beta-band activity after 200 ms in the postero-dorsal auditory pathway for the localization compared with the recognition task. In normal-hearing adults, effects for longer latency event-related potentials were found, but no effects were observed for N1 amplitudes or beta-band responses. Our study suggests that difficulties in speech localization in bilateral CI users are not reflected in a functional reorganization of cortical auditory pathways. New signal processing strategies of cochlear devices preserving unambiguous binaural cues may improve auditory localization performance in bilateral CI users.

Neural correlates of speech processing in prelingually deafened children and adolescents with cochlear implants

Prelingually deafened children with cochlear implants stand a good chance of developing satisfactory speech performance. Nevertheless, their eventual language performance is highly variable and not fully explainable by the duration of deafness and hearing experience. In this study, two groups of cochlear implant users (CI groups) with very good basic hearing abilities but non-overlapping speech performance (very good or very bad speech performance) were matched according to hearing age and age at implantation. We assessed whether these CI groups differed with regard to their phoneme discrimination ability and auditory sensory memory capacity, as suggested by earlier studies. These functions were measured behaviorally and with the Mismatch Negativity (MMN). Phoneme discrimination ability was comparable in the CI group of good performers and matched healthy controls, which were both better than the bad performers. Source analyses revealed larger MMN activity (155-225 ms) in good than in bad performers, which was generated in the frontal cortex and positively correlated with measures of working memory. For the bad performers, this was followed by an increased activation of left temporal regions from 225 to 250 ms with a focus on the auditory cortex. These results indicate that the two CI groups developed different auditory speech processing strategies and stress the role of phonological functions of auditory sensory memory and the prefrontal cortex in positively developing speech perception and production.

Electrophysiological responses to emotional prosody perception in cochlear implant users

The present electroencephalographic (EEG) study investigated the ability of cochlear implant (CI) users to recognize emotional prosody. Two CI speech-processing strategies were compared: the ACE (Advance Combination Encoder) and the newly developed MP3000. Semantically neutral sentences spoken in three different emotional prosodies (neutral, angry, happy) were presented to 20 post-lingually deafened CI users and age-matched normal-hearing controls. Event related potentials (ERPs) were recorded to study the N100 and the P200 responses. In addition, event-related spectral power modulations were calculated to study the brain activity corresponding to the recognition of prosody in earlier (0–400) as well as later (600–1200) part of the stimuli where the prosodic features differed maximally. CI users with MP3000 strategy showed a higher proportion of correctly recognized prosodic information compared to the ACE strategy users. Our ERP results demonstrated that emotional prosody elicited significant N100 and P200 peaks. Furthermore, the P200 amplitude in response to happy prosodic information was significantly more positive for the MP3000 strategy compared to the ACE strategy. On spectral power analysis, two typical gamma activities were observed in the MP3000 users only: (1) an early gamma activity in the 100–250 ms time window reflecting bottom–up attention regulation; and (2) a late gamma activity between 900 and 1100 ms post-stimulus onset, probably reflecting top–down cognitive control. Our study suggests that the MP3000 strategy is better than ACE in regard to happy prosody perception. Furthermore, we show that EEG is a useful tool that, in combination with behavioral analysis, can reveal differences between two CI processing strategies for coding of prosody-specific features of language.

Minimization of cochlear implant artifact in cortical auditory evoked potentials in children

OBJECTIVES

In congenitally deaf children fit with a cochlear implant, little is known about the maturation of the auditory cortex. Cortical auditory evoked potentials are a useful methodology to study the auditory cortical system of children with cochlear implants. Nevertheless, these recordings are contaminated by a cochlear implant artifact. The objective of this study was to use independent component analysis to minimize the artifact of the cochlear implant to study cortical auditory evoked potentials.

STUDY DESIGN

Prospective study.

METHOD

A total of 5 children ranging in age from 21 to 49 months who were fitted with a cochlear implant for at least 6 months were included in this study. The stimuli were pure tones (750 Hz, 200 ms duration, 70 dB SPL) presented with an irregular interstimulus interval (1000-2000 ms) via loud speakers. The cortical auditory evoked potentials were recorded from 17 Ag-AgCl electrodes referenced to the nose. The peak latency and amplitude of each deflection culminating at the fronto-central and temporal sites were analyzed.

MAIN OUTCOME MEASURES

The P100-N250 peak latencies and amplitudes of the cortical auditory evoked potentials recorded from children fitted with cochlear implants. Scalp map potentials distributions were done for each child for the N250 wave.

RESULTS

The use of independent component analysis permitted to minimize the cochlear implant artifact for the five children. Cortical auditory evoked potentials were recorded at fronto-central and temporal sites. Scalp map potentials distributions for the N2 wave showed activation of temporal generators contralateral at the CI for the five children.

CONCLUSION

This preliminary electrophysiological study confirms the value and the limits of independent component analysis. It could allow longitudinal studies in cochlear implant users to examine the maturation of auditory cortex. It could also be used to identify objective cortical electrophysiological measures to help the fitting of CIs in children.