Spectral processing in cochlear implants

Implicit Processing of Pitch in Postlingually Deafened Cochlear Implant Users

Cochlear implant (CI) users can only access limited pitch information through their device, which hinders music appreciation. Poor music perception may not only be due to CI technical limitations; lack of training or negative attitudes toward the electric sound might also contribute to it. Our study investigated with an implicit (indirect) investigation method whether poorly transmitted pitch information, presented as musical chords, can activate listeners’ knowledge about musical structures acquired prior to deafness. Seven postlingually deafened adult CI users participated in a musical priming paradigm investigating pitch processing without explicit judgments. Sequences made of eight sung-chords that ended on either a musically related (expected) target chord or a less-related (less-expected) target chord were presented. The use of a priming task based on linguistic features allowed CI patients to perform fast judgments on target chords in the sung music. If listeners’ musical knowledge is activated and allows for tonal expectations (as in normal-hearing listeners), faster response times were expected for related targets than less-related targets. However, if the pitch percept is too different and does not activate musical knowledge acquired prior to deafness, storing pitch information in a short-term memory buffer predicts the opposite pattern. If transmitted pitch information is too poor, no difference in response times should be observed. Results showed that CI patients were able to perform the linguistic task on the sung chords, but correct response times indicated sensory priming, with faster response times observed for the less-related targets: CI patients processed at least some of the pitch information of the musical sequences, which was stored in an auditory short-term memory and influenced chord processing. This finding suggests that the signal transmitted via electric hearing led to a pitch percept that was too different from that based on acoustic hearing, so that it did not automatically activate listeners’ previously acquired musical structure knowledge. However, the transmitted signal seems sufficiently informative to lead to sensory priming. These findings are encouraging for the development of pitch-related training programs for CI patients, despite the current technological limitations of the CI coding.

Perception of Cantonese Lexical Tones by Pediatric Cochlear Implant Users

PURPOSE

The purpose of this study is to assess Cantonese word recognition and the discrimination of Cantonese tones with manipulated contours by child and adolescent cochlear implant (CI) users and a group of peers with normal hearing (NH). It was hypothesized that the CI users would perform more poorly than their counterparts with NH in both tasks and that CI users implanted before 2 years of age would perform better than those implanted after 2 years.

METHOD

Forty-one participants were recruited from hospitals, schools, and kindergartens in Hong Kong: Ten CI users implanted at or before 2 years of age ("early" CI group), 13 CI users implanted after 2 years of age ("late" CI group), and 18 individuals with NH. The mean age at implantation of the early CI group was 1.5 years (SD = 0.3), and for the late CI group, it was 4.3 years (SD = 2.1). Participants were a mean of 13.3 years of age (SD = 3.7) at time of testing. Participants completed a Cantonese word recognition test and a discrimination task using Cantonese tones with modified fundamental frequency trajectories.

RESULTS

Both CI user groups obtained significantly lower scores than the group with NH on the word recognition test. Mean percent correct scores for the word recognition test were 79% for the early CI group, 69% for the late CI group, and 97% for the group with NH. The group with NH consistently achieved higher scores than the CI user groups when discriminating manipulated Cantonese tones. Increasing the acoustic difference between tones improved discrimination performance for CI users for level tone contrasts only. CI users implanted at or before 2 years of age obtained higher scores than those implanted later.

CONCLUSIONS

The results of this study add further evidence that children using CIs do not perform as well as peers in perceiving Cantonese tones. Modification of tones to increase pitch range did not consistently improve the ability of children with implants to perceive the difference between tones. Further research is required to fully assess potential benefits of early implantation for speakers of tonal languages.

SUPPLEMENTAL MATERIALS

https://doi.org/10.23641/asha.5782209.

fMRI as a Preimplant Objective Tool to Predict Postimplant Oral Language Outcomes in Children with Cochlear Implants

OBJECTIVES

Despite the positive effects of cochlear implantation, postimplant variability in speech perception and oral language outcomes is still difficult to predict. The aim of this study was to identify neuroimaging biomarkers of postimplant speech perception and oral language performance in children with hearing loss who receive a cochlear implant. The authors hypothesized positive correlations between blood oxygen level-dependent functional magnetic resonance imaging (fMRI) activation in brain regions related to auditory language processing and attention and scores on the Clinical Evaluation of Language Fundamentals-Preschool, Second Edition (CELF-P2) and the Early Speech Perception Test for Profoundly Hearing-Impaired Children (ESP), in children with congenital hearing loss.

DESIGN

Eleven children with congenital hearing loss were recruited for the present study based on referral for clinical MRI and other inclusion criteria. All participants were <24 months at fMRI scanning and <36 months at first implantation. A silent background fMRI acquisition method was performed to acquire fMRI during auditory stimulation. A voxel-based analysis technique was utilized to generate z maps showing significant contrast in brain activation between auditory stimulation conditions (spoken narratives and narrow band noise). CELF-P2 and ESP were administered 2 years after implantation. Because most participants reached a ceiling on ESP, a voxel-wise regression analysis was performed between preimplant fMRI activation and postimplant CELF-P2 scores alone. Age at implantation and preimplant hearing thresholds were controlled in this regression analysis.

RESULTS

Four brain regions were found to be significantly correlated with CELF-P2 scores. These clusters of positive correlation encompassed the temporo-parieto-occipital junction, areas in the prefrontal cortex and the cingulate gyrus. For the story versus silence contrast, CELF-P2 core language score demonstrated significant positive correlation with activation in the right angular gyrus (r = 0.95), left medial frontal gyrus (r = 0.94), and left cingulate gyrus (r = 0.96). For the narrow band noise versus silence contrast, the CELF-P2 core language score exhibited significant positive correlation with activation in the left angular gyrus (r = 0.89; for all clusters, corrected p < 0.05).

CONCLUSIONS

Four brain regions related to language function and attention were identified that correlated with CELF-P2. Children with better oral language performance postimplant displayed greater activation in these regions preimplant. The results suggest that despite auditory deprivation, these regions are more receptive to gains in oral language development performance of children with hearing loss who receive early intervention via cochlear implantation. The present study suggests that oral language outcome following cochlear implant may be predicted by preimplant fMRI with auditory stimulation using natural speech.

Fitting prelingually deafened adult cochlear implant users based on electrode discrimination performance

OBJECTIVE

This study investigated the hypotheses that (1) prelingually deafened CI users do not have perfect electrode discrimination ability and (2) the deactivation of non-discriminable electrodes can improve auditory performance.

DESIGN

Electrode discrimination difference limens were determined for all electrodes of the array. The subjects' basic map was subsequently compared to an experimental map, which contained only discriminable electrodes, with respect to speech understanding in quiet and in noise, listening effort, spectral ripple discrimination and subjective appreciation.

STUDY SAMPLE

Subjects were six prelingually deafened, late implanted adults using the Nucleus cochlear implant.

RESULTS

Electrode discrimination difference limens across all subjects and electrodes ranged from 0.5 to 7.125, with significantly larger limens for basal electrodes. No significant differences were found between the basic map and the experimental map on auditory tests. Subjective appreciation was found to be significantly poorer for the experimental map.

CONCLUSIONS

Prelingually deafened CI users were unable to discriminate between all adjacent electrodes. There was no difference in auditory performance between the basic and experimental map. Potential factors contributing to the absence of improvement with the experimental map include the reduced number of maxima, incomplete adaptation to the new frequency allocation, and the mainly basal location of deactivated electrodes.

The Effect of Short-Term Auditory Training on Speech in Noise Perception and Cortical Auditory Evoked Potentials in Adults with Cochlear Implants

This study investigated whether a short intensive psychophysical auditory training program is associated with speech perception benefits and changes in cortical auditory evoked potentials (CAEPs) in adult cochlear implant (CI) users. Ten adult implant recipients trained approximately 7 hours on psychophysical tasks (Gap-in-Noise Detection, Frequency Discrimination, Spectral Rippled Noise [SRN], Iterated Rippled Noise, Temporal Modulation). Speech performance was assessed before and after training using Lexical Neighborhood Test (LNT) words in quiet and in eight-speaker babble. CAEPs evoked by a natural speech stimulus /baba/ with varying syllable stress were assessed pre- and post-training, in quiet and in noise. SRN psychophysical thresholds showed a significant improvement (78% on average) over the training period, but performance on other psychophysical tasks did not change. LNT scores in noise improved significantly post-training by 11% on average compared with three pretraining baseline measures. N1P2 amplitude changed post-training for /baba/ in quiet (p = 0.005, visit 3 pretraining versus visit 4 post-training). CAEP changes did not correlate with behavioral measures. CI recipients' clinical records indicated a plateau in speech perception performance prior to participation in the study. A short period of intensive psychophysical training produced small but significant gains in speech perception in noise and spectral discrimination ability. There remain questions about the most appropriate type of training and the duration or dosage of training that provides the most robust outcomes for adults with CIs.

[The current state and prospects of the development of cochlear implantation]

This paper reports the literature data summarizing the recent achievements in the field of rehabilitation of the patients suffering from deafness and serious impairment of hearing with the use of cochlear implantation. Much attention is given to the limitations of the modern strategies of signal processing and the prospects for the further development of scientific research in this area. Special emphasis is laid on recent progress in audiology including the binaural cochlear implant technology and the electroacoustic stimulation facilitating significant improvement in the outcomes of rehabilitation of the patients. Also, the prospects for the further developments in the field of construction of the new cochlear implantations systems, the novel algorithms for information processing, and the original therapeutic modalities designed to stimulated the growth of axonal processed of the spiral ganglion and their outgrowths into the electrode system.

Gender categorization in cochlear implant users

PURPOSE

In this study, the authors examined the ability of subjects with cochlear implants (CIs) to discriminate voice gender and how this ability evolved as a function of CI experience.

METHOD

The authors presented a continuum of voice samples created by voice morphing, with 9 intermediate acoustic parameter steps between a typical male and a typical female. This method allowed for the evaluation of gender categorization not only when acoustical features were specific to gender but also for more ambiguous cases, when fundamental frequency or formant distribution were located between typical values.

RESULTS

Results showed a global, though variable, deficit for voice gender categorization in CI recipients compared with subjects with normal hearing. This deficit was stronger for ambiguous stimuli in the voice continuum: Average performance scores for CI users were 58% lower than average scores for subjects with normal hearing in cases of ambiguous stimuli and 19% lower for typical male and female voices. The authors found no significant improvement in voice gender categorization with CI experience.

CONCLUSIONS

These results emphasize the dissociation between recovery of speech recognition and voice feature perception after cochlear implantation. This large and durable deficit may be related to spectral and temporal degradation induced by CI sound coding, or it may be related to central voice processing deficits.

Effects of neonatal partial deafness and chronic intracochlear electrical stimulation on auditory and electrical response characteristics in primary auditory cortex

The use of cochlear implants in patients with severe hearing losses but residual low-frequency hearing raises questions concerning the effects of chronic intracochlear electrical stimulation (ICES) on cortical responses to auditory and electrical stimuli. We investigated these questions by studying responses to tonal and electrical stimuli in primary auditory cortex (AI) of two groups of neonatally deafened cats with residual high-threshold, low-frequency hearing. One group were implanted with a multi-channel intracochlear electrode at 8 weeks of age, and received chronic ICES for up to 9 months before cortical recording. Cats in the other group were implanted immediately prior to cortical recording as adults. In all cats in both groups, multi-neuron responses throughout the rostro-caudal extent of AI had low characteristic frequencies (CFs), in the frequency range of the residual hearing, and high-thresholds. Threshold and minimum latency at CF did not differ between the groups, but in the chronic ICES animals there was a higher proportion of electrically but not acoustically excited recording sites. Electrical response thresholds were higher and latencies shorter in the chronically stimulated animals. Thus, chronic implantation and ICES affected the extent of AI that could be activated by acoustic stimuli and resulted in changes in electrical response characteristics.

Voice gender perception by cochlear implantees

Gender identification of human voices was studied in a juvenile population of cochlear implant (CI) users exposed to naturalistic speech stimuli from 20 male and 20 female speakers using two different voice gender perception tasks. Stimulus output patterns were recorded from each individual CI for each stimulus, and features related to voice fundamental frequency and spectral envelope were extracted from these electrical output signals to evaluate the relationship between implant output and behavioral performance. In spite of the fact that temporal and place cues of similar quality were produced by all CI devices, only about half of the subjects were able to label male and female voices correctly. Participants showed evidence of using available temporal cues, but showed no evidence of using place cues. The implants produced a consistent and novel cue to voice gender that participants did not appear to utilize. A subgroup of participants could discriminate male and female voices when two contrasting voices were presented in succession, but were unable to identify gender when voices were singly presented. It is suggested that the nature of long-term auditory categorical memories needs to be studied in more detail in these individuals.

Cochlear implants: a remarkable past and a brilliant future

The aims of this paper are to (i) provide a brief history of cochlear implants; (ii) present a status report on the current state of implant engineering and the levels of speech understanding enabled by that engineering; (iii) describe limitations of current signal processing strategies; and (iv) suggest new directions for research. With current technology the "average" implant patient, when listening to predictable conversations in quiet, is able to communicate with relative ease. However, in an environment typical of a workplace the average patient has a great deal of difficulty. Patients who are "above average" in terms of speech understanding, can achieve 100% correct scores on the most difficult tests of speech understanding in quiet but also have significant difficulty when signals are presented in noise. The major factors in these outcomes appear to be (i) a loss of low-frequency, fine structure information possibly due to the envelope extraction algorithms common to cochlear implant signal processing; (ii) a limitation in the number of effective channels of stimulation due to overlap in electric fields from electrodes; and (iii) central processing deficits, especially for patients with poor speech understanding. Two recent developments, bilateral implants and combined electric and acoustic stimulation, have promise to remediate some of the difficulties experienced by patients in noise and to reinstate low-frequency fine structure information. If other possibilities are realized, e.g., electrodes that emit drugs to inhibit cell death following trauma and to induce the growth of neurites toward electrodes, then the future is very bright indeed.

Auditory cortical plasticity: does it provide evidence for cognitive processing in the auditory cortex?

The past 20 years have seen substantial changes in our view of the nature of the processing carried out in auditory cortex. Some processing of a cognitive nature, previously attributed to higher-order "association" areas, is now considered to take place in auditory cortex itself. One argument adduced in support of this view is the evidence indicating a remarkable degree of plasticity in the auditory cortex of adult animals. Such plasticity has been demonstrated in a wide range of paradigms, in which auditory input or the behavioural significance of particular inputs is manipulated. Changes over the same time period in our conceptualization of the receptive fields of cortical neurons, and well-established mechanisms for use-related changes in synaptic function, can account for many forms of auditory cortical plasticity. On the basis of a review of auditory cortical plasticity and its probable mechanisms, it is argued that only plasticity associated with learning tasks provides a strong case for cognitive processing in auditory cortex. Even in this case the evidence is indirect, in that it has not yet been established that the changes in auditory cortex are necessary for behavioural learning and memory. Although other lines of evidence provide convincing support for cognitive processing in auditory cortex, that provided by auditory cortical plasticity remains equivocal.