Acoustic model investigation of a multiple carrier frequency algorithm for encoding fine frequency structure: implications for cochlear implants

Music perception and training for pediatric cochlear implant users

INTRODUCTION

Cochlear implants (CIs) are biomedical devices that restore sound perception for people with severe-to-profound sensorineural hearing loss. Most postlingually deafened CI users are able to achieve excellent speech recognition in quiet environments. However, current CI sound processors remain limited in their ability to deliver fine spectrotemporal information, making it difficult for CI users to perceive complex sounds. Limited access to complex acoustic cues such as music, environmental sounds, lexical tones, and voice emotion may have significant ramifications on quality of life, social development, and community interactions.

AREAS COVERED

The purpose of this review article is to summarize the literature on CIs and music perception, with an emphasis on music training in pediatric CI recipients. The findings have implications on our understanding of noninvasive, accessible methods for improving auditory processing and may help advance our ability to improve sound quality and performance for implantees.

EXPERT OPINION

Music training, particularly in the pediatric population, may be able to continue to enhance auditory processing even after performance plateaus. The effects of these training programs appear generalizable to non-trained musical tasks, speech prosody and, emotion perception. Future studies should employ rigorous control groups involving a non-musical acoustic intervention, standardized auditory stimuli, and the provision of feedback.

Compensation for channel interaction in a simultaneous cochlear implant coding strategy

This study evaluated a concept to reduce detrimental effects of spatial channel interaction in case of simultaneous stimulation with cochlear implants. The hypothesis was that effects of simultaneous channel interaction can be compensated by an algorithm such that no difference in hearing performance between simultaneous pulsatile stimulation and a strictly sequential reference strategy can be found. The simultaneous strategies used in this study stimulated two or three electrodes simultaneously in a monopolar configuration and used a specific compensation algorithm to reduce detrimental effects of simultaneous channel interaction. Overall stimulation rate was kept constant throughout conditions. Three of the configurations applied extended pulse phase durations. The German Oldenburg sentence and a German vowel test were used to measure speech recognition in 12 cochlear implant users. The results support the initial hypothesis. No significant differences in performance were found. A small spatial distance between simultaneous electrodes yielded slightly better results than a large distance. Extending the pulse phase durations had no significant effect on hearing performance. However, it significantly reduced stimulation amplitudes. Thus strategies implementing channel interaction compensated simultaneous stimulation with extended pulse phase durations might be a viable option for reducing power consumption and increasing battery life in cochlear implants.

Effects of fine structure and extended low frequencies in pediatric cochlear implant recipients

OBJECTIVE

In recent years, new speech coding strategies have been developed with the aim of improving the transmission of temporal fine structure to cochlear implant recipients. This study reports on the implementation of one such strategy (fine structure processing, FSP) in children.

METHODS

This was a prospective study investigating the upgrade to a new speech processor. The upgrade used a repeated measures design with an alternating order of conditions (A-B-A-B design). Twelve pre- and perilingually deaf children with MED-EL C40+ cochlear implants were enrolled in the study. Patients were upgraded from their Tempo+ speech processor, which used continuous interleaved sampling (CIS) in combination with a frequency spectrum of 200-8500 Hz, to an Opus speech processor, which used FSP with an extended frequency spectrum of 70-8500 Hz. The primary means of testing was an HSM (Hochmair, Schulz and Moser) sentence test at 65 and 80 dB in quiet. In addition, the "Mainzer Kindersprachtest" (Mainz audiometric speech test for children) was applied at 65 and 70 dB.

RESULTS

When the new FSP speech processor was used together with the extended low frequency range, HSM sentence tests at 65 and 80 dB resulted in scores indicating statistically significant improvements of 7.1 and 9.9 percentage points, respectively. Scores in the "Mainzer Kindersprachtest" at 65 and 70 dB indicated statistically significant improvements of 9.3 and 6.1 percentage points, respectively.

CONCLUSIONS

The present study clearly shows that children benefit from the fine structure speech coding strategy in combination with an extended frequency spectrum in the low frequencies, as is offered by the Opus speech processors. This should be taken into consideration when fitting pre- and perilingually deaf children implanted almost a decade previously.

The performance of different synthesis signals in acoustic models of cochlear implants

Synthesis (carrier) signals in acoustic models embody assumptions about perception of auditory electric stimulation. This study compared speech intelligibility of consonants and vowels processed through a set of nine acoustic models that used Spectral Peak (SPEAK) and Advanced Combination Encoder (ACE)-like speech processing, using synthesis signals which were representative of signals used previously in acoustic models as well as two new ones. Performance of the synthesis signals was determined in terms of correspondence with cochlear implant (CI) listener results for 12 attributes of phoneme perception (consonant and vowel recognition; F1, F2, and duration information transmission for vowels; voicing, manner, place of articulation, affrication, burst, nasality, and amplitude envelope information transmission for consonants) using four measures of performance. Modulated synthesis signals produced the best correspondence with CI consonant intelligibility, while sinusoids, narrow noise bands, and varying noise bands produced the best correspondence with CI vowel intelligibility. The signals that performed best overall (in terms of correspondence with both vowel and consonant attributes) were modulated and unmodulated noise bands of varying bandwidth that corresponded to a linearly varying excitation width of 0.4 mm at the apical to 8 mm at the basal channels.

The intelligibility of pointillistic speech

A form of processed speech is described that is highly discriminable in a closed-set identification format. The processing renders speech into a set of sinusoidal pulses played synchronously across frequency. The processing and results from several experiments are described. The number and width of frequency analysis channels and tone-pulse duration were variables. In one condition, various proportions of the tones were randomly removed. The processed speech was remarkably resilient to these manipulations. This type of speech may be useful for examining multitalker listening situations in which a high degree of stimulus control is required.

Investigating the effects of stimulus duration and context on pitch perception by cochlear implant users

Cochlear implant sound processing strategies that use time-varying pulse rates to transmit fine structure information are one proposed method for improving the spectral representation of a sound with the eventual goal of improving speech recognition in noisy conditions, speech recognition in tonal languages, and music identification and appreciation. However, many of the perceptual phenomena associated with time-varying rates are not well understood. In this study, the effects of stimulus duration on both the place and rate-pitch percepts were investigated via psychophysical experiments. Four Nucleus CI24 cochlear implant users participated in these experiments, which included a short-duration pitch ranking task and three adaptive pulse rate discrimination tasks. When duration was fixed from trial-to-trial and rate was varied adaptively, results suggested that both the place-pitch and rate-pitch percepts may be independent of duration for durations above 10 and 20 ms, respectively. When duration was varied and pulse rates were fixed, performance was highly variable within and across subjects. Implications for multi-rate sound processing strategies are discussed.

Speech recognition in cochlear implant recipients: comparison of standard HiRes and HiRes 120 sound processing

OBJECTIVE

HiRes (HR) 120 is a sound-processing strategy purported to offer an increase in the precision of frequency-to-place mapping through the use of current steering. This within-subject study was designed to compare speech recognition as well as music and sound quality ratings for HR and HR 120 processing.

SETTING

Cochlear implant/tertiary referral center.

SUBJECTS

Eight postlinguistically deafened adults implanted with an Advanced Bionics CII or HR 90K cochlear implant. STUDY DESIGN/MAIN OUTCOME MEASURES: Performance with HR and HR 120 was assessed during 4 test sessions with a battery of measures including monosyllabic words, sentences in quiet and in noise, and ratings of sound quality and musical passages.

RESULTS

Compared with HR, speech recognition results in adult cochlear implant recipients revealed small but significant improvements with HR 120 for single syllable words and for 2 of 3 sentence recognition measures in noise. Both easy and more difficult sentence material presented in quiet were not significantly different between strategies. Additionally, music quality ratings were significantly better for HR 120 than for HR, and 7 of 8 subjects preferred HR 120 over HR for listening in everyday life.

CONCLUSION

HR 120 may offer equivalent or improved benefit to patients compared with HR. Differences in performance on test measures between strategies are dependent on speech recognition materials and listening conditions.

Cochlear implants: system design, integration, and evaluation

As the most successful neural prosthesis, cochlear implants have provided partial hearing to more than 120000 persons worldwide; half of which being pediatric users who are able to develop nearly normal language. Biomedical engineers have played a central role in the design, integration and evaluation of the cochlear implant system, but the overall success is a result of collaborative work with physiologists, psychologists, physicians, educators, and entrepreneurs. This review presents broad yet in-depth academic and industrial perspectives on the underlying research and ongoing development of cochlear implants. The introduction accounts for major events and advances in cochlear implants, including dynamic interplays among engineers, scientists, physicians, and policy makers. The review takes a system approach to address critical issues in cochlear implant research and development. First, the cochlear implant system design and specifications are laid out. Second, the design goals, principles, and methods of the subsystem components are identified from the external speech processor and radio frequency transmission link to the internal receiver, stimulator and electrode arrays. Third, system integration and functional evaluation are presented with respect to safety, reliability, and challenges facing the present and future cochlear implant designers and users. Finally, issues beyond cochlear implants are discussed to address treatment options for the entire spectrum of hearing impairment as well as to use the cochlear implant as a model to design and evaluate other similar neural prostheses such as vestibular and retinal implants.

Mandarin Chinese tone identification in cochlear implants: predictions from acoustic models

It has been established that current cochlear implants do not supply adequate spectral information for perception of tonal languages. Comprehension of a tonal language, such as Mandarin Chinese, requires recognition of lexical tones. New strategies of cochlear stimulation such as variable stimulation rate and current steering may provide the means of delivering more spectral information and thus may provide the auditory fine-structure required for tone recognition. Several cochlear implant signal processing strategies are examined in this study, the continuous interleaved sampling (CIS) algorithm, the frequency amplitude modulation encoding (FAME) algorithm, and the multiple carrier frequency algorithm (MCFA). These strategies provide different types and amounts of spectral information. Pattern recognition techniques can be applied to data from Mandarin Chinese tone recognition tasks using acoustic models as a means of testing the abilities of these algorithms to transmit the changes in fundamental frequency indicative of the four lexical tones. The ability of processed Mandarin Chinese tones to be correctly classified may predict trends in the effectiveness of different signal processing algorithms in cochlear implants. The proposed techniques can predict trends in performance of the signal processing techniques in quiet conditions but fail to do so in noise.

Assessing the pitch structure associated with multiple rates and places for cochlear implant users

Cochlear implant subjects continue to experience difficulty understanding speech in noise and performing pitch-based musical tasks. Acoustic model studies have suggested that transmitting additional fine structure via multiple stimulation rates is a potential mechanism for addressing these issues [Nie et al., IEEE Trans. Biomed. Eng. 52, 64-73 (2005); Throckmorton et al., Hear. Res. 218, 30-42 (2006)]; however, results from preliminary cochlear implant studies have been less compelling. Multirate speech processing algorithms previously assumed a place-dependent pitch structure in that a basal electrode would always elicit a higher pitch percept than an apical electrode, independent of stimulation rate. Some subjective evidence contradicts this assumption [H. J. McDermott and C. M. McKay, J. Acoust. Soc. Am. 101, 1622-1630 (1997); R. V. Shannon, Hear. Res. 11, 157-189 (1983)]. The purpose of this study is to test the hypothesis that the introduction of multiple rates may invalidate the tonotopic pitch structure resulting from place-pitch alone. The SPEAR3 developmental speech processor was used to collect psychophysical data from five cochlear implant users to assess the tonotopic structure for stimuli presented at two rates on all active electrodes. Pitch ranking data indicated many cases where pitch percepts overlapped across electrodes and rates. Thus, the results from this study suggest that pitch-based tuning across rate and electrode may be necessary to optimize performance of a multirate sound processing strategy in cochlear implant subjects.

Speech perception problems of the hearing impaired reflect inability to use temporal fine structure

People with sensorineural hearing loss have difficulty understanding speech, especially when background sounds are present. A reduction in the ability to resolve the frequency components of complex sounds is one factor contributing to this difficulty. Here, we show that a reduced ability to process the temporal fine structure of sounds plays an important role. Speech sounds were processed by filtering them into 16 adjacent frequency bands. The signal in each band was processed by using the Hilbert transform so as to preserve either the envelope (E, the relatively slow variations in amplitude over time) or the temporal fine structure (TFS, the rapid oscillations with rate close to the center frequency of the band). The band signals were then recombined and the stimuli were presented to subjects for identification. After training, normal-hearing subjects scored perfectly with unprocessed speech, and were approximately 90% correct with E and TFS speech. Both young and elderly subjects with moderate flat hearing loss performed almost as well as normal with unprocessed and E speech but performed very poorly with TFS speech, indicating a greatly reduced ability to use TFS. For the younger hearing-impaired group, TFS scores were highly correlated with the ability to take advantage of temporal dips in a background noise when identifying unprocessed speech. The results suggest that the ability to use TFS may be critical for "listening in the background dips." TFS stimuli may be useful in evaluating impaired hearing and in guiding the design of hearing aids and cochlear implants.