Computer-Assisted Speech Training for Cochlear Implant Patients: Feasibility, Outcomes, and Future Directions

Current practices and opinions on auditory training in adult cochlear implant recipients

OBJECTIVE

To examine current practices and opinions of cochlear implant (CI) providers with respect to post-implantation auditory training.

METHODS

A survey was submitted to the American Cochlear Implant Alliance membership that reviewed current practice and opinions with respect to post-implantation auditory training for adult CI recipients.

MAIN OUTCOME MEASURES

Review of respondent practice, center volume, role on CI team, and current usage and opinions surrounding auditory training, including resources used and schedule of use.

RESULTS

Most (79 %) of the 79 CI providers surveyed reported working at academic centers, 34 % at high-volume centers (>150 CIs/year), and 38 % were surgeons. Nearly all (99 %) respondents recommend auditory training for new adult CI recipients. Just over half (52 %) provide auditory training resources to the patient in the form of a broad list of patient-directed exercises from which a patient could select. A specific training resource, generally a computer-based auditory training program (e.g., AngelSound™), is recommended to patients by 30 % of the respondents. Regarding timing of rehabilitation, median preferred start time was 0 months (interquartile range [IQR] 0-1) post-activation. Sessions were preferably performed for a median of 3 h per week (IQR 2-4) and continued for a median of 12 months (IQR 6-12). Recommendations for auditory training were fairly consistent between surgeon and non-surgeon providers and by center volume. Non-surgeons more often had specific recommendations on training resources, benefits of music, and training condition (e.g., contralateral ear plugged).

CONCLUSIONS

Despite a lack of clinical guidelines for adult post-implantation auditory training, a cross-sectional survey of providers' current practices and opinions demonstrates that these services are widely recommended and regarded as valuable. Training is almost universally patient-directed and believed to be most beneficial if started soon after activation. Interestingly, specific recommendations for which training approaches to use are not common, suggesting a gap in provider knowledge of which resources are most efficacious.

Effectiveness of Computerized Auditory Training on Speech Perception in Children With Hearing Loss: A Systematic Review

PURPOSE

The purpose of this study was to investigate the effectiveness of using computerized auditory training in the auditory perception of speech in children who use electronic devices through a systematic review of the literature.

METHOD

This is a systematic review based on the elaboration of the following guiding question: In hearing-impaired children who use electronic devices, how effective is the use of computerized auditory training in the auditory perception of speech? The Cochrane Library, Embase, LILACS, PubMed, Web of Science, and Scopus databases and gray literature (Google Scholar and ProQuest) were consulted.

RESULTS

Nine hundred and eighteen records were identified, with additional two studies in the citation search, totaling 920 studies. After excluding the 184 duplicate references, using the Rayyan platform, the titles and abstracts were screened (n = 736), with 20 studies selected and considered for full reading. Six of the 20 studies were included in the systematic review of the literature.

CONCLUSIONS

Positive and beneficial results regarding computerized auditory training are evidenced, which describe and discuss the proof of the effectiveness of the positive effects on the auditory perception of speech in children using hearing aids and cochlear implants with regard to auditory detection skills, discrimination, recognition, and auditory memory. The positive results are inspiring for the continuity and expansion of studies that further investigate the use of computerized auditory training with contemporary technologies and have an impact on the improvement of access to specialized intervention.

Effect of Serious Gaming on Speech-in-Noise Intelligibility in Adult Cochlear Implantees: A Randomized Controlled Study

Listening in noise remains challenging for adults with cochlear implants (CI) even after prolonged experience. Personalized auditory training (AT) programs can be proposed to improve specific auditory skills in adults with CI. The objective of this study was to assess serious gaming as a rehabilitation tool to improve speech-in-noise intelligibility in adult CI users. Thirty subjects with bilateral profound hearing loss and at least 9 months of CI experience were randomized to participate in a 5-week serious game-based AT program (n = 15) or a control group (n = 15). All participants were tested at enrolment and at 5 weeks using the sentence recognition-in-noise matrix test to measure the signal-to-noise ratio (SNR) allowing 70% of speech-in-noise understanding (70% speech reception threshold, SRT70). Thirteen subjects completed the AT program and nine of them were re-tested 5 weeks later. The mean SRT70 improved from 15.5 dB to 11.5 dB SNR after 5 weeks of AT (p < 0.001). No significant change in SRT70 was observed in the control group. In the study group, the magnitude of SRT70 improvement was not correlated to the total number of AT hours. A large inter-patient variability was observed for speech-in-noise intelligibility measured once the AT program was completed and at re-test. The results suggest that serious game-based AT may improve speech-in-noise intelligibility in adult CI users. Potential sources of inter-patient variability are discussed. Serious gaming may be considered as a complementary training approach for improving CI outcomes in adults.

Developing the computer-based auditory training program for adults with hearing impairment

Although it is known that auditory training is essential for hearing-impaired individuals, patients do not willingly participate in auditory training sessions, because individual training is a time-consuming and costly process. Computer-based auditory training programs are under development for reducing the cost and time. The aim of this study is to develop a computer-based auditory training program and to evaluate the usability of the program by applying it to adults with normal hearing indifferent age groups and professions. The developed auditory training program consists of nine modules: identification, discrimination, recognition, auditory closure, comprehension, auditory sequencing, phonological awareness, auditory memory, and attention. Forty adults (age ranges of 25-34, 35-44, 45-54, and 55-65 years), nine audiologists, and one software engineer were included in this study. The computer-based auditory training program was applied to all individuals. An evaluation form was filled out by the participants to evaluate the usability of and satisfaction with the program, and the average performances of the individuals were calculated for each module. The form measures five usability subscales: ease of use, comprehensibility, design, satisfaction, and motivation. The professionals evaluated the program and found it to be quite positive in terms of design, ease of use, motivation, and comprehensibility, and positive in terms of the satisfaction subscale. The participants evaluated all factors and found them to be quite positive. There were no statistically significant differences between the gender, age, and computer use groups in terms of the average performance value of the modules (p > 0.05). However, a significant difference was found in the average performance for the auditory sequencing module considering the educational status of individuals (p = 0.019). Furthermore, it was determined that computer experience (> 5 years) and having a personal computer have a significant effect on auditory memory (p = 0.049) and identification (p = 0.027). These results show that the instructions and information used in the program are clear and understandable, the colors and texts used in the program are readable, the program is easy to use, and the individuals are not disturbed by the sounds used in the program. However, it would be valuable to apply it to individuals with hearing losses to evaluate the efficacy of the program.

Comparison of Two Music Training Approaches on Music and Speech Perception in Cochlear Implant Users

In normal-hearing (NH) adults, long-term music training may benefit music and speech perception, even when listening to spectro-temporally degraded signals as experienced by cochlear implant (CI) users. In this study, we compared two different music training approaches in CI users and their effects on speech and music perception, as it remains unclear which approach to music training might be best. The approaches differed in terms of music exercises and social interaction. For the pitch/timbre group, melodic contour identification (MCI) training was performed using computer software. For the music therapy group, training involved face-to-face group exercises (rhythm perception, musical speech perception, music perception, singing, vocal emotion identification, and music improvisation). For the control group, training involved group nonmusic activities (e.g., writing, cooking, and woodworking). Training consisted of weekly 2-hr sessions over a 6-week period. Speech intelligibility in quiet and noise, vocal emotion identification, MCI, and quality of life (QoL) were measured before and after training. The different training approaches appeared to offer different benefits for music and speech perception. Training effects were observed within-domain (better MCI performance for the pitch/timbre group), with little cross-domain transfer of music training (emotion identification significantly improved for the music therapy group). While training had no significant effect on QoL, the music therapy group reported better perceptual skills across training sessions. These results suggest that more extensive and intensive training approaches that combine pitch training with the social aspects of music therapy may further benefit CI users.

Immediate improvement of speech-in-noise perception through multisensory stimulation via an auditory to tactile sensory substitution

BACKGROUND

Hearing loss is becoming a real social and health problem. Its prevalence in the elderly is an epidemic. The risk of developing hearing loss is also growing among younger people. If left untreated, hearing loss can perpetuate development of neurodegenerative diseases, including dementia. Despite recent advancements in hearing aid (HA) and cochlear implant (CI) technologies, hearing impaired users still encounter significant practical and social challenges, with or without aids. In particular, they all struggle with understanding speech in challenging acoustic environments, especially in presence of a competing speaker.

OBJECTIVES

In the current proof-of-concept study we tested whether multisensory stimulation, pairing audition and a minimal-size touch device would improve intelligibility of speech in noise.

METHODS

To this aim we developed an audio-to-tactile sensory substitution device (SSD) transforming low-frequency speech signals into tactile vibrations delivered on two finger tips. Based on the inverse effectiveness law, i.e., multisensory enhancement is strongest when signal-to-noise ratio is lowest between senses, we embedded non-native language stimuli in speech-like noise and paired it with a low-frequency input conveyed through touch.

RESULTS

We found immediate and robust improvement in speech recognition (i.e. in the Signal-To-Noise-ratio) in the multisensory condition without any training, at a group level as well as in every participant. The reported improvement at the group-level of 6 dB was indeed major considering that an increase of 10 dB represents a doubling of the perceived loudness.

CONCLUSIONS

These results are especially relevant when compared to previous SSD studies showing effects in behavior only after a demanding cognitive training. We discuss the implications of our results for development of SSDs and of specific rehabilitation programs for the hearing impaired either using or not using HAs or CIs. We also discuss the potential application of such a set-up for sense augmentation, such as when learning a new language.

Options for Auditory Training for Adults with Hearing Loss

Hearing aid devices alone do not adequately compensate for sensory losses despite significant technological advances in digital technology. Overall use rates of amplification among adults with hearing loss remain low, and overall satisfaction and performance in noise can be improved. Although improved technology may partially address some listening problems, auditory training may be another alternative to improve speech recognition in noise and satisfaction with devices. The literature underlying auditory plasticity following placement of sensory devices suggests that additional auditory training may be needed for reorganization of the brain to occur. Furthermore, training may be required to acquire optimal performance from devices. Several auditory training programs that are readily accessible for adults with hearing loss, hearing aids, or cochlear implants are described. Programs that can be accessed via Web-based formats and smartphone technology are reviewed. A summary table is provided for easy access to programs with descriptions of features that allow hearing health care providers to assist clients in selecting the most appropriate auditory training program to fit their needs.

Auditory implant research at the House Ear Institute 1989-2013

The House Ear Institute (HEI) had a long and distinguished history of auditory implant innovation and development. Early clinical innovations include being one of the first cochlear implant (CI) centers, being the first center to implant a child with a cochlear implant in the US, developing the auditory brainstem implant, and developing multiple surgical approaches and tools for Otology. This paper reviews the second stage of auditory implant research at House - in-depth basic research on perceptual capabilities and signal processing for both cochlear implants and auditory brainstem implants. Psychophysical studies characterized the loudness and temporal perceptual properties of electrical stimulation as a function of electrical parameters. Speech studies with the noise-band vocoder showed that only four bands of tonotopically arrayed information were sufficient for speech recognition, and that most implant users were receiving the equivalent of 8-10 bands of information. The noise-band vocoder allowed us to evaluate the effects of the manipulation of the number of bands, the alignment of the bands with the original tonotopic map, and distortions in the tonotopic mapping, including holes in the neural representation. Stimulation pulse rate was shown to have only a small effect on speech recognition. Electric fields were manipulated in position and sharpness, showing the potential benefit of improved tonotopic selectivity. Auditory training shows great promise for improving speech recognition for all patients. And the Auditory Brainstem Implant was developed and improved and its application expanded to new populations. Overall, the last 25 years of research at HEI helped increase the basic scientific understanding of electrical stimulation of hearing and contributed to the improved outcomes for patients with the CI and ABI devices. This article is part of a Special Issue entitled .

Gameplay as a source of intrinsic motivation in a randomized controlled trial of auditory training for tinnitus

Background

Previous studies of frequency discrimination training (FDT) for tinnitus used repetitive task-based training programmes relying on extrinsic factors to motivate participation. Studies reported limited improvement in tinnitus symptoms.

Purpose

To evaluate FDT exploiting intrinsic motivations by integrating training with computer-gameplay.

Methods

Sixty participants were randomly assigned to train on either a conventional task-based training, or one of two interactive game-based training platforms over six weeks. Outcomes included assessment of motivation, tinnitus handicap, and performance on tests of attention.

Results

Participants reported greater intrinsic motivation to train on the interactive game-based platforms, yet compliance of all three groups was similar (∼70%) and changes in self-reported tinnitus severity were not significant. There was no difference between groups in terms of change in tinnitus severity or performance on measures of attention.

Conclusion

FDT can be integrated within an intrinsically motivating game. Whilst this may improve participant experience, in this instance it did not translate to additional compliance or therapeutic benefit.

Trial Registration

ClinicalTrials.gov NCT02095262

O uso de um software na (re)habilitação de crianças com deficiência auditiva

OBJETIVO: Verificar a aplicabilidade de um software na (re)habilitação de crianças com deficiência auditiva. MÉTODOS: A amostra foi composta por 17 crianças com deficiência auditiva, sendo dez usuárias de Implante Coclear (IC) e sete usuárias de Aparelho de Amplificação Sonora Individual (AASI). Foi utilizado o "Software Auxiliar na Reabilitação de Distúrbios Auditivos (SARDA)". Aplicou-se o protocolo de treinamento durante 30 minutos, duas vezes por semana, pelo tempo necessário para a finalização das estratégias que compõe software. Para mensurar a aplicabilidade do software no treinamento da habilidade de percepção da fala no silêncio e no ruído, foram realizadas avaliações com o Hearing in Noise Test (HINT) pré e pós o treinamento auditivo. Os dados foram analisados estatisticamente. RESULTADOS: O grupo de usuários de IC necessitou em média 12,2 dias para finalizar as estratégias e o grupo de usuários de AASI em média 10,14 dias. Os dois grupos apresentaram diferença entre as avaliações pré e pós no silêncio e no ruído. As crianças mais novas apresentaram maior dificuldade durante a execução das estratégias, porém não houve correlação entre a idade e o desempenho. Não houve influência do tipo do dispositivo eletrônico durante o treinamento. As crianças apresentaram maior dificuldade na estratégia que envolvia estímulos não verbais e na estratégia com estímulos verbais que treina a habilidade de atenção sustentada. A atenção e a motivação da criança durante a estimulação foram fundamentais para o bom rendimento do treinamento auditivo. CONCLUSÃO: O treinamento auditivo com o SARDA foi eficaz, pois propiciou melhora na habilidade de percepção da fala, no silêncio e no ruído, das crianças com deficiência auditiva.