Benefits of Music Training for Perception of Emotional Speech Prosody in Deaf Children With Cochlear Implants

Prosodic and Visual Cues Facilitate Irony Comprehension by Mandarin-Speaking Children With Cochlear Implants

PURPOSE

This study investigated irony comprehension by Mandarin-speaking children with cochlear implants, focusing on how prosodic and visual cues contribute to their comprehension, and whether second-order Theory of Mind is required for using these cues.

METHOD

We tested 52 Mandarin-speaking children with cochlear implants (aged 3-7 years) and 52 age- and gender-matched children with normal hearing. All children completed a Theory of Mind test and a story comprehension test. Ironic stories were presented in three conditions, each providing different cues: (a) context-only, (b) context and prosody, and (c) context, prosody, and visual cues. Comparisons were conducted on the accuracy of story understanding across the three conditions to examine the role of prosodic and visual cues.

RESULTS

The results showed that, compared to the context-only condition, the additional prosodic and visual cues both improved the accuracy of irony comprehension for children with cochlear implants, similar to their normal-hearing peers. Furthermore, such improvements were observed for all children, regardless of whether they passed the second-order Theory of Mind test or not.

CONCLUSIONS

This study is the first to demonstrate the benefits of prosodic and visual cues in irony comprehension, without reliance on second-order Theory of Mind, for Mandarin-speaking children with cochlear implants. It implies potential insights for utilizing prosodic and visual cues in intervention strategies to promote irony comprehension.

A Concert-Based Study on Melodic Contour Identification among Varied Hearing Profiles-A Preliminary Report

Background: This study investigated how different hearing profiles influenced melodic contour identification (MCI) in a real-world concert setting with a live band including drums, bass, and a lead instrument. We aimed to determine the impact of various auditory assistive technologies on music perception in an ecologically valid environment. Methods: The study involved 43 participants with varying hearing capabilities: normal hearing, bilateral hearing aids, bimodal hearing, single-sided cochlear implants, and bilateral cochlear implants. Participants were exposed to melodies played on a piano or accordion, with and without an electric bass as a masker, accompanied by a basic drum rhythm. Bayesian logistic mixed-effects models were utilized to analyze the data. Results: The introduction of an electric bass as a masker did not significantly affect MCI performance for any hearing group when melodies were played on the piano, contrary to its effect on accordion melodies and previous studies. Greater challenges were observed with accordion melodies, especially when accompanied by an electric bass. Conclusions: MCI performance among hearing aid users was comparable to other hearing-impaired profiles, challenging the hypothesis that they would outperform cochlear implant users. A cohort of short melodies inspired by Western music styles was developed for future contour identification tasks.

Musicality - Tuned to the melody of vocal emotions

Musicians outperform non-musicians in vocal emotion perception, likely because of increased sensitivity to acoustic cues, such as fundamental frequency (F0) and timbre. Yet, how musicians make use of these acoustic cues to perceive emotions, and how they might differ from non-musicians, is unclear. To address these points, we created vocal stimuli that conveyed happiness, fear, pleasure or sadness, either in all acoustic cues, or selectively in either F0 or timbre only. We then compared vocal emotion perception performance between professional/semi-professional musicians (N = 39) and non-musicians (N = 38), all socialized in Western music culture. Compared to non-musicians, musicians classified vocal emotions more accurately. This advantage was seen in the full and F0-modulated conditions, but was absent in the timbre-modulated condition indicating that musicians excel at perceiving the melody (F0), but not the timbre of vocal emotions. Further, F0 seemed more important than timbre for the recognition of all emotional categories. Additional exploratory analyses revealed a link between time-varying F0 perception in music and voices that was independent of musical training. Together, these findings suggest that musicians are particularly tuned to the melody of vocal emotions, presumably due to a natural predisposition to exploit melodic patterns.

Meludia platform as a tool to evaluate music perception in pediatric and adult cochlear implant users

PURPOSE

Music perception is one of the greatest challenges for cochlear implant (CI) users. The aims of this study were: (i) to evaluate the music perception of CI users using the online Meludia music training program as music testing platform, (ii) to compare performance among three age groups, and (iii) to compare CI users with their normal hearing (NH) peers.

METHODS

138 individuals participated, divided between children (6-10 y), adolescents (11-16 y), and adults (≥ 17 y). Five music perception tasks were evaluated: Rhythm, Spatialization, Stable/unstable, Melody, and Density. We also administered the music related quality of life (MuRQoL) questionnaire for adults, and a music questionnaire for pediatric population (6-16 y) (MuQPP).

RESULTS

A significantly higher percentage of the adolescent CI users completed the five tasks compared to the other age groups. Both pediatric and adolescent CI users had similar performance to their NH peers in most categories. On the MuRQoL, adult NH listeners reported more music exposure than CI users (3.8 ± 0.6 vs 3.0 ± 0.6, p < 0.01), but both groups reported similar levels of perceived music importance (3.4 ± 0.7 vs 3.2 ± 1.1, p = 0.340). On the MuQPP, pediatric CI users who scored highly on music perception also had higher reported questionnaire scores (54.2 ± 12.9 vs 40.9 ± 12.1, p = 0.009).

CONCLUSIONS

Meludia can be used to evaluate music perception and to use for music training in CI users of all ages. Adolescents had the highest performance in most musical tasks. Pediatric CI users were more similar to their NH peers. The importance of music in adult CI users was comparable to their NH peers.

Objective and Subjective Assessment of Music Perception and Musical Experiences in Young Cochlear Implant Users

For many individuals, music has a significant impact on the quality and enjoyability of life. Cochlear implant (CI) users must cope with the constraints that the CI imposes on music perception. Here, we assessed the musical experiences of young CI users and age-matched controls with normal hearing (NH). CI users and NH peers were divided into subgroups according to age: children and adolescents. Participants were tested on their ability to recognize vocal and instrumental music and instruments. A music questionnaire for pediatric populations (MuQPP) was also used. CI users and NH peers identified a similar percentage of vocal music. CI users were significantly worse at recognizing instruments (p < 0.05) and instrumental music (p < 0.05). CI users scored similarly to NH peers on the MuQPP, except for the musical frequency domain, where CI users in the children subgroup scored higher than their NH peers (p = 0.009). For CI users in the children subgroup, the identification of instrumental music was positively correlated with music importance (p = 0.029). Young CI users have significant deficits in some aspects of music perception (instrumental music and instrument identification) but have similar scores to NH peers in terms of interest in music, frequency of music exposure, and importance of music.

Evaluation of musical emotion perception and language development in children with cochlear implants

OBJECTIVES

While the primary purpose of cochlear implant (CI) fitting is to improve individuals' receptive and expressive skills, musical emotion perception (MEP) is generally ignored. This study assesses the MEP and language skills (LS) of children using CI.

METHODS

26 CI users and 26 matched healthy controls between the ages of 6 and 9 were included in the study. The Test of Language Development (TOLD) was applied to evaluate the LS of the participants, and the Montreal Emotion Identification Test (MEI) was applied to evaluate the MEP.

RESULTS

MEI test scores and all subtests of TOLD were statistically significantly lower in the CI group. Also, there was a statistically significant and moderate correlation between the listening subtest of TOLD and the MEI test.

CONCLUSIONS

MEP and language skills are poor in children with CI. Although language skills are primarily targeted in CI performance, improving MEP should also be included in rehabilitation programs. The relationship between music and the TOLD's listening subtest may provide evidence that listening skills can be improved by paying attention to the MEP, which is frequently ignored in rehabilitation programs.

The Impact of Musical Rehabilitation on Complex Sound Perception in Cochlear Implant Users: A Systematic Review

OBJECTIVE

Musical rehabilitation has been used in clinical and nonclinical contexts to improve postimplantation auditory processing in implanted individuals. This systematic review aimed to evaluate the efficacy of music rehabilitation in controlled experimental and quasi-experimental studies on cochlear implant (CI) user speech and music perception.

DATABASES REVIEWED

PubMed/MEDLINE, EMBASE, Web of Science, PsycARTICLES, and PsycINFO databases through July 2022.

METHODS

Controlled experimental trials and prospective studies were included if they compared pretest and posttest data and excluded hearing aid-only users. Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines were then used to extract data from 11 included studies with a total of 206 pediatric and adult participants. Interventions included group music therapy, melodic contour identification training, auditory-motor instruction, or structured digital music training. Studies used heterogeneous outcome measures evaluating speech and music perception. Risk of bias was assessed using the National Heart, Lung, and Blood Institute Quality Assessment Tool.

RESULTS

A total of 735 studies were screened, and 11 met the inclusion criteria. Six trials reported both speech and music outcomes, whereas five reported only music perception outcomes after the intervention relative to control. For music perception outcomes, significant findings included improvements in melodic contour identification (five studies, p < 0.05), timbre recognition (three studies, p < 0.05), and song appraisal (three studies, p < 0.05) in their respective trials. For speech prosody outcomes, only vocal emotion identification demonstrated significant improvements (two studies, p < 0.05).

CONCLUSION

Music rehabilitation improves performance on multiple measures of music perception, as well as tone-based characteristics of speech (i.e., emotional prosody). This suggests that rehabilitation may facilitate improvements in the discrimination of spectrally complex signals.

Emotions and Psychological Mechanisms of Listening to Music in Cochlear Implant Recipients

OBJECTIVES

Music is a multidimensional phenomenon and is classified by its arousal properties, emotional quality, and structural characteristics. Although structural features of music (i.e., pitch, timbre, and tempo) and music emotion recognition in cochlear implant (CI) recipients are popular research topics, music-evoked emotions, and related psychological mechanisms that reflect both the individual and social context of music are largely ignored. Understanding the music-evoked emotions (the "what") and related mechanisms (the "why") can help professionals and CI recipients better comprehend the impact of music on CI recipients' daily lives. Therefore, the purpose of this study is to evaluate these aspects in CI recipients and compare their findings to those of normal hearing (NH) controls.

DESIGN

This study included 50 CI recipients with diverse auditory experiences who were prelingually deafened (deafened at or before 6 years of age)-early implanted (N = 21), prelingually deafened-late implanted (implanted at or after 12 years of age-N = 13), and postlingually deafened (N = 16) as well as 50 age-matched NH controls. All participants completed the same survey, which included 28 emotions and 10 mechanisms (Brainstem reflex, Rhythmic entrainment, Evaluative Conditioning, Contagion, Visual imagery, Episodic memory, Musical expectancy, Aesthetic judgment, Cognitive appraisal, and Lyrics). Data were presented in detail for CI groups and compared between CI groups and between CI and NH groups.

RESULTS

The principal component analysis showed five emotion factors that are explained by 63.4% of the total variance, including anxiety and anger, happiness and pride, sadness and pain, sympathy and tenderness, and serenity and satisfaction in the CI group. Positive emotions such as happiness, tranquility, love, joy, and trust ranked as most often experienced in all groups, whereas negative and complex emotions such as guilt, fear, anger, and anxiety ranked lowest. The CI group ranked lyrics and rhythmic entrainment highest in the emotion mechanism, and there was a statistically significant group difference in the episodic memory mechanism, in which the prelingually deafened, early implanted group scored the lowest.

CONCLUSION

Our findings indicate that music can evoke similar emotions in CI recipients with diverse auditory experiences as it does in NH individuals. However, prelingually deafened and early implanted individuals lack autobiographical memories associated with music, which affects the feelings evoked by music. In addition, the preference for rhythmic entrainment and lyrics as mechanisms of music-elicited emotions suggests that rehabilitation programs should pay particular attention to these cues.

Meta-Analysis Exploring the Effects of Music Training in Cochlear Implant Users by Age

BACKGROUND AND OBJECTIVES

The present study aimed to explore meaningful change in the musical performance of cochlear implant (CI) users according to age after receiving music training compared to the other CI users who did not receive any music training and normal hearing (NH) listeners. Materials and.

METHODS

Article search was conducted from five journal databases. In accordance with PICOS criteria, 29 articles and 15 articles were included for the CI and NH groups, respectively. A total of 44 articles consisting of 407 CI users and 486 NH participants were then analyzed. Using the data gathered from pre- and post-training, meta-analysis was applied by the random-effects model, and then piecewise meta-regression was employed.

RESULTS

CI users with music training showed better performance than those without the training across all ages. The curve change in musical performance when training showed that the CI users was similar to the general pattern of NH performance, indicating that the CI users gained benefits from music training and developed perceptual ability, even though it was not as high as the level of NH counterparts.

CONCLUSIONS

This finding supports the benefits of active engagement with music for both CI users and NH listeners, while noting the important role of music as one of the primary aural rehabilitation approaches.

Sustainable Benefits of High Variability Phonetic Training in Mandarin-speaking Kindergarteners With Cochlear Implants: Evidence From Categorical Perception of Lexical Tones

OBJECTIVES

Although pitch reception poses a great challenge for individuals with cochlear implants (CIs), formal auditory training (e.g., high variability phonetic training [HVPT]) has been shown to provide direct benefits in pitch-related perceptual performances such as lexical tone recognition for CI users. As lexical tones in spoken language are expressed with a multitude of distinct spectral, temporal, and intensity cues, it is important to determine the sources of training benefits for CI users. The purpose of the present study was to conduct a rigorous fine-scale evaluation with the categorical perception (CP) paradigm to control the acoustic parameters and test the efficacy and sustainability of HVPT for Mandarin-speaking pediatric CI recipients. The main hypothesis was that HVPT-induced perceptual learning would greatly enhance CI users' ability to extract the primary pitch contours from spoken words for lexical tone identification and discrimination. Furthermore, individual differences in immediate and long-term gains from training would likely be attributable to baseline performance and duration of CI use.

DESIGN

Twenty-eight prelingually deaf Mandarin-speaking kindergarteners with CIs were tested. Half of them received five sessions of HVPT within a period of 3 weeks. The other half served as control who did not receive the formal training. Two classical CP tasks on a tonal continuum from Mandarin tone 1 (high-flat in pitch) to tone 2 (mid-rising in pitch) with fixed acoustic features of duration and intensity were administered before (pretest), immediately after (posttest), and 10 weeks posttraining termination (follow-up test). Participants were instructed to either label a speech stimulus along the continuum (i.e., identification task) or determine whether a pair of stimuli separated by zero or two steps from the continuum was the same or different (i.e., discrimination task). Identification function measures (i.e., boundary position and boundary width) and discrimination function scores (i.e., between-category score, within-category score, and peakedness score) were assessed for each child participant across the three test sessions.

RESULTS

Linear mixed-effects (LME) models showed significant training-induced enhancement in lexical tone categorization with significantly narrower boundary width and better between-category discrimination in the immediate posttest over pretest for the trainees. Furthermore, training-induced gains were reliably retained in the follow-up test 10 weeks after training. By contrast, no significant changes were found in the control group across sessions. Regression analysis confirmed that baseline performance (i.e., boundary width in the pretest session) and duration of CI use were significant predictors for the magnitude of training-induced benefits.

CONCLUSIONS

The stringent CP tests with synthesized stimuli that excluded acoustic cues other than the pitch contour and were never used in training showed strong evidence for the efficacy of HVPT in yielding immediate and sustained improvement in lexical tone categorization for Mandarin-speaking children with CIs. The training results and individual differences have remarkable implications for developing personalized computer-based short-term HVPT protocols that may have sustainable long-term benefits for aural rehabilitation in this clinical population.

Effectiveness of rhythmic training on linguistics skill development in deaf children and adolescents with cochlear implants: A systematic review

OBJECTIVE

This review compiles the scientific evidence to date on the effectiveness of musical/rhythmic training for improving and/or enhancing the development of language skills in deaf children aged 6-16 years with cochlear implants.

METHODS

PubMed, ScienceDirect, and Web of Science were used for the research following the PRISMA protocol.

RESULTS

The reviewed studies indicate that rhythmic training can improve language skills (perception, production, and comprehension) in this population, as well as in other cognitive skills.

CONCLUSION

Although further research is still needed, the current evidence can help identify new and more effective early intervention methods for deaf children.

The Impact of Vocal Boost Manipulations on Musical Sound Quality for Cochlear Implant Users

OBJECTIVE

To evaluate the impact of vocal boost manipulations on cochlear implant (CI) musical sound quality appraisals.

METHODS

An anonymous, online study was distributed to 33 CI users. Participants listened to auditory tokens and assessed the musical quality of acoustic stimuli with vocal boosting and attenuation using a validated sound quality rating scale. Four versions of real-world musical stimuli were created: a version with +9 dB vocal boost, a version with -9 dB vocal attenuation, a composite stimulus containing a 1,000 Hz low-pass filter and white noise ("anchor"), and an unaltered version ("hidden reference"). Subjects listened to all four versions and provided ratings based on a 100-point scale that reflected the perceived sound quality difference of the music clip relative to the reference excerpt.

RESULTS

Vocal boost increased musical sound quality ratings relative to the reference clip (11.7; 95% CI, 1.62-21.8, p = 0.016) and vocal attenuation decreased musical sound quality ratings relative to the reference clip (28.5; 95% CI, 18.64-38.44, p < 0.001). When comparing the non-musical training group and musical training group, there was a significant difference in musical sound quality rating scores for the vocal boost condition (21.2; 95% CI: 1.76-40.7, p = 0.028).

CONCLUSIONS

CI-mediated musical sound quality appraisals are impacted by vocal boost and attenuation. Musically trained CI users to report greater musical sound quality enhancement with a vocal boost with respect to CI users with no musical training background. Implementation of front-end vocal boost manipulations in music may improve sound quality and music appreciation among CI users.

LEVEL OF EVIDENCE

2 (Individual cohort study) Laryngoscope, 133:938-947, 2023.

Perception of Prosody in Hearing-Impaired Individuals and Users of Hearing Assistive Devices: An Overview of Recent Advances

PURPOSE

Prosody perception is an essential component of speech communication and social interaction through which both linguistic and emotional information are conveyed. Considering the importance of the auditory system in processing prosody-related acoustic features, the aim of this review article is to review the effects of hearing impairment on prosody perception in children and adults. It also assesses the performance of hearing assistive devices in restoring prosodic perception.

METHOD

Following a comprehensive online database search, two lines of inquiry were targeted. The first summarizes recent attempts toward determining the effects of hearing loss and interacting factors such as age and cognitive resources on prosody perception. The second analyzes studies reporting beneficial or detrimental impacts of hearing aids, cochlear implants, and bimodal stimulation on prosodic abilities in people with hearing loss.

RESULTS

The reviewed studies indicate that hearing-impaired individuals vary widely in perceiving affective and linguistic prosody, depending on factors such as hearing loss severity, chronological age, and cognitive status. In addition, most of the emerging information points to limitations of hearing assistive devices in processing and transmitting the acoustic features of prosody.

CONCLUSIONS

The existing literature is incomplete in several respects, including the lack of a consensus on how and to what extent hearing prostheses affect prosody perception, especially the linguistic function of prosody, and a gap in assessing prosody under challenging listening situations such as noise. This review article proposes directions that future research could follow to provide a better understanding of prosody processing in those with hearing impairment, which may help health care professionals and designers of assistive technology to develop innovative diagnostic and rehabilitation tools.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21809772.

Singing ability is related to vocal emotion recognition: Evidence for shared sensorimotor processing across speech and music

The ability to recognize emotion in speech is a critical skill for social communication. Motivated by previous work that has shown that vocal emotion recognition accuracy varies by musical ability, the current study addressed this relationship using a behavioral measure of musical ability (i.e., singing) that relies on the same effector system used for vocal prosody production. In the current study, participants completed a musical production task that involved singing four-note novel melodies. To measure pitch perception, we used a simple pitch discrimination task in which participants indicated whether a target pitch was higher or lower than a comparison pitch. We also used self-report measures to address language and musical background. We report that singing ability, but not self-reported musical experience nor pitch discrimination ability, was a unique predictor of vocal emotion recognition accuracy. These results support a relationship between processes involved in vocal production and vocal perception, and suggest that sensorimotor processing of the vocal system is recruited for processing vocal prosody.

An RCT study showing few weeks of music lessons enhance audio-visual temporal processing

Music involves different senses and is emotional in nature, and musicians show enhanced detection of audio-visual temporal discrepancies and emotion recognition compared to non-musicians. However, whether musical training produces these enhanced abilities or if they are innate within musicians remains unclear. Thirty-one adult participants were randomly assigned to a music training, music listening, or control group who all completed a one-hour session per week for 11 weeks. The music training group received piano training, the music listening group listened to the same music, and the control group did their homework. Measures of audio-visual temporal discrepancy, facial expression recognition, autistic traits, depression, anxiety, stress and mood were completed and compared from the beginning to end of training. ANOVA results revealed that only the music training group showed a significant improvement in detection of audio-visual temporal discrepancies compared to the other groups for both stimuli (flash-beep and face-voice). However, music training did not improve emotion recognition from facial expressions compared to the control group, while it did reduce the levels of depression, stress and anxiety compared to baseline. This RCT study provides the first evidence of a causal effect of music training on improved audio-visual perception that goes beyond the music domain.

Teaching Children With Hearing Loss to Recognize Speech: Gains Made With Computer-Based Auditory and/or Speechreading Training

OBJECTIVES

Transfer appropriate processing (TAP) refers to a general finding that training gains are maximized when training and testing are conducted under the same conditions. The present study tested the extent to which TAP applies to speech perception training in children with hearing loss. Specifically, we assessed the benefits of computer-based speech perception training games for enhancing children's speech recognition by comparing three training groups: auditory training (AT), audiovisual training (AVT), and a combination of these two (AT/AVT). We also determined whether talker-specific training, as might occur when children train with the speech of a next year's classroom teacher, leads to better recognition of that talker's speech and if so, the extent to which training benefits generalize to untrained talkers. Consistent with TAP theory, we predicted that children would improve their ability to recognize the speech of the trained talker more than that of three untrained talkers and, depending on their training group, would improve more on an auditory-only (listening) or audiovisual (speechreading) speech perception assessment, that matched the type of training they received. We also hypothesized that benefit would generalize to untrained talkers and to test modalities in which they did not train, albeit to a lesser extent.

DESIGN

Ninety-nine elementary school aged children with hearing loss were enrolled into a randomized control trial with a repeated measures A-A-B experimental mixed design in which children served as their own control for the assessment of overall benefit of a particular training type and three different groups of children yielded data for comparing the three types of training. We also assessed talker-specific learning and transfer of learning by including speech perception tests with stimuli spoken by the talker with whom a child trained and stimuli spoken by three talkers with whom the child did not train and by including speech perception tests that presented both auditory (listening) and audiovisual (speechreading) stimuli. Children received 16 hr of gamified training. The games provided word identification and connected speech comprehension training activities.

RESULTS

Overall, children showed significant improvement in both their listening and speechreading performance. Consistent with TAP theory, children improved more on their trained talker than on the untrained talkers. Also consistent with TAP theory, the children who received AT improved more on the listening than the speechreading. However, children who received AVT improved on both types of assessment equally, which is not consistent with our predictions derived from a TAP perspective. Age, language level, and phonological awareness were either not predictive of training benefits or only negligibly so.

CONCLUSIONS

The findings provide support for the practice of providing children who have hearing loss with structured speech perception training and suggest that future aural rehabilitation programs might include teacher-specific speech perception training to prepare children for an upcoming school year, especially since training will generalize to other talkers. The results also suggest that benefits of speech perception training were not significantly related to age, language level, or degree of phonological awareness. The findings are largely consistent with TAP theory, suggesting that the more aligned a training task is with the desired outcome, the more likely benefit will accrue.

Pitch Accuracy of Vocal Singing in Deaf Children With Bimodal Hearing and Bilateral Cochlear Implants

OBJECTIVES

The purpose of the present study was to investigate the pitch accuracy of vocal singing in children with severe to profound hearing loss who use bilateral cochlear implants (CIs) or bimodal devices [CI at one ear and hearing aid (HA) at the other] in comparison to similarly-aged children with normal-hearing (NH).

DESIGN

The participants included four groups: (1) 26 children with NH, (2) 13 children with bimodal devices, (3) 31 children with bilateral CIs that were implanted sequentially, and (4) 10 children with bilateral CIs that were implanted simultaneously. All participants were aged between 7 and 11 years old. Each participant was recorded singing a self-chosen song that was familiar to him or her. The fundamental frequencies (F0) of individual sung notes were extracted and normalized to facilitate cross-subject comparisons. Pitch accuracy was quantified using four pitch-based metrics calculated with reference to the target music notes: mean note deviation, contour direction, mean interval deviation, and F0 variance ratio. A one-way ANOVA was used to compare listener-group difference on each pitch metric. A principal component analysis showed that the mean note deviation best accounted for pitch accuracy in vocal singing. A regression analysis examined potential predictors of CI children's singing proficiency using mean note deviation as the dependent variable and demographic and audiological factors as independent variables.

RESULTS

The results revealed significantly poorer performance on all four pitch-based metrics in the three groups of children with CIs in comparison to children with NH. No significant differences were found among the three CI groups. Among the children with CIs, variability in the vocal singing proficiency was large. Within the group of 13 bimodal users, the mean note deviation was significantly correlated with their unaided pure-tone average thresholds (r = 0.582, p = 0.037). The regression analysis for all children with CIs, however, revealed no significant demographic or audiological predictor for their vocal singing performance.

CONCLUSION

Vocal singing performance in children with bilateral CIs or bimodal devices is not significantly different from each other on a group level. Compared to children with NH, the pediatric bimodal and bilateral CI users, in general, demonstrated significant deficits in vocal singing ability. Demographic and audiological factors, known from previous studies to be associated with good speech and language development in prelingually-deafened children with CIs, were not associated with singing accuracy for these children.

Functional Consequences of Poor Binaural Hearing in Development: Evidence From Children With Unilateral Hearing Loss and Children Receiving Bilateral Cochlear Implants

Poor binaural hearing in children was hypothesized to contribute to related cognitive and academic deficits. Children with unilateral hearing have normal hearing in one ear but no access to binaural cues. Their cognitive and academic deficits could be unique from children receiving bilateral cochlear implants (CIs) at young ages who have poor access to spectral cues and impaired binaural sensitivity. Both groups are at risk for vestibular/balance deficits which could further contribute to memory and learning challenges. Eighty-eight children (43 male:45 female, aged 9.89  ±  3.40 years), grouped by unilateral hearing loss (n = 20), bilateral CI (n = 32), and typically developing (n = 36), completed a battery of sensory, cognitive, and academic tests. Analyses revealed that children in both hearing loss groups had significantly poorer skills (accounting for age) on most tests than their normal hearing peers. Children with unilateral hearing loss had more asymmetric speech perception than children with bilateral CIs (p < .0001) but balance and language deficits (p = .0004, p < .0001, respectively) were similar in the two hearing loss groups (p > .05). Visuospatial memory deficits occurred in both hearing loss groups (p = .02) but more consistently across tests in children with unilateral hearing loss. Verbal memory was not significantly different than normal (p > .05). Principal component analyses revealed deficits in a main cluster of visuospatial memory, oral language, mathematics, and reading measures (explaining 46.8% data variability). The remaining components revealed clusters of self-reported hearing, balance and vestibular function, and speech perception deficits. The findings indicate significant developmental impacts of poor binaural hearing in children.

Bimodal Fitting and Bilateral Cochlear Implants in Children With Significant Residual Hearing: The Impact of Asymmetry in Spatial Release of Masking on Localization

Purpose This study aimed to gain more insight into the primary auditory abilities of children with significant residual hearing in order to improve decision making when choosing between bimodal fitting or sequential bilateral cochlear implantation. Method Sound localization abilities, spatial release of masking, and fundamental frequency perception were tested. Nine children with bimodal fitting and seven children with sequential bilateral cochlear implants were included in the study. As a reference, 15 children with normal hearing and two children with simultaneous bilateral cochlear implants were included. Results On all outcome measures, the implanted children performed worse than the normal hearing children. For high-frequency localization, children with sequential bilateral cochlear implants performed significantly better than children with bimodal fitting. Compared to children with normal hearing, the left-right asymmetry in spatial release of masking was significant. When the implant was hindered by noise, bimodally fitted children obtained significantly lower spatial release of masking compared to when the hearing aid was hindered by noise. Overall, the larger the left-right asymmetry in spatial release of masking, the poorer the localization skills. No significant differences were found in fundamental frequency perception between the implant groups. Conclusions The data hint to an advantage of bilateral implantation over bimodal fitting. The extent of asymmetry in spatial release of masking is a promising tool for decision making when choosing whether to continue with the hearing aid or to provide a second cochlear implant in children with significant residual hearing.

Links of Prosodic Stress Perception and Musical Activities to Language Skills of Children With Cochlear Implants and Normal Hearing

OBJECTIVES

A major issue in the rehabilitation of children with cochlear implants (CIs) is unexplained variance in their language skills, where many of them lag behind children with normal hearing (NH). Here, we assess links between generative language skills and the perception of prosodic stress, and with musical and parental activities in children with CIs and NH. Understanding these links is expected to guide future research and toward supporting language development in children with a CI.

DESIGN

Twenty-one unilaterally and early-implanted children and 31 children with NH, aged 5 to 13, were classified as musically active or nonactive by a questionnaire recording regularity of musical activities, in particular singing, and reading and other activities shared with parents. Perception of word and sentence stress, performance in word finding, verbal intelligence (Wechsler Intelligence Scale for Children (WISC) vocabulary), and phonological awareness (production of rhymes) were measured in all children. Comparisons between children with a CI and NH were made against a subset of 21 of the children with NH who were matched to children with CIs by age, gender, socioeconomic background, and musical activity. Regression analyses, run separately for children with CIs and NH, assessed how much variance in each language task was shared with each of prosodic perception, the child's own music activity, and activities with parents, including singing and reading. All statistical analyses were conducted both with and without control for age and maternal education.

RESULTS

Musically active children with CIs performed similarly to NH controls in all language tasks, while those who were not musically active performed more poorly. Only musically nonactive children with CIs made more phonological and semantic errors in word finding than NH controls, and word finding correlated with other language skills. Regression analysis results for word finding and VIQ were similar for children with CIs and NH. These language skills shared considerable variance with the perception of prosodic stress and musical activities. When age and maternal education were controlled for, strong links remained between perception of prosodic stress and VIQ (shared variance: CI, 32%/NH, 16%) and between musical activities and word finding (shared variance: CI, 53%/NH, 20%). Links were always stronger for children with CIs, for whom better phonological awareness was also linked to improved stress perception and more musical activity, and parental activities altogether shared significantly variance with word finding and VIQ.

CONCLUSIONS

For children with CIs and NH, better perception of prosodic stress and musical activities with singing are associated with improved generative language skills. In addition, for children with CIs, parental singing has a stronger positive association to word finding and VIQ than parental reading. These results cannot address causality, but they suggest that good perception of prosodic stress, musical activities involving singing, and parental singing and reading may all be beneficial for word finding and other generative language skills in implanted children.

Perception of Child-Directed Versus Adult-Directed Emotional Speech in Pediatric Cochlear Implant Users

OBJECTIVES

Cochlear implants (CIs) are remarkable in allowing individuals with severe to profound hearing loss to perceive speech. Despite these gains in speech understanding, however, CI users often struggle to perceive elements such as vocal emotion and prosody, as CIs are unable to transmit the spectro-temporal detail needed to decode affective cues. This issue becomes particularly important for children with CIs, but little is known about their emotional development. In a previous study, pediatric CI users showed deficits in voice emotion recognition with child-directed stimuli featuring exaggerated prosody. However, the large intersubject variability and differential developmental trajectory known in this population incited us to question the extent to which exaggerated prosody would facilitate performance in this task. Thus, the authors revisited the question with both adult-directed and child-directed stimuli.

DESIGN

Vocal emotion recognition was measured using both child-directed (CDS) and adult-directed (ADS) speech conditions. Pediatric CI users, aged 7-19 years old, with no cognitive or visual impairments and who communicated through oral communication with English as the primary language participated in the experiment (n = 27). Stimuli comprised 12 sentences selected from the HINT database. The sentences were spoken by male and female talkers in a CDS or ADS manner, in each of the five target emotions (happy, sad, neutral, scared, and angry). The chosen sentences were semantically emotion-neutral. Percent correct emotion recognition scores were analyzed for each participant in each condition (CDS vs. ADS). Children also completed cognitive tests of nonverbal IQ and receptive vocabulary, while parents completed questionnaires of CI and hearing history. It was predicted that the reduced prosodic variations found in the ADS condition would result in lower vocal emotion recognition scores compared with the CDS condition. Moreover, it was hypothesized that cognitive factors, perceptual sensitivity to complex pitch changes, and elements of each child's hearing history may serve as predictors of performance on vocal emotion recognition.

RESULTS

Consistent with our hypothesis, pediatric CI users scored higher on CDS compared with ADS speech stimuli, suggesting that speaking with an exaggerated prosody-akin to "motherese"-may be a viable way to convey emotional content. Significant talker effects were also observed in that higher scores were found for the female talker for both conditions. Multiple regression analysis showed that nonverbal IQ was a significant predictor of CDS emotion recognition scores while Years using CI was a significant predictor of ADS scores. Confusion matrix analyses revealed a dependence of results on specific emotions; for the CDS condition's female talker, participants had high sensitivity (d' scores) to happy and low sensitivity to the neutral sentences while for the ADS condition, low sensitivity was found for the scared sentences.

CONCLUSIONS

In general, participants had higher vocal emotion recognition to the CDS condition which also had more variability in pitch and intensity and thus more exaggerated prosody, in comparison to the ADS condition. Results suggest that pediatric CI users struggle with vocal emotion perception in general, particularly to adult-directed speech. The authors believe these results have broad implications for understanding how CI users perceive emotions both from an auditory communication standpoint and a socio-developmental perspective.

Beyond Audition: Psychosocial Benefits of Music Training for Children With Hearing Loss

OBJECTIVES

Children with hearing loss tend to have poorer psychosocial and quality of life outcomes than their typical-hearing (TH) peers-particularly in the areas of peer relationships and school functioning. A small number of studies for TH children have suggested that group-based music activities are beneficial for prosocial outcomes and help develop a sense of belonging. While one might question whether perceptual limitations would impede satisfactory participation in musical activities, findings from a few studies have suggested that group music activities may have similar benefits for children with hearing loss as well. It is important to note that the effect of music on psychosocial outcomes has primarily been investigated at an anecdotal level. The objective of this study was to explore the effect of a music training program on psychosocial and quality of life outcomes for children with hearing loss. It was hypothesized that music training would provide benefits for domains centered upon peer relationships and prosocial measures.

DESIGN

Fourteen children aged 6 to 9 years with prelingual sensorineural hearing loss (SNHL) participated in a 12-week music training program that consisted of group-based face-to-face music therapy supplemented by online music apps. The design was a pseudorandomized, longitudinal study (9 participants were waitlisted, initially serving as a passive control group). Psychosocial wellbeing and quality of life were assessed using a questionnaire battery comprised of the Strengths and Difficulty Questionnaire (SDQ), the Pediatric Quality of Life Inventory, the Hearing Environments and Reflection on Quality of Life (HEAR-QL), and the Glasgow Children's Benefit Inventory. For comparative purposes, responses were measured from 16 TH children that ranged in age from 6 to 9 years.

RESULTS

At baseline, children with SNHL had poorer outcomes for internalizing problems, and all measures of the HEAR-QL compared with the TH children. There were no differences for general psychosocial and physical health. After music training, SDQ internalizing problems such as peer relationships and emotional regulation were significantly reduced for the children with SNHL. There were no changes for any outcomes for the passive control group. Additional benefits were noted for emotional and learning factors on the Glasgow Children's Benefit Inventory. However, there were no significant changes for any psychosocial and quality of life outcomes as measured by the Pediatric Quality of Life Inventory or HEAR-QL instruments.

CONCLUSIONS

The present study provides initial evidence that music training has a positive effect on at least some psychosocial and quality of life outcomes for children with hearing loss. As they are at a greater risk of poorer psychosocial and quality of life outcomes, these findings are cause for cautious optimism. Children with hearing loss should be encouraged to participate in group-based musical activities.

High-Variability Phonetic Training Benefits Lexical Tone Perception: An Investigation on Mandarin-Speaking Pediatric Cochlear Implant Users

Purpose Lexical tone perception is known to be persistently difficult for individuals with cochlear implants (CIs). The purpose of this study was to evaluate the efficacy of high-variability phonetic training (HVPT) in improving Mandarin tone perception for native-speaking children with CIs. Method A total of 28 Mandarin-speaking pediatric CI recipients participated in the study. Half of the children with CIs received a five-session HVPT within a period of 3 weeks. Identification and discrimination of lexical tones produced by familiar talkers (used during training) and novel talkers (not used during training) were measured before, immediately after, and 10 weeks after training termination. The other half untrained children served as control for the identical pre- and posttests. Results Lexical tone perception significantly improved in both trained identification task and untrained discrimination task for the trainees. There was also a significant effect in transfer of learning to perceiving tones produced by novel talkers. Moreover, training-induced gains were retained for up to 10 weeks after training. By comparison, no significant pre-post changes were observed in the control group. Conclusion The results provide the first systematical assessment for the efficacy of the HVPT protocol for Mandarin-speaking pediatric CI users with congenital hearing loss, which supports the clinical utility of intensive short-term HVPT in these children's rehabilitative regimens.

Rapid Assessment of Non-Verbal Auditory Perception in Normal-Hearing Participants and Cochlear Implant Users

In the case of hearing loss, cochlear implants (CI) allow for the restoration of hearing. Despite the advantages of CIs for speech perception, CI users still complain about their poor perception of their auditory environment. Aiming to assess non-verbal auditory perception in CI users, we developed five listening tests. These tests measure pitch change detection, pitch direction identification, pitch short-term memory, auditory stream segregation, and emotional prosody recognition, along with perceived intensity ratings. In order to test the potential benefit of visual cues for pitch processing, the three pitch tests included half of the trials with visual indications to perform the task. We tested 10 normal-hearing (NH) participants with material being presented as original and vocoded sounds, and 10 post-lingually deaf CI users. With the vocoded sounds, the NH participants had reduced scores for the detection of small pitch differences, and reduced emotion recognition and streaming abilities compared to the original sounds. Similarly, the CI users had deficits for small differences in the pitch change detection task and emotion recognition, as well as a decreased streaming capacity. Overall, this assessment allows for the rapid detection of specific patterns of non-verbal auditory perception deficits. The current findings also open new perspectives about how to enhance pitch perception capacities using visual cues.

No Evidence That Music Training Benefits Speech Perception in Hearing-Impaired Listeners: A Systematic Review

As musicians have been shown to have a range of superior auditory skills to non-musicians (e.g., pitch discrimination ability), it has been hypothesized by many researchers that music training can have a beneficial effect on speech perception in populations with hearing impairment. This hypothesis relies on an assumption that the benefits seen in musicians are due to their training and not due to innate skills that may support successful musicianship. This systematic review examined the evidence from 13 longitudinal training studies that tested the hypothesis that music training has a causal effect on speech perception ability in hearing-impaired listeners. The papers were evaluated for quality of research design and appropriate analysis techniques. Only 4 of the 13 papers used a research design that allowed a causal relation between music training and outcome benefits to be validly tested, and none of those 4 papers with a better quality study design demonstrated a benefit of music training for speech perception. In spite of the lack of valid evidence in support of the hypothesis, 10 of the 13 papers made claims of benefits of music training, showing a propensity for confirmation bias in this area of research. It is recommended that future studies that aim to evaluate the association of speech perception ability and music training use a study design that differentiates the effects of training from those of innate perceptual and cognitive skills in the participants.

Crucial Music Components Needed for Speech Perception Enhancement of Pediatric Cochlear Implant Users: A Systematic Review and Meta-Analysis

BACKGROUND

Although many clinicians have attempted music training for the hearing-impaired children, no specific effects have yet been reported for individual music components. This paper seeks to discover specific music components that help in improving speech perception of children with cochlear implants (CI) and to identify the effective training periods and methods needed for each component.

METHOD

While assessing 5 electronic databases, that is, ScienceDirect, Scopus, PubMed, CINAHL, and Web of Science, 1,638 articles were found initially. After the screening and eligibility assessment stage based on the Participants, Intervention, Comparisons, Outcome, and Study Design (PICOS) inclusion criteria, 18 of 1,449 articles were chosen.

RESULTS

A total of 18 studies and 14 studies (209 participants) were analyzed using a systematic review and meta-analysis, respectively. No publication bias was detected based on an Egger's regression result even though the funnel plot was asymmetrical. The results of the meta-analysis revealed that the largest improvement was seen for rhythm perception, followed by the perception of pitch and harmony and smallest for timbre perception after the music training. The duration of training affected the rhythm, pitch, and harmony perception but not the timbre. Interestingly, musical activities, such as singing, produced the biggest effect size, implying that children with CI obtained the greatest benefits of music training by singing, followed by playing an instrument and achieved the smallest effect by only listening to musical stimuli. Significant improvement in pitch perception helped with the enhancement of prosody perception.

CONCLUSION

Music training can improve the music perception of children with CI and enhance their speech prosody. Long training duration was shown to provide the largest training effect of the children's perception improvement. The children with CI learned rhythm and pitch better than they did with harmony and timbre. These results support the finding of past studies that with music training, both rhythm and pitch perception can be improved, and it also helps in the development of prosody perception.

Impact of Auditory-Motor Musical Training on Melodic Pattern Recognition in Cochlear Implant Users

OBJECTIVE

Cochlear implant (CI) users struggle with tasks of pitch-based prosody perception. Pitch pattern recognition is vital for both music comprehension and understanding the prosody of speech, which signals emotion and intent. Research in normal-hearing individuals shows that auditory-motor training, in which participants produce the auditory pattern they are learning, is more effective than passive auditory training. We investigated whether auditory-motor training of CI users improves complex sound perception, such as vocal emotion recognition and pitch pattern recognition, compared with purely auditory training.

STUDY DESIGN

Prospective cohort study.

SETTING

Tertiary academic center.

PATIENTS

Fifteen postlingually deafened adults with CIs.

INTERVENTION(S)

Participants were divided into 3 one-month training groups: auditory-motor (intervention), auditory-only (active control), and no training (control). Auditory-motor training was conducted with the "Contours" software program and auditory-only training was completed with the "AngelSound" software program.

MAIN OUTCOME MEASURE

Pre and posttest examinations included tests of speech perception (consonant-nucleus-consonant, hearing-in-noise test sentence recognition), speech prosody perception, pitch discrimination, and melodic contour identification.

RESULTS

Participants in the auditory-motor training group performed better than those in the auditory-only and no-training (p < 0.05) for the melodic contour identification task. No significant training effect was noted on tasks of speech perception, speech prosody perception, or pitch discrimination.

CONCLUSIONS

These data suggest that short-term auditory-motor music training of CI users impacts pitch pattern recognition. This study offers approaches for enriching the world of complex sound in the CI user.

Assessment of music experience after cochlear implantation: A review of current tools and their utilization

Objective

To provide an overview of the current available music assessment tools after cochlear implantation (CI); to report on the utilization of music assessments in the literature; to propose potential future directions in music assessment after CI.

Methods

A thorough search was performed in PubMed, Embase, and The Cochrane Library through October 31, 2020. MeSH search terms, keywords, and phrases included “cochlear implant,” “cochlear prosthesis,” “auditory prosthesis,” “music,” “music assessment,” “music questionnaire,” “music perception,” “music enjoyment, and “music experience.” Potentially relevant studies were reviewed for inclusion, with particular focus on assessments developed specifically for the cochlear implant population and intended for widespread use.

Results/conclusions

Six hundred and forty-three studies were screened for relevance to assessment of music experience among cochlear implantees. Eighty-one studies ultimately met criteria for inclusion. There are multiple validated tools for assessment of music experience after cochlear implantation, each of which provide slightly differing insights into the patients’ subjective and/or objective post-activation experience. However, no single assessment tool has been adopted into widespread use and thus, much of the literature pertaining to this topic evaluates outcomes non-uniformly, including single-use assessments designed specifically for the study at hand. The lack of a widely accepted universal tool for assessment of music limits our collective understanding the contributory and mitigating factors applicable to current music experience of cochlear implantees, and limits our ability to uniformly evaluate the success of new implant technologies or music training paradigms.

Music perception and training for pediatric cochlear implant users

INTRODUCTION

Cochlear implants (CIs) are biomedical devices that restore sound perception for people with severe-to-profound sensorineural hearing loss. Most postlingually deafened CI users are able to achieve excellent speech recognition in quiet environments. However, current CI sound processors remain limited in their ability to deliver fine spectrotemporal information, making it difficult for CI users to perceive complex sounds. Limited access to complex acoustic cues such as music, environmental sounds, lexical tones, and voice emotion may have significant ramifications on quality of life, social development, and community interactions.

AREAS COVERED

The purpose of this review article is to summarize the literature on CIs and music perception, with an emphasis on music training in pediatric CI recipients. The findings have implications on our understanding of noninvasive, accessible methods for improving auditory processing and may help advance our ability to improve sound quality and performance for implantees.

EXPERT OPINION

Music training, particularly in the pediatric population, may be able to continue to enhance auditory processing even after performance plateaus. The effects of these training programs appear generalizable to non-trained musical tasks, speech prosody and, emotion perception. Future studies should employ rigorous control groups involving a non-musical acoustic intervention, standardized auditory stimuli, and the provision of feedback.

Rhythmic Abilities of Children With Hearing Loss

OBJECTIVES

Children with hearing loss (HL), in spite of early cochlear implantation, often struggle considerably with language acquisition. Previous research has shown a benefit of rhythmic training on linguistic skills in children with HL, suggesting that improving rhythmic capacities could help attenuating language difficulties. However, little is known about general rhythmic skills of children with HL and how they relate to speech perception. The aim of this study is twofold: (1) to assess the abilities of children with HL in different rhythmic sensorimotor synchronization tasks compared to a normal-hearing control group and (2) to investigate a possible relation between sensorimotor synchronization abilities and speech perception abilities in children with HL.

DESIGN

A battery of sensorimotor synchronization tests with stimuli of varying acoustic and temporal complexity was used: a metronome, different musical excerpts, and complex rhythmic patterns. Synchronization abilities were assessed in 32 children (aged from 5 to 10 years) with a severe to profound HL mainly fitted with one or two cochlear implants (n = 28) or with hearing aids (n = 4). Working memory and sentence repetition abilities were also assessed. Performance was compared to an age-matched control group of 24 children with normal hearing. The comparison took into account variability in working memory capacities. For children with HL only, we computed linear regressions on speech, sensorimotor synchronization, and working memory abilities, including device-related variables such as onset of device use, type of device, and duration of use.

RESULTS

Compared to the normal-hearing group, children with HL performed poorly in all sensorimotor synchronization tasks, but the effect size was greater for complex as compared to simple stimuli. Group differences in working memory did not explain this result. Linear regression analysis revealed that working memory, synchronization to complex rhythms performances, age, and duration of device use predicted the number of correct syllables produced in a sentence repetition task.

CONCLUSION

Despite early cochlear implantation or hearing aid use, hearing impairment affects the quality of temporal processing of acoustic stimuli in congenitally deaf children. This deficit seems to be more severe with stimuli of increasing rhythmic complexity highlighting a difficulty in structuring sounds according to a temporal hierarchy.

Music Training for Children With Sensorineural Hearing Loss Improves Speech-in-Noise Perception

Purpose A growing body of evidence suggests that long-term music training provides benefits to auditory abilities for typical-hearing adults and children. The purpose of this study was to evaluate how music training may provide perceptual benefits (such as speech-in-noise, spectral resolution, and prosody) for children with hearing loss. Method Fourteen children aged 6-9 years with prelingual sensorineural hearing loss using bilateral cochlear implants, bilateral hearing aids, or bimodal configuration participated in a 12-week music training program, with nine participants completing the full testing requirements of the music training. Activities included weekly group-based music therapy and take-home music apps three times a week. The design was a pseudorandomized, longitudinal study (half the cohort was wait-listed, initially serving as a passive control group prior to music training). The test battery consisted of tasks related to music perception, music appreciation, and speech perception. As a comparison, 16 age-matched children with typical hearing also completed this test battery, but without participation in the music training. Results There were no changes for any outcomes for the passive control group. After music training, perception of speech-in-noise, question/statement prosody, musical timbre, and spectral resolution improved significantly, as did measures of music appreciation. There were no benefits for emotional prosody or pitch perception. Conclusion The findings suggest even a modest amount of music training has benefits for music and speech outcomes. These preliminary results provide further evidence that music training is a suitable complementary means of habilitation to improve the outcomes for children with hearing loss.

Musical Training for Auditory Rehabilitation in Hearing Loss

Despite the overall success of cochlear implantation, language outcomes remain suboptimal and subject to large inter-individual variability. Early auditory rehabilitation techniques have mostly focused on low-level sensory abilities. However, a new body of literature suggests that cognitive operations are critical for auditory perception remediation. We argue in this paper that musical training is a particularly appealing candidate for such therapies, as it involves highly relevant cognitive abilities, such as temporal predictions, hierarchical processing, and auditory-motor interactions. We review recent studies demonstrating that music can enhance both language perception and production at multiple levels, from syllable processing to turn-taking in natural conversation.

Influence of bilateral cochlear implants on vocal control

Receiving a cochlear implant (CI) can improve fundamental frequency (F0) control for deaf individuals, resulting in increased vocal pitch control. However, it is unclear whether using bilateral CIs, which often result in mismatched pitch perception between ears, will counter this benefit. To investigate this, 23 bilateral CI users were asked to produce a sustained vocalization using one CI, the other CI, both CIs, or neither. Additionally, a set of eight normal hearing participants completed the sustained vocalization task as a control group. The results indicated that F0 control is worse with both CIs compared to using the ear that yields the lowest vocal variability. The results also indicated that there was a large range of F0 variability even for the relatively stable portion of the vocalization, spanning from 6 to 46 cents. These results suggest that bilateral CIs can detrimentally affect vocal control.

A Preliminary Study of the Effects of Attentive Music Listening on Cochlear Implant Users' Speech Perception, Quality of Life, and Behavioral and Objective Measures of Frequency Change Detection

Introduction

Most cochlear implant (CI) users have difficulty in listening tasks that rely strongly on perception of frequency changes (e.g., speech perception in noise, musical melody perception, etc.). Some previous studies using behavioral or subjective assessments have shown that short-term music training can benefit CI users’ perception of music and speech. Electroencephalographic (EEG) recordings may reveal the neural basis for music training benefits in CI users.

Objective

To examine the effects of short-term music training on CI hearing outcomes using a comprehensive test battery of subjective evaluation, behavioral tests, and EEG measures.

Design

Twelve adult CI users were recruited for a home-based music training program that focused on attentive listening to music genres and materials that have an emphasis on melody. The participants used a music streaming program (i.e., Pandora) downloaded onto personal electronic devices for training. The participants attentively listened to music through a direct audio cable or through Bluetooth streaming. The training schedule was 40 min/session/day, 5 days/week, for either 4 or 8 weeks. The pre-training and post-training tests included: hearing thresholds, Speech, Spatial and Qualities of Hearing Scale (SSQ12) questionnaire, psychoacoustic tests of frequency change detection threshold (FCDT), speech recognition tests (CNC words, AzBio sentences, and QuickSIN), and EEG responses to tones that contained different magnitudes of frequency changes.

Results

All participants except one finished the 4- or 8-week training, resulting in a dropout rate of 8.33%. Eleven participants performed all tests except for two who did not participate in EEG tests. Results showed a significant improvement in the FCDTs as well as performance on CNC and QuickSIN after training (p < 0.05), but no significant improvement in SSQ scores (p > 0.05). Results of the EEG tests showed larger post-training cortical auditory evoked potentials (CAEPs) in seven of the nine participants, suggesting a better cortical processing of both stimulus onset and within-stimulus frequency changes.

Conclusion

These preliminary data suggest that extensive, focused music listening can improve frequency perception and speech perception in CI users. Further studies that include a larger sample size and control groups are warranted to determine the efficacy of short-term music training in CI users.

How the Brain Understands Spoken and Sung Sentences

The present study investigates whether meaning is similarly extracted from spoken and sung sentences. For this purpose, subjects listened to semantically correct and incorrect sentences while performing a correctness judgement task. In order to examine underlying neural mechanisms, a multi-methodological approach was chosen combining two neuroscientific methods with behavioral data. In particular, fast dynamic changes reflected in the semantically associated N400 component of the electroencephalography (EEG) were simultaneously assessed with the topographically more fine-grained vascular signals acquired by the functional near-infrared spectroscopy (fNIRS). EEG results revealed a larger N400 for incorrect compared to correct sentences in both spoken and sung sentences. However, the N400 was delayed for sung sentences, potentially due to the longer sentence duration. fNIRS results revealed larger activations for spoken compared to sung sentences irrespective of semantic correctness at predominantly left-hemispheric areas, potentially suggesting a greater familiarity with spoken material. Furthermore, the fNIRS revealed a widespread activation for correct compared to incorrect sentences irrespective of modality, potentially indicating a successful processing of sentence meaning. The combined results indicate similar semantic processing in speech and song.

Self-reported hearing quality of life measures in pediatric cochlear implant recipients with bilateral input

Objective: Self-reported hearing quality of life (QoL) for pediatric cochlear implant (CI) recipients was examined, asking whether 1) children with CIs have similar QoL as those with less severe hearing loss (HL); 2) children with different bilateral CI (BCI) device configurations report different QoL; and 3) do audiological, demographic and spoken language factors affect hearing QoL?Design: One hundred four children (ages 7-11 years) using bimodal devices or BCIs participated. The Hearing Environments and Reflection of Quality of Life (HEAR-QL) questionnaire, receptive language and speech perception tests were administered. HEAR-QL scores of CI recipients were compared to scores of age-mates with normal hearing and mild to profound HL.Results: HEAR-QL scores for CI participants were similar to those of children with less severe HL and did not differ with device configuration. Emotion identification and word recognition in noise correlated significantly with HEAR-QL scores.Discussion: CI recipients reported that HL hinders social participation. Better understanding of speech in noise and emotional content was associated with fewer hearing-related difficulties on the HEAR-QL.Conclusions: Noisy situations encountered in educational settings should be addressed for children with HL. The link between perception of emotion and hearing-related QoL for CI recipients should be further examined.

The Role of Music in Families of Children With Hearing Loss and Normal Hearing in Australia, Finland, and the UK

The primary aim of this current study was to compare the role, importance and value placed on music by families with normally hearing (NH) children, to those who had a child with a hearing loss (HL) who wore either hearing aids and/or cochlear implants. A secondary aim was to see whether this differed between the countries. Parents of children aged 2-6 years living in Australia, Finland, and the United Kingdom were invited to complete the Role of Music in Families Questionnaire (RMFQ). Two groups of participants were recruited from each country: (i) parents of NH children, and (ii) parents of children with a HL. The RMFQ had seven subsections covering topics such as music participation, attitudes to music, importance of music in the family, and future perspectives on music. Three hundred and twenty-two families of NH children, and 56 families of children with HL completed the questionnaire (Australia: 50 NH, 25 HL; Finland: 242 NH, 21 HL; United Kingdom: 30 NH, 10 HL). Analyses compared between NH and HL groups within each country, and between the three countries for the NH group, and the HL group, independently. Overall, there were few significant differences between the participation levels, role, or importance of music in families with NH children compared to those with a child who had a HL, regardless of whether the families lived in Australia, Finland or the United Kingdom. Children first started to respond to music at similar ages, and overall music participation frequency, and music enjoyment were relatively similar. The importance of music in the family was also similar between the NH and HL groups. In comparing between the countries, Finnish children had a tendency to have higher participation rates in musical activities, with few other differences noted. Overall, the results of this study indicate that children, regardless of hearing levels or country of residence, have similar levels of music engagement and enjoyment, and HL is not seen as a contraindication to music participation and involvement by the parents involved in this study.

Rhythmic Training Improves Temporal Anticipation and Adaptation Abilities in Children With Hearing Loss During Verbal Interaction

Purpose In this study, we investigate temporal adaptation capacities of children with normal hearing and children with cochlear implants and/or hearing aids during verbal exchange. We also address the question of the efficiency of a rhythmic training on temporal adaptation during speech interaction in children with hearing loss. Method We recorded electroencephalogram data in children while they named pictures delivered on a screen, in alternation with a virtual partner. We manipulated the virtual partner's speech rate (fast vs. slow) and the regularity of alternation (regular vs. irregular). The group of children with normal hearing was tested once, and the group of children with hearing loss was tested twice: once after 30 min of auditory training and once after 30 min of rhythmic training. Results Both groups of children adjusted their speech rate to that of the virtual partner and were sensitive to the regularity of alternation with a less accurate performance following irregular turns. Moreover, irregular turns elicited a negative event-related potential in both groups, showing a detection of temporal deviancy. Notably, the amplitude of this negative component positively correlated with accuracy in the alternation task. In children with hearing loss, the effect was more pronounced and long-lasting following rhythmic training compared with auditory training. Conclusion These results are discussed in terms of temporal adaptation abilities in speech interaction and suggest the use of rhythmic training to improve these skills of children with hearing loss.

The Emotional Communication in Hearing Questionnaire (EMO-CHeQ): Development and Evaluation

Supplemental Digital Content is available in the text.

Objectives:

The objectives of this research were to develop and evaluate a self-report questionnaire (the Emotional Communication in Hearing Questionnaire or EMO-CHeQ) designed to assess experiences of hearing and handicap when listening to signals that contain vocal emotion information.

Design:

Study 1 involved internet-based administration of a 42-item version of the EMO-CHeQ to 586 adult participants (243 with self-reported normal hearing [NH], 193 with self-reported hearing impairment but no reported use of hearing aids [HI], and 150 with self-reported hearing impairment and use of hearing aids [HA]). To better understand the factor structure of the EMO-CHeQ and eliminate redundant items, an exploratory factor analysis was conducted. Study 2 involved laboratory-based administration of a 16-item version of the EMO-CHeQ to 32 adult participants (12 normal hearing/near normal hearing (NH/nNH), 10 HI, and 10 HA). In addition, participants completed an emotion-identification task under audio and audiovisual conditions.

Results:

In study 1, the exploratory factor analysis yielded an interpretable solution with four factors emerging that explained a total of 66.3% of the variance in performance the EMO-CHeQ. Item deletion resulted in construction of the 16-item EMO-CHeQ. In study 1, both the HI and HA group reported greater vocal emotion communication handicap on the EMO-CHeQ than on the NH group, but differences in handicap were not observed between the HI and HA group. In study 2, the same pattern of reported handicap was observed in individuals with audiometrically verified hearing as was found in study 1. On the emotion-identification task, no group differences in performance were observed in the audiovisual condition, but group differences were observed in the audio alone condition. Although the HI and HA group exhibited similar emotion-identification performance, both groups performed worse than the NH/nNH group, thus suggesting the presence of behavioral deficits that parallel self-reported vocal emotion communication handicap. The EMO-CHeQ was significantly and strongly (r = −0.64) correlated with performance on the emotion-identification task for listeners with hearing impairment.

Conclusions:

The results from both studies suggest that the EMO-CHeQ appears to be a reliable and ecologically valid measure to rapidly assess experiences of hearing and handicap when listening to signals that contain vocal emotion information.

Systematic Review of Auditory Training in Pediatric Cochlear Implant Recipients

Objective The purpose of this systematic review is to evaluate the published research in auditory training (AT) for pediatric cochlear implant (CI) recipients. This review investigates whether AT in children with CIs leads to improvements in speech and language development, cognition, and/or quality of life and whether improvements, if any, remain over time post AT intervention. Method A systematic search of 7 databases identified 96 review articles published up until January 2017, 9 of which met the inclusion criteria. Data were extracted and independently assessed for risk of bias and quality of study against a PICOS (participants, intervention, control, outcomes, and study) framework. Results All studies reported improvements in trained AT tasks, including speech discrimination/identification and working memory. Retention of improvements over time was found whenever it was assessed. Transfer of learning was measured in 4 of 6 studies, which assessed generalization. Quality of life was not assessed. Overall, evidence for the included studies was deemed to be of low quality. Conclusion Benefits of AT were illustrated through the improvement in trained tasks, and this was observed in all reviewed studies. Transfer of improvement to other domains and also retention of benefits post AT were evident when assessed, although rarely done. However, higher quality evidence to further examine outcomes of AT in pediatric CI recipients is needed.

Music Training Can Improve Music and Speech Perception in Pediatric Mandarin-Speaking Cochlear Implant Users

Due to limited spectral resolution, cochlear implants (CIs) do not convey pitch information very well. Pitch cues are important for perception of music and tonal language; it is possible that music training may improve performance in both listening tasks. In this study, we investigated music training outcomes in terms of perception of music, lexical tones, and sentences in 22 young (4.8 to 9.3 years old), prelingually deaf Mandarin-speaking CI users. Music perception was measured using a melodic contour identification (MCI) task. Speech perception was measured for lexical tones and sentences presented in quiet. Subjects received 8 weeks of MCI training using pitch ranges not used for testing. Music and speech perception were measured at 2, 4, and 8 weeks after training was begun; follow-up measures were made 4 weeks after training was stopped. Mean baseline performance was 33.2%, 76.9%, and 45.8% correct for MCI, lexical tone recognition, and sentence recognition, respectively. After 8 weeks of MCI training, mean performance significantly improved by 22.9, 14.4, and 14.5 percentage points for MCI, lexical tone recognition, and sentence recognition, respectively (p < .05 in all cases). Four weeks after training was stopped, there was no significant change in posttraining music and speech performance. The results suggest that music training can significantly improve pediatric Mandarin-speaking CI users’ music and speech perception.

The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English

The RAVDESS is a validated multimodal database of emotional speech and song. The database is gender balanced consisting of 24 professional actors, vocalizing lexically-matched statements in a neutral North American accent. Speech includes calm, happy, sad, angry, fearful, surprise, and disgust expressions, and song contains calm, happy, sad, angry, and fearful emotions. Each expression is produced at two levels of emotional intensity, with an additional neutral expression. All conditions are available in face-and-voice, face-only, and voice-only formats. The set of 7356 recordings were each rated 10 times on emotional validity, intensity, and genuineness. Ratings were provided by 247 individuals who were characteristic of untrained research participants from North America. A further set of 72 participants provided test-retest data. High levels of emotional validity and test-retest intrarater reliability were reported. Corrected accuracy and composite "goodness" measures are presented to assist researchers in the selection of stimuli. All recordings are made freely available under a Creative Commons license and can be downloaded at https://doi.org/10.5281/zenodo.1188976.

Musician effect on perception of spectro-temporally degraded speech, vocal emotion, and music in young adolescents

In adult normal-hearing musicians, perception of music, vocal emotion, and speech in noise has been previously shown to be better than non-musicians, sometimes even with spectro-temporally degraded stimuli. In this study, melodic contour identification, vocal emotion identification, and speech understanding in noise were measured in young adolescent normal-hearing musicians and non-musicians listening to unprocessed or degraded signals. Different from adults, there was no musician effect for vocal emotion identification or speech in noise. Melodic contour identification with degraded signals was significantly better in musicians, suggesting potential benefits from music training for young cochlear-implant users, who experience similar spectro-temporal signal degradations.

Hearing, Emotion, Amplification, Research, and Training Workshop: Current Understanding of Hearing Loss and Emotion Perception and Priorities for Future Research

The question of how hearing loss and hearing rehabilitation affect patients' momentary emotional experiences is one that has received little attention but has considerable potential to affect patients' psychosocial function. This article is a product from the Hearing, Emotion, Amplification, Research, and Training workshop, which was convened to develop a consensus document describing research on emotion perception relevant for hearing research. This article outlines conceptual frameworks for the investigation of emotion in hearing research; available subjective, objective, neurophysiologic, and peripheral physiologic data acquisition research methods; the effects of age and hearing loss on emotion perception; potential rehabilitation strategies; priorities for future research; and implications for clinical audiologic rehabilitation. More broadly, this article aims to increase awareness about emotion perception research in audiology and to stimulate additional research on the topic.

Music perception improves in children with bilateral cochlear implants or bimodal devices

The objectives of this study were to determine if music perception by pediatric cochlear implant users can be improved by (1) providing access to bilateral hearing through two cochlear implants or a cochlear implant and a contralateral hearing aid (bimodal users) and (2) any history of music training. The Montreal Battery of Evaluation of Musical Ability test was presented via soundfield to 26 bilateral cochlear implant users, 8 bimodal users and 16 children with normal hearing. Response accuracy and reaction time were recorded via an iPad application. Bilateral cochlear implant and bimodal users perceived musical characteristics less accurately and more slowly than children with normal hearing. Children who had music training were faster and more accurate, regardless of their hearing status. Reaction time on specific subtests decreased with age, years of musical training and, for implant users, better residual hearing. Despite effects of these factors on reaction time, bimodal and bilateral cochlear implant users' responses were less accurate than those of their normal hearing peers. This means children using bilateral cochlear implants and bimodal devices continue to experience challenges perceiving music that are related to hearing impairment and/or device limitations during development.