Speech rate, rate-matching, and intelligibility in early-implanted cochlear implant users

A meta-analysis of expressive prosody in cochlear implant users

INTRODUCTION

Prosody is used to express indexical (identifying the talker), linguistic (e.g., question intonation, lexical stress), pragmatic (e.g., contrastive stress, sarcasm), and emotional/affective functions. It is manifested through changes in fundamental frequency (f0), intensity, and duration. F0 and intensity are degraded when perceived through a cochlear implant (CI). The purpose of this meta-analysis is to compare expressive prosody in speech produced by CI users versus normal hearing peers.

METHODS

A systematic search of the literature found 25 articles that met all inclusion criteria. These articles were assessed for quality, and data pertaining to the expression of f0, intensity, and duration, as well as classification accuracy and appropriateness ratings from normal hearing listeners, were extracted and meta-analyzed using random effects models.

RESULTS

The articles included in the meta-analysis were generally of acceptable or high quality. Meta-analyses revealed significant differences between individuals with CIs vs. normal hearing on all measures except mean f0, mean intensity, and rhythm. Effect sizes were generally medium to large. There was significant heterogeneity across studies, but little evidence of publication bias.

CONCLUSIONS

CI users speak with less variable f0, smaller f0 contours, more variable intensity, a slower speech rate, and reduced final lengthening at syntactic boundaries. These acoustic differences are reflected in significantly poorer ratings of speech produced by CI users compared to their normal hearing peers, as assessed by groups of normal hearing listeners. Because atypical expressive prosody is associated with negative outcomes, clinicians should consider targeting prosody when working with individuals who use CIs.

Measuring speech intelligibility with deaf and hard-of-hearing children: A systematic review

There is great variability in the ways in which the speech intelligibility of d/Deaf and hard-of-hearing (DHH) children who use spoken language as part, or all, of their communication system is measured. This systematic review examined the measures and methods that have been used when examining the speech intelligibility of children who are DHH and the characteristics of these measures and methods. A systematic database search was conducted of CENTRAL; CINAHL; Cochrane; ERIC; Joanna Briggs; Linguistics, Language and Behavior Abstracts; Medline; Scopus; and Web of Science databases, as well as supplemental searches. A total of 204 included studies reported the use of many different measures/methods which measured segmental aspects of speech, with the most common being Allen et al.'s (2001, The reliability of a rating scale for measuring speech intelligibility following pediatric cochlear implantation. Otology and Neurotology, 22(5), 631-633. https://doi.org/10.1097/00129492-200109000-00012) Speech Intelligibility Rating scale. Many studies included insufficient details to determine the measure that was used. Future research should utilize methods/measures with known psychometric validity, provide clear descriptions of the methods/measures used, and consider using more than one measure to account for limitations inherent in different methods of measuring the speech intelligibility of children who are DHH, and consider and discuss the rationale for the measure/method chosen.

Effectiveness of rhythmic training on linguistics skill development in deaf children and adolescents with cochlear implants: A systematic review

OBJECTIVE

This review compiles the scientific evidence to date on the effectiveness of musical/rhythmic training for improving and/or enhancing the development of language skills in deaf children aged 6-16 years with cochlear implants.

METHODS

PubMed, ScienceDirect, and Web of Science were used for the research following the PRISMA protocol.

RESULTS

The reviewed studies indicate that rhythmic training can improve language skills (perception, production, and comprehension) in this population, as well as in other cognitive skills.

CONCLUSION

Although further research is still needed, the current evidence can help identify new and more effective early intervention methods for deaf children.

Effect of telepractice on pediatric cochlear implant users and provider vowel space: A preliminary report

Clear speaking styles are goal-oriented modifications in which talkers adapt acoustic-phonetic characteristics of speech to compensate for communication challenges. Do children with hearing loss and a clinical provider modify speech characteristics during telepractice to adjust for remote communication? The study examined the effect of telepractice (tele-) on vowel production in seven (mean age 4:11 years, SD 1:2 years) children with cochlear implants (CIs) and a provider. The first (F1) and second (F2) formant frequencies of /i/, /ɑ/, and /u/ vowels were measured in child and provider speech during one in-person and one tele-speech-language intervention, order counterbalanced. Child and provider vowel space areas (VSA) were calculated. The results demonstrated an increase in F2 formant frequency for /i/ vowel in child and provider speech and an increase in F1 formant frequency for /ɑ/ vowel in the provider speech during tele- compared to in-person intervention. An expansion of VSA was found in child and provider speech in tele- compared to in-person intervention. In children, the earlier age of CI activation was associated with larger VSA in both tele- and in-person intervention. The results suggest that the children and the provider adjust vowel articulation in response to remote communication during telepractice.

Speaking Rate, Immediate Memory, and Grammatical Processing in Prelingual Cochlear Implant Recipients

PURPOSE

This study examined the extent to which prelingual cochlear implant (CI) users show a slowed speaking rate compared with typical-hearing (TH) talkers when repeating various speech stimuli and whether the slowed speech of CI users relates to their immediate verbal memory.

METHOD

Participants included 10 prelingually deaf teenagers who received CIs before the age of 5 years and 10 age-matched TH teenagers. Participants repeated nonword syllable strings, word strings, and center-embedded sentences, with conditions balanced for syllable length and metrical structure. Participants' digit span forward and backward scores were collected to measure immediate verbal memory. Speaking rate data were analyzed using a mixed-design, repeated-measures analysis of variance, and the relationships between speaking rate and digit spans were evaluated by Pearson correlation.

RESULTS

Participants with CIs spoke more slowly than their TH peers during the sentence repetition task but not in the nonword string and word string repetition tasks. For the CI group, significant correlations emerged between speaking rate and digit span scores (both forward and backward) for the sentence repetition task but not for the nonword string or word string repetition task. For the TH group, no significant correlations were found.

CONCLUSIONS

The findings indicate a relation between slowed speech production, reduced immediate verbal memory, and diminished language capabilities of prelingual CI users, particularly for syntactic processing. These results support theories claiming that immediate memory, including components of a central executive, influences the speaking rate of these talkers. Implications for therapies designed to increase speech fluency in CI recipients are discussed.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21644795.

Adult Cochlear Implant Users Versus Typical Hearing Persons: An Automatic Analysis of Acoustic-Prosodic Parameters

PURPOSE

The aim of this study was to investigate the speech prosody of postlingually deaf cochlear implant (CI) users compared with control speakers without hearing or speech impairment.

METHOD

Speech recordings of 74 CI users (37 males and 37 females) and 72 age-balanced control speakers (36 males and 36 females) are considered. All participants are German native speakers and read Der Nordwind und die Sonne (The North Wind and the Sun), a standard text in pathological speech analysis and phonetic transcriptions. Automatic acoustic analysis is performed considering pitch, loudness, and duration features, including speech rate and rhythm.

RESULTS

In general, duration and rhythm features differ between CI users and control speakers. CI users read slower and have a lower voiced segment ratio compared with control speakers. A lower voiced ratio goes along with a prolongation of the voiced segments' duration in male and with a prolongation of pauses in female CI users. Rhythm features in CI users have higher variability in the duration of vowels and consonants than in control speakers. The use of bilateral CIs showed no advantages concerning speech prosody features in comparison to unilateral use of CI.

CONCLUSIONS

Even after cochlear implantation and rehabilitation, the speech of postlingually deaf adults deviates from the speech of control speakers, which might be due to changed auditory feedback. We suggest considering changes in temporal aspects of speech in future rehabilitation strategies.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21579171.

Classifying Conversational Entrainment of Speech Behavior: An Expanded Framework and Review

Conversational entrainment, also known as alignment, accommodation, convergence, and coordination, is broadly defined as similarity of communicative behavior between interlocutors. Within current literature, specific terminology, definitions, and measurement approaches are wide-ranging and highly variable. As new ways of measuring and quantifying entrainment are developed and research in this area continues to expand, consistent terminology and a means of organizing entrainment research is critical, affording cohesion and assimilation of knowledge. While systems for categorizing entrainment do exist, these efforts are not entirely comprehensive in that specific measurement approaches often used within entrainment literature cannot be categorized under existing frameworks. The purpose of this review article is twofold: First, we propose an expanded version of an earlier framework which allows for the categorization of all measures of entrainment of speech behaviors and includes refinements, additions, and explanations aimed at improving its clarity and accessibility. Second, we present an extensive literature review, demonstrating how current literature fits into the given framework. We conclude with a discussion of how the proposed entrainment framework presented herein can be used to unify efforts in entrainment research.

Rhythm Perception, Speaking Rate Entrainment, and Conversational Quality: A Mediated Model

PURPOSE

Acoustic-prosodic entrainment, defined as the tendency for individuals to modify their speech behaviors to more closely align with the behaviors of their conversation partner, plays an important role in successful interaction. From a mechanistic perspective, acoustic-prosodic entrainment is, by its very nature, a rhythmic activity. Accordingly, it is highly plausible that an individual's rhythm perception abilities play a role in their ability to successfully entrain. Here, we examine the impact of rhythm perception in speaking rate entrainment and subsequent conversational quality.

METHOD

A round-robin paradigm was used to collect 90 dialogues from neurotypical adults. Additional assessments determined participants' rhythm perception abilities, social competence, and partner familiarity (i.e., whether the conversation partners knew each other prior to the interaction. Mediation analysis was used to examine the relationships between rhythm perception scores, speaking rate entrainment (using a measure of static local synchrony), and a measure of conversational success (i.e., conversational quality) based on third-party listener observations. Findings were compared to the same analysis with three additional predictive factors: participant gender, partner familiarity, and social competence.

RESULTS

Results revealed a relationship between rhythm perception and speaking rate entrainment. In unfamiliar conversation partners, there was a relationship between speaking rate entrainment and conversational quality. The relationships between entrainment and each of the three additional factors (i.e., gender, partner familiarity, and social competence) were nonsignificant.

CONCLUSIONS

In unfamiliar conversation partners, better rhythm perception abilities were indicative of increased conversational quality mediated by higher levels of speaking rate entrainment. These results support theoretical postulations specifying rhythm perception abilities as a component of acoustic-prosodic entrainment, which, in turn, facilitates conversational success. Knowledge of this relationship contributes to the development of a causal framework for considering a mechanism by which rhythm perception deficits in clinical populations may impact conversational success.

Auditory feedback experience in the development of phonetic production: Evidence from preschoolers with cochlear implants and their normal-hearing peers

Previous work has found that preschoolers with greater phonological awareness and larger lexicons, who speak more throughout the day, exhibit less intra-syllabic coarticulation in controlled speech production tasks. These findings suggest that both linguistic experience and speech-motor control are important predictors of spoken phonetic development. Still, it remains unclear how preschoolers' speech practice when they talk drives the development of coarticulation because children who talk more are likely to have both increased fine motor control and increased auditory feedback experience. Here, the potential effect of auditory feedback is studied by examining a population-children with cochlear implants (CIs)-which is naturally differing in auditory experience. The results show that (1) developmentally appropriate coarticulation improves with an increased hearing age but not chronological age; (2) children with CIs pattern coarticulatorily closer to their younger, hearing age-matched peers than chronological age-matched peers; and (3) the effects of speech practice on coarticulation, measured using naturalistic, at-home recordings of the children's speech production, only appear in the children with CIs after several years of hearing experience. Together, these results indicate a strong role of auditory feedback experience on coarticulation and suggest that parent-child communicative exchanges could stimulate children's own vocal output, which drives speech development.

Inteligibilidad: diferentes perspectivas de su concepto y evaluación. Una revisión sistemática

Una adecuada inteligibilidad es un indicador del éxito en la comunicación. Su interferencia, a causa de cualquier patología, debe ser abordada en los objetivos primordiales de la terapia. No obstante, los métodos para su evaluación son poco conocidos. Objetivo: desarrollar una revisión sistemática que describa los métodos empleados en la medición de la inteligibilidad y discutir la conceptualización de este constructo. Metodología: se realiza una búsqueda en las bases de datos PubMed, ScieLo y Science Direct para identificar artículos publicados entre 1990 y 2018. Análisis y discusiones: Se seleccionan 50 investigaciones en inglés, español y portugués, que mostraron preferencia por medidas objetivas de evaluación, por sobre las medidas subjetivas de escala. La inteligibilidad se define mejor como un constructo dependiente de la señal acústica, a diferencia del concepto de comprensibilidad. Esta revisión ofrece información actualizada y organizada para optimizar procedimientos clínicos y científicos de medición de la inteligibilidad. 

Methodology Matters: The Impact of Research Design on Conversational Entrainment Outcomes

Purpose Conversational entrainment describes the tendency for individuals to alter their communicative behaviors to more closely align with those of their conversation partner. This communication phenomenon has been widely studied, and thus, the methodologies used to examine it are diverse. Here, we summarize key differences in research design and present a test case to examine the effect of methodology on entrainment outcomes. Method Sixty neurotypical adults were randomly assigned to experimental groups formed by a 2 × 2 factorial combination of two independent variables: stimuli organization (blocked vs. random presentation) and stimuli modality (auditory-only vs. audiovisual stimuli). Individuals participated in a quasiconversational design in which the speech of a virtual interlocutor was manipulated to produce fast and slow speech rate conditions. Results There was a significant effect of stimuli organization on entrainment outcomes. Individuals in the blocked, but not the random, groups altered their speech rate to align with the speech rate of the virtual interlocutor. There were no effect of stimuli modality and no interaction between modality and organization on entrainment outcomes. Conclusion Findings highlight the importance of methodological decisions on entrainment outcomes. This underscores the need for more comprehensive research regarding entrainment methodology.

Sync Pending: Characterizing Conversational Entrainment in Dysarthria Using a Multidimensional, Clinically Informed Approach

Purpose Despite the import of conversational entrainment to successful spoken dialogue, the systematic characterization of this behavioral syncing phenomenon represents a critical gap in the field of speech pathology. The goal of this study was to acoustically characterize conversational entrainment in the context of dysarthria using a multidimensional approach previously validated in healthy populations (healthy conversations; Borrie, Barrett, Willi, & Berisha, 2019). Method A large corpus of goal-oriented conversations between participants with dysarthria and healthy participants (disordered conversations) was elicited using a "spot the difference" task. Expert clinical assessment of entrainment and a measure of conversational success (communicative efficiency) was obtained for each of the audio-recorded conversations. Conversational entrainment of acoustic features representing rhythmic, articulatory, and phonatory dimensions of speech was identified using cross-recurrence quantification analysis with clinically informed model parameters and validated with a sham condition involving conversational participants who did not converse with one another. The relationship between conversational entrainment and communicative efficiency was examined. Results Acoustic evidence of entrainment was observed in phonatory, but not rhythmic and articulatory, behavior, a finding that differs from healthy conversations in which entrainment was observed in all speech signal dimensions. This result, that disordered conversations showed less acoustic entrainment than healthy conversations, is corroborated by clinical assessment of entrainment in which the disordered conversations were rated, overall, as being less in sync than healthy conversations. Furthermore, acoustic entrainment was predictive of communicative efficiency, corroborated by a relationship between clinical assessment and the same outcome measure. Conclusions The findings confirm our hypothesis that the pathological speech production parameters of dysarthria disrupt the seemingly ubiquitous phenomenon of conversational entrainment, thus advancing entrainment deficits as an important variable in dysarthria, one that may have causative effects on the success of everyday communication. Results further reveal that while this approach provides a broad overview, methodologies for characterizing conversational entrainment in dysarthria must continue to be developed and refined, with a focus on clinical utility. Supplemental Material https://osf.io/ktg5q.

Assessing Higher Order Language Processing in Long-Term Cochlear Implant Users

Purpose The purpose of this study was to describe and explain individual differences in complex/higher order language processing in long-term cochlear implant (CI) users relative to normal-hearing (NH) peers. Method Measures of complex/higher order language processing indexed by the Clinical Evaluation of Language Fundamentals-Fourth Edition (CELF-4) Core Language subtests were obtained from 53 long-term (≥ 7 years) CI users aged 9-29 years and 60 NH controls who did not differ in age, gender, or nonverbal IQ. Vocabulary knowledge and fast, automatic language processing (rapid phonological coding, verbal rehearsal speed, and speech intelligibility) were also assessed. Results CI users showed weaker performance than NH controls on all CELF-4 Core Language subtests. These differences remained for Formulated Sentences and Recalling Sentences even when vocabulary knowledge was statistically controlled. About 50% of the CI sample scored within the range of the NH sample on Formulated Sentences and Recalling Sentences, while the remaining 50% scored well below the NH sample on these subtests. Vocabulary knowledge, rapid phonological coding, verbal rehearsal speed, and speech intelligibility were more strongly correlated with CELF-4 subtest scores in the CI sample than in the NH sample. Conclusions Weaknesses in complex, higher order language processing shown by a subgroup of CI users compared to NH peers may result from delays in fast, automatic processing of language. These at-risk domains of language functioning could serve as targets for novel interventions for deaf children who experience suboptimal spoken language outcomes following cochlear implantation.

Going With the Flow: An Examination of Entrainment in Typically Developing Children

Purpose Conversational entrainment is the tendency for individuals to modify their behavior to more closely converge with the behavior of their communication partner and is an important aspect of successful interaction. Evidence of entrainment in adults is robust, yet research regarding its development in children is sparse. Here, we investigate the emergence of entrainment skills in typically developing children. Method Data were collected from a total of 50 typically developing children between the ages of 5 and 14 years. Children participated in a quasiconversational paradigm with a virtual interlocutor. Speech rate of the interlocutor was digitally manipulated to produce fast and slow speech rate conditions. Results Data from the fast and slow conditions were compared using linear mixed models. Results indicated that children, regardless of age, did not alter their speech to match the rate of the virtual interlocutor. Conclusions Findings suggest that entrainment in children may not be as robust as entrainment in adults and therefore not adequately captured with the current experimental paradigm. Modifications to the current paradigm will help identify a methodology sufficiently sensitive to capture the speech alignment phenomenon in children and provide much needed information regarding the typical stages of entrainment development.

Rhythmic Training Improves Temporal Anticipation and Adaptation Abilities in Children With Hearing Loss During Verbal Interaction

Purpose In this study, we investigate temporal adaptation capacities of children with normal hearing and children with cochlear implants and/or hearing aids during verbal exchange. We also address the question of the efficiency of a rhythmic training on temporal adaptation during speech interaction in children with hearing loss. Method We recorded electroencephalogram data in children while they named pictures delivered on a screen, in alternation with a virtual partner. We manipulated the virtual partner's speech rate (fast vs. slow) and the regularity of alternation (regular vs. irregular). The group of children with normal hearing was tested once, and the group of children with hearing loss was tested twice: once after 30 min of auditory training and once after 30 min of rhythmic training. Results Both groups of children adjusted their speech rate to that of the virtual partner and were sensitive to the regularity of alternation with a less accurate performance following irregular turns. Moreover, irregular turns elicited a negative event-related potential in both groups, showing a detection of temporal deviancy. Notably, the amplitude of this negative component positively correlated with accuracy in the alternation task. In children with hearing loss, the effect was more pronounced and long-lasting following rhythmic training compared with auditory training. Conclusion These results are discussed in terms of temporal adaptation abilities in speech interaction and suggest the use of rhythmic training to improve these skills of children with hearing loss.

Findings from aetiological investigation of Auditory Neuropathy Spectrum Disorder in children referred to cochlear implant programs

OBJECTIVES

Auditory neuropathy spectrum disorder (ANSD) is an audiological diagnosis characterised by hearing dysfunction in the presence of intact outer hair cell function in the cochlea. ANSD is thought to account for 7-10% of all childhood permanent hearing impairment, and can result from a range of pathological processes. This paper describes the rationale, methods and findings from the aetiological investigation of ANSD.

METHODS

Retrospective audit of four cochlear implant programmes.

RESULTS

97 patients were identified. 79% of patients were identified before the age of one. Prematurity and jaundice were the most frequently identified aetiological factors. 33 patients had cochlear nerve deficiency on imaging. Genetic diagnoses identified included otoferlin, SX010 gene, connexin 26 and A1FM1 gene mutations. ANSD was seen in conjunction with syndromes including Kallman syndrome, CHARGE syndrome, X-linked deafness, SOTOS syndrome, Brown Vieletto Van Laere syndrome, and CAPOS syndrome.

DISCUSSION

We present a two-level system of aetiological investigation that is clinically practical. Patients with ANSD sufficiently severe to consider cochlear implantation are generally identified at an early age. Aetiological investigation is important to guide prognosis and identify comorbidity.

CONCLUSION

Prematurity and jaundice are the most commonly identified aetiological factors in ANSD. Imaging findings identify crucial factors in a significant minority. An important minority may have genetic and syndromic diagnoses that require further management.