Contribution of auditory working memory to speech understanding in mandarin-speaking cochlear implant users

Task-Specific Rapid Auditory Perceptual Learning in Adult Cochlear Implant Recipients: What Could It Mean for Speech Recognition

OBJECTIVES

Speech recognition in cochlear implant (CI) recipients is quite variable, particularly in challenging listening conditions. Demographic, audiological, and cognitive factors explain some, but not all, of this variance. The literature suggests that rapid auditory perceptual learning explains unique variance in speech recognition in listeners with normal hearing and those with hearing loss. The present study focuses on the early adaptation phase of task-specific rapid auditory perceptual learning. It investigates whether adult CI recipients exhibit this learning and, if so, whether it accounts for portions of the variance in their recognition of fast speech and speech in noise.

DESIGN

Thirty-six adult CI recipients (ages = 35 to 77, M = 55) completed a battery of general speech recognition tests (sentences in speech-shaped noise, four-talker babble noise, and natural-fast speech), cognitive measures (vocabulary, working memory, attention, and verbal processing speed), and a rapid auditory perceptual learning task with time-compressed speech. Accuracy in the general speech recognition tasks was modeled with a series of generalized mixed models that accounted for demographic, audiological, and cognitive factors before accounting for the contribution of task-specific rapid auditory perceptual learning of time-compressed speech.

RESULTS

Most CI recipients exhibited early task-specific rapid auditory perceptual learning of time-compressed speech within the course of the first 20 sentences. This early task-specific rapid auditory perceptual learning had unique contribution to the recognition of natural-fast speech in quiet and speech in noise, although the contribution to natural-fast speech may reflect the rapid learning that occurred in this task. When accounting for demographic and cognitive characteristics, an increase of 1 SD in the early task-specific rapid auditory perceptual learning rate was associated with ~52% increase in the odds of correctly recognizing natural-fast speech in quiet, and ~19% to 28% in the odds of correctly recognizing the different types of speech in noise. Age, vocabulary, attention, and verbal processing speed also had unique contributions to general speech recognition. However, their contribution varied between the different general speech recognition tests.

CONCLUSIONS

Consistent with previous findings in other populations, in CI recipients, early task-specific rapid auditory perceptual, learning also accounts for some of the individual differences in the recognition of speech in noise and natural-fast speech in quiet. Thus, across populations, the early rapid adaptation phase of task-specific rapid auditory perceptual learning might serve as a skill that supports speech recognition in various adverse conditions. In CI users, the ability to rapidly adapt to ongoing acoustical challenges may be one of the factors associated with good CI outcomes. Overall, CI recipients with higher cognitive resources and faster rapid learning rates had better speech recognition.

Impact of SNR, peripheral auditory sensitivity, and central cognitive profile on the psychometric relation between pupillary response and speech performance in CI users

Despite substantial technical advances and wider clinical use, cochlear implant (CI) users continue to report high and elevated listening effort especially under challenging noisy conditions. Among all the objective measures to quantify listening effort, pupillometry is one of the most widely used and robust physiological measures. Previous studies with normally hearing (NH) and hearing-impaired (HI) listeners have shown that the relation between speech performance in noise and listening effort (as measured by peak pupil dilation) is not linear and exhibits an inverted-U shape. However, it is unclear whether the same psychometric relation exists in CI users, and whether individual differences in auditory sensitivity and central cognitive capacity affect this relation. Therefore, we recruited 17 post-lingually deaf CI adults to perform speech-in-noise tasks from 0 to 20 dB SNR with a 4 dB step size. Simultaneously, their pupillary responses and self-reported subjective effort were recorded. To characterize top-down and bottom-up individual variabilities, a spectro-temporal modulation task and a set of cognitive abilities were measured. Clinical word recognition in quiet and Quality of Life (QoL) were also collected. Results showed that at a group level, an inverted-U shape psychometric curve between task difficulty (SNR) and peak pupil dilation (PPD) was not observed. Individual shape of the psychometric curve was significantly associated with some individual factors: CI users with higher clinical word and speech-in-noise recognition showed a quadratic decrease of PPD over increasing SNRs; CI users with better non-verbal intelligence and lower QoL showed smaller average PPD. To summarize, individual differences in CI users had a significant impact on the psychometric relation between pupillary response and task difficulty, hence affecting the interpretation of pupillary response as listening effort (or engagement) at different task difficulty levels. Future research and clinical applications should further characterize the possible effects of individual factors (such as motivation or engagement) in modulating CI users' occurrence of 'tipping point' on their psychometric functions, and develop an individualized method for reliably quantifying listening effort using pupillometry.

Reduced Neural Specialization for Word-level Linguistic Prosody in Children with Autism

Children with autism often show atypical brain lateralization for speech and language processing, however, it is unclear what linguistic component contributes to this phenomenon. Here we measured event-related potential (ERP) responses in 21 school-age autistic children and 25 age-matched neurotypical (NT) peers during listening to word-level prosodic stimuli. We found that both groups displayed larger late negative response (LNR) amplitude to native prosody than to nonnative prosody; however, unlike the NT group exhibiting left-lateralized LNR distinction of prosodic phonology, the autism group showed no evidence of LNR lateralization. Moreover, in both groups, the LNR effects were only present for prosodic phonology but not for phoneme-free prosodic acoustics. These results extended the findings of inadequate neural specialization for language in autism to sub-lexical prosodic structures.

Speech perception in noise, working memory, and attention in children: A scoping review

PURPOSE

Speech perception in noise is an everyday occurrence for adults and children alike. The factors that influence how well individuals cope with noise during spoken communication are not well understood, particularly in the case of children. This article aims to review the available evidence on how working memory and attention play a role in children's speech perception in noise, how characteristics of measures affect results, and how this relationship differs in non-typical populations.

METHOD

This article is a scoping review of the literature available on PubMed. Forty articles were included for meeting the inclusion criteria of including children as participants, some measure of speech perception in noise, some measure of attention and/or working memory, and some attempt to establish relationships between the measures. Findings were charted and presented keeping in mind how they relate to the research questions.

RESULTS

The majority of studies report that attention and especially working memory are involved in speech perception in noise by children. We provide an overview of the impact of certain task characteristics on findings across the literature, as well as how these affect non-typical populations.

CONCLUSION

While most of the work reviewed here provides evidence suggesting that working memory and attention are important abilities employed by children in overcoming the difficulties imposed by noise during spoken communication, methodological variability still prevents a clearer picture from emerging.

Effects of Cognitive Functions on Speech Recognition in Noise in Cochlear Implant Recipients

INTRODUCTION

There are substantial differences in speech recognition performance of adult cochlear implant (CI) recipients. This study investigated the effects of cognitive function on speech recognition in CI recipients.

METHODS

The verbal working memory of 36 adults with unilateral CIs was tested using digit span tests. Attention and inhibition abilities were assessed by using the Stroop test (both congruent and incongruent tasks). Speech recognition in noise was measured using the Turkish matrix test.

RESULTS

A moderate negative correlation was observed between the critical signal-to-noise ratio obtained via speech recognition in noise test and the digit span test scores (backward and digit span total scores). There was no correlation between Stroop test scores and speech recognition in noise in CI recipients.

CONCLUSION

The findings indicated that verbal working memory correlated well with speech recognition outcomes in adult CI recipients and that higher working memory capacity led to better speech recognition performance in noise.

Listening with an Ageing Brain - a Cognitive Challenge

Hearing impairment has been recently identified as a major modifiable risk factor for cognitive decline in later life and has been becoming of increasing scientific interest. Sensory and cognitive decline are connected by complex bottom-up and top-down processes, a sharp distinction between sensation, perception, and cognition is impossible. This review provides a comprehensive overview on the effects of healthy and pathological aging on auditory as well as cognitive functioning on speech perception and comprehension, as well as specific auditory deficits in the 2 most common neurodegenerative diseases in old age: Alzheimer disease and Parkinson syndrome. Hypotheses linking hearing loss to cognitive decline are discussed, and current knowledge on the effect of hearing rehabilitation on cognitive functioning is presented. This article provides an overview of the complex relationship between hearing and cognition in old age.

Neuropsychological Functions and Audiological Findings in Elderly Cochlear Implant Users: The Role of Attention in Postoperative Performance

Objectives: The present study aimed to investigate in a group of elderly CI users working memory and attention, conventionally considered as predictors of better CI performance and to try to disentangle the effects of these cognitive domains on speech perception, finding potential markers of cognitive decline related to audiometric findings. Methods Thirty postlingually deafened CI users aged >60 underwent an audiological evaluation followed by a cognitive assessment of attention and verbal working memory. A correlation analysis was performed to evaluate the associations between cognitive variables while a simple regression investigated the relationships between cognitive and audiological variables. Comparative analysis was performed to compare variables on the basis of subjects’ attention performance. Results: Attention was found to play a significant role in sound field and speech perception. Univariate analysis found a significant difference between poor and high attention performers, while regression analysis showed that attention significantly predicted recognition of words presented at Signal/Noise +10. Further, the high attention performers showed significantly higher scores than low attentional performers for all working memory tasks. Conclusion: Overall findings confirmed that a better cognitive performance may positively contribute to better speech perception outcomes, especially in complex listening situations. WM may play a crucial role in storage and processing of auditory-verbal stimuli and a robust attention may lead to better performance for speech perception in noise. Implementation of cognitive training in auditory rehabilitation of CI users should be investigated in order to improve cognitive and audiological performance in elderly CI users.

Exploring neurocognitive factors and brain activation in adult cochlear implant recipients associated with speech perception outcomes-A scoping review

Background

Cochlear implants (CIs) are considered an effective treatment for severe-to-profound sensorineural hearing loss. However, speech perception outcomes are highly variable among adult CI recipients. Top-down neurocognitive factors have been hypothesized to contribute to this variation that is currently only partly explained by biological and audiological factors. Studies investigating this, use varying methods and observe varying outcomes, and their relevance has yet to be evaluated in a review. Gathering and structuring this evidence in this scoping review provides a clear overview of where this research line currently stands, with the aim of guiding future research.

Objective

To understand to which extent different neurocognitive factors influence speech perception in adult CI users with a postlingual onset of hearing loss, by systematically reviewing the literature.

Methods

A systematic scoping review was performed according to the PRISMA guidelines. Studies investigating the influence of one or more neurocognitive factors on speech perception post-implantation were included. Word and sentence perception in quiet and noise were included as speech perception outcome metrics and six key neurocognitive domains, as defined by the DSM-5, were covered during the literature search (Protocol in open science registries: 10.17605/OSF.IO/Z3G7W of searches in June 2020, April 2022).

Results

From 5,668 retrieved articles, 54 articles were included and grouped into three categories using different measures to relate to speech perception outcomes: (1) Nineteen studies investigating brain activation, (2) Thirty-one investigating performance on cognitive tests, and (3) Eighteen investigating linguistic skills.

Conclusion

The use of cognitive functions, recruiting the frontal cortex, the use of visual cues, recruiting the occipital cortex, and the temporal cortex still available for language processing, are beneficial for adult CI users. Cognitive assessments indicate that performance on non-verbal intelligence tasks positively correlated with speech perception outcomes. Performance on auditory or visual working memory, learning, memory and vocabulary tasks were unrelated to speech perception outcomes and performance on the Stroop task not to word perception in quiet. However, there are still many uncertainties regarding the explanation of inconsistent results between papers and more comprehensive studies are needed e.g., including different assessment times, or combining neuroimaging and behavioral measures.

Systematic review registration

https://doi.org/10.17605/OSF.IO/Z3G7W.

Music and Speech Perception in Prelingually Deafened Young Listeners With Cochlear Implants: A Preliminary Study Using Sung Speech

PURPOSE

In the context of music and speech perception, this study aimed to assess the effect of variation in one of two auditory attributes-pitch contour and timbre-on the perception of the other in prelingually deafened young cochlear implant (CI) users, and the relationship between pitch contour perception and two cognitive functions of interest.

METHOD

Nine prelingually deafened CI users, aged 8.75-22.17 years, completed a melodic contour identification (MCI) task using stimuli of piano notes or sung speech with a fixed timbre (same word for each note) or a mixed timbre (different words for each note), a speech perception task identifying matrix-styled sentences naturally intonated or sung with a fixed pitch (same pitch for each word) or a mixed pitch (different pitches for each word), a forward digit span test indexing auditory short-term memory (STM), and the matrices section of the Kaufman Brief Intelligence Test-Second Edition indexing nonverbal IQ.

RESULTS

MCI was significantly poorer for the mixed timbre condition. Speech perception was significantly poorer for the fixed and mixed pitch conditions than for the naturally intonated condition. Auditory STM positively correlated with MCI at 2- and 3-semitone note spacings. Relative to their normal-hearing peers from a related study using the same stimuli and tasks, the CI participants showed comparable MCI at 2- or 3-semitone note spacing, and a comparable level of significant decrement in speech perception across three pitch contour conditions.

CONCLUSION

Findings suggest that prelingually deafened CI users show similar trends of normal-hearing peers for the effect of variation in pitch contour or timbre on the perception of the other, and that cognitive functions may underlie these outcomes to some extent, at least for the perception of pitch contour.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21217937.

Open-Set Phoneme Recognition Performance With Varied Temporal Cues in Younger and Older Cochlear Implant Users

PURPOSE

The goal of this study was to investigate the effect of age on phoneme recognition performance in which the stimuli varied in the amount of temporal information available in the signal. Chronological age is increasingly recognized as a factor that can limit the amount of benefit an individual can receive from a cochlear implant (CI). Central auditory temporal processing deficits in older listeners may contribute to the performance gap between younger and older CI users on recognition of phonemes varying in temporal cues.

METHOD

Phoneme recognition was measured at three stimulation rates (500, 900, and 1800 pulses per second) and two envelope modulation frequencies (50 Hz and unfiltered) in 20 CI participants ranging in age from 27 to 85 years. Speech stimuli were multiple word pairs differing in temporal contrasts and were presented via direct stimulation of the electrode array using an eight-channel continuous interleaved sampling strategy. Phoneme recognition performance was evaluated at each stimulation rate condition using both envelope modulation frequencies.

RESULTS

Duration of deafness was the strongest subject-level predictor of phoneme recognition, with participants with longer durations of deafness having poorer performance overall. Chronological age did not predict performance for any stimulus condition. Additionally, duration of deafness interacted with envelope filtering. Participants with shorter durations of deafness were able to take advantage of higher frequency envelope modulations, while participants with longer durations of deafness were not.

CONCLUSIONS

Age did not significantly predict phoneme recognition performance. In contrast, longer durations of deafness were associated with a reduced ability to utilize available temporal information within the signal to improve phoneme recognition performance.

The Impact of Neurocognitive Skills on Recognition of Spectrally Degraded Sentences

BACKGROUND

 Recent models theorize that neurocognitive resources are deployed differently during speech recognition depending on task demands, such as the severity of degradation of the signal or modality (auditory vs. audiovisual [AV]). This concept is particularly relevant to the adult cochlear implant (CI) population, considering the large amount of variability among CI users in their spectro-temporal processing abilities. However, disentangling the effects of individual differences in spectro-temporal processing and neurocognitive skills on speech recognition in clinical populations of adult CI users is challenging. Thus, this study investigated the relationship between neurocognitive functions and recognition of spectrally degraded speech in a group of young adult normal-hearing (NH) listeners.

PURPOSE

 The aim of this study was to manipulate the degree of spectral degradation and modality of speech presented to young adult NH listeners to determine whether deployment of neurocognitive skills would be affected.

RESEARCH DESIGN

 Correlational study design.

STUDY SAMPLE

 Twenty-one NH college students.

DATA COLLECTION AND ANALYSIS

 Participants listened to sentences in three spectral-degradation conditions: no degradation (clear sentences); moderate degradation (8-channel noise-vocoded); and high degradation (4-channel noise-vocoded). Thirty sentences were presented in an auditory-only (A-only) modality and an AV fashion. Visual assessments from The National Institute of Health Toolbox Cognitive Battery were completed to evaluate working memory, inhibition-concentration, cognitive flexibility, and processing speed. Analyses of variance compared speech recognition performance among spectral degradation condition and modality. Bivariate correlation analyses were performed among speech recognition performance and the neurocognitive skills in the various test conditions.

RESULTS

 Main effects on sentence recognition were found for degree of degradation (p = < 0.001) and modality (p = < 0.001). Inhibition-concentration skills moderately correlated (r = 0.45, p = 0.02) with recognition scores for sentences that were moderately degraded in the A-only condition. No correlations were found among neurocognitive scores and AV speech recognition scores.

CONCLUSIONS

 Inhibition-concentration skills are deployed differentially during sentence recognition, depending on the level of signal degradation. Additional studies will be required to study these relations in actual clinical populations such as adult CI users.

Bottom-Up Signal Quality Impacts the Role of Top-Down Cognitive-Linguistic Processing During Speech Recognition by Adults with Cochlear Implants

HYPOTHESES

Significant variability persists in speech recognition outcomes in adults with cochlear implants (CIs). Sensory ("bottom-up") and cognitive-linguistic ("top-down") processes help explain this variability. However, the interactions of these bottom-up and top-down factors remain unclear. One hypothesis was tested: top-down processes would contribute differentially to speech recognition, depending on the fidelity of bottom-up input.

BACKGROUND

Bottom-up spectro-temporal processing, assessed using a Spectral-Temporally Modulated Ripple Test (SMRT), is associated with CI speech recognition outcomes. Similarly, top-down cognitive-linguistic skills relate to outcomes, including working memory capacity, inhibition-concentration, speed of lexical access, and nonverbal reasoning.

METHODS

Fifty-one adult CI users were tested for word and sentence recognition, along with performance on the SMRT and a battery of cognitive-linguistic tests. The group was divided into "low-," "intermediate-," and "high-SMRT" groups, based on SMRT scores. Separate correlation analyses were performed for each subgroup between a composite score of cognitive-linguistic processing and speech recognition.

RESULTS

Associations of top-down composite scores with speech recognition were not significant for the low-SMRT group. In contrast, these associations were significant and of medium effect size (Spearman's rho = 0.44-0.46) for two sentence types for the intermediate-SMRT group. For the high-SMRT group, top-down scores were associated with both word and sentence recognition, with medium to large effect sizes (Spearman's rho = 0.45-0.58).

CONCLUSIONS

Top-down processes contribute differentially to speech recognition in CI users based on the quality of bottom-up input. Findings have clinical implications for individualized treatment approaches relying on bottom-up device programming or top-down rehabilitation approaches.

Talker Adaptation and Lexical Difficulty Impact Word Recognition in Adults with Cochlear Implants

INTRODUCTION

Talker-specific adaptation facilitates speech recognition in normal-hearing listeners. This study examined talker adaptation in adult cochlear implant (CI) users. Three hypotheses were tested: (1) high-performing adult CI users show improved word recognition following exposure to a talker ("talker adaptation"), particularly for lexically hard words, (2) individual performance is determined by auditory sensitivity and neurocognitive skills, and (3) individual performance relates to real-world functioning.

METHODS

Fifteen high-performing, post-lingually deaf adult CI users completed a word recognition task consisting of 6 single-talker blocks (3 female/3 male native English speakers); words were lexically "easy" and "hard." Recognition accuracy was assessed "early" and "late" (first vs. last 10 trials); adaptation was assessed as the difference between late and early accuracy. Participants also completed measures of spectral-temporal processing and neurocognitive skills, as well as real-world measures of multiple-talker sentence recognition and quality of life (QoL).

RESULTS

CI users showed limited talker adaptation overall, but performance improved for lexically hard words. Stronger spectral-temporal processing and neurocognitive skills were weakly to moderately associated with more accurate word recognition and greater talker adaptation for hard words. Finally, word recognition accuracy for hard words was moderately related to multiple-talker sentence recognition and QoL.

CONCLUSION

Findings demonstrate a limited talker adaptation benefit for recognition of hard words in adult CI users. Both auditory sensitivity and neurocognitive skills contribute to performance, suggesting additional benefit from adaptation for individuals with stronger skills. Finally, processing differences related to talker adaptation and lexical difficulty may be relevant to real-world functioning.

Can a Self-report Measure Be Used to Assess Cognitive Skills in Adults With Hearing Loss?

HYPOTHESES

Adult cochlear implant candidates would self-report their executive functioning abilities as poorer than normal-hearing peers. These executive function abilities would correlate with laboratory-based cognitive tests. Lastly, executive functioning (EF) abilities would be associated with hearing-related quality of life.

BACKGROUND

Executive function refers to cognitive abilities involved in behavioral regulation during goal-directed activity. Pediatric and adult users have demonstrated delays and deficits in executive function skills compared with normal-hearing peers. This study aimed to compare self-report executive function in adult cochlear implant candidates and normal-hearing peers and to relate executive function skills to laboratory-based cognitive testing and hearing-related quality of life.

METHODS

Twenty-four postlingually deaf adult cochlear implant candidates were enrolled, along with 42 normal-hearing age-matched peers. Participants completed self-reports of executive function using the Behavior Rating Inventory of Executive Function- Adult (BRIEF-A). Participants were also tested using laboratory-based cognitive measures, as well as assessment of hearing-related quality of life on the Nijmegen Cochlear Implant Questionnaire. Groups were compared on BRIEF-A scores, and relations between BRIEF-A and lab-based cognitive measures as well as Nijmegen Cochlear Implant Questionnaire scores were examined.

RESULTS

Self-report executive function on the BRIEF-A was not significantly different between groups. Consistent relations of self-report executive function and nonverbal reasoning were identified. Strong relations were not found between self-report executive function and hearing-related quality of life.

CONCLUSIONS

Executive function as measured by BRIEF-A demonstrates some relation with a laboratory-based metric of nonverbal reasoning, but not other cognitive measures. Hearing-impaired individuals did not report poorer EF than normal-hearing controls. EF additionally did not correlate with quality of life. Our findings provide preliminary, partial validation of the BRIEF-A instrument in the preoperative evaluation of adult cochlear implant candidates.

Cognitive Functions in Adults Receiving Cochlear Implants: Predictors of Speech Recognition and Changes After Implantation

HYPOTHESES

Significant variability in speech recognition outcomes is consistently observed in adults who receive cochlear implants (CIs), some of which may be attributable to cognitive functions. Two hypotheses were tested: 1) preoperative cognitive skills assessed visually would predict postoperative speech recognition at 6 months after CI; and 2) cochlear implantation would result in benefits to cognitive processes at 6 months.

BACKGROUND

Several executive functioning tasks have been identified as contributors to speech recognition in adults with hearing loss. There is also mounting evidence that cochlear implantation can improve cognitive functioning. This study examined whether preoperative cognitive functions would predict speech recognition after implantation, and whether cognitive skills would improve as a result of CI intervention.

METHODS

Nineteen post-lingually deafened adult CI candidates were tested preoperatively using a visual battery of tests to assess working memory (WM), processing speed, inhibition-concentration, and nonverbal reasoning. Six months post-implantation, participants were assessed with a battery of word and sentence recognition measures and cognitive tests were repeated.

RESULTS

Multiple speech measures after 6 months of CI use were correlated with preoperative visual WM (symbol span task) and inhibition ability (stroop incongruent task) with moderate-to-large effect sizes. Small-to-large effect size improvements in visual WM, concentration, and inhibition tasks were found from pre- to post-CI. Patients with lower baseline cognitive abilities improved the most after implantation.

CONCLUSIONS

Findings provide evidence that preoperative cognitive factors contribute to speech recognition outcomes for adult CI users, and support the premise that implantation may lead to improvements in some cognitive domains.

High- and Low-Performing Adult Cochlear Implant Users on High-Variability Sentence Recognition: Differences in Auditory Spectral Resolution and Neurocognitive Functioning

BACKGROUND

Postlingually deafened adult cochlear implant (CI) users routinely display large individual differences in the ability to recognize and understand speech, especially in adverse listening conditions. Although individual differences have been linked to several sensory (''bottom-up'') and cognitive (''top-down'') factors, little is currently known about the relative contributions of these factors in high- and low-performing CI users.

PURPOSE

The aim of the study was to investigate differences in sensory functioning and neurocognitive functioning between high- and low-performing CI users on the Perceptually Robust English Sentence Test Open-set (PRESTO), a high-variability sentence recognition test containing sentence materials produced by multiple male and female talkers with diverse regional accents.

RESEARCH DESIGN

CI users with accuracy scores in the upper (HiPRESTO) or lower quartiles (LoPRESTO) on PRESTO in quiet completed a battery of behavioral tasks designed to assess spectral resolution and neurocognitive functioning.

STUDY SAMPLE

Twenty-one postlingually deafened adult CI users, with 11 HiPRESTO and 10 LoPRESTO participants.

DATA COLLECTION AND ANALYSIS

A discriminant analysis was carried out to determine the extent to which measures of spectral resolution and neurocognitive functioning discriminate HiPRESTO and LoPRESTO CI users. Auditory spectral resolution was measured using the Spectral-Temporally Modulated Ripple Test (SMRT). Neurocognitive functioning was assessed with visual measures of working memory (digit span), inhibitory control (Stroop), speed of lexical/phonological access (Test of Word Reading Efficiency), and nonverbal reasoning (Raven's Progressive Matrices).

RESULTS

HiPRESTO and LoPRESTO CI users were discriminated primarily by performance on the SMRT and secondarily by the Raven's test. No other neurocognitive measures contributed substantially to the discriminant function.

CONCLUSIONS

High- and low-performing CI users differed by spectral resolution and, to a lesser extent, nonverbal reasoning. These findings suggest that the extreme groups are determined by global factors of richness of sensory information and domain-general, nonverbal intelligence, rather than specific neurocognitive processing operations related to speech perception and spoken word recognition. Thus, although both bottom-up and top-down information contribute to speech recognition performance, low-performing CI users may not be sufficiently able to rely on neurocognitive skills specific to speech recognition to enhance processing of spectrally degraded input in adverse conditions involving high talker variability.

Interactions Between Item Set and Vocoding in Serial Recall

OBJECTIVES

Serial recall of digits is frequently used to measure short-term memory span in various listening conditions. However, the use of digits may mask the effect of low quality auditory input. Digits have high frequency and are phonologically distinct relative to one another, so they should be easy to identify even with low quality auditory input. In contrast, larger item sets reduce listener ability to strategically constrain their expectations, which should reduce identification accuracy and increase the time and/or cognitive resources needed for identification when auditory quality is low. This diminished accuracy and increased cognitive load should interfere with memory for sequences of items drawn from large sets. The goal of this work was to determine whether this predicted interaction between auditory quality and stimulus set in short-term memory exists, and if so, whether this interaction is associated with processing speed, vocabulary, or attention.

DESIGN

We compared immediate serial recall within young adults with normal hearing across unprocessed and vocoded listening conditions for multiple stimulus sets. Stimulus sets were lists of digits (1 to 9), consonant-vowel-consonant (CVC) words (chosen from a list of 60 words), and CVC nonwords (chosen from a list of 50 nonwords). Stimuli were unprocessed or vocoded with an eight-channel noise vocoder. To support interpretation of responses, words and nonwords were selected to minimize inclusion of multiple phonemes from within a confusion cluster. We also measured receptive vocabulary (Peabody Picture Vocabulary Test [PPVT-4]), sustained attention (test of variables of attention [TOVA]), and repetition speed for individual items from each stimulus set under both listening conditions.

RESULTS

Vocoding stimuli had no impact on serial recall of digits, but reduced memory span for words and nonwords. This reduction in memory span was attributed to an increase in phonological confusions for nonwords. However, memory span for vocoded word lists remained reduced even after accounting for common phonetic confusions, indicating that lexical status played an additional role across listening conditions. Principal components analysis found two components that explained 84% of the variance in memory span across conditions. Component one had similar load across all conditions, indicating that participants had an underlying memory capacity, which was common to all conditions. Component two was loaded by performance in the vocoded word and nonword conditions, representing the sensitivity of memory span to vocoding of these stimuli. The order in which participants completed listening conditions had a small effect on memory span that could not account for the effect of listening condition. Repetition speed was fastest for digits, slower for words, and slowest for nonwords. On average, vocoding slowed repetition speed for all stimuli, but repetition speed was not predictive of individual memory span. Vocabulary and attention showed no correlation with memory span.

CONCLUSIONS

Our results replicated previous findings that low quality auditory input can impair short-term memory, and demonstrated that this impairment is sensitive to stimulus set. Using multiple stimulus sets in degraded listening conditions can isolate memory capacity (in digit span) from impaired item identification (in word and nonword span), which may help characterize the relationship between memory and speech recognition in difficult listening conditions.

Factors Affecting Bimodal Benefit in Pediatric Mandarin-Speaking Chinese Cochlear Implant Users

OBJECTIVES

While fundamental frequency (F0) cues are important to both lexical tone perception and multitalker segregation, F0 cues are poorly perceived by cochlear implant (CI) users. Adding low-frequency acoustic hearing via a hearing aid in the contralateral ear may improve CI users' F0 perception. For English-speaking CI users, contralateral acoustic hearing has been shown to improve perception of target speech in noise and in competing talkers. For tonal languages such as Mandarin Chinese, F0 information is lexically meaningful. Given competing F0 information from multiple talkers and lexical tones, contralateral acoustic hearing may be especially beneficial for Mandarin-speaking CI users' perception of competing speech.

DESIGN

Bimodal benefit (CI+hearing aid - CI-only) was evaluated in 11 pediatric Mandarin-speaking Chinese CI users. In experiment 1, speech recognition thresholds (SRTs) were adaptively measured using a modified coordinated response measure test; subjects were required to correctly identify 2 keywords from among 10 choices in each category. SRTs were measured with CI-only or bimodal listening in the presence of steady state noise (SSN) or competing speech with the same (M+M) or different voice gender (M+F). Unaided thresholds in the non-CI ear and demographic factors were compared with speech performance. In experiment 2, SRTs were adaptively measured in SSN for recognition of 5 keywords, a more difficult listening task than the 2-keyword recognition task in experiment 1.

RESULTS

In experiment 1, SRTs were significantly lower for SSN than for competing speech in both the CI-only and bimodal listening conditions. There was no significant difference between CI-only and bimodal listening for SSN and M+F (p > 0.05); SRTs were significantly lower for CI-only than for bimodal listening for M+M (p < 0.05), suggesting bimodal interference. Subjects were able to make use of voice gender differences for bimodal listening (p < 0.05) but not for CI-only listening (p > 0.05). Unaided thresholds in the non-CI ear were positively correlated with bimodal SRTs for M+M (p < 0.006) but not for SSN or M+F. No significant correlations were observed between any demographic variables and SRTs (p > 0.05 in all cases). In experiment 2, SRTs were significantly lower with two than with five keywords (p < 0.05). A significant bimodal benefit was observed only for the 5-keyword condition (p < 0.05).

CONCLUSIONS

With the CI alone, subjects experienced greater interference with competing speech than with SSN and were unable to use voice gender difference to segregate talkers. For the coordinated response measure task, subjects experienced no bimodal benefit and even bimodal interference when competing talkers were the same voice gender. A bimodal benefit in SSN was observed for the five-keyword condition but not for the two-keyword condition, suggesting that bimodal listening may be more beneficial as the difficulty of the listening task increased. The present data suggest that bimodal benefit may depend on the type of masker and/or the difficulty of the listening task.

Spectral-Temporal Trade-Off in Vocoded Sentence Recognition: Effects of Age, Hearing Thresholds, and Working Memory

OBJECTIVES

Cochlear implant (CI) signal processing degrades the spectral components of speech. This requires CI users to rely primarily on temporal cues, specifically, amplitude modulations within the temporal envelope, to recognize speech. Auditory temporal processing ability for envelope modulations worsens with advancing age, which may put older CI users at a disadvantage compared with younger users. To evaluate how potential age-related limitations for processing temporal envelope modulations impact spectrally degraded sentence recognition, noise-vocoded sentences were presented to younger and older normal-hearing listeners in quiet. Envelope modulation rates were varied from 10 to 500 Hz by adjusting the low-pass filter cutoff frequency (LPF). The goal of this study was to evaluate if age impacts recognition of noise-vocoded speech and if this age-related limitation existed for a specific range of envelope modulation rates.

DESIGN

Noise-vocoded sentence recognition in quiet was measured as a function of number of spectral channels (4, 6, 8, and 12 channels) and LPF (10, 20, 50, 75, 150, 375, and 500 Hz) in 15 younger normal-hearing listeners and 15 older near-normal-hearing listeners. Hearing thresholds and working memory were assessed to determine the extent to which these factors were related to recognition of noise-vocoded sentences.

RESULTS

Younger listeners achieved significantly higher sentence recognition scores than older listeners overall. Performance improved in both groups as the number of spectral channels and LPF increased. As the number of spectral channels increased, the differences in sentence recognition scores between groups decreased. A spectral-temporal trade-off was observed in both groups in which performance in the 8- and 12-channel conditions plateaued with lower-frequency amplitude modulations compared with the 4- and 6-channel conditions. There was no interaction between age group and LPF, suggesting that both groups obtained similar improvements in performance with increasing LPF. The lack of an interaction between age and LPF may be due to the nature of the task of recognizing sentences in quiet. Audiometric thresholds were the only significant predictor of vocoded sentence recognition. Although performance on the working memory task declined with advancing age, working memory scores did not predict sentence recognition.

CONCLUSIONS

Younger listeners outperformed older listeners for recognizing noise-vocoded sentences in quiet. The negative impact of age was reduced when ample spectral information was available. Age-related limitations for recognizing vocoded sentences were not affected by the temporal envelope modulation rate of the signal, but instead, appear to be related to a generalized task limitation or to reduced audibility of the signal.

The Important Role of Contextual Information in Speech Perception in Cochlear Implant Users and Its Consequences in Speech Tests

This study investigated the role of contextual information in speech intelligibility, the influence of verbal working memory on the use of contextual information, and the suitability of an ecologically valid sentence test containing contextual information, compared with a CNC (Consonant-Nucleus-Consonant) word test, in cochlear implant (CI) users. Speech intelligibility performance was assessed in 50 postlingual adult CI users on sentence lists and on CNC word lists. Results were compared with a normal-hearing (NH) group. The influence of contextual information was calculated from three different context models. Working memory capacity was measured with a Reading Span Test. CI recipients made significantly more use of contextual information in recognition of CNC words and sentences than NH listeners. Their use of contextual information in sentences was related to verbal working memory capacity but not to age, indicating that the ability to use context is dependent on cognitive abilities, regardless of age. The presence of context in sentences enhanced the sensitivity to differences in sensory bottom-up information but also increased the risk of a ceiling effect. A sentence test appeared to be suitable in CI users if word scoring is used and noise is added for the best performers.

Relationship between working memory and comprehension and expression of grammar in Farsi-speaking children with cochlear implants

OBJECTIVES

Grammar is one of the most fundamental components of language and working memory (WM) is one of the most important cognitive features. These two skills play a vital role in learning, literacy and communication. Children with cochlear implants (CIs) experience delays in both of these skills. The aim of this study was to investigate the relationship between these two skills in children with CIs.

SUBJECTS AND METHODS

The sample consisted of 20 Farsi-speaking children with CIs. WM was estimated by forward and backward auditory digit spans (FBS and BDS) from the Persian (Farsi) version of the Wechsler Intelligence Scale for Children, 4th edition. The comprehension of grammar by participants was evaluated using the Persian Syntax Comprehension Test. Grammar expression was assessed using the Photographic Expressive Persian Grammar Test. Pearson's correlation and simple linear regression were used for data analysis.

RESULTS

The results of linear regression and correlation showed a strong correlation between comprehension of grammar and FDS (r = 0.61; p = 0.004) was obtained, between BDS and comprehension of grammar (r = 0.161; p = 0.080). FDS and expression of grammar (r = 0.163; p = 0.222) showed a positive but insignificant correlation.

CONCLUSION

The results indicate that WM decisively effects grammar. Enhancement of the phonological loop can improve grammar, especially comprehension of grammar. The effect of the central executive in grammar requires further research.

Relations Between Self-reported Executive Functioning and Speech Perception Skills in Adult Cochlear Implant Users

HYPOTHESIS

As a result of their hearing loss, adults with cochlear implants (CIs) would self-report poorer executive functioning (EF) skills than normal-hearing (NH) peers, and these EF skills would be associated with performance on speech recognition tasks.

BACKGROUND

EF refers to a group of high order neurocognitive skills responsible for behavioral and emotional regulation during goal-directed activity, and EF has been found to be poorer in children with CIs than their NH age-matched peers. Moreover, there is increasing evidence that neurocognitive skills, including some EF skills, contribute to the ability to recognize speech through a CI.

METHODS

Thirty postlingually deafened adults with CIs and 42 age-matched NH adults were enrolled. Participants and their spouses or significant others (informants) completed well-validated self-reports or informant-reports of EF, the Behavior Rating Inventory of Executive Function - Adult (BRIEF-A). CI users' speech recognition skills were assessed in quiet using several measures of sentence recognition. NH peers were tested for recognition of noise-vocoded versions of the same speech stimuli.

RESULTS

CI users self-reported difficulty on EF tasks of shifting and task monitoring. In CI users, measures of speech recognition correlated with several self-reported EF skills.

CONCLUSION

The present findings provide further evidence that neurocognitive factors, including specific EF skills, may decline in association with hearing loss, and that some of these EF skills contribute to speech processing under degraded listening conditions.

Visual working memory span in adults with cochlear implants: Some preliminary findings

Objective

Neurocognitive functions, specifically verbal working memory (WM), contribute to speech recognition in postlingual adults with cochlear implants (CIs) and normal-hearing (NH) listener shearing degraded speech. Three hypotheses were tested: (1) WM accuracy as assessed using three visual span measures - digits, objects, and symbols - would correlate with recognition scores for spectrally degraded speech (through a CI or when noise-vocoded); (2) WM accuracy would be best for digit span, intermediate for object span, and lowest for symbol span, due to the increasing cognitive demands across these tasks. Likewise, response times, relating to processing demands, would be shortest for digit span, intermediate for object span, and longest for symbol span; (3) CI users would demonstrate poorer and slower performance than NH peers on WM tasks, as a result of less efficient verbally mediated encoding strategies associated with a period of prolonged auditory deprivation.

Methods

Cross-sectional study of 30 postlingually deaf adults with CIs and 34 NH controls. Participants were tested for sentence recognition in quiet (CI users) or after noise-vocoding (NH peers), along with WM using visual measures of digit span, object span, and symbol span.

Results

Of the three measures of WM, digit span scores alone correlated with sentence recognition for CI users; no correlations were found using these three measures for NH peers. As predicted, WM accuracy (and response times) were best (and fastest) for digit span, intermediate for object span, and worst (and slowest) for symbol span. CI users and NH peers demonstrated equivalent WM accuracy and response time for digit span and object span, and similar response times for symbol span, but contrary to our original predictions, CI users demonstrated better accuracy on symbol span than NH peers.

Conclusions

Verbal WM assessed using visual tasks relates weakly to sentence recognition for degraded speech. CI users performed equivalently to NH peers on most visual tasks of WM, but they outperformed NH peers on symbol span accuracy. This finding deserves further exploration but may suggest that CI users develop alternative or compensatory strategies associated with rapid verbal coding, as a result of their prolonged experience of auditory deprivation.

Verbal working memory and inhibition-concentration in adults with cochlear implants

Objectives

Neurocognitive functions contribute to speech recognition in postlingual adults with cochlear implants (CIs). In particular, better verbal working memory (WM) on modality‐specific (auditory) WM tasks predicts better speech recognition. It remains unclear, however, whether this association can be attributed to basic underlying modality‐general neurocognitive functions, or whether it is solely a result of the degraded nature of auditory signals delivered by the CI. Three hypotheses were tested: 1) Both modality‐specific and modality‐general tasks of verbal WM would predict scores of sentence recognition in speech‐shaped noise; 2) Basic modality‐general neurocognitive functions of controlled fluency and inhibition‐concentration would predict both modality‐specific and modality‐general verbal WM; and 3) Scores on both tasks of verbal WM would mediate the effects of more basic neurocognitive functions on sentence recognition.

Study Design

Cross‐sectional study of 30 postlingual adults with CIs and thirty age‐matched normal‐hearing (NH) controls.

Materials and Methods

Participants were tested for sentence recognition in speech‐shaped noise, along with verbal WM using a modality‐general task (Reading Span) and an auditory modality‐specific task (Listening Span). Participants were also assessed for controlled fluency and inhibition‐concentration abilities.

Results

For CI users only, Listening Span scores predicted sentence recognition, and Listening Span scores mediated the effects of inhibition‐concentration on speech recognition. Scores on Reading Span were not related to sentence recognition for either group.

Conclusion

Inhibition‐concentration skills play an important role in CI users' sentence recognition skills, with effects mediated by modality‐specific verbal WM. Further studies will examine inhibition‐concentration and WM skills as novel targets for clinical intervention.

Level of Evidence

4.

Speech Recognition in Adults With Cochlear Implants: The Effects of Working Memory, Phonological Sensitivity, and Aging

Purpose

Models of speech recognition suggest that "top-down" linguistic and cognitive functions, such as use of phonotactic constraints and working memory, facilitate recognition under conditions of degradation, such as in noise. The question addressed in this study was what happens to these functions when a listener who has experienced years of hearing loss obtains a cochlear implant.

Method

Thirty adults with cochlear implants and 30 age-matched controls with age-normal hearing underwent testing of verbal working memory using digit span and serial recall of words. Phonological capacities were assessed using a lexical decision task and nonword repetition. Recognition of words in sentences in speech-shaped noise was measured.

Results

Implant users had only slightly poorer working memory accuracy than did controls and only on serial recall of words; however, phonological sensitivity was highly impaired. Working memory did not facilitate speech recognition in noise for either group. Phonological sensitivity predicted sentence recognition for implant users but not for listeners with normal hearing.

Conclusion

Clinical speech recognition outcomes for adult implant users relate to the ability of these users to process phonological information. Results suggest that phonological capacities may serve as potential clinical targets through rehabilitative training. Such novel interventions may be particularly helpful for older adult implant users.

The Enigma of Poor Performance by Adults With Cochlear Implants

OBJECTIVE

Considerable unexplained variability and large individual differences exist in speech recognition outcomes for postlingually deaf adults who use cochlear implants (CIs), and a sizeable fraction of CI users can be considered "poor performers." This article summarizes our current knowledge of poor CI performance, and provides suggestions to clinicians managing these patients.

METHOD

Studies are reviewed pertaining to speech recognition variability in adults with hearing loss. Findings are augmented by recent studies in our laboratories examining outcomes in postlingually deaf adults with CIs.

RESULTS

In addition to conventional clinical predictors of CI performance (e.g., amount of residual hearing, duration of deafness), factors pertaining to both "bottom-up" auditory sensitivity to the spectro-temporal details of speech, and "top-down" linguistic knowledge and neurocognitive functions contribute to CI outcomes.

CONCLUSIONS

The broad array of factors that contribute to speech recognition performance in adult CI users suggests the potential both for novel diagnostic assessment batteries to explain poor performance, and also new rehabilitation strategies for patients who exhibit poor outcomes. Moreover, this broad array of factors determining outcome performance suggests the need to treat individual CI patients using a personalized rehabilitation approach.

The contribution of short-term memory capacity to reading ability in adolescents with cochlear implants

OBJECTIVE

This study aimed to establish the relationship between short-term memory capacity and reading skills in adolescents with cochlear implants.

METHODS AND MATERIALS

A between-groups design compared a group of young people with cochlear implants with a group of hearing peers on measures of reading, and auditory and visual short-term memory capacity. The groups were matched for non-verbal IQ and age. The adolescents with cochlear implants were recruited from the Cochlear Implant Programme at a specialist children's hospital. The hearing participants were recruited from the same schools as those attended by the implanted adolescents. Participants were 18 cochlear implant users and 14 hearing controls, aged between 12 and 18 years. All used English as their main language and had no significant learning disability or neuro-developmental disorder. Short-term memory capacity was assessed in the auditory modality using Forward and Reverse Digit Span from the WISC IV UK, and visually using Forward and Reverse Memory from the Leiter-R. Individual word reading, reading comprehension and pseudoword decoding were assessed using the WIAT II UK.

RESULTS

A series of ANOVAs revealed that the adolescents with cochlear implants had significantly poorer auditory short-term memory capacity and reading skills (on all measures) compared with their hearing peers. However, when Forward Digit Span was entered into the analyses as a covariate, none of the differences remained statistically significant.

CONCLUSIONS

Deficits in immediate auditory memory persist into adolescence in deaf children with cochlear implants. Short-term auditory memory capacity is an important neurocognitive process in the development of reading skills after cochlear implantation in childhood that remains evident in later adolescence.

Effects of Within-Talker Variability on Speech Intelligibility in Mandarin-Speaking Adult and Pediatric Cochlear Implant Patients

Cochlear implant (CI) speech performance is typically evaluated using well-enunciated speech produced at a normal rate by a single talker. CI users often have greater difficulty with variations in speech production encountered in everyday listening. Within a single talker, speaking rate, amplitude, duration, and voice pitch information may be quite variable, depending on the production context. The coarse spectral resolution afforded by the CI limits perception of voice pitch, which is an important cue for speech prosody and for tonal languages such as Mandarin Chinese. In this study, sentence recognition from the Mandarin speech perception database was measured in adult and pediatric Mandarin-speaking CI listeners for a variety of speaking styles: voiced speech produced at slow, normal, and fast speaking rates; whispered speech; voiced emotional speech; and voiced shouted speech. Recognition of Mandarin Hearing in Noise Test sentences was also measured. Results showed that performance was significantly poorer with whispered speech relative to the other speaking styles and that performance was significantly better with slow speech than with fast or emotional speech. Results also showed that adult and pediatric performance was significantly poorer with Mandarin Hearing in Noise Test than with Mandarin speech perception sentences at the normal rate. The results suggest that adult and pediatric Mandarin-speaking CI patients are highly susceptible to whispered speech, due to the lack of lexically important voice pitch cues and perhaps other qualities associated with whispered speech. The results also suggest that test materials may contribute to differences in performance observed between adult and pediatric CI users.