Effects of Reverberation on the Relation Between Compression Speed and Working Memory for Speech-in-Noise Perception

The Effects of Signal to Noise Ratio, T60 , Wide-Dynamic Range Compression Speed, and Digital Noise Reduction in a Virtual Restaurant Setting

OBJECTIVES

Hearing aid processing in realistic listening environments is difficult to study effectively. Often the environment is unpredictable or unknown, such as in wearable aid trials with subjective report by the wearer. Some laboratory experiments create listening environments to exert tight experimental control, but those environments are often limited by physical space, a small number of sound sources, or room absorptive properties. Simulation techniques bridge this gap by providing greater experimental control over listening environments, effectively bringing aspects of the real-world into the laboratory. This project used simulation to study the effects of wide-dynamic range compression (WDRC) and digital noise reduction (DNR) on speech intelligibility in a reverberant environment with six spatialized competing talkers. The primary objective of this study was to determine the efficacy of WDRC and DNR in a complex listening environment using virtual auditory space techniques.

DESIGN

Participants of greatest interest were listeners with hearing impairment. A group of listeners with clinically normal hearing was included to assess the effects of the simulation absent the complex effects of hearing loss. Virtual auditory space techniques were used to simulate a small restaurant listening environment with two different reverberation times (0.8 and 1.8 sec) in a range of signal to noise ratios (SNRs) (-8.5 to 11.5 dB SNR). Six spatialized competing talkers were included to further enhance realism. A hearing aid simulation was used to examine the degree to which speech intelligibility was affected by slow and fast WDRC in conjunction with the presence or absence of DNR. The WDRC and DNR settings were chosen to be reasonable estimates of hearing aids currently available to consumers.

RESULTS

A WDRC × DNR × Hearing Status interaction was observed, such that DNR was beneficial for speech intelligibility when combined with fast WDRC speeds, but DNR was detrimental to speech intelligibility when WDRC speeds were slow. The pattern of the WDRC × DNR interaction was observed for both listener groups. Significant main effects of reverberation time and SNR were observed, indicating better performance with lower reverberation times and more positive SNR.

CONCLUSIONS

DNR reduced low-amplitude noise before WDRC-amplified the low-intensity portions of the signal, negating one potential downside of fast WDRC and leading to an improvement in speech intelligibility in this simulation. These data suggest that, in some real-world environments that include both reverberation and noise, older listeners with hearing impairment may find speech to be more intelligible if DNR is activated when the hearing aid has fast compression time constants. Additional research is needed to determine the appropriate DNR strength and to confirm results in wearable hearing aids and a wider range of listening environments.

Objective intelligibility measurement of reverberant vocoded speech for normal-hearing listeners: Towards facilitating the development of speech enhancement algorithms for cochlear implants

Cochlear implant (CI) recipients often struggle to understand speech in reverberant environments. Speech enhancement algorithms could restore speech perception for CI listeners by removing reverberant artifacts from the CI stimulation pattern. Listening studies, either with cochlear-implant recipients or normal-hearing (NH) listeners using a CI acoustic model, provide a benchmark for speech intelligibility improvements conferred by the enhancement algorithm but are costly and time consuming. To reduce the associated costs during algorithm development, speech intelligibility could be estimated offline using objective intelligibility measures. Previous evaluations of objective measures that considered CIs primarily assessed the combined impact of noise and reverberation and employed highly accurate enhancement algorithms. To facilitate the development of enhancement algorithms, we evaluate twelve objective measures in reverberant-only conditions characterized by a gradual reduction of reverberant artifacts, simulating the performance of an enhancement algorithm during development. Measures are validated against the performance of NH listeners using a CI acoustic model. To enhance compatibility with reverberant CI-processed signals, measure performance was assessed after modifying the reference signal and spectral filterbank. Measures leveraging the speech-to-reverberant ratio, cepstral distance and, after modifying the reference or filterbank, envelope correlation are strong predictors of intelligibility for reverberant CI-processed speech.

Influence of Audibility and Distortion on Recognition of Reverberant Speech for Children and Adults with Hearing Aid Amplification

BACKGROUND

Adults and children with sensorineural hearing loss (SNHL) have trouble understanding speech in rooms with reverberation when using hearing aid amplification. While the use of amplitude compression signal processing in hearing aids may contribute to this difficulty, there is conflicting evidence on the effects of amplitude compression settings on speech recognition. Less clear is the effect of a fast release time for adults and children with SNHL when using compression ratios derived from a prescriptive procedure.

PURPOSE

The aim of the study is to determine whether release time impacts speech recognition in reverberation for children and adults with SNHL and to determine if these effects of release time and reverberation can be predicted using indices of audibility or temporal and spectral distortion.

RESEARCH DESIGN

This is a quasi-experimental cohort study. Participants used a hearing aid simulator set to the Desired Sensation Level algorithm m[i/o] for three different amplitude compression release times. Reverberation was simulated using three different reverberation times.

PARTICIPANTS

Participants were 20 children and 16 adults with SNHL.

DATA COLLECTION AND ANALYSES

Participants were seated in a sound-attenuating booth and then nonsense syllable recognition was measured. Predictions of speech recognition were made using indices of audibility, temporal distortion, and spectral distortion and the effects of release time and reverberation were analyzed using linear mixed models.

RESULTS

While nonsense syllable recognition decreased in reverberation release time did not significantly affect nonsense syllable recognition. Participants with lower audibility were more susceptible to the negative effect of reverberation on nonsense syllable recognition.

CONCLUSION

We have extended previous work on the effects of reverberation on aided speech recognition to children with SNHL. Variations in release time did not impact the understanding of speech. An index of audibility best predicted nonsense syllable recognition in reverberation and, clinically, these results suggest that patients with less audibility are more susceptible to nonsense syllable recognition in reverberation.

Effects of Directionality, Compression, and Working Memory on Speech Recognition

OBJECTIVES

Previous research has shown that the association between hearing aid-processed speech recognition and individual working memory ability becomes stronger in more challenging conditions (e.g., higher background noise levels) and with stronger hearing aid processing (e.g., fast-acting wide dynamic range compression, WDRC). To date, studies have assumed omnidirectional microphone settings and collocated speech and noise conditions to study such relationships. Such conditions fail to recognize that most hearing aids are fit with directional processing that may improve the signal to noise ratio (SNR) and speech recognition in spatially separated speech and noise conditions. Here, we considered the possibility that directional processing may reduce the signal distortion arising from fast-acting WDRC and in turn influence the relationship between working memory ability and speech recognition with WDRC processing. The combined effects of hearing aid processing (WDRC and directionality) and SNR were quantified using a signal modification metric (cepstral correlation), which measures temporal envelope changes in the processed signal with respect to a linearly amplified reference. It was hypothesized that there will be a weaker association between working memory ability and speech recognition for hearing aid processing conditions that result in overall less signal modification (i.e., fewer changes to the processed envelope).

DESIGN

Twenty-three individuals with bilateral, mild to moderately severe sensorineural hearing loss participated in the study. Participants were fit with a commercially available hearing aid, and signal processing was varied in two dimensions: (1) Directionality (omnidirectional [OMNI] versus fixed-directional [DIR]), and (2) WDRC speed (fast-acting [FAST] versus slow-acting [SLOW]). Sentence recognition in spatially separated multi-talker babble was measured across a range of SNRs: 0 dB, 5 dB, 10 dB, and quiet. Cumulative signal modification was measured with individualized hearing aid settings, for all experimental conditions. A linear mixed-effects model was used to determine the relationship between speech recognition, working memory ability, and cumulative signal modification.

RESULTS

Signal modification results showed a complex relationship between directionality and WDRC speed, which varied by SNR. At 0 and 5 dB SNRs, signal modification was lower for SLOW than FAST regardless of directionality. However, at 10 dB SNR and in the DIR listening condition, there was no signal modification difference between FAST and SLOW. Consistent with previous studies, the association of speech recognition in noise with working memory ability depended on the level of signal modification. Contrary to the hypothesis above, however, there was a significant association of speech recognition with working memory only at lower levels of signal modification, and speech recognition increased at a faster rate for individuals with better working memory as signal modification decreased with DIR and SLOW.

CONCLUSIONS

This research suggests that working memory ability remains a significant predictor of speech recognition when WDRC and directionality are applied. Our findings revealed that directional processing can reduce the detrimental effect of fast-acting WDRC on speech cues at higher SNRs, which affects speech recognition ability. Contrary to some previous research, this study showed that individuals with better working memory ability benefitted more from a decrease in signal modification than individuals with poorer working memory ability.