Selective-Tap Blind Dereverberation for Two-Microphone Enhancement of Reverberant Speech

Evaluation of a spectral subtraction strategy to suppress reverberant energy in cochlear implant devices

The smearing effects of room reverberation can significantly impair the ability of cochlear implant (CI) listeners to understand speech. To ameliorate the effects of reverberation, current dereverberation algorithms focus on recovering the direct sound from the reverberated signal by inverse filtering the reverberation process. This contribution describes and evaluates a spectral subtraction (SS) strategy capable of suppressing late reflections. Late reflections are the most detrimental to speech intelligibility by CI listeners as reverberation increases. By tackling only the late part of reflections, it is shown that users of CI devices can benefit from the proposed strategy even in highly reverberant rooms. The proposed strategy is also compared against an ideal reverberant (binary) masking approach. Speech intelligibility results indicate that the proposed SS solution is able to suppress additive reverberant energy to a degree comparable to that achieved by an ideal binary mask. The added advantage is that the SS strategy proposed in this work can allow for a potentially real-time implementation in clinical CI processors.

Effect of the division between early and late reflections on intelligibility of ideal binary-masked speech

The ideal binary mask (IBM) that was originally defined in anechoic conditions has been found to yield substantial improvements in speech intelligibility in noise. The IBM has recently been extended to reverberant conditions where the direct sound and early reflections of target speech are regarded as the desired signal. It is of great interest to know how the division between early and late reflections impacts on the intelligibility of the IBM-processed noisy reverberant speech. In this present study, the division between early and late reflections in three rooms was first determined by four typical estimation approaches and then used to compute the IBMs in reverberant conditions. The IBMs were then applied to the noisy reverberant mixture signal for segregating the desired signal, and the segregated signal was further presented to normal-hearing listeners for word recognition. Results showed that the IBMs with different divisions between early and late reflections provided substantial improvements in speech intelligibility over the unprocessed mixture signals in all conditions tested, and there were small, but statistically significant, differences in speech intelligibility between the different IBMs in some conditions tested.

The effects of reverberant self- and overlap-masking on speech recognition in cochlear implant listeners

Many cochlear implant (CI) listeners experience decreased speech recognition in reverberant environments [Kokkinakis et al., J. Acoust. Soc. Am. 129(5), 3221-3232 (2011)], which may be caused by a combination of self- and overlap-masking [Bolt and MacDonald, J. Acoust. Soc. Am. 21(6), 577-580 (1949)]. Determining the extent to which these effects decrease speech recognition for CI listeners may influence reverberation mitigation algorithms. This study compared speech recognition with ideal self-masking mitigation, with ideal overlap-masking mitigation, and with no mitigation. Under these conditions, mitigating either self- or overlap-masking resulted in significant improvements in speech recognition for both normal hearing subjects utilizing an acoustic model and for CI listeners using their own devices.

Effects of early and late reflections on intelligibility of reverberated speech by cochlear implant listeners

The purpose of this study was to determine the overall impact of early and late reflections on the intelligibility of reverberated speech by cochlear implant listeners. Two specific reverberation times were assessed. For each reverberation time, sentences were presented in three different conditions wherein the target signal was filtered through the early, late or entire part of the acoustic impulse response. Results obtained with seven cochlear implant listeners indicated that while early reflections neither enhanced nor reduced overall speech perception performance, late reflections severely reduced speech intelligibility in both reverberant conditions tested.

A channel-selection criterion for suppressing reverberation in cochlear implants

Little is known about the extent to which reverberation affects speech intelligibility by cochlear implant (CI) listeners. Experiment 1 assessed CI users' performance using Institute of Electrical and Electronics Engineers (IEEE) sentences corrupted with varying degrees of reverberation. Reverberation times of 0.30, 0.60, 0.80, and 1.0 s were used. Results indicated that for all subjects tested, speech intelligibility decreased exponentially with an increase in reverberation time. A decaying-exponential model provided an excellent fit to the data. Experiment 2 evaluated (offline) a speech coding strategy for reverberation suppression using a channel-selection criterion based on the signal-to-reverberant ratio (SRR) of individual frequency channels. The SRR reflects implicitly the ratio of the energies of the signal originating from the early (and direct) reflections and the signal originating from the late reflections. Channels with SRR larger than a preset threshold were selected, while channels with SRR smaller than the threshold were zeroed out. Results in a highly reverberant scenario indicated that the proposed strategy led to substantial gains (over 60 percentage points) in speech intelligibility over the subjects' daily strategy. Further analysis indicated that the proposed channel-selection criterion reduces the temporal envelope smearing effects introduced by reverberation and also diminishes the self-masking effects responsible for flattened formants.