Speech quality and stable gain trade-offs in adaptive feedback cancellation for hearing aids

Evaluation of deep marginal feedback cancellation for hearing aids using speech and music

Speech and music both play fundamental roles in daily life. Speech is important for communication while music is important for relaxation and social interaction. Both speech and music have a large dynamic range. This does not pose problems for listeners with normal hearing. However, for hearing-impaired listeners, elevated hearing thresholds may result in low-level portions of sound being inaudible. Hearing aids with frequency-dependent amplification and amplitude compression can partly compensate for this problem. However, the gain required for low-level portions of sound to compensate for the hearing loss can be larger than the maximum stable gain of a hearing aid, leading to acoustic feedback. Feedback control is used to avoid such instability, but this can lead to artifacts, especially when the gain is only just below the maximum stable gain. We previously proposed a deep-learning method called DeepMFC for controlling feedback and reducing artifacts and showed that when the sound source was speech DeepMFC performed much better than traditional approaches. However, its performance using music as the sound source was not assessed and the way in which it led to improved performance for speech was not determined. The present paper reveals how DeepMFC addresses feedback problems and evaluates DeepMFC using speech and music as sound sources with both objective and subjective measures. DeepMFC achieved good performance for both speech and music when it was trained with matched training materials. When combined with an adaptive feedback canceller it provided over 13 dB of additional stable gain for hearing-impaired listeners.

A deep learning solution to the marginal stability problems of acoustic feedback systems for hearing aids

For hearing aids, it is critical to reduce the acoustic coupling between the receiver and microphone to ensure that prescribed gains are below the maximum stable gain, thus preventing acoustic feedback. Methods for doing this include fixed and adaptive feedback cancellation, phase modulation, and gain reduction. However, the behavior of hearing aids in situations where the prescribed gain is only just below the maximum stable gain, called here "marginally stable gain," is not well understood. This paper analyzed marginally stable systems and identified three problems, including increased gain at frequencies with the smallest gain margin, short whistles caused by the limited rate of decay of the output when the input drops, and coloration effects. A deep learning framework, called deep marginal feedback cancellation (DeepMFC), was developed to suppress short whistles, and reduce coloration effects, as well as to limit excess amplification at certain frequencies. To implement DeepMFC, many receiver signals in closed-loop systems and corresponding open-loop systems were simulated, and the receiver signals of the closed-loop and open-loop systems were paired together to obtain parallel signals for training. DeepMFC achieved much better performance than existing feedback control methods using objective and subjective measures.

Active Middle Ear Implant Patient Outcomes With Adaptive Feedback Canceller

OBJECTIVE

Evaluation of the audiological patient performance with an upgrade of the firmware from the fixed feedback canceller (FFC) to the adaptive feedback canceller (AFC) on an active middle ear implant.

STUDY DESIGN

Retrospective observational nonrandomized group study.

SETTING

Private hospital.

PATIENTS/INTERVENTIONS

From March 2018 to September 2019, 15 patients implanted with an active middle ear implant, with 6 or more months of experience with a FFC system, were upgraded to an AFC algorithm.

MAIN OUTCOME MEASURES

Functional gain, speech perception in silence and in noise, and sound localization capacities were examined. Feedback reduction was also analyzed.

RESULTS

Thirteen patients were analyzed. Pure tone audiometric evaluation with FFC (mean value of 48.02 dB) compared with AFC at 1 (mean value of 49.12 dB) and 6 months (mean value of 42.75 dB) revealed no statistically significant differences (p = 0.889 and p = 0.358 respectively).In speech discrimination in silence, clinically relevant improvements were observed with AFC at 1 and 6 months, with a mean value of 41.5 and 38.3 dB, respectively (p = 0.03 and p = 0.021 correspondingly). In speech discrimination in noisy environments, we observed an improvement of the different conditions tested. No differences were found in localization capacities between FFC and AFC at the two different moments of evaluation.

CONCLUSIONS

AFC is more effective than FFC in cancelling feedback and improving sound quality, allowing for better speech understanding in silence and in noise.

A Wearable, Extensible, Open-Source Platform for Hearing Healthcare Research

Hearing loss is one of the most common conditions affecting older adults worldwide. Frequent complaints from the users of modern hearing aids include poor speech intelligibility in noisy environments and high cost, among other issues. However, the signal processing and audiological research needed to address these problems has long been hampered by proprietary development systems, underpowered embedded processors, and the difficulty of performing tests in real-world acoustical environments. To facilitate existing research in hearing healthcare and enable new investigations beyond what is currently possible, we have developed a modern, open-source hearing research platform, Open Speech Platform (OSP). This paper presents the system design of the complete OSP wearable platform, from hardware through firmware and software to user applications. The platform provides a complete suite of basic and advanced hearing aid features which can be adapted by researchers. It serves web apps directly from a hotspot on the wearable hardware, enabling users and researchers to control the system in real time. In addition, it can simultaneously acquire high-quality electroencephalography (EEG) or other electrophysiological signals closely synchronized to the audio. All of these features are provided in a wearable form factor with enough battery life for hours of operation in the field.

Proportionate Adaptive Filters Based on Minimizing Diversity Measures for Promoting Sparsity

In this paper, a novel way of deriving proportionate adaptive filters is proposed based on diversity measure minimization using the iterative reweighting techniques well-known in the sparse signal recovery (SSR) area. The resulting least mean square (LMS)-type and normalized LMS (NLMS)-type sparse adaptive filtering algorithms can incorporate various diversity measures that have proved effective in SSR. Furthermore, by setting the regularization coefficient of the diversity measure term to zero in the resulting algorithms, Sparsity promoting LMS (SLMS) and Sparsity promoting NLMS (SNLMS) are introduced, which exploit but do not strictly enforce the sparsity of the system response if it already exists. Moreover, unlike most existing proportionate algorithms that design the step-size control factors based on heuristics, our SSR-based framework leads to designing the factors in a more systematic way. Simulation results are presented to demonstrate the convergence behavior of the derived algorithms for systems with different sparsity levels.

On Mitigating Acoustic Feedback in Hearing Aids with Frequency Warping by All-Pass Networks

Acoustic feedback control continues to be a challenging problem due to the emerging form factors in advanced hearing aids (HAs) and hearables. In this paper, we present a novel use of well-known all-pass filters in a network to perform frequency warping that we call "freping." Freping helps in breaking the Nyquist stability criterion and improves adaptive feedback cancellation (AFC). Based on informal subjective assessments, distortions due to freping are fairly benign. While common objective metrics like the perceptual evaluation of speech quality (PESQ) and the hearing-aid speech quality index (HASQI) may not adequately capture distortions due to freping and acoustic feedback artifacts from a perceptual perspective, they are still instructive in assessing the proposed method. We demonstrate quality improvements with freping for a basic AFC (PESQ: 2.56 to 3.52 and HASQI: 0.65 to 0.78) at a gain setting of 20; and an advanced AFC (PESQ: 2.75 to 3.17 and HASQI: 0.66 to 0.73) for a gain of 30. From our investigations, freping provides larger improvement for basic AFC, but still improves overall system performance for many AFC approaches.

A Wearable Platform for Research in Augmented Hearing

We have previously reported a realtime, open-source speech-processing platform (OSP) for hearing aids (HAs) research. In this contribution, we describe a wearable version of this platform to facilitate audiological studies in the lab and in the field. The system is based on smartphone chipsets to leverage power efficiency in terms of FLOPS/watt and economies of scale. We present the system architecture and discuss salient design elements in support of HA research. The ear-level assemblies support up to 4 microphones on each ear, with 96 kHz, 24 bit codecs. The wearable unit runs OSP Release 2018c on top of 64-bit Debian Linux for binaural HA with an overall latency of 5.6 ms. The wearable unit also hosts an embedded web server (EWS) to monitor and control the HA state in realtime. We describe three example web apps in support of typical audiological studies they enable. Finally, we describe a baseline speech enhancement module included with Release 2018c, and describe extensions to the algorithms as future work.