Role of suppression and retro-cochlear processes in comodulation masking release

Evidence for proactive and retroactive temporal pattern analysis in simultaneous maskinga)

Amplitude modulation (AM) of a masker reduces its masking on a simultaneously presented unmodulated pure-tone target, which likely involves dip listening. This study tested the idea that dip-listening efficiency may depend on stimulus context, i.e., the match in AM peakedness (AMP) between the masker and a precursor or postcursor stimulus, assuming a form of temporal pattern analysis process. Masked thresholds were measured in normal-hearing listeners using Schroeder-phase harmonic complexes as maskers and precursors or postcursors. Experiment 1 showed threshold elevation (i.e., interference) when a flat cursor preceded or followed a peaked masker, suggesting proactive and retroactive temporal pattern analysis. Threshold decline (facilitation) was observed when the masker AMP was matched to the precursor, irrespective of stimulus AMP, suggesting only proactive processing. Subsequent experiments showed that both interference and facilitation (1) remained robust when a temporal gap was inserted between masker and cursor, (2) disappeared when an F0-difference was introduced between masker and precursor, and (3) decreased when the presentation level was reduced. These results suggest an important role of envelope regularity in dip listening, especially when masker and cursor are F0-matched and, therefore, form one perceptual stream. The reported effects seem to represent a time-domain variant of comodulation masking release.

Impact of Reduced Spectral Resolution on Temporal-Coherence-Based Source Segregation

Hearing-impaired listeners struggle to understand speech in noise, even when using cochlear implants (CIs) or hearing aids. Successful listening in noisy environments depends on the brain's ability to organize a mixture of sound sources into distinct perceptual streams (i.e., source segregation). In normal-hearing listeners, temporal coherence of sound fluctuations across frequency channels supports this process by promoting grouping of elements belonging to a single acoustic source. We hypothesized that reduced spectral resolution-a hallmark of both electric/CI (from current spread) and acoustic (from broadened tuning) hearing with sensorineural hearing loss-degrades segregation based on temporal coherence. This is because reduced frequency resolution decreases the likelihood that a single sound source dominates the activity driving any specific channel; concomitantly, it increases the correlation in activity across channels. Consistent with our hypothesis, predictions from a physiologically plausible model of temporal-coherence-based segregation suggest that CI current spread reduces comodulation masking release (CMR; a correlate of temporal-coherence processing) and speech intelligibility in noise. These predictions are consistent with our behavioral data with simulated CI listening. Our model also predicts smaller CMR with increasing levels of outer-hair-cell damage. These results suggest that reduced spectral resolution relative to normal hearing impairs temporal-coherence-based segregation and speech-in-noise outcomes.

Intensity discrimination and neural representation of a masked tone in the presence of three types of masking release

Introduction

Hearing ability is usually evaluated by assessing the lowest detectable intensity of a target sound, commonly referred to as a detection threshold. Detection thresholds of a masked signal are dependent on various auditory cues, such as the comodulation of the masking noise, interaural differences in phase, and temporal context. However, considering that communication in everyday life happens at sound intensities well above the detection threshold, the relevance of these cues for communication in complex acoustical environments is unclear. Here, we investigated the effect of three cues on the perception and neural representation of a signal in noise at supra-threshold levels.

Methods

First, we measured the decrease in detection thresholds produced by three cues, referred to as masking release. Then, we measured just-noticeable difference in intensity (intensity JND) to quantify the perception of the target signal at supra-threshold levels. Lastly, we recorded late auditory evoked potentials (LAEPs) with electroencephalography (EEG) as a physiological correlate of the target signal in noise at supra-threshold levels.

Results

The results showed that the overall masking release can be up to around 20 dB with a combination of these three cues. At the same supra-threshold levels, intensity JND was modulated by the masking release and differed across conditions. The estimated perception of the target signal in noise was enhanced by auditory cues accordingly, however, it did not differ across conditions when the target tone level was above 70 dB SPL. For the LAEPs, the P2 component was more closely linked to the masked threshold and the intensity discrimination than the N1 component.

Discussion

The results indicate that masking release affects the intensity discrimination of a masked target tone at supra-threshold levels, especially when the physical signal-to-noise is low, but plays a less significant role at high signal-to-noise ratios.

Modelling suppression and comodulation masking release using the dual-resonance nonlinear filter

Although comodulation masking release (CMR) is commonly associated with across-channel processes, it was often argued that part of the effect may be explained by processing within an auditory filter. One peripheral mechanism for such within-channel process is cochlear suppression. Using the dual-resonance nonlinear filter model with different sets of model parameters, the present study shows that the simulated CMR is associated with the simulated two-tone suppression. A modification of the model parameters results in a more accurate prediction of suppression and thus, is also more accurate in predicting the contribution of suppression to CMR.

The comparison of the comodulation masking release (CMR) in individuals with and without chronic tinnitus

In comodulation masking release (CMR), the auditory signal threshold improves when maskers far from the frequency of the target signal are coherently amplitude-modulated. Studies show that inhibitory function may play a role in CMR. In individuals who have tinnitus, decreasing inhibitory functioning in auditory central nervous system has been documented. Therefore, in this study, the purpose was to evaluate CMR in individuals suffering from tinnitus and compare CMR findings with those who do not have tinnitus. Seventeen normal-hearing individuals (without tinnitus) and 13 individuals having unilateral tonal tinnitus (4000 or 6000 Hz) with normal or near to normal hearing participated in this study. All participants were 20 to 50 years of age and underwent comodulated (CM), unmodulated (UM), and reference (RF) threshold measurements and then the CMRs (CMR and Across Frequency CMR; AF-CMR) were calculated. An ANOVA showed that the CM thresholds were statistically different between groups, while the RF and UM thresholds were not statistically different. CMR (CMR & AF-CMR) function was higher in those without tinnitus compared to unilateral tinnitus sufferers. Due to the inhibitory role of the auditory central nervous system in CMR, it appears that tinnitus and CMR both may be influenced by inhibitory function.

Comodulation Enhances Signal Detection via Priming of Auditory Cortical Circuits

Acoustic environments are composed of complex overlapping sounds that the auditory system is required to segregate into discrete perceptual objects. The functions of distinct auditory processing stations in this challenging task are poorly understood. Here we show a direct role for mouse auditory cortex in detection and segregation of acoustic information. We measured the sensitivity of auditory cortical neurons to brief tones embedded in masking noise. By altering spectrotemporal characteristics of the masker, we reveal that sensitivity to pure tone stimuli is strongly enhanced in coherently modulated broadband noise, corresponding to the psychoacoustic phenomenon comodulation masking release. Improvements in detection were largest following priming periods of noise alone, indicating that cortical segregation is enhanced over time. Transient opsin-mediated silencing of auditory cortex during the priming period almost completely abolished these improvements, suggesting that cortical processing may play a direct and significant role in detection of quiet sounds in noisy environments.

SIGNIFICANCE STATEMENT Auditory systems are adept at detecting and segregating competing sound sources, but there is little direct evidence of how this process occurs in the mammalian auditory pathway. We demonstrate that coherent broadband noise enhances signal representation in auditory cortex, and that prolonged exposure to noise is necessary to produce this enhancement. Using optogenetic perturbation to selectively silence auditory cortex during early noise processing, we show that cortical processing plays a crucial role in the segregation of competing sounds.

Comodulation masking release in an off-frequency masking paradigm

Detection threshold of a sinusoidal signal masked by a broadband masker is lower when on- and off-frequency masker components have a correlated envelope, compared to a condition in which these masker components have different envelopes. This effect is commonly referred to as comodulation masking release (CMR). The present study investigated if there is a CMR in the absence of a masker component at the signal frequency, i.e., in an off-frequency masking paradigm. Thresholds were measured for a 500-Hz signal in the presence of a broadband masker with a spectral notch at the signal frequency. Thresholds were significantly lower for a (co-)modulated than for an unmodulated masker for all notch widths up to 400 Hz. An additional experiment showed that the particularly large CMR for the no-notch condition was due to the way the modulated masker was generated. No CMR was measured when the notched-noise masker was replaced by a pair of narrowband noises. The addition of more remote masker bands resulted in a CMR of about 3-4 dB. The notched-noise data were predicted on the basis of a modulation-filterbank model. The predictions of the narrowband noise conditions indicated that all mechanisms underlying CMR might still not be fully understood.

Modeling within- and across-channel processes in comodulation masking release

The relative contributions of within-channel and across-channel processes to perceptual comodulation masking release (CMR) were investigated in the framework of an auditory processing model. A generalized version of the computational auditory signal processing and perception model [CASP; Jepsen et al., J. Acoust. Soc. Am. 124, 422-438 (2008)] was used and extended by an across-channel modulation processing stage according to Piechowiak et al. [J. Acoust. Soc. Am. 121, 2111-2126 (2007)]. Five experimental paradigms were considered: CMR with a broadband noise masker as a function of the masker spectrum level; CMR with four widely spaced flanking bands (FBs) varying in overall level; CMR with one FB varying in frequency and level relative to the on-frequency band (OFB); CMR with one FB varying in frequency; and CMR as a function of the number of FBs. The predictions suggest that at least three different mechanisms contribute to overall CMR in the considered conditions: (1) a within-channel process based on changes in the envelope characteristic due to the addition of the signal to the masker; (2) a within-channel process based on nonlinear peripheral processing of the OFB's envelope caused by the FB(s); and (3) an across-channel process that is robust across presentation levels but relatively small (2-5 dB).

Effects of sequential streaming on auditory masking using psychoacoustics and auditory evoked potentials

The present study was aimed at investigating the relationship between the mismatch negativity (MMN) and psychoacoustical effects of sequential streaming on comodulation masking release (CMR). The influence of sequential streaming on CMR was investigated using a psychoacoustical alternative forced-choice procedure and electroencephalography (EEG) for the same group of subjects. The psychoacoustical data showed, that adding precursors comprising of only off-signal-frequency maskers abolished the CMR. Complementary EEG data showed an MMN irrespective of the masker envelope correlation across frequency when only the off-signal-frequency masker components were present. The addition of such precursors promotes a separation of the on- and off-frequency masker components into distinct auditory objects preventing the auditory system from using comodulation as an additional cue. A frequency-specific adaptation changing the representation of the flanking bands in the streaming conditions may also contribute to the reduction of CMR in the stream conditions, however, it is unlikely that adaptation is the primary reason for the streaming effect. A neurophysiological correlate of sequential streaming was found in EEG data using MMN, but the magnitude of the MMN was not correlated with the audibility of the signal in CMR experiments. Dipole source analysis indicated different cortical regions involved in processing auditory streaming and modulation detection. In particular, neural sources for processing auditory streaming include cortical regions involved in decision-making.

Effects of the selective disruption of within- and across-channel cues to comodulation masking release

In many experiments on comodulation masking release (CMR), both across- and within-channel cues may be available. This makes it difficult to determine the mechanisms underlying CMR. The present study compared CMR in a flanking-band (FB) paradigm for a situation in which only across-channel cues were likely to be available [FBs placed distally from the on-frequency band (OFB)] and a situation where both across- and within-channel cues might have been available (proximally spaced FBs, for which larger CMRs have previously been observed). The use of across-channel cues was selectively disrupted using a manipulation of auditory grouping factors, following Dau et al. [J. Acoust. Soc. Am. 125, 2182-2188(2009)] and the use of within-channel cues was selectively disrupted using a manipulation called "OFB reversal," following Goldman et al. [J. Acoust. Soc. Am. 129, 3181-3193 (2011)]. The auditory grouping manipulation eliminated CMR for the distal-FB configuration and reduced CMR for the proximal-FB configuration. This may indicate that across-channel cues are available for proximal FB placement. CMR for the proximal-FB configuration persisted when both manipulations were used together, which suggests that OFB reversal does not entirely eliminate within-channel cues.

Disrupting within-channel cues to comodulation masking release

Comodulation masking release (CMR), assessed using a flanking-band (FB) paradigm, may reflect the contribution of both across- and within-channel cues when FBs are proximal to the signal frequency. This study examined the effect of disrupting within-channel cues based upon envelope beats at the output of an auditory filter centered at the signal frequency, using a method described by Richards [(1988) Hear. Res. 35, 47-58], here called "on-frequency band (OFB) reversal." This removed regular beats for a pair of proximal FBs centered symmetrically about the OFB on a linear frequency scale (but not for a single FB that had the same center frequency as either of the constituent FBs in a pair) while maintaining the comodulation of individual noise bands that provides the basis for across-channel processes. OFB reversal consistently reduced CMR for proximal FB pairs--but not for a single FB or distal FB pair or when the FBs were presented in the opposite ear to the signal plus OFB--across a range of signal frequencies and for continuous and gated noise presentation. Simulations indicated that OFB reversal reduces the availability of within-channel cues based upon temporal fine structure and changes in envelope statistics.

Within-channel cues to comodulation masking release for single and symmetrically placed pairs of flanking bands

Comodulation masking release (CMR) as measured in a flanking-band (FB) paradigm is often larger when the FBs are close to the signal frequency, f(s), than when they are remote from f(s), an effect which may be partly due to the use of within-channel cues. Schooneveldt and Moore [J. Acoust. Soc. Am. 85, 262-272 (1989)] reported that, for f(s) = 1000 Hz, this effect was larger when a single FB was used than when there were two FBs symmetrically placed about f(s), and proposed that there are within-channel cues that are available for a single FB, but not for a symmetrically placed pair of FBs. The present study replicated and extended their study. Although CMR was larger for two symmetrically placed FBs than for a single FB, the effect of FB proximity to f(s) did not differ for the two cases. The results do not support the idea that there are additional within-channel cues that are available for a single FB. Changes in the regularity of temporal fine structure and changes in the prevalence of low-amplitude envelope portions are both plausible within-channel cues.

Modeling cochlear dynamics: interrelation between cochlea mechanics and psychoacoustics

A model of the cochlea was used to bridge the gap between model approaches commonly used to investigate phenomena related to otoacoustic emissions and more filter-based model approaches often used in psychoacoustics. In the present study, a nonlinear and active one-dimensional transmission line model was developed that accounts for several aspects of physiological data with a single fixed parameter set. The model shows plausible excitation patterns and an input-output function similar to the linear-compressive-linear function as hypothesized in psychoacoustics. The model shows realistic results in a two-tone suppression paradigm and a plausible growth function of the 2f(1)-f(2) component of distortion product otoacoustic emissions. Finestructure was found in simulated stimulus-frequency otoacoustic emissions (SFOAE) with realistic levels and rapid phase rotation. A plausible "threshold in quiet" including finestructure and spontaneous otoacoustic emissions (SOAE) could be simulated. It is further shown that psychoacoustical data of modulation detection near threshold can be explained by the mechanical dynamics of the modeled healthy cochlea. It is discussed that such a model can be used to investigate the representation of acoustic signals in healthy and impaired cochleae at this early stage of the auditory pathway for both, physiological as well as psychoacoustical paradigms.

Suppression and comodulation masking release in normal-hearing and hearing-impaired listeners

The detectability of a sinusoidal signal embedded in a masker at the signal frequency can be improved by simultaneously presenting additional maskers in off-frequency regions if the additional maskers and the on-frequency masker component have the same temporal envelope. This effect is commonly referred to as comodulation masking release (CMR). Recently, it was hypothesized that peripheral nonlinear processes such as suppression may play a role in CMR over several octaves when the level of the off-frequency masker component is higher than the level of the on-frequency masker component. The aim of the present study was to test this hypothesis by measuring suppression and CMR within the same subjects for various frequency-level combinations of the off-frequency masker component. Experimental data for normal-hearing listeners show a large overlap between the existence regions for suppression and CMR. Hearing-impaired subjects with a sensorineural hearing loss show, on average, negligible suppression and CMR. The data support the hypothesis that part of the CMR in experiments with large spectral distances and large level differences between the masker components is due to the nonlinear processing at the level of the cochlea.

Spectral profile cues in comodulation masking release

Previous work on spectral shape discrimination has shown that detection of a level increment in one tone of a tonal complex is dependent on spectral position, with thresholds forming a "bowl" pattern for components spanning 200 to 5000 Hz [Green, D. M., (1988). Profile Analysis: Auditory Intensity Discrimination (Oxford University Press, New York)]. The current study examined whether a similar bowl occurs for comodulation masking release, a paradigm in which dynamic spectral cues could be used to detect an added signal. Maskers were logarithmically spaced 15-Hz-wide bands of noise. The signal was a tone or a copy of the on-signal masker band. When the masker was composed of one or more random bands, thresholds were relatively consistent across frequency. When the masker was a set of comodulated bands, thresholds for both signal types formed a bowl, but the minimum threshold occurred at a higher signal frequency for the tonal than for the narrowband noise signal. Results for additional conditions indicate that spectral effects depend on both absolute frequency and relative frequency of the signal within the masker. Data collected with flanking maskers presented contralateral to the signal and on-signal masker indicate that peripheral effects may play a role in threshold elevation at high signal frequencies with narrowband noise signals.

Combination of masking releases for different center frequencies and masker amplitude statistics

Several masking experiments have shown that the auditory system is able to use coherent envelope fluctuations of the masker across frequency within one ear as well as differences in interaural disparity between signal and masker to enhance signal detection. The two effects associated with these abilities are comodulation masking release (CMR) and binaural masking level difference (BMLD). The aim of the present study was to investigate the combination of CMR and BMLD. Thresholds for detecting a sinusoidal signal were measured in a flanking-band paradigm at three different signal frequencies. The masker was presented diotically, and various interaural phase differences (IPDs) of the signal were used. The masker components were either multiplied or Gaussian narrowband noises. In addition, a transposed stimulus was used to increase the BMLD at a high signal frequency. For all frequencies and masker conditions, thresholds decreased as the signal IPD increased and were lower when the masker components were comodulated. The data show an addition of the monaural and binaural masking releases in decibels when masker conditions with and without comodulation and the same spectrum were compared.

Features of across-frequency envelope coherence critical for comodulation masking release

The masking release associated with coherent amplitude modulation of the masker is dependent on the degree of envelope coherence across frequency, with the largest masking release for stimuli with perfectly comodulated envelopes. Experiments described here tested the hypothesis that the effects of reducing envelope coherence depend on the unique envelope features of the on-signal masker as compared to the flanking maskers. Maskers were amplitude-modulated tones (Experiments 1 and 3) or amplitude-modulated bands of noise (Experiment 2), and the signal was a tone; across-frequency masker coherence was manipulated to assess the effects of introducing additional modulation minima in either the on-signal or flanking masker envelopes of otherwise coherently modulated maskers. In all three experiments, the detrimental effect of disrupted modulation coherence was more severe when additional modulation minima were introduced in the flanking as compared to on-signal masker envelopes. This was the case for both ipsilateral and contralateral flanking masker presentations, indicating that within-channel cues were not responsible for this finding. Results are consistent with the interpretation that the cue underlying comodulation masking release is based on dynamic spectral features of the stimulus, with transient spectral peaks at the signal frequency reflecting addition of a signal.

Enhanced signal detectability in comodulated noise introduced by compression

Many examples of natural noise show common amplitude modulations at different frequency regions. This kind of noise has been termed comodulated noise and is widely examined in hearing research, where an enhanced detectability of pure tones and narrow noise bands in comodulated noise compared to unmodulated noise is well known as the CMR or CDD effects, respectively. Here it is shown that only one signal processing step, a compressive nonlinearity motivated by the peripheral auditory system, is sufficient to explain a considerable contribution to these effects. Using an analytical approach, the influence of compression on the detectability of periodic and narrow band signals in the presence of unmodulated and comodulated noise is investigated. This theoretical treatment allows for identifying the mechanism leading to improved signal detection. The compressive nonlinearity constitutes an adaptive gain which selectively boosts a stimulus during time spans of inherently increased signal-to-noise ratio and attenuates it during time spans dominated by noise. On average, these time spans are more pronounced in stimuli with comodulated noise than with unmodulated noise, thus giving rise to the observed CMR and CDD effects.

Superposition of masking releases

We are constantly exposed to a mixture of sounds of which only few are important to consider. In order to improve detectability and to segregate important sounds from less important sounds, the auditory system uses different aspects of natural sound sources. Among these are (a) its specific location and (b) synchronous envelope fluctuations in different frequency regions. Such a comodulation of different frequency bands facilitates the detection of tones in noise, a phenomenon known as comodulation masking release (CMR). Physiological as well as psychoacoustical studies usually investigate only one of these strategies to segregate sounds. Here we present psychoacoustical data on CMR for various virtual locations of the signal by varying its interaural phase difference (IPD). The results indicate that the masking release in conditions with binaural (interaural phase differences) and across-frequency (synchronous envelope fluctuations, i.e. comodulation) cues present is equal to the sum of the masking releases for each of the cues separately. Data and model predictions with a simplified model of the auditory system indicate an independent and serial processing of binaural cues and monaural across-frequency cues, maximizing the benefits from the envelope comparison across frequency and the comparison of fine structure across ears.

Factors contributing to comodulation masking release with dichotic maskers

Detection threshold for a pure tone signal centered in a narrow band of noise may be reduced by inclusion of additional flanking masker bands, provided that they share coherent amplitude modulation (AM) across frequency. This comodulation masking release (CMR) associated with coherent AM across frequency is often much smaller if the signal and on-signal masker are presented to one ear and the flanking masker band(s) are presented contralaterally. An experiment was carried out to explore the role of peripheral effects (e.g., suppression) and central effects (e.g., grouping) in this finding. As frequently reported, CMR was smaller when two or more flanking maskers were presented contralaterally to the signal than when presented ipsilaterally. An intermediate condition, where a subset of flanking maskers was presented to each ear, provided comparable benefit to presenting all flankers ipsilateral to the signal. This result suggests that central effects may play a significant role in the reduced dichotic CMR under some conditions.

Peripheral and central aspects of auditory across-frequency processing

Many natural sounds such as, e.g., speech show common level fluctuations across frequency. It is generally assumed that the auditory system uses this spectro-temporal information to group the frequency components into auditory objects although the exact physiological mechanism is still not fully understood. The aim of the present study is to disentangle the relative contribution of peripheral and central aspects of this across-frequency processing using psychophysical experiments and modelling. The study focuses on two different psychophysical phenomena which are thought to be related to the ability to compare information across frequency: comodulation masking release (CMR), i.e., a release from masking of a sinusoidal signal due to the addition of a comodulated off-frequency masker component to the masker component at the signal frequency, and comodulation detection difference (CDD), i.e., the reduced ability of the auditory system to detect a masked signal if masker and signal share the same envelope. The comparison between model predictions and experimental results indicates that a considerable amount of these effects can be accounted for by peripheral processing alone. This is confirmed by experimental results with confounding across-frequency information about the grouping of the different frequencies into auditory objects.

The role of the auditory periphery in comodulation detection difference and comodulation masking release

Natural sounds often exhibit correlated amplitude modulations at different frequency regions, so-called comodulation. Therefore, the ear might be especially adapted to these kinds of sounds. Two effects have been related to the sensitivity of the auditory system to common modulations across frequency: comodulation detection difference (CDD) and comodulation masking release (CMR). Research on these effects has been done on the psychophysical and on the neurophysiological level in humans and other animals. Until now, models have focused only on one of the effects. In the present study, a simple model based on data from neuronal recordings obtained during CDD experiments with starlings is discussed. This model demonstrates that simple peripheral processing in the ear can go a substantial way to explaining psychophysical signal detection thresholds in response to CDD and CMR stimuli. Moreover, it is largely analytically tractable. The model is based on peripheral processing and incorporates the basic steps frequency filtering, envelope extraction, and compression. Signal detection is performed based on changes in the mean compressed envelope of the filtered stimulus. Comparing the results of the model with data from the literature, the scope of this unifying approach to CDD and CMR is discussed.