Peripheral and central aspects of auditory across-frequency processing

The role of temporal coherence and temporal predictability in the build-up of auditory grouping

The cochlea decomposes sounds into separate frequency channels, from which the auditory brain must reconstruct the auditory scene. To do this the auditory system must make decisions about which frequency information should be grouped together, and which should remain distinct. Two key cues for grouping are temporal coherence, resulting from coherent changes in power across frequency, and temporal predictability, resulting from regular or predictable changes over time. To test how these cues contribute to the construction of a sound scene we present listeners with a range of precursor sounds, which act to prime the auditory system by providing information about each sounds structure, followed by a fixed masker in which participants were required to detect the presence of an embedded tone. By manipulating temporal coherence and/or temporal predictability in the precursor we assess how prior sound exposure influences subsequent auditory grouping. In Experiment 1, we measure the contribution of temporal predictability by presenting temporally regular or jittered precursors, and temporal coherence by using either narrow or broadband sounds, demonstrating that both independently contribute to masking/unmasking. In Experiment 2, we measure the relative impact of temporal coherence and temporal predictability and ask whether the influence of each in the precursor signifies an enhancement or interference of unmasking. We observed that interfering precursors produced the largest changes to thresholds.

Comodulation detection difference and binaural unmasking

The present study investigated the combined effect of binaural cues and comodulation for a narrowband target noise masked by a narrowband noise. The threshold difference between a diotic condition (same stimuli in both ears) and a dichotic condition (target interaural phase difference of π and diotic masker) decreased with spectral distance between masker and target, irrespective of across-frequency envelope correlation. The threshold difference between a condition with comodulated target and masker and a corresponding uncorrelated condition, i.e., the comodulation detection difference, did not depend on target frequency and interaural correlation, indicating that these two stimulus properties are processed independently.

Comodulation masking release in an off-frequency masking paradigm

Detection threshold of a sinusoidal signal masked by a broadband masker is lower when on- and off-frequency masker components have a correlated envelope, compared to a condition in which these masker components have different envelopes. This effect is commonly referred to as comodulation masking release (CMR). The present study investigated if there is a CMR in the absence of a masker component at the signal frequency, i.e., in an off-frequency masking paradigm. Thresholds were measured for a 500-Hz signal in the presence of a broadband masker with a spectral notch at the signal frequency. Thresholds were significantly lower for a (co-)modulated than for an unmodulated masker for all notch widths up to 400 Hz. An additional experiment showed that the particularly large CMR for the no-notch condition was due to the way the modulated masker was generated. No CMR was measured when the notched-noise masker was replaced by a pair of narrowband noises. The addition of more remote masker bands resulted in a CMR of about 3-4 dB. The notched-noise data were predicted on the basis of a modulation-filterbank model. The predictions of the narrowband noise conditions indicated that all mechanisms underlying CMR might still not be fully understood.

Assessing the effects of temporal coherence on auditory stream formation through comodulation masking release

Recent studies of auditory streaming have suggested that repeated synchronous onsets and offsets over time, referred to as "temporal coherence," provide a strong grouping cue between acoustic components, even when they are spectrally remote. This study uses a measure of auditory stream formation, based on comodulation masking release (CMR), to assess the conditions under which a loss of temporal coherence across frequency can lead to auditory stream segregation. The measure relies on the assumption that the CMR, produced by flanking bands remote from the masker and target frequency, only occurs if the masking and flanking bands form part of the same perceptual stream. The masking and flanking bands consisted of sequences of narrowband noise bursts, and the temporal coherence between the masking and flanking bursts was manipulated in two ways: (a) By introducing a fixed temporal offset between the flanking and masking bands that varied from zero to 60 ms and (b) by presenting the flanking and masking bursts at different temporal rates, so that the asynchronies varied from burst to burst. The results showed reduced CMR in all conditions where the flanking and masking bands were temporally incoherent, in line with expectations of the temporal coherence hypothesis.

Effects of sequential streaming on auditory masking using psychoacoustics and auditory evoked potentials

The present study was aimed at investigating the relationship between the mismatch negativity (MMN) and psychoacoustical effects of sequential streaming on comodulation masking release (CMR). The influence of sequential streaming on CMR was investigated using a psychoacoustical alternative forced-choice procedure and electroencephalography (EEG) for the same group of subjects. The psychoacoustical data showed, that adding precursors comprising of only off-signal-frequency maskers abolished the CMR. Complementary EEG data showed an MMN irrespective of the masker envelope correlation across frequency when only the off-signal-frequency masker components were present. The addition of such precursors promotes a separation of the on- and off-frequency masker components into distinct auditory objects preventing the auditory system from using comodulation as an additional cue. A frequency-specific adaptation changing the representation of the flanking bands in the streaming conditions may also contribute to the reduction of CMR in the stream conditions, however, it is unlikely that adaptation is the primary reason for the streaming effect. A neurophysiological correlate of sequential streaming was found in EEG data using MMN, but the magnitude of the MMN was not correlated with the audibility of the signal in CMR experiments. Dipole source analysis indicated different cortical regions involved in processing auditory streaming and modulation detection. In particular, neural sources for processing auditory streaming include cortical regions involved in decision-making.

Effects of the selective disruption of within- and across-channel cues to comodulation masking release

In many experiments on comodulation masking release (CMR), both across- and within-channel cues may be available. This makes it difficult to determine the mechanisms underlying CMR. The present study compared CMR in a flanking-band (FB) paradigm for a situation in which only across-channel cues were likely to be available [FBs placed distally from the on-frequency band (OFB)] and a situation where both across- and within-channel cues might have been available (proximally spaced FBs, for which larger CMRs have previously been observed). The use of across-channel cues was selectively disrupted using a manipulation of auditory grouping factors, following Dau et al. [J. Acoust. Soc. Am. 125, 2182-2188(2009)] and the use of within-channel cues was selectively disrupted using a manipulation called "OFB reversal," following Goldman et al. [J. Acoust. Soc. Am. 129, 3181-3193 (2011)]. The auditory grouping manipulation eliminated CMR for the distal-FB configuration and reduced CMR for the proximal-FB configuration. This may indicate that across-channel cues are available for proximal FB placement. CMR for the proximal-FB configuration persisted when both manipulations were used together, which suggests that OFB reversal does not entirely eliminate within-channel cues.

Disrupting within-channel cues to comodulation masking release

Comodulation masking release (CMR), assessed using a flanking-band (FB) paradigm, may reflect the contribution of both across- and within-channel cues when FBs are proximal to the signal frequency. This study examined the effect of disrupting within-channel cues based upon envelope beats at the output of an auditory filter centered at the signal frequency, using a method described by Richards [(1988) Hear. Res. 35, 47-58], here called "on-frequency band (OFB) reversal." This removed regular beats for a pair of proximal FBs centered symmetrically about the OFB on a linear frequency scale (but not for a single FB that had the same center frequency as either of the constituent FBs in a pair) while maintaining the comodulation of individual noise bands that provides the basis for across-channel processes. OFB reversal consistently reduced CMR for proximal FB pairs--but not for a single FB or distal FB pair or when the FBs were presented in the opposite ear to the signal plus OFB--across a range of signal frequencies and for continuous and gated noise presentation. Simulations indicated that OFB reversal reduces the availability of within-channel cues based upon temporal fine structure and changes in envelope statistics.

Within-channel cues to comodulation masking release for single and symmetrically placed pairs of flanking bands

Comodulation masking release (CMR) as measured in a flanking-band (FB) paradigm is often larger when the FBs are close to the signal frequency, f(s), than when they are remote from f(s), an effect which may be partly due to the use of within-channel cues. Schooneveldt and Moore [J. Acoust. Soc. Am. 85, 262-272 (1989)] reported that, for f(s) = 1000 Hz, this effect was larger when a single FB was used than when there were two FBs symmetrically placed about f(s), and proposed that there are within-channel cues that are available for a single FB, but not for a symmetrically placed pair of FBs. The present study replicated and extended their study. Although CMR was larger for two symmetrically placed FBs than for a single FB, the effect of FB proximity to f(s) did not differ for the two cases. The results do not support the idea that there are additional within-channel cues that are available for a single FB. Changes in the regularity of temporal fine structure and changes in the prevalence of low-amplitude envelope portions are both plausible within-channel cues.

Behavioral semantics of learning and crossmodal processing in auditory cortex: the semantic processor concept

Two phenomena of auditory cortex activity have recently attracted attention, namely that the primary field can show different types of learning-related changes of sound representation and that during learning even this early auditory cortex is under strong multimodal influence. Based on neuronal recordings in animal auditory cortex during instrumental tasks, in this review we put forward the hypothesis that these two phenomena serve to derive the task-specific meaning of sounds by associative learning. To understand the implications of this tenet, it is helpful to realize how a behavioral meaning is usually derived for novel environmental sounds. For this purpose, associations with other sensory, e.g. visual, information are mandatory to develop a connection between a sound and its behaviorally relevant cause and/or the context of sound occurrence. This makes it plausible that in instrumental tasks various non-auditory sensory and procedural contingencies of sound generation become co-represented by neuronal firing in auditory cortex. Information related to reward or to avoidance of discomfort during task learning, that is essentially non-auditory, is also co-represented. The reinforcement influence points to the dopaminergic internal reward system, the local role of which for memory consolidation in auditory cortex is well-established. Thus, during a trial of task performance, the neuronal responses to the sounds are embedded in a sequence of representations of such non-auditory information. The embedded auditory responses show task-related modulations of auditory responses falling into types that correspond to three basic logical classifications that may be performed with a perceptual item, i.e. from simple detection to discrimination, and categorization. This hierarchy of classifications determine the semantic "same-different" relationships among sounds. Different cognitive classifications appear to be a consequence of learning task and lead to a recruitment of different excitatory and inhibitory mechanisms and to distinct spatiotemporal metrics of map activation to represent a sound. The described non-auditory firing and modulations of auditory responses suggest that auditory cortex, by collecting all necessary information, functions as a "semantic processor" deducing the task-specific meaning of sounds by learning.

Suppression and comodulation masking release in normal-hearing and hearing-impaired listeners

The detectability of a sinusoidal signal embedded in a masker at the signal frequency can be improved by simultaneously presenting additional maskers in off-frequency regions if the additional maskers and the on-frequency masker component have the same temporal envelope. This effect is commonly referred to as comodulation masking release (CMR). Recently, it was hypothesized that peripheral nonlinear processes such as suppression may play a role in CMR over several octaves when the level of the off-frequency masker component is higher than the level of the on-frequency masker component. The aim of the present study was to test this hypothesis by measuring suppression and CMR within the same subjects for various frequency-level combinations of the off-frequency masker component. Experimental data for normal-hearing listeners show a large overlap between the existence regions for suppression and CMR. Hearing-impaired subjects with a sensorineural hearing loss show, on average, negligible suppression and CMR. The data support the hypothesis that part of the CMR in experiments with large spectral distances and large level differences between the masker components is due to the nonlinear processing at the level of the cochlea.

Spectral profile cues in comodulation masking release

Previous work on spectral shape discrimination has shown that detection of a level increment in one tone of a tonal complex is dependent on spectral position, with thresholds forming a "bowl" pattern for components spanning 200 to 5000 Hz [Green, D. M., (1988). Profile Analysis: Auditory Intensity Discrimination (Oxford University Press, New York)]. The current study examined whether a similar bowl occurs for comodulation masking release, a paradigm in which dynamic spectral cues could be used to detect an added signal. Maskers were logarithmically spaced 15-Hz-wide bands of noise. The signal was a tone or a copy of the on-signal masker band. When the masker was composed of one or more random bands, thresholds were relatively consistent across frequency. When the masker was a set of comodulated bands, thresholds for both signal types formed a bowl, but the minimum threshold occurred at a higher signal frequency for the tonal than for the narrowband noise signal. Results for additional conditions indicate that spectral effects depend on both absolute frequency and relative frequency of the signal within the masker. Data collected with flanking maskers presented contralateral to the signal and on-signal masker indicate that peripheral effects may play a role in threshold elevation at high signal frequencies with narrowband noise signals.

Features of across-frequency envelope coherence critical for comodulation masking release

The masking release associated with coherent amplitude modulation of the masker is dependent on the degree of envelope coherence across frequency, with the largest masking release for stimuli with perfectly comodulated envelopes. Experiments described here tested the hypothesis that the effects of reducing envelope coherence depend on the unique envelope features of the on-signal masker as compared to the flanking maskers. Maskers were amplitude-modulated tones (Experiments 1 and 3) or amplitude-modulated bands of noise (Experiment 2), and the signal was a tone; across-frequency masker coherence was manipulated to assess the effects of introducing additional modulation minima in either the on-signal or flanking masker envelopes of otherwise coherently modulated maskers. In all three experiments, the detrimental effect of disrupted modulation coherence was more severe when additional modulation minima were introduced in the flanking as compared to on-signal masker envelopes. This was the case for both ipsilateral and contralateral flanking masker presentations, indicating that within-channel cues were not responsible for this finding. Results are consistent with the interpretation that the cue underlying comodulation masking release is based on dynamic spectral features of the stimulus, with transient spectral peaks at the signal frequency reflecting addition of a signal.

Superposition of masking releases

We are constantly exposed to a mixture of sounds of which only few are important to consider. In order to improve detectability and to segregate important sounds from less important sounds, the auditory system uses different aspects of natural sound sources. Among these are (a) its specific location and (b) synchronous envelope fluctuations in different frequency regions. Such a comodulation of different frequency bands facilitates the detection of tones in noise, a phenomenon known as comodulation masking release (CMR). Physiological as well as psychoacoustical studies usually investigate only one of these strategies to segregate sounds. Here we present psychoacoustical data on CMR for various virtual locations of the signal by varying its interaural phase difference (IPD). The results indicate that the masking release in conditions with binaural (interaural phase differences) and across-frequency (synchronous envelope fluctuations, i.e. comodulation) cues present is equal to the sum of the masking releases for each of the cues separately. Data and model predictions with a simplified model of the auditory system indicate an independent and serial processing of binaural cues and monaural across-frequency cues, maximizing the benefits from the envelope comparison across frequency and the comparison of fine structure across ears.

Factors contributing to comodulation masking release with dichotic maskers

Detection threshold for a pure tone signal centered in a narrow band of noise may be reduced by inclusion of additional flanking masker bands, provided that they share coherent amplitude modulation (AM) across frequency. This comodulation masking release (CMR) associated with coherent AM across frequency is often much smaller if the signal and on-signal masker are presented to one ear and the flanking masker band(s) are presented contralaterally. An experiment was carried out to explore the role of peripheral effects (e.g., suppression) and central effects (e.g., grouping) in this finding. As frequently reported, CMR was smaller when two or more flanking maskers were presented contralaterally to the signal than when presented ipsilaterally. An intermediate condition, where a subset of flanking maskers was presented to each ear, provided comparable benefit to presenting all flankers ipsilateral to the signal. This result suggests that central effects may play a significant role in the reduced dichotic CMR under some conditions.