Short Article: Knowing When to Hear Aids What to Hear

The perceived duration of expected events depends on how the expectation is formed

Repeated events can seem shortened. It has been suggested that this results from an inverse relationship between predictability and perceived duration, with more predictable events seeming shorter. Some evidence disputes this generalisation, as there are cases where this relationship has been nullified, or even reversed. This study sought to combine different factors that encourage expectation into a single paradigm, to directly compare their effects. We find that when people are asked to declare a prediction (i.e., to predict which colour sequence will ensue), guess-confirming events can seem relatively protracted. This augmented a positive time-order error, with the first of two sequential presentations already seeming protracted. We did not observe a contraction of perceived duration for more probable or for repeated events. Overall, our results are inconsistent with a simple mapping between predictability and perceived duration. Whether the perceived duration of an expected event will seem relatively contracted or expanded seems to be contingent on the causal origin of expectation.

Temporal preparation accelerates spatial selection by facilitating bottom-up processing

Temporal preparation facilitates spatial selection in visual search. This selection benefit has not only been observed for targets, but also for task-irrelevant, salient distractors. This result suggests that temporal preparation influences bottom-up salience in spatial selection. To test this assumption, we conducted an event-related-potential (ERP) study in which we measured the joint effect of temporal preparation and target salience on the N2pc as an index of spatial selection and the N1 as an index of perceptual discrimination. To manipulate target salience, we employed two different setsizes (i.e., a small or large number of homogeneous distractors). To manipulate temporal preparation, we presented a warning signal before the search display and we varied the length of the interval (foreperiod) between warning signal and search display in different blocks of trials (constant foreperiod paradigm). Replicating previous results, we observed that the N1 and the N2pc arose earlier in case of good temporal preparation. Importantly, the beneficial effect on the N2pc onset latency was stronger when the target salience was initially low (i.e., small setsize). This result provides evidence that temporal preparation influences bottom-up processing and, thereby, facilitates spatial selection.

Reduction of temporal uncertainty facilitates stimulus-driven processes in spatial selection

Previous studies have shown that the reduction of temporal uncertainty facilitates target selection in visual search. We investigated whether this beneficial effect is caused by an effect on stimulus-driven processes or on goal-driven processes in spatial selection. To discriminate between these processes, we employed a visual search task in which participants searched for a shape target while ignoring a color singleton distractor. As an index of stimulus-driven processes, we measured the N2pc evoked by the singleton distractor (N_D). As indices of goal-driven processes, we measured the N2pc evoked by the target (N_T) and the distractor positivity (P_D) evoked by the singleton distractor, respectively. We observed that reducing temporal uncertainty modulated the amplitude of N_D and the onset latency of the N_T, but did not modulate the amplitude of the P_D. These results are consistent with the view that a reduction of temporal uncertainty influences non-selective, stimulus-driven processes in spatial selection.

How does positive mood modulate time-based event expectancy?

In the present study, we investigated how positive mood affects the formation of time-based event expectancies. After positive or neutral mood inductions, participants performed a binary choice response task in which two target stimuli (circle and square) and two pre-target intervals (800 and 1600 ms) appeared equally often. One of the targets was paired with the short interval and the other target with the long interval in 90% of the trials. We found that participants from the positive and neutral groups showed markedly different behavioral patterns of time-based expectancy. The time-based expectancy was restricted to shorter intervals for the positive group and to longer intervals for the neutral group. We propose that positive mood increases attentional prioritization of information that is temporally closer to us.

Implicit temporal predictability enhances pitch discrimination sensitivity and biases the phase of delta oscillations in auditory cortex

Can human listeners use implicit temporal contingencies in auditory input to form temporal predictions, and if so, how are these predictions represented endogenously? To assess this question, we implicitly manipulated temporal predictability in an auditory pitch discrimination task: unbeknownst to participants, the pitch of the standard tone could either be deterministically predictive of the temporal onset of the target tone, or convey no predictive information. Predictive and non-predictive conditions were presented interleaved in one stream, and separated by variable inter-stimulus intervals such that there was no dominant stimulus rhythm throughout. Even though participants were unaware of the implicit temporal contingencies, pitch discrimination sensitivity (the slope of the psychometric function) increased when the onset of the target tone was predictable in time (N = 49, 28 female, 21 male). Concurrently recorded EEG data (N = 24) revealed that standard tones that conveyed temporal predictions evoked a more negative N1 component than non-predictive standards. We observed no significant differences in oscillatory power or phase coherence between conditions during the foreperiod. Importantly, the phase angle of delta oscillations (1-3 Hz) in auditory areas in the post-standard and pre-target time windows predicted behavioral pitch discrimination sensitivity. This suggests that temporal predictions are encoded in delta oscillatory phase during the foreperiod interval. In sum, we show that auditory perception benefits from implicit temporal contingencies, and provide evidence for a role of slow neural oscillations in the endogenous representation of temporal predictions, in absence of exogenously driven entrainment to rhythmic input.

Enhancement of letter identification by concurrent auditory stimuli of varying duration

Previously it has been shown that the concurrent presentation of a sound can improve processing of visual information at higher perceptual levels, for example, in letter identification tasks. Moreover, increasing the duration of the concurrent sounds can enhance performance in low-level tasks as contrast detection, which has been attributed to a sustained visual activation corresponding to the duration of the sound. Yet, the role of sound duration has so far not been investigated in higher-level visual processing. In a series of five Experiments, we again demonstrated that the mere presence of a concurrent sound can enhance the identification of a masked, centrally presented letter compared to unimodal presentation, even though this benefit was absent in one experiment for high-contrast letters yielding an especially high level of task-performance. In general, however, the sound-induced benefit was not modulated by a variation of target contrast or by the duration of the target-to-mask interstimulus interval. Taking individual performance differences into account, a further analysis suggested that the sound-induced facilitation effect may nevertheless be most pronounced at specific performance levels. Beyond this general sound-induced facilitation, letter identification performance was not further affected by the duration of the concurrent sounds, even though in a control experiment it could be established that letter identification performance improved with increasing letter duration, and perceived letter duration was prolonged with increasing auditory duration. The results and their interpretation with respect to the large observed interindividual performance differences are discussed in terms of potential underlying mechanisms of multisensory facilitation, as preparedness enhancement, signal enhancement, and object enhancement.

Influence of metrical structure on learning of positional regularities in movement sequences

Sequential stimuli are usually perceived to have hierarchical temporal structures. However, some of these structures are only investigated in one type of sequence, regardless of the existing evidence, showing the domain-generality of the representation of these structures. Here, we assess whether the hierarchical representation of regularly segmented action sequences resembles the perceived metrical patterns that organize the representation of events hierarchically in temporally regular sequences. In all our experiments, we presented the participants with sequences of human movements and tested the perception of metrical pattern by segmenting the movement streams into temporally equal groups containing four movements. In Experiment 1, we found that a movement sequence with temporally equal groupings improves the learning of positional regularities inherent within each group of movements. To further clarify the degree to which this learning mechanism is affected by the perceived metrical patterns, we conducted Experiments 2a and 2b, in which the relative saliencies of the first and last positions in the movement groups, respectively, were studied. The results showed that, although in the learning of positional regularities, the rule-conforming first positions are as effective as when both first and last positions are legal, the last positions are not as influential. Based on these findings we conclude that, in grouped sequences, learning of positional regularities may be modulated by the metrical saliency patterns that are imposed by the temporal regularity of the sequential grouping pattern.

Time-Based Expectancy for Task Relevant Stimulus Features

When a particular target stimulus appears more frequently after a certain interval than after another one, participants adapt to such regularity, as evidenced by faster responses to frequent interval-target combinations than to infrequent ones. This phenomenon is known as time-based expectancy. Previous research has suggested that time-based expectancy is primarily motor-based, in the sense that participants learn to prepare a particular response after a specific interval. Perceptual time-based expectancy — in the sense of learning to perceive a certain stimulus after specific interval — has previously not been observed. We conducted a Two-Alternative-Forced-Choice experiment with four stimuli differing in shape and orientation. A subset of the stimuli was frequently paired with a certain interval, while the other subset was uncorrelated with interval. We varied the response relevance of the interval-correlated stimuli, and investigated under which conditions time-based expectancy transfers from trials with interval-correlated stimuli to trials with interval-uncorrelated stimuli. Transfer was observed only where transfer of perceptual expectancy and transfer of response expectancy predicted the same behavioral pattern, not when they predicted opposite patterns. The results indicate that participants formed time-based expectancy for stimuli as well as for responses. However, alternative interpretations are also discussed.

Visual adaptation enhances action sound discrimination

Prolonged exposure, or adaptation, to a stimulus in 1 modality can bias, but also enhance, perception of a subsequent stimulus presented within the same modality. However, recent research has also found that adaptation in 1 modality can bias perception in another modality. Here, we show a novel crossmodal adaptation effect, where adaptation to a visual stimulus enhances subsequent auditory perception. We found that when compared to no adaptation, prior adaptation to visual, auditory, or audiovisual hand actions enhanced discrimination between 2 subsequently presented hand action sounds. Discrimination was most enhanced when the visual action “matched” the auditory action. In addition, prior adaptation to a visual, auditory, or audiovisual action caused subsequent ambiguous action sounds to be perceived as less like the adaptor. In contrast, these crossmodal action aftereffects were not generated by adaptation to the names of actions. Enhanced crossmodal discrimination and crossmodal perceptual aftereffects may result from separate mechanisms operating in audiovisual action sensitive neurons within perceptual systems. Adaptation-induced crossmodal enhancements cannot be explained by postperceptual responses or decisions. More generally, these results together indicate that adaptation is a ubiquitous mechanism for optimizing perceptual processing of multisensory stimuli.

Implicit learning of between-group intervals in auditory temporal structures

Implicit learning of temporal structure has primarily been reported when events within a sequence (e.g., visual-spatial locations, tones) are systematically ordered and correlated with the temporal structure. An auditory serial reaction time task was used to investigate implicit learning of temporal intervals between pseudorandomly ordered syllables. Over exposure, participants identified syllables presented in sequences with weakly metrical temporal structures. In a test block, the temporal structure differed from exposure only in the duration of the interonset intervals (IOIs) between groups. It was hypothesized that reaction time (RT) to syllables following between-group IOIs would decrease with exposure and increase at test. In Experiments 1 and 2, the sequences presented over exposure and test were counterbalanced across participants (Pattern 1 and Pattern 2 conditions). An RT increase at test to syllables following between-group IOIs was only evident in the condition that presented an exposure structure with a slightly stronger meter (Pattern 1 condition). The Pattern 1 condition also elicited a global expectancy effect: Test block RT slowed to earlier-than-expected syllables (i.e., syllables shifted to an earlier beat) but not to later-than-expected syllables. Learning of between-group IOIs and the global expectancy effect extended to the Pattern 2 condition when meter was strengthened with an external pulse (Experiment 2). Experiment 3 further demonstrated implicit learning of a new weakly metrical structure with only earlier-than-expected violations at test. Overall findings demonstrate learning of weakly metrical rhythms without correlated event structures (i.e., sequential syllable orders). They further suggest the presence of a global expectancy effect mediated by metrical strength.

The influence of temporal regularities on the implicit learning of pitch structures

Implicit learning is the acquisition of complex information without the intention to learn. The aim of this study was to investigate the influence of temporal regularities on the implicit learning of an artificial pitch grammar. According to the dynamic attending theory (DAT) external regularities can entrain internal oscillators that guide attention over time, inducing temporal expectations that influence perception of future events. In the present study, the presentation of the artificial pitch grammar in the exposure phase was temporally either regular or irregular for one of two participant groups. Based on the DAT, it was hypothesized that the regular temporal presentation would favour implicit learning of tone structures in comparison to the irregular temporal presentation. Results demonstrated learning of the artificial grammar for the group with the regular exposure phase and partial learning for the group with the irregular exposure phase. These findings suggest that the regular presentation helps listeners to develop perceptual expectations about the temporal occurrence of future tones and thus facilitates the learning of the artificial pitch grammar.

Combining spatial and temporal expectations to improve visual perception

The importance of temporal expectations in modulating perceptual functions is increasingly recognized. However, the means through which temporal expectations can bias perceptual information processing remains ill understood. Recent theories propose that modulatory effects of temporal expectations rely on the co-existence of other biases based on receptive-field properties, such as spatial location. We tested whether perceptual benefits of temporal expectations in a perceptually demanding psychophysical task depended on the presence of spatial expectations. Foveally presented symbolic arrow cues indicated simultaneously where (location) and when (time) target events were more likely to occur. The direction of the arrow indicated target location (80% validity), while its color (pink or blue) indicated the interval (80% validity) for target appearance. Our results confirmed a strong synergistic interaction between temporal and spatial expectations in enhancing visual discrimination. Temporal expectation significantly boosted the effectiveness of spatial expectation in sharpening perception. However, benefits for temporal expectation disappeared when targets occurred at unattended locations. Our findings suggest that anticipated receptive-field properties of targets provide a natural template upon which temporal expectations can operate in order to help prioritize goal-relevant events from early perceptual stages.

Dissociative patterns of foreperiod effects in temporal discrimination and reaction time tasks

This study examined whether the process of temporal preparation for a target stimulus is the same regardless of the task required by the target stimulus. To this end, the same variable-foreperiod design was used in a temporal discrimination task (Experiment 1) and a reaction time task (Experiment 2). In Experiment 1, both temporal sensitivity and perceived duration increased as a function of foreperiod, whereas in Experiment 2, foreperiod did not influence reaction time. Furthermore, both temporal sensitivity and perceived duration revealed an asymmetric sequential effect of foreperiod, but the pattern of this effect was opposite to the pattern observed in the reaction time task. Together these dissociative patterns of foreperiod effects suggest that the mechanism of temporal preparation depends on the task required by the target stimulus.

Does temporal preparation increase the rate of sensory information accumulation?

Recent studies showed that temporal preparation, i.e., the ability to prepare for an upcoming stimulus, improves perceptual processing. The mechanisms underlying this benefit are still controversial. Based upon the theoretical framework of accumulation models, it has been proposed that the accumulation of sensory stimulus information begins earlier when participants are temporally prepared than when they are unprepared. Alternatively, however, temporal preparation might also affect the accumulation rate of sensory information. In the present study, we examined these possibilities. Specifically, in three experiments, we manipulated participants' decision criterion. This manipulation should interact with any experimental manipulation affecting the rate of information processing, but produce additive effects with any manipulation affecting the onset of information accumulation rather than its rate. We obtained additive effects on RT, irrespective of whether the decision criterion was manipulated by increasing catch trial proportion or nogo trial proportion. These results suggest that temporal preparation improves perceptual processing by operating on the onset of sensory information accumulation rather than the rate of sensory information accumulation.

Modality-specific perceptual expectations selectively modulate baseline activity in auditory, somatosensory, and visual cortices

Valid expectations are known to improve target detection, but the preparatory attentional mechanisms underlying this perceptual facilitation remain an open issue. Using functional magnetic resonance imaging, we show here that expecting auditory, tactile, or visual targets, in the absence of stimulation, selectively increased baseline activity in corresponding sensory cortices and decreased activity in irrelevant ones. Regardless of sensory modality, expectancy activated bilateral premotor and posterior parietal areas, supplementary motor area as well as right anterior insula and right middle frontal gyrus. The bilateral putamen was sensitive to the modality specificity of expectations during the unexpected omission of targets. Thus, across modalities, detection improvement arising from selectively directing attention to a sensory modality appears mediated through transient changes in pretarget activity. This flexible advance modulation of baseline activity in sensory cortices resolves ambiguities among previous studies unable to discriminate modality-specific preparatory activity from attentional modulation of stimulus processing. Our results agree with predictive-coding models, which suggest that these expectancy-related changes reflect top-down biases--presumably originating from the observed supramodal frontoparietal network--that modulate signal-detection sensitivity by differentially modifying background activity (i.e., noise level) in different input channels. The putamen appears to code omission-related Bayesian "surprise" that depends on the specificity of predictions.

Temporal Preparation Decreases Perceptual Latency: Evidence from a Clock Paradigm

A clock paradigm was employed to assess whether temporal preparation decreases the time to detect the onset of a stimulus—that is, perceptual latency. In four experiments participants watched a revolving clock hand while listening to soft or loud target tones under high or low temporal preparation. At the end of each trial, participants reported the clock hand position at the onset of the target tone. The deviation of the reported clock hand position from the actual position indexed perceptual latency. As expected, perceptual latency decreased with target tone intensity. Most importantly, however, greater temporal preparation decreased perceptual latency in all four experiments, especially for soft tones, which supports rather directly the idea that temporal preparation diminishes the duration of perceptual processing.

Auditory expectations for newly acquired structures

Our study investigated whether newly acquired auditory structure knowledge allows listeners to develop perceptual expectations for future events. For that aim, we introduced a new experimental approach that combines implicit learning and priming paradigms. Participants were first exposed to structured tone sequences without being told about the underlying artificial grammar. They then made speeded judgements on a perceptual feature of target tones in new sequences (i.e., in-tune/out-of-tune judgements). The target tones respected or violated the structure of the artificial grammar and were thus supposed to be expected or unexpected. In this priming task, grammatical tones were processed faster and more accurately than ungrammatical ones. This processing advantage was observed for an experimental group performing a memory task during the exposure phase, but was not observed for a control group, which was lacking the exposure phase (Experiment 1). It persisted when participants realized an in-tune/out-of-tune detection task during exposure (Experiment 2). This finding suggests that the acquisition of new structure knowledge not only influences grammaticality judgements on entire sequences (as previously shown in implicit learning research), but allows developing perceptual expectations that influence single event processing. It further promotes the priming paradigm as an implicit access to acquired artificial structure knowledge.

Consonant identification in noise by native and non-native listeners: effects of local context

Speech recognition in noise is harder in second (L2) than first languages (L1). This could be because noise disrupts speech processing more in L2 than L1, or because L1 listeners recover better though disruption is equivalent. Two similar prior studies produced discrepant results: Equivalent noise effects for L1 and L2 (Dutch) listeners, versus larger effects for L2 (Spanish) than L1. To explain this, the latter experiment was presented to listeners from the former population. Larger noise effects on consonant identification emerged for L2 (Dutch) than L1 listeners, suggesting that task factors rather than L2 population differences underlie the results discrepancy.