Localization of moving sound

Motion perception in touch: resolving contradictory findings by varying probabilities of different trial types

Representational momentum describes the typical overestimation of the final location of a moving stimulus in the direction of stimulus motion. While systematically observed in different sensory modalities, especially vision and audition, in touch, empirical findings indicate a mixed pattern of results, with some published studies suggesting the existence of the phenomenon, while others do not. In the present study, one possible moderating variable, the relative probabilities of different trial types, was explored in an attempt to resolve the seemingly contradictory findings in the literature. In some studies, only consistently moving target stimuli were presented and no representational momentum was observed, while other studies have included inconsistently moving target stimuli in the same experimental block, and observed representational momentum. Therefore, the present study was designed to systematically compare the localization of consistent target motion stimuli across two experimental blocks, for which either only consistent motion trials were presented, or else mixed with inconsistent target motion trials. The results indicate a strong influence of variations in the probability of different trial types on the occurrence of representational momentum. That is, representational momentum only occurred when both trial types (inconsistent and consistent target motion) were presented within one experimental block. The results are discussed in light of recent theoretical advancements in the literature, namely the speed prior account of motion perception.

Head and Eye Movements Reveal Compensatory Strategies for Acute Binaural Deficits During Sound Localization

The present study aimed to define use of head and eye movements during sound localization in children and adults to: (1) assess effects of stationary versus moving sound and (2) define effects of binaural cues degraded through acute monaural ear plugging. Thirty-three youth (MAge = 12.9 years) and seventeen adults (MAge = 24.6 years) with typical hearing were recruited and asked to localize white noise anywhere within a horizontal arc from -60° (left) to +60° (right) azimuth in two conditions (typical binaural and right ear plugged). In each trial, sound was presented at an initial stationary position (L1) and then while moving at ∼4°/s until reaching a second position (L2). Sound moved in five conditions (±40°, ±20°, or 0°). Participants adjusted a laser pointer to indicate L1 and L2 positions. Unrestricted head and eye movements were collected with gyroscopic sensors on the head and eye-tracking glasses, respectively. Results confirmed that accurate sound localization of both stationary and moving sound is disrupted by acute monaural ear plugging. Eye movements preceded head movements for sound localization in normal binaural listening and head movements were larger than eye movements during monaural plugging. Head movements favored the unplugged left ear when stationary sounds were presented in the right hemifield and during sound motion in both hemifields regardless of the movement direction. Disrupted binaural cues have greater effects on localization of moving than stationary sound. Head movements reveal preferential use of the better-hearing ear and relatively stable eye positions likely reflect normal vestibular-ocular reflexes.

Need for (expected) speed: Exploring the indirect influence of trial type consistency on representational momentum

The biases affecting people's perception of dynamic stimuli are typically robust and strong for specific stimulus configurations. For example, representational momentum describes a systematic perceptual bias in the direction of motion for the final location of a moving stimulus. Under clearly defined stimulus configurations (e.g., specific stimulus identity, size, speed), for example, the frequently used "implied motion" trial sequence, for which a target is subsequently presented in a consistent direction and with a consistent speed, a displacement in motion direction is evidenced. The present study explores the potential influence of expectations regarding directional as well as speed consistencies on representational momentum, elicited by including other, inconsistently moving trial types within the same experimental block. A systematic representational momentum effect was observed when only consistent motion trials were presented. In contrast, when inconsistent target motion trials were mixed within the same block of experimental trials, the representational momentum effect decreased, or was even eliminated (Experiments 1 & 2). Detailed analysis indicated that this reflects a global (proportion of consistent and inconsistent motion trials within a particular experimental block), not local (preceding trial influencing actual trial) effect. Yet, additional follow-up studies (Experiments 3 & 4) support the idea that these changes in perceived location are strongly influenced by the overall stimulus speed statistics in the different experimental blocks. These results are discussed and interpreted in light of recent theoretical developments in the literature on motion perception that highlight the importance of expectations about stimulus speed for motion perception.

Doppler Frequency-Shift Information Processing in WOx -Based Memristive Synapse for Auditory Motion Perception

Auditory motion perception is one crucial capability to decode and discriminate the spatiotemporal information for neuromorphic auditory systems. Doppler frequency-shift feature and interaural time difference (ITD) are two fundamental cues of auditory information processing. In this work, the functions of azimuth detection and velocity detection, as the typical auditory motion perception, are demonstrated in a WO_x -based memristive synapse. The WO_x memristor presents both the volatile mode (M1) and semi-nonvolatile mode (M2), which are capable of implementing the high-pass filtering and processing the spike trains with a relative timing and frequency shift. In particular, the Doppler frequency-shift information processing for velocity detection is emulated in the WO_x memristor based auditory system for the first time, which relies on a scheme of triplet spike-timing-dependent-plasticity in the memristor. These results provide new opportunities for the mimicry of auditory motion perception and enable the auditory sensory system to be applied in future neuromorphic sensing.

The implicit sense of agency is not a perceptual effect but is a judgment effect

The sense of agency (SoA) is characterized as the sense of being the causal agent of one's own actions, and it is measured in two forms: explicit and implicit. In the explicit SoA experiments, the participants explicitly report whether they have a sense of control over their actions or whether they or somebody else is the causal agent of seen actions; the implicit SoA experiments study how do participants' agentive or voluntary actions modify perceptual processes (like time, vision, tactility, and audition) without directly asking the participants to explicitly think about their causal agency or sense of control. However, recent implicit SoA literature reported contradictory findings of the relationship between implicit SoA reports and agency states. Thus, I argue that the purported implicit SoA reports are not agency-driven perceptual effects per se but are judgment effects, by showing that (a) the typical operationalizations in implicit SoA domain lead to perceptual uncertainty on the part of the participants, (b) under uncertainty, participants' implicit SoA reports are due to heuristic judgments which are independent of agency states, and (c) under perceptual certainty, the typical implicit SoA reports might not have occurred at all. Thus, I conclude that the instances of implicit SoA are judgments (or response biases)-under uncertainty-rather than perceptual effects.

Tactile temporal offset cues reduce visual representational momentum

The perception of dynamic objects is sometimes biased. For example, localizing a moving object after it has disappeared results in a perceptual shift in the direction of motion, a bias known as representational momentum. We investigated whether the temporal characteristics of an irrelevant, spatially uninformative vibrotactile stimulus bias the perceived location of a visual target. In two visuotactile experiments, participants judged the final location of a dynamic, visual target. Simultaneously, a continuous (starting with the onset of the visual target, Experiments 1 and 2) or brief (33-ms stimulation, Experiment 2) vibrotactile stimulus (at the palm of participant's hands) was presented, and the offset disparity between the visual target and tactile stimulation was systematically varied. The results indicate a cross-modal influence of tactile stimulation on the perceived final location of the visual target. Closer inspection of the nature of this cross-modal influence, observed here for the first time, reveals that the vibrotactile stimulus was likely just taken as a temporal cue regarding the offset of the visual target, but no strong interaction and combined processing of the two stimuli occurred. The present results are related to similar cross-modal temporal illusions and current accounts of multisensory perception, integration, and cross-modal facilitation.

The impact of pitch on tempo-spatial accuracy and precision in intercepting a virtually moving ball

In two experiments, horizontal and vertical orientated sounds moved in parabolas. Participants had to touch a screen to indicate where and when a virtual moving ball would cross a visible line. We predicted that due to the sensitivity of the auditory system to temporal information, manipulations of pitch should affect temporal errors more than spatial errors. Stimuli were sound sources at five different pitches moving along a parabola produced through loudspeakers mounted around a touch screen. Results showed pitch effects on spatial constant and spatial variable errors when the parabola was horizontally oriented (Exp. 1), and on temporal constant errors in vertically oriented parabolas (Exp. 2). We conclude that temporal and spatial precision in interception tasks were affected differently by pitch manipulations and require consideration in future studies when assessing the impact of auditory information on catching virtually moving balls.

Effects of Audiovisual Presentations on Visual Localization Errors: One or Several Multisensory Mechanisms?

The present study examines the extent to which temporal and spatial properties of sound modulate visual motion processing in spatial localization tasks. Participants were asked to locate the place at which a moving visual target unexpectedly vanished. Across different tasks, accompanying sounds were factorially varied within subjects as to their onset and offset times and/or positions relative to visual motion. Sound onset had no effect on the localization error. Sound offset was shown to modulate the perceived visual offset location, both for temporal and spatial disparities. This modulation did not conform to attraction toward the timing or location of the sounds but, demonstrably in the case of temporal disparities, to bimodal enhancement instead. Favorable indications to a contextual effect of audiovisual presentations on interspersed visual-only trials were also found. The short sound-leading offset asynchrony had equivalent benefits to audiovisual offset synchrony, suggestive of the involvement of early-level mechanisms, constrained by a temporal window, at these conditions. Yet, we tentatively hypothesize that the whole of the results and how they compare with previous studies requires the contribution of additional mechanisms, including learning-detection of auditory-visual associations and cross-sensory spread of endogenous attention.

Representational momentum in vision and touch: Visual motion information biases tactile spatial localization

After an object disappears, the vanishing point is shifted in the direction of motion, a phenomenon known as representational momentum. The present study focused on the relationship between motion information and spatial location in a crossmodal setting. In two visuotactile experiments, we studied how motion information in one sensory modality affects the perceived final location of a motion signal (congruent vs. incongruent left-right motion direction) in another modality. The results revealed a unidirectional crossmodal influence of motion information on spatial localization performance. While visual motion information influenced the perceived final location of the tactile stimulus, tactile motion information had no influence on visual localization. These results therefore extend the existing literature on crossmodal influences on spatial location and are discussed in relation to current theories of multisensory perception.

The contradictory influence of velocity: representational momentum in the tactile modality

Representational momentum (RM) is the term used to describe a systematic mislocalization of dynamic stimuli, a forward shift; that is, an overestimation of the location of a stimulus along its anticipated trajectory. In the present study, we investigate the effect of velocity on tactile RM, because two distinct and contrasting predictions can be made, based on different theoretical accounts. According to classical accounts of RM, based on numerous visual and auditory RM studies, an increase of the forward shift with increasing target velocity is predicted. In contrast, theoretical accounts explaining spatiotemporal tactile illusions such as the tau or cutaneous rabbit effect predict a decrease of the forward shift with increasing target velocity. In three experiments reported here, a tactile experimental setup modeled on existing RM setups was implemented. Participants indicated the last location of a sequence of three tactile stimuli, which either did or did not imply motion in a consistent direction toward the elbow/wrist. Velocity was manipulated by changing the interstimulus interval as well as the duration of the stimuli. The results reveal that increasing target velocity led to a decrease and even a reversal of the forward shift, resulting in a backward shift. This result is consistent with predictions based on the evidence from tactile spatiotemporal illusions. The theoretical implications of these results for RM are discussed. NEW & NOTEWORTHY This study tests two distinct predictions concerning the influence of velocity on the localization of dynamic tactile stimuli. We demonstrate for tactile stimuli that with increasing velocity, a misperception in the direction of anticipated motion (termed "representational momentum") turns into a misperception against the direction of motion. This result is in line with predictions based on tactile spatiotemporal illusions but challenges classical theoretical accounts of representational momentum based on evidence from vision and audition.

Implied tactile motion: Localizing dynamic stimulations on the skin

We report two experiments designed to investigate how the implied motion of tactile stimuli influences perceived location. Predicting the location of sensory input is especially important as far as the perception of, and interaction with, the external world is concerned. Using two different experimental approaches, an overall pattern of localization shifts analogous to what has been described previously in the visual and auditory modalities is reported. That is, participants perceive the last location of a dynamic stimulus further along its trajectory than is objectively the case. In Experiment 1, participants judged whether the last vibration in a sequence of three was located closer to the wrist or to the elbow. In Experiment 2, they indicated the last location on a ruler attached to their forearm. We further pinpoint the effects of implied motion on tactile localization by investigating the independent influences of motion direction and perceptual uncertainty. Taken together, these findings underline the importance of dynamic information in localizing tactile stimuli on the skin.

Angle-Dependent Distortions in the Perceptual Topology of Acoustic Space

By moving sounds around the head and asking listeners to report which ones moved more, it was found that sound sources at the side of a listener must move at least twice as much as ones in front to be judged as moving the same amount. A relative expansion of space in the front and compression at the side has consequences for spatial perception of moving sounds by both static and moving listeners. An accompanying prediction that the apparent location of static sound sources ought to also be distorted agrees with previous work and suggests that this is a general perceptual phenomenon that is not limited to moving signals. A mathematical model that mimics the measured expansion of space can be used to successfully capture several previous findings in spatial auditory perception. The inverse of this function could be used alongside individualized head-related transfer functions and motion tracking to produce hyperstable virtual acoustic environments.

The effect of velocity on auditory representational momentum

"Representational Momentum" (RM) is a mislocalization of the endpoint of a moving target in the direction of motion. In vision, RM has been shown to increase with target velocity. In audition, however, the effect of target velocity is unclear. Using a perceptual paradigm with moving broadband noise targets in Virtual Auditory Space resulted in a linear increase in RM from 0.9° to 2.3° for an increase in target velocity from 25°/s to 100°/s. Accounting for the effect of eye position also reduced variance. These results suggest that RM may be the result of similar underlying mechanisms in both modalities.

"Cutaneous rabbit" hops toward a light: unimodal and cross-modal causality on the skin

Our somatosensory system deals with not only spatial but also temporal imprecision, resulting in characteristic spatiotemporal illusions. Repeated rapid stimulation at the wrist, then near the elbow, can create the illusion of touch at intervening locations along the arm (as if a rabbit is hopping along the arm). This is known as the “cutaneous rabbit effect” (CRE). Previous studies have suggested that the CRE involves not only an intrinsic somatotopic representation but also the representation of an extended body schema that includes causality or animacy perception upon the skin. On the other hand, unlike other multi-modal causality couplings, it is possible that the CRE is not affected by concurrent auditory temporal information. The present study examined the effect of a simple visual flash on the CRE, which has both temporal and spatial information. Here, stronger cross-modal causality or correspondence could be provided. We presented three successive tactile stimuli on the inside of a participant’s left arm. Stimuli were presented on the wrist, elbow, and midway between the two. Results from our five experimental manipulations suggest that a one-shot flash enhances or attenuates the CRE depending on its congruency with cutaneous rabbit saltation. Our results reflect that (1) our brain interprets successive stimuli on the skin as motion in terms of time and space (unimodal causality) and that (2) the concurrent signals from other modalities provide clues for creating unified representations of this external motion (multi-modal causality) as to the extent that “spatiotemporal” synchronicity among modalities is provided.

Shared Cortical Systems for Processing of Horizontal and Vertical Sound Motion

Cortical processing of horizontal and vertical sound motion in free-field space was investigated using high-density electroencephalography in combination with standardized low-resolution brain electromagnetic tomography (sLORETA). Eighteen subjects heard sound stimuli that, after an initial stationary phase in a central position, started to move centrifugally, either to the left, to the right, upward, or downward. The delayed onset of both horizontal and vertical motion elicited a specific motion-onset response (MOR), resulting in widely distributed activations, with prominent maxima in primary and nonprimary auditory cortices, insula, and parietal lobe. The comparison of MORs to horizontal and vertical motion orientations did not indicate any significant differences in latency or topography. Contrasting the sLORETA solutions for the two motion orientations revealed only marginal activation in postcentral gyrus. These data are consistent with the notion that azimuth and elevation components of dynamic auditory spatial information are processed in common, rather than separate, cortical substrates. Furthermore, the findings support the assumption that the MOR originates at a stage of auditory analysis after the different spatial cues (interaural and monaural spectral cues) have been integrated into a unified space code.

The effect of sound intensity on the audiotactile crossmodal dynamic capture effect

We investigated the effect of varying sound intensity on the audiotactile crossmodal dynamic capture effect. Participants had to discriminate the direction of a target stream (tactile, Experiment 1; auditory, Experiment 2) while trying to ignore the direction of a distractor stream presented in a different modality (auditory, Experiment 1; tactile, Experiment 2). The distractor streams could either be spatiotemporally congruent or incongruent with respect to the target stream. In half of the trials, the participants were presented with auditory stimuli at 75 dB(A) while in the other half of the trials they were presented with auditory stimuli at 82 dB(A). Participants' performance on both tasks was significantly affected by the intensity of the sounds. Namely, the crossmodal capture of tactile motion by audition was stronger with the more intense (vs. less intense) auditory distractors (Experiment 1), whereas the capture effect exerted by the tactile distractors was stronger for less intense (than for more intense) auditory targets (Experiment 2). The crossmodal dynamic capture was larger in Experiment 1 than in Experiment 2, with a stronger congruency effect when the target streams were presented in the tactile (vs. auditory) modality. Two explanations are put forward to account for these results: an attentional biasing toward the more intense auditory stimuli, and a modulation induced by the relative perceptual weight of, respectively, the auditory and the tactile signals.

Distortions of auditory space during rapid head turns

Auditory localisation was examined using brief broadband sounds presented during rapid head turns to visual targets in the peripheral field. Presenting sounds during a rapid head movement will "smear" the acoustic cues to the sound's location. During the early stages of a head turn, sound localisation accuracy was comparable to a no-turn control condition. However, significant localisation errors occurred when the probe sound was presented during the later part of a head turn. After correcting for head position, the estimate of lateral angle (horizontal position) in the front hemisphere was generally accurate. However, lateral angle estimates for positions in the rear hemisphere exhibited systematic errors that were especially large around the midline. Polar angle (elevation) perception remained robust, being comparable to no-turn controls whether tested early or late in the head turn. The results are interpreted in terms of a 'multiple look' strategy for calculating sound location, and the allocation of attention to the hemisphere containing the head-turn target.