Looming sounds are perceived as faster than receding sounds

Cortical signatures of auditory looming bias show cue-specific adaptation between newborns and young adults

Adaptive biases in favor of approaching, or "looming", sounds have been found across ages and species, thereby implicating the potential of their evolutionary origin and universal basis. The human auditory system is well-developed at birth, yet spatial hearing abilities further develop with age. To disentangle the speculated inborn, evolutionary component of the auditory looming bias from its learned counterpart, we collected high-density electroencephalographic data across human adults and newborns. As distance-motion cues we manipulated either the sound's intensity or spectral shape, which is pinna-induced and thus prenatally inaccessible. Through cortical source localisation we demonstrated the emergence of the bias in both age groups at the level of Heschl's gyrus. Adults exhibited the bias in both attentive and inattentive states; yet differences in amplitude and latency appeared based on attention and cue type. Contrary to the adults, in newborns the bias was elicited only through manipulations of intensity and not spectral cues. We conclude that the looming bias comprises innate components while flexibly incorporating the spatial cues acquired through lifelong exposure.

Increasing auditory intensity enhances temporal but deteriorates spatial accuracy in a virtual interception task

Humans are quite accurate and precise in interception performance. So far, it is still unclear what role auditory information plays in spatiotemporal accuracy and consistency during interception. In the current study, interception performance was measured as the spatiotemporal accuracy and consistency of when and where a virtual ball was intercepted on a visible line displayed on a screen based on auditory information alone. We predicted that participants would more accurately indicate when the ball would cross a target line than where it would cross the line, because human hearing is particularly sensitive to temporal parameters. In a within-subject design, we manipulated auditory intensity (52, 61, 70, 79, 88 dB) using a sound stimulus programmed to be perceived over the screen in an inverted C-shape trajectory. Results showed that the louder the sound, the better was temporal accuracy, but the worse was spatial accuracy. We argue that louder sounds increased attention toward auditory information when performing interception judgments. How balls are intercepted and practically how intensity of sound may add to temporal accuracy and consistency is discussed from a theoretical perspective of modality-specific interception behavior.

Comparison of peripersonal space in front and rear spaces

The space immediately around the body, referred to as the peripersonal space (PPS), plays a crucial role in interactions with external objects and in avoiding unsafe situations. This study aimed to investigate whether the size of the PPS changes depending on direction, with a particular focus on the disparity between the front and rear spaces. A vibrotactile stimulus was presented to measure PPS while a task-irrelevant auditory stimulus (probe) approached the participant. In addition, to evaluate the effect of the probe, a baseline condition was used in which only tactile stimuli were presented. The results showed that the auditory facilitation effect of the tactile stimulus was greater in the rear condition than in the front condition. Conversely, the performance on tasks related to auditory distance perception and sound speed estimation did not differ between the two directions, indicating that the difference in the auditory facilitation effect between directions cannot be explained by these factors. These findings indicate that the strength of audio-tactile integration is greater in the rear space compared to the front space, suggesting that the representation of the PPS differed between the front and rear spaces.

Face your fears: direct and indirect measurement of responses to looming threats

This study investigated the emotional and behavioural effects of looming threats using both recalled (self-reported valence) and real-time response measurements (facial expressions). The looming bias refers to the tendency to underestimate the time of arrival of rapidly approaching (looming) stimuli, providing additional time for defensive reactions. While previous research has shown negative emotional responses to looming threats based on self-reports after stimulus exposure, facial expressions offer valuable insights into emotional experiences and non-verbal behaviour during stimulus exposure. A face reading experiment examined responses to threats in motion, considering stimulus direction (looming versus receding motion) and threat strength (more versus less threatening stimuli). We also explored the added value of facial expression recognition compared to self-reported valence. Results indicated that looming threats elicit more negative facial expressions than receding threats, supporting previous findings on the looming bias. Further, more (vs. less) threatening stimuli evoked more negative facial expressions, but only when the threats were looming rather than receding. Interestingly, facial expressions of valence and self-reported valence showed opposing results, suggesting the importance of incorporating facial expression recognition to understand defensive responses to looming threats more comprehensively.

Age and Auditory Spatial Perception in Humans: Review of Behavioral Findings and Suggestions for Future Research

It has been well documented, and fairly well known, that concomitant with an increase in chronological age is a corresponding increase in sensory impairment. As most people realize, our hearing suffers as we get older; hence, the increased need for hearing aids. The first portion of the present paper is how the change in age apparently affects auditory judgments of sound source position. A summary of the literature evaluating the changes in the perception of sound source location and the perception of sound source motion as a function of chronological age is presented. The review is limited to empirical studies with behavioral findings involving humans. It is the view of the author that we have an immensely limited understanding of how chronological age affects perception of space when based on sound. In the latter part of the paper, discussion is given to how auditory spatial perception is traditionally conducted in the laboratory. Theoretically, beneficial reasons exist for conducting research in the manner it has been. Nonetheless, from an ecological perspective, the vast majority of previous research can be considered unnatural and greatly lacking in ecological validity. Suggestions for an alternative and more ecologically valid approach to the investigation of auditory spatial perception are proposed. It is believed an ecological approach to auditory spatial perception will enhance our understanding of the extent to which individuals perceive sound source location and how those perceptual judgments change with an increase in chronological age.

The impact of pitch on tempo-spatial accuracy and precision in intercepting a virtually moving ball

In two experiments, horizontal and vertical orientated sounds moved in parabolas. Participants had to touch a screen to indicate where and when a virtual moving ball would cross a visible line. We predicted that due to the sensitivity of the auditory system to temporal information, manipulations of pitch should affect temporal errors more than spatial errors. Stimuli were sound sources at five different pitches moving along a parabola produced through loudspeakers mounted around a touch screen. Results showed pitch effects on spatial constant and spatial variable errors when the parabola was horizontally oriented (Exp. 1), and on temporal constant errors in vertically oriented parabolas (Exp. 2). We conclude that temporal and spatial precision in interception tasks were affected differently by pitch manipulations and require consideration in future studies when assessing the impact of auditory information on catching virtually moving balls.

Neural Mechanisms Underlying the Auditory Looming Bias

Our auditory system constantly keeps track of our environment, informing us about our surroundings and warning us of potential threats. The auditory looming bias is an early perceptual phenomenon, reflecting higher alertness of listeners to approaching auditory objects, rather than to receding ones. Experimentally, this sensation has been elicited by using both intensity-varying stimuli, as well as spectrally varying stimuli with constant intensity. Following the intensity-based approach, recent research delving into the cortical mechanisms underlying the looming bias argues for top-down signaling from the prefrontal cortex to the auditory cortex in order to prioritize approaching over receding sonic motion. We here test the generalizability of that finding to spectrally induced looms by re-analyzing previously published data. Our results indicate the promoted top-down projection but at time points slightly preceding the motion onset and thus considered to reflect a bias driven by anticipation. At time points following the motion onset, our findings show a bottom-up bias along the dorsal auditory pathway directed toward the prefrontal cortex.

Expansion of space for visuotactile interaction during visually induced self-motion

Peripersonal space (PPS), which refers to space immediately around an individual's body, plays an important role in interacting with external objects and avoiding unsafe situations. Studies suggest that, during self-motion perception, PPS expands in the direction in which a person perceives himself/herself to be traveling. In the present study, we built on this by investigating, using visually induced self-motion (vection), how visual self-motion information modulates PPS representation. In our experiment, large-field visual motion was presented through a head-mounted display that caused observers to perceive themselves as moving forward in a tunnel (LF condition). To clarify the effects of self-motion information, we compared the findings for this condition with those of another condition, in which small-field visual motion was presented; here, only the central visual field represented motion, which caused the observers to perceive relatively little self-motion (SF condition). Two speeds were tested for both conditions: 1.5 m/s and 6.0 m/s. For measurement, we used a visuotactile-interaction task in which participants, while observing a visual probe object approaching from various distances, were instructed to press a response key as soon as they detected tactile stimuli delivered to their chest. We measured the distance at which the visual approaching probe object facilitated tactile detection (visual-facilitation effect); this was determined through comparisons with trials when no probe was presented. The results showed that the visual facilitation effects were observed for larger distance in the LF than SF conditions, irrespective of tested speeds. These results suggest that visual self-motion information can modulate PPS representation. This finding fits well with the view that PPS representation contributes to protecting the body from potential threats in the environment.

Proximal Binaural Sound Can Induce Subjective Frisson

Auditory frisson is the experience of feeling of cold or shivering related to sound in the absence of a physical cold stimulus. Multiple examples of frisson-inducing sounds have been reported, but the mechanism of auditory frisson remains elusive. Typical frisson-inducing sounds may contain a looming effect, in which a sound appears to approach the listener's peripersonal space. Previous studies on sound in peripersonal space have provided objective measurements of sound-inducing effects, but few have investigated the subjective experience of frisson-inducing sounds. Here we explored whether it is possible to produce subjective feelings of frisson by moving a noise sound (white noise, rolling beads noise, or frictional noise produced by rubbing a plastic bag) stimulus around a listener's head. Our results demonstrated that sound-induced frisson can be experienced stronger when auditory stimuli are rotated around the head (binaural moving sounds) than the one without the rotation (monaural static sounds), regardless of the source of the noise sound. Pearson's correlation analysis showed that several acoustic features of auditory stimuli, such as variance of interaural level difference (ILD), loudness, and sharpness, were correlated with the magnitude of subjective frisson. We had also observed that the subjective feelings of frisson by moving a musical sound had increased comparing with a static musical sound.

Do sounds near the hand facilitate tactile reaction times? Four experiments and a meta-analysis provide mixed support and suggest a small effect size

The brain represents the space immediately surrounding the body differently to more distant parts of space. Direct evidence for this ‘peripersonal space’ representation comes from neurophysiological studies in monkeys, which show distance-dependent responses to visual stimuli in neurons with spatially coincident tactile responses. Most evidence for peripersonal space in humans is indirect: spatial- and distance-dependent modulations of reaction times and error rates in behavioural tasks. In one task often used to assess peripersonal space, sounds near the body have been argued to speed reactions to tactile stimuli. We conducted four experiments attempting to measure this distance-dependent audiotactile interaction. We found no distance-dependent enhancement of tactile processing in error rates or task performance, but found some evidence for a general speeding of reaction times by 9.5 ms when sounds were presented near the hand. A systematic review revealed an overestimation of reported effect sizes, lack of control conditions, a wide variety of methods, post hoc removal of data, and flexible methods of data analysis. After correcting for the speed of sound, removing biased or inconclusive studies, correcting for temporal expectancy, and using the trim-and-fill method to correct for publication bias, meta-analysis revealed an overall benefit of 15.2 ms when tactile stimuli are accompanied by near sounds compared to sounds further away. While this effect may be due to peripersonal space, response probability and the number of trials per condition explained significant proportions of variance in this near versus far benefit. These confounds need to be addressed, and alternative explanations ruled out by future, ideally pre-registered, studies.

Frontal cortex selectively overrides auditory processing to bias perception for looming sonic motion

Rising intensity sounds signal approaching objects traveling toward an observer. A variety of species preferentially respond to looming over receding auditory motion, reflecting an evolutionary perceptual bias for recognizing approaching threats. We probed the neural origins of this stark perceptual anisotropy to reveal how the brain creates privilege for auditory looming events. While recording neural activity via electroencephalography (EEG), human listeners rapidly judged whether dynamic (intensity varying) tones were looming or receding in percept. Behaviorally, listeners responded faster to auditory looms confirming a perceptual bias for approaching signals. EEG source analysis revealed sensory activation localized to primary auditory cortex (PAC) and decision-related activity in prefrontal cortex (PFC) within 200 ms after sound onset followed by additional expansive PFC activation by 500 ms. Notably, early PFC (but not PAC) activity rapidly differentiated looming and receding stimuli and this effect roughly co-occurred with sound arrival in auditory cortex. Brain-behavior correlations revealed an association between PFC neural latencies and listeners' speed of sonic motion judgments. Directed functional connectivity revealed stronger information flow from PFC → PAC during looming vs. receding sounds. Our electrophysiological data reveal a critical, previously undocumented role of prefrontal cortex in judging dynamic sonic motion. Both faster neural bias and a functional override of obligatory sensory processing via selective, directional PFC signaling toward auditory system establish the perceptual privilege for approaching looming sounds.

Cross-modal size-contrast illusion: Acoustic increases in intensity and bandwidth modulate haptic representation of object size

Changes in the retinal size of stationary objects provide a cue to the observer's motion in the environment: Increases indicate the observer's forward motion, and decreases backward motion. In this study, a series of images each comprising a pair of pine-tree figures were translated into auditory modality using sensory substitution software. Resulting auditory stimuli were presented in an ascending sequence (i.e. increasing in intensity and bandwidth compatible with forward motion), descending sequence (i.e. decreasing in intensity and bandwidth compatible with backward motion), or in a scrambled order. During the presentation of stimuli, blindfolded participants estimated the lengths of wooden sticks by haptics. Results showed that those exposed to the stimuli compatible with forward motion underestimated the lengths of the sticks. This consistent underestimation may share some aspects with visual size-contrast effects such as the Ebbinghaus illusion. In contrast, participants in the other two conditions did not show such magnitude of error in size estimation; which is consistent with the "adaptive perceptual bias" towards acoustic increases in intensity and bandwidth. In sum, we report a novel cross-modal size-contrast illusion, which reveals that auditory motion cues compatible with listeners' forward motion modulate haptic representations of object size.

Doppler Illusion Prevails Over Pratt Effect in Risset Tones

Changes in frequency such as those found in Risset tones have been associated with moving sound sources in the vertical plane (Pratt effect) and the horizontal plane (Doppler illusion). We investigated the reported origin and motion of unspatialized Risset tones presented monotically and diotically, and Risset tones simulated to be in the sagittal or coronal plane, approaching or receding, from above or horizontally. Independent of the artificial spatialization used (none, spatializing frequency components collectively or individually, elevated or not), upward glissandi were more likely to be judged as approaching than receding, and downward glissandi as receding than approaching, in most cases from the horizon. Glissandi associations with horizontal movements were more common in stimuli simulated on the sagittal plane than in stimuli simulated on the coronal plane. These findings suggest that the Doppler illusion is stronger than the Pratt effect, at least for Risset tones presented over headphones and simulated to be in the sagittal plane. These findings may contribute to better understanding of the association between auditory motion perception and changes in frequency.

Change deafness, dual-task performance, and domain-specific expertise

In a change deafness manipulation using radio broadcasts of sporting events, we show that change deafness to a switch in talker increases when listeners are asked to monitor both lexical and indexical information for change. We held semantic content constant and demonstrated a change deafness rate of 85% when participants listened to the home team broadcast of a hockey game that switched midway to the away team broadcast with a different announcer. In Study 2, participants were asked to monitor either the indexical characteristics ( listen for a change in announcer) or both the indexical and semantic components ( listen for a change in announcer or a goal scored). Monitoring both components led to significantly greater change deafness even though both groups were alerted to the possibility of a change in announcer. In Study 3, we changed both the indexical and the semantic components when the broadcast switched from a hockey game to a basketball game. We found a negative correlation between sports expertise and change deafness. The results are discussed in terms of the nature of perceptual representation and the influence of expertise and evolution on attention allocation.

Asymmetries in behavioral and neural responses to spectral cues demonstrate the generality of auditory looming bias

Studies of auditory looming bias have shown that sources increasing in intensity are more salient than sources decreasing in intensity. Researchers have argued that listeners are more sensitive to approaching sounds compared with receding sounds, reflecting an evolutionary pressure. However, these studies only manipulated overall sound intensity; therefore, it is unclear whether looming bias is truly a perceptual bias for changes in source distance, or only in sound intensity. Here we demonstrate both behavioral and neural correlates of looming bias without manipulating overall sound intensity. In natural environments, the pinnae induce spectral cues that give rise to a sense of externalization; when spectral cues are unnatural, sounds are perceived as closer to the listener. We manipulated the contrast of individually tailored spectral cues to create sounds of similar intensity but different naturalness. We confirmed that sounds were perceived as approaching when spectral contrast decreased, and perceived as receding when spectral contrast increased. We measured behavior and electroencephalography while listeners judged motion direction. Behavioral responses showed a looming bias in that responses were more consistent for sounds perceived as approaching than for sounds perceived as receding. In a control experiment, looming bias disappeared when spectral contrast changes were discontinuous, suggesting that perceived motion in distance and not distance itself was driving the bias. Neurally, looming bias was reflected in an asymmetry of late event-related potentials associated with motion evaluation. Hence, both our behavioral and neural findings support a generalization of the auditory looming bias, representing a perceptual preference for approaching auditory objects.