Threatening pictures induce shortened time-to-contact estimates

Tennis expert-novice difference in motion-in-depth perception is associated with early inhibition of invalid attention

Perception of motion-in-depth is essential to guide and modify the hitting action in interceptive-dominated sports (e.g., tennis). The purpose of this research was to investigate the effect of tennis expertise on motion-in-depth perception at different cognition processes by two event-related potential (ERP) studies. Specifically, the study explored differences in behavior and electroencephalogram (EEG) characteristics between tennis experts and novices under two different task conditions. Seventeen skilled tennis players (average professional experience: 10.76 ± 2.56 years) and 17 age-matched novices participated in two experiments. Cortical activity (P1, N1, P2, and the later component) and task performance (reaction time, accuracy rate, and error value) were recorded when participants completed a direction-identifying task (Experiment 1) and a prediction-motion task (Experiment 2) while perceiving motion-in-depth. Results demonstrated that P1 latency in the expert group was significantly shorter than the novice group in experiment 1; and in experiment 2, the expert group showed shorter P1 latency than the novice group under the TTC1 (actual time-to-collision is 400 ms) condition. The results indicate that the effect of tennis expertise on motion-in-depth perception was primarily manifested as early visual attentional investment in the features of objects. Experts have the rapid inbibition of invalid attention.

Self-other boundary under social threat in schizophrenia

Spatial representation of the self plays a vital role constructing our sense of bodily self-boundary that distinguishes the self from others. This perceptual border, known as the peripersonal space (PPS), has been suggested to be altered in individuals with schizophrenia (SZ). PPS represents a protective defensive zone that triggers alarm signals upon threat detection; thus disrupted PPS could lead to social interactional difficulties. However, very little is known about the impact of threat on PPS. To address this gap, a visual-tactile response-time (RT) experiment was conducted in immersive virtual reality (VR) for SZ and matched controls (CO). Participants were asked to detect a tactile vibration on their hand while an avatar (either threatening or neutral) approached them. Avatars were presented at different distance from the participants. PPS size and slope were estimated by identifying significant RT drop at the hypothesized self-other boundary. We also examined the relationship between PPS parameters, clinical symptoms and social disconnection. There was no overall group difference in PPS size. Perceived social threat posed in the avatars sharpened the self-boundary in CO but not in SZ. In SZ, shallower PPS slope was associated with delusion, persecution, negative symptoms and loneliness but not in CO. These results show that the regulation of self-other boundary in response to impending social threat may be maladaptive in SZ. Further research is needed on the causal mechanisms between self-disturbance and social impairments.

Altered representation of peripersonal and interpersonal space in psychopathology

The space surrounding the body, and the regulation of this buffer zone play a central role in adaptive behavior, with direct implications for psychopathology. The physical distance that we choose to maintain between ourselves and others for social comfort is known as Interpersonal Distance (IPD), whereas the action space that marks the perceptual border between the self and the external world is known as Peripersonal Space (PPS ). While both IPD and PPS represent personal space, they are distinct constructs, each associated with different methodologies. Here we review the existing literature on IPD and PPS to elucidate their distinct and common contributions to psychiatric conditions including schizophrenia, autism, anxiety, and others. Altered representation and regulation of IPD and PPS were associated with clinical symptoms and social impairments across a wide range of psychiatric disorders, underscoring the important role of the self-other boundary and personal space regulation in adaptive social behavior. Future research should clarify the relationship between IPD and PPS and specify risk factors for self-other boundary dysregulation and associated psychopathologies.

Motion in the depth direction appears faster when the target is closer to the observer

The target velocity at the retina and the initial phase of target motion are known to affect the perceived velocity of a target in planar motion. For depth motion, however, the role of this information in velocity perception remains unclear. Therefore, the purpose of this study was to reveal the role of the angular velocity derived from the vergence angle and the initial phase of target motion on the perceived velocity for depth motion. We devised two experimental tasks with five stimuli and used a two-alternative forced-choice paradigm to investigate velocity perception. In the tasks, a target moving toward or away from the observer was used. The five stimuli in each task moved between 40 and 240 cm (standard stimulus), 20 and 240 cm, 20 and 220 cm, 40 and 260 cm, and 60 and 260 cm from the participants. In the comparison of the standard stimulus with other stimuli, the stimuli approaching or receding from a distance of 20 cm were perceived as faster than the standard stimulus approaching or receding from a distance of 40 cm. We also showed that the stimuli that receded starting from a distance of 60 cm were perceived as moving slower than the standard stimulus. Our results suggest that larger changes in angular velocity affect velocity perception for depth motion; thus, observers perceive the target velocity as faster when the target is closer to the observer.

Emotion-gaze interaction affects time-to-collision estimates, but not preferred interpersonal distance towards looming faces

Estimating the time until impending collision (time-to-collision, TTC) of approaching or looming individuals and maintaining a comfortable distance from others (interpersonal distance, IPD) are commonly required in daily life and contribute to survival and social goals. Despite accumulating evidence that facial expressions and gaze direction interactively influence face processing, it remains unclear how these facial features affect the spatiotemporal processing of looming faces. We examined whether facial expressions (fearful vs. neutral) and gaze direction (direct vs. averted) interact on the judgments of TTC and IPD for looming faces, based on the shared signal hypothesis that fear signals the existence of threats in the environment when coupled with averted gaze. Experiment 1 demonstrated that TTC estimates were reduced for fearful faces compared to neutral ones only when the concomitant gaze was averted. In Experiment 2, the emotion-gaze interaction was not observed in the IPD regulation, which is arguably sensitive to affective responses to faces. The results suggest that fearful-averted faces modulate the cognitive extrapolation process of looming motion by communicating environmental threats rather than by altering subjective fear or perceived emotional intensity of faces. The TTC-specific effect may reflect an enhanced defensive response to unseen threats implied by looming fearful-averted faces. Our findings provide insight into how the visual system processes facial features to ensure bodily safety and comfortable interpersonal communication in dynamic environments.

The role of arousal in the estimation of time-to-collision of threatening stimuli

The accurate estimation of time-to-collision (TTC) is essential for the survival of organisms. Previous studies have revealed that the emotional properties of approaching stimuli can influence the estimation of TTC, indicating that approaching threatening stimuli are perceived to collide with the observers earlier than they actually do, and earlier than non-threatening stimuli. However, not only are threatening stimuli more negative in valence, but they also have higher arousal compared to non-threatening stimuli. Up to now, the effect of arousal on TTC estimation remains unclear. In addition, inconsistent findings may result from the different experimental settings employed in previous studies. To investigate whether the underestimation of TTC is attributed to threat or high arousal, three experiments with the same settings were conducted. In Experiment 1, the underestimation of TTC estimation of threatening stimuli was replicated when arousal was not controlled, in comparison to non-threatening stimuli. In Experiments 2 and 3, the underestimation effect of threatening stimuli disappeared when compared to positive stimuli with similar arousal. These findings suggest that being threatening alone is not sufficient to explain the underestimation effect, and arousal also plays a significant role in the TTC estimation of approaching stimuli. Further studies are required to validate the effect of arousal on TTC estimation, as no difference was observed in Experiment 3 between the estimated TTC of high and low arousal stimuli.

Face your fears: direct and indirect measurement of responses to looming threats

This study investigated the emotional and behavioural effects of looming threats using both recalled (self-reported valence) and real-time response measurements (facial expressions). The looming bias refers to the tendency to underestimate the time of arrival of rapidly approaching (looming) stimuli, providing additional time for defensive reactions. While previous research has shown negative emotional responses to looming threats based on self-reports after stimulus exposure, facial expressions offer valuable insights into emotional experiences and non-verbal behaviour during stimulus exposure. A face reading experiment examined responses to threats in motion, considering stimulus direction (looming versus receding motion) and threat strength (more versus less threatening stimuli). We also explored the added value of facial expression recognition compared to self-reported valence. Results indicated that looming threats elicit more negative facial expressions than receding threats, supporting previous findings on the looming bias. Further, more (vs. less) threatening stimuli evoked more negative facial expressions, but only when the threats were looming rather than receding. Interestingly, facial expressions of valence and self-reported valence showed opposing results, suggesting the importance of incorporating facial expression recognition to understand defensive responses to looming threats more comprehensively.

General tau theory as a model to evaluate audiovisual interplay in interceptive actions

When interacting with the environment, sensory information is essential to guide movements. Picking up the appropriate sensory information (both visual and auditory) about the progression of an event is required to reach the right place at the right time. In this study, we aimed to see if general tau theory could explain the audiovisual guidance of movement in interceptive action (an interception task). The specific contributions of auditory and visual sensory information were tested by timing synchronous and asynchronous audiovisual interplays in successful interceptive trials. The performance was computed by using the tau-coupling model for information-movement guidance. Our findings revealed that while the auditory contribution to movement guidance did change across conditions, the visual contribution remained constant. In addition, when comparing the auditory and visual contributions, the results revealed a significant decrease in the auditory compared to the visual contribution in just one of the asynchronous conditions where the visual target was presented after the sound. This may be because more attention was drawn to the visual information, resulting in a decrease in the auditory guidance of movement. To summarize, our findings reveal how tau-coupling can be used to disentangle the relative contributions of the visual and auditory sensory modalities in movement planning.

How Do Looming and Receding Emotional Faces Modulate Duration Perception?

The direction of visual motion has been shown to affect the perception of interval duration; objects moving towards an observer (i.e., looming) are perceived to last longer than objects moving away (i.e., receding), and this has been explained in terms of arousal- or attention-based modulation. To dissociate the two competing accounts, we investigated how the influence of motion direction on duration perception is modulated by the emotional content of stimuli. Participants were given the temporal bisection task with images of emotional faces (angry, happy, and neutral) presented in a static (Experiment 1) or dynamic (Experiment 2) display. In Experiment 1, we found no influence of facial emotion on perceived duration. In Experiment 2, however, looming (i.e., expanding) stimuli were perceived as lasting longer than receding (contracting) ones. More importantly, we found an interaction between participant-rated arousal to faces and motion direction: The looming/receding asymmetry was pronounced when the stimulus arousal was rated low, but this asymmetry diminished with increasing arousal ratings. Thus, looming/receding temporal asymmetry seems to be reduced when arousing facial expressions enhance attentional engagement.

The effect of real-world and retinal motion on speed perception for motion in depth

For motion in depth, even if the target moves at a constant speed in the real-world (physically), it would appear to be moving with acceleration on the retina. Therefore, the purpose of this study was to determine whether real-world and retinal motion affect speed perception in depth and to verify the influence of eye movements on both motion signals in judging speed in depth. We used a two-alternative forced-choice paradigm with two types of tasks. One stimulus moved at a constant speed in the real-world (world constant task) with three conditions: 80-60 cm (far), 60-40 cm (middle), and 40-20 cm (near) from the participant. The other stimulus moved at a constant speed on the retina (retinal constant task) with three conditions: 4-8 deg (far), 8-12 deg (middle), and 12-16 deg (near) as the vergence angle. The results showed that stimulus speed was perceived faster in the near condition than in the middle and far conditions for the world constant task, regardless of whether it was during fixation or convergence eye movements. In contrast, stimulus speed was perceived faster in the order of the far, middle, and near conditions for the retinal constant task. Our results indicate that speed perception of a visual target approaching the observer depends on real-world motion when the target position is relatively far from the observer. In contrast, retinal motion may influence speed perception when the target position is close to the observer. Our results also indicate that the effects of real-world and retinal motion on speed perception for motion in depth are similar with or without convergence eye movements. Therefore, it is suggested that when the visual target moves from far to near, the effects of real-world and retinal motion on speed perception are different depending on the initial target position.

Auditory affective content facilitates time-to-contact estimation of visual affective targets

Reacting to a moving object requires an ability to estimate when a moving object reaches its destination, also referred to as the time-to-contact (TTC) estimation. Although the TTC estimation of threatening visually moving objects is known to be underestimated, the effect of the affective content of auditory information on visual TTC estimation remains unclear. We manipulated the velocity and presentation time to investigate the TTC of a threat or non-threat target with the addition of auditory information. In the task, a visual or an audiovisual target moved from right to left and disappeared behind an occluder. Participants' task was to estimate the TTC of the target, they needed to press a button when they thought that the target contacted a destination behind the occluder. Behaviorally, the additional auditory affective content facilitated TTC estimation; velocity was a more critical factor than presentation time in determining the audiovisual threat facilitation effect. Overall, the results indicate that exposure to auditory affective content can influence TTC estimation and that the effect of velocity on TTC estimation will provide more information than presentation time.

Spatial proximity to others induces plastic changes in the neural representation of the peripersonal space

Peripersonal space (PPS) is a highly plastic "invisible bubble" surrounding the body whose boundaries are mapped through multisensory integration. Yet, it is unclear how the spatial proximity to others alters PPS boundaries. Across five experiments (N = 80), by recording behavioral and electrophysiological responses to visuo-tactile stimuli, we demonstrate that the proximity to others induces plastic changes in the neural PPS representation. The spatial proximity to someone else's hand shrinks the portion of space within which multisensory responses occur, thus reducing the PPS boundaries. This suggests that PPS representation, built from bodily and multisensory signals, plastically adapts to the presence of conspecifics to define the self-other boundaries, so that what is usually coded as "my space" is recoded as "your space". When the space is shared with conspecifics, it seems adaptive to move the other-space away from the self-space to discriminate whether external events pertain to the self-body or to other-bodies.

Wider is better but sharper is not: optimizing the image of camera-monitor systems

The replacement of rear-view mirrors with camera-monitor systems introduces new opportunities for design, such as altering the image quality and the rearward field-of-view. We investigated how the image quality and field-of-view might affect the distance and time-to-contact estimation of other vehicles. Eighty-six subjects estimated either their egocentric distance to a stationary vehicle (Experiment I) or the time-to-contact to an approaching vehicle (Experiment II). Throughout the experiments, the pixel density and either the field-of-view or the viewing condition varied. A larger field-of-view increased distance estimation accuracy and confidence. Reduced pixel density led to larger estimates. In contrast, reduced pixel density and simulated dirt shortened time-to-contact estimates. This is compatible with a safety strategy applied under conditions of impaired vision. Moreover, a limited benefit was observed for higher pixel densities. Therefore, camera-monitor systems with large field-of-view and a pixel density of around 300 ppi could ensure accurate TTC and distance estimation. Practitioner summary: A camera's field-of-view and image quality are important parameters for camera-monitor systems. In two experiments, we investigated the effects of these two parameters on rearward distance and time-to-contact estimation. Whereas a larger field-of-view improved distance estimation accuracy, increasing the pixel density had a limited effect in the estimation of time-to-contact.

Threat Detection in Nearby Space Mobilizes Human Ventral Premotor Cortex, Intraparietal Sulcus, and Amygdala

In the monkey brain, the precentral gyrus and ventral intraparietal area are two interconnected brain regions that form a system for detecting and responding to events in nearby “peripersonal” space (PPS), with threat detection as one of its major functions. Behavioral studies point toward a similar defensive function of PPS in humans. Here, our aim was to find support for this hypothesis by investigating if homolog regions in the human brain respond more strongly to approaching threatening stimuli. During fMRI scanning, naturalistic social stimuli were presented in a 3D virtual environment. Our results showed that the ventral premotor cortex and intraparietal sulcus responded more strongly to threatening stimuli entering PPS. Moreover, we found evidence for the involvement of the amygdala and anterior insula in processing threats. We propose that the defensive function of PPS may be supported by a subcortical circuit that sends information about the relevance of the stimulus to the premotor cortex and intraparietal sulcus, where action preparation is facilitated when necessary.

Estimating time-to-contact when vision is impaired

Often, we have to rely on limited information when judging time-to-contact (TTC), as for example, when driving in foul weather, or in situations where we would need reading glasses but do not have them handy. However, most existing studies on the ability to judge TTC have worked with optimal visual stimuli. In a prediction motion task, we explored to what extent TTC estimation is affected by visual stimulus degradation. A simple computer-simulated object approached the observer at constant speed either with clear or impaired vision. It was occluded after 1 or 1.5 s. The observers extrapolated the object's motion and pressed a button when they thought the object would have collided with them. We found that dioptric blur and simulated snowfall shortened TTC-estimates. Contrast reduction produced by a virtual semi-transparent mask lengthened TTC estimates, which could be the result of distance overestimation or speed underestimation induced by the lower contrast or the increased luminance of the mask. We additionally explored the potential influence of arousal and valence, although they played a minor role for basic TTC estimation. Our findings suggest that vision impairments have adverse effects on TTC estimation, depending on the specific type of degradation and the changes of the visual environmental cues which they cause.

Effects of cognitive load and type of object on the visual looming bias

According to the behavioral urgency hypothesis, organisms have evolved various mechanisms that facilitate their survival by focusing attention and resources on approaching danger. One example of such mechanisms is the looming bias-the tendency for an individual to judge an approaching object's distance as being closer or time-to-collision as being sooner than receding or stationary objects. To date, most research on the looming bias has explored the ways in which human factors and object characteristics influence the strength and direction of the bias. The current study expanded on this field of research in two novels ways by exploring (a) whether cognitive vulnerabilities may influence the strength of the looming bias in the visual domain, and (b) whether the combination of human factors (i.e., cognitive load) and object characteristics (i.e., object threat) interact to create an additive effect on looming bias strength. Findings appear to only partially support the hypotheses that cognitive vulnerabilities can influence looming bias strength in the visual domain, and that factors related to both the individual and the looming object may interact to create a stronger looming bias. These findings help to highlight possible evolutionary advantages of the looming bias and its presence across modalities, as well as add some strength to the claims that the margin of safety theory can be generalized to include psychological factors.

Auditory roughness elicits defense reactions

Auditory roughness elicits aversion, and higher activation in cerebral areas involved in threat processing, but its link with defensive behavior is unknown. Defensive behaviors are triggered by intrusions into the space immediately surrounding the body, called peripersonal space (PPS). Integrating multisensory information in PPS is crucial to assure the protection of the body. Here, we assessed the behavioral effects of roughness on auditory-tactile integration, which reflects the monitoring of this multisensory region of space. Healthy human participants had to detect as fast as possible a tactile stimulation delivered on their hand while an irrelevant sound was approaching them from the rear hemifield. The sound was either a simple harmonic sound or a rough sound, processed through binaural rendering so that the virtual sound source was looming towards participants. The rough sound speeded tactile reaction times at a farther distance from the body than the non-rough sound. This indicates that PPS, as estimated here via auditory-tactile integration, is sensitive to auditory roughness. Auditory roughness modifies the behavioral relevance of simple auditory events in relation to the body. Even without emotional or social contextual information, auditory roughness constitutes an innate threat cue that elicits defensive responses.

A Directional Congruency Effect of Amplified Dilated Time Perception Induced by Looming Stimuli With Implied Motion Cues

The perception of time is not veridical, but, rather, it is susceptible to environmental context, like the intrinsic dynamics of moving stimuli. The direction of motion has been reported to affect time perception such that movement of objects toward an observer (i.e., looming stimuli) is perceived as longer in duration than movement of objects away from the observer (i.e., receding stimuli). In the current study we investigated whether this looming/receding temporal asymmetry can be modulated by the direction of movement implied by static cues of images. Participants were presented with images of a running person, rendered from either the front or the back (i.e., representing movement toward or away from the observer). In Experiment 1, the size of the images was constant. In Experiment 2, the image sizes varied (i.e., increasing: looming; or decreasing: receding). In both experiments, participants performed a temporal bisection task by judging the duration of the image presentation as "short" or "long". In Experiment 1, we found no influence of implied-motion direction in the participants' duration perceptions. In Experiment 2, however, participants overestimated the duration of the looming, as compared to the receding image in relation to real motion. This finding replicated previous findings of the looming/receding asymmetry using naturalistic human-character stimuli. Further, in Experiment 2 we observed a directional congruency effect between real and implied motion; stimuli were perceived as lasting longer when the directions of real and implied motion were congruent versus when these directions were incongruent. Thus, looming (versus receding) movement, a perceptually salient stimulus, elicits differential temporal processing, and higher-order motion processing integrates signals of real and implied motion in time perception.

Effect of Acute Psychological Stress on Motion-in-Depth Perception: An Event-Related Potential Study

The present study explored the intrinsic event-related potential (ERP) features of the effects of acute psychological stress on the processing of motion-in-depth perception using a dual-task paradigm. After a mental arithmetic task was used to induce acute psychological stress, a collision task was used to evaluate motion-in-depth perception. The error value and average amplitude of late slow waves (SW) were significantly larger for the earlier colliding spheres' than for the later colliding spheres. The P1 peak latency in the left occipital region was significantly shorter than that of the right occipital region in the motion-in-depth perception task. Compared to the control condition, the estimated value of residual time-to-collision and error value were significantly reduced, and the N1 peak amplitude and the SW averaged amplitude were significantly increased in the stress condition. Longer motion-in-depth time improved discrimination accuracy and decreased the investment of cognitive resources. Acute psychological stress increased behavioral performance and enhanced attention resources on the motion-in-depth perception task together with greater investment of cognitive resources.

Semantic modulation of time-to-collision judgments

Observers are able to make generally accurate judgments of the time-to-collision (TTC) of approaching stimuli. Traditional theories have emphasized the role of optical cues about the expansion of the retinal image in this ability. Recent work, however, has further emphasized the role of semantic information about the object. Here we investigate the role of semantic information in TTC judgments by presenting a range of real-world objects, which varied widely in size, weight, and hardness. Our results show that the physical characteristics of looming stimuli predict observers' TTC estimations. Bigger, heavier, and harder objects were underestimated more, relative to smaller, lighter, and softer objects. As expected, actual TTC and stimulus size were also significant predictors of TTC judgments. In estimating the arrival time of looming stimuli, observers automatically take into account several characteristics of the stimuli, even though these characteristics are completely task irrelevant. This suggests that semantic properties of seen objects and the consequences of their impact on the observer's body are processed automatically.

Lifting, tasting, and carrying: The interaction of magnitude and valence effects in time perception

Magnitude effects (e.g., heavier or faster is longer) and valence effects (e.g., negative > positive) are widely observed in time perception studies, but not well understood. In four experiments, we explored how different action contexts (e.g., tasting, lifting) affected magnitude and valence effects. In two experiments a valence effect occurred: Tasting a sweet food (watermelon) led to temporal underestimations relative to a neutral stimulus, while sour and bitter foods led to overestimations. However, when the same foods were presented in a lifting context a magnitude effect occurred: Reproduced times for the heavier food (watermelon) were overestimated relative to the lighter foods. In a fourth experiment magnitude and valence interacted: Imagining tasting increasing amounts of lemon or carrying increasing loads of lemon, both negative, yielded magnitude effects; however, imagining carrying lemons to feed malnourished people, which was positive, did not. Results present challenges for several common theoretical approaches (e.g., arousal, attention, common magnitude theory) but provide support for affordance theory and perceptual salience theory. Timing depends on action relevance and is jointly shaped by valence and magnitude.

The Prediction of Impact of a Looming Stimulus onto the Body Is Subserved by Multisensory Integration Mechanisms

In the jungle, survival is highly correlated with the ability to detect and distinguish between an approaching predator and a putative prey. From an ecological perspective, a predator rapidly approaching its prey is a stronger cue for flight than a slowly moving predator. In the present study, we use functional magnetic resonance imaging in the nonhuman primate, to investigate the neural bases of the prediction of an impact to the body by a looming stimulus, i.e., the neural bases of the interaction between a dynamic visual stimulus approaching the body and its expected consequences onto an independent sensory modality, namely, touch. We identify a core cortical network of occipital, parietal, premotor, and prefrontal areas maximally activated by tactile stimulations presented at the predicted time and location of impact of the looming stimulus on the faces compared with the activations observed for spatially or temporally incongruent tactile and dynamic visual cues. These activations reflect both an active integration of visual and tactile information and of spatial and temporal prediction information. The identified cortical network coincides with a well described multisensory visuotactile convergence and integration network suggested to play a key role in the definition of peripersonal space. These observations are discussed in the context of multisensory integration and spatial, temporal prediction and Bayesian causal inference.SIGNIFICANCE STATEMENT Looming stimuli have a particular ecological relevance as they are expected to come into contact with the body, evoking touch or pain sensations and possibly triggering an approach or escape behavior depending on their identity. Here, we identify the nonhuman primate functional network that is maximally activated by tactile stimulations presented at the predicted time and location of impact of the looming stimulus. Our findings suggest that the integration of spatial and temporal predictive cues possibly rely on the same neural mechanisms that are involved in multisensory integration.

Human Perception of Animacy in Light of the Uncanny Valley Phenomenon

The uncanny valley hypothesis by Japanese roboticist Masahiro Mori posits a nonlinear relation between human replicas’ human likeness and the emotional responses they elicit. In three studies, we corroborated the uncanny valley hypothesis, using the uncanny phenomenon as a vehicle to shed a new light on human animacy perception. In Study 1, 62 participants rated emotional responses and human likeness of 89 artificial and human faces. In Study 2, another 62 participants conducted a visual looming task with the same 89 faces allowing for the measurement of perceived threat. Results support the uncanny valley hypothesis, suggesting that the uncanny feeling may serve a function to wary humans of the potential danger of entities crossing the animate–inanimate boundary. In Study 3, 36 participants sorted faces as either real or unreal as quickly as possible in a reaction time sorting task allowing for the measurement of categorical uncertainty associated with animacy perception. Faces associated with longer sorting reaction times were also those associated with the highest ratings of negative emotions, suggesting that categorical uncertainty in animacy detection is related to the uncanny feeling. Results are discussed in light of human animacy perception and new directions for future research are suggested.

Action ability modulates time-to-collision judgments

Time-to-collision (TTC) underestimation has been interpreted as an adaptive response that allows observers to have more time to engage in a defensive behaviour. This bias seems, therefore, strongly linked to action preparation. There is evidence that the observer’s physical fitness modulates the underestimation effect so that people who need more time to react (i.e. those with less physical fitness) show a stronger underestimation effect. Here we investigated whether this bias is influenced by the momentary action capability of the observers. In the first experiment, participants estimated the time-to-collision of threatening or non-threatening stimuli while being mildly immobilized (with a chin rest) or while standing freely. Having reduced the possibility of movement led participants to show more underestimation of the approaching stimuli. However, this effect was not stronger for threatening relative to non-threatening stimuli. The effect of the action capability found in the first experiment could be interpreted as an expansion of peripersonal space (PPS). In the second experiment, we thus investigated the generality of this effect using an established paradigm to measure the size of peripersonal space. Participants bisected lines from different distances while in the chin rest or standing freely. The results replicated the classic left-to-right gradient in lateral spatial attention with increasing viewing distance, but no effect of immobilization was found. The manipulation of the momentary action capability of the observers influenced the participants’ performance in the TTC task but not in the line bisection task. These results are discussed in relation to the different functions of PPS.

Judging arrival times of incoming traffic vehicles is not a prerequisite for safely crossing an intersection: Differential effects of vehicle size and type in passive judgment and active driving tasks

Using a fixed-base driving simulator we compared the effects of the size and type of traffic vehicles (i.e., normal-sized or double-sized cars or motorcycles) approaching an intersection in two different tasks. In the perceptual judgment task, passively moving participants estimated when a traffic vehicle would reach the intersection for actual arrival times (ATs) of 1, 2, or 3s. In line with earlier findings, ATs were generally underestimated, the more so the longer the actual AT. Results revealed that vehicle size affected judgments in particular for the larger actual ATs (2 and 3s), with double-sized vehicles then being judged as arriving earlier than normal-sized vehicles. Vehicle type, on the other hand, affected judgments at the smaller actual ATs (1 and 2s), with cars then being judged as arriving earlier than motorcycles. In the behavioral task participants actively drove the simulator to cross the intersection by passing through a gap in a train of traffic. Analyses of the speed variations observed during the active intersection-crossing task revealed that the size and type of vehicles in the traffic train did not affect driving behavior in the same way as in the AT judgment task. First, effects were considerably smaller, affecting driving behavior only marginally. Second, effects were opposite to expectations based on AT judgments: driver approach speeds were smaller (rather than larger) when confronted with double-sized vehicles as compared to their normal-sized counterparts and when confronted with cars as compared to motorcycles. Finally, the temporality of the effects was different on the two tasks: vehicle size affected driver approach speed in the final stages of approach rather than early on, while vehicle type affected driver approach speed early on rather than later. Overall, we conclude that the active control of approach to the intersection is not based on successive judgments of traffic vehicle arrival times. These results thereby question the general belief that arrival time estimates are crucial for safe interaction with traffic.

Emotional modulation of interval timing and time perception

Like other senses, our perception of time is not veridical, but rather, is modulated by changes in environmental context. Anecdotal experiences suggest that emotions can be powerful modulators of time perception; nevertheless, the functional and neural mechanisms underlying emotion-induced temporal distortions remain unclear. Widely accepted pacemaker-accumulator models of time perception suggest that changes in arousal and attention have unique influences on temporal judgments and contribute to emotional distortions of time perception. However, such models conflict with current views of arousal and attention suggesting that current models of time perception do not adequately explain the variability in emotion-induced temporal distortions. Instead, findings provide support for a new perspective of emotion-induced temporal distortions that emphasizes both the unique and interactive influences of arousal and attention on time perception over time. Using this framework, we discuss plausible functional and neural mechanisms of emotion-induced temporal distortions and how these temporal distortions may have important implications for our understanding of how emotions modulate our perceptual experiences in service of adaptive responding to biologically relevant stimuli.

Audiovisual Integration of Time-to-Contact Information for Approaching Objects

Previous studies of time-to-collision (TTC) judgments of approaching objects focused on effectiveness of visual TTC information in the optical expansion pattern (e.g., visual tau, disparity). Fewer studies examined effectiveness of auditory TTC information in the pattern of increasing intensity (auditory tau), or measured integration of auditory and visual TTC information. Here, participants judged TTC of an approaching object presented in the visual or auditory modality, or both concurrently. TTC information provided by the modalities was jittered slightly against each other, so that auditory and visual TTC were not perfectly correlated. A psychophysical reverse correlation approach was used to estimate the influence of auditory and visual cues on TTC estimates. TTC estimates were shorter in the auditory than the visual condition. On average, TTC judgments in the audiovisual condition were not significantly different from judgments in the visual condition. However, multiple regression analyses showed that TTC estimates were based on both auditory and visual information. Although heuristic cues (final sound pressure level, final optical size) and more reliable information (relative rate of change in acoustic intensity, optical expansion) contributed to auditory and visual judgments, the effect of heuristics was greater in the auditory condition. Although auditory and visual information influenced judgments, concurrent presentation of both did not result in lower response variability compared to presentation of either one alone; there was no multimodal advantage. The relative weightings of heuristics and more reliable information differed between auditory and visual TTC judgments, and when both were available, visual information was weighted more heavily.

Threat modulates neural responses to looming visual stimuli

Objects on a collision course with an observer produce a specific pattern of optical expansion on the retina known as looming, which in theory exactly specifies the time-to-collision (TTC) of approaching objects. It was recently demonstrated that the affective content of looming stimuli influences perceived TTC, with threatening objects judged as approaching sooner than non-threatening objects. Here, the neural mechanisms by which perceived threat modulates spatiotemporal perception were investigated. Participants judged the TTC of threatening (snakes, spiders) or non-threatening (butterflies, rabbits) stimuli, which expanded in size at a rate indicating one of five TTCs. Visual-evoked potentials (VEPs) and oscillatory neural responses measured with electroencephalography were analysed. The arrival time of threatening stimuli was underestimated compared with non-threatening stimuli, though an interaction suggested that this underestimation was not constant across TTCs. Further, both speed of approach and threat modulated both VEPs and oscillatory responses. Speed of approach modulated the N1 parietal and oscillations in the beta band. Threat modulated several VEP components (P1, N1 frontal, N1 occipital, early posterior negativity and late positive potential) and oscillations in the alpha and high gamma band. The results for the high gamma band suggest an interaction between these two factors. Previous evidence suggests that looming stimuli activate sensorimotor areas, even in the absence of an intended action. The current results show that threat disrupts the synchronization over the sensorimotor areas that are likely activated by the presentation of a looming stimulus.

Threatening scenes but not threatening faces shorten time-to-contact estimates

We previously reported that time-to-contact (TTC) judgments of threatening scene pictures (e.g., frontal attacks) resulted in shortened estimations and were mediated by cognitive processes, and that judgments of threatening (e.g., angry) face pictures resulted in a smaller effect and did not seem cognitively mediated. In the present study, the effects of threatening scenes and faces were compared in two different tasks. An effect of threatening scene pictures occurred in a prediction-motion task, which putatively requires cognitive motion extrapolation, but not in a relative TTC judgment task, which was designed to be less reliant on cognitive processes. An effect of threatening face pictures did not occur in either task. We propose that an object's explicit potential of threat per se, and not only emotional valence, underlies the effect of threatening scenes on TTC judgments and that such an effect occurs only when the task allows sufficient cognitive processing. Results are consistent with distinctions between predator and social fear systems and different underlying physiological mechanisms. Not all threatening information elicits the same responses, and whether an effect occurs at all may depend on the task and the degree to which the task involves cognitive processes.

Emotional effects on time-to-contact judgments: arousal, threat, and fear of spiders modulate the effect of pictorial content

Recently, responses to looming visual stimuli have been shown to depend on the emotional content of the stimulus. A threatening stimulus is judged to arrive sooner compared to a neutral stimulus, possibly buying the organism time to prepare defensive actions. Here, we explored the underlying mechanism. We found that time-to-contact judgments of threatening pictures did not differ from those of highly arousing pleasant pictures (Experiment 1), suggesting that arousal, not fear, modulates the perception of looming. Specific fear modulated the effects of arousal (Experiment 2): Spider-fearful participants' judgments showed a threat advantage effect, while non-fearful participants' judgments were less affected by emotional content. In Experiment 3, arrival times were less overestimated when pictures induced arousal. However, this effect interacted with the valence of the stimulus: For unpleasant stimuli, arousal induced shorter time-to-contact judgments, whereas for pleasant stimuli, an inverted U-shaped relation was found. We propose a general content effect to explain the overestimation with neutral pictures: Pictorial content may draw visual attention to inner contours instead of to the outer edges of the picture. This could delay time-to-contact judgments according to the known size-arrival effect. Our results add to the growing literature examining affective influences on visual perception.

Cynophobic fear adaptively extends peri-personal space

Peri-personal space (PPS) is defined as the space immediately surrounding our bodies, which is critical in the adaptation of our social behavior. As a space of interaction with the external world, PPS is involved in the control of motor action as well as in the protection of the body. The boundaries of this PPS are known to be flexible but so far, little is known about how PPS boundaries are influenced by unreasonable fear. We hypothesized that unreasonable fear extends the neural representation of the multisensory space immediately surrounding the body in the presence of a feared object, with the aim of expanding the space of protection around the body. To test this hypothesis, we explored the impact of unreasonable fear on the size of PPS in two groups of non-clinical participants: dog-fearful and non-fearful participants. The sensitivity to cynophobia was assessed with a questionnaire. We measured participants' PPS extent in the presence of threatening (dog growling) and non-threatening (sheep bleating) auditory stimuli. The sound stimuli were processed through binaural rendering so that the virtual sound sources were looming toward participants from their rear hemi-field. We found that, when in the presence of the auditory dog stimulus, the PPS of dog-fearful participants is larger than that of non-fearful participants. Our results demonstrate that PPS size is adaptively modulated by cynophobia and suggest that anxiety tailors PPS boundaries when exposed to fear-relevant features. Anxiety, with the exception of social phobia, has rarely been studied as a disorder of social interaction. These findings could help develop new treatment strategies for anxious disorders by involving the link between space and interpersonal interaction in the approach of the disorder.

Effects of Size on Collision Perception and Implications for Perceptual Theory and Transportation Safety

People avoid collisions when they walk or drive, and they create collisions when they hit balls or tackle opponents. To do so, people rely on the perception of depth (perception of objects’ locations) and time-to-collision (perception of when a collision will occur), which are supported by different information sources. Depth cues, such as relative size, provide heuristics for relative depth, whereas optical invariants, such as tau, provide reliable time-to-collision information. One would expect people to rely on invariants rather than depth cues, but the size-arrival effect shows the contrary: People reported that a large far approaching object would hit them sooner than a small near object that would have hit first. This effect of size on collision perception violates theories of time-to-collision perception based solely on the invariant tau and suggests that perception is based on multiple information sources, including heuristics. The size-arrival effect potentially can lead drivers to misjudge when a vehicle would arrive at an intersection and is considered a contributing factor in motorcycle accidents. In this article, I review research on the size-arrival effect and its theoretical and practical implications.