Emotional effects on time-to-contact judgments: arousal, threat, and fear of spiders modulate the effect of pictorial content

Tennis expert-novice difference in motion-in-depth perception is associated with early inhibition of invalid attention

Perception of motion-in-depth is essential to guide and modify the hitting action in interceptive-dominated sports (e.g., tennis). The purpose of this research was to investigate the effect of tennis expertise on motion-in-depth perception at different cognition processes by two event-related potential (ERP) studies. Specifically, the study explored differences in behavior and electroencephalogram (EEG) characteristics between tennis experts and novices under two different task conditions. Seventeen skilled tennis players (average professional experience: 10.76 ± 2.56 years) and 17 age-matched novices participated in two experiments. Cortical activity (P1, N1, P2, and the later component) and task performance (reaction time, accuracy rate, and error value) were recorded when participants completed a direction-identifying task (Experiment 1) and a prediction-motion task (Experiment 2) while perceiving motion-in-depth. Results demonstrated that P1 latency in the expert group was significantly shorter than the novice group in experiment 1; and in experiment 2, the expert group showed shorter P1 latency than the novice group under the TTC1 (actual time-to-collision is 400 ms) condition. The results indicate that the effect of tennis expertise on motion-in-depth perception was primarily manifested as early visual attentional investment in the features of objects. Experts have the rapid inbibition of invalid attention.

Motion in the depth direction appears faster when the target is closer to the observer

The target velocity at the retina and the initial phase of target motion are known to affect the perceived velocity of a target in planar motion. For depth motion, however, the role of this information in velocity perception remains unclear. Therefore, the purpose of this study was to reveal the role of the angular velocity derived from the vergence angle and the initial phase of target motion on the perceived velocity for depth motion. We devised two experimental tasks with five stimuli and used a two-alternative forced-choice paradigm to investigate velocity perception. In the tasks, a target moving toward or away from the observer was used. The five stimuli in each task moved between 40 and 240 cm (standard stimulus), 20 and 240 cm, 20 and 220 cm, 40 and 260 cm, and 60 and 260 cm from the participants. In the comparison of the standard stimulus with other stimuli, the stimuli approaching or receding from a distance of 20 cm were perceived as faster than the standard stimulus approaching or receding from a distance of 40 cm. We also showed that the stimuli that receded starting from a distance of 60 cm were perceived as moving slower than the standard stimulus. Our results suggest that larger changes in angular velocity affect velocity perception for depth motion; thus, observers perceive the target velocity as faster when the target is closer to the observer.

The role of arousal in the estimation of time-to-collision of threatening stimuli

The accurate estimation of time-to-collision (TTC) is essential for the survival of organisms. Previous studies have revealed that the emotional properties of approaching stimuli can influence the estimation of TTC, indicating that approaching threatening stimuli are perceived to collide with the observers earlier than they actually do, and earlier than non-threatening stimuli. However, not only are threatening stimuli more negative in valence, but they also have higher arousal compared to non-threatening stimuli. Up to now, the effect of arousal on TTC estimation remains unclear. In addition, inconsistent findings may result from the different experimental settings employed in previous studies. To investigate whether the underestimation of TTC is attributed to threat or high arousal, three experiments with the same settings were conducted. In Experiment 1, the underestimation of TTC estimation of threatening stimuli was replicated when arousal was not controlled, in comparison to non-threatening stimuli. In Experiments 2 and 3, the underestimation effect of threatening stimuli disappeared when compared to positive stimuli with similar arousal. These findings suggest that being threatening alone is not sufficient to explain the underestimation effect, and arousal also plays a significant role in the TTC estimation of approaching stimuli. Further studies are required to validate the effect of arousal on TTC estimation, as no difference was observed in Experiment 3 between the estimated TTC of high and low arousal stimuli.

How Do Looming and Receding Emotional Faces Modulate Duration Perception?

The direction of visual motion has been shown to affect the perception of interval duration; objects moving towards an observer (i.e., looming) are perceived to last longer than objects moving away (i.e., receding), and this has been explained in terms of arousal- or attention-based modulation. To dissociate the two competing accounts, we investigated how the influence of motion direction on duration perception is modulated by the emotional content of stimuli. Participants were given the temporal bisection task with images of emotional faces (angry, happy, and neutral) presented in a static (Experiment 1) or dynamic (Experiment 2) display. In Experiment 1, we found no influence of facial emotion on perceived duration. In Experiment 2, however, looming (i.e., expanding) stimuli were perceived as lasting longer than receding (contracting) ones. More importantly, we found an interaction between participant-rated arousal to faces and motion direction: The looming/receding asymmetry was pronounced when the stimulus arousal was rated low, but this asymmetry diminished with increasing arousal ratings. Thus, looming/receding temporal asymmetry seems to be reduced when arousing facial expressions enhance attentional engagement.

The effect of real-world and retinal motion on speed perception for motion in depth

For motion in depth, even if the target moves at a constant speed in the real-world (physically), it would appear to be moving with acceleration on the retina. Therefore, the purpose of this study was to determine whether real-world and retinal motion affect speed perception in depth and to verify the influence of eye movements on both motion signals in judging speed in depth. We used a two-alternative forced-choice paradigm with two types of tasks. One stimulus moved at a constant speed in the real-world (world constant task) with three conditions: 80-60 cm (far), 60-40 cm (middle), and 40-20 cm (near) from the participant. The other stimulus moved at a constant speed on the retina (retinal constant task) with three conditions: 4-8 deg (far), 8-12 deg (middle), and 12-16 deg (near) as the vergence angle. The results showed that stimulus speed was perceived faster in the near condition than in the middle and far conditions for the world constant task, regardless of whether it was during fixation or convergence eye movements. In contrast, stimulus speed was perceived faster in the order of the far, middle, and near conditions for the retinal constant task. Our results indicate that speed perception of a visual target approaching the observer depends on real-world motion when the target position is relatively far from the observer. In contrast, retinal motion may influence speed perception when the target position is close to the observer. Our results also indicate that the effects of real-world and retinal motion on speed perception for motion in depth are similar with or without convergence eye movements. Therefore, it is suggested that when the visual target moves from far to near, the effects of real-world and retinal motion on speed perception are different depending on the initial target position.

Estimating time-to-contact when vision is impaired

Often, we have to rely on limited information when judging time-to-contact (TTC), as for example, when driving in foul weather, or in situations where we would need reading glasses but do not have them handy. However, most existing studies on the ability to judge TTC have worked with optimal visual stimuli. In a prediction motion task, we explored to what extent TTC estimation is affected by visual stimulus degradation. A simple computer-simulated object approached the observer at constant speed either with clear or impaired vision. It was occluded after 1 or 1.5 s. The observers extrapolated the object's motion and pressed a button when they thought the object would have collided with them. We found that dioptric blur and simulated snowfall shortened TTC-estimates. Contrast reduction produced by a virtual semi-transparent mask lengthened TTC estimates, which could be the result of distance overestimation or speed underestimation induced by the lower contrast or the increased luminance of the mask. We additionally explored the potential influence of arousal and valence, although they played a minor role for basic TTC estimation. Our findings suggest that vision impairments have adverse effects on TTC estimation, depending on the specific type of degradation and the changes of the visual environmental cues which they cause.

A Directional Congruency Effect of Amplified Dilated Time Perception Induced by Looming Stimuli With Implied Motion Cues

The perception of time is not veridical, but, rather, it is susceptible to environmental context, like the intrinsic dynamics of moving stimuli. The direction of motion has been reported to affect time perception such that movement of objects toward an observer (i.e., looming stimuli) is perceived as longer in duration than movement of objects away from the observer (i.e., receding stimuli). In the current study we investigated whether this looming/receding temporal asymmetry can be modulated by the direction of movement implied by static cues of images. Participants were presented with images of a running person, rendered from either the front or the back (i.e., representing movement toward or away from the observer). In Experiment 1, the size of the images was constant. In Experiment 2, the image sizes varied (i.e., increasing: looming; or decreasing: receding). In both experiments, participants performed a temporal bisection task by judging the duration of the image presentation as "short" or "long". In Experiment 1, we found no influence of implied-motion direction in the participants' duration perceptions. In Experiment 2, however, participants overestimated the duration of the looming, as compared to the receding image in relation to real motion. This finding replicated previous findings of the looming/receding asymmetry using naturalistic human-character stimuli. Further, in Experiment 2 we observed a directional congruency effect between real and implied motion; stimuli were perceived as lasting longer when the directions of real and implied motion were congruent versus when these directions were incongruent. Thus, looming (versus receding) movement, a perceptually salient stimulus, elicits differential temporal processing, and higher-order motion processing integrates signals of real and implied motion in time perception.

Effect of Acute Psychological Stress on Motion-in-Depth Perception: An Event-Related Potential Study

The present study explored the intrinsic event-related potential (ERP) features of the effects of acute psychological stress on the processing of motion-in-depth perception using a dual-task paradigm. After a mental arithmetic task was used to induce acute psychological stress, a collision task was used to evaluate motion-in-depth perception. The error value and average amplitude of late slow waves (SW) were significantly larger for the earlier colliding spheres' than for the later colliding spheres. The P1 peak latency in the left occipital region was significantly shorter than that of the right occipital region in the motion-in-depth perception task. Compared to the control condition, the estimated value of residual time-to-collision and error value were significantly reduced, and the N1 peak amplitude and the SW averaged amplitude were significantly increased in the stress condition. Longer motion-in-depth time improved discrimination accuracy and decreased the investment of cognitive resources. Acute psychological stress increased behavioral performance and enhanced attention resources on the motion-in-depth perception task together with greater investment of cognitive resources.

Semantic modulation of time-to-collision judgments

Observers are able to make generally accurate judgments of the time-to-collision (TTC) of approaching stimuli. Traditional theories have emphasized the role of optical cues about the expansion of the retinal image in this ability. Recent work, however, has further emphasized the role of semantic information about the object. Here we investigate the role of semantic information in TTC judgments by presenting a range of real-world objects, which varied widely in size, weight, and hardness. Our results show that the physical characteristics of looming stimuli predict observers' TTC estimations. Bigger, heavier, and harder objects were underestimated more, relative to smaller, lighter, and softer objects. As expected, actual TTC and stimulus size were also significant predictors of TTC judgments. In estimating the arrival time of looming stimuli, observers automatically take into account several characteristics of the stimuli, even though these characteristics are completely task irrelevant. This suggests that semantic properties of seen objects and the consequences of their impact on the observer's body are processed automatically.

The 'Saw but Forgot' error: A role for short-term memory failures in understanding junction crashes?

Motorcyclists are involved in an exceptionally high number of crashes for the distance they travel, with one of the most common incidents being where another road user pulls out into the path of an oncoming motorcycle frequently resulting in a fatal collision. These instances have previously been interpreted as failures of visual attention, sometimes termed 'Look but Fail to See' (LBFTS) crashes, and interventions have focused on improving drivers' visual scanning and motorcycles' visibility. Here we show from a series of three experiments in a high-fidelity driving simulator, that when drivers' visual attention towards and memory for approaching vehicles is experimentally tested, drivers fail to report approaching motorcycles on between 13% and 18% of occasions. This happens even when the driver is pulling out into a safety-critical gap in front of the motorcycle, and often happens despite the driver having directly fixated on the oncoming vehicle. These failures in reporting a critical vehicle were not associated with how long the driver looked at the vehicle for, but were associated with drivers' subsequent visual search and the time that elapsed between fixating on the oncoming vehicle and pulling out of the junction. Here, we raise the possibility that interference in short-term memory might prevent drivers holding important visual information during these complex manoeuvres. This explanation suggests that some junction crashes on real roads that have been attributed to LBFTS errors may have been misclassified and might instead be the result of 'Saw but Forgot' (SBF) errors. We provide a framework for understanding the role of short-term memory in such situations, the Perceive Retain Choose (PRC) model, as well as novel predictions and proposals for practical interventions that may prevent this type of crash in the future.

Cognitive penetration of early vision in face perception

Cognitive and affective penetration of perception refers to the influence that higher mental states such as beliefs and emotions have on perceptual systems. Psychological and neuroscientific studies appear to show that these states modulate the visual system at the visuomotor, attentional, and late levels of processing. However, empirical evidence showing that similar consequences occur in early stages of visual processing seems to be scarce. In this paper, I argue that psychological evidence does not seem to be either sufficient or necessary to argue in favour of or against the cognitive penetration of perception in either late or early vision. In order to do that we need to have recourse to brain imaging techniques. Thus, I introduce a neuroscientific study and argue that it seems to provide well-grounded evidence for the cognitive penetration of early vision in face perception. I also examine and reject alternative explanations to my conclusion.

Change deafness, dual-task performance, and domain-specific expertise

In a change deafness manipulation using radio broadcasts of sporting events, we show that change deafness to a switch in talker increases when listeners are asked to monitor both lexical and indexical information for change. We held semantic content constant and demonstrated a change deafness rate of 85% when participants listened to the home team broadcast of a hockey game that switched midway to the away team broadcast with a different announcer. In Study 2, participants were asked to monitor either the indexical characteristics ( listen for a change in announcer) or both the indexical and semantic components ( listen for a change in announcer or a goal scored). Monitoring both components led to significantly greater change deafness even though both groups were alerted to the possibility of a change in announcer. In Study 3, we changed both the indexical and the semantic components when the broadcast switched from a hockey game to a basketball game. We found a negative correlation between sports expertise and change deafness. The results are discussed in terms of the nature of perceptual representation and the influence of expertise and evolution on attention allocation.

Judging arrival times of incoming traffic vehicles is not a prerequisite for safely crossing an intersection: Differential effects of vehicle size and type in passive judgment and active driving tasks

Using a fixed-base driving simulator we compared the effects of the size and type of traffic vehicles (i.e., normal-sized or double-sized cars or motorcycles) approaching an intersection in two different tasks. In the perceptual judgment task, passively moving participants estimated when a traffic vehicle would reach the intersection for actual arrival times (ATs) of 1, 2, or 3s. In line with earlier findings, ATs were generally underestimated, the more so the longer the actual AT. Results revealed that vehicle size affected judgments in particular for the larger actual ATs (2 and 3s), with double-sized vehicles then being judged as arriving earlier than normal-sized vehicles. Vehicle type, on the other hand, affected judgments at the smaller actual ATs (1 and 2s), with cars then being judged as arriving earlier than motorcycles. In the behavioral task participants actively drove the simulator to cross the intersection by passing through a gap in a train of traffic. Analyses of the speed variations observed during the active intersection-crossing task revealed that the size and type of vehicles in the traffic train did not affect driving behavior in the same way as in the AT judgment task. First, effects were considerably smaller, affecting driving behavior only marginally. Second, effects were opposite to expectations based on AT judgments: driver approach speeds were smaller (rather than larger) when confronted with double-sized vehicles as compared to their normal-sized counterparts and when confronted with cars as compared to motorcycles. Finally, the temporality of the effects was different on the two tasks: vehicle size affected driver approach speed in the final stages of approach rather than early on, while vehicle type affected driver approach speed early on rather than later. Overall, we conclude that the active control of approach to the intersection is not based on successive judgments of traffic vehicle arrival times. These results thereby question the general belief that arrival time estimates are crucial for safe interaction with traffic.

Emotional modulation of interval timing and time perception

Like other senses, our perception of time is not veridical, but rather, is modulated by changes in environmental context. Anecdotal experiences suggest that emotions can be powerful modulators of time perception; nevertheless, the functional and neural mechanisms underlying emotion-induced temporal distortions remain unclear. Widely accepted pacemaker-accumulator models of time perception suggest that changes in arousal and attention have unique influences on temporal judgments and contribute to emotional distortions of time perception. However, such models conflict with current views of arousal and attention suggesting that current models of time perception do not adequately explain the variability in emotion-induced temporal distortions. Instead, findings provide support for a new perspective of emotion-induced temporal distortions that emphasizes both the unique and interactive influences of arousal and attention on time perception over time. Using this framework, we discuss plausible functional and neural mechanisms of emotion-induced temporal distortions and how these temporal distortions may have important implications for our understanding of how emotions modulate our perceptual experiences in service of adaptive responding to biologically relevant stimuli.

Discriminative Fear Learners are Resilient to Temporal Distortions during Threat Anticipation

Discriminative fear conditioning requires learning to dissociate between safety cues and cues that predict negative outcomes yet little is known about what processes contribute to discriminative fear learning. According to attentional models of time perception, processes that distract from timing result in temporal underestimation. If discriminative fear learning only requires learning what cues predict what outcomes, and threatening stimuli distract attention from timing, then better discriminative fear learning should predict greater temporal distortion on threat trials. Alternatively, if discriminative fear learning also reflects a more accurate perceptual experience of time in threatening contexts, discriminative fear learning scores would predict less temporal distortion on threat trials, as time is perceived more veridically. Healthy young adults completed discriminative fear conditioning in which they learned to associate one stimulus (CS+) with aversive electrical stimulation and another stimulus (CS-) with non-aversive tactile stimulation and then an ordinal comparison timing task during which CSs were presented as task-irrelevant distractors Consistent with predictions, we found an overall temporal underestimation bias on CS+ relative to CS- trials. Differential skin conductance responses to the CS+ versus the CS- during conditioning served as a physiological index of discriminative fear conditioning and this measure predicted the magnitude of the underestimation bias, such that individuals exhibiting greater discriminative fear conditioning showed less underestimation on CS+ versus CS- trials. These results are discussed with respect to the nature of discriminative fear learning and the relationship between temporal distortions and maladaptive threat processing in anxiety.

Approaching threat modulates visuotactile interactions in peripersonal space

The region surrounding our body (i.e. peripersonal space) is coded in a multimodal representation by fronto-parietal bimodal neurons integrating tactile stimuli on the body with nearby visual stimuli. This has often been suggested to serve a defensive purpose, which we propose could be mediated through visuotactile predictions. An approaching threat would then be of particular interest to peripersonal space processing. To investigate this, we asked participants to respond as fast as possible to a tactile stimulus on the hand, while looking at an animation of an approaching or receding spider or butterfly. Tactile stimulation was applied at one of 25 possible time points during the animation. Tactile reaction times were faster when an approaching stimulus was closer to the hand at the time of tactile presentation. Critically, this effect of distance on reaction times was larger when participants saw an approaching spider compared to an approaching butterfly, but only for participants who were afraid of spiders. This finding demonstrates that the perceived threat of an approaching stimulus modulates visuotactile interactions in peripersonal space and is consistent with the idea that visuotactile predictions are important for defensive purposes and maintaining bodily integrity.