Incidental Processing of Biological Motion

I like the way you move: how animate motion affects visual attention in early human infancy

The ability to detect animates (as compared with inanimates) rapidly is advantageous for human survival. Due to its relevance, not only the adult human brain has evolved specific neural mechanisms to discriminate animates, but it has been proposed that selection finely tuned the human visual attention system to prioritize visual cues that signal the presence of living things. Among them, animate motion-i.e., the motion of animate entities -, is one of the most powerful cues that triggers humans' attention. From a developmental point of view, whether such specialization is inborn or acquired through experience is a fascinating research topic. This mini-review aims to summarize and discuss recent behavioral and electrophysiological research that suggests that animate motion has an attentional advantage in the first year of life starting from birth. Specifically, the rationale underlying this paper concerns how attention deployment is affected by animate motion conveyed both by the movement of a single dot and, also, when the single dot is embedded in a complex array, named biological motion. Overall, it will highlight the importance of both inborn predispositions to pay attention preferentially to animate motion, mainly supported by subcortical structures, and the exposure to certain experiences, shortly after birth, to drive the cortical attentional visual system to become the way it is in adults.

Atypical local and global biological motion perception in children with attention deficit hyperactivity disorder

Perceiving biological motion (BM) is crucial for human survival and social interaction. Many studies have reported impaired BM perception in autism spectrum disorder, which is characterised by deficits in social interaction. Children with attention deficit hyperactivity disorder (ADHD) often exhibit similar difficulties in social interaction. However, few studies have investigated BM perception in children with ADHD. Here, we compared differences in the ability to process local kinematic and global configurational cues, two fundamental abilities of BM perception, between typically developing and ADHD children. We further investigated the relationship between BM perception and social interaction skills measured using the Social Responsiveness Scale and examined the contributions of latent factors (e.g. sex, age, attention, and intelligence) to BM perception. The results revealed that children with ADHD exhibited atypical BM perception. Local and global BM processing showed distinct features. Local BM processing ability was related to social interaction skills, whereas global BM processing ability significantly improved with age. Critically, general BM perception (i.e. both local and global BM processing) may be affected by sustained attentional ability in children with ADHD. This relationship was primarily mediated by reasoning intelligence. These findings elucidate atypical BM perception in ADHD and the latent factors related to BM perception. Moreover, this study provides new evidence that BM perception is a hallmark of social cognition and advances our understanding of the potential roles of local and global processing in BM perception and social cognitive disorders.

Effect of spatial context on perceived walking direction

Contextual modulation occurs for many aspects of high-level vision but is relatively unexplored for the perception of walking direction. In a recent study, we observed an effect of the temporal context on perceived walking direction. Here, we examined the spatial contextual modulation by measuring the perceived direction of a target point-light walker in the presence of two flanker walkers, one on each side. Experiment 1 followed a within-subjects design. Participants (n = 30) completed a spatial context task by judging the walking direction of the target in 13 different conditions: a walker alone in the center or with two flanking walkers either intact or scrambled at a flanker deviation of ±15°, ±30°, or ±45°. For comparison, participants completed an adaptation task where they reported the walking direction of a target after adaptation to ±30° walking direction. We found the expected repulsive effects in the adaptation task but attractive effects in the spatial context task. In Experiment 2 (n = 40), we measured the tuning of spatial contextual modulation across a wide range of flanker deviation magnitudes ranging from 15° to 165° in 15° intervals. Our results showed significant attractive effects across a wide range of flanker walking directions with the peak effect at around 30°. The assimilative versus repulsive effects of spatial contextual modulation and temporal adaptation suggest dissociable neural mechanisms, but they may operate on the same population of sensory channels coding for walking direction, as evidenced by similarity in the peak tuning across the walking direction of the inducers.

Life motion signals bias the perception of apparent motion direction

Walking direction conveyed by biological motion (BM) cues, which humans are highly sensitive to since birth, can elicit involuntary shifts of attention to enhance the detection of static targets. Here, we demonstrated that such intrinsic sensitivity to walking direction could also modulate the direction perception of simultaneously presented dynamic stimuli. We showed that the perceived direction of apparent motion was biased towards the walking direction even though observers had been informed in advance that the walking direction of BM did not predict the apparent motion direction. In particular, rightward BM cues had an advantage over leftward BM cues in altering the perception of motion direction. Intriguingly, this perceptual bias disappeared when BM cues were shown inverted, or when the critical biological characteristics were removed from the cues. Critically, both the perceptual direction bias and the rightward advantage persisted even when only local BM cues were presented without any global configuration. Furthermore, the rightward advantage was found to be specific to social cues (i.e., BM), as it vanished when non-social cues (i.e., arrows) were utilized. Taken together, these findings support the existence of a specific processing mechanism for life motion signals and shed new light on their influences in a dynamic environment.

Life motion signals modulate visual working memory

Previous research has demonstrated that biological motion (BM) cues can induce a reflexive attentional orienting effect, a phenomenon referred to as social attention. However, it remains undetermined whether BM cues can further affect higher-order cognitive processes, such as visual working memory (WM). By combining a modified central pre-cueing paradigm with a traditional WM change detection task, the current study investigated whether the walking direction of BM, as a non-predictive central cue, could modulate the encoding process of WM. Results revealed a significant improvement in WM performance for the items appearing at the location cued by the walking direction of BM. The observed effect disappeared when the BM cues were shown inverted, or when the critical biological characteristics of the cues were removed. Crucially, this effect could be extended to upright feet motion cues without global configuration, reflecting the key role of local BM signals in modulating WM. More importantly, such a BM-induced modulation effect was not observed with inanimate motion cues, although these cues can also elicit attentional effects. Our findings suggest that the attentional effect induced by life motion signals can penetrate to higher-order cognitive processes, and provide compelling evidence for the existence of "life motion detector" in the human brain from a high-level cognitive function perspective.

Neural processing of bottom-up perception of biological motion under attentional load

Considering its importance for one's survival and social significance, biological motion (BM) perception is assumed to occur automatically. Previous behavioral results showed that task-irrelevant BM in the periphery interfered with task performance at the fovea. Under selective attention, BM perception is supported by a network of regions including the occipito-temporal (OTC), parietal, and premotor cortices. Retinotopy studies that use BM stimulus showed distinct maps for its processing under and away from selective attention. Based on these findings, we investigated how bottom-up perception of BM would be processed in the human brain under attentional load when it was shown away from the focus of attention as a task-irrelevant stimulus. Participants (N = 31) underwent an fMRI study in which they performed an attentionally demanding visual detection task at the fovea while intact or scrambled point light displays of BM were shown at the periphery. Our results showed the main effect of attentional load in fronto-parietal regions and both univariate activity maps and multivariate pattern analysis results support the attentional load modulation on the task-irrelevant peripheral stimuli. However, this effect was not specific to intact BM stimuli and was generalized to motion stimuli as evidenced by the motion-sensitive OTC involvement during the presence of dynamic stimuli in the periphery. These results confirm and extend previous work by showing that task-irrelevant distractors can be processed by stimulus-specific regions when there are enough attentional resources available. We discussed the implications of these results for future studies.

Following Other People's Footsteps: A Contextual-Attraction Effect Induced by Biological Motion

Our visual system is bombarded with numerous social interactions that form intangible social bonds among people, as exemplified by synchronized walking in crowds. Here, we investigated whether these perceived social bonds implicitly intrude on visual perception and induce a contextual effect. Using multiple point-light walkers and a classical contextual paradigm, we tested 72 college-age adults across six experiments and found that the perceived direction of the central walker was attracted toward the direction of the surrounding walkers. The observed contextual-attraction effect occurred even when the surrounding walkers differed from the central walker in gender and walking speed but disappeared when they were asynchronously presented or replaced by inanimate motion. Strikingly, this contextual-attraction effect partially persisted in the context of local motion rather than static figures. These findings, in contrast to the typical contextual-repulsion effect, lend support for the distinctiveness of perceived social bonds on contextual modulation and suggest a specialized contextual mechanism tuned to social factors.

Human-like behavioral variability blurs the distinction between a human and a machine in a nonverbal Turing test

Variability is a property of biological systems, and in animals (including humans), behavioral variability is characterized by certain features, such as the range of variability and the shape of its distribution. Nevertheless, only a few studies have investigated whether and how variability features contribute to the ascription of humanness to robots in a human-robot interaction setting. Here, we tested whether two aspects of behavioral variability, namely, the standard deviation and the shape of distribution of reaction times, affect the ascription of humanness to robots during a joint action scenario. We designed an interactive task in which pairs of participants performed a joint Simon task with an iCub robot placed by their side. Either iCub could perform the task in a preprogrammed manner, or its button presses could be teleoperated by the other member of the pair, seated in the other room. Under the preprogrammed condition, the iCub pressed buttons with reaction times falling within the range of human variability. However, the distribution of the reaction times did not resemble a human-like shape. Participants were sensitive to humanness, because they correctly detected the human agent above chance level. When the iCub was controlled by the computer program, it passed our variation of a nonverbal Turing test. Together, our results suggest that hints of humanness, such as the range of behavioral variability, might be used by observers to ascribe humanness to a humanoid robot.

Aesthetic preferences for causality in biological movements arise from visual processes

"People watching" is a ubiquitous component of human activities. An important aspect of such activities is the aesthetic experience that arises naturally from seeing how elegant people move their bodies in performing different actions. What makes some body movements look better than others? We examine how the human visual system gives rise to aesthetic experience from observing actions, using "creatures" generated by spatially scrambling locations of a point-light walker's joints. Observers rated how aesthetically pleasing and lifelike creatures were when the trajectories of joints were generated either from an upright walker (thus exhibiting gravitational acceleration) or an inverted walker (thus defying gravity), and were either congruent to the direction of global body displacements or incongruent (as in the moonwalk). Observers gave both higher aesthetic and animacy ratings for creatures with upright compared to inverted trajectories, and congruent compared to incongruent movements. Moreover, after controlling for animacy, aesthetic preferences for causally plausible movements (those in accord with gravity and body displacement) persisted. This systematicity in aesthetic impressions, even in the absence of explicit recognition of the moving agents, suggests an important role of automatic perceptual mechanisms in determining aesthetic experiences.

Bird expertise does not increase motion sensitivity to bird flight motion

While motion information is important for the early stages of vision, it also contributes to later stages of object recognition. For example, human observers can detect the presence of a human, judge its actions, and judge its gender and identity simply based on motion cues conveyed in a point-light display. Here we examined whether object expertise enhances the observer's sensitivity to its characteristic movement. Bird experts and novices were shown point-light displays of upright and inverted birds in flight, or upright and inverted human walkers, and asked to discriminate them from spatially scrambled point-light displays of the same stimuli. While the spatially scrambled stimuli retained the local motion of each dot of the moving objects, it disrupted the global percept of the object in motion. To estimate a detection threshold in each object domain, we systematically varied the number of noise dots in which the stimuli were embedded using an adaptive staircase approach. Contrary to our predictions, the experts did not show disproportionately higher sensitivity to bird motion, and both groups showed no inversion cost. However, consistent with previous work showing a robust inversion effect for human motion, both groups were more sensitive to upright human walkers than their inverted counterparts. Thus, the result suggests that real-world experience in the bird domain has little to no influence on the sensitivity to bird motion and that birds do not show the typical inversion effect seen with humans and other terrestrial movement.

Comparable search efficiency for human and animal targets in the context of natural scenes

In a previous series of studies, we have shown that search for human targets in the context of natural scenes is more efficient than search for mechanical targets. Here we asked whether this search advantage extends to other categories of biological objects. We used videos of natural scenes to directly contrast search efficiency for animal and human targets among biological or nonbiological distractors. In visual search arrays consisting of two, four, six, or eight videos, observers searched for animal targets among machine distractors, and vice versa (Exp. 1). Another group searched for animal targets among human distractors, and vice versa (Exp. 2). We measured search slope as a proxy for search efficiency, and complemented the slope with eye movement measurements (fixation duration on the target, as well as the proportion of first fixations landing on the target). In both experiments, we observed no differences in search slopes or proportions of first fixations between any of the target-distractor category pairs. With respect to fixation durations, we found shorter on-target fixations only for animal targets as compared to machine targets (Exp. 1). In summary, we did not find that the search advantage for human targets over mechanical targets extends to other biological objects. We also found no search advantage for detecting humans as compared to other biological objects. Overall, our pattern of findings suggests that search efficiency in natural scenes, as elsewhere, depends crucially on the specific target-distractor categories.

Ensemble coding of crowd speed using biological motion

The accurate perception of human crowds is integral to social understanding and interaction. Previous studies have shown that observers are sensitive to several crowd characteristics such as average facial expression, gender, identity, joint attention, and heading direction. In two experiments, we examined ensemble perception of crowd speed using standard point-light walkers (PLW). Participants were asked to estimate the average speed of a crowd consisting of 12 figures moving at different speeds. In Experiment 1, trials of intact PLWs alternated with trials of scrambled PLWs with a viewing duration of 3 seconds. We found that ensemble processing of crowd speed could rely on local motion alone, although a globally intact configuration enhanced performance. In Experiment 2, observers estimated the average speed of intact-PLW crowds that were displayed at reduced viewing durations across five blocks of trials (between 2500 ms and 500 ms). Estimation of fast crowds was precise and accurate regardless of viewing duration, and we estimated that three to four walkers could still be integrated at 500 ms. For slow crowds, we found a systematic deterioration in performance as viewing time reduced, and performance at 500 ms could not be distinguished from a single-walker response strategy. Overall, our results suggest that rapid and accurate ensemble perception of crowd speed is possible, although sensitive to the precise speed range examined.

Eriksen flanker delta plot shapes depend on the stimulus

Several experimental paradigms are purported to measure response conflict, including the Stroop, Simon, and Eriksen flanker tasks. Although these tasks are often treated as being similar, delta plot analyses of response time distributions have revealed marked differences across them. Several theories have been proposed to explain these differences, however, assessing their veracity is difficult given the numerous differences across tasks. To explore what might cause delta plots to differ in a more controlled manner, here stimulus materials were manipulated across four Eriksen flanker tasks. The results reveal substantially different delta plot shapes for different stimuli: positive-going functions when color or motion served as the target and flankers, and delta plots with negative-going components when stimuli were arrows or orientated gratings. These results cast doubt on the proposal that negative-going delta plots occur only when spatial location serves as the interfering stimulus dimension. Moreover, because targets and flankers were always of the same stimulus type, the results also suggest that differences in materials across the relevant and irrelevant dimensions do not determine delta plot shapes. Instead, we propose that the delta plot shape is determined by several factors, including how early the interfering information is processed in the visual cortex.

Exploring biological motion perception in two-stream convolutional neural networks

Visual recognition of biological motion recruits form and motion processes supported by both dorsal and ventral pathways. This neural architecture inspired the two-stream convolutional neural network (CNN) model, which includes a spatial CNN to process appearance information in a sequence of image frames, a temporal CNN to process optical flow information, and a fusion network to integrate the features extracted by the two CNNs and make final decisions about action recognition. In five simulations, we compared the CNN model's performance with classical findings in biological motion perception. The CNNs trained with raw RGB action videos showed weak performance in recognizing point-light actions. Additional transfer training with actions shown in other display formats (e.g., skeletal) was necessary for CNNs to recognize point-light actions. The CNN models exhibited largely viewpoint-dependent recognition of actions, with a limited ability to generalize to viewpoints close to the training views. The CNNs predicted the inversion effect in the presence of global body configuration, but failed to predict the inversion effect driven solely by local motion signals. The CNNs provided a qualitative account of some behavioral results observed in human biological motion perception for fine discrimination tasks with noisy inputs, such as point-light actions with disrupted local motion signals, and walking actions with temporally misaligned motion cues. However, these successes are limited by the CNNs' lack of adaptive integration for form and motion processes, and failure to incorporate specialized mechanisms (e.g., a life detector) as well as top-down influences on biological motion perception.

Visual attention, biological motion perception, and healthy ageing

Biological motion perception is the ability of the visual system to perceive complex human movement patterns. The previous studies have shown a direct link between attentional abilities and performance on biological motion tasks, both of which have been shown to deteriorate with age. However, it is not known whether there is a direct link between age-related deficits in biological motion processing and attention. Here, we investigated whether age-related changes in biological motion perception are mediated by impaired attentional abilities. To assess basic biological motion performance, we asked 42 younger (M = 21 years) and 39 older adults (M = 69 years) to indicate the facing direction of point-light actions. Performance did not differ between age groups. We assessed visual spatial and selective attentional abilities, using a range of tasks: conjunctive visual search, spatial cueing, and the Stroop task. Across all tasks, older adults were significantly slower to respond and exhibited larger interference/cueing effects, compared to younger adults. To assess attentional demands in relation with biological motion perception, participants performed a biological motion search task for which they had to indicate the presence of a target point-light walker among a varied number of distracters. Older adults were slower, and generally worse than younger adults at discriminating the walkers. Correlations showed that there was no significant relationship between performance in attention tasks and biological motion processing, which indicates that age-related changes in biological motion perception are unlikely to be driven by general attentional decline.

Heritability of reflexive social attention triggered by eye gaze and walking direction: common and unique genetic underpinnings

BACKGROUND

Social attention ability is crucial for human adaptive social behaviors and interpersonal communications, and the malfunction of which has been implicated in autism spectrum disorder (ASD), a highly genetic neurodevelopmental disorder marked by striking social deficits.

METHODS

Using a classical twin design, the current study investigated the genetic contribution to individual variation in social and non-social attention abilities, and further probed their potential genetic linkage. Moreover, individual autistic traits were further measured in an independent group of non-twin participants to examine the hypothetical link between the core social attention ability and ASD.

RESULTS

We found reliable genetic influences on the social attentional effects induced by two distinct cues (eye gaze and walking direction), with 91% of their covariance accounted for by common genetic effects. However, no evidence of heritability or shared genetic effects was observed for the attentional effect directed by a non-social cue (i.e. arrow direction) and its correlation with the social attention ability. Remarkably, one's autistic traits could well predict his/her heritable core social attention ability extracted from the conventional social attentional effect.

CONCLUSIONS

These findings together suggest that human social attention ability is supported by unique genetic mechanisms that can be shared across different social, but not non-social, processing. Moreover, they also encourage the identification of 'social attention genes' and highlight the critical role of the core human social attention ability in seeking the endophenotypes of social cognitive disorders including ASD.

The two-process theory of biological motion processing

Perception, identification, and understanding of others' actions from motion information are vital for our survival in the social world. A breakthrough in the understanding of action perception was the discovery that our visual system is sensitive to human action from the sparse motion input of only a dozen point lights, a phenomenon known as biological motion (BM) processing. Previous psychological and computational models cannot fully explain the emerging evidence for the existence of BM processing during early ontogeny. Here, we propose a two-process model of the mechanisms underlying BM processing. We hypothesize that the first system, the 'Step Detector,' rapidly processes the local foot motion and feet-below-the-body information that is specific to vertebrates, is less dependent on postnatal learning, and involves subcortical networks. The second system, the 'Bodily Action Evaluator,' slowly processes the fine global structure-from-motion, is specific to conspecific, and dependent on gradual learning processed in cortical networks. This proposed model provides new insight into research on the development of BM processing.

The Relationship between Biological Motion-Based Visual Consciousness and Attention: An Electroencephalograph Study

Understanding and predicting the intentions of others through limb movements are vital to social interaction. The processing of biological motion is unique from the processing of motion of inanimate objects. Presently, there is controversy over whether visual consciousness of biological motion is regulated by visual attention. In addition, the neural mechanisms involved in biological motion-related visual awareness are not known. In the current study, the relationship between visual awareness (aware vs unaware), represented by a point-light walker and biological-motion-based attention, manipulated by a difference in congruence (congruent, incongruent) between the direction of a pre-cue and that of biological motion was explored. The neural mechanisms involved in processing the stimuli were explored through electroencephalography. Both early (50-150 ms, 100-200 ms, and 174-226 ms after target presentation) and late (350-550 ms after target presentation) awareness-related neural processings were observed during a biological motion-based congruency task. Early processing was localized to occipital-parietal regions, such as the left postcentral gyrus, the left middle occipital gyrus, and the right precentral gyrus. In the 174-226-ms window, the activity in the occipital region was gradually replaced by activity in the parietal and frontal regions. Late processing was localized to frontal-parietal regions, such as the right dorsal superior frontal gyrus, the left medial superior frontal gyrus, and the occipito-temporal regions. Congruency-related processing occurred in the 246-260-ms window and was localized to the right superior occipital gyrus. In summary, due to its complexity, biological motion awareness has a unique neural basis.

Camouflage pattern features interact with movement speed to determine human target detectability

Applied ergonomics research examines not only the fit, form and function of military uniforms, but also their ability to effectively camouflage personnel as they perform job-related tasks. Many of these job-related tasks involve moving through environments, but existing literature examining camouflage effectiveness often assumes that movement effectively "breaks" even the best camouflage patterns, rendering them of limited utility for reducing the visual signature of a moving target. However, recent research demonstrates that animals equipped with adaptive camouflage change their patterning in predictable ways during movement and this adaptation decreases detectability, suggesting that uniform patterning may still hold value for reducing conspicuity during movement. The present experiment examined whether three visual pattern characteristics, local contrast, orientation, and spatial frequency, would influence the detectability of a moving human target. Participants attempted to detect and localize a simulated human target moving across a background scene, and a factorial design varied target movement speed, and the local contrast, spatial frequency, and orientation of its camouflage patterning. Results showed that target detectability was strongly influenced by target movement rate, pattern local contrast, and pattern spatial frequency, and these effects persisted even under conditions of very fast movement. Importantly, we found that the effect of local contrast was most robust under conditions of movement, suggesting its importance for reducing detectability of moving personnel. We conclude that movement is not always sufficient to break the concealment offered by a pattern with low contrast and a spatial frequency match with its background. Results are discussed in the context of visual processing theories and the application of these findings to the design and development of static and adaptive camouflage patterns for military personnel.

Visual salience and biological motion interact to determine camouflaged target detectability

Target visual salience and biological motion independently influence the accuracy and latency of observer detection. However, it is currently unknown how these target parameters might interact in modulating the detectability of camouflaged human targets. In two experiments, observers performed a visual target detection task. In a pilot experiment, observers detected a static human target with parametrically varied visual salience, superimposed on a complex background scene. As expected, results demonstrated varied target detectability as a function of salience, with observers showing higher hit rates and faster response times as a function of increased salience. In the Main Experiment, observers detected simulated human targets walking across a complex scene at five different speeds and three different levels of visual salience (as validated in the pilot experiment). We found strong effects of both movement rate and visual salience, and the two parameters interacted. Specifically, increasing the rate of biological motion increased detectability for even the least salient camouflage patterns. In other words, biological motion can "break" even the least conspicuous camouflage pattern. In contrast, a very salient pattern was highly detectable under static and moving conditions. Results are considered in relation to theories of camouflage detectability, and trade-offs between camouflage development efforts versus advanced training in military maneuvering.

Aberrant patterns of neural activity when perceiving emotion from biological motion in schizophrenia

Social perceptual deficits in schizophrenia are well established. Recent work suggests that the ability to extract social information from bodily cues is reduced in patients. However, little is known about the neurobiological mechanisms underlying this deficit. In the current study, 20 schizophrenia patients and 16 controls completed two tasks using point-light animations during fMRI: a basic biological motion task and an emotion in biological motion task. The basic biological motion task was used to localize activity in posterior superior temporal sulcus (pSTS), a critical region for biological motion perception. During the emotion in biological motion task, participants viewed brief videos depicting happiness, fear, anger, or neutral emotions and were asked to decide which emotion was portrayed. Activity in pSTS and amygdala was interrogated during this task. Results indicated that patients showed overall reduced activation compared to controls in pSTS and at a trend level in amygdala across emotions, despite similar task performance. Further, a functional connectivity analysis revealed that controls, but not patients, showed significant positive connectivity between pSTS and left frontal regions as well as bilateral angular gyrus during the emotion in biological motion task. These findings indicate that schizophrenia patients show aberrant neural activity and functional connectivity when extracting complex social information from simple motion stimuli, which may contribute to social perception deficits in this disorder.

•

Perception of social information from bodily cues is impaired in schizophrenia.

•

We examined neural correlates of perception of emotion from biological motion.

•

Activity in amygdala and posterior superior temporal sulcus was reduced in patients.

•

pSTS functional connectivity with frontal and parietal regions was reduced in patients.

•

Aberrant neural responses may contribute to social perceptual deficits in schizophrenia.

Action Recognition in a Crowded Environment

So far, action recognition has been mainly examined with small point-light human stimuli presented alone within a narrow central area of the observer's visual field. Yet, we need to recognize the actions of life-size humans viewed alone or surrounded by bystanders, whether they are seen in central or peripheral vision. Here, we examined the mechanisms in central vision and far periphery (40° eccentricity) involved in the recognition of the actions of a life-size actor (target) and their sensitivity to the presence of a crowd surrounding the target. In Experiment 1, we used an action adaptation paradigm to probe whether static or idly moving crowds might interfere with the recognition of a target's action (hug or clap). We found that this type of crowds whose movements were dissimilar to the target action hardly affected action recognition in central and peripheral vision. In Experiment 2, we examined whether crowd actions that were more similar to the target actions affected action recognition. Indeed, the presence of that crowd diminished adaptation aftereffects in central vision as wells as in the periphery. We replicated Experiment 2 using a recognition task instead of an adaptation paradigm. With this task, we found evidence of decreased action recognition accuracy, but this was significant in peripheral vision only. Our results suggest that the presence of a crowd carrying out actions similar to that of the target affects its recognition. We outline how these results can be understood in terms of high-level crowding effects that operate on action-sensitive perceptual channels.

Backward-walking biological motion orients attention to moving away instead of moving toward

Walking direction is an important attribute of biological motion because it carries key information, such as the specific intention of the walker. Although it is known that spatial attention is guided by walking direction, it remains unclear whether this attentional shift is reflexive (i.e., constantly shifts to the walking direction) or not. A richer interpretation of this effect is that attention is guided to seek the information that is necessary to understand the motion. To investigate this issue, we examined how backward-walking biological motion orients attention because the intention of walking backward is usually to avoid something that walking forward would encounter. The results showed that attention was oriented to the walking-away direction of biological motion instead of the walking-toward direction (Experiment 1), and this effect was not due to the gaze direction of biological motion (Experiment 2). Our findings suggest that the attentional shift triggered by walking direction is not reflexive, thus providing support for the rich interpretation of these attentional effects.

Biological motion distorts size perception

Visual illusions explore the limits of sensory processing and provide an ideal testbed to study perception. Size illusions - stimuli whose size is consistently misperceived - do not only result from sensory cues, but can also be induced by cognitive factors, such as social status. Here we investigate, whether the ecological relevance of biological motion can also distort perceived size. We asked observers to judge the size of point-light walkers (PLWs), configurations of dots whose movements induce the perception of human movement, and visually matched control stimuli (inverted PLWs). We find that upright PLWs are consistently judged as larger than inverted PLWs, while static point-light figures do not elicit the same effect. We also show the phenomenon using an indirect paradigm: observers judged the relative size of a disc that followed an inverted PLW larger than a disc following an upright PLW. We interpret this as a contrast effect: The upright PLW is perceived larger and thus the subsequent disc is judged smaller. Together, these results demonstrate that ecologically relevant biological-motion stimuli are perceived larger than visually matched control stimuli. Our findings present a novel case of illusory size perception, where ecological importance leads to a distorted perception of size.

The Importance of Spatiotemporal Information in Biological Motion Perception: White Noise Presented with a Step-like Motion Activates the Biological Motion Area

Humans can easily recognize the motion of living creatures using only a handful of point-lights that describe the motion of the main joints (biological motion perception). This special ability to perceive the motion of animate objects signifies the importance of the spatiotemporal information in perceiving biological motion. The posterior STS (pSTS) and posterior middle temporal gyrus (pMTG) region have been established by many functional neuroimaging studies as a locus for biological motion perception. Because listening to a walking human also activates the pSTS/pMTG region, the region has been proposed to be supramodal in nature. In this study, we investigated whether the spatiotemporal information from simple auditory stimuli is sufficient to activate this biological motion area. We compared spatially moving white noise, having a running-like tempo that was consistent with biological motion, with stationary white noise. The moving-minus-stationary contrast showed significant differences in activation of the pSTS/pMTG region. Our results suggest that the spatiotemporal information of the auditory stimuli is sufficient to activate the biological motion area.

Response Priming with More or Less Biological Movements as Primes

Response priming in general is a suitable tool in cognitive psychology to investigate motor preactivations. Typically, compatibility effects reflect faster reactions in cases in which prime and target suggest the same response (i.e., compatible trials) compared with cases in which prime and target suggest opposite responses (i.e., incompatible trials). With moving dots that were horizontally aligned, Bermeitinger (2013) found a stable pattern of results: with short SOAs, faster responses in compatible trials were found; with longer SOAs up to 250 ms, faster responses in incompatible trials were found. It is unclear whether these results are specific to the special motion used therein or whether it generalizes to other motions. We therefore used other motions realized by arrangements of dots. In four experiments, we tested point-light displays (biological coherent walkers vs. less biological scrambled/split displays) as primes. In two experiments, eye gaze motions realized by moving dots representing irises and pupils (i.e., biological) versus the same motion either without surrounding face information or integrated in an abstract line drawing (i.e., less biological) were used. We found overall large positive compatibility effects with biological motion primes and also positive-but smaller-compatibility effects with less biological motion primes. Most important, also with very long SOAs (up to 1320 ms), we did not find evidence for negative compatibility effects. Thus, the pattern of positive-followed-by-negative-compatibility effects found in Bermeitinger (2013) seems to be specific to the materials used therein, whereas response priming in general seems an applicable tool to study motion perception.

Embodied artificial agents for understanding human social cognition

In this paper, we propose that experimental protocols involving artificial agents, in particular the embodied humanoid robots, provide insightful information regarding social cognitive mechanisms in the human brain. Using artificial agents allows for manipulation and control of various parameters of behaviour, appearance and expressiveness in one of the interaction partners (the artificial agent), and for examining effect of these parameters on the other interaction partner (the human). At the same time, using artificial agents means introducing the presence of artificial, yet human-like, systems into the human social sphere. This allows for testing in a controlled, but ecologically valid, manner human fundamental mechanisms of social cognition both at the behavioural and at the neural level. This paper will review existing literature that reports studies in which artificial embodied agents have been used to study social cognition and will address the question of whether various mechanisms of social cognition (ranging from lower- to higher-order cognitive processes) are evoked by artificial agents to the same extent as by natural agents, humans in particular. Increasing the understanding of how behavioural and neural mechanisms of social cognition respond to artificial anthropomorphic agents provides empirical answers to the conundrum 'What is a social agent?'

Do People "Pop Out"?

The human body is a highly familiar and socially very important object. Does this mean that the human body has a special status with respect to visual attention? In the current paper we tested whether people in natural scenes attract attention and “pop out” or, alternatively, are at least searched for more efficiently than targets of another category (machines). Observers in our study searched a visual array for dynamic or static scenes containing humans amidst scenes containing machines and vice versa. The arrays consisted of 2, 4, 6 or 8 scenes arranged in a circular array, with targets being present or absent. Search times increased with set size for dynamic and static human and machine targets, arguing against pop out. However, search for human targets was more efficient than for machine targets as indicated by shallower search slopes for human targets. Eye tracking further revealed that observers made more first fixations to human than to machine targets and that their on-target fixation durations were shorter for human compared to machine targets. In summary, our results suggest that searching for people in natural scenes is more efficient than searching for other categories even though people do not pop out.

What can fish brains tell us about visual perception?

Fish are a complex taxonomic group, whose diversity and distance from other vertebrates well suits the comparative investigation of brain and behavior: in fish species we observe substantial differences with respect to the telencephalic organization of other vertebrates and an astonishing variety in the development and complexity of pallial structures. We will concentrate on the contribution of research on fish behavioral biology for the understanding of the evolution of the visual system. We shall review evidence concerning perceptual effects that reflect fundamental principles of the visual system functioning, highlighting the similarities and differences between distant fish groups and with other vertebrates. We will focus on perceptual effects reflecting some of the main tasks that the visual system must attain. In particular, we will deal with subjective contours and optical illusions, invariance effects, second order motion and biological motion and, finally, perceptual binding of object properties in a unified higher level representation.

Developmental tuning of reflexive attentional effect to biological motion cues

The human visual system is extremely sensitive to the direction information retrieved from biological motion. In the current study, we investigate the functional impact of this sensitivity on attentional orienting in young children. We found that children as early as 4 years old, like adults, showed a robust reflexive attentional orienting effect to the walking direction of an upright point-light walker, indicating that biological motion signals can automatically direct spatial attention at an early age. More importantly, the inversion effect associated with attentional orienting emerges by 4 years old and gradually develops into a similar pattern found in adults. These results provide strong evidence that biological motion cues can guide the distribution of spatial attention in young children, and highlight a critical development from a broadly- to finely-tuned process of utilizing biological motion cues in the human social brain.

A biological walker is faster and better recognized when aligned with body axis observer

The representation of the vertical direction is a compromise between the directions given by the egocentric and allocentric references. Dissociations between these two referentials in the discrimination of a biological walker which typically refers to a model of verticality questions the coordinate system (allocentric and/or egocentric) used to perceive it. With a point-light display paradigm, the characteristics of an artificial walking pattern were manipulated in order to offer to 10 healthy participants (5 men/5 women; 24.6±3.4 years) a female or male locomotion which had to be identified as such. The body position of the viewer (sitting/lying) and the walking pattern viewed (aligned/rotated in relation to the egocentric referential) were crossed. Three indices were analyzed and 200 trials recorded: percentage of correct identification, reaction time and confidence score. This paper confirms the validity of the walking pattern model since the more pronounced the gradient of the walking pattern (as female or male) the better the recognition. Furthermore, whatever the body position, artificial walking patterns were more easily identified when they were aligned with the egocentric referential rather than tilted. The participant gender had no influence on the walking pattern recognition. We conclude that the perception of a biological walker referenced to the vertical is exclusively improved by a representation of the spatial information in an egocentric coordinate system.

The feet have it: local biological motion cues trigger reflexive attentional orienting in the brain

Most vertebrates, humans included, have a primitive visual system extremely sensitive to the motion of biological entities. Most previous studies have examined the global aspects of biological motion perception, but local motion processing has received much less attention. Here we provide direct psychophysical and electrophysiological evidence that human observers are intrinsically tuned to the characteristics of local biological motion cues independent of global configuration. Using a modified central cueing paradigm, we show that observers involuntarily orient their attention towards the walking direction of feet motion sequences, which triggers an early directing attention negativity (EDAN) in the occipito-parietal region 100-160ms after the stimulus onset. Notably, such effects are sensitive to the orientation of the local cues and are independent of whether the observers are aware of the biological nature of the motion. Our findings unambiguously demonstrate the automatic processing of local biological motion without explicit recognition. More importantly, with the discovery that local biological motion signals modulate attention, we highlight the functional importance of such processing in the brain.

Interobject spacing explains the attentional bias toward interacting objects

Spatio-temporal interactions between simple geometrical shapes typically elicit strong impressions of intentionality. Recent research has started to explore the link between attentional processes and the detection of interacting objects. Here, we asked whether visual attention is biased toward such interactions. We investigated probe discrimination performance in algorithmically generated animations that involved two chasing objects and two randomly moving objects. In Experiment 1, we observed a pronounced attention capture effect for chasing objects. Because reduced interobject spacing is an inherent feature of interacting objects, in Experiment 2 we designed randomly moving objects that were matched to the chasing objects with respect to interobject spacing at probe onset. In this experiment, the capture effect attenuated completely. Therefore, we argue that reduced interobject spacing reflects an efficient cue to guide visual attention toward objects that interact intentionally.

Speed of human biological form and motion processing

Recent work suggests that biological motion processing can begin within ~110 ms of stimulus onset, as indexed by the P1 component of the event-related potential (ERP). Here, we investigated whether modulation of the P1 component reflects configural processing alone, rather than the processing of both configuration and motion cues. A three-stimulus oddball task was employed to evaluate bottom-up processing of biological motion. Intact point-light walkers (PLWs) or scrambled PLWs served as distractor stimuli, whereas point-light displays of tool motion served as standard and target stimuli. In a second experiment, the same design was used, but the dynamic stimuli were replaced with static point-light displays. The first experiment revealed that dynamic PLWs elicited a larger P1 as compared to scrambled PLWs. A similar P1 increase was also observed for static PLWs in the second experiment, indicating that these stimuli were more salient than static, scrambled PLWs. These findings suggest that the visual system can rapidly extract global form information from static PLWs and that the observed P1 effect for dynamic PLWs is not dependent on the presence of motion cues. Finally, we found that the N1 component was sensitive to dynamic, but not static, PLWs, suggesting that this component reflects the processing of both form and motion information. The sensitivity of P1 to static PLWs has implications for dynamic form models of biological motion processing that posit temporal integration of configural cues present in individual frames of PLW animations.

Sensing, assessing, and augmenting threat detection: behavioral, neuroimaging, and brain stimulation evidence for the critical role of attention

Rapidly identifying the potentially threatening movements of other people and objects—biological motion perception and action understanding—is critical to maintaining security in many civilian and military settings. A key approach to improving threat detection in these environments is to sense when less than ideal conditions exist for the human observer, assess that condition relative to an expected standard, and if necessary use tools to augment human performance. Action perception is typically viewed as a relatively “primitive,” automatic function immune to top-down effects. However, recent research shows that attention is a top-down factor that has a critical influence on the identification of threat-related targets. In this paper we show that detection of motion-based threats is attention sensitive when surveillance images are obscured by other movements, when they are visually degraded, when other stimuli or tasks compete for attention, or when low-probability threats must be watched for over long periods of time—all features typical of operational security settings. Neuroimaging studies reveal that action understanding recruits a distributed network of brain regions, including the superior temporal cortex, intraparietal cortex, and inferior frontal cortex. Within this network, attention modulates activation of the superior temporal sulcus (STS) and middle temporal gyrus. The dorsal frontoparietal network may provide the source of attention-modulation signals to action representation areas. Stimulation of this attention network should therefore enhance threat detection. We show that transcranial Direct Current Stimulation (tDCS) at 2 mA accelerates perceptual learning of participants performing a challenging threat-detection task. Together, cognitive, neuroimaging, and brain stimulation studies provide converging evidence for the critical role of attention in the detection and understanding of threat-related intentional actions.

Impaired global, and compensatory local, biological motion processing in people with high levels of autistic traits

People with Autism Spectrum Disorder (ASD) are hypothesized to have poor high-level processing but superior low-level processing, causing impaired social recognition, and a focus on non-social stimulus contingencies. Biological motion perception provides an ideal domain to investigate exactly how ASD modulates the interaction between low and high-level processing, because it involves multiple processing stages, and carries many important social cues. We investigated individual differences among typically developing observers in biological motion processing, and whether such individual differences associate with the number of autistic traits. In Experiment 1, we found that individuals with fewer autistic traits were automatically and involuntarily attracted to global biological motion information, whereas individuals with more autistic traits did not show this pre-attentional distraction. We employed an action adaptation paradigm in the second study to show that individuals with more autistic traits were able to compensate for deficits in global processing with an increased involvement in local processing. Our findings can be interpreted within a predictive coding framework, which characterizes the functional relationship between local and global processing stages, and explains how these stages contribute to the perceptual difficulties associated with ASD.

Bodily movement of approach is detected faster than that of receding

The human visual system is efficient at detecting an approaching object. In detecting approaching human beings, bodily movement serves as a cue for the visual system to compute moving direction. On the basis of this knowledge, we hypothesized that bodily movement implying approach is detected faster than receding bodily movement even when only bodily movement is available as a clue to discerning motion direction. To examine this hypothesis, we conducted a visual search experiment in which participants searched for a point-light figure with approaching or receding walking movement. Results showed that an approaching point-light figure was detected faster than a receding one. This search asymmetry was eliminated when the figures were presented upside-down. These findings indicate the potency of bodily movement that implies approach in effectively capturing visuospatial attention.

Discrimination between biological motion with and without social intention: a pilot study using visual scanning in healthy adults

Human beings have a detailed understanding of others' action and body language allowing them to adapt their behaviour for effective social interaction. A proper selection of human motion deserving a social intention over the many human motion surrounding them may be executed by overt visual-spatial attention. The aim of this study was to characterize eye movements in 32 healthy adults while exploring Social and Non-social human biological motion using an eye tracking method according to two paradigms. The "preferential looking paradigm" revealed that the first fixation is more often on the Non-social Motion than Social Motion but the first fixations duration are longer on Social Motion. Moreover, with the same paradigm, subjects spent a greater looking time percentage on Social Motion than Non-social Motion, no matter whether discrimination between categories was asked for or not. In the "blocks paradigm" the looking time percentage varied by the body parts (chests, pelvis and legs) and its distribution was different between categories. Eye movements revealed a spontaneous, fast and durable bias of overt visual-spatial attention favouring the perception of Social Motion and a different visual scanpath for Social compared to Non-social human biological motion. These findings constitute a basis for the investigation of a 'social intention' bias in perception of human biological motion.

Stimulus complexity modulates contrast response functions in the human middle temporal area (hMT+)

The brain systems that support motion perception are some of the most studied in the primate visual system, with apparent specialization in the middle temporal area (hMT+ in humans, MT or V5 in monkeys). Even with this specialization, it is safe to assume that the hMT+ interacts with other brain systems as visual tasks demand. Here we have measured those interactions using a specialized case of structure-from-motion, point-light biological motion. We have measured the BOLD-contrast response functions in hMT+ for translating and biological motion. Even after controlling for task and attention, we find the BOLD response for translating motion to be largely insensitive to contrast, but the BOLD response for biological motion to be strongly contrast dependent. To track the brain systems involved in these interactions, we probed for brain areas outside of the hMT+ with the same contrast dependent neural response. This analysis revealed brain systems known to support form perception (including ventral temporal cortex and the superior temporal sulcus). We conclude that the contrast dependent response in hMT+ likely reflects stimulus complexity, and may be evidence for interactions with shape-based brain systems.

Perceptual wholes can reduce the conscious accessibility of their parts

Humans can rapidly extract object and category information from an image despite surprising limitations in detecting changes to the individual parts of that image. In this article we provide evidence that the construction of a perceptual whole, or Gestalt, reduces awareness of changes to the parts of this object. This result suggests that the rapid extraction of a perceptual Gestalt, and the inaccessibility of the parts that make up that Gestalt, may in fact reflect two sides of the same coin whereby human vision provides only the most useful level of abstraction to conscious awareness.

PERCEPTION OF HUMANOID MOVEMENT

With the ultimate goal of producing natural-looking movements in humanoid robots and virtual humans, we examined the visual perception of movements generated by different models of movement generation. The models of movement generation included 14 synthetic motion generation algorithms based on theories of human motor production. In addition, we obtained motion from recordings of actual human movement. The resulting movements were applied to both a humanoid robot and a computer graphics virtual human. The computational efficiency of the motion production algorithms is described. In Experiment 1, we examined observers' judgments of the naturalness of a movement. Results showed that, for the humanoid robot, low ratings of naturalness were obtained for rapid movement. In addition, it was found that some movements that appeared to have unremarkable naturalness ratings were anomalous examples of the desired movement. In Experiment 2, we used naturalness ratings to study the influence of movement speed on the humanoid robot. Results indicated that the decrease in naturalness was due to motion artifacts at the ends of the movement. In Experiment 3, we returned to the issue of anomalous movements by obtaining ratings of similarity between pairs of movements, and analyzing these with multi-dimensional scaling to obtain a psychological space representation of the set of movements. Results showed that the presumed anomalous movements were indeed distinctive from the other movements, suggesting that the naturalness judgments did not completely indicate the perception of movement. We discuss these results in the context of what they suggest for the relative effectiveness of the different generation algorithms at producing natural movement, and their relative computational efficiency, as well as in terms of the effectiveness of different psychological techniques for the assessment of humanoid movement.

Attention, biological motion, and action recognition

Interacting with others in the environment requires that we perceive and recognize their movements and actions. Neuroimaging and neuropsychological studies have indicated that a number of brain regions, particularly the superior temporal sulcus, are involved in a number of processes essential for action recognition, including the processing of biological motion and processing the intentions of actions. We review the behavioral and neuroimaging evidence suggesting that while some aspects of action recognition might be rapid and effective, they are not necessarily automatic. Attention is particularly important when visual information about actions is degraded or ambiguous, or if competing information is present. We present evidence indicating that neural responses associated with the processing of biological motion are strongly modulated by attention. In addition, behavioral and neuroimaging evidence shows that drawing inferences from the actions of others is attentionally demanding. The role of attention in action observation has implications for everyday social interactions and workplace applications that depend on observing, understanding and interpreting actions.

The neurophysiology of human biological motion processing: a high-density electrical mapping study

The neural processing of biological motion (BM) is of profound experimental interest since it is often through the movement of another that we interpret their immediate intentions. Neuroimaging points to a specialized cortical network for processing biological motion. Here, high-density electrical mapping and source-analysis techniques were employed to interrogate the timing of information processing across this network. Participants viewed point-light-displays depicting standard body movements (e.g. jumping), while event-related potentials (ERPs) were recorded and compared to ERPs to scrambled motion control stimuli. In a pair of experiments, three major phases of BM-specific processing were identified: 1) The earliest phase of BM-sensitive modulation was characterized by a positive shift of the ERP between 100 and 200 ms after stimulus onset. This modulation was observed exclusively over the right hemisphere and source-analysis suggested a likely generator in close proximity to regions associated with general motion processing (KO/hMT). 2) The second phase of BM-sensitivity occurred from 200 to 350 ms, characterized by a robust negative-going ERP modulation over posterior middle temporal regions bilaterally. Source-analysis pointed to bilateral generators at or near the posterior superior temporal sulcus (STS). 3) A third phase of processing was evident only in our second experiment, where participants actively attended the BM aspect of the stimuli, and was manifest as a centro-parietal positive ERP deflection, likely related to later cognitive processes. These results point to very early sensory registration of biological motion, and highlight the interactive role of the posterior STS in analyzing the movements of other living organisms.