Orientation specificity in biological motion perception

The dual nature of working memory deficits: methamphetamine abusers have more impaired social working memory capacity than canonical working memory capacity

Social working memory (WM) temporarily retains and manipulates various aspects of social information. Extensive research has highlighted impaired social cognitive functions in individuals with substance addiction. However, the specific deficit in social WM within this population remains notably understudied. Bridging this gap, we investigated social WM capacity using biological motion (BM) stimuli in methamphetamine (MA) abusers compared to an inmate control group, alongside contrasting these findings with their canonical WM deficits. Across two studies, we recruited female MA abusers (N = 80) undergoing post-isolation rehabilitation within a mandatory confinement circumstance. To ensure a pertinent comparison, we recruited female inmates (N = 80) subjected to comparable confinement. Results show substantial BM WM impairment in MA abusers, yet non-BM WM remains mostly intact. These findings highlight a pronounced social WM deficit in MA abusers, surpassing their canonical WM deficit relative to inmate controls. This suggests a distinct dissociation between social and canonical WM processing.

Eye pupil signals life motion perception

The ability to readily detect and recognize biological motion (BM) is fundamental to survival and interpersonal communication. However, perception of BM is strongly disrupted when it is shown upside down. This well-known inversion effect is proposed to be caused by a life motion detection mechanism highly tuned to gravity-compatible motion cues. In the current study, we assessed the inversion effect in BM perception using a no-report pupillometry. We found that the pupil size was significantly enlarged when observers viewed upright BMs (gravity-compatible) compared with the inverted counterparts (gravity-incompatible). Importantly, such an effect critically depended on the dynamic biological characteristics, and could be extended to local feet motion signals. These findings demonstrate that the eye pupil can signal gravity-dependent life motion perception. More importantly, with the convenience, objectivity, and noninvasiveness of pupillometry, the current study paves the way for the potential application of pupillary responses in detecting the deficiency of life motion perception in individuals with socio-cognitive disorders.

Recognition of humans from biological motion in infants

Infant studies have suggested that the detection of biological motion (BM) might be an innate capacity, based on newborns' spontaneous preference for BM. However, it is unclear if, like adults, infants recognize humans from BM and are able to build the representation of bodies and faces. To address this issue, we tested whether exposure to BM influences subsequent face recognition in 3- to 8-month-old infants. After familiarization with a point-light walker (PLW) of either a female or a male, the infant's preference for female and male faces was measured. If infants can build the representation of not only the body but also the face from PLWs, the familiarization effect of gender induced by the PLW might be generalized to faces. We found that infants at 7 to 8 months looked for longer at the face whose gender was opposite to that of the PLW, whereas 3- to 4- and 5- to 6-month-old infants did not. These results suggest that infants can access the representation of humans from BM and extract gender, which is shared across bodies and faces, from at least 7 to 8 months of age.

Cues for predictive eye movements in naturalistic scenes

We previously compared following of the same trajectories with eye movements, but either as an isolated targets or embedded in a naturalistic scene-in this case, the movement of a puck in an ice hockey game. We observed that the oculomotor system was able to leverage the contextual cues available in the naturalistic scene to produce predictive eye movements. In this study, we wanted to assess which factors are critical for achieving this predictive advantage by manipulating four factors: the expertise of the viewers, the amount of available peripheral information, and positional and kinematic cues. The more peripheral information became available (by manipulating the area of the video that was visible), the better the predictions of all observers. However, expert ice hockey fans were consistently better at predicting than novices and used peripheral information more effectively for predictive saccades. Artificial cues about player positions did not lead to a predictive advantage, whereas impairing the causal structure of kinematic cues by playing the video in reverse led to a severe impairment. When videos were flipped vertically to introduce more difficult kinematic cues, predictive behavior was comparable to watching the original videos. Together, these results demonstrate that, when contextual information is available in naturalistic scenes, the oculomotor system is successfully integrating them and is not relying only on low-level information about the target trajectory. Critical factors for successful prediction seem to be the amount of available information, experience with the stimuli, and the availability of intact kinematic cues for player movements.

Representational momentum of biological motion in full-body, point-light and single-dot displays

Observing the actions of others triggers, in our brain, an internal and automatic simulation of its unfolding in time. Here, we investigated whether the instantaneous internal representation of an observed action is modulated by the point of view under which an action is observed and the stimulus type. To this end, we motion captured the elliptical arm movement of a human actor and used these trajectories to animate a photorealistic avatar, a point-light stimulus or a single dot rendered either from an egocentric or an allocentric point of view. Crucially, the underlying physical characteristics of the movement were the same in all conditions. In a representational momentum paradigm, we then asked subjects to report the perceived last position of an observed movement at the moment in which the stimulus was randomly stopped. In all conditions, subjects tended to misremember the last configuration of the observed stimulus as being further forward than the veridical last showed position. This misrepresentation was however significantly smaller for full-body stimuli compared to point-light and single dot displays and it was not modulated by the point of view. It was also smaller when first-person full body stimuli were compared with a stimulus consisting of a solid shape moving with the same physical motion. We interpret these findings as evidence that full-body stimuli elicit a simulation process that is closer to the instantaneous veridical configuration of the observed movements while impoverished displays (both point-light and single-dot) elicit a prediction that is further forward in time. This simulation process seems to be independent from the point of view under which the actions are observed.

Atypical development of social and nonsocial working memory capacity among preschoolers with autism spectrum disorders

Individuals with autism spectrum disorders (ASD) have shown impaired performance in canonical and nonsocial working memory (WM). However, no study has investigated social WM and its early development. Using biological motion stimuli, our study assessed the development of social and nonsocial WM capacity among children with or without ASD across the age span between 4 and 6 (N = 150). While typically developing (TD) children show a rapid development from age 5 to 6, children with ASD showed a delayed development for both social and nonsocial WM capacity, reaching a significant group difference at age 6. Furthermore, we found a negative correlation between social (but not nonsocial) WM capacity and the severity of autistic symptoms among children with ASD. In contrast, there is a positive correlation between both types of WM capacity and intelligence among TD children but not among children with ASD. Our findings thus indicate that individuals with ASD miss the rapid development of WM capacity in early childhood and, particularly, their delayed social WM development might contribute to core symptoms that critically depend on social information processing.

Using EEG movement tagging to isolate brain responses coupled to biological movements

Detecting biological motion is essential for adaptive social behavior. Previous research has revealed the brain processes underlying this ability. However, brain activity during biological motion perception captures a multitude of processes. As a result, it is often unclear which processes reflect movement processing and which processes reflect secondary processes that build on movement processing. To address this issue, we developed a new approach to measure brain responses directly coupled to observed movements. Specifically, we showed 30 male and female adults a point-light walker moving at a pace of 2.4 Hz and used EEG frequency tagging to measure the brain response coupled to that pace ('movement tagging'). The results revealed a reliable response at the walking frequency that was reduced by two manipulations known to disrupt biological motion perception: phase scrambling and inversion. Interestingly, we also identified a brain response at half the walking frequency (i.e., 1.2 Hz), corresponding to the rate at which the individual dots completed a cycle. In contrast to the 2.4 Hz response, the response at 1.2 Hz was increased for scrambled (vs. unscrambled) walkers. These results show that frequency tagging can be used to capture the visual processing of biological movements and can dissociate between global (2.4 Hz) and local (1.2 Hz) processes involved in biological motion perception, at different frequencies of the brain signal.

Extended visuomotor experience with inverted movements can overcome the inversion effect in biological motion perception

Studies have demonstrated that perceiving human and animal movements as point-light displays is effortless. However, simply inverting the display can significantly impair this ability. Compared to non-dancers and typical dancers, vertical dancers have the unique experience of observing and performing movements upside down as being suspended in the air. We studied whether this unique visuomotor experience makes them better at perceiving the inverted movements. We presented ten pairs of dance movements as point-light displays. Each pair included a version performed on the ground whereas the other was in the air. We inverted the display in half of the trials and asked vertical dancers, typical dancers, and non-dancers about whether the display was inverted. We found that only vertical dancers, who have extended visual and motor experience with the configural and dynamic information of the movements, could identify the inversion of movements performed in the air. Neither typical dancers nor non-dancers, who have no motor experience with performing the inverted movements, could detect the inversion. Our findings suggest that motor experience plays a more critical role in enabling the observers to use dynamic information for identifying artificial inversion in biological motion.

Attentional influences on neural processing of biological motion in typically developing children and those on the autism spectrum

BACKGROUND

Biological motion imparts rich information related to the movement, actions, intentions and affective state of others, which can provide foundational support for various aspects of social cognition and behavior. Given that atypical social communication and cognition are hallmark symptoms of autism spectrum disorder (ASD), many have theorized that a potential source of this deficit may lie in dysfunctional neural mechanisms of biological motion processing. Synthesis of existing literature provides some support for biological motion processing deficits in autism spectrum disorder, although high study heterogeneity and inconsistent findings complicate interpretation. Here, we attempted to reconcile some of this residual controversy by investigating a possible modulating role for attention in biological motion processing in ASD.

METHODS

We employed high-density electroencephalographic recordings while participants observed point-light displays of upright, inverted and scrambled biological motion under two task conditions to explore spatiotemporal dynamics of intentional and unintentional biological motion processing in children and adolescents with ASD (n = 27), comparing them to a control cohort of neurotypical (NT) participants (n = 35).

RESULTS

Behaviorally, ASD participants were able to discriminate biological motion with similar accuracy to NT controls. However, electrophysiologic investigation revealed reduced automatic selective processing of upright biologic versus scrambled motion stimuli in ASD relative to NT individuals, which was ameliorated when task demands required explicit attention to biological motion. Additionally, we observed distinctive patterns of covariance between visual potentials evoked by biological motion and functional social ability, such that Vineland Adaptive Behavior Scale-Socialization domain scores were differentially associated with biological motion processing in the N1 period in the ASD but not the NT group.

LIMITATIONS

The cross-sectional design of this study does not allow us to definitively answer the question of whether developmental differences in attention to biological motion cause disruption in social communication, and the sample was limited to children with average or above cognitive ability.

CONCLUSIONS

Together, these data suggest that individuals with ASD are able to discriminate, with explicit attention, biological from non-biological motion but demonstrate diminished automatic neural specificity for biological motion processing, which may have cascading implications for the development of higher-order social cognition.

Human (but not animal) motion can be recognized at first sight - After treatment for congenital blindness

The long-standing nativist vs. empiricist debate asks a foundational question in epistemology - does our knowledge arise through experience or is it available innately? Studies that probe the sensitivity of newborns and patients recovering from congenital blindness are central in informing this dialogue. One of the most robust sensitivities our visual system possesses is to 'biological motion' - the movement patterns of humans and other vertebrates. Various biological motion perception skills (such as distinguishing between movement of human and non-human animals, or between upright and inverted human movement) become evident within the first months of life. The mechanisms of acquiring these capabilities, and specifically the contribution of visual experience to their development, are still under debate. We had the opportunity to directly examine the role of visual experience in biological motion perception, by testing what level of sensitivity is present immediately upon onset of sight following years of congenital visual deprivation. Two congenitally blind patients who underwent sight-restorative cataract-removal surgery late in life (at the ages of 7 and 20 years) were tested before and after sight restoration. The patients were shown displays of walking humans, pigeons, and cats, and asked to describe what they saw. Visual recognition of movement patterns emerged immediately upon eye-opening following surgery, when the patients spontaneously began to identify human, but not animal, biological motion. This recognition ability was evident contemporaneously for upright and inverted human displays. These findings suggest that visual recognition of human motion patterns may not critically depend on visual experience, as it was evident upon first exposure to un-obstructed sight in patients with very limited prior visual exposure, and furthermore, was not limited to the typical (upright) orientation of humans in real-life settings.

Modulation of biological motion perception in humans by gravity

The human visual perceptual system is highly sensitive to biological motion (BM) but less sensitive to its inverted counterpart. This perceptual inversion effect may stem from our selective sensitivity to gravity-constrained life motion signals and confer an adaptive advantage to creatures living on Earth. However, to what extent and how such selective sensitivity is shaped by the Earth's gravitational field is heretofore unexplored. Taking advantage of a spaceflight experiment and its ground-based analog via 6° head-down tilt bed rest (HDTBR), we show that prolonged microgravity/HDTBR reduces the inversion effect in BM perception. No such change occurs for face perception, highlighting the particular role of gravity in regulating kinematic motion analysis. Moreover, the reduced BM inversion effect is associated with attenuated orientation-dependent neural responses to BM rather than general motion cues and correlated with strengthened functional connectivity between cortical regions dedicated to visual BM processing (i.e., pSTS) and vestibular gravity estimation (i.e., insula). These findings suggest that the neural computation of gravity may act as an embodied constraint, presumably implemented through visuo-vestibular interaction, to sustain the human brain's selective tuning to life motion signals.

Making heads or tails of body inversion effects: Do heads matter?

Observers are better at discriminating upright bodies than inverted bodies, and this body inversion effect (BIE) is reliable with whole figures (bodies with heads), but not with bodies presented without heads or the heads occluded suggesting that heads may be key to BIEs. Some studies present whole figures and bodies without heads between groups, and BIEs are not found for bodies without heads [1]. Other studies present whole figures and bodies without heads in the same blocks and BIEs are found with bodies without heads [2]. Does seeing the heads of whole figures induce BIEs in bodies without heads? Here, participants discriminated bodies with either whole figures and bodies without heads presented within blocks, or in separate blocks with bodies without heads presented first. We tested body identity and posture discrimination and measured participants’ gaze. BIEs were found with whole figures and bodies without heads in both identity and posture discrimination, and in both study designs. However, efficiency scores were better for the whole figures than the bodies without heads, but only when whole figures appeared in separate blocks. The magnitude of the BIE was overall stronger for whole figures compared to bodies without heads, but only in identity discrimination. BIE magnitudes were similar in the identity and posture tasks. Participants were better at identity discrimination, yet, there was greater looking at heads and less at bodies. During posture discrimination, greater looking at bodies and less at heads was associated with better performance. Faces might influence BIEs but are not essential. Configural representations of bodies without heads are sufficient for BIEs in posture and identity discrimination.

Distinct cerebellar regions for body motion discrimination

Visual processing of human movements is critical for adaptive social behavior. Cerebellar activations have been observed during biological motion discrimination in prior neuroimaging studies, and cerebellar lesions may be detrimental for this task. However, whether the cerebellum plays a causal role in biological motion discrimination has never been tested. Here, we addressed this issue in three different experiments by interfering with the posterior cerebellar lobe using transcranial magnetic stimulation (TMS) during a biological discrimination task. In Experiments 1 and 2, we found that TMS delivered at onset of the visual stimuli over the vermis (vermal lobule VI), but not over the left cerebellar hemisphere (left lobule VI/Crus I), interfered with participants' ability to distinguish biological from scrambled motion compared to stimulation of a control site (vertex). Interestingly, when stimulation was delivered at a later time point (300 ms after stimulus onset), participants performed worse when TMS was delivered over the left cerebellar hemisphere compared to the vermis and the vertex (Experiment 3). Our data show that the posterior cerebellum is causally involved in biological motion discrimination and suggest that different sectors of the posterior cerebellar lobe may contribute to the task at different time points.

Varying Degrees of Perception-Action Coupling and Anticipation in Handball Goalkeeping

Anticipation in sports is commonly investigated using perception-action uncoupled methods, thus raising questions regarding transferability of findings to the field. The aim of this study was to investigate the influence of different degrees of perception-action coupling on anticipation in handball goalkeeping. Advanced, intermediate and novice handball goalkeepers watched videos of throws on the goal and were asked to anticipate throw direction via key press (perception-action artificial condition) and via natural movement response (perception-action simulated condition). Results reveal overall superior performance in the artificial compared to the simulated condition. Skill-based differences, however, were descriptively more pronounced in the simulated condition compared to the artificial condition. The findings further highlight the importance of more representative research methods to unravel perceptual-cognitive skill in sports.

Linguistic labels cue biological motion perception and misperception

Linguistic labels exert a particularly strong top-down influence on perception. The potency of this influence has been ascribed to their ability to evoke category-diagnostic features of concepts. In doing this, they facilitate the formation of a perceptual template concordant with those features, effectively biasing perceptual activation towards the labelled category. In this study, we employ a cueing paradigm with moving, point-light stimuli across three experiments, in order to examine how the number of biological motion features (form and kinematics) encoded in lexical cues modulates the efficacy of lexical top-down influence on perception. We find that the magnitude of lexical influence on biological motion perception rises as a function of the number of biological motion-relevant features carried by both cue and target. When lexical cues encode multiple biological motion features, this influence is robust enough to mislead participants into reporting erroneous percepts, even when a masking level yielding high performance is used.

Dogs fail to recognize a human pointing gesture in two-dimensional depictions of motion cues

Few studies have investigated biological motion perception in dogs and it remains unknown whether dogs recognise the biological identity of two-dimensional animations of human motion cues. To test this, we assessed the dogs' (N = 32) responses to point-light displays of a human performing a pointing gesture towards one of two pots. At the start of the experiment the demonstrator was a real-life person, but over the course of the test dogs were presented with two-dimensional figurative representations of pointing gestures in which visual information was progressively removed until only the isolated motion cues remained. Dogs' accuracy was above chance level only with real-life and black-and-white videos, but not with the silhouette or the point-light figure. Dogs' accuracy during these conditions was significantly lower than in the real-life condition. This result could not be explained by trial order since dogs' performance was still not higher than chance when only the point-light figure condition was presented after the initial demonstration. The results imply that dogs are unable to recognise humans in two-dimensional depictions of human motion cues only. In spite of extensive exposure to human movement, dogs need more perceptual cues to detect equivalence between human two-dimensional animations and the represented living entity.

Bird expertise does not increase motion sensitivity to bird flight motion

While motion information is important for the early stages of vision, it also contributes to later stages of object recognition. For example, human observers can detect the presence of a human, judge its actions, and judge its gender and identity simply based on motion cues conveyed in a point-light display. Here we examined whether object expertise enhances the observer's sensitivity to its characteristic movement. Bird experts and novices were shown point-light displays of upright and inverted birds in flight, or upright and inverted human walkers, and asked to discriminate them from spatially scrambled point-light displays of the same stimuli. While the spatially scrambled stimuli retained the local motion of each dot of the moving objects, it disrupted the global percept of the object in motion. To estimate a detection threshold in each object domain, we systematically varied the number of noise dots in which the stimuli were embedded using an adaptive staircase approach. Contrary to our predictions, the experts did not show disproportionately higher sensitivity to bird motion, and both groups showed no inversion cost. However, consistent with previous work showing a robust inversion effect for human motion, both groups were more sensitive to upright human walkers than their inverted counterparts. Thus, the result suggests that real-world experience in the bird domain has little to no influence on the sensitivity to bird motion and that birds do not show the typical inversion effect seen with humans and other terrestrial movement.

Ensemble coding of crowd speed using biological motion

The accurate perception of human crowds is integral to social understanding and interaction. Previous studies have shown that observers are sensitive to several crowd characteristics such as average facial expression, gender, identity, joint attention, and heading direction. In two experiments, we examined ensemble perception of crowd speed using standard point-light walkers (PLW). Participants were asked to estimate the average speed of a crowd consisting of 12 figures moving at different speeds. In Experiment 1, trials of intact PLWs alternated with trials of scrambled PLWs with a viewing duration of 3 seconds. We found that ensemble processing of crowd speed could rely on local motion alone, although a globally intact configuration enhanced performance. In Experiment 2, observers estimated the average speed of intact-PLW crowds that were displayed at reduced viewing durations across five blocks of trials (between 2500 ms and 500 ms). Estimation of fast crowds was precise and accurate regardless of viewing duration, and we estimated that three to four walkers could still be integrated at 500 ms. For slow crowds, we found a systematic deterioration in performance as viewing time reduced, and performance at 500 ms could not be distinguished from a single-walker response strategy. Overall, our results suggest that rapid and accurate ensemble perception of crowd speed is possible, although sensitive to the precise speed range examined.

Exploring biological motion perception in two-stream convolutional neural networks

Visual recognition of biological motion recruits form and motion processes supported by both dorsal and ventral pathways. This neural architecture inspired the two-stream convolutional neural network (CNN) model, which includes a spatial CNN to process appearance information in a sequence of image frames, a temporal CNN to process optical flow information, and a fusion network to integrate the features extracted by the two CNNs and make final decisions about action recognition. In five simulations, we compared the CNN model's performance with classical findings in biological motion perception. The CNNs trained with raw RGB action videos showed weak performance in recognizing point-light actions. Additional transfer training with actions shown in other display formats (e.g., skeletal) was necessary for CNNs to recognize point-light actions. The CNN models exhibited largely viewpoint-dependent recognition of actions, with a limited ability to generalize to viewpoints close to the training views. The CNNs predicted the inversion effect in the presence of global body configuration, but failed to predict the inversion effect driven solely by local motion signals. The CNNs provided a qualitative account of some behavioral results observed in human biological motion perception for fine discrimination tasks with noisy inputs, such as point-light actions with disrupted local motion signals, and walking actions with temporally misaligned motion cues. However, these successes are limited by the CNNs' lack of adaptive integration for form and motion processes, and failure to incorporate specialized mechanisms (e.g., a life detector) as well as top-down influences on biological motion perception.

Information for perceiving blurry events: Optic flow and color are additive

Information used in visual event perception includes both static image structure projected from opaque object surfaces and dynamic optic flow generated by motion. Events presented in static blurry grayscale displays have been shown to be recognized only when and after presented with optic flow. In this study, we investigate the effects of optic flow and color on identifying blurry events by studying the identification accuracy and eye-movement patterns. Three types of color displays were tested: grayscale, original colors, or rearranged colors (where the RGB values of the original colors were adjusted). In each color condition, participants identified 12 blurry events in five experimental phases. In the first two phases, static blurry images were presented alone or sequentially with a motion mask between consecutive frames, and identification was poor. In Phase 3, where optic flow was added, identification was comparably good. In Phases 4 and 5, motion was removed, but identification remained good. Thus, optic flow improved event identification during and after its presentation. Color also improved performance, where participants were consistently better at identifying color displays than grayscale or rearranged color displays. Importantly, the effects of optic flow and color were additive. Finally, in both motion and postmotion phases, a significant portion of eye fixations fell in strong optic flow areas, suggesting that participants continued to look where flow was available even after it stopped. We infer that optic flow specified depth structure in the blurry image structure and yielded an improvement in identification from static blurry images.

Social Cognitive Dysfunction in Elderly Patients After Anesthesia and Surgery

Extensive studies have revealed that cognitive processing was impaired after anesthesia and surgery, particularly for the elderly patients. However, most of the existing studies focused on the general cognitive deficits (e.g., delayed neuro-cognitive recovery and POCD). Although diagnosis of social abilities has been used in various clinical fields, few studies have investigated the potential deficit on social cognition after anesthesia and surgery. The current study examined whether there was any social cognitive dysfunction after anesthesia and surgery. We achieved this by taking biological motion (BM) as the stimuli of interest, the perception of which has been taken as the hallmark of social cognition. The elderly patients (aged ≥ 60 years) were required to judge whether an upright BM stimulus appeared among the dynamic noises to test their social cognition, as well as do a Mini-Mental State Examination to test their general cognition. The two tests were performed at both 1-day before and 7-day after the surgery. Results showed that 31.25% of patients exhibited BM perception deficit after anesthesia and surgery relative to before anesthesia and surgery, implying that social cognitive dysfunction existed. Meanwhile, social cognitive dysfunction was independent from delayed neurocognitive recovery.

Somatosensory-visual effects in visual biological motion perception

Social cognition is dependent on the ability to extract information from human stimuli. Of those, patterns of biological motion (BM) and in particular walking patterns of other humans, are prime examples. Although most often tested in isolation, BM outside the laboratory is often associated with multisensory cues (i.e. we often hear and see someone walking) and there is evidence that vision-based judgments of BM stimuli are systematically influenced by motor signals. Furthermore, cross-modal visuo-tactile mechanisms have been shown to influence perception of bodily stimuli. Based on these observations, we here investigated if somatosensory inputs would affect visual BM perception. In two experiments, we asked healthy participants to perform a speed discrimination task on two point light walkers (PLW) presented one after the other. In the first experiment, we quantified somatosensory-visual interactions by presenting PLW together with tactile stimuli either on the participants' forearms or feet soles. In the second experiment, we assessed the specificity of these interactions by presenting tactile stimuli either synchronously or asynchronously with upright or inverted PLW. Our results confirm that somatosensory input in the form of tactile foot stimulation influences visual BM perception. When presented with a seen walker's footsteps, additional tactile cues enhanced sensitivity on a speed discrimination task, but only if the tactile stimuli were presented on the relevant body-part (under the feet) and when the tactile stimuli were presented synchronously with the seen footsteps of the PLW, whether upright or inverted. Based on these findings we discuss potential mechanisms of somatosensory-visual interactions in BM perception.

The two-process theory of biological motion processing

Perception, identification, and understanding of others' actions from motion information are vital for our survival in the social world. A breakthrough in the understanding of action perception was the discovery that our visual system is sensitive to human action from the sparse motion input of only a dozen point lights, a phenomenon known as biological motion (BM) processing. Previous psychological and computational models cannot fully explain the emerging evidence for the existence of BM processing during early ontogeny. Here, we propose a two-process model of the mechanisms underlying BM processing. We hypothesize that the first system, the 'Step Detector,' rapidly processes the local foot motion and feet-below-the-body information that is specific to vertebrates, is less dependent on postnatal learning, and involves subcortical networks. The second system, the 'Bodily Action Evaluator,' slowly processes the fine global structure-from-motion, is specific to conspecific, and dependent on gradual learning processed in cortical networks. This proposed model provides new insight into research on the development of BM processing.

Agent identity drives adaptive encoding of biological motion into working memory

To engage in normal social interactions, we have to encode human biological motions (BMs, e.g., walking and jumping), which is one of the most salient and biologically significant types of kinetic information encountered in everyday life, into working memory (WM). Critically, each BM in real life is produced by a distinct person, carrying a dynamic motion signature (i.e., identity). Whether agent identity influences the WM processing of BMs remains unknown. Here, we addressed this question by examining whether memorizing BMs with different identities promoted the WM processing of task-irrelevant clothing colors. Two opposing hypotheses were tested: (a) WM only stores the target action (element-based hypothesis) and (b) WM stores both action and irrelevant clothing color (event-based hypothesis), interpreting each BM as an event. We required participants to memorize actions that either performed by one agent or distinct agents, while ignoring clothing colors. Then we examined whether the irrelevant color was also stored in WM by probing a distracting effect: If the color was extracted into WM, the change of irrelevant color in the probe would lead to a significant distracting effect on action performance. We found that WM encoding of BMs was adaptive: Once the memorized actions had different identities, WM adopted an event-based encoding mode regardless of memory load and probe identity (Experiment 1, different-identity group of Experiment 2, and Experiment 3). However, WM used an element-based encoding mode when memorized-actions shared the same identity (same-identity group of Experiment 2) or were inverted (Experiment 4). Overall, these findings imply that agent identity information has a significant effect on the WM processing of BMs.

The neural correlates of orienting to walking direction in 6-month-old infants: An ERP study

The ability to detect social signals represents a first step to enter our social world. Behavioral evidence has demonstrated that 6-month-old infants are able to orient their attention toward the position indicated by walking direction, showing faster orienting responses toward stimuli cued by the direction of motion than toward uncued stimuli. The present study investigated the neural mechanisms underpinning this attentional priming effect by using a spatial cueing paradigm and recording EEG (Geodesic System 128 channels) from 6-month-old infants. Infants were presented with a central point-light walker followed by a single peripheral target. The target appeared randomly at a position either congruent or incongruent with the walking direction of the cue. We examined infants' target-locked event-related potential (ERP) responses and we used cortical source analysis to explore which brain regions gave rise to the ERP responses. The P1 component and saccade latencies toward the peripheral target were modulated by the congruency between the walking direction of the cue and the position of the target. Infants' saccade latencies were faster in response to targets appearing at congruent spatial locations. The P1 component was larger in response to congruent than to incongruent targets and a similar congruency effect was found with cortical source analysis in the parahippocampal gyrus and the anterior fusiform gyrus. Overall, these findings suggest that a type of biological motion like the one of a vertebrate walking on the legs can trigger covert orienting of attention in 6-month-old infants, enabling enhancement of neural activity related to visual processing of potentially relevant information as well as a facilitation of oculomotor responses to stimuli appearing at the attended location.

Motion or emotion: Infants discriminate emotional biological motion based on low-level visual information

Infants' ability to discriminate emotional facial expressions and tones of voice is well-established, yet little is known about infant discrimination of emotional body movements. Here, we asked if 10-20-month-old infants rely on high-level emotional cues or low-level motion related cues when discriminating between emotional point-light displays (PLDs). In Study 1, infants viewed 18 pairs of angry, happy, sad, or neutral PLDs. Infants looked more at angry vs. neutral, happy vs. neutral, and neutral vs. sad. Motion analyses revealed that infants preferred the PLD with more total body movement in each pairing. Study 2, in which infants viewed inverted versions of the same pairings, yielded similar findings except for sad-neutral. Study 3 directly paired all three emotional stimuli in both orientations. The angry and happy stimuli did not significantly differ in terms of total motion, but both had more motion than the sad stimuli. Infants looked more at angry vs. sad, more at happy vs. sad, and about equally to angry vs. happy in both orientations. Again, therefore, infants preferred PLDs with more total body movement. Overall, the results indicate that a low-level motion preference may drive infants' discrimination of emotional human walking motions.

Face recognition ability does not predict person identification performance: using individual data in the interpretation of group results

There are large individual differences in people's face recognition ability. These individual differences provide an opportunity to recruit the best face-recognisers into jobs that require accurate person identification, through the implementation of ability-screening tasks. To date, screening has focused exclusively on face recognition ability; however real-world identifications can involve the use of other person-recognition cues. Here we incorporate body and biological motion recognition as relevant skills for person identification. We test whether performance on a standardised face-matching task (the Glasgow Face Matching Test) predicts performance on three other identity-matching tasks, based on faces, bodies, and biological motion. We examine the results from group versus individual analyses. We found stark differences between the conclusions one would make from group analyses versus analyses that retain information about individual differences. Specifically, tests of correlation and analysis of variance suggested that face recognition ability was related to performance for all person identification tasks. These analyses were strikingly inconsistent with the individual differences data, which suggested that the screening task was related only to performance on the face task. This study highlights the importance of individual data in the interpretation of results of person identification ability.

PLAViMoP: How to standardize and simplify the use of point-light displays

The study of biological point-light displays (PLDs) has fascinated researchers for more than 40 years. However, the mechanisms underlying PLD perception remain unclear, partly due to difficulties with precisely controlling and transforming PLD sequences. Furthermore, little agreement exists regarding how transformations are performed. This article introduces a new free-access program called PLAViMoP (Point-Light Display Visualization and Modification Platform) and presents the algorithms for PLD transformations actually included in the software. PLAViMoP fulfills two objectives. First, it standardizes and makes clear many classical spatial and kinematic transformations described in the PLD literature. Furthermore, given its optimized interface, PLAViMOP makes these transformations easy and fast to achieve. Overall, PLAViMoP could directly help scientists avoid technical difficulties and make possible the use of PLDs for nonacademic applications.

Points and Stripes: A Novel Technique for Masking Biological Motion Point-Light Stimuli

Human articulated motion can be readily recognized robustly even from impoverished so-called point-light displays. Such sequence information is processed by separate visual processing channels recruiting different stages at low and intermediate levels of the cortical visual processing hierarchy. The different contributions that motion and form information make to form articulated, or biological, motion perception are still under investigation. Here we investigate experimentally whether and how specific spatio-temporal features, such as extrema in the motion energy or maximum limb expansion, indicated by the lateral and longitudinal extension, constrain the formation of the representations of articulated body motion. In order to isolate the relevant stimulus properties we suggest a novel masking technique, which allows to selectively impair the ankle information of the body configuration while keeping the motion of the point-light locations intact. Our results provide evidence that maxima in feature channel representations, e.g., the lateral or longitudinal extension, define elemental features to specify key poses of biological motion patterns. These findings provide support for models which aim at automatically building visual representations for the cortical processing of articulated motion by identifying temporally localized events in a continuous input stream.

Reduced orienting to audiovisual synchrony in infancy predicts autism diagnosis at 3 years of age

BACKGROUND

Effective multisensory processing develops in infancy and is thought to be important for the perception of unified and multimodal objects and events. Previous research suggests impaired multisensory processing in autism, but its role in the early development of the disorder is yet uncertain. Here, using a prospective longitudinal design, we tested whether reduced visual attention to audiovisual synchrony is an infant marker of later-emerging autism diagnosis.

METHODS

We studied 10-month-old siblings of children with autism using an eye tracking task previously used in studies of preschoolers. The task assessed the effect of manipulations of audiovisual synchrony on viewing patterns while the infants were observing point light displays of biological motion. We analyzed the gaze data recorded in infancy according to diagnostic status at 3 years of age (DSM-5).

RESULTS

Ten-month-old infants who later received an autism diagnosis did not orient to audiovisual synchrony expressed within biological motion. In contrast, both infants at low-risk and high-risk siblings without autism at follow-up had a strong preference for this type of information. No group differences were observed in terms of orienting to upright biological motion.

CONCLUSIONS

This study suggests that reduced orienting to audiovisual synchrony within biological motion is an early sign of autism. The findings support the view that poor multisensory processing could be an important antecedent marker of this neurodevelopmental condition.

"Wrong Way Up": Temporal and Spatial Dynamics of the Networks for Body Motion Processing at 9.4 T

Body motion delivers a wealth of socially relevant information. Yet display inversion severely impedes biological motion (BM) processing. It is largely unknown how the brain circuits for BM are affected by display inversion. As upright and upside-down point-light BM displays are similar, we addressed this issue by using ultrahigh field functional MRI at 9.4 T providing for high sensitivity and spatial resolution. Whole-brain analysis along with exploration of the temporal dynamics of the blood-oxygen-level-dependent response reveals that in the left hemisphere, inverted BM activates anterior networks likely engaged in decision making and cognitive control, whereas readily recognizable upright BM activates posterior areas solely. In the right hemisphere, multiple networks are activated in response to upright BM as compared with scarce activation to inversion. With identical visual input with display inversion, a large-scale network in the right hemisphere is detected in perceivers who do not constantly interpret displays as shown the "wrong way up." For the first time, we uncover (1) (multi)functional involvement of each region in the networks underpinning BM processing and (2) large-scale ensembles of regions playing in unison with distinct temporal dynamics. The outcome sheds light on the neural circuits underlying BM processing as an essential part of the social brain.

Two Ways to Facial Expression Recognition? Motor and Visual Information Have Different Effects on Facial Expression Recognition

Motor-based theories of facial expression recognition propose that the visual perception of facial expression is aided by sensorimotor processes that are also used for the production of the same expression. Accordingly, sensorimotor and visual processes should provide congruent emotional information about a facial expression. Here, we report evidence that challenges this view. Specifically, the repeated execution of facial expressions has the opposite effect on the recognition of a subsequent facial expression than the repeated viewing of facial expressions. Moreover, the findings of the motor condition, but not of the visual condition, were correlated with a nonsensory condition in which participants imagined an emotional situation. These results can be well accounted for by the idea that facial expression recognition is not always mediated by motor processes but can also be recognized on visual information alone.

A Longitudinal Investigation of Preferential Attention to Biological Motion in 2- to 24-Month-Old Infants

Preferential attention to biological motion is an early-emerging mechanism of adaptive action that plays a critical role in social development. The present study provides a comprehensive longitudinal mapping of developmental change in preferential attention to biological motion in 116 infants at 7 longitudinal time points. Tested repeatedly from 2 until 24 months of age, results reveal that preferential attention to biological motion changes considerably during the first months of life. Previously reported preferences in both neonates and older infants are absent in the second month but do reemerge by month 3 and become increasingly pronounced during the subsequent two years. These results highlight the second month of life as a potentially critical transition period in social visual engagement.

Novel method of extracting motion from natural movies

BACKGROUND

The visual system in primates can be segregated into motion and shape pathways. Interaction occurs at multiple stages along these pathways. Processing of shape-from-motion and biological motion is considered to be a higher-order integration process involving motion and shape information. However, relatively limited types of stimuli have been used in previous studies on these integration processes.

NEW METHOD

We propose a new algorithm to extract object motion information from natural movies and to move random dots in accordance with the information. The object motion information is extracted by estimating the dynamics of local normal vectors of the image intensity projected onto the x-y plane of the movie.

RESULTS

An electrophysiological experiment on two adult common marmoset monkeys (Callithrix jacchus) showed that the natural and random dot movies generated with this new algorithm yielded comparable neural responses in the middle temporal visual area.

COMPARISON WITH EXISTING METHODS

In principle, this algorithm provided random dot motion stimuli containing shape information for arbitrary natural movies. This new method is expected to expand the neurophysiological and psychophysical experimental protocols to elucidate the integration processing of motion and shape information in biological systems.

CONCLUSIONS

The novel algorithm proposed here was effective in extracting object motion information from natural movies and provided new motion stimuli to investigate higher-order motion information processing.

Dopaminergic Modulation of Biological Motion Perception in patients with Parkinson's disease

Parkinson’s disease (PD) is a progressive neurodegenerative disorder pathologically characterized by a selective loss of dopaminergic neurons in the substantia nigra. In previous studies, greater attention was paid to impairments in motor disturbances in contrast to impairments of cognitive function in PD that was often ignored. In present study, a duration discrimination paradigm was used to assess global and local biological motion (BM) perception in healthy controls(HCs) and PD patients with and without dopamine substitution treatment (DST). Biological motion sequences and inanimate motion sequences (inverted BM sequences) were sequentially presented on a screen. Observers were required to verbally make a 2-alternative forced-choice to indicate whether the first or second interval appeared longer. The stimuli involved global and local BM sequences. Statistical analyses were conducted on points of subjective equality (PSE). We found significant differences between untreated PD patients and HCs as well as differences between global and local BM conditions. PD patients have a deficit in both global and local BM perception. Nevertheless, these two BM conditions can be improved under DST. Our data indicates that BM perception may be damaged in PD patients and dopaminergic medication is conducive to maintain the BM perception in PD patients.

Gravity Cues Embedded in the Kinematics of Human Motion Are Detected in Form-from-Motion Areas of the Visual System and in Motor-Related Areas

The present study investigated the cortical areas engaged in the perception of graviceptive information embedded in biological motion (BM). To this end, functional magnetic resonance imaging was used to assess the cortical areas active during the observation of human movements performed under normogravity and microgravity (parabolic flight). Movements were defined by motion cues alone using point-light displays. We found that gravity modulated the activation of a restricted set of regions of the network subtending BM perception, including form-from-motion areas of the visual system (kinetic occipital region, lingual gyrus, cuneus) and motor-related areas (primary motor and somatosensory cortices). These findings suggest that compliance of observed movements with normal gravity was carried out by mapping them onto the observer's motor system and by extracting their overall form from local motion of the moving light points. We propose that judgment on graviceptive information embedded in BM can be established based on motor resonance and visual familiarity mechanisms and not necessarily by accessing the internal model of gravitational motion stored in the vestibular cortex.

10-Month-Old Infants Are Sensitive to the Time Course of Perceived Actions: Eye-Tracking and EEG Evidence

Research has shown that infants are able to track a moving target efficiently - even if it is transiently occluded from sight. This basic ability allows prediction of when and where events happen in everyday life. Yet, it is unclear whether, and how, infants internally represent the time course of ongoing movements to derive predictions. In this study, 10-month-old crawlers observed the video of a same-aged crawling baby that was transiently occluded and reappeared in either a temporally continuous or non-continuous manner (i.e., delayed by 500 ms vs. forwarded by 500 ms relative to the real-time movement). Eye movement and rhythmic neural brain activity (EEG) were measured simultaneously. Eye movement analyses showed that infants were sensitive to slight temporal shifts in movement continuation after occlusion. Furthermore, brain activity associated with sensorimotor processing differed between observation of continuous and non-continuous movements. Early sensitivity to an action's timing may hence be explained within the internal real-time simulation account of action observation. Overall, the results support the hypothesis that 10-month-old infants are well prepared for internal representation of the time course of observed movements that are within the infants' current motor repertoire.

Familiarity with images affects how dogs ( Canis familiaris) process life-size video projections of humans

A central problem of behavioural studies providing artificial visual stimuli for non-human animals is to determine how subjects perceive and process these stimuli. Especially in the case of videos, it is important to ascertain that animals perceive the actual content of the images and are not just reacting to the motion cues in the presentation. In this study, we set out to investigate how dogs process life-sized videos. We aimed to find out whether dogs perceive the actual content of video images or whether they only react to the videos as a set of dynamic visual elements. For this purpose, dogs were presented with an object search task where a life-sized projected human was hiding a target object. The videos were either normally oriented or displayed upside down, and we analysed dogs' reactions towards the projector screen after the video presentations, and their performance in the search task. Results indicated that in the case of the normally oriented videos, dogs spontaneously perceived the actual content of the images. However, the 'Inverted' videos were first processed as a set of unrelated visual elements, and only after some exposure to these videos did the dogs show signs of perceiving the unusual configuration of the depicted scene. Our most important conclusion was that dogs process the same type of artificial visual stimuli in different ways, depending on the familiarity of the depicted scene, and that the processing mode can change with exposure to unfamiliar stimuli.

First, you need a Gestalt: An interaction of bottom-up and top-down streams during the perception of the ambiguously rotating human walker

Our visual system combines sensory evidence with prior knowledge to produce a representation of an outside world. Here, we explored the limits of the feedforward computation using an ambiguously rotating human biological motion. Specifically, we investigated whether an overall rotation, which was added to all the displays used in the study, would be perceived when the point-light walker was presented upside-down, a condition that typically obliterates perception of a human Gestalt. We report that inversion of the point-light walker or the absence of an identifiable Gestalt abolished the perception of an overall rotation. Perception of rotation was restored if the human walker Gestalt could be identified (an upright walker), if observers were informed about the nature of the motion display, or if observers expected to see the rotation of an unknown dynamic object. This implies that a mathematically more complex human motion was accounted for before the remaining motion components could be used to infer an overall rotation. Our results indicate that the perceptual inference does not proceed in a hierarchical manner with the simpler components being identified first. Instead, prior knowledge acts as a starting point for the decomposition of an even relatively simple combination of two motions.

Using a Kinect sensor to acquire biological motion: Toolbox and evaluation

Biological motion (BM) is the movement of animate entities, which conveys rich social information. To obtain pure BM, researchers nowadays predominantly use point-light displays (PLDs), which depict BM through a set of light points (e.g., 12 points) placed at distinct joints of a moving human body. Most prevalent BM stimuli are created by state-of-the-art motion capture systems. Although these stimuli are highly precise, the motion capture system is expensive and bulky, and its process of constructing a PLD-based BM is time-consuming and complex. These factors impede the investigation of BM mechanisms. In this study, we propose a free Kinect-based biological motion capture (KBC) toolbox based on the Kinect Sensor 2.0 in C++. The KBC toolbox aims to help researchers acquire PLD-based BM in an easy, low-cost, and user-friendly way. We conducted three experiments to examine whether KBC-generated BM can genuinely reflect the processing characteristics of BM: (1) Is BM from this source processed globally in vision? (2) Does its BM (e.g., from the feet) retain detailed local information? and (3) Does the BM convey emotional information? We obtained positive results in response to all three questions. Therefore, we think that the KBC toolbox can be useful in generating BM for future research.

Prediction of Biological Motion Perception Performance from Intrinsic Brain Network Regional Efficiency

Biological motion perception (BMP) refers to the ability to perceive the moving form of a human figure from a limited amount of stimuli, such as from a few point lights located on the joints of a moving body. BMP is commonplace and important, but there is great inter-individual variability in this ability. This study used multiple regression model analysis to explore the association between BMP performance and intrinsic brain activity, in order to investigate the neural substrates underlying inter-individual variability of BMP performance. The resting-state functional magnetic resonance imaging (rs-fMRI) and BMP performance data were collected from 24 healthy participants, for whom intrinsic brain networks were constructed, and a graph-based network efficiency metric was measured. Then, a multiple linear regression model was used to explore the association between network regional efficiency and BMP performance. We found that the local and global network efficiency of many regions was significantly correlated with BMP performance. Further analysis showed that the local efficiency rather than global efficiency could be used to explain most of the BMP inter-individual variability, and the regions involved were predominately located in the Default Mode Network (DMN). Additionally, discrimination analysis showed that the local efficiency of certain regions such as the thalamus could be used to classify BMP performance across participants. Notably, the association pattern between network nodal efficiency and BMP was different from the association pattern of static directional/gender information perception. Overall, these findings show that intrinsic brain network efficiency may be considered a neural factor that explains BMP inter-individual variability.

Perception of Elliptic Biological Motion

We tested the ability of the mature visual system for discrimination between types of elliptic biological motion on the basis of event kinematics. Healthy adult volunteers were presented with point-light displays depicting elliptic motion when only a single dot, a moving point-light arm, or a whole point-light human figure was visible. The displays were created in accordance with the two-thirds power kinematic law ( natural motion), whereas the control displays violated this principle ( unnatural motion). On each trial, participants judged whether the display represented natural or unnatural motion. The findings indicate that adults are highly sensitive to violation of the two-thirds power kinematic law. Notably, participants can easily discriminate between natural and unnatural motions without recognising the stimuli, which suggests that people implicitly use kinematic information. Most intriguing, event recognition seems to diminish the capacity to judge whether event kinematics is unnatural. We discuss possible ways for a cross-talk between perception and production of biological movement, and the brain mechanisms involved in biological motion processing.

Prior Knowledge about Display Inversion in Biological Motion Perception

Display inversion severely impedes veridical perception of point-light biological motion (Pavlova and Sokolov, 2000 Perception & Psychophysics62 889–899; Sumi, 1984 Perception13 283–286). Here, by using a spontaneous-recognition paradigm, we ask whether prior information about display orientation improves biological motion perception. Participants were shown a set of 180° inverted point-light stimuli depicting a human walker and quadrupeds (dogs). In experiment 1, one group of observers was not aware of the orientation of stimuli, whereas the other group was told beforehand that stimuli will be presented upside down. In experiment 2, independent groups of participants informed about stimulus orientation saw the same set of stimuli, in each of which either a moving or a static background line was inserted. The findings indicate that information about display inversion is insufficient for reliable recognition of inverted point-light biological motion. Instead, prior information facilitates display recognition only when it is complemented by additional contextual elements. It appears that visual impressions from inverted point-light stimuli remain impenetrable with respect to one's knowledge about display orientation. The origins of orientation specificity in biological motion perception are discussed in relation to the recent neuroimaging data obtained with point-light stimuli and fragmented Mooney faces.

Bistability and Biasing Effects in the Perception of Ambiguous Point-Light Walkers

The perceptually bistable character of point-light walkers has been examined in three experiments. A point-light figure without explicit depth cues constitutes a perfectly ambiguous stimulus: from all viewpoints, multiple interpretations are possible concerning the depth orientation of the figure. In the first experiment, it is shown that non-lateral views of the walker are indeed interpreted in two orientations, either as facing towards the viewer or as facing away from the viewer, but that the interpretation in which the walker is oriented towards the viewer is reported more frequently. In the second experiment the point-light figure was walking backwards, making the global orientation of the point-light figure opposite to the direction of global motion. The interpretation in which the walker was facing the viewer was again reported more frequently. The robustness of these findings was examined in the final experiment, in which the effects of disambiguating the stimulus by introducing a local depth cue (occlusion) or a more global depth cue (applying perspective projection) were explored.

Recognition of Biological Motion from Blurred Natural Scenes

Biological-motion perception can be regarded as a template-matching process. We are concerned with the visual cues in this template. Biological-motion perception is usually studied with point-light displays similar to the point-light displays invented by Johansson (1973 Perception & Psychophysics14 201 – 211). These stimuli are in some ways abstract. In order to use more natural stimuli, we recorded movies of different actions in natural scenes. By blurring the scenes we modified the visual cues, particularly the local form and motion information. Observers were asked to identify the action portrayed. Our results demonstrate that templates for biological-motion recognition combine global form and motion cues. Reductions of local form and local motion information by blurring can be compensated by global form change and global motion. Local motion information is also used for segmentation.