Low-level visual processing of biological motion

The cerebellum and the Mirror Neuron System: A matter of inhibition? From neurophysiological evidence to neuromodulatory implications. A narrative review

Mirror neurons show activity during both the execution (AE) and observation of actions (AO). The Mirror Neuron System (MNS) could be involved during motor imagery (MI) as well. Extensive research suggests that the cerebellum is interconnected with the MNS and may be critically involved in its activities. We gathered evidence on the cerebellum's role in MNS functions, both theoretically and experimentally. Evidence shows that the cerebellum plays a major role during AO and MI and that its lesions impair MNS functions likely because, by modulating the activity of cortical inhibitory interneurons with mirror properties, the cerebellum may contribute to visuomotor matching, which is fundamental for shaping mirror properties. Indeed, the cerebellum may strengthen sensory-motor patterns that minimise the discrepancy between predicted and actual outcome, both during AE and AO. Furthermore, through its connections with the hippocampus, the cerebellum might be involved in internal simulations of motor programs during MI. Finally, as cerebellar neuromodulation might improve its impact on MNS activity, we explored its potential neurophysiological and neurorehabilitation implications.

Limb articulation of biological motion can induce illusory motion perception during self-motion

When one walks toward a crowd of pedestrians, dealing with their biological motion while controlling one's own self-motion is a difficult perceptual task. Limb articulation of a walker is naturally coupled to the walker's translation through the scene and allows the separation of optic flow generated by self-motion from the biological motion of other pedestrians. Recent research has shown that if limb articulation and translation mismatch, such as for walking in place, self-motion perception becomes biased. This bias may reflect an illusory motion attributed to the pedestrian crowd from the articulation of their limbs. To investigate this hypothesis, we presented observers with a simulation of forward self-motion toward a laterally moving crowd of point-light walkers and asked them to report the perceived lateral speed of the crowd. To investigate the dependence of the crowd speed percept on biological motion, we also included conditions in which the points of the walker were spatially scrambled to destroy body form and limb articulation. We observed illusory crowd speed percepts that were related to the articulation rate of the biological motion. Scrambled walkers also produced illusory motion but it was not related to articulation rate. We conclude that limb articulation induces percepts of crowd motion that can be used for interpreting self-motion toward crowds.

"Extended Descriptive Risk-Averse Bayesian Model" a More Comprehensive Approach in Simulating Complex Biological Motion Perception

The ability to perceive biological motion is crucial for human survival, social interactions, and communication. Over the years, researchers have studied the mechanisms and neurobiological substrates that enable this ability. In a previous study, we proposed a descriptive Bayesian simulation model to represent the dorsal pathway of the visual system, which processes motion information. The model was inspired by recent studies that questioned the impact of dynamic form cues in biological motion perception and was trained to distinguish the direction of a soccer ball from a set of complex biological motion soccer-kick stimuli. However, the model was unable to simulate the reaction times of the athletes in a credible manner, and a few subjects could not be simulated. In this current work, we implemented a novel disremembering strategy to incorporate neural adaptation at the decision-making level, which improved the model's ability to simulate the athletes' reaction times. We also introduced receptive fields to detect rotational optic flow patterns not considered in the previous model to simulate a new subject and improve the correlation between the simulation and experimental data. The findings suggest that rotational optic flow plays a critical role in the decision-making process and sheds light on how different individuals perform at different levels. The correlation analysis of human versus simulation data shows a significant, almost perfect correlation between experimental and simulated angular thresholds and slopes, respectively. The analysis also reveals a strong relation between the average reaction times of the athletes and the simulations.

Recognition of humans from biological motion in infants

Infant studies have suggested that the detection of biological motion (BM) might be an innate capacity, based on newborns' spontaneous preference for BM. However, it is unclear if, like adults, infants recognize humans from BM and are able to build the representation of bodies and faces. To address this issue, we tested whether exposure to BM influences subsequent face recognition in 3- to 8-month-old infants. After familiarization with a point-light walker (PLW) of either a female or a male, the infant's preference for female and male faces was measured. If infants can build the representation of not only the body but also the face from PLWs, the familiarization effect of gender induced by the PLW might be generalized to faces. We found that infants at 7 to 8 months looked for longer at the face whose gender was opposite to that of the PLW, whereas 3- to 4- and 5- to 6-month-old infants did not. These results suggest that infants can access the representation of humans from BM and extract gender, which is shared across bodies and faces, from at least 7 to 8 months of age.

Motion information plays only a secondary role in sex identification of walking persons in frontal view

Observers have a success rate above chance in identifying the sex of walking persons on the basis of movies showing only point lights. It has been claimed that observers rely heavily on motion information for their judgment. Here, we studied, for the frontal plane, the added value of motion information over just form information. In the first experiment, we asked 209 observers to identify the sex of frontal-plane still images of point lights of six male and six female walkers. We used two types of point-light images: (1) cloud-like images, showing just point lights, and (2) skeleton-like images with point lights interconnected. On the basis of cloud-like still images, observers had a mean success rate of 63%; on the basis of skeleton-like still images, they had a higher mean success rate of 70% (p < 0.001). In the second experiment, we asked 273 observers to identify the sex of skeleton-like still images and skeleton-like movies of eight full walking strides. The overall success rate based on movies was 73%. Among the observers first presented with still images, the success rate based on still images was 68%, but for observers first presented with movies the success rate based on still images was 74%, not different from that based on movies (p > 0.05). Our interpretation was that motion information revealed what the point lights represented but had no additional value when this became clear. Hence, we concluded that motion information plays only a secondary role in sex identification of walking persons in the frontal plane.

"Descriptive Risk-Averse Bayesian Decision-Making," a Model for Complex Biological Motion Perception in the Human Dorsal Pathway

Biological motion perception is integral not only to survival but also to the social life of human beings. Identifying the underlying mechanisms and their associated neurobiological substrates has been a matter of investigation and debate for some time. Although, in general, it is believed that the integration of local motion and dynamic form cues in the brain empowers the visual system to perceive/recognize biological motion stimuli, some recent studies have indicated the importance of dynamic form cues in such a process. Inspired by the previous neurophysiologically plausible biological motion perception models, a new descriptive risk-averse Bayesian simulation model, capable of discerning a ball's direction from a set of complex biological motion soccer kick stimuli, is proposed. The model represents only the dorsal pathway as a motion information processing section of the visual system according to the two-stream theory. The stimuli used have been obtained from a previous psychophysical study on athletes in our lab. Furthermore, the acquired psychophysical data from that study have been used to re-enact human behavior using our simulation model. By adjusting the model parameters, the psychometric function of athlete subjects has been mimicked. A correlation analysis between human and simulation data shows a significant and robust correlation between angular thresholds and slopes of the psychometric functions of both groups. Although it is established that the visual system optimally integrates all available information in the decision-making process, the results conform to the speculations favoring motion cue importance over dynamic form by testing the limits in which biological motion perception only depends on motion information processing.

A two-stage framework for neural processing of biological motion

It remains to be understood how biological motion is hierarchically computed, from discrimination of local biological motion animacy to global dynamic body perception. Here, we addressed this functional separation of the correlates of the perception of local biological motion from perception of global motion of a body. We hypothesized that local biological motion processing can be isolated, by using a single dot motion perceptual decision paradigm featuring the biomechanical details of local realistic motion of a single joint. To ensure that we were indeed tackling processing of biological motion properties we used a discrimination instead of detection task. We discovered using representational similarity analysis that two key early dorsal and two ventral stream regions (visual motion selective hMT+ and V3A, extrastriate body area EBA and a region within fusiform gyrus FFG) showed robust and separable signals related to encoding of local biological motion and global motion-mediated shape. These signals reflected two independent processing stages, as revealed by representational similarity analysis and deconvolution of fMRI responses to each motion pattern. This study showed that higher level pSTS encodes both classes of biological motion in a similar way, revealing a higher-level integrative stage, reflecting scale independent biological motion perception. Our results reveal a two-stage framework for neural computation of biological motion, with an independent contribution of dorsal and ventral regions for the initial stage.

EXPRESS: Investigating the Role of Working Memory Resources across Aesthetic and Non-Aesthetic Judgments

Aesthetic judgments dominate much of daily life by guiding how we evaluate objects, people, and experiences in our environment. One key question that remains unanswered is the extent to which more specialised or largely general cognitive resources support aesthetic judgments. To investigate this question in the context of working memory, we examined the extent to which a working memory load produces similar or different response time interference on aesthetic compared to non-aesthetic judgments. Across three pre-registered experiments that used Bayesian multi-level modelling approaches (N>100 per experiment), we found clear evidence that a working memory load produces similar response time interference on aesthetic judgments relative to non-aesthetic (motion) judgments. We also showed that this similarity in processing across aesthetic versus non-aesthetic judgments holds across variations in the form of art (people vs landscape; Exps. 1-3), medium type (artwork vs photographs; Exp. 2) and load content (art images vs letters; Exps. 1-3). These findings suggest that across a range of experimental contexts, as well as different processing streams in working memory (e.g., visual vs verbal), aesthetic and motion judgments commonly rely on a domain-general cognitive system, rather than a system that is more specifically tied to aesthetic judgments. In doing so, these findings shine new light on the working memory resources that supports aesthetic judgments, as well as how domain-general cognitive systems operate more generally in cognition.

Neural Suppression Elicited During Motor Imagery Following the Observation of Biological Motion From Point-Light Walker Stimuli

Introduction: Advantageous effects of biological motion (BM) detection, a low-perceptual mechanism that allows the rapid recognition and understanding of spatiotemporal characteristics of movement via salient kinematics information, can be amplified when combined with motor imagery (MI), i.e., the mental simulation of motor acts. According to Jeannerod's neurostimulation theory, asynchronous firing and reduction of mu and beta rhythm oscillations, referred to as suppression over the sensorimotor area, are sensitive to both MI and action observation (AO) of BM. Yet, not many studies investigated the use of BM stimuli using combined AO-MI tasks. In this study, we assessed the neural response in the form of event-related synchronization and desynchronization (ERD/S) patterns following the observation of point-light-walkers and concordant MI, as compared to MI alone. Methods: Twenty right-handed healthy participants accomplished the experimental task by observing BM stimuli and subsequently performing the same movement using kinesthetic MI (walking, cycling, and jumping conditions). We recorded an electroencephalogram (EEG) with 32 channels and performed time-frequency analysis on alpha (8-13 Hz) and beta (18-24 Hz) frequency bands during the MI task. A two-way repeated-measures ANOVA was performed to test statistical significance among conditions and electrodes of interest. Results: The results revealed significant ERD/S patterns in the alpha frequency band between conditions and electrode positions. Post hoc comparisons showed significant differences between condition 1 (walking) and condition 3 (jumping) over the left primary motor cortex. For the beta band, a significantly less difference in ERD patterns (p < 0.01) was detected only between condition 3 (jumping) and condition 4 (reference). Discussion: Our results confirmed that the observation of BM combined with MI elicits a neural suppression, although just in the case of jumping. This is in line with previous findings of AO and MI (AOMI) eliciting a neural suppression for simulated whole-body movements. In the last years, increasing evidence started to support the integration of AOMI training as an adjuvant neurorehabilitation tool in Parkinson's disease (PD). Conclusion: We concluded that using BM stimuli in AOMI training could be promising, as it promotes attention to kinematic features and imitative motor learning.

Linguistic labels cue biological motion perception and misperception

Linguistic labels exert a particularly strong top-down influence on perception. The potency of this influence has been ascribed to their ability to evoke category-diagnostic features of concepts. In doing this, they facilitate the formation of a perceptual template concordant with those features, effectively biasing perceptual activation towards the labelled category. In this study, we employ a cueing paradigm with moving, point-light stimuli across three experiments, in order to examine how the number of biological motion features (form and kinematics) encoded in lexical cues modulates the efficacy of lexical top-down influence on perception. We find that the magnitude of lexical influence on biological motion perception rises as a function of the number of biological motion-relevant features carried by both cue and target. When lexical cues encode multiple biological motion features, this influence is robust enough to mislead participants into reporting erroneous percepts, even when a masking level yielding high performance is used.

Top-Down Attention Guidance Shapes Action Encoding in the pSTS

The posterior superior temporal sulcus (pSTS) is a brain region characterized by perceptual representations of human body actions that promote the understanding of observed behavior. Increasingly, action observation is recognized as being strongly shaped by the expectations of the observer (Kilner 2011; Koster-Hale and Saxe 2013; Patel et al. 2019). Therefore, to characterize top-down influences on action observation, we evaluated the statistical structure of multivariate activation patterns from the action observation network (AON) while observers attended to the different dimensions of action vignettes (the action kinematics, goal, or identity of avatars jumping or crouching). Decoding accuracy varied as a function of attention instruction in the right pSTS and left inferior frontal cortex (IFC), with the right pSTS classifying actions most accurately when observers attended to the action kinematics and the left IFC classifying most accurately when observed attended to the actor's goal. Functional connectivity also increased between the right pSTS and right IFC when observers attended to the actions portrayed in the vignettes. Our findings are evidence that the attentive state of the viewer modulates sensory representations in the pSTS, consistent with proposals that the pSTS occupies an interstitial zone mediating top-down context and bottom-up perceptual cues during action observation.

Moving Toward versus Away from Another: How Body Motion Direction Changes the Representation of Bodies and Actions in the Visual Cortex

Representing multiple agents and their mutual relations is a prerequisite to understand social events such as interactions. Using functional magnetic resonance imaging on human adults, we show that visual areas dedicated to body form and body motion perception contribute to processing social events, by holding the representation of multiple moving bodies and encoding the spatial relations between them. In particular, seeing animations of human bodies facing and moving toward (vs. away from) each other increased neural activity in the body-selective cortex [extrastriate body area (EBA)] and posterior superior temporal sulcus (pSTS) for biological motion perception. In those areas, representation of body postures and movements, as well as of the overall scene, was more accurate for facing body (vs. nonfacing body) stimuli. Effective connectivity analysis with dynamic causal modeling revealed increased coupling between EBA and pSTS during perception of facing body stimuli. The perceptual enhancement of multiple-body scenes featuring cues of interaction (i.e., face-to-face positioning, spatial proximity, and approaching signals) was supported by the participants' better performance in a recognition task with facing body versus nonfacing body stimuli. Thus, visuospatial cues of interaction in multiple-person scenarios affect the perceptual representation of body and body motion and, by promoting functional integration, streamline the process from body perception to action representation.

Spatiotemporal dynamics of responses to biological motion in the human brain

We sought to understand the spatiotemporal characteristics of biological motion perception. We presented observers with biological motion walkers that differed in terms of form coherence or kinematics (i.e., the presence or absence of natural acceleration). Participants were asked to discriminate the facing direction of the stimuli while their magnetoencephalographic responses were concurrently imaged. We found that two univariate response components can be observed around ~200 msec and ~650 msec post-stimulus onset, each engaging lateral-occipital and parietal cortex prior to temporal and frontal cortex. Moreover, while univariate responses show biological motion form-specificity only after 300 msec, multivariate patterns specific to form can be well discriminated from those for local cues as early as 100 msec after stimulus onset. By finally examining the representational similarity of fMRI and MEG patterned responses, we show that early responses to biological motion are most likely sourced to occipital cortex while later responses likely originate from extrastriate body areas.

Ensemble coding of crowd speed using biological motion

The accurate perception of human crowds is integral to social understanding and interaction. Previous studies have shown that observers are sensitive to several crowd characteristics such as average facial expression, gender, identity, joint attention, and heading direction. In two experiments, we examined ensemble perception of crowd speed using standard point-light walkers (PLW). Participants were asked to estimate the average speed of a crowd consisting of 12 figures moving at different speeds. In Experiment 1, trials of intact PLWs alternated with trials of scrambled PLWs with a viewing duration of 3 seconds. We found that ensemble processing of crowd speed could rely on local motion alone, although a globally intact configuration enhanced performance. In Experiment 2, observers estimated the average speed of intact-PLW crowds that were displayed at reduced viewing durations across five blocks of trials (between 2500 ms and 500 ms). Estimation of fast crowds was precise and accurate regardless of viewing duration, and we estimated that three to four walkers could still be integrated at 500 ms. For slow crowds, we found a systematic deterioration in performance as viewing time reduced, and performance at 500 ms could not be distinguished from a single-walker response strategy. Overall, our results suggest that rapid and accurate ensemble perception of crowd speed is possible, although sensitive to the precise speed range examined.

Exploring biological motion perception in two-stream convolutional neural networks

Visual recognition of biological motion recruits form and motion processes supported by both dorsal and ventral pathways. This neural architecture inspired the two-stream convolutional neural network (CNN) model, which includes a spatial CNN to process appearance information in a sequence of image frames, a temporal CNN to process optical flow information, and a fusion network to integrate the features extracted by the two CNNs and make final decisions about action recognition. In five simulations, we compared the CNN model's performance with classical findings in biological motion perception. The CNNs trained with raw RGB action videos showed weak performance in recognizing point-light actions. Additional transfer training with actions shown in other display formats (e.g., skeletal) was necessary for CNNs to recognize point-light actions. The CNN models exhibited largely viewpoint-dependent recognition of actions, with a limited ability to generalize to viewpoints close to the training views. The CNNs predicted the inversion effect in the presence of global body configuration, but failed to predict the inversion effect driven solely by local motion signals. The CNNs provided a qualitative account of some behavioral results observed in human biological motion perception for fine discrimination tasks with noisy inputs, such as point-light actions with disrupted local motion signals, and walking actions with temporally misaligned motion cues. However, these successes are limited by the CNNs' lack of adaptive integration for form and motion processes, and failure to incorporate specialized mechanisms (e.g., a life detector) as well as top-down influences on biological motion perception.

The two-process theory of biological motion processing

Perception, identification, and understanding of others' actions from motion information are vital for our survival in the social world. A breakthrough in the understanding of action perception was the discovery that our visual system is sensitive to human action from the sparse motion input of only a dozen point lights, a phenomenon known as biological motion (BM) processing. Previous psychological and computational models cannot fully explain the emerging evidence for the existence of BM processing during early ontogeny. Here, we propose a two-process model of the mechanisms underlying BM processing. We hypothesize that the first system, the 'Step Detector,' rapidly processes the local foot motion and feet-below-the-body information that is specific to vertebrates, is less dependent on postnatal learning, and involves subcortical networks. The second system, the 'Bodily Action Evaluator,' slowly processes the fine global structure-from-motion, is specific to conspecific, and dependent on gradual learning processed in cortical networks. This proposed model provides new insight into research on the development of BM processing.

Heading perception from optic flow in the presence of biological motion

We investigated whether biological motion biases heading estimation from optic flow in a similar manner to nonbiological moving objects. In two experiments, observers judged their heading from displays depicting linear translation over a random-dot ground with normal point light walkers, spatially scrambled point light walkers, or laterally moving objects composed of random dots. In Experiment 1, we found that both types of walkers biased heading estimates similarly to moving objects when they obscured the focus of expansion of the background flow. In Experiment 2, we also found that walkers biased heading estimates when they did not obscure the focus of expansion. These results show that both regular and scrambled biological motion affect heading estimation in a similar manner to simple moving objects, and suggest that biological motion is not preferentially processed for the perception of self-motion.

Local Dot Motion, Not Global Configuration, Determines Dogs' Preference for Point-Light Displays

Visual perception remains an understudied area of dog cognition, particularly the perception of biological motion where the small amount of previous research has created an unclear impression regarding dogs' visual preference towards different types of point-light displays. To date, no thorough investigation has been conducted regarding which aspects of the motion contained in point-light displays attract dogs. To test this, pet dogs (N = 48) were presented with pairs of point-light displays with systematic manipulation of motion features (i.e., upright or inverted orientation, coherent or scrambled configuration, human or dog species). Results revealed a significant effect of inversion, with dogs directing significantly longer looking time towards upright than inverted dog point-light displays; no effect was found for scrambling or the scrambling-inversion interaction. No looking time bias was found when dogs were presented with human point-light displays, regardless of their orientation or configuration. The results of the current study imply that dogs' visual preference is driven by the motion of individual dots in accordance with gravity, rather than the point-light display's global arrangement, regardless their long exposure to human motion.

Emotional cues and social anxiety resolve ambiguous perception of biological motion

Perceptions of ambiguous biological motion are modulated by different individual cognitive abilities (such as inhibition and empathy) and emotional states (such as anxiety). This study explored facing-the-viewer bias (FTV) in perceiving ambiguous directions of biological motion, and investigated whether task-irrelevant simultaneous face emotional cues in the background and the individual social anxiety traits could affect FTV. We found that facial motion cues as background affect sociobiologically relevant scenarios, including biological motion, but not non-biological situations (conveyed through random dot motion). Individuals with high anxiety traits demonstrated a more dominant FTV bias than individuals with low anxiety traits. Ensemble coding-like processing of task-irrelevant multiple emotional cues could magnify the facing-the-viewer bias than did in the single emotional cue. Overall, those findings suggest a correlation between high-level emotional processing and high-level motion perception (subjective to attentional control) contributes to facing-the-viewer bias.

Behavioural evidence for distinct mechanisms related to global and biological motion perception

The perception of human motion is a vital ability in our daily lives. Human movement recognition is often studied using point-light stimuli in which dots represent the joints of a moving person. Depending on task and stimulus, the local motion of the single dots, and the global form of the stimulus can be used to discriminate point-light stimuli. Previous studies often measured motion coherence for global motion perception and contrasted it with performance in biological motion perception to assess whether difficulties in biological motion processing are related to more general difficulties with motion processing. However, it is so far unknown as to how performance in global motion tasks relates to the ability to use local motion or global form to discriminate point-light stimuli. Here, we investigated this relationship in more detail. In Experiment 1, we measured participants' ability to discriminate the facing direction of point-light stimuli that contained primarily local motion, global form, or both. In Experiment 2, we embedded point-light stimuli in noise to assess whether previously found relationships in task performance are related to the ability to detect signal in noise. In both experiments, we also assessed motion coherence thresholds from random-dot kinematograms. We found relationships between performances for the different biological motion stimuli, but performance for global and biological motion perception was unrelated. These results are in accordance with previous neuroimaging studies that highlighted distinct areas for global and biological motion perception in the dorsal pathway, and indicate that results regarding the relationship between global motion perception and biological motion perception need to be interpreted with caution.

The neural representation of human versus nonhuman bipeds and quadrupeds

How do humans recognize humans among other creatures? Recent studies suggest that a preference for conspecifics may emerge already in perceptual processing, in regions such as the right posterior superior temporal sulcus (pSTS), implicated in visual perception of biological motion. In the current functional MRI study, participants viewed point-light displays of human and nonhuman creatures moving in their typical bipedal (man and chicken) or quadrupedal mode (crawling-baby and cat). Stronger activity for man and chicken versus baby and cat was found in the right pSTS responsive to biological motion. The novel effect of pedalism suggests that, if right pSTS contributes to recognizing of conspecifics, it does so by detecting perceptual features (e.g. bipedal motion) that reliably correlate with their appearance. A searchlight multivariate pattern analysis could decode humans and nonhumans across pedalism in the left pSTS and bilateral posterior cingulate cortex. This result implies a categorical human-nonhuman distinction, independent from within-category physical/perceptual variation. Thus, recognizing conspecifics involves visual classification based on perceptual features that most frequently co-occur with humans, such as bipedalism, and retrieval of information that determines category membership above and beyond visual appearance. The current findings show that these processes are at work in separate brain networks.

Efficiencies for parts and wholes in biological-motion perception

People can reliably infer the actions, intentions, and mental states of fellow humans from body movements (Blake & Shiffrar, 2007). Previous research on such biological-motion perception has suggested that the movements of the feet may play a particularly important role in making certain judgments about locomotion (Chang & Troje, 2009; Troje & Westhoff, 2006). One account of this effect is that the human visual system may have evolved specialized processes that are efficient for extracting information carried by the feet (Troje & Westhoff, 2006). Alternatively, the motion of the feet may simply be more discriminable than that of other parts of the body. To dissociate these two possibilities, we measured people's ability to discriminate the walking direction of stimuli in which individual body parts (feet, hands) were removed or shown in isolation. We then compared human performance to that of a statistically optimal observer (Gold, Tadin, Cook, & Blake, 2008), giving us a measure of humans' discriminative ability independent of the information available (a quantity known as efficiency). We found that efficiency was highest when the hands and the feet were shown in isolation. A series of follow-up experiments suggested that observers were relying on a form-based cue with the isolated hands (specifically, the orientation of their path through space) and a motion-based cue with the isolated feet to achieve such high efficiencies. We relate our findings to previous proposals of a distinction between form-based and motion-based mechanisms in biological-motion perception.

Dopaminergic Modulation of Biological Motion Perception in patients with Parkinson's disease

Parkinson's disease (PD) is a progressive neurodegenerative disorder pathologically characterized by a selective loss of dopaminergic neurons in the substantia nigra. In previous studies, greater attention was paid to impairments in motor disturbances in contrast to impairments of cognitive function in PD that was often ignored. In present study, a duration discrimination paradigm was used to assess global and local biological motion (BM) perception in healthy controls(HCs) and PD patients with and without dopamine substitution treatment (DST). Biological motion sequences and inanimate motion sequences (inverted BM sequences) were sequentially presented on a screen. Observers were required to verbally make a 2-alternative forced-choice to indicate whether the first or second interval appeared longer. The stimuli involved global and local BM sequences. Statistical analyses were conducted on points of subjective equality (PSE). We found significant differences between untreated PD patients and HCs as well as differences between global and local BM conditions. PD patients have a deficit in both global and local BM perception. Nevertheless, these two BM conditions can be improved under DST. Our data indicates that BM perception may be damaged in PD patients and dopaminergic medication is conducive to maintain the BM perception in PD patients.

Recognising the Style of Spatially Exaggerated Tennis Serves

A technique for the construction of exaggerated human movements was developed and its effectiveness tested for the case of categorising tennis serves as flat, slice, or topspin. The technique involves treating movements as points in a high-dimensional space and uses average movements as the basis for constructing exaggerated movements. Exaggerated movements of a particular style are defined as those points in the space of movements which lie on a line originating at the style average and in the direction defined by the difference between the style average and the grand average. In order to visualise the movements, computer animation techniques were employed to transform the three-dimensional coordinates of the movement into the motion of a solid-body figure. These solid-body models were used in perceptual experiments to assess the effectiveness of the exaggeration technique. After an initial training session on the exemplars from the original library, subjects viewed the synthetic tennis-serve motions and in two separate sessions either made three-alternative, categorisation judgments after viewing a single serve or rated dissimilarity after viewing a pair of serves. Results from both accuracy in the categorisation task and structure of a multidimensional scaling solution of the matrix of dissimilarities indicated that, as distance from the grand average increased, the service motion became more distinct and more accurately identified.

Bistability and Biasing Effects in the Perception of Ambiguous Point-Light Walkers

The perceptually bistable character of point-light walkers has been examined in three experiments. A point-light figure without explicit depth cues constitutes a perfectly ambiguous stimulus: from all viewpoints, multiple interpretations are possible concerning the depth orientation of the figure. In the first experiment, it is shown that non-lateral views of the walker are indeed interpreted in two orientations, either as facing towards the viewer or as facing away from the viewer, but that the interpretation in which the walker is oriented towards the viewer is reported more frequently. In the second experiment the point-light figure was walking backwards, making the global orientation of the point-light figure opposite to the direction of global motion. The interpretation in which the walker was facing the viewer was again reported more frequently. The robustness of these findings was examined in the final experiment, in which the effects of disambiguating the stimulus by introducing a local depth cue (occlusion) or a more global depth cue (applying perspective projection) were explored.

Recognition of Biological Motion from Blurred Natural Scenes

Biological-motion perception can be regarded as a template-matching process. We are concerned with the visual cues in this template. Biological-motion perception is usually studied with point-light displays similar to the point-light displays invented by Johansson (1973 Perception & Psychophysics14 201 – 211). These stimuli are in some ways abstract. In order to use more natural stimuli, we recorded movies of different actions in natural scenes. By blurring the scenes we modified the visual cues, particularly the local form and motion information. Observers were asked to identify the action portrayed. Our results demonstrate that templates for biological-motion recognition combine global form and motion cues. Reductions of local form and local motion information by blurring can be compensated by global form change and global motion. Local motion information is also used for segmentation.

Response Priming with More or Less Biological Movements as Primes

Response priming in general is a suitable tool in cognitive psychology to investigate motor preactivations. Typically, compatibility effects reflect faster reactions in cases in which prime and target suggest the same response (i.e., compatible trials) compared with cases in which prime and target suggest opposite responses (i.e., incompatible trials). With moving dots that were horizontally aligned, Bermeitinger (2013) found a stable pattern of results: with short SOAs, faster responses in compatible trials were found; with longer SOAs up to 250 ms, faster responses in incompatible trials were found. It is unclear whether these results are specific to the special motion used therein or whether it generalizes to other motions. We therefore used other motions realized by arrangements of dots. In four experiments, we tested point-light displays (biological coherent walkers vs. less biological scrambled/split displays) as primes. In two experiments, eye gaze motions realized by moving dots representing irises and pupils (i.e., biological) versus the same motion either without surrounding face information or integrated in an abstract line drawing (i.e., less biological) were used. We found overall large positive compatibility effects with biological motion primes and also positive-but smaller-compatibility effects with less biological motion primes. Most important, also with very long SOAs (up to 1320 ms), we did not find evidence for negative compatibility effects. Thus, the pattern of positive-followed-by-negative-compatibility effects found in Bermeitinger (2013) seems to be specific to the materials used therein, whereas response priming in general seems an applicable tool to study motion perception.

Local form interference in biological motion perception

Replacing the local dots of point-light walkers with complex images leads to significant detriments to performance in biological motion detection and discrimination tasks. This detriment has previously been shown to be larger when the local elements match the global shape in object category and facing direction. In contrast, studies using Navon stimuli have demonstrated that local interference on global processing primarily occurs when local elements are dissimilar to the global form. In 3 experiments, we investigated this contradiction by replacing the local dots of a point-light walker with human images or stick figures. Participants were significantly faster and more accurate at discriminating the facing and walking direction of a walker when the local images were facing in the same direction as the global walker than when they were facing in the opposite direction. These results provide support for the idea that organization of biological motion depends on allocation of limited processing resources to the global motion information when the local elements are complex. However, there is more disruption to global form processing when the local elements and global form conflict in task-related properties.

TMS reveals flexible use of form and motion cues in biological motion perception

The perception of human movement is a key component of daily social interactions. Although extrastriate area MT+/V5 is closely associated with motion processing, its role in the processing of sparse 'biological motion' displays is still unclear. We developed two closed matched psychophysical tasks to assess simple coherent motion perception and biological motion perception, and measured changes in performance caused by application of TMS over MT+/V5. Performance of the simple motion discrimination task was significantly depressed by TMS stimulation, and highly correlated within observers in TMS conditions, but there was no significant decrement in performance of the biological motion task, despite low intra-observer correlations across TMS conditions. We conclude that extrastriate area MT+/V5 is an obligatory waypoint in the neural processing of simple coherent motion, but is not obligatory for the processing of biological motion. Results are consistent with a dual neural processing route for biological motion processing.

A comparison of form processing involved in the perception of biological and nonbiological movements

Although there is evidence for specialization in the human brain for processing biological motion per se, few studies have directly examined the specialization of form processing in biological motion perception. The current study was designed to systematically compare form processing in perception of biological (human walkers) to nonbiological (rotating squares) stimuli. Dynamic form-based stimuli were constructed with conflicting form cues (position and orientation), such that the objects were perceived to be moving ambiguously in two directions at once. In Experiment 1, we used the classification image technique to examine how local form cues are integrated across space and time in a bottom-up manner. By comparing with a Bayesian observer model that embodies generic principles of form analysis (e.g., template matching) and integrates form information according to cue reliability, we found that human observers employ domain-general processes to recognize both human actions and nonbiological object movements. Experiments 2 and 3 found differential top-down effects of spatial context on perception of biological and nonbiological forms. When a background does not involve social information, observers are biased to perceive foreground object movements in the direction opposite to surrounding motion. However, when a background involves social cues, such as a crowd of similar objects, perception is biased toward the same direction as the crowd for biological walking stimuli, but not for rotating nonbiological stimuli. The model provided an accurate account of top-down modulations by adjusting the prior probabilities associated with the internal templates, demonstrating the power and flexibility of the Bayesian approach for visual form perception.

Tactile input and empathy modulate the perception of ambiguous biological motion

Evidence has shown that task-irrelevant auditory cues can bias perceptual decisions regarding directional information associated with biological motion, as indicated in perceptual tasks using point-light walkers (PLWs) (Brooks et al., 2007). In the current study, we extended the investigation of cross-modal influences to the tactile domain by asking how tactile input resolves perceptual ambiguity in visual apparent motion, and how empathy plays a role in this cross-modal interaction. In Experiment 1, we simulated the tactile feedback on the observers' fingertips when the (upright or inverted) PLWs (comprised of either all red or all green dots) were walking (leftwards or rightwards). The temporal periods between tactile events and critical visual events (the PLW's feet hitting the ground) were manipulated so that the tap could lead, synchronize, or lag the visual foot-hitting-ground event. We found that the temporal structures between tactile (feedback) and visual (hitting) events systematically biases the directional perception for upright PLWs, making either leftwards or rightwards more dominant. However, this effect was absent for inverted PLWs. In Experiment 2, we examined how empathy modulates cross-modal capture. Instead of giving tactile feedback on participants' fingertips, we gave taps on their ankles and presented the PLWs with motion directions of approaching (facing toward observer)/receding (facing away from observer) to resemble normal walking postures. With the same temporal structure, we found that individuals with higher empathy were more subject to perceptual bias in the presence of tactile feedback. Taken together, our findings showed that task-irrelevant tactile input can resolve the otherwise ambiguous perception of the direction of biological motion, and this cross-modal bias was mediated by higher level social-cognitive factors, including empathy.

Deficient local biological motion perception in migraineurs: results from a duration discrimination paradigm

Migraine ranks as the third most common disease in the world and has caused significant losses of daily life abilities. Previously, people gave more attention to the pain of migraines and usually ignored the impairments of cognitive function in migraineurs. In the present study, a duration discrimination paradigm was used to assess the global and local biological motion perception in migraineurs and healthy controls. In the experiment, biological motion sequences and inanimate motion sequences (the inverted biological motion sequences) were sequentially presented on a screen. Observers were instructed to make a two-alternative forced choice to accurately indicate which interval (the first or the second) appeared longer. The stimuli involved global biological motion sequences and local biological motion sequences. The statistical analyses were conducted on the points of subjective equality that were obtained by fitting a psychometric function to each individual observer's data. In migraineurs, global biological motion signals lengthened the perceived temporal duration (as occurs in normal people), whereas local biological motion signals did not have this temporal dilation effect. The results indicated that patients with migraine showed a deficit in local biological motion perception, whereas their global biological motion perception was comparable to that of healthy subjects.

Individual differences in the perception of biological motion and fragmented figures are not correlated

We live in a cluttered, dynamic visual environment that poses a challenge for the visual system: for objects, including those that move about, to be perceived, information specifying those objects must be integrated over space and over time. Does a single, omnibus mechanism perform this grouping operation, or does grouping depend on separate processes specialized for different feature aspects of the object? To address this question, we tested a large group of healthy young adults on their abilities to perceive static fragmented figures embedded in noise and to perceive dynamic point-light biological motion figures embedded in dynamic noise. There were indeed substantial individual differences in performance on both tasks, but none of the statistical tests we applied to this data set uncovered a significant correlation between those performance measures. These results suggest that the two tasks, despite their superficial similarity, require different segmentation and grouping processes that are largely unrelated to one another. Whether those processes are embodied in distinct neural mechanisms remains an open question.

Responses of Anterior Superior Temporal Polysensory (STPa) Neurons to "Biological Motion" Stimuli

Abstract Cells have been found in the superior temporal polysensory area (STPa) of the macaque temporal cortex that are selectively responsive to the sight of particular whole body movements (e.g., walking) under normal lighting. These cells typically discriminate the direction of walking and the view of the body (e.g., left profile walking left). We investigated the extent to which these cells are responsive under "biological motion" conditions where the form of the body is defined only by the movement of light patches attached to the points of limb articulation. One-third of the cells (25/72) selective for the form and motion of walking bodies showed sensitivity to the moving light displays. Seven of these cells showed only partial sensitivity to form from motion, in so far as the cells responded more to moving light displays than to moving controls but failed to discriminate body view. These seven cells exhibited directional selectivity. Eighteen cells showed statistical discrimination for both direction of movement and body view under biological motion conditions. Most of these cells showed reduced responses to the impoverished moving light stimuli compared to full light conditions. The 18 cells were thus sensitive to detailed form information (body view) from the pattern of articulating motion. Cellular processing of the global pattern of articulation was indicated by the observations that none of these cells were found sensitive to movement of individual limbs and that jumbling the pattern of moving limbs reduced response magnitude. A further 10 cells were tested for sensitivity to moving light displays of whole body actions other than walking. Of these cells 5/10 showed selectivity for form displayed by biological motion stimuli that paralleled the selectivity under normal lighting conditions. The cell responses thus provide direct evidence for neural mechanisms computing form from nonrigid motion. The selectivity of the cells was for body view, specific direction, and specific type of body motion presented by moving light displays and is not predicted by many current computational approaches to the extraction of form from motion.

Contribution of coherent motion to the perception of biological motion among persons with Schizophrenia

People with schizophrenia (SCZ) are impaired in several domains of visual processing, including the discrimination and detection of biological motion. However, the mechanisms underlying SCZ-related biological motion processing deficits are unknown. Moreover, whether these impairments are specific to biological motion or represent a more widespread visual motion processing deficit is unclear. In the current study, three experiments were conducted to investigate the contribution of global coherent motion processing to biological motion perception among patients with SCZ. In Experiments 1 and 2, participants with SCZ (n = 33) and healthy controls (n = 33) were asked to discriminate the direction of motion from upright and inverted point-light walkers in the presence and absence of a noise mask. Additionally, participants discriminated the direction of non-biological global coherent motion. In Experiment 3, participants discriminated the direction of motion from upright scrambled walkers (which contained only local motion information) and upright random position walkers (which contained only global form information). Consistent with previous research, results from Experiment 1 and 2 showed that people with SCZ exhibited deficits in the direction discrimination of point-light walkers; however, this impairment was accounted for by decreased performance in the coherent motion control task. Furthermore, results from Experiment 3 demonstrated similar performance in the discrimination of scrambled and random position point-light walkers.

Interactions between motion and form processing in the human visual system

The predominant view of motion and form processing in the human visual system assumes that these two attributes are handled by separate and independent modules. Motion processing involves filtering by direction-selective sensors, followed by integration to solve the aperture problem. Form processing involves filtering by orientation-selective and size-selective receptive fields, followed by integration to encode object shape. It has long been known that motion signals can influence form processing in the well-known Gestalt principle of common fate; texture elements which share a common motion property are grouped into a single contour or texture region. However, recent research in psychophysics and neuroscience indicates that the influence of form signals on motion processing is more extensive than previously thought. First, the salience and apparent direction of moving lines depends on how the local orientation and direction of motion combine to match the receptive field properties of motion-selective neurons. Second, orientation signals generated by "motion-streaks" influence motion processing; motion sensitivity, apparent direction and adaptation are affected by simultaneously present orientation signals. Third, form signals generated by human body shape influence biological motion processing, as revealed by studies using point-light motion stimuli. Thus, form-motion integration seems to occur at several different levels of cortical processing, from V1 to STS.

Physical and Biological Constraints Govern Perceived Animacy of Scrambled Human Forms

Point-light animations of biological motion are perceived quickly and spontaneously, giving rise to an irresistible sensation of animacy. However, the mechanisms that support judgments of animacy based on biological motion remain unclear. The current study demonstrates that animacy ratings increase when a spatially scrambled animation of human walking maintains consistency with two fundamental constraints: the direction of gravity and congruency between the directions of intrinsic and extrinsic motion. Furthermore, using a reverse-correlation method, we show that observers employ structural templates, or form-based “priors,” reflecting the prototypical mammalian body plan when attributing animacy to scrambled human forms. These findings reveal that perception of animacy in scrambled biological motion involves not only analysis of local intrinsic motion, but also its congruency with global extrinsic motion and global spatial structure. Thus, they suggest a strong influence of prior knowledge about characteristic features of creatures in the natural environment.

Non-conscious processing of motion coherence can boost conscious access

Research on the scope and limits of non-conscious vision can advance our understanding of the functional and neural underpinnings of visual awareness. Here we investigated whether distributed local features can be bound, outside of awareness, into coherent patterns. We used continuous flash suppression (CFS) to create interocular suppression, and thus lack of awareness, for a moving dot stimulus that varied in terms of coherence with an overall pattern (radial flow). Our results demonstrate that for radial motion, coherence favors the detection of patterns of moving dots even under interocular suppression. Coherence caused dots to break through the masks more often: this indicates that the visual system was able to integrate low-level motion signals into a coherent pattern outside of visual awareness. In contrast, in an experiment using meaningful or scrambled biological motion we did not observe any increase in the sensitivity of detection for meaningful patterns. Overall, our results are in agreement with previous studies on face processing and with the hypothesis that certain features are spatiotemporally bound into coherent patterns even outside of attention or awareness.

Developmental changes in point-light walker processing during childhood: a two-year follow-up ERP study

Event-related potentials were measured in twenty-four children aged 6-15 years, at one-year intervals for two years, to investigate developmental changes in each subject's neural response to a point-light walker (PLW) and a scrambled PLW (sPLW) stimulus. One positive peak (P1) and two negative peaks (N1 and N2) were observed in both occipitotemporal regions at approximately 130, 200, and 300-400ms. The amplitude and latency of the P1 component measured by the occipital electrode decreased during development over the first one-year period. Negative amplitudes of both N1 and N2, induced by the PLW stimulus, were significantly larger than those induced by the sPLW stimulus. Moreover, for the P1-N1 amplitude, the values for the eight-year-old children were significantly larger than those for the twelve-year-old children. N1 and N2 latency at certain electrodes decreased with age, but no consistent changes were observed. These results suggest that enhanced electrophysiological responses to PLW can be observed in all age groups, and that the early components were changed even over the course of a single year at the age of twelve.

Local-to-global form interference in biological motion perception

Point-light walkers have been useful to study the contribution of form and motion to biological motion perception by manipulating the lifetime, number, or spatial distribution of the light points. Recent studies have also manipulated the light points themselves, replacing them with small images of objects. This manipulation degraded the recognizability of biological motion, particularly for local images of human bodies. This result suggests an interference of body form information in the local images with the body form analysis necessary for global biological motion recognition at the global level. We further explored this interference with respect to its selectivity for body orientation and motion. Participants had to either discriminate the facing direction (left/right) or the walking direction (forward/backward) of a global walker composed of local stick figures that could face left or right and either stand still or walk forward or backward. Local stick figures interfered stronger with the facing direction task if they were facing in the same direction as the global walker. Walking (forward/backward/static) of the stick figures influenced neither the facing direction task nor the walking direction task. We conclude that the interference is highly specific since it concerns not only the category (human form), but even the facing direction.

Life motion signals lengthen perceived temporal duration

Point-light biological motions, conveying various different attributes of biological entities, have particular spatiotemporal properties that enable them to be processed with remarkable efficiency in the human visual system. Here we demonstrate that such signals automatically lengthen their perceived temporal duration independent of global configuration and without observers' subjective awareness of their biological nature. By using a duration discrimination paradigm, we showed that an upright biological motion sequence was perceived significantly longer than an inverted but otherwise identical sequence of the same duration. Furthermore, this temporal dilation effect could be extended to spatially scrambled biological motion signals, whose global configurations were completely disrupted, regardless of whether observers were aware of the nature of the stimuli. However, such an effect completely disappeared when critical biological characteristics were removed. Taken together, our findings suggest a special mechanism of time perception tuned to life motion signals and shed new light on the temporal encoding of biological motion.

Body Configuration Modulates the Usage of Local Cues to Direction in Biological-Motion Perception

The presence of information in a visual display does not guarantee its use by the visual system. Studies of inversion effects in both face recognition and biological-motion perception have shown that the same information may be used by observers when it is presented in an upright display but not used when the display is inverted. In our study, we tested the inversion effect in scrambled biological-motion displays to investigate mechanisms that validate information contained in the local motion of a point-light walker. Using novel biological-motion stimuli that contained no configural cues to the direction in which a walker was facing, we found that manipulating the relative vertical location of the walker’s feet significantly affected observers’ performance on a direction-discrimination task. Our data demonstrate that, by themselves, local cues can almost unambiguously indicate the facing direction of the agent in biological-motion stimuli. Additionally, we document a noteworthy interaction between local and global information and offer a new explanation for the effect of local inversion in biological-motion perception.

Effects of visual context upon functional connectivity during observation of biological motions

The aim of this study was to examine brain responses, in particular functional connectivity, to different visual stimuli depicting familiar biological motions. Ten subjects actively observed familiar biological motions embedded in point-light and video displays. Electroencephalograms were recorded from 64 electrodes. Activity was considered in three frequency bands (4-8 Hz, 8-10 Hz, and 10-13 Hz) using a non-linear measure of functional connectivity. In the 4-8 Hz and 8-10 Hz frequency bands, functional connectivity for the SMA was greater during the observation of biological motions presented in a point-light display compared to the observation of motions presented in a video display. The reverse was observed for the 4-8 Hz frequency band for the left temporal area. Explanations related to: (i) the task demands (i.e., attention and mental effort), (ii) the role(s) of theta and alpha oscillations in cognitive processes, and (iii) the function(s) of cortical areas are discussed. It has been suggested that attention was required to process human biological motions under unfamiliar viewing conditions such as point-light display.