Perceiving human locomotion: priming effects in direction discrimination

PLAViMoP database: A new continuously assessed and collaborative 3D point-light display dataset

It was more than 45 years ago that Gunnar Johansson invented the point-light display technique. This showed for the first time that kinematics is crucial for action recognition, and that humans are very sensitive to their conspecifics' movements. As a result, many of today's researchers use point-light displays to better understand the mechanisms behind this recognition ability. In this paper, we propose PLAViMoP, a new database of 3D point-light displays representing everyday human actions (global and fine-motor control movements), sports movements, facial expressions, interactions, and robotic movements. Access to the database is free, at https://plavimop.prd.fr/en/motions . Moreover, it incorporates a search engine to facilitate action retrieval. In this paper, we describe the construction, functioning, and assessment of the PLAViMoP database. Each sequence was analyzed according to four parameters: type of movement, movement label, sex of the actor, and age of the actor. We provide both the mean scores for each assessment of each point-light display, and the comparisons between the different categories of sequences. Our results are discussed in the light of the literature and the suitability of our stimuli for research and applications.

Exploring biological motion perception in two-stream convolutional neural networks

Visual recognition of biological motion recruits form and motion processes supported by both dorsal and ventral pathways. This neural architecture inspired the two-stream convolutional neural network (CNN) model, which includes a spatial CNN to process appearance information in a sequence of image frames, a temporal CNN to process optical flow information, and a fusion network to integrate the features extracted by the two CNNs and make final decisions about action recognition. In five simulations, we compared the CNN model's performance with classical findings in biological motion perception. The CNNs trained with raw RGB action videos showed weak performance in recognizing point-light actions. Additional transfer training with actions shown in other display formats (e.g., skeletal) was necessary for CNNs to recognize point-light actions. The CNN models exhibited largely viewpoint-dependent recognition of actions, with a limited ability to generalize to viewpoints close to the training views. The CNNs predicted the inversion effect in the presence of global body configuration, but failed to predict the inversion effect driven solely by local motion signals. The CNNs provided a qualitative account of some behavioral results observed in human biological motion perception for fine discrimination tasks with noisy inputs, such as point-light actions with disrupted local motion signals, and walking actions with temporally misaligned motion cues. However, these successes are limited by the CNNs' lack of adaptive integration for form and motion processes, and failure to incorporate specialized mechanisms (e.g., a life detector) as well as top-down influences on biological motion perception.

PLAViMoP: How to standardize and simplify the use of point-light displays

The study of biological point-light displays (PLDs) has fascinated researchers for more than 40 years. However, the mechanisms underlying PLD perception remain unclear, partly due to difficulties with precisely controlling and transforming PLD sequences. Furthermore, little agreement exists regarding how transformations are performed. This article introduces a new free-access program called PLAViMoP (Point-Light Display Visualization and Modification Platform) and presents the algorithms for PLD transformations actually included in the software. PLAViMoP fulfills two objectives. First, it standardizes and makes clear many classical spatial and kinematic transformations described in the PLD literature. Furthermore, given its optimized interface, PLAViMOP makes these transformations easy and fast to achieve. Overall, PLAViMoP could directly help scientists avoid technical difficulties and make possible the use of PLDs for nonacademic applications.

Neural basis of altered earlier attention and higher order biological motion processing in schizophrenia

Schizophrenia patients have impairments of biological motion (BM) perception, which provides critical information about social cognition. Because social cognition is underpinned by attention, the impairments of BM perception in schizophrenia could be partially attributable to altered attention. To elucidate the impairments in attention and social perception in schizophrenia, we investigated the neural basis of impaired BM processing using MRI in respect to attention deficits by eye tracker. Voxel-based morphometry was performed to evaluate the relationship between BM perception and gray matter (GM) volume. The temporo-parietal junction (TPJ) and anterior superior temporal sulcus (aSTS) were related to task accuracy. However, when the effect of attention (i.e., eye movement) was controlled, the relationship in TPJ became non-significant, while aSTS showed a significant relationship with BM perception. Alteration in TPJ might be associated with inefficient attentional strategy, whereas dysfunctional aSTS might be correlated with deficit in higher order BM processing per se. Several cognitive levels as well as corresponding brain areas are possibly involved in the manifestation of social cognitive deficits in schizophrenia.

Motion Induction from Biological Motion

A new type of motion illusion is described in which ambiguous motion becomes unidirectional on superimposition of a human figure walking on a treadmill. A point-light walker in profile was superimposed on a vertical counterphase grating backdrop. Eleven naïve observers judged the apparent direction of motion against the grating as left or right in a two-alternative forced-choice task and found that the grating appeared to drift in a direction opposite to the walking. The illusion disappeared when the point lights moved in scrambled configurations. This indicates that the illusion is caused by biological motion that provides recognition of gaits. A human figure walking backwards produced no illusion because of the difficulty in identifying the gait. This indicates that the illusion is determined by translational motion rather than form represented from biological motion.

Communicative interactions in point-light displays: Choosing among multiple response alternatives

Vision scientists are increasingly relying on the point-light technique as a way to investigate the perception of human motion. Unfortunately, the lack of standardized stimulus sets has so far limited the use of this technique for studying social interaction. Here, we describe a new tool to study the interaction between two agents starting from point-light displays: the Communicative Interaction Database - 5AFC format (CID-5). The CID-5 consists of 14 communicative and seven non-communicative individual actions performed by two agents. Stimuli were constructed by combining motion capture techniques and 3-D animation software to provide precise control over the computer-generated actions. For each action stimulus, we provide coordinate files and movie files depicting the action as seen from four different perspectives. Furthermore, the archive contains a text file with a list of five alternative action descriptions to construct forced-choice paradigms. In order to validate the CID-5 format, we provide normative data collected to assess action identification within a 5AFC tasks. The CID-5 archive is freely downloadable from http://bsb-lab.org/research/ and from the supplementary materials of this article.

Perception of Elliptic Biological Motion

We tested the ability of the mature visual system for discrimination between types of elliptic biological motion on the basis of event kinematics. Healthy adult volunteers were presented with point-light displays depicting elliptic motion when only a single dot, a moving point-light arm, or a whole point-light human figure was visible. The displays were created in accordance with the two-thirds power kinematic law ( natural motion), whereas the control displays violated this principle ( unnatural motion). On each trial, participants judged whether the display represented natural or unnatural motion. The findings indicate that adults are highly sensitive to violation of the two-thirds power kinematic law. Notably, participants can easily discriminate between natural and unnatural motions without recognising the stimuli, which suggests that people implicitly use kinematic information. Most intriguing, event recognition seems to diminish the capacity to judge whether event kinematics is unnatural. We discuss possible ways for a cross-talk between perception and production of biological movement, and the brain mechanisms involved in biological motion processing.

Bistability and Biasing Effects in the Perception of Ambiguous Point-Light Walkers

The perceptually bistable character of point-light walkers has been examined in three experiments. A point-light figure without explicit depth cues constitutes a perfectly ambiguous stimulus: from all viewpoints, multiple interpretations are possible concerning the depth orientation of the figure. In the first experiment, it is shown that non-lateral views of the walker are indeed interpreted in two orientations, either as facing towards the viewer or as facing away from the viewer, but that the interpretation in which the walker is oriented towards the viewer is reported more frequently. In the second experiment the point-light figure was walking backwards, making the global orientation of the point-light figure opposite to the direction of global motion. The interpretation in which the walker was facing the viewer was again reported more frequently. The robustness of these findings was examined in the final experiment, in which the effects of disambiguating the stimulus by introducing a local depth cue (occlusion) or a more global depth cue (applying perspective projection) were explored.

Response Priming with More or Less Biological Movements as Primes

Response priming in general is a suitable tool in cognitive psychology to investigate motor preactivations. Typically, compatibility effects reflect faster reactions in cases in which prime and target suggest the same response (i.e., compatible trials) compared with cases in which prime and target suggest opposite responses (i.e., incompatible trials). With moving dots that were horizontally aligned, Bermeitinger (2013) found a stable pattern of results: with short SOAs, faster responses in compatible trials were found; with longer SOAs up to 250 ms, faster responses in incompatible trials were found. It is unclear whether these results are specific to the special motion used therein or whether it generalizes to other motions. We therefore used other motions realized by arrangements of dots. In four experiments, we tested point-light displays (biological coherent walkers vs. less biological scrambled/split displays) as primes. In two experiments, eye gaze motions realized by moving dots representing irises and pupils (i.e., biological) versus the same motion either without surrounding face information or integrated in an abstract line drawing (i.e., less biological) were used. We found overall large positive compatibility effects with biological motion primes and also positive-but smaller-compatibility effects with less biological motion primes. Most important, also with very long SOAs (up to 1320 ms), we did not find evidence for negative compatibility effects. Thus, the pattern of positive-followed-by-negative-compatibility effects found in Bermeitinger (2013) seems to be specific to the materials used therein, whereas response priming in general seems an applicable tool to study motion perception.

Perceiving the direction of articulatory motion in point-light actions

Human observers are able to perceive the motion direction of actions (either forward or backward) on the basis of the articulatory, relative motion of the limbs, even when the actions are shown under point-light conditions. However, most studies have focused on the action of walking. The primary purpose of the present study is to further investigate the perception of articulatory motion in different point-light actions (walking, crawling, hand walking, and rowing). On each trial, participants were presented with a forward or backward moving person and they had to decide on the direction of articulatory motion of the person. We analyzed sensitivity (d') as well as response bias (c). In addition to the type of action, the diagnosticity of the available information was manipulated by varying the visibility of the body parts (full body, only upper limbs, or only lower limbs) and the viewpoint from which the action was seen (from frontal view to sagittal view). We observe that, depending on the specific action, perception of direction of motion is driven by different body parts. Implications for the possible existence of a life detector, i.e., an evolutionarily old and innate visual filter that is tuned to quickly and automatically detect the presence of a moving living organism and direct attention to it, are discussed.

Visual processing and social cognition in schizophrenia: relationships among eye movements, biological motion perception, and empathy

Schizophrenia patients have impairments at several levels of cognition including visual attention (eye movements), perception, and social cognition. However, it remains unclear how lower-level cognitive deficits influence higher-level cognition. To elucidate the hierarchical path linking deficient cognitions, we focused on biological motion perception, which is involved in both the early stage of visual perception (attention) and higher social cognition, and is impaired in schizophrenia. Seventeen schizophrenia patients and 18 healthy controls participated in the study. Using point-light walker stimuli, we examined eye movements during biological motion perception in schizophrenia. We assessed relationships among eye movements, biological motion perception and empathy. In the biological motion detection task, schizophrenia patients showed lower accuracy and fixated longer than healthy controls. As opposed to controls, patients exhibiting longer fixation durations and fewer numbers of fixations demonstrated higher accuracy. Additionally, in the patient group, the correlations between accuracy and affective empathy index and between eye movement index and affective empathy index were significant. The altered gaze patterns in patients indicate that top-down attention compensates for impaired bottom-up attention. Furthermore, aberrant eye movements might lead to deficits in biological motion perception and finally link to social cognitive impairments. The current findings merit further investigation for understanding the mechanism of social cognitive training and its development.

Detecting temporal reversals in human locomotion

An experiment investigated the ability by human observers to detect temporal reversals in dynamic displays of human locomotion. We video-taped the lower portion of the body of actors walking at their preferred speed either in the normal, forward direction (FW) or in the backward direction (BW). The videos were presented in a random order either as recorded (N) or in reverse (R). In one session, we presented both normal and time-reversed stimuli in the original upright orientation. In a second session, the stimuli were rotated by 180° around the horizontal axis. Observers were informed that the real recorded movement was either forward or backward and were asked to decide whether or not the movement had been time-reversed prior to the presentation. Although the kinematics of forward and backward human locomotion is quite similar, the detection of temporal reversals followed a consistent pattern showing a good accuracy in condition FW-N and a reduced but still above-chance performance in condition BW-R (by design, in both conditions actors appeared to walk forward). Performance was instead at chance level in the other two conditions where the apparent direction of the movement was backward. Inverting the spatial orientation of the stimuli reduced but did not suppress the ability to detect temporal reversals in the two conditions with apparent forward direction of movement. It is argued that implicit motor competence is at least in part instrumental for extracting the subtle discriminal information from the stimuli.

Neural correlates of coherent and biological motion perception in autism

Recent evidence suggests those with autism may be generally impaired in visual motion perception. To examine this, we investigated both coherent and biological motion processing in adolescents with autism employing both psychophysical and fMRI methods. Those with autism performed as well as matched controls during coherent motion perception but had significantly higher thresholds for biological motion perception. The autism group showed reduced posterior Superior Temporal Sulcus (pSTS), parietal and frontal activity during a biological motion task while showing similar levels of activity in MT+/V5 during both coherent and biological motion trials. Activity in MT+/V5 was predictive of individual coherent motion thresholds in both groups. Activity in dorsolateral prefrontal cortex (DLPFC) and pSTS was predictive of biological motion thresholds in control participants but not in those with autism. Notably, however, activity in DLPFC was negatively related to autism symptom severity. These results suggest that impairments in higher-order social or attentional networks may underlie visual motion deficits observed in autism.

The facing bias in biological motion perception: structure, kinematics, and body parts

Depth-ambiguous point-light walkers (PLWs) elicit a facing bias: Observers perceive a PLW as facing toward them more often than as facing away (Vanrie,Dekeyser, & Verfaillie, Perception, 33, 547-560, 2004). While the facing bias correlates with the PLW's perceived gender (Brooks et al., Current Biology, 18, R728-R729, 2008; Schouten, Troje, Brooks, van der Zwan, & Verfaillie, Attention, Perception, & Psychophysics, 72,1256-1260, 2010), it remains unclear whether the change in perceived in-depth orientation is caused by a change in perceived gender. In Experiment 1, we show that structural and kinematic stimulus properties that lead to the same changes in perceived gender elicit opposite changes in perceived in-depth orientation, indicating that the relation between perceived gender and in-depth orientation is not causal. The results of Experiments 2 and 3 further suggest that the perceived in-depth orientation of PLWs is strongly affected by locally acting stimulus properties. The facing bias seems to be induced by stimulus properties in the lower part of the PLW.

The effect of looming and receding sounds on the perceived in-depth orientation of depth-ambiguous biological motion figures

BACKGROUND

The focus in the research on biological motion perception traditionally has been restricted to the visual modality. Recent neurophysiological and behavioural evidence, however, supports the idea that actions are not represented merely visually but rather audiovisually. The goal of the present study was to test whether the perceived in-depth orientation of depth-ambiguous point-light walkers (plws) is affected by the presentation of looming or receding sounds synchronized with the footsteps.

METHODOLOGY/PRINCIPAL FINDINGS

In Experiment 1 orthographic frontal/back projections of plws were presented either without sound or with sounds of which the intensity level was rising (looming), falling (receding) or stationary. Despite instructions to ignore the sounds and to only report the visually perceived in-depth orientation, plws accompanied with looming sounds were more often judged to be facing the viewer whereas plws paired with receding sounds were more often judged to be facing away from the viewer. To test whether the effects observed in Experiment 1 act at a perceptual level rather than at the decisional level, in Experiment 2 observers perceptually compared orthographic plws without sound or paired with either looming or receding sounds to plws without sound but with perspective cues making them objectively either facing towards or facing away from the viewer. Judging whether either an orthographic plw or a plw with looming (receding) perspective cues is visually most looming becomes harder (easier) when the orthographic plw is paired with looming sounds.

CONCLUSIONS/SIGNIFICANCE

The present results suggest that looming and receding sounds alter the judgements of the in-depth orientation of depth-ambiguous point-light walkers. While looming sounds are demonstrated to act at a perceptual level and make plws look more looming, it remains a challenge for future research to clarify at what level in the processing hierarchy receding sounds affect how observers judge the in-depth perception of plws.

Anthropomorphism influences perception of computer-animated characters' actions

Computer-animated characters are common in popular culture and have begun to be used as experimental tools in social cognitive neurosciences. Here we investigated how appearance of these characters' influences perception of their actions. Subjects were presented with different characters animated either with motion data captured from human actors or by interpolating between poses (keyframes) designed by an animator, and were asked to categorize the motion as biological or artificial. The response bias towards 'biological', derived from the Signal Detection Theory, decreases with characters' anthropomorphism, while sensitivity is only affected by the simplest rendering style, point-light displays. fMRI showed that the response bias correlates positively with activity in the mentalizing network including left temporoparietal junction and anterior cingulate cortex, and negatively with regions sustaining motor resonance. The absence of significant effect of the characters on the brain activity suggests individual differences in the neural responses to unfamiliar artificial agents. While computer-animated characters are invaluable tools to investigate the neural bases of social cognition, further research is required to better understand how factors such as anthropomorphism affect their perception, in order to optimize their appearance for entertainment, research or therapeutic purposes.

Observing or producing a motor action improves later perception of biological motion: evidence for a gender effect

Two experiments are presented addressing the issue of whether observing (visual priming) or producing (motor priming) a running activity during a very short period (30s) facilitates the perception of the direction of a point-light runner embedded in a dense dynamical mask. Experiment 1 showed that perceptual judgements improved and response time increased in the visual priming compared to the neutral priming condition (video of a moving car) in which judgements were at random. Because this effect was observed for male participants only, we performed a second experiment with the aim of evaluating the role of gender congruency in the visual priming condition. Results confirmed the facilitation effect and demonstrated that this effect was strictly dependent on the gender congruency between the perceiver and the priming information. Moreover, we found that actually producing a motor activity similar to the one presented in the video sequence improved to the same extent participants' judgement of the direction of the point-light runner, without any gender effect. As a whole, these findings argue in favour of common representation for the perception and the production of human movement and showed that the perception of biological motion can be improved by prior motor activity either performed or observed. However, the gender-dependent effect of visual priming suggested that motor repertoire differed in males and females.

Determining the point of subjective ambiguity of ambiguous biological-motion figures with perspective cues

Orthographic frontal/back projections of biological-motion figures are bistable: The point-light figure in principle can be perceived either as facing toward the viewer or as facing away from the viewer. Some point-light actions--for example, walking--elicit a strong "facing bias": Despite the absence of objective cues to depth, observers tend to interpret the figure as facing toward the viewer in most of the cases. In this article, we present and experimentally validate a technique that affords full experimental control of the perceived in-depth orientation of point-light figures. We demonstrate that by parametrically manipulating the amount of perspective information in the stimulus, it is possible to obtain any desired level of subjective ambiguity. Directions for future research, in which this technique can be fruitfully implemented, are suggested. Program code of a demo is provided that can be modified easily for program code of new experiments. The demo and QuickTime movie files illustrating our perspective manipulation technique may be downloaded from http://brm.psychonomic-journals.org/content/supplemental.

Anger and happiness are linked differently to the explicit detection of biological motion

The detection of biological motion and the detection of emotion from this motion are important visual functions with obvious survival and social values. The perception of biological motion is remarkably robust, and numerous studies have shown that the emotional states of a person can be deduced from point-light biological motion. In the present study, we investigated the extent to which the detection of emotion from biological motion is linked to the explicit detection of human gait. Subjects performed gait detection and emotion detection for the same stimulus. The stimulus consisted of one coherent interval and one scrambled biological-motion interval, each of which contained one emotionally neutral and one emotional (angry or happy) walker. Significant correlations with gait detection performance were observed for anger detection but not necessarily for happiness detection, implying that the detection of anger may be more strongly linked to explicit gait detection. This leads to a hypothesis that differential dependence may reflect the differential behavioural meaning between anger and happiness detection; it may be more crucial to localise or identify a person with anger than happiness.

Off on the Wrong Foot: Local Features in Biological Motion

Biological-motion perception consists of a number of different phenomena. They include global mechanisms that support the retrieval of the coherent shape of a walker, but also mechanisms which derive information from the local motion of its parts about facing direction and animacy, independent of the particular shape of the display. A large body of the literature on biological-motion perception is based on a synthetic stimulus generated by an algorithm published by James Cutting in 1978 ( Perception7 393–405). Here we show that this particular stimulus lacks a visual invariant inherent to the local motion of the feet of a natural walker, which in more realistic motion patterns indicates the facing direction of a walker independent of its shape. Comparing Cutting's walker to a walker derived from motion-captured data of real human walkers, we find no difference between the two displays in a detection task designed such that observers had to rely on global shape. In a direction discrimination task, however, in which only local motion was accessible to the observer, performance on Cutting's walker was at chance, while direction could still be retrieved from the stimuli derived from the real walker.

Simple movement imitation: are kinematic features sufficient to map perceptions into actions?

The aim of this study was to pinpoint the nature of the visual features used in the automatic mapping of perceived movements into similar executed movements, following the direct matching hypothesis. In Experiment 1 subjects imitated the lifting of one of two fingers, presented with different orientations. As predicted, stimuli which were further rotated away from the posture of the executing hand elicited slower reaction times. In Experiment 2, we verified that this orientation effect was not a purely perceptual effect by presenting the same stimuli but asking subjects to respond verbally. No orientation effect was found using a verbal response. In Experiment 3, we replaced the moving fingers by two arbitrary objects moving with the trajectories of the finger tips of Experiment 1. The same orientation effect as in Experiment 1 was observed. We conclude that in this experiment participants are using purely kinematic features to map perceived into executed movements.

Behavioral speed contagion: automatic modulation of movement timing by observation of body movements

To coordinate our actions with those of others, it is crucial to not only choose an appropriate category of action but also to execute it at an appropriate timing. It is widely documented that people tend to unconsciously mimic others' behavior. The present study show that people also tend to modify their movement timing according to others' movements even when the observed and the to-be-executed movements are unrelated. Observers viewed either point-light biological motion, scrambled biological motion, or solid object motion. The stimulus sequence was presented at three different (half, normal, and double) rates. After a 300-2400-ms blank period, the observers performed a simple choice reaction-time task that was unrelated to the presented stimulus sequence. The observation of the biological motion produced a negative correlation between reaction time and stimulus speed, whereas no such trend was observed with the scrambled or solid object motion. Furthermore, speed-dependent modulation occurred only when the task was imposed within approximately 1s after the offset of the biological motion. These results suggest that behavioral tempo may be contagious; the speed of others' movements may automatically influence the timing of movement execution by the observer.

Perception of Human Motion

Humans, being highly social creatures, rely heavily on the ability to perceive what others are doing and to infer from gestures and expressions what others may be intending to do. These perceptual skills are easily mastered by most, but not all, people, in large part because human action readily communicates intentions and feelings. In recent years, remarkable advances have been made in our understanding of the visual, motoric, and affective influences on perception of human action, as well as in the elucidation of the neural concomitants of perception of human action. This article reviews those advances and, where possible, draws links among those findings.

A motion capture library for the study of identity, gender, and emotion perception from biological motion

We present the methods that were used in capturing a library of human movements for use in computer-animated displays of human movement. The library is an attempt to systematically tap into and represent the wide range of personal properties, such as identity, gender, and emotion, that are available in a person's movements. The movements from a total of 30 nonprofessional actors (15 of them female) were captured while they performed walking, knocking, lifting, and throwing actions, as well as their combination in angry, happy, neutral, and sad affective styles. From the raw motion capture data, a library of 4,080 movements was obtained, using techniques based on Character Studio (plug-ins for 3D Studio MAX, AutoDesk, Inc.), MATLAB The MathWorks, Inc.), or a combination of these two. For the knocking, lifting, and throwing actions, 10 repetitions of the simple action unit were obtained for each affect, and for the other actions, two longer movement recordings were obtained for each affect. We discuss the potential use of the library for computational and behavioral analyses of movement variability, of human character animation, and of how gender, emotion, and identity are encoded and decoded from human movement.

Evidence for distinct contributions of form and motion information to the recognition of emotions from body gestures

The importance of kinematics in emotion perception from body movement has been widely demonstrated. Evidence also suggests that the perception of biological motion relies to some extent on information about spatial and spatiotemporal form, yet the contribution of such form-related cues to emotion perception remains unclear. This study reports, for the first time, the relative effects on emotion recognition of inverting and motion-reversing patch-light compared to fully illuminated displays of whole-body emotion gestures. Inverting the gesture movies or playing them backwards significantly impaired emotion classification accuracy, but did so more for patch-light displays than for identical but fully illuminated movement sequences. This result suggests that inversion impairs the processing of form information related to the configuration of body parts, and reversal impairs the sequencing of form changes, more than these manipulations impair the processing of kinematic cues. This effect was strongest for inversion, suggesting an important role for configural information in emotion recognition. Nevertheless, even in combination these stimulus manipulations did not abolish above chance recognition of any of the emotions, suggesting that kinematics help distinguish emotions expressed by body gestures. Disproportionate impairments in recognition accuracy were observed for fear and disgust under inversion, and for fear under motion reversal, suggesting a greater role for form-related cues in the perception of these emotions.

Optical flow and viewpoint change modulate the perception and memorization of complex motion

Participants observed a point-light character (PLC) performing a gymnastic movement. They either memorized the final PLC orientation from the initial viewpoint, to match it to a test posture (memory task), or judged whether the biological motion appeared continuous (perceptual task), despite a viewpoint change. The observer could be either static or virtually in motion (pan or track) while looking at the movement from the initial viewpoint. The presence of a spatial layout during virtual self-motion induced a global optical flow specifying the translational component of the PLC movement, rendering the event more predictable for the participants. A representational momentum effect was observed in the memory task, suggesting that when a visual stimulation, such as a PLC motion, is abruptly stopped, its dynamics survive. In contrast, structural and transformational invariants specifying the PLC motion were sufficient to solve the perceptual task accurately. Finally, both the remembering of the final posture and the perception of continuity degraded with an increase in viewpoint change due to tilt/slant posture orientation matching, indicating that orientation processes interfered with event perception.

Backscroll illusion: Apparent motion in the background of locomotive objects

Backscroll illusion is an apparent motion perceived in backgrounds of movie images that present locomotive objects such as people, animals, and vehicles. This illusion is from the visual system registering retinal motion signals in relation to high-level object motion signals. We confirmed this notion from psychophysical experiments that mainly presented a realistic human figure on a treadmill walking or running in front of a counterphase grating. The apparent grating motion was consistently induced in the direction opposite to the locomotion. The induction was tuned to a gait velocity. The time course showed that the illusion arose as if it was synchronized with gait recognition, and that it was sustained against several reversals of limb swings so that local motion accounts were denied. A weak but significant illusion was observed from a static figure that implied a gait. Thus, we concluded that the illusion was determined by the high-level recognition of biological motion. An additional experiment found a similar effect from a vehicle with rotating wheels but no induction from a rotating wheel per se. This result led us to hypothesize that the backscroll illusion is generalized to objects that have shapes implying their moving directions.

Specificity of regions processing biological motion

Using functional magnetic resonance imaging and point light displays portraying six different human actions, we were able to show that several visual cortical regions, including human MT/V5 complex, posterior inferior temporal gyrus and superior temporal sulcus, are differentially active in the subtraction comparing biological motion to scrambled motion. Comparison of biological motion to three-dimensional rotation (of a human figure), articulated motion and translation suggests that human superior temporal sulcus activity reflects the action portrayed in the biological motion stimuli, whereas posterior inferior temporal gyrus responds to the figure and hMT/V5+ to the complex motion pattern present in biological motion stimuli. These results were confirmed with implied action stimuli.

Eccentric perception of biological motion is unscalably poor

Accurately perceiving the activities of other people is a crucially important social skill of obvious survival value. Human vision is equipped with highly sensitive mechanisms for recognizing activities performed by others [Johansson, G. (1973). Visual perception of biological motion and a model for its analysis. Perception and Psychophysics, 14, 201; Johansson, G. (1976). Spatio-temporal differentiation and integration in visual motion perception: An experimental and theoretical analysis of calculus-like functions in visual data processing. Psychological Research, 38, 379]. One putative functional role of biological motion perception is to register the presence of biological events anywhere within the visual field, not just within central vision. To assess the salience of biological motion throughout the visual field, we compared the detectability performances of biological motion animations imaged in central vision and in peripheral vision. To compensate for the poorer spatial resolution within the periphery, we spatially magnified the motion tokens defining biological motion. Normal and scrambled biological motion sequences were embedded in motion noise and presented in two successively viewed intervals on each trial (2AFC). Subjects indicated which of the two intervals contained normal biological motion. A staircase procedure varied the number of noise dots to produce a criterion level of discrimination performance. For both foveal and peripheral viewing, performance increased but saturated with stimulus size. Foveal and peripheral performance could not be equated by any magnitude of size scaling. Moreover, the inversion effect--superiority of upright over inverted biological motion [Sumi, S. (1984). Upside-down presentation of the Johansson moving light-spot pattern. Perception, 13, 283]--was found only when animations were viewed within the central visual field. Evidently the neural resource responsible for biological motion perception are embodied within neural mechanisms focused on central vision.

Perception of biological motion: A stimulus set of human point-light actions

We present a set of stimuli representing human actions under point-light conditions, as seen from different viewpoints. The set contains 22 fairly short, well-delineated, and visually "loopable" actions. For each action, we provide movie files from five different viewpoints as well as a text file with the three spatial coordinates of the point lights, allowing researchers to construct customized versions. The full set of stimuli may be downloaded from www.psychonomic.org/archive/.

A chimeric point-light walker

Ambiguity has long been used as a probe into visual processing. Here, we describe a new dynamic ambiguous figure-the chimeric point-light walker--which we hope will prove to be a useful tool for exploring biological motion. We begin by describing the construction of the stimulus and discussing the compelling finding that, when presented in a mask, observers consistently fail to notice anything odd about the walker, reporting instead that they are watching an unambiguous figure moving either to the left or right. Some observers report that the initial percept fluctuates, moving first to the left, then to the right, or vice versa; others always perceive a constant direction. All observers, when briefly shown the unmasked ambiguous figure, have no difficulty in perceiving the novel motion pattern once the mask is returned. These two findings--the initial report of unambiguous motion and the subsequent 'primed' perception of the ambiguity--are both consistent with an important role for top-down processing in biological motion. We conclude by suggesting several domains within the realm of biological-motion processing where this simple stimulus may prove to be useful.

Neural mechanisms for the recognition of biological movements

The visual recognition of complex movements and actions is crucial for the survival of many species. It is important not only for communication and recognition at a distance, but also for the learning of complex motor actions by imitation. Movement recognition has been studied in psychophysical, neurophysiological and imaging experiments, and several cortical areas involved in it have been identified. We use a neurophysiologically plausible and quantitative model as a tool for organizing and making sense of the experimental data, despite their growing size and complexity. We review the main experimental findings and discuss possible neural mechanisms, and show that a learning-based, feedforward model provides a neurophysiologically plausible and consistent summary of many key experimental results.

Creating stimuli for the study of biological-motion perception

In the perception of biological motion, the stimulus information is confined to a small number of lights attached to the major joints of a moving person. Despite this drastic degradation of the stimulus information, the human visual apparatus organizes the swarm of moving dots into a vivid percept of a moving biological creature. Several techniques have been proposed to create point-light stimuli: placing dots at strategic locations on photographs or films, video recording a person with markers attached to the body, computer animation based on artificial synthesis, and computer animation based on motion-capture data. A description is given of the technique we are currently using in our laboratory to produce animated point-light figures. The technique is based on a combination of motion capture and three-dimensional animation software (Character Studio, Autodesk, Inc., 1998). Some of the advantages of our approach are that the same actions can be shown from any viewpoint, that point-light versions, as well as versions with a full-fleshed character, can be created of the same actions, and that point lights can indicate the center of a joint (thereby eliminating several disadvantages associated with other techniques).

Biological motion shown backwards: the apparent-facing effect

We examined how showing a film backwards (reverse transformation) affects the visual perception of biological motion. Adults and 6-year-old children saw first a point-light quadruped moving normally as if on a treadmill, and then saw the same display in reverse transformation. For other groups the order of presentation was the opposite. Irrespective of the presentation mode (normal or reverse) and of the facing of the point-light figure (rightward or leftward), a pronounced apparent-facing effect was observed: the perceptual identification of a display was mainly determined by the apparent direction of locomotion. The findings suggest that in interpreting impoverished point-light biological-motion stimuli the visual system may neglect distortions caused by showing a film backwards. This property appears to be robust across perceptual development. Possible explanations of the apparent-facing effect are discussed.

Is perceptual anticipation a motor simulation? A PET study

A large body of psychophysical evidence suggests that perception of human movement is constrained by the observer's motor competence. PET measurements of regional cerebral blood flow were performed in eight healthy subjects who were requested, in a forced-choice paradigm, to anticipate the outcome of a single moving dot trajectory depicting the beginning of either mechanical, pointing, or writing movements. Selective activation of the left premotor cortex and of the right intraparietal sulcus was associated with visual anticipation of pointing movements while the left frontal operculum and superior parietal lobule were found to be activated during anticipation of writing movements. These results are discussed in the perspective that the motor system is part of a simulation network, which is used to interpret perceived actions.