The visual perception of human and animal motion in point-light displays

Disentangling Object Category Representations Driven by Dynamic and Static Visual Input

Humans can label and categorize objects in a visual scene with high accuracy and speed, a capacity well characterized with studies using static images. However, motion is another cue that could be used by the visual system to classify objects. To determine how motion-defined object category information is processed by the brain in the absence of luminance-defined form information, we created a novel stimulus set of "object kinematograms" to isolate motion-defined signals from other sources of visual information. Object kinematograms were generated by extracting motion information from videos of 6 object categories and applying the motion to limited-lifetime random dot patterns. Using functional magnetic resonance imaging (fMRI) (n = 15, 40% women), we investigated whether category information from the object kinematograms could be decoded within the occipitotemporal and parietal cortex and evaluated whether the information overlapped with category responses to static images from the original videos. We decoded object category for both stimulus formats in all higher-order regions of interest (ROIs). More posterior occipitotemporal and ventral regions showed higher accuracy in the static condition, while more anterior occipitotemporal and dorsal regions showed higher accuracy in the dynamic condition. Further, decoding across the two stimulus formats was possible in all regions. These results demonstrate that motion cues can elicit widespread and robust category responses on par with those elicited by static luminance cues, even in ventral regions of visual cortex that have traditionally been associated with primarily image-defined form processing.SIGNIFICANCE STATEMENT Much research on visual object recognition has focused on recognizing objects in static images. However, motion is a rich source of information that humans might also use to categorize objects. Here, we present the first study to compare neural representations of several animate and inanimate objects when category information is presented in two formats: static cues or isolated dynamic motion cues. Our study shows that, while higher-order brain regions differentially process object categories depending on format, they also contain robust, abstract category representations that generalize across format. These results expand our previous understanding of motion-derived animate and inanimate object category processing and provide useful tools for future research on object category processing driven by multiple sources of visual information.

"The clothes (and the face) make the Starman": Facial and clothing features shape self-other matching processes between human observers and a cartoon character

Anthropomorphization occurs when human characteristics are attributed to nonhuman animals or objects. One process that could facilitate the anthropomorphization of nonhuman animals may be a self-other body-part matching mechanism wherein the body of the nonhuman animal is conceptually mapped to the human observer's representation of their body. The present study was designed to determine if specific features could facilitate body-part matching between the cartoon of a nonhuman animal and human observers. Participants responded to targets presented on the cartoon of a starfish. In No Structure conditions, dots and curved lines were distributed evenly within the starfish. In Face conditions, two dots and one curved line represented eyes and a mouth of a "face". In Clothes conditions, dots and lines represented a shirt and pants. Body-part matching emerged when the image had a face or clothing, but did not emerge in No Structure conditions. These studies provide unique evidence that the anthropomorphization of a nonhuman cartoon may be facilitated by human-like internal features on the image.

Human (but not animal) motion can be recognized at first sight - After treatment for congenital blindness

The long-standing nativist vs. empiricist debate asks a foundational question in epistemology - does our knowledge arise through experience or is it available innately? Studies that probe the sensitivity of newborns and patients recovering from congenital blindness are central in informing this dialogue. One of the most robust sensitivities our visual system possesses is to 'biological motion' - the movement patterns of humans and other vertebrates. Various biological motion perception skills (such as distinguishing between movement of human and non-human animals, or between upright and inverted human movement) become evident within the first months of life. The mechanisms of acquiring these capabilities, and specifically the contribution of visual experience to their development, are still under debate. We had the opportunity to directly examine the role of visual experience in biological motion perception, by testing what level of sensitivity is present immediately upon onset of sight following years of congenital visual deprivation. Two congenitally blind patients who underwent sight-restorative cataract-removal surgery late in life (at the ages of 7 and 20 years) were tested before and after sight restoration. The patients were shown displays of walking humans, pigeons, and cats, and asked to describe what they saw. Visual recognition of movement patterns emerged immediately upon eye-opening following surgery, when the patients spontaneously began to identify human, but not animal, biological motion. This recognition ability was evident contemporaneously for upright and inverted human displays. These findings suggest that visual recognition of human motion patterns may not critically depend on visual experience, as it was evident upon first exposure to un-obstructed sight in patients with very limited prior visual exposure, and furthermore, was not limited to the typical (upright) orientation of humans in real-life settings.

When Visual Cues Do Not Help the Beat: Evidence for a Detrimental Effect of Moving Point-Light Figures on Rhythmic Priming

Rhythm perception involves strong auditory-motor connections that can be enhanced with movement. However, it is unclear whether just seeing someone moving to a rhythm can enhance auditory-motor coupling, resulting in stronger entrainment. Rhythmic priming studies show that presenting regular rhythms before naturally spoken sentences can enhance grammaticality judgments compared to irregular rhythms or other baseline conditions. The current study investigated whether introducing a point-light figure moving in time with regular rhythms could enhance the rhythmic priming effect. Three experiments revealed that the addition of a visual cue did not benefit rhythmic priming in comparison to auditory conditions with a static image. In Experiment 1 (27 7–8-year-old children), grammaticality judgments were poorer after audio-visual regular rhythms (with a bouncing point-light figure) compared to auditory-only regular rhythms. In Experiments 2 (31 adults) and 3 (31 different adults), there was no difference in grammaticality judgments after audio-visual regular rhythms compared to auditory-only irregular rhythms for either a bouncing point-light figure (Experiment 2) or a swaying point-light figure (Experiment 3). Comparison of the observed performance with previous data suggested that the audio-visual component removed the regular prime benefit. These findings suggest that the visual cues used in this study do not enhance rhythmic priming and could hinder the effect by potentially creating a dual-task situation. In addition, individual differences in sensory-motor and social scales of music reward influenced the effect of the visual cue. Implications for future audio-visual experiments aiming to enhance beat processing, and the importance of individual differences will be discussed.

Bird expertise does not increase motion sensitivity to bird flight motion

While motion information is important for the early stages of vision, it also contributes to later stages of object recognition. For example, human observers can detect the presence of a human, judge its actions, and judge its gender and identity simply based on motion cues conveyed in a point-light display. Here we examined whether object expertise enhances the observer's sensitivity to its characteristic movement. Bird experts and novices were shown point-light displays of upright and inverted birds in flight, or upright and inverted human walkers, and asked to discriminate them from spatially scrambled point-light displays of the same stimuli. While the spatially scrambled stimuli retained the local motion of each dot of the moving objects, it disrupted the global percept of the object in motion. To estimate a detection threshold in each object domain, we systematically varied the number of noise dots in which the stimuli were embedded using an adaptive staircase approach. Contrary to our predictions, the experts did not show disproportionately higher sensitivity to bird motion, and both groups showed no inversion cost. However, consistent with previous work showing a robust inversion effect for human motion, both groups were more sensitive to upright human walkers than their inverted counterparts. Thus, the result suggests that real-world experience in the bird domain has little to no influence on the sensitivity to bird motion and that birds do not show the typical inversion effect seen with humans and other terrestrial movement.

Comparable search efficiency for human and animal targets in the context of natural scenes

In a previous series of studies, we have shown that search for human targets in the context of natural scenes is more efficient than search for mechanical targets. Here we asked whether this search advantage extends to other categories of biological objects. We used videos of natural scenes to directly contrast search efficiency for animal and human targets among biological or nonbiological distractors. In visual search arrays consisting of two, four, six, or eight videos, observers searched for animal targets among machine distractors, and vice versa (Exp. 1). Another group searched for animal targets among human distractors, and vice versa (Exp. 2). We measured search slope as a proxy for search efficiency, and complemented the slope with eye movement measurements (fixation duration on the target, as well as the proportion of first fixations landing on the target). In both experiments, we observed no differences in search slopes or proportions of first fixations between any of the target-distractor category pairs. With respect to fixation durations, we found shorter on-target fixations only for animal targets as compared to machine targets (Exp. 1). In summary, we did not find that the search advantage for human targets over mechanical targets extends to other biological objects. We also found no search advantage for detecting humans as compared to other biological objects. Overall, our pattern of findings suggests that search efficiency in natural scenes, as elsewhere, depends crucially on the specific target-distractor categories.

Local Dot Motion, Not Global Configuration, Determines Dogs' Preference for Point-Light Displays

Visual perception remains an understudied area of dog cognition, particularly the perception of biological motion where the small amount of previous research has created an unclear impression regarding dogs' visual preference towards different types of point-light displays. To date, no thorough investigation has been conducted regarding which aspects of the motion contained in point-light displays attract dogs. To test this, pet dogs (N = 48) were presented with pairs of point-light displays with systematic manipulation of motion features (i.e., upright or inverted orientation, coherent or scrambled configuration, human or dog species). Results revealed a significant effect of inversion, with dogs directing significantly longer looking time towards upright than inverted dog point-light displays; no effect was found for scrambling or the scrambling-inversion interaction. No looking time bias was found when dogs were presented with human point-light displays, regardless of their orientation or configuration. The results of the current study imply that dogs' visual preference is driven by the motion of individual dots in accordance with gravity, rather than the point-light display's global arrangement, regardless their long exposure to human motion.

Adults with autism are less proficient in identifying biological motion actions portrayed with point-light displays

BACKGROUND

Whether individuals with autism spectrum disorder (ASD) have impairments with biological motion perception has been debated. The present study examined the ability to identify point-light-displayed (PLD) human actions in neurotypical (NT) adults and adults with ASD.

METHOD

Twenty-seven adults with ASD (mean age = 28.36) and 30 NT adults (mean age = 22.45) were tested. Both groups viewed 10 different biological motion actions contacting an object/tool and 10 without making contact. Each action was presented twice, and participant's naming responses and reaction times were recorded.

RESULTS

The ASD group had a significantly lower total number of correct items (M = 29.30 ± 5.08 out of 40) and longer response time (M = 4550 ± 1442 ms) than NT group (M = 32.77 ± 2.78; M = 3556 ± 1148 ms). Both groups were better at naming the actions without objects (ASD group: 17.33 ± 2.30, NT group: 18.67 ± 1.30) than those with objects (ASD group: 11.96 ± 3.57, NT group: 14.10 ± 1.97). Correlation analyses showed that individuals with higher Autism-spectrum Quotient scale scores tended to make more errors and responded more slowly.

CONCLUSION

Adults with ASD were able to identify human point-light display biological motion actions much better than chance; however, they were less proficient compared with NT adults in terms of accuracy and speed, regardless of action type.

Observing and participating in social interactions: Action perception and action control across the autistic spectrum

Autism is a developmental condition, characterized by difficulties of social interaction and communication, as well as restricted interests and repetitive behaviors. Although several important conceptions have shed light on specific facets, there is still no consensus about a universal yet specific theory in terms of its underlying mechanisms. While some theories have exclusively focused on sensory aspects, others have emphasized social difficulties. However, sensory and social processes in autism might be interconnected to a higher degree than what has been traditionally thought. We propose that a mismatch in sensory abilities across individuals can lead to difficulties on a social, i.e. interpersonal level and vice versa. In this article, we, therefore, selectively review evidence indicating an interrelationship between perceptual and social difficulties in autism. Additionally, we link this body of research with studies, which investigate the mechanisms of action control in social contexts. By doing so, we highlight that autistic traits are also crucially related to differences in integration, anticipation and automatic responding to social cues, rather than a mere inability to register and learn from social cues. Importantly, such differences may only manifest themselves in sufficiently complex situations, such as real-life social interactions, where such processes are inextricably linked.

The neural representation of human versus nonhuman bipeds and quadrupeds

How do humans recognize humans among other creatures? Recent studies suggest that a preference for conspecifics may emerge already in perceptual processing, in regions such as the right posterior superior temporal sulcus (pSTS), implicated in visual perception of biological motion. In the current functional MRI study, participants viewed point-light displays of human and nonhuman creatures moving in their typical bipedal (man and chicken) or quadrupedal mode (crawling-baby and cat). Stronger activity for man and chicken versus baby and cat was found in the right pSTS responsive to biological motion. The novel effect of pedalism suggests that, if right pSTS contributes to recognizing of conspecifics, it does so by detecting perceptual features (e.g. bipedal motion) that reliably correlate with their appearance. A searchlight multivariate pattern analysis could decode humans and nonhumans across pedalism in the left pSTS and bilateral posterior cingulate cortex. This result implies a categorical human-nonhuman distinction, independent from within-category physical/perceptual variation. Thus, recognizing conspecifics involves visual classification based on perceptual features that most frequently co-occur with humans, such as bipedalism, and retrieval of information that determines category membership above and beyond visual appearance. The current findings show that these processes are at work in separate brain networks.

The application of biological motion research: biometrics, sport, and the military

The body of research that examines the perception of biological motion is extensive and explores the factors that are perceived from biological motion and how this information is processed. This research demonstrates that individuals are able to use relative (temporal and spatial) information from a person's movement to recognize factors, including gender, age, deception, emotion, intention, and action. The research also demonstrates that movement presents idiosyncratic properties that allow individual discrimination, thus providing the basis for significant exploration in the domain of biometrics and social signal processing. Medical forensics, safety garments, and victim selection domains also have provided a history of research on the perception of biological motion applications; however, a number of additional domains present opportunities for application that have not been explored in depth. Therefore, the purpose of this paper is to present an overview of the current applications of biological motion-based research and to propose a number of areas where biological motion research, specific to recognition, could be applied in the future.

Embodying animals: Body-part compatibility in mammalian, reptile and aves classes

The purpose of the present study was to determine how humans code homologous body parts of nonhuman mammal, reptilian, and aves animals with respect to the representation of the human body. To this end, participants completed body-part compatibility tasks in which responses were executed to colored targets that were superimposed over the upper limbs, lower limbs or head of different animals in different postures. In Experiment 1, the images were of meekats and lizards in bipedal and quadrupedal postures. In Experiment 2, the images were of a human, a penguin, and an owl in a bipedal posture with upper limbs stretched out. Overall, the results revealed that the limbs of nonhuman mammals (meerkat and human) were consistently mapped onto the homologous human body parts only when the mammals were in a bipedal posture. Specifically, body-part compatibility effects emerged for the human and the meerkat in a bipedal posture, but not the meerkat in the quadrupedal posture. Further, consistent body-part compatibility effects were not observed for the lizard in the quadrupedal posture or for the lizard, penguin, or owl in a bipedal posture. The pattern of results suggests that the human bipedal body representation may distinguish taxonomical classes and is most highly engaged when viewing homologous body parts of mammalian animals.

Auditory perception of a human walker

When one hears footsteps in the hall, one is able to instantly recognise it as a person: this is an everyday example of auditory biological motion perception. Despite the familiarity of this experience, research into this phenomenon is in its infancy compared with visual biological motion perception. Here, two experiments explored sensitivity to, and recognition of, auditory stimuli of biological and nonbiological origin. We hypothesised that the cadence of a walker gives rise to a temporal pattern of impact sounds that facilitates the recognition of human motion from auditory stimuli alone. First a series of detection tasks compared sensitivity with three carefully matched impact sounds: footsteps, a ball bouncing, and drumbeats. Unexpectedly, participants were no more sensitive to footsteps than to impact sounds of nonbiological origin. In the second experiment participants made discriminations between pairs of the same stimuli, in a series of recognition tasks in which the temporal pattern of impact sounds was manipulated to be either that of a walker or the pattern more typical of the source event (a ball bouncing or a drumbeat). Under these conditions, there was evidence that both temporal and nontemporal cues were important in recognising theses stimuli. It is proposed that the interval between footsteps, which reflects a walker's cadence, is a cue for the recognition of the sounds of a human walking.

Perception of pointing from biological motion point-light displays in typically developing children and children with autism spectrum disorder

We examined whether the movement involved in a pointing gesture, depicted using point-light displays, is sufficient to cue attention in typically developing children (TD) and children with autism spectrum disorder (ASD) (aged 8-11 years). Using a Posner-type paradigm, a centrally located display indicated the location of a forthcoming target on 80% of trials and the opposite location on 20% of trials. TD children, but not children with ASD, were faster to identify a validly cued target than an invalidly cued target. A scrambled version of the point-light pointing gesture, retaining individual dot speed and direction of movement but not the configuration, produced no validity effect in either group. A video of a pointing gesture produced validity effects in both groups.

The planning and control model (PCM) of motorvisual priming: reconciling motorvisual impairment and facilitation effects

Previous research on dual-tasks has shown that, under some circumstances, actions impair the perception of action-consistent stimuli, whereas, under other conditions, actions facilitate the perception of action-consistent stimuli. We propose a new model to reconcile these contrasting findings. The planning and control model (PCM) of motorvisual priming proposes that action planning binds categorical representations of action features so that their availability for perceptual processing is inhibited. Thus, the perception of categorically action-consistent stimuli is impaired during action planning. Movement control processes, on the other hand, integrate multi-sensory spatial information about the movement and, therefore, facilitate perceptual processing of spatially movement-consistent stimuli. We show that the PCM is consistent with a wider range of empirical data than previous models on motorvisual priming. Furthermore, the model yields previously untested empirical predictions. We also discuss how the PCM relates to motorvisual research paradigms other than dual-tasks.

Disrupted action perception in autism: behavioral evidence, neuroendophenotypes, and diagnostic utility

Disruptions in the visual perception of biological motion are emerging as a hallmark of autism spectrum disorder (ASD), consistent with the pathognomonic social deficits of this neurodevelopmental disorder. Accumulating evidence suggests an early and marked divergence in ASD from the typical developmental tuning of brain regions to process social information. In this review, we discuss a relatively recent yet substantial literature of behavioral and neuroimaging studies that consistently indicates impairments in biological motion perception in ASD. We then illustrate the fundamental disruption in this form of social perception in autism, drawing connections between a genetic liability to develop autism and disrupted associated brain mechanisms, as we describe neuroendophenotypes of autism derived from an fMRI study of biological motion perception in children with autism and their unaffected siblings. Finally, we demonstrate the diagnostic utility of brain responses to biological motion. With the ability to measure brain function in the first year of life comes the potential to chart the development of disrupted biological motion processing in ASD and to specify the gene-brain-behavior interactions shaping this atypical trajectory. We propose that a comprehensive understanding of the development of impaired responses to biological motion in ASD can inform future diagnosis and treatment approaches.

Socially tuned: brain responses differentiating human and animal motion

Typical adult observers demonstrate enhanced behavioral sensitivity to human movement compared to animal movement. Yet, the neural underpinnings of this effect are unknown. We examined the tuning of brain mechanisms for the perception of biological motion to the social relevance of this category of motion by comparing neural response to human and non-human biological motion. In particular, we tested the hypothesis that the response of the right posterior superior temporal sulcus (pSTS) varies according to the social relevance of the motion, responding most strongly to those biological motions with the greatest social relevance (human > dog). During a functional magnetic resonance imaging (fMRI) session, typical adults viewed veridical point-light displays of human, dog, and tractor motions created from motion capture data. A conjunction analysis identified regions of significant activation during biological motion perception relative to object motion. Within each of these regions, only one brain area, the right pSTS, revealed an enhanced response to human motion relative to dog motion. This finding demonstrates that the pSTS response is sensitive to the social relevance of a biological motion stimulus.

Comparison of visual sensitivity to human and object motion in autism spectrum disorder

Successful social behavior requires the accurate detection of other people's movements. Consistent with this, typical observers demonstrate enhanced visual sensitivity to human movement relative to equally complex, nonhuman movement [e.g., Pinto & Shiffrar, 2009]. A psychophysical study investigated visual sensitivity to human motion relative to object motion in observers with autism spectrum disorder (ASD). Participants viewed point-light depictions of a moving person and, for comparison, a moving tractor and discriminated between coherent and scrambled versions of these stimuli in unmasked and masked displays. There were three groups of participants: young adults with ASD, typically developing young adults, and typically developing children. Across masking conditions, typical observers showed enhanced visual sensitivity to human movement while observers in the ASD group did not. Because the human body is an inherently social stimulus, this result is consistent with social brain theories [e.g., Pelphrey & Carter, 2008; Schultz, 2005] and suggests that the visual systems of individuals with ASD may not be tuned for the detection of socially relevant information such as the presence of another person. Reduced visual sensitivity to human movements could compromise important social behaviors including, for example, gesture comprehension.

Die Fähigkeiten von Athleten verändern deren Wahrnehmung von Handlungen

Zusammenfassung. Wie nimmt das menschliche visuelle System Handlungen wahr? – Traditionelle Modelle der visuellen Wahrnehmung nehmen an, dass bei allen Beobachtern die gleichen visuellen Prozesse der Analyse von visuellen Stimuli unterschiedlicher Art zu Grunde liegen. Dieser theoretische Ansatz sagt vorher, dass unterschiedliche Personen Gegenstände und Handlungen in gleicher Art und Weise wahrnehmen, unabhängig davon, ob sich ihr Bewegungssystem beispielsweise durch krankheitsbedingte Veränderungen oder Trainingsanpassungen unterscheidet. Demgegenüber nehmen Theorien der embodied perception an, dass individuelle Fähigkeiten des Beobachters die visuelle Wahrnehmung beeinflussen. Ausgehend von diesem Ansatz ist das, was man sieht, dadurch bestimmt, was man physisch tun (kann). Menschliche Bewegung wird dabei als eine spezielle Kategorie von visuellen Bewegungsreizen angesehen, da es die einzige Bewegungsart ist, welche der Mensch ausführen und wahrnehmen kann. Der vorliegende Artikel gibt einen Überblick über aktuelle neuro- und verhaltenswissenschaftliche Befunde zur visuellen Wahrnehmung menschlicher Bewegung unter besonderer Berücksichtigung der Rolle des motorischen Systems. Dabei wird auf die Wahrnehmung von Athleten eingegangen, da diese Personengruppe über spezifische motorische und visuelle Fähigkeiten verfügt, welche den Erklärungswert traditioneller Theorien der visuellen Wahrnehmung kritisch hinterfragen.

The visual perception of motion by observers with autism spectrum disorders: a review and synthesis

Traditionally, psychological research on autism spectrum disorder (ASD) has focused on social and cognitive abilities. Vision provides an important input channel to both of these processes, and, increasingly, researchers are investigating whether observers with ASD differ from typical observers in their visual percepts. Recently, significant controversies have arisen over whether observers with ASD differ from typical observers in their visual analyses of movement. Initial studies suggested that observers with ASD experience significant deficits in their visual sensitivity to coherent motion in random dot displays but not to point-light displays of human motion. More recent evidence suggests exactly the opposite: that observers with ASD do not differ from typical observers in their visual sensitivity to coherent motion in random dot displays, but do differ from typical observers in their visual sensitivity to human motion. This review examines these apparently conflicting results, notes gaps in previous findings, suggests a potentially unifying hypothesis, and identifies areas ripe for future research.