Visual search by action category

Figure-Ground Segmentation and Biological Motion Perception in Peripheral Visual Field

Biological motion perception is a specific type of perceptual organization, during which a clear image of a moving human body is perceptually generated in virtue of certain core light dots representing the major joint movements. While the processes of biological motion perception have been studied extensively for almost a century, there is still a debate on whether biological motion task performance can be equally precise across all visual field or is central visual field specified for biological motion perception. The current study explores the processes of biological motion perception and figure-ground segmentation in the central and peripheral visual field, expanding the understanding of perceptual organization across different eccentricities. The method involved three different tasks of visual grouping: (1) a static visual grouping task, (2) a dynamic visual grouping task, and (3) a biological motion detection task. The stimuli in (1) and (2) were generated from 12-13 dots grouped by proximity and common fate, and, in (3), light dots representing human motion. All stimuli were embedded in static or dynamics visual noise and the threshold value for the number of noise dots in which the elements could still be grouped by proximity and/or common fate was determined. The results demonstrate that biological motion can be differentiated from the scrambled set of moving dots in a more intensive visual noise than static and dynamic visual grouping tasks. Furthermore, in all three visual tasks (static and dynamic grouping, and biological motion detection) the performance was significantly worse in the periphery than in the central visual field, and object magnification could not compensate for the reduced performance in any of the three grouping tasks. The preliminary results of nine participants indicate that (a) human motion perception involves specific perceptual processes, providing the high-accuracy perception of the human body and (b) the processes of figure-ground segmentation are governed by the bottom-up processes and the best performance can be achieved only when the object is demonstrated in the central visual field.

Understanding the visual perception of awkward body movements: How interactions go awry

Dyadic interactions can sometimes elicit a disconcerting response from viewers, generating a sense of "awkwardness." Despite the ubiquity of awkward social interactions in daily life, it remains unknown what visual cues signal the oddity of human interactions and yield the subjective impression of awkwardness. In the present experiments, we focused on a range of greeting behaviors (handshake, fist bump, high five) to examine both the inherent objectivity and impact of contextual and kinematic information in the social evaluation of awkwardness. In Experiment 1, participants were asked to discriminate whether greeting behaviors presented in raw videos were awkward or natural, and if judged as awkward, participants provided verbal descriptions regarding the awkward greeting behaviors. Participants showed consensus in judging awkwardness from raw videos, with a high proportion of congruent responses across a range of awkward greeting behaviors. We also found that people used social-related and motor-related words in their descriptions for awkward interactions. Experiment 2 employed advanced computer vision techniques to present the same greeting behaviors in three different display types. All display types preserved kinematic information, but varied contextual information: (1) patch displays presented blurred scenes composed of patches; (2) body displays presented human body figures on a black background; and (3) skeleton displays presented skeletal figures of moving bodies. Participants rated the degree of awkwardness of greeting behaviors. Across display types, participants consistently discriminated awkward and natural greetings, indicating that the kinematics of body movements plays an important role in guiding awkwardness judgments. Multidimensional scaling analysis based on the similarity of awkwardness ratings revealed two primary cues: motor coordination (which accounted for most of the variability in awkwardness judgments) and social coordination. We conclude that the perception of awkwardness, while primarily inferred on the basis of kinematic information, is additionally affected by the perceived social coordination underlying human greeting behaviors.

The Impact of Autistic Traits on Self-Recognition of Body Movements

Despite the sparse visual information and paucity of self-identifying cues provided by point-light stimuli, as well as a dearth of experience in seeing our own-body movements, people can identify themselves solely based on the kinematics of body movements. The present study found converging evidence of this remarkable ability using a broad range of actions with whole-body movements. In addition, we found that individuals with a high degree of autistic traits showed worse performance in identifying own-body movements, particularly for simple actions. A Bayesian analysis showed that action complexity modulates the relationship between autistic traits and self-recognition performance. These findings reveal the impact of autistic traits on the ability to represent and recognize own-body movements.

Intact perception of coherent motion, dynamic rigid form, and biological motion in chronic schizophrenia

BACKGROUND

Prior studies have documented biological motion perception deficits in schizophrenia, but it remains unclear whether the impairments arise from poor social cognition, perceptual organization, basic motion processing, or sustained attention/motivation. To address the issue, we had 24 chronic schizophrenia patients and 27 healthy controls perform three tasks: coherent motion, where subjects indicated whether a cloud of dots drifted leftward or rightward; dynamic rigid form, where subjects determined the tilt direction of a translating, point-light rectangle; and biological motion, where subjects judged whether a human point-light figure walked leftward or rightward. Task difficulty was staircase controlled and depended on the directional variability of the background dot motion. Catch trials were added to verify task attentiveness and engagement.

RESULTS

Patients and controls demonstrated similar performance thresholds and near-ceiling catch trial accuracy for each task (uncorrected ps > 0.1; ds < 0.35). In all but the coherent motion task, higher IQ correlated with better performance (ps < 0.001).

CONCLUSION

Schizophrenia patients have intact perception of motion coherence, dynamic rigid form, and biological motion at least for our sample and set-up. We speculate that previously documented biological motion perception deficits arose from task or stimulus differences or from group differences in IQ, attention, or motivation.

Communicative interactions in point-light displays: Choosing among multiple response alternatives

Vision scientists are increasingly relying on the point-light technique as a way to investigate the perception of human motion. Unfortunately, the lack of standardized stimulus sets has so far limited the use of this technique for studying social interaction. Here, we describe a new tool to study the interaction between two agents starting from point-light displays: the Communicative Interaction Database - 5AFC format (CID-5). The CID-5 consists of 14 communicative and seven non-communicative individual actions performed by two agents. Stimuli were constructed by combining motion capture techniques and 3-D animation software to provide precise control over the computer-generated actions. For each action stimulus, we provide coordinate files and movie files depicting the action as seen from four different perspectives. Furthermore, the archive contains a text file with a list of five alternative action descriptions to construct forced-choice paradigms. In order to validate the CID-5 format, we provide normative data collected to assess action identification within a 5AFC tasks. The CID-5 archive is freely downloadable from http://bsb-lab.org/research/ and from the supplementary materials of this article.

Do People "Pop Out"?

The human body is a highly familiar and socially very important object. Does this mean that the human body has a special status with respect to visual attention? In the current paper we tested whether people in natural scenes attract attention and “pop out” or, alternatively, are at least searched for more efficiently than targets of another category (machines). Observers in our study searched a visual array for dynamic or static scenes containing humans amidst scenes containing machines and vice versa. The arrays consisted of 2, 4, 6 or 8 scenes arranged in a circular array, with targets being present or absent. Search times increased with set size for dynamic and static human and machine targets, arguing against pop out. However, search for human targets was more efficient than for machine targets as indicated by shallower search slopes for human targets. Eye tracking further revealed that observers made more first fixations to human than to machine targets and that their on-target fixation durations were shorter for human compared to machine targets. In summary, our results suggest that searching for people in natural scenes is more efficient than searching for other categories even though people do not pop out.

Perceiving the direction of articulatory motion in point-light actions

Human observers are able to perceive the motion direction of actions (either forward or backward) on the basis of the articulatory, relative motion of the limbs, even when the actions are shown under point-light conditions. However, most studies have focused on the action of walking. The primary purpose of the present study is to further investigate the perception of articulatory motion in different point-light actions (walking, crawling, hand walking, and rowing). On each trial, participants were presented with a forward or backward moving person and they had to decide on the direction of articulatory motion of the person. We analyzed sensitivity (d') as well as response bias (c). In addition to the type of action, the diagnosticity of the available information was manipulated by varying the visibility of the body parts (full body, only upper limbs, or only lower limbs) and the viewpoint from which the action was seen (from frontal view to sagittal view). We observe that, depending on the specific action, perception of direction of motion is driven by different body parts. Implications for the possible existence of a life detector, i.e., an evolutionarily old and innate visual filter that is tuned to quickly and automatically detect the presence of a moving living organism and direct attention to it, are discussed.

Getting the gist of events: recognition of two-participant actions from brief displays

Unlike rapid scene and object recognition from brief displays, little is known about recognition of event categories and event roles from minimal visual information. In 3 experiments, we displayed naturalistic photographs of a wide range of 2-participant event scenes for 37 ms and 73 ms followed by a mask, and found that event categories (the event gist; e.g., "kicking," "pushing") and event roles (i.e., Agent and Patient) can be recognized rapidly, even with various actor pairs and backgrounds. Norming ratings from a subsequent experiment revealed that certain physical features (e.g., outstretched extremities) that correlate with Agent-hood could have contributed to rapid role recognition. In a final experiment, using identical twin actors, we then varied these features in 2 sets of stimuli, in which Patients had Agent-like features or not. Subjects recognized the roles of event participants less accurately when Patients possessed Agent-like features, with this difference being eliminated with 2-s durations. Thus, given minimal visual input, typical Agent-like physical features are used in role recognition, but with sufficient input from multiple fixations, people categorically determine the relationship between event participants.

Impaired global, and compensatory local, biological motion processing in people with high levels of autistic traits

People with Autism Spectrum Disorder (ASD) are hypothesized to have poor high-level processing but superior low-level processing, causing impaired social recognition, and a focus on non-social stimulus contingencies. Biological motion perception provides an ideal domain to investigate exactly how ASD modulates the interaction between low and high-level processing, because it involves multiple processing stages, and carries many important social cues. We investigated individual differences among typically developing observers in biological motion processing, and whether such individual differences associate with the number of autistic traits. In Experiment 1, we found that individuals with fewer autistic traits were automatically and involuntarily attracted to global biological motion information, whereas individuals with more autistic traits did not show this pre-attentional distraction. We employed an action adaptation paradigm in the second study to show that individuals with more autistic traits were able to compensate for deficits in global processing with an increased involvement in local processing. Our findings can be interpreted within a predictive coding framework, which characterizes the functional relationship between local and global processing stages, and explains how these stages contribute to the perceptual difficulties associated with ASD.