Moving a Shape behind a Slit: Partial Shape Representations in Inferior Temporal Cortex

Evaluating integration of letter fragments through contrast and spatially targeted masking

Four experiments were conducted to gain a better understanding of the visual mechanisms related to how integration of partial shape cues provides for recognition of the full shape. In each experiment, letters formed as outline contours were displayed as a sequence of adjacent segments (fragments), each visible during a 17-ms time frame. The first experiment varied the contrast of the fragments. There were substantial individual differences in contrast sensitivity, so stimulus displays in the masking experiments that followed were calibrated to the sensitivity of each participant. Masks were displayed either as patterns that filled the entire screen (full field) or as successive strips that were sliced from the pattern, each strip lying across the location of the letter fragment that had been shown a moment before. Contrast of masks were varied to be lighter or darker than the letter fragments. Full-field masks, whether light or dark, provided relatively little impairment of recognition, as was the case for mask strips that were lighter than the letter fragments. However, dark strip masks proved to be very effective, with the degree of recognition impairment becoming larger as mask contrast was increased. A final experiment found the strip masks to be most effective when they overlapped the location where the letter fragments had been shown a moment before. They became progressively less effective with increased spatial separation from that location. Results are discussed with extensive reference to potential brain mechanisms for integrating shape cues.

Dynamically occluded action recognition by pigeons

Identifying the behaviors of organisms is essential for an animal's survival. This ability is particularly challenged when the "actors" are dynamically occluded by other objects and become fragmented as they move through an environment. Even when fragmented in time and across space, humans readily recognize the behavior of these dynamically occluded objects and actors. How animals process such fragmented information, especially when involving motion, remains uncertain. In three experiments, we investigated the ability of six pigeons to discriminate between the running and walking actions of digital animal models when dynamically occluded. The pigeons were tested in a go/no-go procedure using three models that transited behind multiple occluders in a semirealistic scene. Without ever seeing the entirety of the animal model at one time, all the pigeons learned to discriminate among these two behaviors. This discrimination transferred to an unfamiliar model, transit direction, transiting rates, camera perspectives, and occluders. Tests with different static and dynamic features indicated that the pigeons relied on motion features for the discrimination, especially articulated motion. These experiments demonstrate that pigeons, like humans, can discriminate actions even when their view of the actor is fragmented in time and space.

More Than the Face: Representations of Bodies in the Inferior Temporal Cortex

Visual representations of bodies, in addition to those of faces, contribute to the recognition of con- and heterospecifics, to action recognition, and to nonverbal communication. Despite its importance, the neural basis of the visual analysis of bodies has been less studied than that of faces. In this article, I review what is known about the neural processing of bodies, focusing on the macaque temporal visual cortex. Early single-unit recording work suggested that the temporal visual cortex contains representations of body parts and bodies, with the dorsal bank of the superior temporal sulcus representing bodily actions. Subsequent functional magnetic resonance imaging studies in both humans and monkeys showed several temporal cortical regions that are strongly activated by bodies. Single-unit recordings in the macaque body patches suggest that these represent mainly body shape features. More anterior patches show a greater viewpoint-tolerant selectivity for body features, which may reflect a processing principle shared with other object categories, including faces. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.