A comparison of form processing involved in the perception of biological and nonbiological movements

How the window of visibility varies around polar angle

Contrast sensitivity, the amount of contrast required to discriminate an object, depends on spatial frequency (SF). The contrast sensitivity function (CSF) peaks at intermediate SFs and drops at other SFs. The CSF varies from foveal to peripheral vision, but only a couple of studies have assessed how the CSF changes with polar angle of the visual field. For many visual dimensions, sensitivity is better along the horizontal than the vertical meridian and at the lower than the upper vertical meridian, yielding polar angle asymmetries. Here, for the first time, to our knowledge, we investigate CSF attributes around polar angle at both group and individual levels and examine the relations in CSFs across locations and individual observers. To do so, we used hierarchical Bayesian modeling, which enables precise estimation of CSF parameters. At the group level, maximum contrast sensitivity and the SF at which the sensitivity peaks are higher at the horizontal than vertical meridian and at the lower than the upper vertical meridian. By analyzing the covariance across observers (n = 28), we found that, at the individual level, CSF attributes (e.g., maximum sensitivity) across locations are highly correlated. This correlation indicates that, although the CSFs differ across locations, the CSF at one location is predictive of that at another location. Within each location, the CSF attributes covary, indicating that CSFs across individuals vary in a consistent manner (e.g., as maximum sensitivity increases, so does the corresponding SF), but more so at the horizontal than the vertical meridian locations. These results show similarities and uncover some critical polar angle differences across locations and individuals, suggesting that the CSF should not be generalized across isoeccentric locations around the visual field.

Exploring biological motion perception in two-stream convolutional neural networks

Visual recognition of biological motion recruits form and motion processes supported by both dorsal and ventral pathways. This neural architecture inspired the two-stream convolutional neural network (CNN) model, which includes a spatial CNN to process appearance information in a sequence of image frames, a temporal CNN to process optical flow information, and a fusion network to integrate the features extracted by the two CNNs and make final decisions about action recognition. In five simulations, we compared the CNN model's performance with classical findings in biological motion perception. The CNNs trained with raw RGB action videos showed weak performance in recognizing point-light actions. Additional transfer training with actions shown in other display formats (e.g., skeletal) was necessary for CNNs to recognize point-light actions. The CNN models exhibited largely viewpoint-dependent recognition of actions, with a limited ability to generalize to viewpoints close to the training views. The CNNs predicted the inversion effect in the presence of global body configuration, but failed to predict the inversion effect driven solely by local motion signals. The CNNs provided a qualitative account of some behavioral results observed in human biological motion perception for fine discrimination tasks with noisy inputs, such as point-light actions with disrupted local motion signals, and walking actions with temporally misaligned motion cues. However, these successes are limited by the CNNs' lack of adaptive integration for form and motion processes, and failure to incorporate specialized mechanisms (e.g., a life detector) as well as top-down influences on biological motion perception.