Reduced surround suppression in monocular motion perception

Pre-saccadic Preview Shapes Post-Saccadic Processing More Where Perception is Poor

The pre-saccadic preview of a peripheral target enhances the efficiency of its post-saccadic processing, termed the extrafoveal preview effect. Peripheral visual performance -and thus the quality of the preview- varies around the visual field, even at iso-eccentric locations: it is better along the horizontal than vertical meridian and along the lower than upper vertical meridian. To investigate whether these polar angle asymmetries influence the preview effect, we asked human participants (to preview four tilted gratings at the cardinals, until a central cue indicated to which one to saccade. During the saccade, the target orientation either remained or slightly changed (valid/invalid preview). After saccade landing, participants discriminated the orientation of the (briefly presented) second grating. Stimulus contrast was titrated with adaptive staircases to assess visual performance. Expectedly, valid previews increased participants' post-saccadic contrast sensitivity. This preview benefit, however, was inversely related to polar angle perceptual asymmetries; largest at the upper, and smallest at the horizontal meridian. This finding reveals that the visual system compensates for peripheral asymmetries when integrating information across saccades, by selectively assigning higher weights to the less-well perceived preview information. Our study supports the recent line of evidence showing that perceptual dynamics around saccades vary with eye movement direction.

Neural correlates of crowding in macaque area V4

Visual crowding refers to the phenomenon where a target object that is easily identifiable in isolation becomes difficult to recognize when surrounded by other stimuli (distractors). Extensive psychophysical studies support two alternative possibilities for the underlying mechanisms. One hypothesis suggests that crowding results from the loss of visual information due to pooled encoding of multiple nearby stimuli in the mid-level processing stages along the ventral visual pathway. Alternatively, crowding may arise from limited resolution in decoding object information during recognition and the encoded information may remain inaccessible unless it is salient. To rigorously test these alternatives, we studied the responses of single neurons in macaque area V4, an intermediate stage of the ventral, object-processing pathway, to parametrically designed crowded displays and their texture-statistics matched metameric counterparts. Our investigations reveal striking parallels between how crowding parameters, e.g., number, distance, and position of distractors, influence human psychophysical performance and V4 shape selectivity. Importantly, we found that enhancing the salience of a target stimulus could reverse crowding effects even in highly cluttered scenes and such reversals could be protracted reflecting a dynamical process. Overall, we conclude that a pooled encoding of nearby stimuli cannot explain the observed responses and we propose an alternative model where V4 neurons preferentially encode salient stimuli in crowded displays.

Reduced visual context effects in global motion processing in depression

Research supports abnormal inhibitory visual motion processing in adults with remitted and current depression, but all studies to date have used paradigms with simple grating stimuli. Global motion processing, where multiple motion signals must be integrated, has not been explored in depression, nor have inhibitory processes within that domain. Depressed participants (n = 46) and healthy controls (n = 28) completed a direction discrimination task featuring a random dot pattern stimulus. Various signal (rightward or leftward dots) to noise (dots with randomly assigned directions) ratios modulated task difficulty. Metrics of global center surround suppression and facilitation were calculated. Accuracy in the baseline condition (i.e., no surrounding annulus) was not significantly different between depressed and healthy participants. Global center surround suppression and facilitation were not significantly different between healthy and depressed participants overall. When limiting the sample to unmedicated individuals, depressed participants (n = 27) showed a reduced global center surround suppression effect compared to controls, and there was no difference in global center surround facilitation. While global motion processing is intact in depression, abnormal center surround suppression effects in depression do extend to global motion stimuli. These alterations may be mitigated by the psychotropic medications taken by some subjects in our depressed sample. Future studies should explore the mechanisms underlying these effects.

Emergence of brain-like mirror-symmetric viewpoint tuning in convolutional neural networks

Primates can recognize objects despite 3D geometric variations such as in-depth rotations. The computational mechanisms that give rise to such invariances are yet to be fully understood. A curious case of partial invariance occurs in the macaque face-patch AL and in fully connected layers of deep convolutional networks in which neurons respond similarly to mirror-symmetric views (e.g., left and right profiles). Why does this tuning develop? Here, we propose a simple learning-driven explanation for mirror-symmetric viewpoint tuning. We show that mirror-symmetric viewpoint tuning for faces emerges in the fully connected layers of convolutional deep neural networks trained on object recognition tasks, even when the training dataset does not include faces. First, using 3D objects rendered from multiple views as test stimuli, we demonstrate that mirror-symmetric viewpoint tuning in convolutional neural network models is not unique to faces: it emerges for multiple object categories with bilateral symmetry. Second, we show why this invariance emerges in the models. Learning to discriminate among bilaterally symmetric object categories induces reflection-equivariant intermediate representations. AL-like mirror-symmetric tuning is achieved when such equivariant responses are spatially pooled by downstream units with sufficiently large receptive fields. These results explain how mirror-symmetric viewpoint tuning can emerge in neural networks, providing a theory of how they might emerge in the primate brain. Our theory predicts that mirror-symmetric viewpoint tuning can emerge as a consequence of exposure to bilaterally symmetric objects beyond the category of faces, and that it can generalize beyond previously experienced object categories.

Visual motion discrimination experiments reveal small differences between males and females

Recent results have shown that males have lower duration thresholds for motion direction discrimination than females. Measuring contrast thresholds, a previous study has shown that males have a greater sensitivity to fine details and fast flickering stimuli than females, and that females have a higher sensitivity to low spatial frequencies modulated at low temporal frequencies. Here, we present the data of a contrast-detection motion discrimination experiment and a reanalysis of four different motion discrimination experiments where we compare duration thresholds for males and females using different spatial frequencies, stimulus sizes, contrasts, and temporal frequencies (in two experiments, motion surround suppression was measured). Results from the main experiment and the reanalysis show that, in general, the association between sex and contrast and duration thresholds for motion discrimination is not significant, with males and females showing similar data patterns. Only the reanalysis of one out of four studies revealed different duration thresholds between males and females paired with a strong effect size supporting previous results in the literature, although motion surround suppression was identical between groups. Importantly, most of our results do not show significant differences between males and females in contrast and duration thresholds, suggesting that the sex variable may not be as relevant as previously claimed when testing visual motion discrimination.

A gradual transition from veridical to categorical representations along the visual hierarchy during working memory, but not perception

The ability to stably maintain visual information over brief delays is central to cognitive functioning. One possible way to achieve robust working memory maintenance is by having multiple concurrent mnemonic representations across multiple cortical loci. For example, early visual cortex might contribute to storage by representing information in a "sensory-like" format, while intraparietal sulcus uses a format transformed away from sensory driven responses. As an explicit test of mnemonic code transformations along the visual hierarchy, we quantitatively modeled the progression of veridical-to-categorical orientation representations in human participants. Participants directly viewed, or held in mind, an oriented grating pattern, and the similarity between fMRI activation patterns for different orientations was calculated throughout retinotopic cortex. During direct perception, similarity was clustered around cardinal orientations, while during working memory the obliques were represented more similarly. We modeled these similarity patterns based on the known distribution of orientation information in the natural world: The "veridical" model uses an efficient coding framework to capture hypothesized representations during visual perception. The "categorical" model assumes that different "psychological distances" between orientations result in orientation categorization relative to cardinal axes. During direct perception, the veridical model explained the data well in early visual areas, while the categorical model did worse. During working memory, the veridical model only explained some of the data, while the categorical model gradually gained explanatory power for increasingly anterior retinotopic regions. These findings suggest that directly viewed images are represented veridically, but once visual information is no longer tethered to the sensory world, there is a gradual progression to more categorical mnemonic formats along the visual hierarchy.

A Unifying Principle for the Functional Organization of Visual Cortex

A key feature of many cortical systems is functional organization: the arrangement of neurons with specific functional properties in characteristic spatial patterns across the cortical surface. However, the principles underlying the emergence and utility of functional organization are poorly understood. Here we develop the Topographic Deep Artificial Neural Network (TDANN), the first unified model to accurately predict the functional organization of multiple cortical areas in the primate visual system. We analyze the key factors responsible for the TDANN's success and find that it strikes a balance between two specific objectives: achieving a task-general sensory representation that is self-supervised, and maximizing the smoothness of responses across the cortical sheet according to a metric that scales relative to cortical surface area. In turn, the representations learned by the TDANN are lower dimensional and more brain-like than those in models that lack a spatial smoothness constraint. Finally, we provide evidence that the TDANN's functional organization balances performance with inter-area connection length, and use the resulting models for a proof-of-principle optimization of cortical prosthetic design. Our results thus offer a unified principle for understanding functional organization and a novel view of the functional role of the visual system in particular.

Neural Mechanisms of Visual Motion Anomalies in Autism: A Two-Decade Update and Novel Aetiology

The 21st century has seen dramatic changes in our understanding of the visual physio-perceptual anomalies of autism and also in the structure and development of the primate visual system. This review covers the past 20 years of research into motion perceptual/dorsal stream anomalies in autism, as well as new understanding of the development of primate vision. The convergence of this literature allows a novel developmental hypothesis to explain the physiological and perceptual differences of the broad autistic spectrum. Central to these observations is the development of motion areas MT+, the seat of the dorsal cortical stream, central area of pre-attentional processing as well as being an anchor of binocular vision for 3D action. Such development normally occurs via a transfer of thalamic drive from the inferior pulvinar → MT to the anatomically stronger but later-developing LGN → V1 → MT connection. We propose that autistic variation arises from a slowing in the normal developmental attenuation of the pulvinar → MT pathway. We suggest that this is caused by a hyperactive amygdala → thalamic reticular nucleus circuit increasing activity in the PIm → MT via response gain modulation of the pulvinar and hence altering synaptic competition in area MT. We explore the probable timing of transfer in dominance of human MT from pulvinar to LGN/V1 driving circuitry and discuss the implications of the main hypothesis.