Primary visual cortex neurons that contribute to resolve the aperture problem

On event-based optical flow detection

Event-based sensing, i.e., the asynchronous detection of luminance changes, promises low-energy, high dynamic range, and sparse sensing. This stands in contrast to whole image frame-wise acquisition by standard cameras. Here, we systematically investigate the implications of event-based sensing in the context of visual motion, or flow, estimation. Starting from a common theoretical foundation, we discuss different principal approaches for optical flow detection ranging from gradient-based methods over plane-fitting to filter based methods and identify strengths and weaknesses of each class. Gradient-based methods for local motion integration are shown to suffer from the sparse encoding in address-event representations (AER). Approaches exploiting the local plane like structure of the event cloud, on the other hand, are shown to be well suited. Within this class, filter based approaches are shown to define a proper detection scheme which can also deal with the problem of representing multiple motions at a single location (motion transparency). A novel biologically inspired efficient motion detector is proposed, analyzed and experimentally validated. Furthermore, a stage of surround normalization is incorporated. Together with the filtering this defines a canonical circuit for motion feature detection. The theoretical analysis shows that such an integrated circuit reduces motion ambiguity in addition to decorrelating the representation of motion related activations.

The marmoset monkey as a model for visual neuroscience

The common marmoset (Callithrix jacchus) has been valuable as a primate model in biomedical research. Interest in this species has grown recently, in part due to the successful demonstration of transgenic marmosets. Here we examine the prospects of the marmoset model for visual neuroscience research, adopting a comparative framework to place the marmoset within a broader evolutionary context. The marmoset's small brain bears most of the organizational features of other primates, and its smooth surface offers practical advantages over the macaque for areal mapping, laminar electrode penetration, and two-photon and optical imaging. Behaviorally, marmosets are more limited at performing regimented psychophysical tasks, but do readily accept the head restraint that is necessary for accurate eye tracking and neurophysiology, and can perform simple discriminations. Their natural gaze behavior closely resembles that of other primates, with a tendency to focus on objects of social interest including faces. Their immaturity at birth and routine twinning also makes them ideal for the study of postnatal visual development. These experimental factors, together with the theoretical advantages inherent in comparing anatomy, physiology, and behavior across related species, make the marmoset an excellent model for visual neuroscience.

A simpler primate brain: the visual system of the marmoset monkey

Humans are diurnal primates with high visual acuity at the center of gaze. Although primates share many similarities in the organization of their visual centers with other mammals, and even other species of vertebrates, their visual pathways also show unique features, particularly with respect to the organization of the cerebral cortex. Therefore, in order to understand some aspects of human visual function, we need to study non-human primate brains. Which species is the most appropriate model? Macaque monkeys, the most widely used non-human primates, are not an optimal choice in many practical respects. For example, much of the macaque cerebral cortex is buried within sulci, and is therefore inaccessible to many imaging techniques, and the postnatal development and lifespan of macaques are prohibitively long for many studies of brain maturation, plasticity, and aging. In these and several other respects the marmoset, a small New World monkey, represents a more appropriate choice. Here we review the visual pathways of the marmoset, highlighting recent work that brings these advantages into focus, and identify where additional work needs to be done to link marmoset brain organization to that of macaques and humans. We will argue that the marmoset monkey provides a good subject for studies of a complex visual system, which will likely allow an important bridge linking experiments in animal models to humans.

Beta, but not gamma, band oscillations index visual form-motion integration

Electrophysiological oscillations in different frequency bands co-occur with perceptual, motor and cognitive processes but their function and respective contributions to these processes need further investigations. Here, we recorded MEG signals and seek for percept related modulations of alpha, beta and gamma band activity during a perceptual form/motion integration task. Participants reported their bound or unbound perception of ambiguously moving displays that could either be seen as a whole square-like shape moving along a Lissajou's figure (bound percept) or as pairs of bars oscillating independently along cardinal axes (unbound percept). We found that beta (15–25 Hz), but not gamma (55–85 Hz) oscillations, index perceptual states at the individual and group level. The gamma band activity found in the occipital lobe, although significantly higher during visual stimulation than during base line, is similar in all perceptual states. Similarly, decreased alpha activity during visual stimulation is not different for the different percepts. Trial-by-trial classification of perceptual reports based on beta band oscillations was significant in most observers, further supporting the view that modulation of beta power reliably index perceptual integration of form/motion stimuli, even at the individual level.

Combining feature selection and integration--a neural model for MT motion selectivity

Background

The computation of pattern motion in visual area MT based on motion input from area V1 has been investigated in many experiments and models attempting to replicate the main mechanisms. Two different core conceptual approaches were developed to explain the findings. In integrationist models the key mechanism to achieve pattern selectivity is the nonlinear integration of V1 motion activity. In contrast, selectionist models focus on the motion computation at positions with 2D features.

Methodology/Principal Findings

Recent experiments revealed that neither of the two concepts alone is sufficient to explain all experimental data and that most of the existing models cannot account for the complex behaviour found. MT pattern selectivity changes over time for stimuli like type II plaids from vector average to the direction computed with an intersection of constraint rule or by feature tracking. Also, the spatial arrangement of the stimulus within the receptive field of a MT cell plays a crucial role. We propose a recurrent neural model showing how feature integration and selection can be combined into one common architecture to explain these findings. The key features of the model are the computation of 1D and 2D motion in model area V1 subpopulations that are integrated in model MT cells using feedforward and feedback processing. Our results are also in line with findings concerning the solution of the aperture problem.

Conclusions/Significance

We propose a new neural model for MT pattern computation and motion disambiguation that is based on a combination of feature selection and integration. The model can explain a range of recent neurophysiological findings including temporally dynamic behaviour.

Magnetoencephalographic signatures of visual form and motion binding

This study investigates neural magneto-encephalographic (MEG) correlates of visual form and motion binding. Steady-state visual evoked fields (SSVEF) were recorded in MEG while observers reported their bound or unbound perception of moving bars arranged in a square shape. By using pairs of oscillating vertical and horizontal bars, "frequency-tagged" at f1 and f2, we identified a region with enhanced sustained power at 2f1+2f2 intermodulation frequency correlated with perceptual reports. Intermodulation power is more important during perceptual form/motion integration than during the perceptual segmentation of the stimulus into individual component motions, indicating that intermodulation frequency power is a neuromarker of form/motion integration. Source reconstruction of cortical activities at the relevant frequencies further reveals well segregated activity in the occipital lobe at the fundamental of the stimulation, f1 and f2, widely spread activity at 2f1 and 2f2 and a focal activity in the medial part of the right precentral sulcus region at the intermodulation component, 2f1+2f2. The present findings indicate that motion tagging provides a powerful way of investigating the processes underlying visual form/motion binding non-invasively in humans.

Reporting the Implementation of the Three Rs in European Primate and Mouse Research Papers: Are We Making Progress?

It is now more than 20 years since both Council of Europe Convention ETS123 and EU Directive 86/609?EEC were introduced, to promote the implementation of the Three Rs in animal experimentation and to provide guidance on animal housing and care. It might therefore be expected that reports of the implementation of the Three Rs in animal research papers would have increased during this period. In order to test this hypothesis, a literature survey of animal-based research was conducted. A randomly-selected sample from 16 high-profile medical journals, of original research papers arising from European institutions that featured experiments which involved either mice or primates, were identified for the years 1986 and 2006 (Total sample = 250 papers). Each paper was scored out of 10 for the incidence of reporting on the implementation of Three Rs-related factors corresponding to Replacement (justification of non-use of non-animal methods), Reduction (statistical analysis of the number of animals needed) and Refinement (housing aspects, i.e. increased cage size, social housing, enrichment of cage environment and food; and procedural aspects, i.e. the use of anaesthesia, analgesia, humane endpoints, and training for procedures with positive reinforcement). There was no significant increase in overall reporting score over time, for either mouse or primate research. By 2006, mouse research papers scored an average of 0 out of a possible 10, and primate research papers scored an average of 1.5. This review provides systematic evidence that animal research is still not properly reported, and supports the call within the scientific community for action to be taken by journals to update their policies.

Directional anisotropy of motion responses in retinotopic cortex

Recently, evidence has emerged for a radial orientation bias in early visual cortex. These results predict that in early visual cortex a tangential bias should be present for motion direction. We tested this prediction in a human imaging study, using a translating random dot pattern that slowly rotated its motion direction 360 degrees in cycles of 54 s. In addition, polar angle and eccentricity mapping were performed. This allowed the measurement of the BOLD response across the visual representations of the different retinotopic areas. We found that, in V1, V2, and V3, BOLD responses were consistently enhanced for centrifugal and centripetal motion, relative to tangential motion. The relative magnitude of the centrifugal and centripetal response biases changed with visual eccentricity. We found no motion direction biases in MT+. These results are in line with previously observed anisotropies in motion sensitivity across the visual field. However, the observation of radial motion biases in early visual cortex is surprising considering the evidence for a radial orientation bias. An additional experiment was performed to resolve this apparent conflict in results. The additional experiment revealed that the observed motion direction biases most likely originate from anisotropies in long range horizontal connections within visual cortex.

Stimulus dependency and mechanisms of surround modulation in cortical area MT

The perceptual interpretation of a given visual feature depends on the surrounding context. To explore the neural mechanisms underlying such contextual interactions in the motion domain, we studied responses of neurons in the middle temporal area (MT) of macaque monkeys while presenting a variety of center-surround stimuli that stimulated both the classical receptive visual field (CRF) and the receptive field surround. In human psychophysical experiments, the perceptual impact of the surround stimulus on the center stimulus varied from motion capture ("integration") to motion contrast ("segmentation"). In our neurophysiological experiments, the directional tuning of surround modulation with these stimuli ranged from antagonistic (consistent with motion contrast) to integrative (consistent with motion capture) and agreed qualitatively with perception under some but not all conditions. Most strikingly, for a stimulus that elicited perceptual motion contrast, surround modulation was integrative if the CRF stimulus was ambiguous due to the aperture problem. In addition, we found that surround modulation was linked to response magnitude: stimuli eliciting the largest responses yielded the strongest antagonism and those eliciting the smallest responses yielded the strongest integration. We developed a neural network model that accounts for this finding as well as a previous finding that surround suppression in area MT is contrast-dependent. Our findings suggest that changes in MT surround modulation result from shifts in the balance between directionally tuned excitation and inhibition mediated by changes in input strength. We speculate that input strength is, in turn, linked with the ambiguity of the motion present within the CRF.