Motion opponency in visual cortex

Direct comparison reveals algorithmic similarities in fly and mouse visual motion detection

Evolution has equipped vertebrates and invertebrates with neural circuits that selectively encode visual motion. While similarities in the computations performed by these circuits in mouse and fruit fly have been noted, direct experimental comparisons have been lacking. Because molecular mechanisms and neuronal morphology in the two species are distinct, we directly compared motion encoding in these two species at the algorithmic level, using matched stimuli and focusing on a pair of analogous neurons, the mouse ON starburst amacrine cell (ON SAC) and Drosophila T4 neurons. We find that the cells share similar spatiotemporal receptive field structures, sensitivity to spatiotemporal correlations, and tuning to sinusoidal drifting gratings, but differ in their responses to apparent motion stimuli. Both neuron types showed a response to summed sinusoids that deviates from models for motion processing in these cells, underscoring the similarities in their processing and identifying response features that remain to be explained.

A neural model for vector decomposition and relative-motion perception

The perception of motion not only depends on the detection of motion signals but also on choosing and applying reference-frames according to which motion is interpreted. Here we propose a neural model that implements the common-fate principle for reference-frame selection. The model starts with a retinotopic layer of directionally-tuned motion detectors. The Gestalt common-fate principle is applied to the activities of these detectors to implement in two neural populations the direction and the magnitude (speed) of the reference-frame. The output activities of retinotopic motion-detectors are decomposed using the direction of the reference-frame. The direction and magnitude of the reference-frame are then applied to these decomposed motion-vectors to generate activities that reflect relative-motion perception, i.e., the perception of motion with respect to the prevailing reference-frame. We simulated this model for classical relative motion stimuli, viz., the three-dot, rotating-wheel, and point-walker (biological motion) paradigms and found the model performance to be close to theoretical vector decomposition values. In the three-dot paradigm, the model made the prediction of perceived curved-trajectories for the target dot when its horizontal velocity was slower or faster than the flanking dots. We tested this prediction in two psychophysical experiments and found a good qualitative and quantitative agreement between the model and the data. Our results show that a simple neural network using solely motion information can account for the perception of group and relative motion.

Motion opponency at the middle temporal cortex: Preserved motion information and the effect of perceptual learning

Motion opponency, first observed within the primate middle temporal cortex (MT), refers to the suppressing effect of opposite motion directions on neuronal activity. Namely, when opposing motion directional signals stimulate an MT neuron's receptive field, this neuron's response is comparable with that induced by flicker noise. Under such suppression, it is unknown whether any directional information is still represented at MT. In this study, we applied support vector machine (SVM) learning to human functional magnetic resonance imaging data to investigate if any motion defined orientation information was still available from suppressed MT. We found that, at least at the level of ±45° discrimination, such orientation information was still available. Interestingly, after behavioural perceptual learning that improved human discrimination of fine orientation discrimination (e.g. 42° vs. 48°) using the MT-suppressive motion stimuli, the SVM discrimination of ±45° worsened when functional magnetic resonance imaging (fMRI) signals at post-learning MT were used. This result is consistent with findings in Thompson et al. (2013) that, post-perceptual learning, MT suppression was not released, suggesting that motion opponency was perhaps functionally too important for perceptual learning to overcome.

A key role of orientation in the coding of visual motion direction

Despite the fundamental importance of visual motion processing, our understanding of how the brain represents basic aspects of motion is incomplete. While it is generally believed that direction is the main representational feature of motion, motion processing is also influenced by nondirectional orientation signals that are present in most motion stimuli. Here, we aimed to test whether this nondirectional motion axis contributes motion perception even when orientation is completely absent from the stimulus. Using stimuli with and without orientation signals, we found that serial dependence in a simple motion direction estimation task was predominantly determined by the orientation of the previous motion stimulus. Moreover, the observed attraction profiles closely matched the characteristic pattern of serial attraction found in orientation perception. Evidently, the sequential integration of motion signals strongly depends on the orientation of motion, indicating a fundamental role of nondirectional orientation in the coding of visual motion direction.

Visual Motion Coherence Responses in Human Visual Cortex

Random dot kinematograms (RDKs) have recently been used to train subjects with cortical scotomas to perform direction of motion discrimination, partially restoring visual motion perception. To study the recovery of visual perception, it is important to understand how visual areas in normal subjects and subjects with cortical scotomas respond to RDK stimuli. Studies in normal subjects have shown that blood oxygen level-dependent (BOLD) responses in human area hV5/MT+ increase monotonically with coherence, in general agreement with electrophysiology studies in primates. However, RDK responses in prior studies were obtained while the subject was performing fixation, not a motion discrimination condition. Furthermore, BOLD responses were gauged against a baseline condition of uniform illumination or static dots, potentially decreasing the specificity of responses for the spatial integration of local motion signals (motion coherence). Here, we revisit this question starting from a baseline RDK condition of no coherence, thereby isolating the component of BOLD response due specifically to the spatial integration of local motion signals. In agreement with prior studies, we found that responses in the area hV5/MT+ of healthy subjects were monotonically increasing when subjects fixated without performing a motion discrimination task. In contrast, when subjects were performing an RDK direction of motion discrimination task, responses in the area hV5/MT+ remained flat, changing minimally, if at all, as a function of motion coherence. A similar pattern of responses was seen in the area hV5/MT+ of subjects with dense cortical scotomas performing direction of motion discrimination for RDKs presented inside the scotoma. Passive RDK presentation within the scotoma elicited no significant hV5/MT+ responses. These observations shed further light on how visual cortex responses behave as a function of motion coherence, helping to prepare the ground for future studies using these methods to study visual system recovery after injury.

Evidence for strictly monocular processing in visual motion opponency and Glass pattern perception

When presented with locally paired dots moving in opposite directions, motion selective neurons in the middle temporal cortex (MT) reduce firing while neurons in V1 are unaffected. This physiological effect is known as motion opponency. The current study used psychophysics to investigate the neural circuit underlying motion opponency. We asked whether opposing motion signals could arrive from different eyes into the receptive field of a binocular neuron while still maintaining motion opponency. We took advantage of prior findings that orientation discrimination of the motion axis (along which paired dots oscillate) is harder when dots move counter-phase than in-phase, an effect associated with motion opponency. We found that such an effect disappeared when paired dots originated from different eyes. This suggests that motion opponency, at some point, involves strictly monocular processing. This does not mean that motion opponency is entirely monocular. Further, we found that the effect of a Glass pattern disappeared under similar viewing conditions, suggesting that Glass pattern perception also involves some strictly monocular processing.

Reduced direction discrimination sensitivity in visual motion adaptation, and the role of perceptual learning

We investigated visual direction discrimination under the influence of motion aftereffect (MAE). Participants in each experiment first adapted to a horizontally drifting grating before deciding whether a drifting test grating moved to the left or right. A psychometric function was obtained as a function of the velocity of the test. Interestingly, in addition to the horizontal shift of the psychometric function that typified the MAE, the slope of the psychometric function became shallower after adaptation, indicating decreased discrimination sensitivity. However, this decrease was only observed in psychophysically experienced participants. Motivated, but psychophysically inexperienced participants only showed this effect after weeks of perceptual learning. This shallowing effect transferred to the untrained adaptation direction (e.g., from leftward adaptation to rightward), although perceptual learning of improved discrimination could not transfer. When the test duration was lengthened to reduce task difficulty, less training was needed to produce the same effect. These results indicate that, post-adaptation and when steady measurements could be obtained, left-right motion direction discrimination sensitivity was reduced.

Direction-selective motion discrimination by traveling waves in visual cortex

The majority of neurons in primary visual cortex respond selectively to bars of light that have a specific orientation and move in a specific direction. The spatial and temporal responses of such neurons are non-separable. How neurons accomplish that computational feat without resort to explicit time delays is unknown. We propose a novel neural mechanism whereby visual cortex computes non-separable responses by generating endogenous traveling waves of neural activity that resonate with the space-time signature of the visual stimulus. The spatiotemporal characteristics of the response are defined by the local topology of excitatory and inhibitory lateral connections in the cortex. We simulated the interaction between endogenous traveling waves and the visual stimulus using spatially distributed populations of excitatory and inhibitory neurons with Wilson-Cowan dynamics and inhibitory-surround coupling. Our model reliably detected visual gratings that moved with a given speed and direction provided that we incorporated neural competition to suppress false motion signals in the opposite direction. The findings suggest that endogenous traveling waves in visual cortex can impart direction-selectivity on neural responses without resort to explicit time delays. They also suggest a functional role for motion opponency in eliminating false motion signals.

It is well established that the so-called ‘simple cells’ of the primary visual cortex respond preferentially to oriented bars of light that move across the visual field with a particular speed and direction. The spatiotemporal responses of such neurons are said to be non-separable because they cannot be constructed from independent spatial and temporal neural mechanisms. Contemporary theories of how neurons compute non-separable responses typically rely on finely tuned transmission delays between signals from disparate regions of the visual field. However the existence of such delays is controversial. We propose an alternative neural mechanism for computing non-separable responses that does not require transmission delays. It instead relies on the predisposition of the cortical tissue to spontaneously generate spatiotemporal waves of neural activity that travel with a particular speed and direction. We propose that the endogenous wave activity resonates with the visual stimulus to elicit direction-selective neural responses to visual motion. We demonstrate the principle in computer models and show that competition between opposing neurons robustly enhances their ability to discriminate between visual gratings that move in opposite directions.

Motion opponency examined throughout visual cortex with multivariate pattern analysis of fMRI data

This study explores how the human brain solves the challenge of flicker noise in motion processing. Despite providing no useful directional motion information, flicker is common in the visual environment and exhibits omnidirectional motion energy which is processed by low‐level motion detectors. Models of motion processing propose a mechanism called motion opponency that reduces flicker processing. Motion opponency involves the pooling of local motion signals to calculate an overall motion direction. A neural correlate of motion opponency has been observed in human area MT+/V5, whereby stimuli with perfectly balanced motion energy constructed from dots moving in counter‐phase elicit a weaker response than nonbalanced (in‐phase) motion stimuli. Building on this previous work, we used multivariate pattern analysis to examine whether the activation patterns elicited by motion opponent stimuli resemble that elicited by flicker noise across the human visual cortex. Robust multivariate signatures of opponency were observed in V5 and in V3A. Our results support the notion that V5 is centrally involved in motion opponency and in the reduction of flicker. Furthermore, these results demonstrate the utility of multivariate analysis methods in revealing the role of additional visual areas, such as V3A, in opponency and in motion processing more generally.

The 4D Space-Time Dimensions of Facial Perception

Facial information is a powerful channel for human-to-human communication. Characteristically, faces can be defined as biological objects that are four-dimensional (4D) patterns, whereby they have concurrently a spatial structure and surface as well as temporal dynamics. The spatial characteristics of facial objects contain a volume and surface in three dimensions (3D), namely breadth, height and importantly, depth. The temporal properties of facial objects are defined by how a 3D facial structure and surface evolves dynamically over time; where time is referred to as the fourth dimension (4D). Our entire perception of another’s face, whether it be social, affective or cognitive perceptions, is therefore built on a combination of 3D and 4D visual cues. Counterintuitively, over the past few decades of experimental research in psychology, facial stimuli have largely been captured, reproduced and presented to participants with two dimensions (2D), while remaining largely static. The following review aims to advance and update facial researchers, on the recent revolution in computer-generated, realistic 4D facial models produced from real-life human subjects. We delve in-depth to summarize recent studies which have utilized facial stimuli that possess 3D structural and surface cues (geometry, surface and depth) and 4D temporal cues (3D structure + dynamic viewpoint and movement). In sum, we have found that higher-order perceptions such as identity, gender, ethnicity, emotion and personality, are critically influenced by 4D characteristics. In future, it is recommended that facial stimuli incorporate the 4D space-time perspective with the proposed time-resolved methods.

Dynamic nonlinearities enable direction opponency in Drosophila elementary motion detectors

Direction-selective neurons respond to visual motion in a preferred direction. They are direction-opponent if they are also inhibited by motion in the opposite direction. In flies and vertebrates, direction opponency has been observed in second-order direction-selective neurons, which achieve this opponency by subtracting signals from first-order direction-selective cells with opposite directional tunings. Here, we report direction opponency in Drosophila that emerges in first-order direction-selective neurons, the elementary motion detectors T4 and T5. This opponency persists when synaptic output from these cells is blocked, suggesting that it arises from feedforward, not feedback, computations. These observations exclude a broad class of linear-nonlinear models that have been proposed to describe direction-selective computations. However, they are consistent with models that include dynamic nonlinearities. Simulations of opponent models suggest that direction opponency in first-order motion detectors improves motion discriminability by suppressing noise generated by the local structure of natural scenes.

Asymmetries between achromatic and chromatic extraction of 3D motion signals

Motion in depth (MID) can be cued by high-resolution changes in binocular disparity over time (CD), and low-resolution interocular velocity differences (IOVD). Computational differences between these two mechanisms suggest that they may be implemented in visual pathways with different spatial and temporal resolutions. Here, we used fMRI to examine how achromatic and S-cone signals contribute to human MID perception. Both CD and IOVD stimuli evoked responses in a widespread network that included early visual areas, parts of the dorsal and ventral streams, and motion-selective area hMT+. Crucially, however, we measured an interaction between MID type and chromaticity. fMRI CD responses were largely driven by achromatic stimuli, but IOVD responses were better driven by isoluminant S-cone inputs. In our psychophysical experiments, when S-cone and achromatic stimuli were matched for perceived contrast, participants were equally sensitive to the MID in achromatic and S-cone IOVD stimuli. In comparison, they were relatively insensitive to S-cone CD. These findings provide evidence that MID mechanisms asymmetrically draw on information in precortical pathways. An early opponent motion signal optimally conveyed by the S-cone pathway may provide a substantial contribution to the IOVD mechanism.

Magnetoencephalography adaptation reveals depth-cue-invariant object representations in the visual cortex

Independent of edges and 2-D shape that can be highly informative of object identity, depth cues alone can also give rise to vivid and effective object percepts. The processing of different depth cues engages segregated cortical areas, and an efficient object representation would be one that is invariant to depth cues. Here, we investigated depth-cue invariance of object representations by measuring the category-specific response to faces-the M170 response measured with magnetoencephalography. The M170 response is strongest to faces and is sensitive to adaptation, such that repeated presentation of a face diminishes subsequent M170 responses. We used this feature of the M170 and measured the degree to which the adaptation effect is affected by variations in depth cue and 3-D object shape. Subjects viewed a rapid presentation of two stimuli-an adaptor and a test stimulus. The adaptor was either a face, a chair, or a face-like oval surface, and rendered with a single depth cue (shading, structure from motion, or texture). The test stimulus was always a shaded face of a random identity, thus completely controlling for low-level influences on the M170 response to the test stimulus. In the left fusiform face area, we found strong M170 adaptation when the adaptor was a face regardless of its depth cue. This adaptation was marginal in the right fusiform and negligible in the occipital regions. Our results support the presence of depth-cue-invariant representations in the human visual system, alongside size, position, and viewpoint invariance.

The frequency of alpha oscillations: Task-dependent modulation and its functional significance

Power (amplitude) and frequency are two important characteristics of EEG alpha oscillations (8-12 Hz). There is an extensive literature showing that alpha power can be modulated in a goal-oriented manner to either enhance or suppress sensory information processing. Only a few studies to date have examined the task-dependent modulation of alpha frequency. Instead, alpha frequency is often viewed as a trait variable, and used to characterize individual differences in cognitive functioning. We performed two experiments to examine the task-dependent modulation of alpha frequency and its functional significance. In the first experiment, high-density EEG was recorded from 21 participants performing a Sternberg working memory task. The results showed that: (1) during memory encoding, alpha frequency decreased with increasing memory load, whereas during memory retention and retrieval, alpha frequency increased with increasing memory load, (2) higher alpha frequency prior to the onset of probe was associated with longer reaction time, and (3) higher alpha frequency prior to the onset of cue or probe was associated with weaker early cue-evoked or probe-evoked neural responses. In the second experiment, simultaneous EEG-fMRI was recorded from 59 participants during resting state. An EEG-informed fMRI analysis revealed that the spontaneous fluctuations of alpha frequency, but not alpha power, were inversely associated with BOLD activity in the visual cortex. Taken together, these findings suggest that alpha frequency is task-dependent, may serve as an indicator of cortical excitability, and along with alpha power, provides more comprehensive indexing of sensory gating.

A quantitative framework for motion visibility in human cortex

Despite the central use of motion visibility to reveal the neural basis of perception, perceptual decision making, and sensory inference there exists no comprehensive quantitative framework establishing how motion visibility parameters modulate human cortical response. Random-dot motion stimuli can be made less visible by reducing image contrast or motion coherence, or by shortening the stimulus duration. Because each of these manipulations modulates the strength of sensory neural responses they have all been extensively used to reveal cognitive and other nonsensory phenomena such as the influence of priors, attention, and choice-history biases. However, each of these manipulations is thought to influence response in different ways across different cortical regions and a comprehensive study is required to interpret this literature. Here, human participants observed random-dot stimuli varying across a large range of contrast, coherence, and stimulus durations as we measured blood-oxygen-level dependent responses. We developed a framework for modeling these responses that quantifies their functional form and sensitivity across areas. Our framework demonstrates the sensitivity of all visual areas to each parameter, with early visual areas V1-V4 showing more parametric sensitivity to changes in contrast and V3A and the human middle temporal area to coherence. Our results suggest that while motion contrast, coherence, and duration share cortical representation, they are encoded with distinct functional forms and sensitivity. Thus, our quantitative framework serves as a reference for interpretation of the vast perceptual literature manipulating these parameters and shows that different manipulations of visibility will have different effects across human visual cortex and need to be interpreted accordingly. NEW & NOTEWORTHY Manipulations of motion visibility have served as a key tool for understanding the neural basis for visual perception. Here we measured human cortical response to changes in visibility across a comprehensive range of motion visibility parameters and modeled these with a quantitative framework. Our quantitative framework can be used as a reference for linking human cortical response to perception and underscores that different manipulations of motion visibility can have greatly different effects on cortical representation.

Visual perceptual training reconfigures post-task resting-state functional connectivity with a feature-representation region

The neural mechanisms underlying visual perceptual learning (VPL) have typically been studied by examining changes in task-related brain activation after training. However, the relationship between post-task "offline" processes and VPL remains unclear. The present study examined this question by obtaining resting-state functional magnetic resonance imaging (fMRI) scans of human brains before and after a task-fMRI session involving visual perceptual training. During the task-fMRI session, participants performed a motion coherence discrimination task in which they judged the direction of moving dots with a coherence level that varied between trials (20, 40, and 80%). We found that stimulus-induced activation increased with motion coherence in the middle temporal cortex (MT+), a feature-specific region representing visual motion. On the other hand, stimulus-induced activation decreased with motion coherence in the dorsal anterior cingulate cortex (dACC) and bilateral insula, regions involved in decision making under perceptual ambiguity. Moreover, by comparing pre-task and post-task rest periods, we revealed that resting-state functional connectivity (rs-FC) with the MT+ was significantly increased after training in widespread cortical regions including the bilateral sensorimotor and temporal cortices. In contrast, rs-FC with the MT+ was significantly decreased in subcortical regions including the thalamus and putamen. Importantly, the training-induced change in rs-FC was observed only with the MT+, but not with the dACC or insula. Thus, our findings suggest that perceptual training induces plastic changes in offline functional connectivity specifically in brain regions representing the trained visual feature, emphasising the distinct roles of feature-representation regions and decision-related regions in VPL.

Spatial proximity modulates the strength of motion opponent suppression elicited by locally paired dot displays

Locally paired dot stimuli that contain opposing motion signals at roughly the same spatial locations (counter-phase stimuli) have been reported to produce percepts devoid of global motion. Counter-phase stimuli are also thought to elicit a reduced neural response at motion processing brain area MT/V5, an effect known as motion opponency. The current study examines the effect of vertical counter-phase background motion on behavioral discrimination of horizontal target motion. We found that counter-phase backgrounds generally produced lower behavioral thresholds than locally unbalanced backgrounds, an effect consistent with the idea that counter-phase motion elicits opponency. However, this effect was apparent only if the paired dots were close enough in proximity that they crossed one another during their movement. Furthermore, we found that counter-phase stimuli containing within-pair dot crossing elicits similar behavioral thresholds to non-motion flicker stimuli. These results provide insight into the requirements for activating opponency in the brain and suggest that the brain processes counter-phase and flicker stimuli similarly due to opponency.

Low-level mediation of directionally specific motion aftereffects: Motion perception is not necessary

Previous psychophysical experiments with normal human observers have shown that adaptation to a moving dot stream causes directionally specific repulsion in the perceived angle of a subsequently viewed moving probe. In this study, we used a two-alternative forced choice task with roving pedestals to determine the conditions that are necessary and sufficient for producing directionally specific repulsion with compound adaptors, each of which contains two oppositely moving, differently colored component streams. Experiment 1 provided a demonstration of repulsion between single-component adaptors and probes moving at approximately 90° or 270°. In Experiment 2, oppositely moving dots in the adaptor were paired to preclude the appearance of motion. Nonetheless, repulsion remained strong when the angle between each probe stream and one component was approximately 30°. In Experiment 3, adapting dot pairs were kept stationary during their limited lifetimes. Their orientation content alone proved insufficient for producing repulsion. In Experiments 4–6, the angle between the probe and both adapting components was approximately 90° or 270°. Directional repulsion was found when observers were asked to visually track one of the adapting components (Exp. 6), but not when they were asked to attentionally track it (Exp. 5), nor while they passively viewed the adaptor (Exp. 4). Our results are consistent with a low-level mechanism for motion adaptation. This mechanism is not selective for stimulus color and is not susceptible to attentional modulation. The most likely cortical locus of adaptation is area V1.

Neural Hyperexcitability in Autism Spectrum Disorders

Despite the progress that has been made in research on autism spectrum disorders (ASD), the understanding of the biological basis of ASD to identify targets for novel, effective treatment remains limited. One of the leading biological theories of autism is a model of cortical hyperexcitability. While numerous genetic and epigenetic studies support this model, how this particular biological alteration relates to known phenotypes in ASD is not well established. Using examples of sensory processing alterations, this review illustrates how cortical excitability may affect neural processes to result eventually in some core clinical phenotypes in ASD. Applications of the cortical excitability model for translational research and drug development are also discussed.

Structural and functional correlates for language efficiency in auditory word processing

This study aims to provide convergent understanding of the neural basis of auditory word processing efficiency using a multimodal imaging. We investigated the structural and functional correlates of word processing efficiency in healthy individuals. We acquired two structural imaging (T1-weighted imaging and diffusion tensor imaging) and functional magnetic resonance imaging (fMRI) during auditory word processing (phonological and semantic tasks). Our results showed that better phonological performance was predicted by the greater thalamus activity. In contrary, better semantic performance was associated with the less activation in the left posterior middle temporal gyrus (pMTG), supporting the neural efficiency hypothesis that better task performance requires less brain activation. Furthermore, our network analysis revealed the semantic network including the left anterior temporal lobe (ATL), dorsolateral prefrontal cortex (DLPFC) and pMTG was correlated with the semantic efficiency. Especially, this network acted as a neural efficient manner during auditory word processing. Structurally, DLPFC and cingulum contributed to the word processing efficiency. Also, the parietal cortex showed a significate association with the word processing efficiency. Our results demonstrated that two features of word processing efficiency, phonology and semantics, can be supported in different brain regions and, importantly, the way serving it in each region was different according to the feature of word processing. Our findings suggest that word processing efficiency can be achieved by in collaboration of multiple brain regions involved in language and general cognitive function structurally and functionally.

Visual perception in dyslexia is limited by sub-optimal scale selection

Readers with dyslexia are purported to have a selective visual impairment but the underlying nature of the deficit remains elusive. Here, we used a combination of behavioural psychophysics and biologically-motivated computational modeling to investigate if this deficit extends to object segmentation, a process implicated in visual word form recognition. Thirty-eight adults with a wide range of reading abilities were shown random-dot displays spatially divided into horizontal segments. Adjacent segments contained either local motion signals in opposing directions or analogous static form cues depicting orthogonal orientations. Participants had to discriminate these segmented patterns from stimuli containing identical motion or form cues that were spatially intermingled. Results showed participants were unable to perform the motion or form task reliably when segment size was smaller than a spatial resolution (acuity) limit that was independent of reading skill. Coherence thresholds decreased as segment size increased, but for the motion task the rate of improvement was shallower for readers with dyslexia and the segment size where performance became asymptotic was larger. This suggests that segmentation is impaired in readers with dyslexia but only on tasks containing motion information. We interpret these findings within a novel framework in which the mechanisms underlying scale selection are impaired in developmental dyslexia.

Opposite effects of high- and low-frequency transcranial random noise stimulation probed with visual motion adaptation

Transcranial random noise stimulation (tRNS) is a recent neuro-modulation technique whose effects at both behavioural and neural level are still debated. Here we employed the well-known phenomenon of motion after-effect (MAE) in order to investigate the effects of high- vs. low-frequency tRNS on motion adaptation and recovery. Participants were asked to estimate the MAE duration following prolonged adaptation (20 s) to a complex moving pattern, while being stimulated with either sham or tRNS across different blocks. Different groups were administered with either high- or low-frequency tRNS. Stimulation sites were either bilateral human MT complex (hMT⁺) or frontal areas. The results showed that, whereas no effects on MAE duration were induced by stimulating frontal areas, when applied to the bilateral hMT⁺, high-frequency tRNS caused a significant decrease in MAE duration whereas low-frequency tRNS caused a significant corresponding increase in MAE duration. These findings indicate that high- and low-frequency tRNS have opposed effects on the adaptation-dependent unbalance between neurons tuned to opposite motion directions, and thus on neuronal excitability.

Contribution of color signals to ocular following responses

Ocular following responses (OFRs) are elicited at ultra-short latencies (< 60 ms) by sudden movements of the visual scene. In this study, we investigated the roles of color signals in OFRs in monkeys. To make physiologically isoluminant sinusoidal color gratings, we estimated the physiologically isoluminant points using OFRs and found that the physiologically isoluminant points were nearly independent of the spatiotemporal frequency of the gratings. We recorded OFRs induced by the motion of physiologically isoluminant color gratings and found that OFRs elicited by the motion of color gratings had different spatiotemporal frequency tuning from those elicited by the motion of luminance gratings. Additionally, OFRs to isoluminant color gratings had smaller peak responses, suggesting that color signals weakly contribute to OFRs compared with luminance signals. OFRs to the motion of stimuli composed of luminance and color signals were also examined. We found that color signals largely contributed to OFRs under low luminance signals regardless of whether color signals moved in the same or opposite direction to luminance signals. These results provide evidence of the multichannel visual computations underlying motor responses. We conclude that, in everyday situations, color information contributes cooperatively with luminance information to the generation of ocular tracking behaviors.

Properties of the Visible Light Phototaxis and UV Avoidance Behaviors in the Larval Zebrafish

For many organisms, color is an essential source of information from visual scenes. The larval zebrafish has the potential to be a model for the study of this topic, given its tetrachromatic retina and high dependence on vision. In this study we took a step toward understanding how the larval zebrafish might use color sensing. To this end, we used a projector-based paradigm to force a choice of a color stimulus at every turn of the larva. The stimuli used spanned most of the larval spectral range, including activation of its Ultraviolet (UV) cone, which has not been described behaviorally before. We found that zebrafish larvae swim toward visible wavelengths (>400 nm) when choosing between them and darkness, as has been reported with white light. However, when presented with UV light and darkness zebrafish show an intensity dependent avoidance behavior. This UV avoidance does not interact cooperatively with phototaxis toward longer wavelengths, but can compete against it in an intensity dependent manner. Finally, we show that the avoidance behavior depends on the presence of eyes with functional UV cones. These findings open future avenues for studying the neural circuits that underlie color sensing in the larval zebrafish.

Psychophysical and rTMS Evidence for the Presence of Motion Opponency in Human V5

BACKGROUND

Motion sensitive cells within macaque V5, but not V1, exhibit motion opponency whereby their firing is suppressed by motion in their anti-preferred direction. fMRI studies indicate the presence of motion opponent mechanisms in human V5.

OBJECTIVE/HYPOTHESIS

We tested two hypotheses. 1) Performance of a motion discrimination task would be poorer when stimuli were constructed from pairs of dots that moved in counter-phase vs. in-phase, because counter-phase dots would activate motion opponent mechanisms in V5. 2) Offline 1 Hz rTMS of V5 would impair discrimination performance for in-phase stimuli but not counter-phase stimuli, and the opposite effect would be found for rTMS of V1.

METHODS

Stimuli were constructed from 100 dot pairs. Paired dots moved along a fixed motion axis either in counter-phase (motion opponent stimulus) or in-phase (non-opponent motion stimulus). Motion axis orientation discrimination thresholds were measured for each stimulus. Blocks of 300 trials were then presented at 85% correct threshold and discrimination accuracy was measured before and after 1 Hz offline rTMS of either V1 or V5. Subjects were 8 healthy adults.

RESULTS

Discrimination thresholds were significantly larger (worse) for counter-phase than in-phase stimuli (p = 0.02). V5 rTMS mildly impaired discrimination accuracy for the in-phase dot stimuli (p = 0.02) but not the counter-phase dot stimuli. The opposite effect occurred for V1 rTMS (p = 0.05).

CONCLUSIONS

Opponent motion mechanisms are present within human V5 and activation of these mechanisms impairs motion discrimination. In addition, perception of the motion axis within opponent motion stimuli involves processing within V1.

Human visual cortical responses to specular and matte motion flows

Determining the compositional properties of surfaces in the environment is an important visual capacity. One such property is specular reflectance, which encompasses the range from matte to shiny surfaces. Visual estimation of specular reflectance can be informed by characteristic motion profiles; a surface with a specular reflectance that is difficult to determine while static can be confidently disambiguated when set in motion. Here, we used fMRI to trace the sensitivity of human visual cortex to such motion cues, both with and without photometric cues to specular reflectance. Participants viewed rotating blob-like objects that were rendered as images (photometric) or dots (kinematic) with either matte-consistent or shiny-consistent specular reflectance profiles. We were unable to identify any areas in low and mid-level human visual cortex that responded preferentially to surface specular reflectance from motion. However, univariate and multivariate analyses identified several visual areas; V1, V2, V3, V3A/B, and hMT+, capable of differentiating shiny from matte surface flows. These results indicate that the machinery for extracting kinematic cues is present in human visual cortex, but the areas involved in integrating such information with the photometric cues necessary for surface specular reflectance remain unclear.

Absence of direction-specific cross-modal visual-auditory adaptation in motion-onset event-related potentials

Adaptation to visual or auditory motion affects within-modality motion processing as reflected by visual or auditory free-field motion-onset evoked potentials (VEPs, AEPs). Here, a visual-auditory motion adaptation paradigm was used to investigate the effect of visual motion adaptation on VEPs and AEPs to leftward motion-onset test stimuli. Effects of visual adaptation to (i) scattered light flashes, and motion in the (ii) same or in the (iii) opposite direction of the test stimulus were compared. For the motion-onset VEPs, i.e. the intra-modal adaptation conditions, direction-specific adaptation was observed--the change-N2 (cN2) and change-P2 (cP2) amplitudes were significantly smaller after motion adaptation in the same than in the opposite direction. For the motion-onset AEPs, i.e. the cross-modal adaptation condition, there was an effect of motion history only in the change-P1 (cP1), and this effect was not direction-specific--cP1 was smaller after scatter than after motion adaptation to either direction. No effects were found for later components of motion-onset AEPs. While the VEP results provided clear evidence for the existence of a direction-specific effect of motion adaptation within the visual modality, the AEP findings suggested merely a motion-related, but not a direction-specific effect. In conclusion, the adaptation of veridical auditory motion detectors by visual motion is not reflected by the AEPs of the present study.

Insights into decision making using choice probability

A long-standing question in systems neuroscience is how the activity of single neurons gives rise to our perceptions and actions. Critical insights into this question occurred in the last part of the 20th century when scientists began linking modulations of neuronal activity directly to perceptual behavior. A significant conceptual advance was the application of signal detection theory to both neuronal activity and behavior, providing a quantitative assessment of the relationship between brain and behavior. One metric that emerged from these efforts was choice probability (CP), which provides information about how well an ideal observer can predict the choice an animal makes from a neuron's discharge rate distribution. In this review, we describe where CP has been studied, locational trends in the values found, and why CP values are typically so low. We discuss its dependence on correlated activity among neurons of a population, assess whether it arises from feedforward or feedback mechanisms, and investigate what CP tells us about how many neurons are required for a decision and how they are pooled to do so.

Opponent backgrounds reduce discrimination sensitivity to competing motions: effects of different vertical motions on horizontal motion perception

We examined the relationship between two distinct motion phenomena. First, locally balanced stimuli in which opposing motion signals are presented spatially near one another fail to cause a robust firing pattern in brain area MT. The brain's response to this motion is effectively suppressed, a phenomenon known as opponency. Second, past research has found that discrimination sensitivity to a target motion is negatively affected by a superimposed irrelevant motion signal - a process we call "perceptual suppression." In the current study, we examined how opponency affects the strength of perceptual suppression. We found unexpected results: a target motion embedded within an opponent background was harder to discriminate than a target motion embedded within a non-opponent background. We argue that this pattern of results runs contrary to the clear prediction stemming from the current understanding of the role of opponency in motion processing and tentatively offer an explanation based on recent MT physiology.

Construction and evaluation of an integrated dynamical model of visual motion perception

Although numerous models describe the individual neural mechanisms that may be involved in the perception of visual motion, few of them have been constructed to take arbitrary stimuli and map them to a motion percept. Here, we propose an integrated dynamical motion model (IDM), which is sufficiently general to handle diverse moving stimuli, yet sufficiently precise to account for a wide-ranging set of empirical observations made on a family of random dot kinematograms. In particular, we constructed models of the cortical areas involved in motion detection, motion integration and perceptual decision. We analyzed their parameters through dynamical simulations and numerical continuation to constrain their proper ranges. Then, empirical data from a family of random dot kinematograms experiments with systematically varying direction distribution, presentation duration and stimulus size, were used to evaluate our model and estimate corresponding model parameters. The resulting model provides an excellent account of a demanding set of parametrically varied behavioral effects on motion perception, providing both quantitative and qualitative elements of evaluation.

Disrupted gamma-band neural oscillations during coherent motion perception in heavy cannabis users

Previous work in animals and humans has shown that exogenous cannabinoids disrupt time-locked, evoked gamma oscillations (30-80 Hz). However, no studies to date have examined the effect of cannabis on non-time-locked, induced gamma oscillations during more complex Gestalt perception. The current study therefore utilized electroencephalography (EEG) to examine gamma oscillations during coherent motion perception in heavy cannabis users and controls. Chronic cannabis users (n = 24; 12 h abstinence before study; positive 11-nor-9-carboxy-delta-9-tetrahydrocannabinol urine levels) and cannabis-naive controls (n = 23) were evaluated. Stimuli consisted of random dot kinetograms (RDKs) that subjects passively viewed during three different conditions: coherent motion, incoherent motion, and static. Time × frequency analysis on EEG data was performed using Fourier-based mean trial power (MTP). Transient event-related potentials (ERPs) to stimulus onset (visual N100 and P200 components) were also evaluated. The results showed that the coherent motion condition produced a robust increase in neural activity in the gamma range (induced power from 40 to 59 Hz) as compared with the incoherent motion and static conditions. As predicted, the cannabis group showed significant reductions in induced gamma power in the coherent condition relative to healthy controls. No differences were observed between the groups in the N100 or P200 components, indicating intact primary sensory processing. Finally, cannabis users showed a trend toward increased scores on the Chapman Perceptual Aberration Scale (PAS) that was positively correlated with total years of active cannabis use. These data suggest that cannabis use may interfere with the generation of induced gamma-band neural oscillations that could in part mediate the perceptual-altering effects of exogenous cannabinoids.

Motion area V5/MT+ response to global motion in the absence of V1 resembles early visual cortex

Motion area V5/MT+ shows a variety of characteristic visual responses, often linked to perception, which are heavily influenced by its rich connectivity with the primary visual cortex (V1). This human motion area also receives a number of inputs from other visual regions, including direct subcortical connections and callosal connections with the contralateral hemisphere. Little is currently known about such alternative inputs to V5/MT+ and how they may drive and influence its activity. Using functional magnetic resonance imaging, the response of human V5/MT+ to increasing the proportion of coherent motion was measured in seven patients with unilateral V1 damage acquired during adulthood, and a group of healthy age-matched controls. When V1 was damaged, the typical V5/MT+ response to increasing coherence was lost. Rather, V5/MT+ in patients showed a negative trend with coherence that was similar to coherence-related activity in V1 of healthy control subjects. This shift to a response-pattern more typical of early visual cortex suggests that in the absence of V1, V5/MT+ activity may be shaped by similar direct subcortical input. This is likely to reflect intact residual pathways rather than a change in connectivity, and has important implications for blindsight function. It also confirms predictions that V1 is critically involved in normal V5/MT+ global motion processing, consistent with a convergent model of V1 input to V5/MT+. Historically, most attempts to model cortical visual responses do not consider the contribution of direct subcortical inputs that may bypass striate cortex, such as input to V5/MT+. We have shown that the signal change driven by these non-striate pathways can be measured, and suggest that models of the intact visual system may benefit from considering their contribution.

Truncation of the flash-lag effect by a fixed spatial landmark

The flash-lag effect is a visual illusion where a moving image is perceived to be advanced in its spatial location relative to a flashed image. Multiple studies have shown that the flash-lag effect can be enhanced by increasing the uncertainty of the moving and/or flashed images. However, little is known about the effect of task-irrelevant visual objects on the flash-lag effect. We were interested to see whether a task-irrelevant spatial landmark might reduce uncertainty and hence reduce the flash-lag effect. We placed a fixed bar between moving and flashed bars while measuring the flash-lag effect in six participants. For most participants, the fixed bar substantially truncated the flash-lag effect. The effect was maximal when the fixed bar was aligned with the flashed bar and decreased when the fixed bar was positioned more peripherally. A second experiment with two participants used a smaller fixed bar; the smaller bar had less truncation effect in one participant, while the other participant showed similar truncation regardless of the fixed bar size. Our results support models that place the locus of the flash-lag effect in higher-order brain areas, e.g., the parietal lobe.

Global processing in amblyopia: a review

Amblyopia is a neurodevelopmental disorder of the visual system that is associated with disrupted binocular vision during early childhood. There is evidence that the effects of amblyopia extend beyond the primary visual cortex to regions of the dorsal and ventral extra-striate visual cortex involved in visual integration. Here, we review the current literature on global processing deficits in observers with either strabismic, anisometropic, or deprivation amblyopia. A range of global processing tasks have been used to investigate the extent of the cortical deficit in amblyopia including: global motion perception, global form perception, face perception, and biological motion. These tasks appear to be differentially affected by amblyopia. In general, observers with unilateral amblyopia appear to show deficits for local spatial processing and global tasks that require the segregation of signal from noise. In bilateral cases, the global processing deficits are exaggerated, and appear to extend to specialized perceptual systems such as those involved in face processing.

The coupling of vision with locomotion in cortical blindness

Maintaining or modifying the speed and direction of locomotion requires the coupling of the locomotion with the retinal optic flow that it generates. It is shown that this essential behavioral capability, which requires on-line neural control, is preserved in the cortically blind hemifield of a hemianope. In experiments, optic flow stimuli were presented to either the normal or blind hemifield while the patient was walking on a treadmill. Little difference was found between the hemifields with respect to the coupling (i.e. co-dependency) of optic flow detection with locomotion. Even in the cortically blind hemifield, faster walking resulted in the perceptual slowing of detected optic flow, and self-selected locomotion speeds demonstrated behavioral discrimination between different optic flow speeds. The results indicate that the processing of optic flow, and thereby on-line visuo-locomotor coupling, can take place along neural pathways that function without processing in Area V1, and thus in the absence of conscious intervention. These and earlier findings suggest that optic flow and object motion are processed in parallel along with correlated non-visual locomotion signals. Extrastriate interactions may be responsible for discounting the optical effects of locomotion on the perceived direction of object motion, and maintaining visually guided self-motion.

Motion-defined surface segregation in human visual cortex

Surface segregation provides an efficient way to parse the visual scene for perceptual analysis. Here, we investigated the segregation of a bivectorial motion display into transparent surfaces through a psychophysical task and fMRI. We found that perceptual transparency correlated with neural activity in the early areas of the visual cortex, suggesting these areas may be involved in the segregation of motion-defined surfaces. Two oppositely rotating, uniquely colored random dot kinematograms (RDKs) were presented either sequentially or in a spatially interleaved manner, displayed at varying alternation frequencies. Participants reported the color and rotation direction pairing of the RDKs in the psychophysical task. The spatially interleaved display generated the percept of motion transparency across the range of frequencies tested, yielding ceiling task performance. At high alternation frequencies, performance on the sequential display also approached ceiling, indicative of perceived transparency. However, transparency broke down in lower alternation frequency sequential displays, producing performance close to chance. A corresponding pattern mirroring the psychophysical data was also evident in univariate and multivariate analyses of the fMRI BOLD activity in visual cortical areas V1, V2, V3, V3AB, hV4, and V5/MT+. Using gray RDKs, we found significant presentation by frequency interactions in most areas; differences in BOLD signal between presentation types were significant only at the lower alternation frequency. Multivariate pattern classification was similarly unable to discriminate between presentation types at the higher frequency. This study provides evidence that early visual cortex may code for motion-defined surface segregation, which in turn may enable perceptual transparency.

Visual motion processing and visual sensorimotor control in autism

Impairments in visual motion perception and use of visual motion information to guide behavior have been reported in autism, but the brain alterations underlying these abnormalities are not well characterized. We performed functional magnetic resonance imaging (fMRI) studies to investigate neural correlates of impairments related to visual motion processing. Sixteen high-functioning individuals with autism and 14 age and IQ-matched typically developing individuals completed two fMRI tasks using passive viewing to examine bottom-up responses to visual motion and visual pursuit tracking to assess top-down modulation of visual motion processing during sensorimotor control. The autism group showed greater activation and faster hemodynamic decay in V5 during the passive viewing task and reduced frontal and V5 activation during visual pursuit. The observations of increased V5 activation and its faster decay during passive viewing suggest alterations in local V5 circuitries that may be associated with reduced GABAergic tone and inhibitory modulation. Reduced frontal and V5 activation during active pursuit suggest reduced top-down modulation of sensory processing. These results suggest that both local intrinsic abnormalities in V5 and more widely distributed network level abnormalities are associated with visual motion processing in autism.

The role of human ventral visual cortex in motion perception

Visual motion perception is fundamental to many aspects of visual perception. Visual motion perception has long been associated with the dorsal (parietal) pathway and the involvement of the ventral 'form' (temporal) visual pathway has not been considered critical for normal motion perception. Here, we evaluated this view by examining whether circumscribed damage to ventral visual cortex impaired motion perception. The perception of motion in basic, non-form tasks (motion coherence and motion detection) and complex structure-from-motion, for a wide range of motion speeds, all centrally displayed, was assessed in five patients with a circumscribed lesion to either the right or left ventral visual pathway. Patients with a right, but not with a left, ventral visual lesion displayed widespread impairments in central motion perception even for non-form motion, for both slow and for fast speeds, and this held true independent of the integrity of areas MT/V5, V3A or parietal regions. In contrast with the traditional view in which only the dorsal visual stream is critical for motion perception, these novel findings implicate a more distributed circuit in which the integrity of the right ventral visual pathway is also necessary even for the perception of non-form motion.

A functional and perceptual signature of the second visual area in primates

There is no generally accepted account of the function of the second visual cortical area (V2), partly because no simple response properties robustly distinguish V2 neurons from those in primary visual cortex (V1). We constructed synthetic stimuli replicating the higher-order statistical dependencies found in natural texture images and used them to stimulate macaque V1 and V2 neurons. Most V2 cells responded more vigorously to these textures than to control stimuli lacking naturalistic structure; V1 cells did not. Functional magnetic resonance imaging (fMRI) measurements in humans revealed differences between V1 and V2 that paralleled the neuronal measurements. The ability of human observers to detect naturalistic structure in different types of texture was well predicted by the strength of neuronal and fMRI responses in V2 but not in V1. Together, these results reveal a particular functional role for V2 in the representation of natural image structure.

Modelling adaptation to directional motion using the Adelson-Bergen energy sensor

The motion energy sensor has been shown to account for a wide range of physiological and psychophysical results in motion detection and discrimination studies. It has become established as the standard computational model for retinal movement sensing in the human visual system. Adaptation effects have been extensively studied in the psychophysical literature on motion perception, and play a crucial role in theoretical debates, but the current implementation of the energy sensor does not provide directly for modelling adaptation-induced changes in output. We describe an extension of the model to incorporate changes in output due to adaptation. The extended model first computes a space-time representation of the output to a given stimulus, and then a RC gain-control circuit ("leaky integrator") is applied to the time-dependent output. The output of the extended model shows effects which mirror those observed in psychophysical studies of motion adaptation: a decline in sensor output during stimulation, and changes in the relative of outputs of different sensors following this adaptation.

Visual short-term memory for global motion revealed by directional and speed-tuned masking

Neurobehavioral research with non-human primates has shown that different attributes of motion stimuli, such as direction and speed can be stored in visual short-term memory (VSTM) with a high degree of accuracy. We examined VSTM for global motion with a memory masking paradigm to determine which stimulus attributes are important in the storage process. We presented in two visual quadrants global motion random dot kinematograms (RDKs), whereas in the two remaining visual quadrants we presented random-motion RDKs. This pattern of stimulation was displayed in two distinct temporal intervals, i.e., sample and test stimuli (duration: 200 ms), separated in time by a 3.2-s delay period. During the delay period a random- or directional-motion mask was presented briefly (200 ms) either at the beginning, in the middle or at the end of the delay period. The results showed that the mask mainly interferes with performance when displayed 200 ms after the offset of the sample and when it had a coherent direction rather than random directions. Moreover, the mask is significantly more effective when its direction and speed matched that of the remembered sample. These results support the notion that the memory representation of global motion is selective for direction and speed, being compromised by intervening directional stimuli presented immediately after the encoding phase. Moreover, this selectivity suggests that the same neural mechanisms involved in the processing of global motion may be recruited for its storage.

Perceptual learning of motion direction discrimination with suppressed and unsuppressed MT in humans: an fMRI study

The middle temporal area of the extrastriate visual cortex (area MT) is integral to motion perception and is thought to play a key role in the perceptual learning of motion tasks. We have previously found, however, that perceptual learning of a motion discrimination task is possible even when the training stimulus contains locally balanced, motion opponent signals that putatively suppress the response of MT. Assuming at least partial suppression of MT, possible explanations for this learning are that 1) training made MT more responsive by reducing motion opponency, 2) MT remained suppressed and alternative visual areas such as V1 enabled learning and/or 3) suppression of MT increased with training, possibly to reduce noise. Here we used fMRI to test these possibilities. We first confirmed that the motion opponent stimulus did indeed suppress the BOLD response within hMT+ compared to an almost identical stimulus without locally balanced motion signals. We then trained participants on motion opponent or non-opponent stimuli. Training with the motion opponent stimulus reduced the BOLD response within hMT+ and greater reductions in BOLD response were correlated with greater amounts of learning. The opposite relationship between BOLD and behaviour was found at V1 for the group trained on the motion-opponent stimulus and at both V1 and hMT+ for the group trained on the non-opponent motion stimulus. As the average response of many cells within MT to motion opponent stimuli is the same as their response to non-directional flickering noise, the reduced activation of hMT+ after training may reflect noise reduction.

Limited featured-based attention to multiple features

Attending to a feature (e.g., color or motion direction) can enhance the early visual processing of that feature. However, it is not known whether one can simultaneously enhance multiple features. We examined people's ability to attend to multiple features in a feature cueing paradigm. Each trial contained two intervals consisting of a random dot motion stimulus. One interval (noise) had 0% coherence (no net motion), while the other interval (signal) moved in a particular direction with varying levels of coherence. Participants reported which interval contained the signal in one of three cueing conditions. In the one-cue condition, a line segment preceded the stimuli indicating the direction of the signal with 100% validity. In the two-cue condition, two lines preceded the stimuli, indicating the signal would move in one of the two cued directions. In the no-cue condition, no line segment appeared before the dot stimuli. In several experiments, we consistently observed a lower detection threshold in the one-cue condition than the no-cue condition, showing that participants can enhance processing of a single feature. However, detection threshold was consistently higher for the two-cue than one-cue condition, indicating that participants could not simultaneously enhance two motion directions as effectively as one direction. This finding revealed a severe capacity limit in our ability to enhance early visual processing for multiple features.

Neural correlates of object-based attentional selection in human cortex

Humans can attend to different objects independent of their spatial locations. While selecting an object has been shown to modulate object processing in high-level visual areas in occipitotemporal cortex, where/how behavioral importance (i.e., priority) for objects is represented is unknown. Here we examined the patterns of distributed neural activity during an object-based selection task. We measured brain activity with functional magnetic resonance imaging (fMRI), while participants viewed two superimposed, dynamic objects (left- and right-pointing triangles) and were cued to attend to one of the triangle objects. Enhanced fMRI response was observed for the attention conditions compared to a neutral condition, but no significant difference was found in overall response amplitude between two attention conditions. By using multi-voxel pattern classification (MVPC), however, we were able to distinguish the neural patterns associated with attention to different objects in early visual cortex (V1 to hMT+) and lateral occipital complex (LOC). Furthermore, distinct multi-voxel patterns were also observed in frontal and parietal areas. Our results demonstrate that object-based attention has a wide-spread modulation effect along the visual hierarchy and suggest that object-specific priority information is represented by patterned neural activity in the dorsal frontoparietal network.

Multiplexing in the primate motion pathway

This article begins by reviewing recent work on 3D motion processing in the primate visual system. Some of these results suggest that 3D motion signals may be processed in the same circuitry already known to compute 2D motion signals. Such "multiplexing" has implications for the study of visual cortical circuits and neural signals. A more explicit appreciation of multiplexing--and the computations required for demultiplexing--may enrich the study of the visual system by emphasizing the importance of a structured and balanced "encoding/decoding" framework. In addition to providing a fresh perspective on how successive stages of visual processing might be approached, multiplexing also raises caveats about the value of "neural correlates" for understanding neural computation.

Pattern-motion selective responses in MT, MST and the pulvinar of humans

Plaid stimuli are often used to investigate the mechanisms involved in the integration and segregation of motion information. Considering the perceptual importance of such mechanisms, only a very limited number of visual brain areas have been found to be specifically involved in motion integration. These are the human (h)MT+ complex, area V3 and the pulvinar. The hMT+ complex can be functionally subdivided into two separate areas, middle temporal area (MT) and medial superior temporal area (MST); however, it is currently unclear whether these distinct sub-regions have different responses to plaid stimuli. To address this issue we used functional magnetic resonance imaging to quantify the relative response of MT and MST to component and pattern motion. Participants viewed plaid stimuli that were constrained to result in the perception of either component motion (segregation of motion information) or pattern motion (integration of motion information). MT/MST segregation was achieved using a moving dot stimulus that allowed stimulation of each visual hemifield either in unison or separately. We found pattern motion selective responses in both MT and MST. Consistent with previous reports, activity indicative of pattern motion selectivity was also found in the pulvinar as well as in other extrastriate areas. These results demonstrate that MT, MST and the pulvinar are involved in the complex motion integration mechanisms that are triggered by plaid stimuli. This reinforces the concept that integrative computations take place in a distributed neuronal circuit both in cortical and sub-cortical networks.

Linear systems analysis of the fMRI signal

In 1995 when we began our investigations of the human visual system using fMRI, little was known about the temporal properties of the fMRI signal. Before we felt comfortable making quantitative estimates of neuronal responses with this new technique, we decided to first conduct a basic study of how the time-course of the fMRI response varied with stimulus timing and strength. The results ended up showing strong evidence that to a first approximation the hemodynamic transformation was linear in time. This was both important and remarkable: important because nearly all fMRI data analysis techniques assume or require linearity, and remarkable because the physiological basis of the hemodynamic transformation is so complex that we still have a far from complete understanding of it. In this paper, we provide highlights of the results of our original paper supporting the linear transform hypothesis. A reanalysis of the original data provides some interesting new insights into the published results. We also provide a detailed appendix describing of the properties and predictions of a linear system in time in the context of the transformation between neuronal responses and the BOLD signal.