Activity patterns in human motion-sensitive areas depend on the interpretation of global motion

A human cortical adaptive mutual inhibition circuit underlying competition for perceptual decision and repetition suppression reversal

A model based on inhibitory coupling has been proposed to explain perceptual oscillations. This 'adapting reciprocal inhibition' model postulates that it is the strength of inhibitory coupling that determines the fate of competition between percepts. Here, we used an fMRI-based adaptation technique to reveal the influence of neighboring neuronal populations, such as reciprocal inhibition, in motion-selective hMT+/V5. If reciprocal inhibition exists in this region, the following predictions should hold: 1. stimulus-driven response would not simply decrease, as predicted by simple repetition-suppression of neuronal populations, but instead, increase due to the activity from adjacent populations; 2. perceptual decision involving competing representations, should reflect decreased reciprocal inhibition by adaptation; 3. neural activity for the competing percept should also later on increase upon adaptation. Our results confirm these three predictions, showing that a model of perceptual decision based on adapting reciprocal inhibition holds true. Finally, they also show that the net effect of the well-known repetition suppression phenomenon can be reversed by this mechanism.

Horizontal connectivity in V1: Prediction of coherence in contour and motion integration

This study demonstrates the functional importance of the Surround context relayed laterally in V1 by the horizontal connectivity, in controlling the latency and the gain of the cortical response to the feedforward visual drive. We report here four main findings: 1) a centripetal apparent motion sequence results in a shortening of the spiking latency of V1 cells, when the orientation of the local inducer and the global motion axis are both co-aligned with the RF orientation preference; 2) this contextual effects grows with visual flow speed, peaking at 150–250°/s when it matches the propagation speed of horizontal connectivity (0.15–0.25 mm/ms); 3) For this speed range, the axial sensitivity of V1 cells is tilted by 90° to become co-aligned with the orientation preference axis; 4) the strength of modulation by the surround context correlates with the spatiotemporal coherence of the apparent motion flow. Our results suggest an internally-generated binding process, linking local (orientation /position) and global (motion/direction) features as early as V1. This long-range diffusion process constitutes a plausible substrate in V1 of the human psychophysical bias in speed estimation for collinear motion. Since it is demonstrated in the anesthetized cat, this novel form of contextual control of the cortical gain and phase is a built-in property in V1, whose expression does not require behavioral attention and top-down control from higher cortical areas. We propose that horizontal connectivity participates in the propagation of an internal “prediction” wave, shaped by visual experience, which links contour co-alignment and global axial motion at an apparent speed in the range of saccade-like eye movements.

A two-stage framework for neural processing of biological motion

It remains to be understood how biological motion is hierarchically computed, from discrimination of local biological motion animacy to global dynamic body perception. Here, we addressed this functional separation of the correlates of the perception of local biological motion from perception of global motion of a body. We hypothesized that local biological motion processing can be isolated, by using a single dot motion perceptual decision paradigm featuring the biomechanical details of local realistic motion of a single joint. To ensure that we were indeed tackling processing of biological motion properties we used a discrimination instead of detection task. We discovered using representational similarity analysis that two key early dorsal and two ventral stream regions (visual motion selective hMT+ and V3A, extrastriate body area EBA and a region within fusiform gyrus FFG) showed robust and separable signals related to encoding of local biological motion and global motion-mediated shape. These signals reflected two independent processing stages, as revealed by representational similarity analysis and deconvolution of fMRI responses to each motion pattern. This study showed that higher level pSTS encodes both classes of biological motion in a similar way, revealing a higher-level integrative stage, reflecting scale independent biological motion perception. Our results reveal a two-stage framework for neural computation of biological motion, with an independent contribution of dorsal and ventral regions for the initial stage.

Non-stimulated regions in early visual cortex encode the contents of conscious visual perception

Predictions shape our perception. The theory of predictive processing poses that our brains make sense of incoming sensory input by generating predictions, which are sent back from higher to lower levels of the processing hierarchy. These predictions are based on our internal model of the world and enable inferences about the hidden causes of the sensory input data. It has been proposed that conscious perception corresponds to the currently most probable internal model of the world. Accordingly, predictions influencing conscious perception should be fed back from higher to lower levels of the processing hierarchy. Here, we used functional magnetic resonance imaging and multivoxel pattern analysis to show that non‐stimulated regions of early visual areas contain information about the conscious perception of an ambiguous visual stimulus. These results indicate that early sensory cortices in the human brain receive predictive feedback signals that reflect the current contents of conscious perception.

Comparing the influence of stimulus size and contrast on the perception of moving gratings and random dot patterns-A registered report protocol

Modern accounts of visual motion processing in the primate brain emphasize a hierarchy of different regions within the dorsal visual pathway, especially primary visual cortex (V1) and the middle temporal area (MT). However, recent studies have called the idea of a processing pipeline with fixed contributions to motion perception from each area into doubt. Instead, the role that each area plays appears to depend on properties of the stimulus as well as perceptual history. We propose to test this hypothesis in human subjects by comparing motion perception of two commonly used stimulus types: drifting sinusoidal gratings (DSGs) and random dot patterns (RDPs). To avoid potential biases in our approach we are pre-registering our study. We will compare the effects of size and contrast levels on the perception of the direction of motion for DSGs and RDPs. In addition, based on intriguing results in a pilot study, we will also explore the effects of a post-stimulus mask. Our approach will offer valuable insights into how motion is processed by the visual system and guide further behavioral and neurophysiological research.

The dual nature of the BOLD signal: Responses in visual area hMT+ reflect both input properties and perceptual decision

Neuroimaging studies have suggested that hMT+ encodes global motion interpretation, but this contradicts the notion that BOLD activity mainly reflects neuronal input. While measuring fMRI responses at 7 Tesla, we used an ambiguous moving stimulus, yielding the perception of two incoherently moving surfaces—component motion—or only one coherently moving surface—pattern motion, to induce perceptual fluctuations and identify perceptual organization size‐matched domains in hMT+. Then, moving gratings, exactly matching either the direction of component or pattern motion percepts of the ambiguous stimulus, were shown to the participants to investigate whether response properties reflect the input or decision. If hMT+ responses reflect the input, component motion domains (selective to incoherent percept) should show grating direction stimulus‐dependent changes, unlike pattern motion domains (selective to the coherent percept). This hypothesis is based on the known direction‐selective nature of inputs in component motion perceptual domains versus non‐selectivity in pattern motion perceptual domains. The response amplitude of pattern motion domains did not change with grating direction (consistently with their non‐selective input), in contrast to what happened for the component motion domains (consistently with their selective input). However, when we analyzed relative ratio measures they mirrored perceptual interpretation. These findings are consistent with the notion that patterns of BOLD responses reflect both sensory input and perceptual read‐out.

Identification of competing neural mechanisms underlying positive and negative perceptual hysteresis in the human visual system

Hysteresis is a well-known phenomenon in physics that relates changes in a system with its prior history. It is also part of human visual experience (perceptual hysteresis), and two different neural mechanisms might explain it: persistence (a cause of positive hysteresis), which forces to keep a current percept for longer, and adaptation (a cause of negative hysteresis), which in turn favors the switch to a competing percept early on. In this study, we explore the neural correlates underlying these mechanisms and the hypothesis of their competitive balance, by combining behavioral assessment with fMRI. We used machine learning on the behavioral data to distinguish between positive and negative hysteresis, and discovered a neural correlate of persistence at a core region of the ventral attention network, the anterior insula. Our results add to the understanding of perceptual multistability and reveal a possible mechanistic explanation for the regulation of different forms of perceptual hysteresis.

Neural bases of visual processing of moving and stationary stimuli presented to the blind hemifield of hemianopic patients

Unilateral damage to post-chiasmatic visual pathways or cortical areas results in the loss of vision in the contralateral hemifield, known as hemianopia. Some patients, however, may retain the ability to perform an above chance unconscious detection or discrimination of visual stimuli presented to the blind hemifield, known as "blindsight". An important finding in blindsight research is that it can often be elicited by moving stimuli. Therefore, in the present study, we wanted to test whether moving stimuli might yield blindsight phenomena in patients with cortical lesions resulting in hemianopia, in a discrimination task where stimulus movement is orthogonal to the feature of interest. This could represent an important strategy for rehabilitation because it might improve discrimination ability of stimulus features different but related to movement, e.g. line orientation. We tested eight hemianopic patients and eight age-matched healthy controls in an orientation discrimination task with moving or static visual stimuli. During performance of the task we carried out fMRI scanning and tractography. Behaviourally, we did not find a reliable main effect of motion on orientation discrimination; however, an important result was that in different patients blindsight could occur only with moving or stationary stimuli or with both. As to brain imaging results, following presentation of moving stimuli to the blind hemifield, a widespread fronto-parietal bilateral network was recruited including areas of the dorsal stream and in particular bilateral motion area hMT + whose activation positively correlated with behavioural performance. This bilateral network was not activated in controls suggesting that it represents a compensatory functional change following brain damage. Moreover, there was a higher activation of ipsilesional area hMT+ in patients who performed above chance in the moving condition. By contrast, in patients who performed above chance in the static condition, we found a higher activation of contralesional area V1 and extrastriate visual areas. Finally, we found a linear relationship between structural integrity of the ipsilesional pathway connecting lateral geniculate nucleus (LGN) with motion area hMT+ and both behavioural performance and ipsilesional hMT + activation. These results support the role of LGN in modulating performance as well as BOLD amplitude in the absence of visual awareness in ipsilesional area hMT+ during an orientation discrimination task with moving stimuli.

The direction after-effect is a global motion phenomenon

Prior experience influences visual perception. For example, extended viewing of a moving stimulus results in the misperception of a subsequent stimulus's motion direction-the direction after-effect (DAE). There has been an ongoing debate regarding the locus of the neural mechanisms underlying the DAE. We know the mechanisms are cortical, but there is uncertainty about where in the visual cortex they are located-at relatively early local motion processing stages, or at later global motion stages. We used a unikinetic plaid as an adapting stimulus, then measured the DAE experienced with a drifting random dot test stimulus. A unikinetic plaid comprises a static grating superimposed on a drifting grating of a different orientation. Observers cannot see the true motion direction of the moving component; instead they see pattern motion running parallel to the static component. The pattern motion of unikinetic plaids is encoded at the global processing level-specifically, in cortical areas MT and MST-and the local motion component is encoded earlier. We measured the direction after-effect as a function of the plaid's local and pattern motion directions. The DAE was induced by the plaid's pattern motion, but not by its component motion. This points to the neural mechanisms underlying the DAE being located at the global motion processing level, and no earlier than area MT.

Columnar clusters in the human motion complex reflect consciously perceived motion axis

Existing knowledge of how cortical responses link to conscious content in humans is either inferred from animal models or from human studies limited by lower spatial resolution. While previous studies could relate distinct categorical percepts (faces vs. places) to signal differences across brain areas, measuring responses at submillimeter resolution allowed us to link subcategory conscious percepts (vertical vs. horizontal motion) to amplitude changes of separate populations within the same brain area. Furthermore, preferences for horizontal and vertical motion were organized into columnar clusters. We pave the way for future studies investigating if columnar clusters represent subcategorical distinctions in conscious content different from motion or in high-level perceptual and cognitive phenomena.

The specific contents of human consciousness rely on the activity of specialized neurons in cerebral cortex. We hypothesized that the conscious experience of a specific visual motion axis is reflected in response amplitudes of direction-selective clusters in the human motion complex. Using submillimeter fMRI at ultrahigh field (7 T) we identified fine-grained clusters that were tuned to either horizontal or vertical motion presented in an unambiguous motion display. We then recorded their responses while human observers reported the perceived axis of motion for an ambiguous apparent motion display. Although retinal stimulation remained constant, subjects reported recurring changes between horizontal and vertical motion percepts every 7 to 13 s. We found that these perceptual states were dissociatively reflected in the response amplitudes of the identified horizontal and vertical clusters. We also found that responses to unambiguous motion were organized in a columnar fashion such that motion preferences were stable in the direction of cortical depth and changed when moving along the cortical surface. We suggest that activity in these specialized clusters is involved in tracking the distinct conscious experience of a particular motion axis.

Tracking perceptual decision mechanisms through changes in interhemispheric functional connectivity in human visual cortex

The role of long-range integration mechanisms underlying visual perceptual binding and their link to interhemispheric functional connectivity, as measured by fMRI, remains elusive. Only inferences on anatomical organization from resting state data paradigms not requiring coherent binding have been achieved. Here, we used a paradigm that allowed us to study such relation between perceptual interpretation and functional connectivity under bistable interhemispheric binding vs. non-binding of visual surfaces. Binding occurs by long-range perceptual integration of motion into a single object across hemifields and non-binding reflects opponent segregation of distinct moving surfaces into each hemifield. We hypothesized that perceptual integration vs. segregation of surface motion, which is achieved in visual area hMT+, is modulated by changes in interhemispheric connectivity in this region. Using 7T fMRI, we found that perceptual long-range integration of bistable motion can be tracked by changes in interhemispheric functional connectivity between left/right hMT+. Increased connectivity was tightly related with long-range perceptual integration. Our results indicate that hMT+ interhemispheric functional connectivity reflects perceptual decision, suggesting its pivotal role on long-range disambiguation of bistable physically constant surface motion. We reveal for the first time, at the scale of fMRI, a relation between interhemispheric functional connectivity and decision based perceptual binding.

Inhibition-excitation balance in the parietal cortex modulates volitional control for auditory and visual multistability

Perceptual organisation must select one interpretation from several alternatives to guide behaviour. Computational models suggest that this could be achieved through an interplay between inhibition and excitation across competing types of neural population coding for each interpretation. Here, to test for such models, we used magnetic resonance spectroscopy to measure non-invasively the concentrations of inhibitory γ-aminobutyric acid (GABA) and excitatory glutamate-glutamine (Glx) in several brain regions. Human participants first performed auditory and visual multistability tasks that produced spontaneous switching between percepts. Then, we observed that longer percept durations during behaviour were associated with higher GABA/Glx ratios in the sensory area coding for each modality. When participants were asked to voluntarily modulate their perception, a common factor across modalities emerged: the GABA/Glx ratio in the posterior parietal cortex tended to be positively correlated with the amount of effective volitional control. Our results provide direct evidence implicating that the balance between neural inhibition and excitation within sensory regions resolves perceptual competition. This powerful computational principle appears to be leveraged by both audition and vision, implemented independently across modalities, but modulated by an integrated control process.

A Generic Mechanism for Perceptual Organization in the Parietal Cortex

Our visual system's ability to group visual elements into meaningful entities and to separate them from others is referred to as scene segmentation. Visual motion often provides a powerful cue for this process as parallax or coherence can inform the visual system about scene or object structure. Here we tested the hypothesis that scene segmentation by motion cues relies on a common neural substrate in the parietal cortex. We used fMRI and a set of three entirely distinct motion stimuli to examine scene segmentation in the human brain. The stimuli covered a wide range of high-level processes, including perceptual grouping, transparent motion, and depth perception. All stimuli were perceptually bistable such that percepts alternated every few seconds while the physical stimulation remained constant. The perceptual states were asymmetric, in that one reflected the default (nonsegmented) interpretation, and the other the non-default (segmented) interpretation. We confirmed behaviorally that upon stimulus presentation, the default percept was always perceived first, before perceptual alternations ensued. Imaging results showed that across all stimulus classes perceptual scene-segmentation was associated with an increase of activity in the posterior parietal cortex together with a decrease of neural signal in the early visual cortex. This pattern of activation is compatible with predictive coding models of visual perception, and suggests that parietal cortex hosts a generic mechanism for scene segmentation.SIGNIFICANCE STATEMENT Making sense of cluttered visual scenes is crucial for everyday perception. An important cue to scene segmentation is visual motion: slight movements of scene elements give away which elements belong to the foreground or background or to the same object. We used three distinct stimuli that engage visual scene segmentation mechanisms based on motion. They involved perceptual grouping, transparent motion, and depth perception. Brain activity associated with all three mechanisms converged in the same parietal region with concurrent deactivation of early visual areas. The results suggest that posterior parietal cortex is a hub involved in structuring visual scenes based on different motion cues, and that feedback modulates early cortical processing in accord with predictive coding theory.

Evidence for distinct levels of neural adaptation to both coherent and incoherently moving visual surfaces in visual area hMT

Visual adaptation describes the processes by which the visual system alters its operating properties in response to changes in the environment. It is one of the mechanisms controlling visual perceptual bistability - when two perceptual solutions are available - by controlling the duration of each percept. Moving plaids are an example of such ambiguity. They can be perceived as two surfaces sliding incoherently over each other or as a single coherent surface. Here, we investigated, using fMRI, whether activity in the human motion complex (hMT+), a region tightly related to the perceptual integration of visual motion, is modulated by distinct forms of visual adaptation to coherent or incoherent perception of moving plaids. Our hypothesis is that exposure to global coherent or incoherent moving stimuli leads to different levels of measurable adaptation, reflected in hMT+ activity. We found that the strength of the measured visual adaptation effect depended on whether subjects integrated (coherent percept) or segregated (incoherent percept) surface motion signals. Visual motion adaptation was significant both for coherent motion and globally incoherent surface motion. Although not as strong as to the coherent percept, visual adaptation due to the incoherent percept also affects hMT+. This shows that adaptation can contribute to regulate percept duration during visual bistability, with distinct weights, depending on the type of percept. Our findings suggest a link between bistability and adaptation mechanisms, both due to coherent and incoherent motion percepts, but in an asymmetric manner. These asymmetric adaptation weights have strong implications in models of perceptual decision and may explain asymmetry of perceptual interpretation periods.

Spectral fingerprints of large-scale cortical dynamics during ambiguous motion perception

Ambiguous stimuli have been widely used to study the neuronal correlates of consciousness. Recently, it has been suggested that conscious perception might arise from the dynamic interplay of functionally specialized but widely distributed cortical areas. While previous research mainly focused on phase coupling as a correlate of cortical communication, more recent findings indicated that additional coupling modes might coexist and possibly subserve distinct cortical functions. Here, we studied two coupling modes, namely phase and envelope coupling, which might differ in their origins, putative functions and dynamics. Therefore, we recorded 128-channel EEG while participants performed a bistable motion task and utilized state-of-the-art source-space connectivity analysis techniques to study the functional relevance of different coupling modes for cortical communication. Our results indicate that gamma-band phase coupling in extrastriate visual cortex might mediate the integration of visual tokens into a moving stimulus during ambiguous visual stimulation. Furthermore, our results suggest that long-range fronto-occipital gamma-band envelope coupling sustains the horizontal percept during ambiguous motion perception. Additionally, our results support the idea that local parieto-occipital alpha-band phase coupling controls the inter-hemispheric information transfer. These findings provide correlative evidence for the notion that synchronized oscillatory brain activity reflects the processing of sensory input as well as the information integration across several spatiotemporal scales. The results indicate that distinct coupling modes are involved in different cortical computations and that the rich spatiotemporal correlation structure of the brain might constitute the functional architecture for cortical processing and specific multi-site communication. Hum Brain Mapp 37:4099-4111, 2016. © 2016 Wiley Periodicals, Inc.

Joint Encoding of Object Motion and Motion Direction in the Salamander Retina

The processing of motion in visual scenes is important for detecting and tracking moving objects as well as for monitoring self-motion through the induced optic flow. Specialized neural circuits have been identified in the vertebrate retina for detecting motion direction or for distinguishing between object motion and self-motion, although little is known about how information about these distinct features of visual motion is combined. The salamander retina, which is a widely used model system for analyzing retinal function, contains object-motion-sensitive (OMS) ganglion cells, which strongly respond to local motion signals but are suppressed by global image motion. Yet, direction-selective (DS) ganglion cells have been conspicuously absent from characterizations of the salamander retina, despite their ubiquity in other model systems. We here show that the retina of axolotl salamanders contains at least two distinct classes of DS ganglion cells. For one of these classes, the cells display a strong preference for local over global motion in addition to their direction selectivity (OMS-DS cells) and thereby combine sensitivity to two distinct motion features. The OMS-DS cells are further distinct from standard (non-OMS) DS cells by their smaller receptive fields and different organization of preferred motion directions. Our results suggest that the two classes of DS cells specialize to encode motion direction of local and global motion stimuli, respectively, even for complex composite motion scenes. Furthermore, although the salamander DS cells are OFF-type, there is a strong analogy to the systems of ON and ON-OFF DS cells in the mammalian retina.

SIGNIFICANCE STATEMENT

The retina contains specialized cells for motion processing. Among the retinal ganglion cells, which form the output neurons of the retina, some are known to report the direction of a moving stimulus (direction-selective cells), and others distinguish the motion of an object from a moving background. But little is known about how information about local object motion and information about motion direction interact. Here, we report that direction-selective ganglion cells can be identified in the salamander retina, where their existence had been unclear. Furthermore, there are two independent systems of direction-selective cells, and one of these combines direction selectivity with sensitivity to local motion. The output of these cells could assist in tracking moving objects and estimating their future position.

Pivotal role of hMT+ in long-range disambiguation of interhemispheric bistable surface motion

It remains an open question whether long-range disambiguation of ambiguous surface motion can be achieved in early visual cortex or instead in higher level regions, which concerns object/surface segmentation/integration mechanisms. We used a bistable moving stimulus that can be perceived as a pattern comprehending both visual hemi-fields moving coherently downward or as two widely segregated nonoverlapping component objects (in each visual hemi-field) moving separately inward. This paradigm requires long-range integration across the vertical meridian leading to interhemispheric binding. Our fMRI study (n = 30) revealed a close relation between activity in hMT+ and perceptual switches involving interhemispheric segregation/integration of motion signals, crucially under nonlocal conditions where components do not overlap and belong to distinct hemispheres. Higher signal changes were found in hMT+ in response to spatially segregated component (incoherent) percepts than to pattern (coherent) percepts. This did not occur in early visual cortex, unlike apparent motion, which does not entail surface segmentation. We also identified a role for top-down mechanisms in state transitions. Deconvolution analysis of switch-related changes revealed prefrontal, insula, and cingulate areas, with the right superior parietal lobule (SPL) being particularly involved. We observed that directed influences could emerge either from left or right hMT+ during bistable motion integration/segregation. SPL also exhibited significant directed functional connectivity with hMT+, during perceptual state maintenance (Granger causality analysis). Our results suggest that long-range interhemispheric binding of ambiguous motion representations mainly reflect bottom-up processes from hMT+ during perceptual state maintenance. In contrast, state transitions maybe influenced by high-level regions such as the SPL. Hum Brain Mapp 38:4882-4897, 2017. © 2017 Wiley Periodicals, Inc.

Normal Aging Slows Spontaneous Switching in Auditory and Visual Bistability

Age-related changes in auditory and visual perception have an impact on the quality of life. It has been debated how perceptual organization is influenced by advancing age. From the neurochemical perspective, we investigated age effects on auditory and visual bistability. In perceptual bistability, a sequence of sensory inputs induces spontaneous switching between different perceptual objects. We used different modality tasks of auditory streaming and visual plaids. Young and middle-aged participants (20-60years) were instructed to indicate by a button press whenever their perception changed from one stable state to the other. The number of perceptual switches decreased with participants' ages. We employed magnetic resonance spectroscopy to measure non-invasively concentrations of the inhibitory neurotransmitter (γ-aminobutyric acid, GABA) in the brain regions of interest. When participants were asked to voluntarily modulate their perception, the amount of effective volitional control was positively correlated with the GABA concentration in the auditory and motion-sensitive areas corresponding to each sensory modality. However, no correlation was found in the prefrontal cortex and anterior cingulate cortex. In addition, effective volitional control was reduced with advancing age. Our results suggest that sequential scene analysis in auditory and visual domains is influenced by both age-related and neurochemical factors.

Probing the Characteristics of Colour-Motion Binding and Its Dependence on Persistent Surface Segregation

Identifying the spatial and temporal characteristics of visual feature binding is a remaining challenge in the science of perception. Within the feature-binding literature, disparate findings have suggested the existence of more than one feature-binding mechanism with differing temporal resolutions. For example, one surprising result is that temporal alternations between two different feature pairings of colour and motion (e.g., orange dots moving left with blue dots moving right) support accurate conjunction discrimination at alternation frequencies of around 10 Hz and greater. However, at lower alternation frequencies around 5 Hz, conjunction discrimination falls to chance. To further investigate this effect, we present two experiments that probe the stimulus characteristics that facilitate or impede feature binding. Using novel manipulations of random dot kinematograms, we identify that facilitating surface representations through temporal integration can enable accurate conjunction discrimination at both intermediate and high alternation frequencies. We also offer a neurally plausible evidence accumulator model to describe these results, removing the need to suggest multiple binding mechanisms acting at different timescales. In effect, we propose a single, flexible binding process, whereby the relatively low temporal resolution for binding features can be circumvented by extracting them from rapidly formed and persistent surface representations.

Three-Dimensional Face Recognition in Mild Cognitive Impairment: A Psychophysical and Structural MR Study

OBJECTIVES

Mild cognitive impairment (MCI) has been associated with a high risk of conversion to Alzheimer's dementia. In addition to memory complaints, impairments in the visuospatial domain have been reported in this condition. We have previously shown that deficits in perceiving structure-from-motion (SFM) objects are reflected in functional reorganization of brain activity within the visual ventral stream. Here we aimed to identify structural correlates of psychophysical complex face and object recognition performance in amnestic MCI patients (n=30 vs. n=25 controls). This study was, therefore, motivated by evidence from recent studies showing that a combination of visual information across dorsal and ventral visual streams may be needed for the perception of three-dimensional (3D) SFM objects.

METHODS

In our experimental paradigm, participants had to discriminate 3D SFM shapes (faces and objects) from 3D SFM meaningless (scrambled) shapes.

RESULTS

Morphometric analysis established neuroanatomical evidence for impairment in MCI as demonstrated by smaller hippocampal volumes. We found association between cortical thickness and face recognition performance, comprising the occipital lobe and visual ventral stream fusiform regions (overlapping the known location of face fusiform area) in the right hemisphere, in MCI.

CONCLUSIONS

We conclude that impairment of 3D visual integration exists at the MCI stage involving also the visual ventral stream and contributing to face recognition deficits. The specificity of such observed structure-function correlation for faces suggests a special role of this processing pathway in health and disease. (JINS, 2016, 22, 744-754).

Plaid Motion Rivalry: Correlates with Binocular Rivalry and Positive Mood State

Recently Hupé and Rubin (2003, Vision Research43 531–548) re-introduced the plaid as a form of perceptual rivalry by using two sets of drifting gratings behind a circular aperture to produce quasi-regular perceptual alternations between a coherent moving plaid of diamond-shaped intersections and the two sets of component ‘sliding’ gratings. We call this phenomenon plaid motion rivalry (PMR), and have compared its temporal dynamics with those of binocular rivalry in a sample of subjects covering a wide range of perceptual alternation rates. In support of the proposal that all rivalries may be mediated by a common switching mechanism, we found a high correlation between alternation rates induced by PMR and binocular rivalry. In keeping with a link discovered between the phase of rivalry and mood, we also found a link between PMR and an individual's mood state that is consistent with suggestions that each opposing phase of rivalry is associated with one or the other hemisphere, with the ‘diamonds’ phase of PMR linked with the ‘positive’ left hemisphere.

Control of Brain Activity in hMT+/V5 at Three Response Levels Using fMRI-Based Neurofeedback/BCI

A major challenge in brain-computer interface (BCI) research is to increase the number of command classes and levels of control. BCI studies often use binary control level approaches (level 0 and 1 of brain activation for each class of control). Different classes may often be achieved but not different levels of activation for the same class. The increase in the number of levels of control in BCI applications may allow for larger efficiency in neurofeedback applications. In this work we test the hypothesis whether more than two modulation levels can be achieved in a single brain region, the hMT+/V5 complex. Participants performed three distinct imagery tasks during neurofeedback training: imagery of a stationary dot, imagery of a dot with two opposing motions in the vertical axis and imagery of a dot with four opposing motions in vertical or horizontal axes (imagery of 2 or 4 motion directions). The larger the number of motion alternations, the higher the expected hMT+/V5 response. A substantial number (17 of 20) of participants achieved successful binary level of control and 12 were able to reach even 3 significant levels of control within the same session, confirming the whole group effects at the individual level. With this simple approach we suggest that it is possible to design a parametric system of control based on activity modulation of a specific brain region with at least 3 different levels. Furthermore, we show that particular imagery task instructions, based on different number of motion alternations, provide feasible achievement of different control levels in BCI and/or neurofeedback applications.

Effect of motion coherence on time perception relates to perceived speed

The present study examined the effect of coherence of moving visual objects on time perception. Participants observed stimuli composed of four line segments moving behind or in front of occluders. The line segments appeared to move either coherently as a diamond outline or incoherently, depending on the occlusion. Results from the temporal bisection task indicated that the duration of the coherently moving stimulus was perceived longer or shorter compared to the duration of the incoherently moving stimulus depending on the stimulus configurations. The speed comparison task revealed that the trend of the difference in perceived speed between the coherent and incoherent motions in each stimulus configuration was consistent with that of the difference in perceived duration between them. These results demonstrate the effect of motion coherence on perceived duration, and that this effect may be mediated by changes in perceived speed. Our finding provides evidence supporting the involvement of global motion processing in time perception.

Early disrupted neurovascular coupling and changed event level hemodynamic response function in type 2 diabetes: an fMRI study

Type 2 diabetes (T2DM) patients develop vascular complications and have increased risk for neurophysiological impairment. Vascular pathophysiology may alter the blood flow regulation in cerebral microvasculature, affecting neurovascular coupling. Reduced fMRI signal can result from decreased neuronal activation or disrupted neurovascular coupling. The uncertainty about pathophysiological mechanisms (neurodegenerative, vascular, or both) underlying brain function impairments remains. In this cross-sectional study, we investigated if the hemodynamic response function (HRF) in lesion-free brains of patients is altered by measuring BOLD (Blood Oxygenation Level-Dependent) response to visual motion stimuli. We used a standard block design to examine the BOLD response and an event-related deconvolution approach. Importantly, the latter allowed for the first time to directly extract the true shape of HRF without any assumption and probe neurovascular coupling, using performance-matched stimuli. We discovered a change in HRF in early stages of diabetes. T2DM patients show significantly different fMRI response profiles. Our visual paradigm therefore demonstrated impaired neurovascular coupling in intact brain tissue. This implies that functional studies in T2DM require the definition of HRF, only achievable with deconvolution in event-related experiments. Further investigation of the mechanisms underlying impaired neurovascular coupling is needed to understand and potentially prevent the progression of brain function decrements in diabetes.

Visual motion imagery neurofeedback based on the hMT+/V5 complex: evidence for a feedback-specific neural circuit involving neocortical and cerebellar regions

OBJECTIVE

Current approaches in neurofeedback/brain-computer interface research often focus on identifying, on a subject-by-subject basis, the neural regions that are best suited for self-driven modulation. It is known that the hMT+/V5 complex, an early visual cortical region, is recruited during explicit and implicit motion imagery, in addition to real motion perception. This study tests the feasibility of training healthy volunteers to regulate the level of activation in their hMT+/V5 complex using real-time fMRI neurofeedback and visual motion imagery strategies.

APPROACH

We functionally localized the hMT+/V5 complex to further use as a target region for neurofeedback. An uniform strategy based on motion imagery was used to guide subjects to neuromodulate hMT+/V5.

MAIN RESULTS

We found that 15/20 participants achieved successful neurofeedback. This modulation led to the recruitment of a specific network as further assessed by psychophysiological interaction analysis. This specific circuit, including hMT+/V5, putative V6 and medial cerebellum was activated for successful neurofeedback runs. The putamen and anterior insula were recruited for both successful and non-successful runs.

SIGNIFICANCE

Our findings indicate that hMT+/V5 is a region that can be modulated by focused imagery and that a specific cortico-cerebellar circuit is recruited during visual motion imagery leading to successful neurofeedback. These findings contribute to the debate on the relative potential of extrinsic (sensory) versus intrinsic (default-mode) brain regions in the clinical application of neurofeedback paradigms. This novel circuit might be a good target for future neurofeedback approaches that aim, for example, the training of focused attention in disorders such as ADHD.

Global processing in amblyopia: a review

Amblyopia is a neurodevelopmental disorder of the visual system that is associated with disrupted binocular vision during early childhood. There is evidence that the effects of amblyopia extend beyond the primary visual cortex to regions of the dorsal and ventral extra-striate visual cortex involved in visual integration. Here, we review the current literature on global processing deficits in observers with either strabismic, anisometropic, or deprivation amblyopia. A range of global processing tasks have been used to investigate the extent of the cortical deficit in amblyopia including: global motion perception, global form perception, face perception, and biological motion. These tasks appear to be differentially affected by amblyopia. In general, observers with unilateral amblyopia appear to show deficits for local spatial processing and global tasks that require the segregation of signal from noise. In bilateral cases, the global processing deficits are exaggerated, and appear to extend to specialized perceptual systems such as those involved in face processing.

Online tracking of the contents of conscious perception using real-time fMRI

Perception is an active process that interprets and structures the stimulus input based on assumptions about its possible causes. We use real-time functional magnetic resonance imaging (rtfMRI) to investigate a particularly powerful demonstration of dynamic object integration in which the same physical stimulus intermittently elicits categorically different conscious object percepts. In this study, we simulated an outline object that is moving behind a narrow slit. With such displays, the physically identical stimulus can elicit categorically different percepts that either correspond closely to the physical stimulus (vertically moving line segments) or represent a hypothesis about the underlying cause of the physical stimulus (a horizontally moving object that is partly occluded). In the latter case, the brain must construct an object from the input sequence. Combining rtfMRI with machine learning techniques we show that it is possible to determine online the momentary state of a subject's conscious percept from time resolved BOLD-activity. In addition, we found that feedback about the currently decoded percept increased the decoding rates compared to prior fMRI recordings of the same stimulus without feedback presentation. The analysis of the trained classifier revealed a brain network that discriminates contents of conscious perception with antagonistic interactions between early sensory areas that represent physical stimulus properties and higher-tier brain areas. During integrated object percepts, brain activity decreases in early sensory areas and increases in higher-tier areas. We conclude that it is possible to use BOLD responses to reliably track the contents of conscious visual perception with a relatively high temporal resolution. We suggest that our approach can also be used to investigate the neural basis of auditory object formation and discuss the results in the context of predictive coding theory.

Decoding pattern motion information in V1

When two gratings drifting in different directions are superimposed, the resulting stimulus can be perceived as two overlapping component gratings moving in different directions or as a single pattern moving in one direction. Whilst the motion direction of component gratings is already represented in visual area V1, the majority of previous studies have found processing of pattern motion direction only from visual area V2 onwards. Here, we question these findings using multi-voxel pattern analysis (MVPA). In Experiment 1, we presented superimposed sinusoidal gratings with varying angles between the two component motions. These stimuli were perceived as patterns moving in one of two possible directions. We found that linear support vector machines (SVMs) could generalise across stimuli composed of different component motions to successfully discriminate pattern motion direction from brain activity in V1, V3A and hMT+/V5. This demonstrates the representation of pattern motion information present in these visual areas. This conclusion was verified in Experiment 2, where we manipulated similar plaid stimuli to induce the perception of either a single moving pattern or two separate component gratings. While a classifier could again generalise across stimuli composed of different component motions when they were perceived as a single moving pattern, its performance dropped substantially in the case where components were perceived. Our results indicate that pattern motion direction information is present in V1.

Integration and segregation of multiple motion signals by neurons in area MT of primate

We used multielectrode arrays to measure the response of populations of neurons in primate middle temporal area to the transparent motion of two superimposed dot fields moving in different directions. The shape of the population response was well predicted by the sum of the responses to the constituent fields. However, the population response profile for transparent dot fields was similar to that for coherent plaid motion and hence an unreliable cue to transparency. We then used single-unit recording to characterize component and pattern cells from their response to drifting plaids. Unlike for plaids, component cells responded to the average direction of superimposed dot fields, whereas pattern cells could signal the constituent motions. This observation provides support for a strong prediction of the Simoncelli and Heeger (1998) model of motion analysis in area middle temporal, and suggests that pattern cells have a special status in the processing of superimposed dot fields.

Dynamic cortical activity during the perception of three-dimensional object shape from two-dimensional random-dot motion

Recent neuroimaging studies implicate that both the dorsal and ventral visual pathways, as well as the middle temporal (MT) areas which are critical for the perception of visual motion, are involved in the perception of three-dimensional (3D) structure from two-dimensional (2D) motion (3D-SFM). However, the neural dynamics underlying the reconstruction of a 3D object from 2D optic flow is not known. Here we combined magnetoencephalography (MEG) and functional MRI (fMRI) measurements to investigate the spatiotemporal brain dynamics during 3D-SFM. We manipulated parametrically the coherence of randomly moving groups of dots to create different levels of 3D perception and to study the associated changes in brain activity. At different latencies, the posterior infero-temporal (pIT), the parieto-occipital (PO), and the intraparietal (IP) regions showed increased neural activity during highly coherent motion conditions in which subjects perceived a robust 3D object. Causality analysis between these regions indicated significant causal influence from IP to pIT and from pIT to PO only in conditions where subjects perceived a robust 3D object. Current results suggest that the perception of a 3D object from 2D motion includes integration of global motion and 3D mental image processing, as well as object recognition that are accomplished by interactions between the dorsal and ventral visual pathways.

Functional specialization and generalization for grouping of stimuli based on colour and motion

This study was undertaken to learn whether the principle of functional specialization that is evident at the level of the prestriate visual cortex extends to areas that are involved in grouping visual stimuli according to attribute, and specifically according to colour and motion. Subjects viewed, in an fMRI scanner, visual stimuli composed of moving dots, which could be either coloured or achromatic; in some stimuli the moving coloured dots were randomly distributed or moved in random directions; in others, some of the moving dots were grouped together according to colour or to direction of motion, with the number of groupings varying from 1 to 3. Increased activation was observed in area V4 in response to colour grouping and in V5 in response to motion grouping while both groupings led to activity in separate though contiguous compartments within the intraparietal cortex. The activity in all the above areas was parametrically related to the number of groupings, as was the prominent activity in Crus I of the cerebellum where the activity resulting from the two types of grouping overlapped. This suggests (a) that, the specialized visual areas of the prestriate cortex have functions beyond the processing of visual signals according to attribute, namely that of grouping signals according to colour (V4) or motion (V5); (b) that the functional separation evident in visual cortical areas devoted to motion and colour, respectively, is maintained at the level of parietal cortex, at least as far as grouping according to attribute is concerned; and (c) that, by contrast, this grouping-related functional segregation is not maintained at the level of the cerebellum.

Aging of low and high level vision: from chromatic and achromatic contrast sensitivity to local and 3D object motion perception

The influence of normal aging in early, intermediate and high-level visual processing is still poorly understood. We have addressed this important issue in a large cohort of 653 subjects divided into five distinct age groups, [20;30[, [30;40[, [40;50[, [50;60[and [60;[. We applied a broad range of psychophysical tests, testing distinct levels of the visual hierarchy, from local processing to global integration, using simple gratings (spatial contrast sensitivity -CS- using high temporal/low spatial frequency or intermediate spatial frequency static gratings), color CS using Landolt patches, moving dot stimuli (Local Speed Discrimination) and dot patterns defining 3D objects (3D Structure from Motion, 3D SFM). Aging data were fitted with linear or quadratic regression models, using the adjusted coefficient of determination (R²_a) to quantify the effect of aging. A significant effect of age was found on all visual channels tested, except for the red-green chromatic channel. The high temporal low spatial frequency contrast sensitivity channel showed a mean sensitivity loss of 0.75 dB per decade (R²_a = 0.17, p<0.001), while the lower intermediate spatial frequency channel showed a more pronounced decrease, around 2.35 dB (R²_a = 0.55, p<0.001). Concerning low-level motion perception, speed discrimination decreased 2.71°/s (R²_a = 0.18, p<0.001) and 3.15°/s (R²_a = 0.13, p<0.001) only for short presentations for horizontal and oblique meridians, respectively. The 3D SFM task, requiring high-level integration across dorsal and ventral streams, showed the strongest (quadratic) decrease of motion coherence perception with age, especially when the task was temporally constrained (R²_a = 0.54, p<0.001). These findings show that visual channels are influenced by aging into different extent, with time presenting a critical role, and high-level dorso-ventral dominance of deterioration, which accelerates with aging, in contrast to the other channels that show a linear pattern of deterioration.

Pattern-motion selective responses in MT, MST and the pulvinar of humans

Plaid stimuli are often used to investigate the mechanisms involved in the integration and segregation of motion information. Considering the perceptual importance of such mechanisms, only a very limited number of visual brain areas have been found to be specifically involved in motion integration. These are the human (h)MT+ complex, area V3 and the pulvinar. The hMT+ complex can be functionally subdivided into two separate areas, middle temporal area (MT) and medial superior temporal area (MST); however, it is currently unclear whether these distinct sub-regions have different responses to plaid stimuli. To address this issue we used functional magnetic resonance imaging to quantify the relative response of MT and MST to component and pattern motion. Participants viewed plaid stimuli that were constrained to result in the perception of either component motion (segregation of motion information) or pattern motion (integration of motion information). MT/MST segregation was achieved using a moving dot stimulus that allowed stimulation of each visual hemifield either in unison or separately. We found pattern motion selective responses in both MT and MST. Consistent with previous reports, activity indicative of pattern motion selectivity was also found in the pulvinar as well as in other extrastriate areas. These results demonstrate that MT, MST and the pulvinar are involved in the complex motion integration mechanisms that are triggered by plaid stimuli. This reinforces the concept that integrative computations take place in a distributed neuronal circuit both in cortical and sub-cortical networks.

Abnormal cortical processing of pattern motion in amblyopia: evidence from fMRI

Converging evidence from human psychophysics and animal neurophysiology indicates that amblyopia is associated with abnormal function of area MT, a motion sensitive region of the extrastriate visual cortex. In this context, the recent finding that amblyopic eyes mediate normal perception of dynamic plaid stimuli was surprising, as neural processing and perception of plaids has been closely linked to MT function. One intriguing potential explanation for this discrepancy is that the amblyopic eye recruits alternative visual brain areas to support plaid perception. This is the hypothesis that we tested. We used functional magnetic resonance imaging (fMRI) to measure the response of the amblyopic visual cortex and thalamus to incoherent and coherent motion of plaid stimuli that were perceived normally by the amblyopic eye. We found a different pattern of responses within the visual cortex when plaids were viewed by amblyopic as opposed to non-amblyopic eyes. The non-amblyopic eyes of amblyopes and control eyes differentially activated the hMT+ complex when viewing incoherent vs. coherent plaid motion, consistent with the notion that this region is centrally involved in plaid perception. However, for amblyopic eye viewing, hMT+ activation did not vary reliably with motion type. In a sub-set of our participants with amblyopia we were able to localize MT and MST within the larger hMT+ complex and found a lack of plaid motion selectivity in both sub-regions. The response of the pulvinar and ventral V3 to plaid stimuli also differed under amblyopic vs. non-amblyopic eye viewing conditions, however the response of these areas did vary according to motion type. These results indicate that while the perception of the plaid stimuli was constant for both amblyopic and non-amblyopic viewing, the network of neural areas that supported this perception was different.

Separability and commonality of auditory and visual bistable perception

It is unclear what neural processes induce individual differences in perceptual organization in different modalities. To examine this issue, the present study used different forms of bistable perception: auditory streaming, verbal transformations, visual plaids, and reversible figures. We performed factor analyses on the number of perceptual switches in the tasks. A 3-factor model provided a better fit to the data than the other possible models. These factors, namely the "auditory," "shape," and "motion" factors, were separable but correlated with each other. We compared the number of perceptual switches among genotype groups to identify the effects of neurotransmitter functions on the factors. We focused on polymorphisms of catechol-O-methyltransferase (COMT) Val(158)Met and serotonin 2A receptor (HTR2A) -1438G/A genes, which are involved in the modulation of dopamine and serotonin, respectively. The number of perceptual switches in auditory streaming and verbal transformations differed among COMT genotype groups, whereas that in reversible figures differed among HTR2A genotype groups. The results indicate that the auditory and shape factors reflect the functions of the dopamine and serotonin systems, respectively. Our findings suggest that the formation and selection of percepts involve neural processes in cortical and subcortical areas.

Physiological Signal Variability in hMT+ Reflects Performance on a Direction Discrimination Task

Our ability to perceive visual motion is critically dependent on the human motion complex (hMT+) in the dorsal visual stream. Extensive electrophysiological research in the monkey equivalent of this region has demonstrated how neuronal populations code for properties such as speed and direction, and that neurometric functions relate to psychometric functions within the individual monkey. In humans, the physiological correlates of inter-individual perceptual differences are still largely unknown. To address this question, we used functional magnetic resonance imaging (fMRI) while participants viewed translational motion in different directions, and we measured thresholds for direction discrimination of moving stimuli in a separate psychophysics experiment. After determining hMT+ in each participant with a functional localizer, we were able to decode the different directions of visual motion from it using pattern classification (PC). We also characterized the variability of fMRI signal in hMT+ during stimulus and rest periods with a generative model. Relating perceptual performance to physiology, individual direction discrimination thresholds were significantly correlated with the variability measure in hMT+, but not with PC accuracies. Individual differences in PC accuracy were driven by non-physiological sources of noise, such as head-movement, which makes this method a poor tool to investigate inter-individual differences. In contrast, variability analysis of the fMRI signal was robust to non-physiological noise, and variability characteristics in hMT+ correlated with psychophysical thresholds in the individual participants. Higher levels of fMRI signal variability compared to rest correlated with lower discrimination thresholds. This result is in line with theories on stochastic resonance in the context of neuronal populations, which suggest that endogenous or exogenous noise can increase the sensitivity of neuronal populations to incoming signals.

The neural basis of centre-surround interactions in visual motion processing

Perception of a moving visual stimulus can be suppressed or enhanced by surrounding context in adjacent parts of the visual field. We studied the neural processes underlying such contextual modulation with fMRI. We selected motion selective regions of interest (ROI) in the occipital and parietal lobes with sufficiently well defined topography to preclude direct activation by the surround. BOLD signal in the ROIs was suppressed when surround motion direction matched central stimulus direction, and increased when it was opposite. With the exception of hMT+/V5, inserting a gap between the stimulus and the surround abolished surround modulation. This dissociation between hMT+/V5 and other motion selective regions prompted us to ask whether motion perception is closely linked to processing in hMT+/V5, or reflects the net activity across all motion selective cortex. The motion aftereffect (MAE) provided a measure of motion perception, and the same stimulus configurations that were used in the fMRI experiments served as adapters. Using a linear model, we found that the MAE was predicted more accurately by the BOLD signal in hMT+/V5 than it was by the BOLD signal in other motion selective regions. However, a substantial improvement in prediction accuracy could be achieved by using the net activity across all motion selective cortex as a predictor, suggesting the overall conclusion that visual motion perception depends upon the integration of activity across different areas of visual cortex.

Magnetoencephalographic signatures of visual form and motion binding

This study investigates neural magneto-encephalographic (MEG) correlates of visual form and motion binding. Steady-state visual evoked fields (SSVEF) were recorded in MEG while observers reported their bound or unbound perception of moving bars arranged in a square shape. By using pairs of oscillating vertical and horizontal bars, "frequency-tagged" at f1 and f2, we identified a region with enhanced sustained power at 2f1+2f2 intermodulation frequency correlated with perceptual reports. Intermodulation power is more important during perceptual form/motion integration than during the perceptual segmentation of the stimulus into individual component motions, indicating that intermodulation frequency power is a neuromarker of form/motion integration. Source reconstruction of cortical activities at the relevant frequencies further reveals well segregated activity in the occipital lobe at the fundamental of the stimulation, f1 and f2, widely spread activity at 2f1 and 2f2 and a focal activity in the medial part of the right precentral sulcus region at the intermodulation component, 2f1+2f2. The present findings indicate that motion tagging provides a powerful way of investigating the processes underlying visual form/motion binding non-invasively in humans.

Investigating human audio-visual object perception with a combination of hypothesis-generating and hypothesis-testing fMRI analysis tools

Primate multisensory object perception involves distributed brain regions. To investigate the network character of these regions of the human brain, we applied data-driven group spatial independent component analysis (ICA) to a functional magnetic resonance imaging (fMRI) data set acquired during a passive audio-visual (AV) experiment with common object stimuli. We labeled three group-level independent component (IC) maps as auditory (A), visual (V), and AV, based on their spatial layouts and activation time courses. The overlap between these IC maps served as definition of a distributed network of multisensory candidate regions including superior temporal, ventral occipito-temporal, posterior parietal and prefrontal regions. During an independent second fMRI experiment, we explicitly tested their involvement in AV integration. Activations in nine out of these twelve regions met the max-criterion (A < AV > V) for multisensory integration. Comparison of this approach with a general linear model-based region-of-interest definition revealed its complementary value for multisensory neuroimaging. In conclusion, we estimated functional networks of uni- and multisensory functional connectivity from one dataset and validated their functional roles in an independent dataset. These findings demonstrate the particular value of ICA for multisensory neuroimaging research and using independent datasets to test hypotheses generated from a data-driven analysis.

No interaction of first- and second-order signals in the extraction of global-motion and optic-flow

Edwards and Badcock (Vision Research 35, 2589, 1995) argued for independent first-order (FO) and second-order (SO) motion systems up to and including the global-motion level. That study used luminance (which they called FO) and contrast (SO) modulated dots. They found that SO noise dots did not mask signal extraction with luminance increment dots while luminance increment dots did mask SO signal extraction. However, they argued this asymmetry was not due to a combined FO-SO pathway, but rather due to the fact that the luminance-modulated dots, being also local variations in contrast, are both FO and SO stimuli. We test their claim of FO and SO independence by using a stimulus that can generate pure FO and SO signals, specifically one consisting of multiple Gabors (the global-Gabor stimulus) in which the Gaussian envelopes are static and the carriers drift. The carrier can either be luminance-modulated (FO) or contrast-modulated (SO) and motion signals from the randomly-oriented local Gabors must be combined to detect the global-motion vector. Results show no cross-masking of FO and SO signals, thus supporting the hypothesis of independent FO and SO systems up to and including the level extracting optic-flow.

Motion-onset visual evoked potentials predict performance during a global direction discrimination task

The relationship between cognitive processing stages and event-related potential components has been extensively researched for single components, but even the simplest task comprises multiple electrophysiological and cognitive components. Here we examined the relationship between behavioral measures and several visual evoked potentials (VEPs) related to global motion onset during a visual motion discrimination task. In addition to reaction time and accuracy, the EZ diffusion model was used to characterize elements of the decision process. Results showed that latencies, but not amplitudes, from three VEP components reliably predicted about 40% of the variance in reaction times for motion discrimination. These included the latency from stimulus motion onset to N2 onset, the latency from N2 onset to N2 peak, and the latency from the N2 peak to the peak of a late positive potential. These latencies were also able to predict the rate of information accumulation during the decision process and the duration of non-decision processes, but not the observer's threshold (boundary) for making a response. This pattern of results is consistent with an interpretation of these three latencies as reflecting a non-specific visual perceptual process, a motion-specific process, and a decision process, respectively. The relationship between the earliest interval and drift rate estimated with the EZ model also supports the notion that early perceptual processing might be a constituent part of the decision process itself.

Discrete object representation, attention switching, and task difficulty in the parietal lobe

An important component of perception, attention, and memory is the structuring of information into subsets ("objects"), which allows some parts to be considered together but kept separate from others. Portions of the posterior parietal lobe respond proportionally to the number of objects in the scope of attention and short-term memory, up to a capacity limit of around four, suggesting they have a role in this important process. This study investigates the relationship of discrete object representation to other parietal functions. Two experiments and two supplementary analyses were conducted to evaluate responsivity in parietal regions to the number of objects, the number of spatial locations, attention switching, and general task difficulty. Using transparent motion, it was found that a posterior and inferior parietal response to multiple objects persists even in the absence of a change in visual extent or the number of spatial locations. In a monitoring task, it was found that attention switching (or task difficulty) and object representation have distinct neural signatures, with the former showing greater recruitment of an anterior and lateral intraparietal sulcus (IPS) region, but the latter in a posterior and lateral region. A dissociation was also seen between selectivity for object load across tasks in the inferior IPS and feature or object-related memory load in the superior IPS.

Extrastriate cortical activity reflects segmentation of motion into independent sources

Identical local image motion signals can arise from countless object motions in the world. In order to resolve this ambiguity, the visual system must somehow integrate motion signals arising from different locations along an object's contour. Difficulties arise, however, because image contours can derive from multiple objects and from occlusion. Thus, correctly integrating respective objects' motion signals presupposes the specification of what counts as an object. Depending on how this form analysis problem is solved, dramatically different object motion percepts can be constructed from the same set of local image motions. Here we apply fMRI to investigate the mechanisms underlying the segmentation and integration of motion signals that are critical to motion perception in general. We hold the number of image objects constant, but vary whether these objects are perceived to move independently or not. We find that BOLD signal in V3v, V4v, V3A, V3B and MT varies with the number of distinct sources of motion information in the visual scene. These data support the hypothesis that these areas integrate form and motion information in order to segment motion into independent sources (i.e. objects) thereby overcoming ambiguities that arise at the earliest stages of motion processing.

Attractors and noise: twin drivers of decisions and multistability

Perceptual decisions are made not only during goal-directed behavior such as choice tasks, but also occur spontaneously while multistable stimuli are being viewed. In both contexts, the formation of a perceptual decision is best captured by noisy attractor dynamics. Noise-driven attractor transitions can accommodate a wide range of timescales and a hierarchical arrangement with "nested attractors" harbors even more dynamical possibilities. The attractor framework seems particularly promising for understanding higher-level mental states that combine heterogeneous information from a distributed set of brain areas.

A double dissociation between striate and extrastriate visual cortex for pattern motion perception revealed using rTMS

The neural mechanisms underlying the integration and segregation of motion signals are often studied using plaid stimuli. These stimuli consist of two spatially coincident dynamic gratings of differing orientations, which are either perceived to move in two unique directions or are integrated by the visual system to elicit the percept of a checkerboard moving in a single direction. Computations pertaining to the motion of the individual component gratings are thought to take place in striate cortex (V1) whereas motion integration is thought to involve neurons in dorsal stream extrastriate visual areas, particularly V5/MT. By combining a psychophysical task that employed plaid stimuli with 1 Hz offline repetitive transcranial magnetic stimulation (rTMS), we demonstrated a double dissociation between striate and extrastriate visual cortex in terms of their contributions to motion integration. rTMS over striate cortex increased coherent motion percepts whereas rTMS over extrastriate cortex had the opposite effect. These effects were robust directly after the stimulation administration and gradually returned to baseline within 15 minutes. This double dissociation is consistent with previous patient data and the recent hypothesis that both coherent and transparent motion percepts are supported by the visual system simultaneously and compete for perceptual dominance.

Type of featural attention differentially modulates hMT+ responses to illusory motion aftereffects

Activity in the human motion complex (hMT(+)/V5) is related to the perception of motion, be it either real surface motion or an illusion of motion such as apparent motion (AM) or motion aftereffect (MAE). It is a long-lasting debate whether illusory motion-related activations in hMT(+) represent the motion itself or attention to it. We have asked whether hMT(+) responses to MAEs are present when shifts in arousal are suppressed and attention is focused on concurrent motion versus nonmotion features. Significant enhancement of hMT(+) activity was observed during MAEs when attention was focused either on concurrent spatial angle or color features. This observation was confirmed by direct comparison of adapting (MAE inducing) versus nonadapting conditions. In contrast, this effect was diminished when subjects had to report on concomitant speed changes of superimposed AM. The same finding was observed for concomitant orthogonal real motion (RM), suggesting that selective attention to concurrent illusory or real motion was interfering with the saliency of MAE signals in hMT(+). We conclude that MAE-related changes in the global activity of hMT(+) are present provided selective attention is not focused on an interfering feature such as concurrent motion. Accordingly, there is a genuine MAE-related motion signal in hMT(+) that is neither explained by shifts in arousal nor by selective attention.