Parallel motion signals to the medial and lateral motion areas V6 and MT+

Neural sensitivity to translational self- and object-motion velocities

The ability to detect and assess world-relative object-motion is a critical computation performed by the visual system. This computation, however, is greatly complicated by the observer's movements, which generate a global pattern of motion on the observer's retina. How the visual system implements this computation is poorly understood. Since we are potentially able to detect a moving object if its motion differs in velocity (or direction) from the expected optic flow generated by our own motion, here we manipulated the relative motion velocity between the observer and the object within a stationary scene as a strategy to test how the brain accomplishes object-motion detection. Specifically, we tested the neural sensitivity of brain regions that are known to respond to egomotion-compatible visual motion (i.e., egomotion areas: cingulate sulcus visual area, posterior cingulate sulcus area, posterior insular cortex [PIC], V6+, V3A, IPSmot/VIP, and MT+) to a combination of different velocities of visually induced translational self- and object-motion within a virtual scene while participants were instructed to detect object-motion. To this aim, we combined individual surface-based brain mapping, task-evoked activity by functional magnetic resonance imaging, and parametric and representational similarity analyses. We found that all the egomotion regions (except area PIC) responded to all the possible combinations of self- and object-motion and were modulated by the self-motion velocity. Interestingly, we found that, among all the egomotion areas, only MT+, V6+, and V3A were further modulated by object-motion velocities, hence reflecting their possible role in discriminating between distinct velocities of self- and object-motion. We suggest that these egomotion regions may be involved in the complex computation required for detecting scene-relative object-motion during self-motion.

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Functional organization of the caudal part of the human superior parietal lobule

Like in macaque, the caudal portion of the human superior parietal lobule (SPL) plays a key role in a series of perceptive, visuomotor and somatosensory processes. Here, we review the functional properties of three separate portions of the caudal SPL, i.e., the posterior parieto-occipital sulcus (POs), the anterior POs, and the anterior part of the caudal SPL. We propose that the posterior POs is mainly dedicated to the analysis of visual motion cues useful for object motion detection during self-motion and for spatial navigation, while the more anterior parts are implicated in visuomotor control of limb actions. The anterior POs is mainly involved in using the spotlight of attention to guide reach-to-grasp hand movements, especially in dynamic environments. The anterior part of the caudal SPL plays a central role in visually guided locomotion, being implicated in controlling leg-related movements as well as the four limbs interaction with the environment, and in encoding egomotion-compatible optic flow. Together, these functions reveal how the caudal SPL is strongly implicated in skilled visually-guided behaviors.

Activation of human visual area V6 during egocentric navigation with and without visual experience

V6 is a retinotopic area located in the dorsal visual stream that integrates eye movements with retinal and visuo-motor signals. Despite the known role of V6 in visual motion, it is unknown whether it is involved in navigation and how sensory experiences shape its functional properties. We explored the involvement of V6 in egocentric navigation in sighted and in congenitally blind (CB) participants navigating via an in-house distance-to-sound sensory substitution device (SSD), the EyeCane. We performed two fMRI experiments on two independent datasets. In the first experiment, CB and sighted participants navigated the same mazes. The sighted performed the mazes via vision, while the CB performed them via audition. The CB performed the mazes before and after a training session, using the EyeCane SSD. In the second experiment, a group of sighted participants performed a motor topography task. Our results show that right V6 (rhV6) is selectively involved in egocentric navigation independently of the sensory modality used. Indeed, after training, rhV6 of CB is selectively recruited for auditory navigation, similarly to rhV6 in the sighted. Moreover, we found activation for body movement in area V6, which can putatively contribute to its involvement in egocentric navigation. Taken together, our findings suggest that area rhV6 is a unique hub that transforms spatially relevant sensory information into an egocentric representation for navigation. While vision is clearly the dominant modality, rhV6 is in fact a supramodal area that can develop its selectivity for navigation in the absence of visual experience.

Cortical maps as a fundamental neural substrate for visual representation

Visual perception is the product of serial hierarchical processing, parallel processing, and remapping on a dynamic network involving several topographically organized cortical visual areas. Here, we will focus on the topographical organization of cortical areas and the different kinds of visual maps found in the primate brain. We will interpret our findings in light of a broader representational framework for perception. Based on neurophysiological data, our results do not support the notion that vision can be explained by a strict representational model, where the objective visual world is faithfully represented in our brain. On the contrary, we find strong evidence that vision is an active and constructive process from the very initial stages taking place in the eye and from the very initial stages of our development. A constructive interplay between perceptual and motor systems (e.g., during saccadic eye movements) is actively learnt from early infancy and ultimately provides our fluid stable visual perception of the world.

Investigate the Neuro Mechanisms of Stereoscopic Visual Fatigue

Stereoscopic visual fatigue (SVF) due to prolonged immersion in the virtual environment can lead to negative user experience, thus hindering the development of virtual reality (VR) industry. Previous studies have focused on investigating the evaluation indicators associated with SVF, while few studies have been conducted to reveal the underlying neural mechanism, especially in VR applications. In this paper, a modified Go/NoGo paradigm was adopted to induce SVF in VR environment with Go trials for maintaining participants' attention to experimental viewing tasks and NoGo trials for investigating the neural effects under SVF. Random dot stereograms (RDSs) with 11 disparities and 2 types of shapes (arrow and rectangle) were presented to evoke the depth-related visual evoked potentials (DVEPs) during 64-channel EEG recordings. EEG datasets collected from 15 participants in NoGo trials were selected to conduct individual processing and group analysis, in which the characteristics of the DVEPs components for various fatigue degrees were compared with one-way repeated-measurement ANOVA and independent components were clustered to explore the original cortex areas related to SVF. Point-by-point permutation statistics revealed that DVEPs sample points from 230ms to 280ms in most brain areas changed significantly with SVF. More specifically, we found that amplitudes of component P2 changed significantly when SVF increased. Additionally, independent component analysis (ICA) identified that component P2 which originated from posterior cingulate cortex and precuneus, was associated statistically with SVF. We believe that SVF is rather a conscious status concerning the changes of self-awareness or self-location awareness than the performance reduction of retinal image processing. Moreover, we suggest that indicators representing higher conscious state may be a better indicator for SVF evaluation in VR environments.

Optic flow selectivity in the macaque parieto-occipital sulcus

In humans, several neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates higher-level motion areas, like V6 and the cingulate sulcus visual area (CSv). In macaque, there are few studies on the sensitivity of V6 and CSv to egomotion compatible optic flow. The only fMRI study on this issue revealed selectivity to egomotion compatible optic flow in macaque CSv but not in V6 (Cotterau et al. Cereb Cortex 27(1):330-343, 2017, but see Fan et al. J Neurosci. 35:16303-16314, 2015). Yet, it is unknown whether monkey visual motion areas MT + and V6 display any distinctive fMRI functional profile relative to the optic flow stimulation, as it is the case for the homologous human areas (Pitzalis et al., Cereb Cortex 20(2):411-424, 2010). Here, we described the sensitivity of the monkey brain to two motion stimuli (radial rings and flow fields) originally used in humans to functionally map the motion middle temporal area MT + (Tootell et al. J Neurosci 15: 3215-3230, 1995a; Nature 375:139-141, 1995b) and the motion medial parietal area V6 (Pitzalis et al. 2010), respectively. In both animals, we found regions responding only to optic flow or radial rings stimulation, and regions responding to both stimuli. A region in the parieto-occipital sulcus (likely including V6) was one of the most highly selective area for coherently moving fields of dots, further demonstrating the power of this type of stimulation to activate V6 in both humans and monkeys. We did not find any evidence that putative macaque CSv responds to Flow Fields.

Robust vestibular self-motion signals in macaque posterior cingulate region

Self-motion signals, distributed ubiquitously across parietal-temporal lobes, propagate to limbic hippocampal system for vector-based navigation via hubs including posterior cingulate cortex (PCC) and retrosplenial cortex (RSC). Although numerous studies have indicated posterior cingulate areas are involved in spatial tasks, it is unclear how their neurons represent self-motion signals. Providing translation and rotation stimuli to macaques on a 6-degree-of-freedom motion platform, we discovered robust vestibular responses in PCC. A combined three-dimensional spatiotemporal model captured data well and revealed multiple temporal components including velocity, acceleration, jerk, and position. Compared to PCC, RSC contained moderate vestibular temporal modulations and lacked significant spatial tuning. Visual self-motion signals were much weaker in both regions compared to the vestibular signals. We conclude that macaque posterior cingulate region carries vestibular-dominant self-motion signals with plentiful temporal components that could be useful for path integration.

From Observed Action Identity to Social Affordances

Others' observed actions cause continuously changing retinal images, making it challenging to build neural representations of action identity. The monkey anterior intraparietal area (AIP) and its putative human homologue (phAIP) host neurons selective for observed manipulative actions (OMAs). The neuronal activity of both AIP and phAIP allows a stable readout of OMA identity across visual formats, but human neurons exhibit greater invariance and generalize from observed actions to action verbs. These properties stem from the convergence in AIP of superior temporal signals concerning: (i) observed body movements; and (ii) the changes in the body-object relationship. We propose that evolutionarily preserved mechanisms underlie the specification of observed-actions identity and the selection of motor responses afforded by them, thereby promoting social behavior.

Cortical thickness of primary visual cortex correlates with motion deficits in periventricular leukomalacia

Impairments of visual motion perception and, in particular, of flow motion have been consistently observed in premature and very low birth weight subjects during infancy. Flow motion information is analyzed at various cortical levels along the dorsal pathways, with information mainly provided by primary and early visual cortex (V1, V2 and V3). We investigated the cortical stage of the visual processing that underlies these motion impairments, measuring Grey Matter Volume and Cortical Thickness in 13 children with Periventricular Leukomalacia (PVL). The cortical thickness, but not the grey matter volume of area V1, correlates negatively with motion coherence sensitivity, indicating that the thinner the cortex, the better the performance among the patients. However, we did not find any such association with either the thickness or volume of area MT, MST and areas of the IPS, suggesting damage at the level of primary visual cortex or along the optic radiation.

A Causal Role of Area hMST for Self-Motion Perception in Humans

Previous studies in the macaque monkey have provided clear causal evidence for an involvement of the medial-superior-temporal area (MST) in the perception of self-motion. These studies also revealed an overrepresentation of contraversive heading. Human imaging studies have identified a functional equivalent (hMST) of macaque area MST. Yet, causal evidence of hMST in heading perception is lacking. We employed neuronavigated transcranial magnetic stimulation (TMS) to test for such a causal relationship. We expected TMS over hMST to induce increased perceptual variance (i.e., impaired precision), while leaving mean heading perception (accuracy) unaffected. We presented 8 human participants with an optic flow stimulus simulating forward self-motion across a ground plane in one of 3 directions. Participants indicated perceived heading. In 57% of the trials, TMS pulses were applied, temporally centered on self-motion onset. TMS stimulation site was either right-hemisphere hMST, identified by a functional magnetic resonance imaging (fMRI) localizer, or a control-area, just outside the fMRI localizer activation. As predicted, TMS over area hMST, but not over the control-area, increased response variance of perceived heading as compared with noTMS stimulation trials. As hypothesized, this effect was strongest for contraversive self-motion. These data provide a first causal evidence for a critical role of hMST in visually guided navigation.

A common neural substrate for processing scenes and egomotion-compatible visual motion

Neuroimaging studies have revealed two separate classes of category-selective regions specialized in optic flow (egomotion-compatible) processing and in scene/place perception. Despite the importance of both optic flow and scene/place recognition to estimate changes in position and orientation within the environment during self-motion, the possible functional link between egomotion- and scene-selective regions has not yet been established. Here we reanalyzed functional magnetic resonance images from a large sample of participants performing two well-known “localizer” fMRI experiments, consisting in passive viewing of navigationally relevant stimuli such as buildings and places (scene/place stimulus) and coherently moving fields of dots simulating the visual stimulation during self-motion (flow fields). After interrogating the egomotion-selective areas with respect to the scene/place stimulus and the scene-selective areas with respect to flow fields, we found that the egomotion-selective areas V6+ and pIPS/V3A responded bilaterally more to scenes/places compared to faces, and all the scene-selective areas (parahippocampal place area or PPA, retrosplenial complex or RSC, and occipital place area or OPA) responded more to egomotion-compatible optic flow compared to random motion. The conjunction analysis between scene/place and flow field stimuli revealed that the most important focus of common activation was found in the dorsolateral parieto-occipital cortex, spanning the scene-selective OPA and the egomotion-selective pIPS/V3A. Individual inspection of the relative locations of these two regions revealed a partial overlap and a similar response profile to an independent low-level visual motion stimulus, suggesting that OPA and pIPS/V3A may be part of a unique motion-selective complex specialized in encoding both egomotion- and scene-relevant information, likely for the control of navigation in a structured environment.

Motion sickness-susceptible participants exposed to coherent rotating dot patterns show excessive N2 amplitudes and impaired theta-band phase synchronization

Visually induced motion sickness (VIMS) can occur via prolonged exposure to visual stimulation that generates the illusion of self-motion (vection). Not everyone is susceptible to VIMS and the neural mechanism underlying susceptibility is unclear. This study explored the differences of electroencephalographic (EEG) signatures between VIMS-susceptible and VIMS-resistant groups. Thirty-two-channel EEG data were recorded from 12 VIMS-susceptible and 15 VIMS-resistant university students while they were watching two patterns of moving dots: (1) a coherent rotation pattern (vection-inducing and potentially VIMS-provoking pattern), and (2) a random movement pattern (non-VIMS-provoking control). The VIMS-susceptible group exhibited a significantly larger increase in the parietal N2 response when exposed to the coherent rotating pattern than when exposed to control patterns. In members of the VIMS-resistant group, before vection onset, global connectivity from all other EEG electrodes to the right-temporal-parietal and to the right-central areas increased, whereas after vection onset the global connectivity to the right-frontal area reduced. Such changes were not observed in the susceptible group. Further, the increases in N2 amplitude and the identified phase synchronization index were significantly correlated with individual motion sickness susceptibility. Results suggest that VIMS susceptibility is associated with systematic impairment of dynamic cortical coordination as captured by the phase synchronization of cortical activities. Analyses of dynamic EEG signatures could be a means to unlock the neural mechanism of VIMS.

Neural bases of self- and object-motion in a naturalistic vision

To plan movements toward objects our brain must recognize whether retinal displacement is due to self-motion and/or to object-motion. Here, we aimed to test whether motion areas are able to segregate these types of motion. We combined an event-related functional magnetic resonance imaging experiment, brain mapping techniques, and wide-field stimulation to study the responsivity of motion-sensitive areas to pure and combined self- and object-motion conditions during virtual movies of a train running within a realistic landscape. We observed a selective response in MT to the pure object-motion condition, and in medial (PEc, pCi, CSv, and CMA) and lateral (PIC and LOR) areas to the pure self-motion condition. Some other regions (like V6) responded more to complex visual stimulation where both object- and self-motion were present. Among all, we found that some motion regions (V3A, LOR, MT, V6, and IPSmot) could extract object-motion information from the overall motion, recognizing the real movement of the train even when the images remain still (on the screen), or moved, because of self-movements. We propose that these motion areas might be good candidates for the "flow parsing mechanism," that is the capability to extract object-motion information from retinal motion signals by subtracting out the optic flow components.

Functional Similarity of Medial Superior Parietal Areas for Shift-Selective Attention Signals in Humans and Monkeys

We continually shift our attention between items in the visual environment. These attention shifts are usually based on task relevance (top-down) or the saliency of a sudden, unexpected stimulus (bottom-up), and are typically followed by goal-directed actions. It could be argued that any species that can covertly shift its focus of attention will rely on similar, evolutionarily conserved neural substrates for processing such shift-signals. To address this possibility, we performed comparative fMRI experiments in humans and monkeys, combining traditional, and novel, data-driven analytical approaches. Specifically, we examined correspondences between monkey and human brain areas activated during covert attention shifts. When "shift" events were compared with "stay" events, the medial (superior) parietal lobe (mSPL) and inferior parietal lobes showed similar shift sensitivities across species, whereas frontal activations were stronger in monkeys. To identify, in a data-driven manner, monkey regions that corresponded with human shift-selective SPL, we used a novel interspecies beta-correlation strategy whereby task-related beta-values were correlated across voxels or regions-of-interest in the 2 species. Monkey medial parietal areas V6/V6A most consistently correlated with shift-selective human mSPL. Our results indicate that both species recruit corresponding, evolutionarily conserved regions within the medial superior parietal lobe for shifting spatial attention.

A putative human homologue of the macaque area PEc

The cortical area PEc is anatomically and functionally well-defined in macaque, but it is unknown whether it has a counterpart in human. Since we know that macaque PEc, but not the nearby posterior regions, hosts a lower limb representation, in an attempt to recognize a possible human PEc we looked for the existence of leg representations in the human parietal cortex using individual cortical surface-based analysis, task-evoked paradigms and resting-state functional connectivity. fMRI images were acquired while thirty-one participants performed long-range leg movements through an in-house MRI-compatible set-up. We revealed the existence of multiple leg representations in the human dorsomedial parietal cortex, here defined as S-I (somatosensory-I), hPE (human PE, in the postcentral sulcus), and hPEc (human PEc, in the anterior precuneus). Among the three "leg" regions, hPEc had a unique functional profile, in that it was the only one responding to both arm and leg movements, to both hand-pointing and foot pointing movements, and to flow field visual stimulation, very similar to macaque area PEc. In addition, hPEc showed functional connections with the somatomotor regions hosting a lower limb representation, again as in macaque area PEc. Therefore, based on similarity in brain position, functional organization, cortical connections, and relationship with the neighboring areas, we propose that this cortical region is the human homologue of macaque area PEc.

Egomotion-related visual areas respond to active leg movements

Monkey neurophysiology and human neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates a cortical network of temporal, parietal, insular, and cingulate visual motion regions. Here, we tested whether the human visual motion areas involved in processing optic flow signals simulating self-motion are also activated by active lower limb movements, and hence are likely involved in guiding human locomotion. To this aim, we used a combined approach of task-evoked activity and resting-state functional connectivity by fMRI. We localized a set of six egomotion-responsive visual areas (V6+, V3A, intraparietal motion/ventral intraparietal [IPSmot/VIP], cingulate sulcus visual area [CSv], posterior cingulate sulcus area [pCi], posterior insular cortex [PIC]) by using optic flow. We tested their response to a motor task implying long-range active leg movements. Results revealed that, among these visually defined areas, CSv, pCi, and PIC responded to leg movements (visuomotor areas), while V6+, V3A, and IPSmot/VIP did not (visual areas). Functional connectivity analysis showed that visuomotor areas are connected to the cingulate motor areas, the supplementary motor area, and notably to the medial portion of the somatosensory cortex, which represents legs and feet. We suggest that CSv, pCi, and PIC perform the visual analysis of egomotion-like signals to provide sensory information to the motor system with the aim of guiding locomotion.

The Effect of 4-Week Stroboscopic Training on Visual Function and Sport-Specific Visuomotor Performance in Top-Level Badminton Players

PURPOSE

Stroboscopic training is suggested to improve visuomotor abilities in sports. However, previous research has primarily focused on untrained participants and only considered behavioral data. Because visuomotor performance is substantially determined by neural visual processes, this study aimed to examine the effects of stroboscopic training on visuomotor performance and neural visual function of athletes.

METHODS

A total of 10 German top-level badminton players (intervention: n = 5 and control: n = 5) participated in this study. Over a 4-week training period, athletes performed badminton-specific visuomotor tasks either wearing shutter glasses (intervention) or under normal visual conditions (control). Prior to and after the training period, behavioral smash-defense tests and neurophysiologic investigations of the N2 motion onset visual evoked potential were used to identify modulations in the athletes' visuomotor performance and visual perception speed, respectively.

RESULTS

Badminton training improved visuomotor performance in both groups; however, stroboscopic training resulted in superior posttraining performance compared with normal visual conditions (P = .007). Training-induced modulations in N2 latency did not reach significance, although a strong relationship was observed between changes in N2 latency and changes in visuomotor performance (r = -.55), indicating that higher performance gains following training were associated with a stronger reduction in N2 latency.

CONCLUSIONS

The results indicate that stroboscopic training may be more effective than conventional visuomotor training for improving visuomotor abilities even in athletes performing at high skill levels. Furthermore, visuomotor performance gains could potentially be mediated by neural adaptations in the visual motion system. These findings should be confirmed for athletes from different disciplines.

Axonal Projections From the Middle Temporal Area in the Common Marmoset

Neural activity in the middle temporal (MT) area is modulated by the direction and speed of motion of visual stimuli. The area is buried in a sulcus in the macaque, but exposed to the cortical surface in the marmoset, making the marmoset an ideal animal model for studying MT function. To better understand the details of the roles of this area in cognition, underlying anatomical connections need to be clarified. Because most anatomical tracing studies in marmosets have used retrograde tracers, the axonal projections remain uncharacterized. In order to examine axonal projections from MT, we utilized adeno-associated viral (AAV) tracers, which work as anterograde tracers by expressing either green or red fluorescent protein in infected neurons. AAV tracers were injected into three sites in MT based on retinotopy maps obtained via in vivo optical intrinsic signal imaging. Brains were sectioned and divided into three series, one for fluorescent image scanning and two for myelin and Nissl substance staining to identify specific brain areas. Overall projection patterns were similar across the injections. MT projected to occipital visual areas V1, V2, V3 (VLP) and V4 (VLA) and surrounding areas in the temporal cortex including MTC (V4T), MST, FST, FSTv (PGa/IPa) and TE3. There were also projections to the dorsal visual pathway, V3A (DA), V6 (DM) and V6A, the intraparietal areas AIP, LIP, MIP, frontal A4ab and the prefrontal cortex, A8aV and A8C. There was a visuotopic relationship with occipital visual areas. In a marmoset in which two tracer injections were made, the projection targets did not overlap in A8aV and AIP, suggesting topographic projections from different parts of MT. Most of these areas are known to send projections back to MT, suggesting that they are reciprocally connected with it.

Functional correlate and delineated connectivity pattern of human motion aftereffect responses substantiate a subjacent visual-vestibular interaction

The visual motion aftereffect (MAE) is the most prominent aftereffect in the visual system. Regarding its function, psychophysical studies suggest its function to be a form of sensory error correction, possibly also triggered by incongruent visual-vestibular stimulation. Several observational imaging experiments have deducted an essential role for region MT+ in the perception of a visual MAE but not provided conclusive evidence. Potential confounders with the MAE such as ocular motor performance, attention, and vection sensations have also never been controlled for. Aim of this neuroimaging study was to delineate the neural correlates of MAE and its subjacent functional connectivity pattern. A rotational MAE (n = 22) was induced using differing visual stimuli whilst modulating ocular motor parameters in a 3T scanner. Data was analyzed with SPM12. Eye movements as a response to the same stimuli were studied by means of high-resolution videooculography. Analysis for all stimuli gave bilateral activations along the dorsal visual stream with an emphasis on area MT. The onset of a visual MAE revealed an additional response in the right medial superior temporal area (MST) and a concurrent deactivation of vestibular hub region OP2. There was no correlation for the BOLD effects during the MAE with either ocular motor or attention parameters. The functional correlate of a visual MAE in humans may be represented in the interaction between region MT and area MST. This MAE representation is independent of a potential afternystagmus, attention and the presence of egomotion sensations. Connectivity analyses showed that in the event of conflicting visual-vestibular motion information (here MAE) area MST and area OP2 may act as the relevant mediating network hubs.

Detailed spatiotemporal brain mapping of chromatic vision combining high-resolution VEP with fMRI and retinotopy

Neuroimaging studies have identified so far, several color-sensitive visual areas in the human brain, and the temporal dynamics of these activities have been separately investigated using the visual-evoked potentials (VEPs). In the present study, we combined electrophysiological and neuroimaging methods to determine a detailed spatiotemporal profile of chromatic VEP and to localize its neural generators. The accuracy of the present co-registration study was obtained by combining standard fMRI data with retinotopic and motion mapping data at the individual level. We found a sequence of occipito activities more complex than that typically reported for chromatic VEPs, including feed-forward and reentrant feedback. Results showed that chromatic human perception arises by the combined activity of at the least five parieto-occipital areas including V1, LOC, V8/VO, and the motion-sensitive dorsal region MT+. However, the contribution of V1 and V8/VO seems dominant because the re-entrant activity in these areas was present more than once (twice in V8/VO and thrice in V1). This feedforward and feedback chromatic processing appears delayed compared with the luminance processing. Associating VEPs and neuroimaging measures, we showed for the first time a complex spatiotemporal pattern of activity, confirming that chromatic stimuli produce intricate interactions of many different brain dorsal and ventral areas.

Global Motion Processing in Human Visual Cortical Areas V2 and V3

Global motion perception entails the ability to extract the central direction tendency from an extended area of visual space containing widely disparate local directions. A substantial body of evidence suggests that local motion signals generated in primary visual cortex (V1) are spatially integrated to provide perception of global motion, beginning in the middle temporal area (MT) in macaques and its counterpart in humans, hMT. However, V2 and V3 also contain motion-sensitive neurons that have larger receptive fields than those found in V1, giving the potential for spatial integration of motion signals. Despite this, V2 and V3 have been overlooked as sites of global motion processing. To test, free of local-global confounds, whether human V2 and V3 are important for encoding global motion, we developed a visual stimulus that yields a global direction yet includes all possible local directions and is perfectly balanced at the local motion level. We then attempted to decode global motion direction in such stimuli with multivariate pattern classification of fMRI data. We found strong sensitivity to global motion in hMT, as expected, and also in several higher visual areas known to encode optic flow. Crucially, we found that global motion direction could be decoded in human V2 and, particularly, in V3. The results suggest the surprising conclusion that global motion processing is a key function of cortical visual areas V2 and V3. A possible purpose is to provide global motion signals to V6.

SIGNIFICANCE STATEMENT

Humans can readily detect the overall direction of movement in a flock of birds despite large differences in the directions of individual birds at a given moment. This ability to combine disparate motion signals across space underlies many aspects of visual motion perception and has therefore received considerable research attention. The received wisdom is that spatial integration of motion signals occurs in the cortical motion complex MT+ in both human and nonhuman primates. We show here that areas V2 and V3 in humans are also able to perform this function. We suggest that different cortical areas integrate motion signals in different ways for different purposes.

Differential processing of the direction and focus of expansion of optic flow stimuli in areas MST and V3A of the human visual cortex

Human neuropsychological and neuroimaging studies have raised the possibility that different attributes of optic flow stimuli, namely radial direction and the position of the focus of expansion (FOE), are processed within separate cortical areas. In the human brain, visual areas V5/MT+ and V3A have been proposed as integral to the analysis of these different attributes of optic flow stimuli. To establish direct causal relationships between neural activity in human (h)V5/MT+ and V3A and the perception of radial motion direction and FOE position, we used transcranial magnetic stimulation (TMS) to disrupt cortical activity in these areas while participants performed behavioral tasks dependent on these different aspects of optic flow stimuli. The cortical regions of interest were identified in seven human participants using standard functional MRI retinotopic mapping techniques and functional localizers. TMS to area V3A was found to disrupt FOE positional judgments but not radial direction discrimination, whereas the application of TMS to an anterior subdivision of hV5/MT+, MST/TO-2 produced the reverse effects, disrupting radial direction discrimination but eliciting no effect on the FOE positional judgment task. This double dissociation demonstrates that FOE position and radial direction of optic flow stimuli are signaled independently by neural activity in areas hV5/MT+ and V3A.NEW & NOTEWORTHY Optic flow constitutes a biologically relevant visual cue as we move through any environment. With the use of neuroimaging and brain-stimulation techniques, this study demonstrates that separate human brain areas are involved in the analysis of the direction of radial motion and the focus of expansion in optic flow. This dissociation reveals the existence of separate processing pathways for the analysis of different attributes of optic flow that are important for the guidance of self-locomotion and object avoidance.

The dorsal visual stream revisited: Stable circuits or dynamic pathways?

In both macaque and human brain, information regarding visual motion flows from the extrastriate area V6 along two different paths: a dorsolateral one towards areas MT/V5, MST, V3A, and a dorsomedial one towards the visuomotor areas of the superior parietal lobule (V6A, MIP, VIP). The dorsolateral visual stream is involved in many aspects of visual motion analysis, including the recognition of object motion and self motion. The dorsomedial stream uses visual motion information to continuously monitor the spatial location of objects while we are looking and/or moving around, to allow skilled reaching for and grasping of the objects in structured, dynamically changing environments. Grasping activity is present in two areas of the dorsal stream, AIP and V6A. Area AIP is more involved than V6A in object recognition, V6A in encoding vision for action. We suggest that V6A is involved in the fast control of prehension and plays a critical role in biomechanically selecting appropriate postures during reach to grasp behaviors. In everyday life, numerous functional networks, often involving the same cortical areas, are continuously in action in the dorsal visual stream, with each network dynamically activated or inhibited according to the context. The dorsolateral and dorsomedial streams represent only two examples of these networks. Many others streams have been described in the literature, but it is worthwhile noting that the same cortical area, and even the same neurons within an area, are not specific for just one functional property, being part of networks that encode multiple functional aspects. Our proposal is to conceive the cortical streams not as fixed series of interconnected cortical areas in which each area belongs univocally to one stream and is strictly involved in only one function, but as interconnected neuronal networks, often involving the same neurons, that are involved in a number of functional processes and whose activation changes dynamically according to the context.

Visual motion serves but is not under the purview of the dorsal pathway

Visual motion processing is often attributed to the dorsal visual pathway despite visual motion's involvement in almost all visual functions. Furthermore, some visual motion tasks critically depend on the structural integrity of regions outside the dorsal pathway. Here, based on numerous studies, I propose that visual motion signals are swiftly transmitted via multiple non-hierarchical routes to primary motion-dedicated processing regions (MT/V5 and MST) that are not part of the dorsal pathway, and then propagated to a multiplicity of brain areas according to task demands, reaching these regions earlier than the dorsal/ventral hierarchical flow. This not only places MT/V5 at the same or even earlier visual processing stage as that of V1, but can also elucidate many findings with implications to visual awareness. While the integrity of the non-hierarchical motion pathway is necessary for all visual motion perception, it is insufficient on its own, and the transfer of visual motion signals to additional brain areas is crucial to allow the different motion perception tasks (e.g. optic flow, visuo-vestibular balance, movement observation, dynamic form detection and perception, and even reading). I argue that this lateral visual motion pathway can be distinguished from the dorsal pathway not only based on faster response latencies and distinct anatomical connections, but also based on its full field representation. I also distinguish between this primary lateral visual motion pathway sensitive to all motion in the visual field, and a much less investigated optic flow sensitive medial processing pathway (from V1 to V6 and V6A) that appears to be part of the dorsal pathway. Multiple additional predictions are provided that allow testing this proposal and distinguishing between the visual pathways.

The human cortical areas V6 and V6A

In macaque, it has long been known since the late nineties that the medial parieto-occipital sulcus (POS) contains two regions, V6 and V6A, important for visual motion and action. While V6 is a retinotopically organized extrastriate area, V6A is a broadly retinotopically organized visuomotor area constituted by a ventral and dorsal subdivision (V6Av and V6Ad), both containing arm movement-related cells active during spatially directed reaching movements. In humans, these areas have been mapped only in recent years thanks to neuroimaging methods. In a series of brain mapping studies, by using a combination of functional magnetic resonance imaging methods such as wide-field retinotopy and task-evoked activity, we mapped human areas V6 (Pitzalis et al., 2006) and V6Av (Pitzalis et al., 2013 d) retinotopically and defined human V6Ad functionally as a pointing-selective region situated anteriorly in the close proximity of V6Av (Tosoni et al., 2014). Like in macaque, human V6 is a motion area (e.g., Pitzalis et al., 2010, 2012, 2013 a, b , c ), while V6Av and V6Ad respond to pointing movements (Tosoni et al., 2014). The retinotopic organization (when present), anatomical position, neighbor relations, and functional properties of these three areas closely resemble those reported for macaque V6 (Galletti et al., 1996, 1999 a), V6Av, and V6Ad (Galletti et al., 1999 b; Gamberini et al., 2011). We suggest that information on objects in depth which are translating in space, because of the self-motion, is processed in V6 and conveyed to V6A for evaluating object distance in a dynamic condition such as that created by self-motion, so to orchestrate the eye and arm movements necessary to reach or avoid static and moving objects in the environment.

Short-term monocular deprivation alters early components of visual evoked potentials

KEY POINTS

Short-term monocular deprivation in adult humans produces a perceptual boost of the deprived eye reflecting homeostatic plasticity. Visual evoked potentials (VEPs) to transient stimuli change after 150 min of monocular deprivation in adult humans. The amplitude of the C1 component of the VEP at a latency of about 100 ms increases for the deprived eye and decreases for the non-deprived eye after deprivation, the two effects being highly negatively correlated. Similarly, the evoked alpha rhythm increases after deprivation for the deprived eye and decreases for the non-deprived eye. The data demonstrate that primary visual cortex excitability is altered by a short period of monocular deprivation, reflecting homeostatic plasticity.

ABSTRACT

Very little is known about plasticity in the adult visual cortex. In recent years psychophysical studies have shown that short-term monocular deprivation alters visual perception in adult humans. Specifically, after 150 min of monocular deprivation the deprived eye strongly dominates the dynamics of binocular rivalry, reflecting homeostatic plasticity. Here we investigate the neural mechanisms underlying this form of short-term visual cortical plasticity by measuring visual evoked potentials (VEPs) on the scalp of adult humans during monocular stimulation before and after 150 min of monocular deprivation. We found that monocular deprivation had opposite effects on the amplitude of the earliest component of the VEP (C1) for the deprived and non-deprived eye stimulation. C1 amplitude increased (+66%) for the deprived eye, while it decreased (-29%) for the non-deprived eye. Source localization analysis confirmed that the C1 originates in the primary visual cortex. We further report that following monocular deprivation, the amplitude of the peak of the evoked alpha spectrum increased on average by 23% for the deprived eye and decreased on average by 10% for the non-deprived eye, indicating a change in cortical excitability. These results indicate that a brief period of monocular deprivation alters interocular balance in the primary visual cortex of adult humans by both boosting the activity of the deprived eye and reducing the activity of the non-deprived eye. This indicates a high level of residual homeostatic plasticity in the adult human primary visual cortex, probably mediated by a change in cortical excitability.

Activity-dependent plasticity of mouse hippocampal assemblies in vitro

Memory formation is associated with the generation of transiently stable neuronal assemblies. In hippocampal networks, such groups of functionally coupled neurons express highly ordered spatiotemporal activity patterns which are coordinated by local network oscillations. One of these patterns, sharp wave-ripple complexes (SPW-R), repetitively activates previously established groups of memory-encoding neurons, thereby supporting memory consolidation. This function implies that repetition of specific SPW-R induces plastic changes which render the underlying neuronal assemblies more stable. We modeled this repetitive activation in an in vitro model of SPW-R in mouse hippocampal slices. Weak electrical stimulation upstream of the CA3-CA1 networks reliably induced SPW-R of stereotypic waveform, thus representing re-activation of similar neuronal activity patterns. Frequent repetition of these patterns (100 times) reduced the variance of both, evoked and spontaneous SPW-R waveforms, indicating stabilization of pre-existing assemblies. These effects were most pronounced in the CA1 subfield and depended on the timing of stimulation relative to spontaneous SPW-R. Additionally, plasticity of SPW-R was blocked by application of a NMDA receptor antagonist, suggesting a role for associative synaptic plasticity in this process. Thus, repetitive activation of specific patterns of SPW-R causes stabilization of memory-related networks.

Dissociation of retinal and headcentric disparity signals in dorsal human cortex

Recent fMRI studies have shown fusion of visual motion and disparity signals for shape perception (Ban et al., 2012), and unmasking camouflaged surfaces (Rokers et al., 2009), but no such interaction is known for typical dorsal motion pathway tasks, like grasping and navigation. Here, we investigate human speed perception of forward motion and its representation in the human motion network. We observe strong interaction in medial (V3ab, V6) and lateral motion areas (MT⁺), which differ significantly. Whereas the retinal disparity dominates the binocular contribution to the BOLD activity in the anterior part of area MT⁺, headcentric disparity modulation of the BOLD response dominates in area V3ab and V6. This suggests that medial motion areas not only represent rotational speed of the head (Arnoldussen et al., 2011), but also translational speed of the head relative to the scene. Interestingly, a strong response to vergence eye movements was found in area V1, which showed a dependency on visual direction, just like vertical-size disparity. This is the first report of a vertical-size disparity correlate in human striate cortex.

Functional Reorganization of the Visual Dorsal Stream as Probed by 3-D Visual Coherence in Williams Syndrome

Object and depth perception from motion cues involves the recruitment of visual dorsal stream brain areas. In 3-D structure-from-motion (SFM) perception, motion and depth information are first extracted in this visual stream to allow object categorization, which is in turn mediated by the ventral visual stream. Such interplay justifies the use of SFM paradigms to understand dorsal–ventral integration of visual information. The nature of such processing is particularly interesting to be investigated in a neurological model of cognitive dissociation between dorsal (impaired) and ventral stream (relatively preserved) processing, Williams syndrome (WS). In the current fMRI study, we assessed dorsal versus ventral stream processing by using a performance-matched 3-D SFM object categorization task. We found evidence for substantial reorganization of the dorsal stream in WS as assessed by whole-brain ANOVA random effects analysis, with subtle differences in ventral activation. Dorsal reorganization was expressed by larger medial recruitment in WS (cuneus, precuneus, and retrosplenial cortex) in contrast with controls, which showed the expected dorsolateral pattern (caudal intraparietal sulcus and lateral occipital cortex). In summary, we found a substantial reorganization of dorsal stream regions in WS in response to simple visual categories and 3-D SFM perception, with less affected ventral stream. Our results corroborate the existence of a medial dorsal pathway that provides the substrate for information rerouting and reorganization in the presence of lateral dorsal stream vulnerability. This interpretation is consistent with recent findings suggesting parallel routing of information in medial and lateral parts of dorsal stream.

Functional roles of 10 Hz alpha-band power modulating engagement and disengagement of cortical networks in a complex visual motion task

Alpha band power, particularly at the 10 Hz frequency, is significantly involved in sensory inhibition, attention modulation, and working memory. However, the interactions between cortical areas and their relationship to the different functional roles of the alpha band oscillations are still poorly understood. Here we examined alpha band power and the cortico-cortical interregional phase synchrony in a psychophysical task involving the detection of an object moving in depth by an observer in forward self-motion. Wavelet filtering at the 10 Hz frequency revealed differences in the profile of cortical activation in the visual processing regions (occipital and parietal lobes) and in the frontoparietal regions. The alpha rhythm driving the visual processing areas was found to be asynchronous with the frontoparietal regions. These findings suggest a decoupling of the 10 Hz frequency into separate functional roles: sensory inhibition in the visual processing regions and spatial attention in the frontoparietal regions.

Resting-state connectivity and functional specialization in human medial parieto-occipital cortex

According to recent models of visuo-spatial processing, the medial parieto-occipital cortex is a crucial node of the dorsal visual stream. Evidence from neurophysiological studies in monkeys has indicated that the parieto-occipital sulcus (POS) contains three functionally and cytoarchitectonically distinct areas: the visual area V6 in the fundus of the POS, and the visuo-motor areas V6Av and V6Ad in a progressively dorsal and anterior location with respect to V6. Besides different topographical organization, cytoarchitectonics, and functional properties, these three monkey areas can also be distinguished based on their patterns of cortico-cortical connections. Thanks to wide-field retinotopic mapping, areas V6 and V6Av have been also mapped in the human brain. Here, using a combined approach of resting-state functional connectivity and task-evoked activity by fMRI, we identified a new region in the anterior POS showing a pattern of functional properties and cortical connections that suggests a homology with the monkey area V6Ad. In addition, we observed distinct patterns of cortical connections associated with the human V6 and V6Av which are remarkably consistent with those showed by the anatomical tracing studies in the corresponding monkey areas. Consistent with recent models on visuo-spatial processing, our findings demonstrate a gradient of functional specialization and cortical connections within the human POS, with more posterior regions primarily dedicated to the analysis of visual attributes useful for spatial navigation and more anterior regions primarily dedicated to analyses of spatial information relevant for goal-directed action.

Towards obtaining spatiotemporally precise responses to continuous sensory stimuli in humans: a general linear modeling approach to EEG

Noninvasive investigation of human sensory processing with high temporal resolution typically involves repeatedly presenting discrete stimuli and extracting an average event-related response from scalp recorded neuroelectric or neuromagnetic signals. While this approach is and has been extremely useful, it suffers from two drawbacks: a lack of naturalness in terms of the stimulus and a lack of precision in terms of the cortical response generators. Here we show that a linear modeling approach that exploits functional specialization in sensory systems can be used to rapidly obtain spatiotemporally precise responses to complex sensory stimuli using electroencephalography (EEG). We demonstrate the method by example through the controlled modulation of the contrast and coherent motion of visual stimuli. Regressing the data against these modulation signals produces spatially focal, highly temporally resolved response measures that are suggestive of specific activation of visual areas V1 and V6, respectively, based on their onset latency, their topographic distribution and the estimated location of their sources. We discuss our approach by comparing it with fMRI/MRI informed source analysis methods and, in doing so, we provide novel information on the timing of coherent motion processing in human V6. Generalizing such an approach has the potential to facilitate the rapid, inexpensive spatiotemporal localization of higher perceptual functions in behaving humans.

Differential responses in dorsal visual cortex to motion and disparity depth cues

We investigated how interactions between monocular motion parallax and binocular cues to depth vary in human motion areas for wide-field visual motion stimuli (110 × 100°). We used fMRI with an extensive 2 × 3 × 2 factorial blocked design in which we combined two types of self-motion (translational motion and translational + rotational motion), with three categories of motion inflicted by the degree of noise (self-motion, distorted self-motion, and multiple object-motion), and two different view modes of the flow patterns (stereo and synoptic viewing). Interactions between disparity and motion category revealed distinct contributions to self- and object-motion processing in 3D. For cortical areas V6 and CSv, but not the anterior part of MT(+) with bilateral visual responsiveness (MT(+)/b), we found a disparity-dependent effect of rotational flow and noise: When self-motion perception was degraded by adding rotational flow and moderate levels of noise, the BOLD responses were reduced compared with translational self-motion alone, but this reduction was cancelled by adding stereo information which also rescued the subject's self-motion percept. At high noise levels, when the self-motion percept gave way to a swarm of moving objects, the BOLD signal strongly increased compared to self-motion in areas MT(+)/b and V6, but only for stereo in the latter. BOLD response did not increase for either view mode in CSv. These different response patterns indicate different contributions of areas V6, MT(+)/b, and CSv to the processing of self-motion perception and the processing of multiple independent motions.

Integration of sensory information precedes the sensation of vection: a combined behavioral and event-related brain potential (ERP) study

Illusory self-motion (known as vection) describes the sensation of ego-motion in the absence of physical movement. Vection typically occurs in stationary observers being exposed to visual information that suggest self-motion (e.g. simulators, virtual reality). In the present study, we tested whether sensory integration of visual information triggers vection: participants (N=13) perceived patterns of moving altered black-and-white vertical stripes on a screen that was divided into a central and a surrounding peripheral visual field. In both fields the pattern was either moving or stationary, resulting in four combinations of central and peripheral motions: (1) central and peripheral stripes moved into the same direction, (2) central and peripheral stripes moved in opposite directions, or (3) either the central or (4) the peripheral stripes were stable while the other stripes were in motion. This stimulation induced vection: Results showed significantly higher vection ratings when the stationary center of the pattern was surrounded by a moving periphery. Event-related potentials mirrored this finding: The occipital N2 was largest with stationary central and moving peripheral stripes. Our findings suggest that sensory integration of peripheral and central visual information triggers the perception of vection. Furthermore, we found evidence that neural processes precede the subjective perception of vection strength prior to the actual onset of vection. We will discuss our findings with respect to the role of stimulus eccentricity, stimulus' depth, and neural correlates involved during the genesis of vection.

The human homologue of macaque area V6A

In macaque monkeys, V6A is a visuomotor area located in the anterior bank of the POs, dorsal and anterior to retinotopically-organized extrastriate area V6 (Galletti et al., 1996). Unlike V6, V6A represents both contra- and ipsilateral visual fields and is broadly retinotopically organized (Galletti et al., 1999b). The contralateral lower visual field is over-represented in V6A. The central 20°-30° of the visual field is mainly represented dorsally (V6Ad) and the periphery ventrally (V6Av), at the border with V6. Both sectors of area V6A contain arm movement-related cells, active during spatially-directed reaching movements (Gamberini et al., 2011). In humans, we previously mapped the retinotopic organization of area V6 (Pitzalis et al., 2006). Here, using phase-encoded fMRI, cortical surface-based analysis and wide-field retinotopic mapping, we define a new cortical region that borders V6 anteriorly and shows a clear over-representation of the contralateral lower visual field and the periphery. As with macaque V6A, the eccentricity increases moving ventrally within the area. The new region contains a non-mirror-image representation of the visual field. Functional mapping reveals that, as in macaque V6A, the new region, but not the nearby area V6, responds during finger pointing and reaching movements. Based on similarity in position, retinotopic properties, functional organization and relationship with the neighboring extrastriate visual areas, we propose that the new cortical region is the human homologue of macaque area V6A.

Selectivity to translational egomotion in human brain motion areas

The optic flow generated when a person moves through the environment can be locally decomposed into several basic components, including radial, circular, translational and spiral motion. Since their analysis plays an important part in the visual perception and control of locomotion and posture it is likely that some brain regions in the primate dorsal visual pathway are specialized to distinguish among them. The aim of this study is to explore the sensitivity to different types of egomotion-compatible visual stimulations in the human motion-sensitive regions of the brain. Event-related fMRI experiments, 3D motion and wide-field stimulation, functional localizers and brain mapping methods were used to study the sensitivity of six distinct motion areas (V6, MT, MST+, V3A, CSv and an Intra-Parietal Sulcus motion [IPSmot] region) to different types of optic flow stimuli. Results show that only areas V6, MST+ and IPSmot are specialized in distinguishing among the various types of flow patterns, with a high response for the translational flow which was maximum in V6 and IPSmot and less marked in MST+. Given that during egomotion the translational optic flow conveys differential information about the near and far external objects, areas V6 and IPSmot likely process visual egomotion signals to extract information about the relative distance of objects with respect to the observer. Since area V6 is also involved in distinguishing object-motion from self-motion, it could provide information about location in space of moving and static objects during self-motion, particularly in a dynamically unstable environment.

The functional role of the medial motion area V6

In macaque, several visual areas are devoted to analyze motion in the visual field, and V6 is one of these areas. In macaque, area V6 occupies the ventral part of the anterior bank of the parieto-occipital sulcus (POs), is retinotopically-organized and contains a point-to-point representation of the retinal surface. V6 is a motion sensitive area that largely represents the peripheral part of the visual field and whose cells are very sensitive to translational motion. Based on the fact that macaque V6 contains many real-motion cells, it has been suggested that V6 is involved in object-motion recognition. Recently, area V6 has been recognized also in the human brain by neuroimaging and electrophysiological methods. Like macaque V6, human V6 is located in the POs, is retinotopically organized, and represents the entire contralateral hemifield up to the far periphery. Human V6, like macaque V6, is a motion area that responds to unidirectional motion. It has a strong preference for coherent motion and a recent combined VEPs/fMRI work has shown that area V6 is even one of the most early stations coding the motion coherence. Human V6 is highly sensitive to flow field and is also able to distinguish between different 3D flow fields being selective to translational egomotion. This suggests that this area processes visual egomotion signals to extract information about the relative distance of objects, likely in order to act on them, or to avoid them. The view that V6 is involved in the estimation of egomotion has been tested also in other recent fMRI studies. Thus, taken together, human and macaque data suggest that V6 is involved in both object and self-motion recognition. Specifically, V6 could be involved in "subtracting out" self-motion signals across the whole visual field and in providing information about moving objects, particularly during self-motion in a complex and dynamically unstable environment.