Human v6: the medial motion area

Common and specific activations supporting optic flow processing and navigation as revealed by a meta-analysis of neuroimaging studies

Optic flow provides useful information in service of spatial navigation. However, whether brain networks supporting these two functions overlap is still unclear. Here we used Activation Likelihood Estimation (ALE) to assess the correspondence between brain correlates of optic flow processing and spatial navigation and their specific neural activations. Since computational and connectivity evidence suggests that visual input from optic flow provides information mainly during egocentric navigation, we further tested the correspondence between brain correlates of optic flow processing and that of both egocentric and allocentric navigation. Optic flow processing shared activation with egocentric (but not allocentric) navigation in the anterior precuneus, suggesting its role in providing information about self-motion, as derived from the analysis of optic flow, in service of egocentric navigation. We further documented that optic flow perception and navigation are partially segregated into two functional and anatomical networks, i.e., the dorsal and the ventromedial networks. Present results point to a dynamic interplay between the dorsal and ventral visual pathways aimed at coordinating visually guided navigation in the environment.

A previously undescribed scene-selective site is the key to encoding ego-motion in naturalistic environments

Current models of scene processing in the human brain include three scene-selective areas: the parahippocampal place area (or the temporal place areas), the restrosplenial cortex (or the medial place area), and the transverse occipital sulcus (or the occipital place area). Here, we challenged this model by showing that at least one other scene-selective site can also be detected within the human posterior intraparietal gyrus. Despite the smaller size of this site compared to the other scene-selective areas, the posterior intraparietal gyrus scene-selective (PIGS) site was detected consistently in a large pool of subjects (n = 59; 33 females). The reproducibility of this finding was tested based on multiple criteria, including comparing the results across sessions, utilizing different scanners (3T and 7T) and stimulus sets. Furthermore, we found that this site (but not the other three scene-selective areas) is significantly sensitive to ego-motion in scenes, thus distinguishing the role of PIGS in scene perception relative to other scene-selective areas. These results highlight the importance of including finer scale scene-selective sites in models of scene processing - a crucial step toward a more comprehensive understanding of how scenes are encoded under dynamic conditions.

Is there a lower visual field advantage for object affordances? A registered report

It's been repeatedly shown that pictures of graspable objects can facilitate visual processing, even in the absence of reach-to-grasp actions, an effect often attributed to the concept of affordances. A classic demonstration of this is the handle compatibility effect, characterised by faster reaction times when the orientation of a graspable object's handle is compatible with the hand used to respond, even when the handle orientation is task-irrelevant. Nevertheless, it is debated whether the speeded reaction times are a result of affordances or spatial compatibility. First, we investigated whether we could replicate the handle compatibility effect while controlling for spatial compatibility. Participants (N = 68) responded with left or right-handed keypresses to whether the object was upright or inverted and, in separate blocks, whether the object was red or green. We failed to replicate the handle compatibility effect, with no significant difference between compatible and incompatible conditions, in both tasks. Second, we investigated whether there is a lower visual field (VF) advantage for the handle compatibility effect in line with what has been found for hand actions. A further 68 participants responded to object orientation presented either in the upper or lower VF. A significant handle compatibility effect was observed in the lower VF, but not the upper VF. This suggests that there is a lower VF advantage for affordances, possibly as the lower VF is where our actions most frequently occur. However, future studies should explore the impact of eye movements on the handle compatibility effect and tool affordances.

Perceptual transitions between object rigidity and non-rigidity: Competition and cooperation among motion energy, feature tracking, and shape-based priors

Why do moving objects appear rigid when projected retinal images are deformed non-rigidly? We used rotating rigid objects that can appear rigid or non-rigid to test whether shape features contribute to rigidity perception. When two circular rings were rigidly linked at an angle and jointly rotated at moderate speeds, observers reported that the rings wobbled and were not linked rigidly, but rigid rotation was reported at slow speeds. When gaps, paint, or vertices were added, the rings appeared rigidly rotating even at moderate speeds. At high speeds, all configurations appeared non-rigid. Salient features thus contribute to rigidity at slow and moderate speeds but not at high speeds. Simulated responses of arrays of motion-energy cells showed that motion flow vectors are predominantly orthogonal to the contours of the rings, not parallel to the rotation direction. A convolutional neural network trained to distinguish flow patterns for wobbling versus rotation gave a high probability of wobbling for the motion-energy flows. However, the convolutional neural network gave high probabilities of rotation for motion flows generated by tracking features with arrays of MT pattern-motion cells and corner detectors. In addition, circular rings can appear to spin and roll despite the absence of any sensory evidence, and this illusion is prevented by vertices, gaps, and painted segments, showing the effects of rotational symmetry and shape. Combining convolutional neural network outputs that give greater weight to motion energy at fast speeds and to feature tracking at slow speeds, with the shape-based priors for wobbling and rolling, explained rigid and non-rigid percepts across shapes and speeds (R2 = 0.95). The results demonstrate how cooperation and competition between different neuronal classes lead to specific states of visual perception and to transitions between the states.

A previously undescribed scene-selective site is the key to encoding ego-motion in naturalistic environments

Current models of scene processing in the human brain include three scene-selective areas: the Parahippocampal Place Area (or the temporal place areas; PPA/TPA), the restrosplenial cortex (or the medial place area; RSC/MPA) and the transverse occipital sulcus (or the occipital place area; TOS/OPA). Here, we challenged this model by showing that at least one other scene-selective site can also be detected within the human posterior intraparietal gyrus. Despite the smaller size of this site compared to the other scene-selective areas, the posterior intraparietal gyrus scene-selective (PIGS) site was detected consistently in a large pool of subjects (n=59; 33 females). The reproducibility of this finding was tested based on multiple criteria, including comparing the results across sessions, utilizing different scanners (3T and 7T) and stimulus sets. Furthermore, we found that this site (but not the other three scene-selective areas) is significantly sensitive to ego-motion in scenes, thus distinguishing the role of PIGS in scene perception relative to other scene-selective areas. These results highlight the importance of including finer scale scene-selective sites in models of scene processing - a crucial step toward a more comprehensive understanding of how scenes are encoded under dynamic conditions.

A previously undescribed scene-selective site is the key to encoding ego-motion in naturalistic environments

Current models of scene processing in the human brain include three scene-selective areas: the Parahippocampal Place Area (or the temporal place areas; PPA/TPA), the restrosplenial cortex (or the medial place area; RSC/MPA) and the transverse occipital sulcus (or the occipital place area; TOS/OPA). Here, we challenged this model by showing that at least one other scene-selective site can also be detected within the human posterior intraparietal gyrus. Despite the smaller size of this site compared to the other scene-selective areas, the posterior intraparietal gyrus scene-selective (PIGS) site was detected consistently in a large pool of subjects (n=59; 33 females). The reproducibility of this finding was tested based on multiple criteria, including comparing the results across sessions, utilizing different scanners (3T and 7T) and stimulus sets. Furthermore, we found that this site (but not the other three scene-selective areas) is significantly sensitive to ego-motion in scenes, thus distinguishing the role of PIGS in scene perception relative to other scene-selective areas. These results highlight the importance of including finer scale scene-selective sites in models of scene processing - a crucial step toward a more comprehensive understanding of how scenes are encoded under dynamic conditions.

Neural sensitivity to translational self- and object-motion velocities

The ability to detect and assess world-relative object-motion is a critical computation performed by the visual system. This computation, however, is greatly complicated by the observer's movements, which generate a global pattern of motion on the observer's retina. How the visual system implements this computation is poorly understood. Since we are potentially able to detect a moving object if its motion differs in velocity (or direction) from the expected optic flow generated by our own motion, here we manipulated the relative motion velocity between the observer and the object within a stationary scene as a strategy to test how the brain accomplishes object-motion detection. Specifically, we tested the neural sensitivity of brain regions that are known to respond to egomotion-compatible visual motion (i.e., egomotion areas: cingulate sulcus visual area, posterior cingulate sulcus area, posterior insular cortex [PIC], V6+, V3A, IPSmot/VIP, and MT+) to a combination of different velocities of visually induced translational self- and object-motion within a virtual scene while participants were instructed to detect object-motion. To this aim, we combined individual surface-based brain mapping, task-evoked activity by functional magnetic resonance imaging, and parametric and representational similarity analyses. We found that all the egomotion regions (except area PIC) responded to all the possible combinations of self- and object-motion and were modulated by the self-motion velocity. Interestingly, we found that, among all the egomotion areas, only MT+, V6+, and V3A were further modulated by object-motion velocities, hence reflecting their possible role in discriminating between distinct velocities of self- and object-motion. We suggest that these egomotion regions may be involved in the complex computation required for detecting scene-relative object-motion during self-motion.

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Perceptual Transitions between Object Rigidity & Non-rigidity: Competition and cooperation between motion-energy, feature-tracking and shape-based priors

Why do moving objects appear rigid when projected retinal images are deformed non-rigidly? We used rotating rigid objects that can appear rigid or non-rigid to test whether shape features contribute to rigidity perception. When two circular rings were rigidly linked at an angle and jointly rotated at moderate speeds, observers reported that the rings wobbled and were not linked rigidly but rigid rotation was reported at slow speeds. When gaps, paint or vertices were added, the rings appeared rigidly rotating even at moderate speeds. At high speeds, all configurations appeared non-rigid. Salient features thus contribute to rigidity at slow and moderate speeds, but not at high speeds. Simulated responses of arrays of motion-energy cells showed that motion flow vectors are predominantly orthogonal to the contours of the rings, not parallel to the rotation direction. A convolutional neural network trained to distinguish flow patterns for wobbling versus rotation, gave a high probability of wobbling for the motion-energy flows. However, the CNN gave high probabilities of rotation for motion flows generated by tracking features with arrays of MT pattern-motion cells and corner detectors. In addition, circular rings can appear to spin and roll despite the absence of any sensory evidence, and this illusion is prevented by vertices, gaps, and painted segments, showing the effects of rotational symmetry and shape. Combining CNN outputs that give greater weight to motion energy at fast speeds and to feature tracking at slow, with the shape-based priors for wobbling and rolling, explained rigid and nonrigid percepts across shapes and speeds (R2=0.95). The results demonstrate how cooperation and competition between different neuronal classes leads to specific states of visual perception and to transitions between the states.

Functional organization of the caudal part of the human superior parietal lobule

Like in macaque, the caudal portion of the human superior parietal lobule (SPL) plays a key role in a series of perceptive, visuomotor and somatosensory processes. Here, we review the functional properties of three separate portions of the caudal SPL, i.e., the posterior parieto-occipital sulcus (POs), the anterior POs, and the anterior part of the caudal SPL. We propose that the posterior POs is mainly dedicated to the analysis of visual motion cues useful for object motion detection during self-motion and for spatial navigation, while the more anterior parts are implicated in visuomotor control of limb actions. The anterior POs is mainly involved in using the spotlight of attention to guide reach-to-grasp hand movements, especially in dynamic environments. The anterior part of the caudal SPL plays a central role in visually guided locomotion, being implicated in controlling leg-related movements as well as the four limbs interaction with the environment, and in encoding egomotion-compatible optic flow. Together, these functions reveal how the caudal SPL is strongly implicated in skilled visually-guided behaviors.

Variability of visual field maps in human early extrastriate cortex challenges the canonical model of organization of V2 and V3

Visual field maps in human early extrastriate areas (V2 and V3) are traditionally thought to form mirror-image representations which surround the primary visual cortex (V1). According to this scheme, V2 and V3 form nearly symmetrical halves with respect to the calcarine sulcus, with the dorsal halves representing lower contralateral quadrants, and the ventral halves representing upper contralateral quadrants. This arrangement is considered to be consistent across individuals, and thus predictable with reasonable accuracy using templates. However, data that deviate from this expected pattern have been observed, but mainly treated as artifactual. Here, we systematically investigate individual variability in the visual field maps of human early visual cortex using the 7T Human Connectome Project (HCP) retinotopy dataset. Our results demonstrate substantial and principled inter-individual variability. Visual field representation in the dorsal portions of V2 and V3 was more variable than in their ventral counterparts, including substantial departures from the expected mirror-symmetrical patterns. In addition, left hemisphere retinotopic maps were more variable than those in the right hemisphere. Surprisingly, only one-third of individuals had maps that conformed to the expected pattern in the left hemisphere. Visual field sign analysis further revealed that in many individuals the area conventionally identified as dorsal V3 shows a discontinuity in the mirror-image representation of the retina, associated with a Y-shaped lower vertical representation. Our findings challenge the current view that inter-individual variability in early extrastriate cortex is negligible, and that the dorsal portions of V2 and V3 are roughly mirror images of their ventral counterparts.

Pathway and directional specificity of Hebbian plasticity in the cortical visual motion processing network

Cortico-cortical paired associative stimulation (ccPAS), which repeatedly pairs single-pulse transcranial magnetic stimulation (TMS) over two distant brain regions, is thought to modulate synaptic plasticity. We explored its spatial selectivity (pathway and direction specificity) and its nature (oscillatory signature and perceptual consequences) when applied along the ascending (Forward) and descending (Backward) motion discrimination pathway. We found unspecific connectivity increases in bottom-up inputs in the low gamma band, probably reflecting visual task exposure. A clear distinction in information transfer occurred in the re-entrant alpha signals, which were only modulated by Backward-ccPAS, and predictive of visual improvements in healthy participants. These results suggest a causal involvement of the re-entrant MT-to-V1 low-frequency inputs in motion discrimination and integration in healthy participants. Modulating re-entrant input activity could provide single-subject prediction scenarios for visual recovery. Visual recovery might indeed partly rely on these residual inputs projecting to spared V1 neurons.

Neural correlates of visual and tactile path integration and their task related modulation

Self-motion induces sensory signals that allow to determine travel distance (path integration). For veridical path integration, one must distinguish self-generated from externally induced sensory signals. Predictive coding has been suggested to attenuate self-induced sensory responses, while task relevance can reverse the attenuating effect of prediction. But how is self-motion processing affected by prediction and task demands, and do effects generalize across senses? In this fMRI study, we investigated visual and tactile self-motion processing and its modulation by task demands. Visual stimuli simulated forward self-motion across a ground plane. Tactile self-motion stimuli were delivered by airflow across the subjects' forehead. In one task, subjects replicated a previously observed distance (Reproduction/Active; high behavioral demand) of passive self-displacement (Reproduction/Passive). In a second task, subjects travelled a self-chosen distance (Self/Active; low behavioral demand) which was recorded and played back to them (Self/Passive). For both tasks and sensory modalities, Active as compared to Passive trials showed enhancement in early visual areas and suppression in higher order areas of the inferior parietal lobule (IPL). Contrasting high and low demanding active trials yielded supramodal enhancement in the anterior insula. Suppression in the IPL suggests this area to be a comparator of sensory self-motion signals and predictions thereof.

Activation of human visual area V6 during egocentric navigation with and without visual experience

V6 is a retinotopic area located in the dorsal visual stream that integrates eye movements with retinal and visuo-motor signals. Despite the known role of V6 in visual motion, it is unknown whether it is involved in navigation and how sensory experiences shape its functional properties. We explored the involvement of V6 in egocentric navigation in sighted and in congenitally blind (CB) participants navigating via an in-house distance-to-sound sensory substitution device (SSD), the EyeCane. We performed two fMRI experiments on two independent datasets. In the first experiment, CB and sighted participants navigated the same mazes. The sighted performed the mazes via vision, while the CB performed them via audition. The CB performed the mazes before and after a training session, using the EyeCane SSD. In the second experiment, a group of sighted participants performed a motor topography task. Our results show that right V6 (rhV6) is selectively involved in egocentric navigation independently of the sensory modality used. Indeed, after training, rhV6 of CB is selectively recruited for auditory navigation, similarly to rhV6 in the sighted. Moreover, we found activation for body movement in area V6, which can putatively contribute to its involvement in egocentric navigation. Taken together, our findings suggest that area rhV6 is a unique hub that transforms spatially relevant sensory information into an egocentric representation for navigation. While vision is clearly the dominant modality, rhV6 is in fact a supramodal area that can develop its selectivity for navigation in the absence of visual experience.

A Large Video Set of Natural Human Actions for Visual and Cognitive Neuroscience Studies and Its Validation with fMRI

The investigation of the perception of others' actions and underlying neural mechanisms has been hampered by the lack of a comprehensive stimulus set covering the human behavioral repertoire. To fill this void, we present a video set showing 100 human actions recorded in natural settings, covering the human repertoire except for emotion-driven (e.g., sexual) actions and those involving implements (e.g., tools). We validated the set using fMRI and showed that observation of the 100 actions activated the well-established action observation network. We also quantified the videos' low-level visual features (luminance, optic flow, and edges). Thus, this comprehensive video set is a valuable resource for perceptual and neuronal studies.

The human egomotion network

All volitional movement in a three-dimensional space requires multisensory integration, in particular of visual and vestibular signals. Where and how the human brain processes and integrates self-motion signals remains enigmatic. Here, we applied visual and vestibular self-motion stimulation using fast and precise whole-brain neuroimaging to delineate and characterize the entire cortical and subcortical egomotion network in a substantial cohort (n=131). Our results identify a core egomotion network consisting of areas in the cingulate sulcus (CSv, PcM/pCi), the cerebellum (uvula), and the temporo-parietal cortex including area VPS and an unnamed region in the supramarginal gyrus. Based on its cerebral connectivity pattern and anatomical localization, we propose that this region represents the human homologue of macaque area 7a. Whole-brain connectivity and gradient analyses imply an essential role of the connections between the cingulate sulcus and the cerebellar uvula in egomotion perception. This could be via feedback loops involved updating visuo-spatial and vestibular information. The unique functional connectivity patterns of PcM/pCi hint at central role in multisensory integration essential for the perception of self-referential spatial awareness. All cortical egomotion hubs showed modular functional connectivity with other visual, vestibular, somatosensory and higher order motor areas, underlining their mutual function in general sensorimotor integration.

The human middle temporal cortex responds to both active leg movements and egomotion-compatible visual motion

The human middle-temporal region MT+ is highly specialized in processing visual motion. However, recent studies have shown that this region is modulated by extraretinal signals, suggesting a possible involvement in processing motion information also from non-visual modalities. Here, we used functional MRI data to investigate the influence of retinal and extraretinal signals on MT+ in a large sample of subjects. Moreover, we used resting-state functional MRI to assess how the subdivisions of MT+ (i.e., MST, FST, MT, and V4t) are functionally connected. We first compared responses in MST, FST, MT, and V4t to coherent vs. random visual motion. We found that only MST and FST were positively activated by coherent motion. Furthermore, regional analyses revealed that MST and FST were positively activated by leg, but not arm, movements, while MT and V4t were deactivated by arm, but not leg, movements. Taken together, regional analyses revealed a visuomotor role for the anterior areas MST and FST and a pure visual role for the anterior areas MT and V4t. These findings were mirrored by the pattern of functional connections between these areas and the rest of the brain. Visual and visuomotor regions showed distinct patterns of functional connectivity, with the latter preferentially connected with the somatosensory and motor areas representing leg and foot. Overall, these findings reveal a functional sensitivity for coherent visual motion and lower-limb movements in MST and FST, suggesting their possible involvement in integrating sensory and motor information to perform locomotion.

Egomotion-related visual areas respond to goal-directed movements

Integration of proprioceptive signals from the various effectors with visual feedback of self-motion from the retina is necessary for whole-body movement and locomotion. Here, we tested whether the human visual motion areas involved in processing optic flow signals simulating self-motion are also activated by goal-directed movements (as saccades or pointing) performed with different effectors (eye, hand, and foot), suggesting a role in visually guiding movements through the external environment. To achieve this aim, we used a combined approach of task-evoked activity and effective connectivity (PsychoPhysiological Interaction, PPI) by fMRI. We localized a set of six egomotion-responsive visual areas through the flow field stimulus and distinguished them into visual (pIPS/V3A, V6+ , IPSmot/VIP) and visuomotor (pCi, CSv, PIC) areas according to recent literature. We tested their response to a visuomotor task implying spatially directed delayed eye, hand, and foot movements. We observed a posterior-to-anterior gradient of preference for eye-to-foot movements, with posterior (visual) regions showing a preference for saccades, and anterior (visuomotor) regions showing a preference for foot pointing. No region showed a clear preference for hand pointing. Effective connectivity analysis showed that visual areas were more connected to each other with respect to the visuomotor areas, particularly during saccades. We suggest that visual and visuomotor egomotion regions can play different roles within a network that integrates sensory-motor signals with the aim of guiding movements in the external environment.

Topological Maps and Brain Computations From Low to High

We first briefly summarize data from microelectrode studies on visual maps in non-human primates and other mammals, and characterize differences among the features of the approximately topological maps in the three main sensory modalities. We then explore the almost 50% of human neocortex that contains straightforward topological visual, auditory, and somatomotor maps by presenting a new parcellation as well as a movie atlas of cortical area maps on the FreeSurfer average surface, fsaverage. Third, we review data on moveable map phenomena as well as a recent study showing that cortical activity during sensorimotor actions may involve spatially locally coherent traveling wave and bump activity. Finally, by analogy with remapping phenomena and sensorimotor activity, we speculate briefly on the testable possibility that coherent localized spatial activity patterns might be able to ‘escape’ from topologically mapped cortex during ‘serial assembly of content’ operations such as scene and language comprehension, to form composite ‘molecular’ patterns that can move across some cortical areas and possibly return to topologically mapped cortex to generate motor output there.

The retrocalcarine sulcus maps different retinotopic representations in macaques and humans

Primate cerebral cortex is highly convoluted with much of the cortical surface buried in sulcal folds. The origins of cortical folding and its functional relevance have been a major focus of systems and cognitive neuroscience, especially when considering stereotyped patterns of cortical folding that are shared across individuals within a primate species and across multiple species. However, foundational questions regarding organizing principles shared across species remain unanswered. Taking a cross-species comparative approach with a careful consideration of historical observations, we investigate cortical folding relative to primary visual cortex (area V1). We identify two macroanatomical structures-the retrocalcarine and external calcarine sulci-in 24 humans and 6 macaque monkeys. We show that within species, these sulci are identifiable in all individuals, fall on a similar part of the V1 retinotopic map, and thus, serve as anatomical landmarks predictive of functional organization. Yet, across species, the underlying eccentricity representations corresponding to these macroanatomical structures differ strikingly across humans and macaques. Thus, the correspondence between retinotopic representation and cortical folding for an evolutionarily old structure like V1 is species-specific and suggests potential differences in developmental and experiential constraints across primates.

Multisensory integration in cortical regions responding to locomotion-related visual and somatomotor signals

During real-world locomotion, in order to be able to move along a path or avoid an obstacle, continuous changes in self-motion direction (i.e. heading) are needed. Control of heading changes during locomotion requires the integration of multiple signals (i.e., visual, somatomotor, vestibular). Recent fMRI studies have shown that both somatomotor areas (human PEc [hPEc], human PE [hPE], primary somatosensory cortex [S-I]) and egomotion visual regions (cingulate sulcus visual area [CSv], posterior cingulate area [pCi], posterior insular cortex [PIC]) respond to either leg movements and egomotion-compatible visual stimulations, suggesting a role in the analysis of both visual attributes of egomotion and somatomotor signals with the aim of guiding locomotion. However, whether these regions are able to integrate egomotion-related visual signals with somatomotor inputs coming from leg movements during heading changes remains an open question. Here we used a combined approach of individual functional localizers and task-evoked activity by fMRI. In thirty subjects we first localized three egomotion areas (CSv, pCi, PIC) and three somatomotor regions (S-I, hPE, hPEc). Then, we tested their responses in a multisensory integration experiment combining visual and somatomotor signals relevant to locomotion in congruent or incongruent trials. We used an fMR-adaptation paradigm to explore the sensitivity to the repeated presentation of these bimodal stimuli in the six regions of interest. Results revealed that hPE, S-I and CSv showed an adaptation effect regardless of congruency, while PIC, pCi and hPEc showed sensitivity to congruency. PIC exhibited a preference for congruent trials compared to incongruent trials. Areas pCi and hPEc exhibited an adaptation effect only for congruent and incongruent trials, respectively. PIC, pCi and hPEc sensitivity to the congruency relationship between visual (locomotion-compatible) cues and (leg-related) somatomotor inputs suggests that these regions are involved in multisensory integration processes, likely in order to guide/adjust leg movements during heading changes.

Visual Cortical Area MT Is Required for Development of the Dorsal Stream and Associated Visuomotor Behaviors

The middle temporal (MT) area of the extrastriate visual cortex has long been studied in adulthood for its distinctive physiological properties and function as a part of the dorsal stream, yet interestingly it possesses a similar maturation profile as the primary visual cortex (V1). Here, we examined whether an early-life lesion in MT of marmoset monkeys (six female, two male) altered the dorsal stream development and the behavioral precision of reaching-to-grasp sequences. We observed permanent changes in the anatomy of cortices associated with both reaching (parietal and medial intraparietal areas) and grasping (anterior intraparietal area), as well as in reaching-and-grasping behaviors. In addition, we observed a significant impact on the anatomy of V1 and the direction sensitivity of V1 neurons in the lesion projection zone. These findings indicate that area MT is a crucial node in the development of primate vision, affecting both V1 and areas in the dorsal visual pathway known to mediate visually guided manual behaviors.SIGNIFICANCE STATEMENT Previous studies have identified a role for the MT area of the visual cortex in perceiving motion, yet none have examined its central role in the development of the visual cortex and in the establishment of visuomotor behaviors. To address this, we used a unilateral MT lesion model in neonatal marmosets before examining the anatomic, physiological, and behavioral consequences. In adulthood, we observed perturbations in goal-orientated reach-and-grasp behavior, altered direction selectivity of V1 neurons, and changes in the cytoarchitecture throughout dorsal stream areas. This study highlights the importance of MT as a central node in visual system development and consequential visuomotor activity.

Vision for action: thalamic and cortical inputs to the macaque superior parietal lobule

The dorsal visual stream, the cortical circuit that in the primate brain is mainly dedicated to the visual control of actions, is split into two routes, a lateral and a medial one, both involved in coding different aspects of sensorimotor control of actions. The lateral route, named "lateral grasping network", is mainly involved in the control of the distal part of prehension, namely grasping and manipulation. The medial route, named "reach-to-grasp network", is involved in the control of the full deployment of prehension act, from the direction of arm movement to the shaping of the hand according to the object to be grasped. In macaque monkeys, the reach-to-grasp network (the target of this review) includes areas of the superior parietal lobule (SPL) that hosts visual and somatosensory neurons well suited to control goal-directed limb movements toward stationary as well as moving objects. After a brief summary of the neuronal functional properties of these areas, we will analyze their cortical and thalamic inputs thanks to retrograde neuronal tracers separately injected into the SPL areas V6, V6A, PEc, and PE. These areas receive visual and somatosensory information distributed in a caudorostral, visuosomatic trend, and some of them are directly connected with the dorsal premotor cortex. This review is particularly focused on the origin and type of visual information reaching the SPL, and on the functional role this information can play in guiding limb interaction with objects in structured and dynamic environments.

Cortical visual area CSv as a cingulate motor area: a sensorimotor interface for the control of locomotion

The response properties, connectivity and function of the cingulate sulcus visual area (CSv) are reviewed. Cortical area CSv has been identified in both human and macaque brains. It has similar response properties and connectivity in the two species. It is situated bilaterally in the cingulate sulcus close to an established group of medial motor/premotor areas. It has strong connectivity with these areas, particularly the cingulate motor areas and the supplementary motor area, suggesting that it is involved in motor control. CSv is active during visual stimulation but only if that stimulation is indicative of self-motion. It is also active during vestibular stimulation and connectivity data suggest that it receives proprioceptive input. Connectivity with topographically organized somatosensory and motor regions strongly emphasizes the legs over the arms. Together these properties suggest that CSv provides a key interface between the sensory and motor systems in the control of locomotion. It is likely that its role involves online control and adjustment of ongoing locomotory movements, including obstacle avoidance and maintaining the intended trajectory. It is proposed that CSv is best seen as part of the cingulate motor complex. In the human case, a modification of the influential scheme of Picard and Strick (Picard and Strick, Cereb Cortex 6:342–353, 1996) is proposed to reflect this.

Optic flow selectivity in the macaque parieto-occipital sulcus

In humans, several neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates higher-level motion areas, like V6 and the cingulate sulcus visual area (CSv). In macaque, there are few studies on the sensitivity of V6 and CSv to egomotion compatible optic flow. The only fMRI study on this issue revealed selectivity to egomotion compatible optic flow in macaque CSv but not in V6 (Cotterau et al. Cereb Cortex 27(1):330-343, 2017, but see Fan et al. J Neurosci. 35:16303-16314, 2015). Yet, it is unknown whether monkey visual motion areas MT + and V6 display any distinctive fMRI functional profile relative to the optic flow stimulation, as it is the case for the homologous human areas (Pitzalis et al., Cereb Cortex 20(2):411-424, 2010). Here, we described the sensitivity of the monkey brain to two motion stimuli (radial rings and flow fields) originally used in humans to functionally map the motion middle temporal area MT + (Tootell et al. J Neurosci 15: 3215-3230, 1995a; Nature 375:139-141, 1995b) and the motion medial parietal area V6 (Pitzalis et al. 2010), respectively. In both animals, we found regions responding only to optic flow or radial rings stimulation, and regions responding to both stimuli. A region in the parieto-occipital sulcus (likely including V6) was one of the most highly selective area for coherently moving fields of dots, further demonstrating the power of this type of stimulation to activate V6 in both humans and monkeys. We did not find any evidence that putative macaque CSv responds to Flow Fields.

Aberrant visual population receptive fields in human albinism

Retinotopic organization is a fundamental feature of visual cortex thought to play a vital role in encoding spatial information. One important aspect of normal retinotopy is the representation of the right and left hemifields in contralateral visual cortex. However, in human albinism, many temporal retinal afferents decussate aberrantly at the optic chiasm resulting in partially superimposed representations of opposite hemifields in each hemisphere of visual cortex. Previous functional magnetic resonance imaging (fMRI) studies in human albinism suggest that the right and left hemifield representations are superimposed in a mirror-symmetric manner. This should produce imaging voxels which respond to two separate locations mirrored across the vertical meridian. However, it is not yet clear how retino-cortical miswiring in albinism manifests at the level of single voxel population receptive fields (pRFs). Here, we used pRF modeling to fit both single and dual pRF models to the visual responses of voxels in visual areas V1 to V3 of five subjects with albinism. We found that subjects with albinism (but not controls) have sizable clusters of voxels with unequivocal dual pRFs consistently corresponding to, but not fully coextensive with, regions of hemifield overlap. These dual pRFs were typically positioned at locations roughly mirrored across the vertical meridian and were uniquely clustered within a portion of the visual field for each subject.

Functional Connectivity in Developmental Dyslexia during Speed Discrimination

A universal signature of developmental dyslexia is literacy acquisition impairments. Besides, dyslexia may be related to deficits in selective spatial attention, in the sensitivity to global visual motion, speed processing, oculomotor coordination, and integration of auditory and visual information. Whether motion-sensitive brain areas of children with dyslexia can recognize different speeds of expanded optic flow and segregate the slow-speed from high-speed contrast of motion was a main question of the study. A combined event-related EEG experiment with optic flow visual stimulation and functional frequency-based graph approach (small-world propensity ϕ) were applied to research the responsiveness of areas, which are sensitive to motion, and also distinguish slow/fast -motion conditions on three groups of children: controls, untrained (pre-D) and trained dyslexics (post-D) with visual intervention programs. Lower ϕ at θ, α, γ1-frequencies (low-speed contrast) for controls than other groups represent that the networks rewire, expressed at β frequencies (both speed contrasts) in the post-D, whose network was most segregated. Functional connectivity nodes have not existed in pre-D at dorsal medial temporal area MT+/V5 (middle, superior temporal gyri), left-hemispheric middle occipital gyrus/visual V2, ventral occipitotemporal (fusiform gyrus/visual V4), ventral intraparietal (supramarginal, angular gyri), derived from θ-frequency network for both conditions. After visual training, compensatory mechanisms appeared to implicate/regain these brain areas in the left hemisphere through plasticity across extended brain networks. Specifically, for high-speed contrast, the nodes were observed in pre-D (θ-frequency) and post-D (β2-frequency) relative to controls in hyperactivity of the right dorsolateral prefrontal cortex, which might account for the attentional network and oculomotor control impairments in developmental dyslexia.

Activity Strength within Optic Flow-Sensitive Cortical Regions Is Associated with Visual Path Integration Accuracy in Aged Adults

Spatial navigation is a cognitive skill fundamental to successful interaction with our environment, and aging is associated with weaknesses in this skill. Identifying mechanisms underlying individual differences in navigation ability in aged adults is important to understanding these age-related weaknesses. One understudied factor involved in spatial navigation is self-motion perception. Important to self-motion perception is optic flow–the global pattern of visual motion experienced while moving through our environment. A set of optic flow-sensitive (OF-sensitive) cortical regions was defined in a group of young (n = 29) and aged (n = 22) adults. Brain activity was measured in this set of OF-sensitive regions and control regions using functional magnetic resonance imaging while participants performed visual path integration (VPI) and turn counting (TC) tasks. Aged adults had stronger activity in RMT+ during both tasks compared to young adults. Stronger activity in the OF-sensitive regions LMT+ and RpVIP during VPI, not TC, was associated with greater VPI accuracy in aged adults. The activity strength in these two OF-sensitive regions measured during VPI explained 42% of the variance in VPI task performance in aged adults. The results of this study provide novel support for global motion processing as a mechanism underlying visual path integration in normal aging.

Preference for locomotion-compatible curved paths and forward direction of self-motion in somatomotor and visual areas

During locomotion, leg movements define the direction of walking (forward or backward) and the path one is taking (straight or curved). These aspects of locomotion produce characteristic visual motion patterns during movement. Here, we tested whether cortical regions responding to either egomotion-compatible visual motion, or leg movements, or both, are sensitive to these locomotion-relevant aspects of visual motion. We compared a curved path (typically the visual feedback of a changing direction of movement in the environment) to a linear path for simulated forward and backward motion in an event-related fMRI experiment. We used an individual surface-based approach and two functional localizers to define (1) six egomotion-related areas (V6+, V3A, intraparietal motion area [IPSmot], cingulate sulcus visual area [CSv], posterior cingulate area [pCi], posterior insular cortex [PIC]) using the flow field stimulus and (2) three leg-related cortical regions (human PEc [hPEc], human PE [hPE] and primary somatosensory cortex [S-I]) using a somatomotor task. Then, we extracted the response from all these regions with respect to the main event-related fMRI experiment, consisting of passive viewing of an optic flow stimulus, simulating a forward or backward direction of self-motion in either linear or curved path. Results showed that some regions have a significant preference for the curved path motion (hPEc, hPE, S-I, IPSmot) or a preference for the forward motion (V3A), while other regions have both a significant preference for the curved path motion and for the forward compared to backward motion (V6+, CSv, pCi). We did not find any significant effects of the present stimuli in PIC. Since controlling locomotion mainly means controlling changes of walking direction in the environment during forward self-motion, such a differential functional profile among these cortical regions suggests that they play a differentiated role in the visual guidance of locomotion.

Electroencephalographic Study on Sensory Integration in Visually Induced Postural Sway

A periodically reversing optic flow animation, experienced while standing, induces an involuntary sway termed visually induced postural sway (VIPS). Interestingly, VIPS is suppressed during light finger touch to a stationary object. Here, we explored whether VIPS is mediated by parietal field activity in the dorsal visual stream as well as by activity in early visual areas, as has been suggested. We performed a mobile brain/body imaging study using high-density electroencephalographic recording from human participants (11 men and 3 women) standing during exposure to periodically reversing optic flow with and without light finger touch to a stable surface. We also performed recording their visuo-postural tracking movements as a typical visually guided movement to explore differences of cortical process of VIPS from the voluntary visuomotor process involving the dorsal stream. In the visuo-postural tracking condition, the participants moved their center of pressure in time with a slowly oscillating (expanding, shrinking) target rectangle. Source-resolved results showed that alpha band (8-13 Hz) activity in the medial and right occipital cortex during VIPS was modulated by the direction and velocity of optic flow and increased significantly during light finger touch. However, source-resolved potentials from the parietal association cortex showed no such modulation. During voluntary postural sway with feedback (but no visual flow) in which the dorsal stream is involved, sensorimotor areas produced more theta band (4-7 Hz) and less beta band (14-35 Hz) activity than during involuntary VIPS. These results suggest that VIPS involves cortical field dynamic changes in the early visual cortex rather than in the posterior parietal cortex of the visual dorsal stream.

Neuronal Encoding of Multisensory Motion Features in the Rat Associative Parietal Cortex

Motion perception is facilitated by the interplay of various sensory channels. In rodents, the cortical areas involved in multisensory motion coding remain to be identified. Using voltage-sensitive-dye imaging, we revealed a visuo-tactile convergent region that anatomically corresponds to the associative parietal cortex (APC). Single unit responses to moving visual gratings or whiskers deflections revealed a specific coding of motion characteristics strikingly found in both sensory modalities. The heteromodality of this region was further supported by a large proportion of bimodal neurons and by a classification procedure revealing that APC carries information about motion features, sensory origin and multisensory direction-congruency. Altogether, the results point to a central role of APC in multisensory integration for motion perception.

Pitting optic flow, object motion, and biological motion against each other

Heading estimation from optic flow is crucial for safe locomotion but becomes inaccurate if independent object motion is present. In ecological settings, such motion typically involves other animals or humans walking across the scene. An independently walking person presents a local disturbance of the flow field, which moves across the flow field as the walker traverses the scene. Is the bias in heading estimation produced by the local disturbance of the flow field or by the movement of the walker through the scene? We present a novel flow field stimulus in which the local flow disturbance and the movement of the walker can be pitted against each other. Each frame of this stimulus consists of a structureless random dot distribution. Across frames, the body shape of a walker is molded by presenting different flow field dynamics within and outside the body shape. In different experimental conditions, the flow within the body shape can be congruent with the walker's movement, incongruent with it, or congruent with the background flow. We show that heading inaccuracy results from the local flow disturbance rather than the movement through the scene. Moreover, we show that the local disturbances of the optic flow can be used to segment the walker and support biological motion perception to some degree. The dichotomous result that the walker can be segmented from the scene but that heading perception is nonetheless influenced by the flow produced by the walker confirms separate visual pathways for heading estimation, object segmentation, and biological motion perception.

Disrupted neural signals in patients with concomitant exotropia

PURPOSE

Decreased binocular and oculomotor function in strabismics has recently been considered as cortical in origin. This study aimed to investigate functional abnormalities using a frequency-specific neuroimaging method in patients with concomitant exotropia (XT), and to demonstrate the clinical implications.

METHODS

Resting-state functional magnetic resonance imaging data were collected in 26 XT patients and 26 matched controls. To evaluate the local spontaneous neural activity, the amplitude of low frequency fluctuations (ALFF) was calculated in the typical frequency band (0.01-0.08 Hz) as well as five narrowly-defined frequency bands (slow-6: 0-0.01 Hz, slow-5: 0.01-0.027 Hz, slow-4: 0.027-0.073 Hz, slow-3: 0.073-0.167 Hz, and slow-2: 0.167-0.25 Hz), respectively.

RESULTS

Patients with XT showed decreased ALFF in the bilateral parieto-occipital sulcus (POS), and increased ALFF in the bilateral thalamus within the typical frequency band. Frequency-dependent ALFF alterations were found in the higher visual areas such as the right lateral occipital complex (LOC). Furthermore, ALFF in the right LOC in the slow-5 band was positively correlated with fusion control score (r = 0.70, p < 0.0001) and binocular function score (r = 0.67, p = 0.0002). Regression analyses showed that early age of onset remained the only significant explanatory factor for ALFF reduction in the right POS in the typically-measured frequency band (also referred to as the typical frequency band) (Odds ratio, 0.038; 95% confidence interval, 0.001 to 0.075).

CONCLUSIONS

Our findings provide spatial information regarding the functionally disrupted regions in XT. Moreover, the frequency-dependent ALLF alteration in the right LOC might reflect a potential plastic capacity in binocular function, which could be a potential objective index for evaluating disease severity.

A common neural substrate for processing scenes and egomotion-compatible visual motion

Neuroimaging studies have revealed two separate classes of category-selective regions specialized in optic flow (egomotion-compatible) processing and in scene/place perception. Despite the importance of both optic flow and scene/place recognition to estimate changes in position and orientation within the environment during self-motion, the possible functional link between egomotion- and scene-selective regions has not yet been established. Here we reanalyzed functional magnetic resonance images from a large sample of participants performing two well-known “localizer” fMRI experiments, consisting in passive viewing of navigationally relevant stimuli such as buildings and places (scene/place stimulus) and coherently moving fields of dots simulating the visual stimulation during self-motion (flow fields). After interrogating the egomotion-selective areas with respect to the scene/place stimulus and the scene-selective areas with respect to flow fields, we found that the egomotion-selective areas V6+ and pIPS/V3A responded bilaterally more to scenes/places compared to faces, and all the scene-selective areas (parahippocampal place area or PPA, retrosplenial complex or RSC, and occipital place area or OPA) responded more to egomotion-compatible optic flow compared to random motion. The conjunction analysis between scene/place and flow field stimuli revealed that the most important focus of common activation was found in the dorsolateral parieto-occipital cortex, spanning the scene-selective OPA and the egomotion-selective pIPS/V3A. Individual inspection of the relative locations of these two regions revealed a partial overlap and a similar response profile to an independent low-level visual motion stimulus, suggesting that OPA and pIPS/V3A may be part of a unique motion-selective complex specialized in encoding both egomotion- and scene-relevant information, likely for the control of navigation in a structured environment.

Neural activity underlying the detection of an object movement by an observer during forward self-motion: Dynamic decoding and temporal evolution of directional cortical connectivity

Relatively little is known about how the human brain identifies movement of objects while the observer is also moving in the environment. This is, ecologically, one of the most fundamental motion processing problems, critical for survival. To study this problem, we used a task which involved nine textured spheres moving in depth, eight simulating the observer's forward motion while the ninth, the target, moved independently with a different speed towards or away from the observer. Capitalizing on the high temporal resolution of magnetoencephalography (MEG) we trained a Support Vector Classifier (SVC) using the sensor-level data to identify correct and incorrect responses. Using the same MEG data, we addressed the dynamics of cortical processes involved in the detection of the independently moving object and investigated whether we could obtain confirmatory evidence for the brain activity patterns used by the classifier. Our findings indicate that response correctness could be reliably predicted by the SVC, with the highest accuracy during the blank period after motion and preceding the response. The spatial distribution of the areas critical for the correct prediction was similar but not exclusive to areas underlying the evoked activity. Importantly, SVC identified frontal areas otherwise not detected with evoked activity that seem to be important for the successful performance in the task. Dynamic connectivity further supported the involvement of frontal and occipital-temporal areas during the task periods. This is the first study to dynamically map cortical areas using a fully data-driven approach in order to investigate the neural mechanisms involved in the detection of moving objects during observer's self-motion.

Cytoarchitectonic segregation of human posterior intraparietal and adjacent parieto-occipital sulcus and its relation to visuomotor and cognitive functions

Human posterior intraparietal sulcus (pIPS) and adjacent posterior wall of parieto-occipital sulcus (POS) are functionally diverse, serving higher motor, visual and cognitive functions. Its microstructural basis, though, is still largely unknown. A similar or even more pronounced architectonical complexity, as described in monkeys, could be assumed. We cytoarchitectonically mapped the pIPS/POS in 10 human postmortem brains using an observer-independent, quantitative parcellation. 3D-probability maps were generated within MNI reference space and used for functional decoding and meta-analytic coactivation modeling based on the BrainMap database to decode the general structural–functional organization of the areas. Seven cytoarchitectonically distinct areas were identified: five within human pIPS, three on its lateral (hIP4-6) and two on its medial wall (hIP7-8); and two (hPO1, hOc6) in POS. Mediocaudal areas (hIP7, hPO1) were predominantly involved in visual processing, whereas laterorostral areas (hIP4-6, 8) were associated with higher cognitive functions, e.g. counting. This shift was mirrored by systematic changes in connectivity, from temporo-occipital to premotor and prefrontal cortex, and in cytoarchitecture, from prominent Layer IIIc pyramidal cells to homogeneous neuronal distribution. This architectonical mosaic within human pIPS/POS represents a structural basis of its functional and connectional heterogeneity. The new 3D-maps of the areas enable dedicated assessments of structure–function relationships.

Integration of Motion and Form Cues for the Perception of Self-Motion in the Human Brain

When moving around in the world, the human visual system uses both motion and form information to estimate the direction of self-motion (i.e., heading). However, little is known about cortical areas in charge of this task. This brain-imaging study addressed this question by using visual stimuli consisting of randomly distributed dot pairs oriented toward a locus on a screen (the form-defined focus of expansion [FoE]) but moved away from a different locus (the motion-defined FoE) to simulate observer translation. We first fixed the motion-defined FoE location and shifted the form-defined FoE location. We then made the locations of the motion- and the form-defined FoEs either congruent (at the same location in the display) or incongruent (on the opposite sides of the display). The motion- or the form-defined FoE shift was the same in the two types of stimuli, but the perceived heading direction shifted for the congruent, but not for the incongruent stimuli. Participants (both sexes) made a task-irrelevant (contrast discrimination) judgment during scanning. Searchlight and ROI-based multivoxel pattern analysis revealed that early visual areas V1, V2, and V3 responded to either the motion- or the form-defined FoE shift. After V3, only the dorsal areas V3a and V3B/KO responded to such shifts. Furthermore, area V3B/KO shows a significantly higher decoding accuracy for the congruent than the incongruent stimuli. Our results provide direct evidence showing that area V3B/KO does not simply respond to motion and form cues but integrates these two cues for the perception of heading.SIGNIFICANCE STATEMENT Human survival relies on accurate perception of self-motion. The visual system uses both motion (optic flow) and form cues for the perception of the direction of self-motion (heading). Although human brain areas for processing optic flow and form structure are well identified, the areas responsible for integrating these two cues for the perception of self-motion remain unknown. We conducted fMRI experiments and used multivoxel pattern analysis technique to find human brain areas that can decode the shift in heading specified by each cue alone and the two cues combined. We found that motion and form cues are first processed in the early visual areas and then are likely integrated in the higher dorsal area V3B/KO for the final estimation of heading.

Computational Mechanisms for Perceptual Stability using Disparity and Motion Parallax

Walking and other forms of self-motion create global motion patterns across our eyes. With the resulting stream of visual signals, how do we perceive ourselves as moving through a stable world? Although the neural mechanisms are largely unknown, human studies (Warren and Rushton, 2009) provide strong evidence that the visual system is capable of parsing the global motion into two components: one due to self-motion and the other due to independently moving objects. In the present study, we use computational modeling to investigate potential neural mechanisms for stabilizing visual perception during self-motion that build on neurophysiology of the middle temporal (MT) and medial superior temporal (MST) areas. One such mechanism leverages direction, speed, and disparity tuning of cells in dorsal MST (MSTd) to estimate the combined motion parallax and disparity signals attributed to the observer's self-motion. Feedback from the most active MSTd cell subpopulations suppresses motion signals in MT that locally match the preference of the MSTd cell in both parallax and disparity. This mechanism combined with local surround inhibition in MT allows the model to estimate self-motion while maintaining a sparse motion representation that is compatible with perceptual stability. A key consequence is that after signals compatible with the observer's self-motion are suppressed, the direction of independently moving objects is represented in a world-relative rather than observer-relative reference frame. Our analysis explicates how temporal dynamics and joint motion parallax-disparity tuning resolve the world-relative motion of moving objects and establish perceptual stability. Together, these mechanisms capture findings on the perception of object motion during self-motion.SIGNIFICANCE STATEMENT The image integrated by our eyes as we move through our environment undergoes constant flux as trees, buildings, and other surroundings stream by us. If our view can change so radically from one moment to the next, how do we perceive a stable world? Although progress has been made in understanding how this works, little is known about the underlying brain mechanisms. We propose a computational solution whereby multiple brain areas communicate to suppress the motion attributed to our movement relative to the stationary world, which is often responsible for a large proportion of the flux across the visual field. We simulated the proposed neural mechanisms and tested model estimates using data from human perceptual studies.

A model of how depth facilitates scene-relative object motion perception

Many everyday interactions with moving objects benefit from an accurate perception of their movement. Self-motion, however, complicates object motion perception because it generates a global pattern of motion on the observer’s retina and radically influences an object’s retinal motion. There is strong evidence that the brain compensates by suppressing the retinal motion due to self-motion, however, this requires estimates of depth relative to the object—otherwise the appropriate self-motion component to remove cannot be determined. The underlying neural mechanisms are unknown, but neurons in brain areas MT and MST may contribute given their sensitivity to motion parallax and depth through joint direction, speed, and disparity tuning. We developed a neural model to investigate whether cells in areas MT and MST with well-established neurophysiological properties can account for human object motion judgments during self-motion. We tested the model by comparing simulated object motion signals to human object motion judgments in environments with monocular, binocular, and ambiguous depth. Our simulations show how precise depth information, such as that from binocular disparity, may improve estimates of the retinal motion pattern due the self-motion through increased selectivity among units that respond to the global self-motion pattern. The enhanced self-motion estimates emerged from recurrent feedback connections in MST and allowed the model to better suppress the appropriate direction, speed, and disparity signals from the object’s retinal motion, improving the accuracy of the object’s movement direction represented by motion signals.

Research has shown that the accuracy with which humans perceive object motion during self-motion improves in the presence of stereo cues. Using a neural modelling approach, we explore whether this finding can be explained through improved estimation of the retinal motion induced by self-motion. Our results show that depth cues that provide information about scene structure may have a large effect on the specificity with which the neural mechanisms for motion perception represent the visual self-motion signal. This in turn enables effective removal of the retinal motion due to self-motion when the goal is to perceive object motion relative to the stationary world. These results reveal a hitherto unknown critical function of stereo tuning in the MT-MST complex, and shed important light on how the brain may recruit signals from upstream and downstream brain areas to simultaneously perceive self-motion and object motion.

Neural bases of self- and object-motion in a naturalistic vision

To plan movements toward objects our brain must recognize whether retinal displacement is due to self-motion and/or to object-motion. Here, we aimed to test whether motion areas are able to segregate these types of motion. We combined an event-related functional magnetic resonance imaging experiment, brain mapping techniques, and wide-field stimulation to study the responsivity of motion-sensitive areas to pure and combined self- and object-motion conditions during virtual movies of a train running within a realistic landscape. We observed a selective response in MT to the pure object-motion condition, and in medial (PEc, pCi, CSv, and CMA) and lateral (PIC and LOR) areas to the pure self-motion condition. Some other regions (like V6) responded more to complex visual stimulation where both object- and self-motion were present. Among all, we found that some motion regions (V3A, LOR, MT, V6, and IPSmot) could extract object-motion information from the overall motion, recognizing the real movement of the train even when the images remain still (on the screen), or moved, because of self-movements. We propose that these motion areas might be good candidates for the "flow parsing mechanism," that is the capability to extract object-motion information from retinal motion signals by subtracting out the optic flow components.

A putative human homologue of the macaque area PEc

The cortical area PEc is anatomically and functionally well-defined in macaque, but it is unknown whether it has a counterpart in human. Since we know that macaque PEc, but not the nearby posterior regions, hosts a lower limb representation, in an attempt to recognize a possible human PEc we looked for the existence of leg representations in the human parietal cortex using individual cortical surface-based analysis, task-evoked paradigms and resting-state functional connectivity. fMRI images were acquired while thirty-one participants performed long-range leg movements through an in-house MRI-compatible set-up. We revealed the existence of multiple leg representations in the human dorsomedial parietal cortex, here defined as S-I (somatosensory-I), hPE (human PE, in the postcentral sulcus), and hPEc (human PEc, in the anterior precuneus). Among the three "leg" regions, hPEc had a unique functional profile, in that it was the only one responding to both arm and leg movements, to both hand-pointing and foot pointing movements, and to flow field visual stimulation, very similar to macaque area PEc. In addition, hPEc showed functional connections with the somatomotor regions hosting a lower limb representation, again as in macaque area PEc. Therefore, based on similarity in brain position, functional organization, cortical connections, and relationship with the neighboring areas, we propose that this cortical region is the human homologue of macaque area PEc.

Topographic Organization of the 'Third-Tier' Dorsomedial Visual Cortex in the Macaque

The boundaries of the visual areas located anterior to V2 in the dorsomedial region of the macaque cortex remain contentious. This region is usually conceptualized as including two functional subdivisions: the dorsal component of area V3 (V3d) laterally and another area named the parietooccipital area (PO) or V6 medially. However, the nature of the putative border between V3d and PO/V6 has remained undefined. We recorded the receptive fields of multiunit clusters in male macaques and reconstructed the locations of recording sites using histological sections and computer-generated maps. Immediately adjacent to dorsomedial V2, we observed a representation of the lower contralateral quadrant that represented the vertical meridian at its rostral border. This region formed a simple eccentricity gradient from ∼<5° in the annectant gyrus to >60° in the parietooccipital medial sulcus. There was no topographic reversal where one would expect to find the border between V3d and PO/V6. Rather, near the midline, this lower quadrant map continued directly into a representation of the peripheral upper visual field without an intervening lower quadrant representation. Therefore, cortex previously assigned to the medial part of V3d and to PO/V6 forms a single map that includes parts of both quadrants. Together with previous observations that V3d and PO/V6 are densely myelinated relative to adjacent cortex and share similar input from V1, these results suggest that they are parts of a single area (for which we suggest the designation V6), which is distinct from the one forming the ventral component of the third-tier complex.SIGNIFICANCE STATEMENT The primate visual cortex has a large number of areas. Knowing the extent of each visual area and how they can be distinguished from each other is essential for the interpretation of experiments aimed at understanding visual processing. Currently, there are conflicting models of the organization of the dorsomedial visual cortex rostral to area V2 (one of the earliest stages of cortical processing of vision). By conducting large-scale electrophysiological recordings, we found that what were originally thought to be distinct areas in this region (dorsal V3 and the parietooccipital area PO/V6), together form a single map of the visual field. This will help to guide future functional studies and the interpretation of the outcomes of lesions involving the dorsal visual cortex.

Population receptive field estimates for motion-defined stimuli

The processing of motion changes throughout the visual hierarchy, from spatially restricted ‘local motion’ in early visual cortex to more complex large-field ‘global motion’ at later stages. Here we used functional magnetic resonance imaging (fMRI) to examine spatially selective responses in these areas related to the processing of random-dot stimuli defined by differences in motion. We used population receptive field (pRF) analyses to map retinotopic cortex using bar stimuli comprising coherently moving dots. In the first experiment, we used three separate background conditions: no background dots (dot-defined bar-only), dots moving coherently in the opposite direction to the bar (kinetic boundary) and dots moving incoherently in random directions (global motion). Clear retinotopic maps were obtained for the bar-only and kinetic-boundary conditions across visual areas V1–V3 and in higher dorsal areas. For the global-motion condition, retinotopic maps were much weaker in early areas and became clear only in higher areas, consistent with the emergence of global-motion processing throughout the visual hierarchy. However, in a second experiment we demonstrate that this pattern is not specific to motion-defined stimuli, with very similar results for a transparent-motion stimulus and a bar defined by a static low-level property (dot size) that should have driven responses particularly in V1. We further exclude explanations based on stimulus visibility by demonstrating that the observed differences in pRF properties do not follow the ability of observers to localise or attend to these bar elements. Rather, our findings indicate that dorsal extrastriate retinotopic maps may primarily be determined by the visibility of the neural responses to the bar relative to the background response (i.e. neural signal-to-noise ratios) and suggests that claims about stimulus selectivity from pRF experiments must be interpreted with caution.

Connectivity of the Cingulate Sulcus Visual Area (CSv) in the Human Cerebral Cortex

The human cingulate sulcus visual area (CSv) responds selectively to visual and vestibular cues to self-motion. Although it is more selective for visual self-motion cues than any other brain region studied, it is not known whether CSv mediates perception of self-motion. An alternative hypothesis, based on its location, is that it provides sensory information to the motor system for use in guiding locomotion. To evaluate this hypothesis we studied the connectivity pattern of CSv, which is completely unknown, with a combination of diffusion MRI and resting-state functional MRI. Converging results from the 2 approaches suggest that visual drive is provided primarily by areas hV6, pVIP (putative intraparietal cortex) and PIC (posterior insular cortex). A strong connection with the medial portion of the somatosensory cortex, which represents the legs and feet, suggests that CSv may receive locomotion-relevant proprioceptive information as well as visual and vestibular signals. However, the dominant connections of CSv are with specific components of the motor system, in particular the cingulate motor areas and the supplementary motor area. We propose that CSv may provide a previously unknown link between perception and action that serves the online control of locomotion.

Self-reported navigation ability is associated with optic flow-sensitive regions' functional connectivity patterns during visual path integration

INTRODUCTION

Spatial navigation is a complex cognitive skill that varies between individuals, and the mechanisms underlying this variability are not clear. Studying simpler components of spatial navigation may help illuminate factors that contribute to variation in this complex skill; path integration is one such component. Optic flow provides self-motion information while moving through an environment and is sufficient for path integration. This study aims to investigate whether self-reported navigation ability is related to information transfer between optic flow-sensitive (OF-sensitive) cortical regions and regions important to navigation during environmental spatial tasks.

METHODS

Functional magnetic resonance imaging was used to define OF-sensitive regions and map their functional connectivity (FC) with the retrosplenial cortex and hippocampus during visual path integration (VPI) and turn counting (TC) tasks. Both tasks presented visual self-motion through a real-world environment. Correlations predicting a positive association between self-reported navigation ability (measured with the Santa Barbara Sense of Direction scale) and FC strength between OF-sensitive regions and retrosplenial cortex and OF-sensitive regions and the hippocampus were performed.

RESULTS

During VPI, FC strength between left cingulate sulcus visual area (L CSv) and right retrosplenial cortex and L CSv and right hippocampus was positively associated with self-reported navigation ability. FC strength between right cingulate sulcus visual area (R CSv) and right retrosplenial cortex during VPI was also positively associated with self-reported navigation ability. These relationships were specific to VPI, and whole-brain exploratory analyses corroborated these results.

CONCLUSIONS

These findings support the hypothesis that perceived spatial navigation ability is associated with communication strength between OF-sensitive and navigationally relevant regions during visual path integration, which may represent the transformation accuracy of visual motion information into internal spatial representations. More broadly, these results illuminate underlying mechanisms that may explain some variability in spatial navigation ability.

Egomotion-related visual areas respond to active leg movements

Monkey neurophysiology and human neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates a cortical network of temporal, parietal, insular, and cingulate visual motion regions. Here, we tested whether the human visual motion areas involved in processing optic flow signals simulating self-motion are also activated by active lower limb movements, and hence are likely involved in guiding human locomotion. To this aim, we used a combined approach of task-evoked activity and resting-state functional connectivity by fMRI. We localized a set of six egomotion-responsive visual areas (V6+, V3A, intraparietal motion/ventral intraparietal [IPSmot/VIP], cingulate sulcus visual area [CSv], posterior cingulate sulcus area [pCi], posterior insular cortex [PIC]) by using optic flow. We tested their response to a motor task implying long-range active leg movements. Results revealed that, among these visually defined areas, CSv, pCi, and PIC responded to leg movements (visuomotor areas), while V6+, V3A, and IPSmot/VIP did not (visual areas). Functional connectivity analysis showed that visuomotor areas are connected to the cingulate motor areas, the supplementary motor area, and notably to the medial portion of the somatosensory cortex, which represents legs and feet. We suggest that CSv, pCi, and PIC perform the visual analysis of egomotion-like signals to provide sensory information to the motor system with the aim of guiding locomotion.

Dynamic cognitive remediation for a Traumatic Brain Injury (TBI) significantly improves attention, working memory, processing speed, and reading fluency

BACKGROUND

In the U.S. 3.8 million people have a Traumatic Brain Injury (TBI) each year. Rapid brain training exercises to improve cognitive function after a mild TBI are needed.

OBJECTIVE

This study determines whether cognitive remediation by discriminating the direction a test pattern moves relative to a stationary background (movement figure-ground discrimination) improves the vision and cognitive deficits that result from a TBI, providing a paradigm shift in treatment methods.

METHODS

Movement-discrimination neurotraining was used to remediate low-level visual timing deficits in the dorsal stream to determine whether it improved high-level cognitive functions, such as processing speed, reading fluency, and the executive control functions of attention and working memory in four men with a TBI between the ages of 15-68. Standardized tests, as well as Magnetoencephalography (MEG) brain imaging, were administered at the beginning and end of 8-16 weeks of intervention training to evaluate improvements in cognitive skills.

RESULTS

Movement-discrimination cognitive neurotraining remediated both low-level visual timing deficits and high-level cognitive functioning, including selective and sustained attention, reading fluency, processing speed, and working memory for all TBI patients we studied. MEG brain imaging, using the Fast-VESTAL procedure, showed that this movement-discrimination training improved time-locked activity in the dorsal stream, attention, and executive control networks.

CONCLUSIONS

Remediating visual timing deficits in the dorsal stream revealed the causal role of visual movement discrimination training in improving high-level cognitive functions such as focusing and switching attention, working memory, processing speed, and reading. This study found that movement-discrimination training was very rapid and effective in remediating cognitive deficits, providing a new approach that is very beneficial for treating a mild TBI.

The neural basis of hand choice: An fMRI investigation of the Posterior Parietal Interhemispheric Competition model

The current study investigates a new neurobiological model of human hand choice: The Posterior Parietal Interhemispheric Competition (PPIC) model. The model specifies that neural populations in bilateral posterior intraparietal and superior parietal cortex (pIP-SPC) encode actions in hand-specific terms, and compete for selection across and within hemispheres. Actions with both hands are encoded bilaterally, but the contralateral hand is overrepresented. We use a novel fMRI paradigm to test the PPIC model. Participants reach to visible targets while in the scanner, and conditions involving free choice of which hand to use (Choice) are compared with when hand-use is instructed. Consistent with the PPIC model, bilateral pIP-SPC is preferentially responsive for the Choice condition, and for actions made with the contralateral hand. In the right pIP-SPC, these effects include anterior intraparietal and superior parieto-occipital cortex. Left dorsal premotor cortex, and an area in the right lateral occipitotemporal cortex show the same response pattern, while the left inferior parietal lobule is preferentially responsive for the Choice condition and when using the ipsilateral hand. Behaviourally, hand choice is biased by target location - for targets near the left/right edges of the display, the hand in ipsilateral hemispace is favoured. Moreover, consistent with a competitive process, response times are prolonged for choices to more ambiguous targets, where hand choice is relatively unbiased, and fMRI responses in bilateral pIP-SPC parallel this pattern. Our data provide support for the PPIC model, and reveal a selective network of brain areas involved in free hand choice, including bilateral posterior parietal cortex, left-lateralized inferior parietal and dorsal premotor cortices, and the right lateral occipitotemporal cortex.