A representation of changing heading direction in human cortical areas pVIP and CSv

Common and specific activations supporting optic flow processing and navigation as revealed by a meta-analysis of neuroimaging studies

Optic flow provides useful information in service of spatial navigation. However, whether brain networks supporting these two functions overlap is still unclear. Here we used Activation Likelihood Estimation (ALE) to assess the correspondence between brain correlates of optic flow processing and spatial navigation and their specific neural activations. Since computational and connectivity evidence suggests that visual input from optic flow provides information mainly during egocentric navigation, we further tested the correspondence between brain correlates of optic flow processing and that of both egocentric and allocentric navigation. Optic flow processing shared activation with egocentric (but not allocentric) navigation in the anterior precuneus, suggesting its role in providing information about self-motion, as derived from the analysis of optic flow, in service of egocentric navigation. We further documented that optic flow perception and navigation are partially segregated into two functional and anatomical networks, i.e., the dorsal and the ventromedial networks. Present results point to a dynamic interplay between the dorsal and ventral visual pathways aimed at coordinating visually guided navigation in the environment.

Conflicts between short- and long-term experiences affect visual perception through modulating sensory or motor response systems: Evidence from Bayesian inference models

The independent effects of short- and long-term experiences on visual perception have been discussed for decades. However, no study has investigated whether and how these experiences simultaneously affect our visual perception. To address this question, we asked participants to estimate their self-motion directions (i.e., headings) simulated from optic flow, in which a long-term experience learned in everyday life (i.e., straight-forward motion being more common than lateral motion) plays an important role. The headings were selected from three distributions that resembled a peak, a hill, and a flat line, creating different short-term experiences. Importantly, the proportions of headings deviating from the straight-forward motion gradually increased in the peak, hill, and flat distributions, leading to a greater conflict between long- and short-term experiences. The results showed that participants biased their heading estimates towards the straight-ahead direction and previously seen headings, which increased with the growing experience conflict. This suggests that both long- and short-term experiences simultaneously affect visual perception. Finally, we developed two Bayesian models (Model 1 vs. Model 2) based on two assumptions that the experience conflict altered the likelihood distribution of sensory representation or the motor response system. The results showed that both models accurately predicted participants' estimation biases. However, Model 1 predicted a higher variance of serial dependence compared to Model 2, while Model 2 predicted a higher variance of the bias towards the straight-ahead direction compared to Model 1. This suggests that the experience conflict can influence visual perception by affecting both sensory and motor response systems. Taken together, the current study systematically revealed the effects of long- and short-term experiences on visual perception and the underlying Bayesian processing mechanisms.

White matter tracts adjacent to the human cingulate sulcus visual area (CSv)

Human cingulate sulcus visual area (CSv) was first identified as an area that responds selectively to visual stimulation indicative of self-motion. It was later shown that the area is also sensitive to vestibular stimulation as well as to bodily motion compatible with locomotion. Understanding the anatomical connections of CSv will shed light on how CSv interacts with other parts of the brain to perform information processing related to self-motion and navigation. A previous neuroimaging study (Smith et al. 2018, Cerebral Cortex, 28, 3685-3596) used diffusion-weighted magnetic resonance imaging (dMRI) to examine the structural connectivity of CSv, and demonstrated connections between CSv and the motor and sensorimotor areas in the anterior and posterior cingulate sulcus. The present study aimed to complement this work by investigating the relationship between CSv and adjacent major white matter tracts, and to map CSv's structural connectivity onto known white matter tracts. By re-analysing the dataset from Smith et al. (2018), we identified bundles of fibres (i.e. streamlines) from the whole-brain tractography that terminate near CSv. We then assessed to which white matter tracts those streamlines may belong based on previously established anatomical prescriptions. We found that a significant number of CSv streamlines can be categorised as part of the dorsalmost branch of the superior longitudinal fasciculus (SLF I) and the cingulum. Given current thinking about the functions of these white matter tracts, our results support the proposition that CSv provides an interface between sensory and motor systems in the context of self-motion.

Processing of complex traffic scenes for effective steering and collision avoidance: a perspective, from research into human control, on the challenges for sensor-based autonomous vehicles on urban roads

An overview is provided of behavioral research into human steering and collision avoidance including the processing of optic flow, optical looming and the role of the human mobile gaze system. A consideration is then made of the issues that may occur for autonomous vehicles (AV) when they move from grid-type road networks into complex inner-city streets and interact with human drivers, pedestrians and cyclists. Comparisons between human processing and AV processing of these interactions are made. This raises issues as to whether AV control systems need to mimic human visual processing more closely and highlights the need for AV systems to develop a "theory of road users" that allows attribution of intent to other drivers, cyclists or pedestrians. Guidelines for the development of a "theory of road users" for AVs are suggested.

Neural sensitivity to translational self- and object-motion velocities

The ability to detect and assess world-relative object-motion is a critical computation performed by the visual system. This computation, however, is greatly complicated by the observer's movements, which generate a global pattern of motion on the observer's retina. How the visual system implements this computation is poorly understood. Since we are potentially able to detect a moving object if its motion differs in velocity (or direction) from the expected optic flow generated by our own motion, here we manipulated the relative motion velocity between the observer and the object within a stationary scene as a strategy to test how the brain accomplishes object-motion detection. Specifically, we tested the neural sensitivity of brain regions that are known to respond to egomotion-compatible visual motion (i.e., egomotion areas: cingulate sulcus visual area, posterior cingulate sulcus area, posterior insular cortex [PIC], V6+, V3A, IPSmot/VIP, and MT+) to a combination of different velocities of visually induced translational self- and object-motion within a virtual scene while participants were instructed to detect object-motion. To this aim, we combined individual surface-based brain mapping, task-evoked activity by functional magnetic resonance imaging, and parametric and representational similarity analyses. We found that all the egomotion regions (except area PIC) responded to all the possible combinations of self- and object-motion and were modulated by the self-motion velocity. Interestingly, we found that, among all the egomotion areas, only MT+, V6+, and V3A were further modulated by object-motion velocities, hence reflecting their possible role in discriminating between distinct velocities of self- and object-motion. We suggest that these egomotion regions may be involved in the complex computation required for detecting scene-relative object-motion during self-motion.

Functional organization of the caudal part of the human superior parietal lobule

Like in macaque, the caudal portion of the human superior parietal lobule (SPL) plays a key role in a series of perceptive, visuomotor and somatosensory processes. Here, we review the functional properties of three separate portions of the caudal SPL, i.e., the posterior parieto-occipital sulcus (POs), the anterior POs, and the anterior part of the caudal SPL. We propose that the posterior POs is mainly dedicated to the analysis of visual motion cues useful for object motion detection during self-motion and for spatial navigation, while the more anterior parts are implicated in visuomotor control of limb actions. The anterior POs is mainly involved in using the spotlight of attention to guide reach-to-grasp hand movements, especially in dynamic environments. The anterior part of the caudal SPL plays a central role in visually guided locomotion, being implicated in controlling leg-related movements as well as the four limbs interaction with the environment, and in encoding egomotion-compatible optic flow. Together, these functions reveal how the caudal SPL is strongly implicated in skilled visually-guided behaviors.

Egomotion-related visual areas respond to goal-directed movements

Integration of proprioceptive signals from the various effectors with visual feedback of self-motion from the retina is necessary for whole-body movement and locomotion. Here, we tested whether the human visual motion areas involved in processing optic flow signals simulating self-motion are also activated by goal-directed movements (as saccades or pointing) performed with different effectors (eye, hand, and foot), suggesting a role in visually guiding movements through the external environment. To achieve this aim, we used a combined approach of task-evoked activity and effective connectivity (PsychoPhysiological Interaction, PPI) by fMRI. We localized a set of six egomotion-responsive visual areas through the flow field stimulus and distinguished them into visual (pIPS/V3A, V6+ , IPSmot/VIP) and visuomotor (pCi, CSv, PIC) areas according to recent literature. We tested their response to a visuomotor task implying spatially directed delayed eye, hand, and foot movements. We observed a posterior-to-anterior gradient of preference for eye-to-foot movements, with posterior (visual) regions showing a preference for saccades, and anterior (visuomotor) regions showing a preference for foot pointing. No region showed a clear preference for hand pointing. Effective connectivity analysis showed that visual areas were more connected to each other with respect to the visuomotor areas, particularly during saccades. We suggest that visual and visuomotor egomotion regions can play different roles within a network that integrates sensory-motor signals with the aim of guiding movements in the external environment.

Cortical visual area CSv as a cingulate motor area: a sensorimotor interface for the control of locomotion

The response properties, connectivity and function of the cingulate sulcus visual area (CSv) are reviewed. Cortical area CSv has been identified in both human and macaque brains. It has similar response properties and connectivity in the two species. It is situated bilaterally in the cingulate sulcus close to an established group of medial motor/premotor areas. It has strong connectivity with these areas, particularly the cingulate motor areas and the supplementary motor area, suggesting that it is involved in motor control. CSv is active during visual stimulation but only if that stimulation is indicative of self-motion. It is also active during vestibular stimulation and connectivity data suggest that it receives proprioceptive input. Connectivity with topographically organized somatosensory and motor regions strongly emphasizes the legs over the arms. Together these properties suggest that CSv provides a key interface between the sensory and motor systems in the control of locomotion. It is likely that its role involves online control and adjustment of ongoing locomotory movements, including obstacle avoidance and maintaining the intended trajectory. It is proposed that CSv is best seen as part of the cingulate motor complex. In the human case, a modification of the influential scheme of Picard and Strick (Picard and Strick, Cereb Cortex 6:342-353, 1996) is proposed to reflect this.

Multisensory integration in cortical regions responding to locomotion-related visual and somatomotor signals

During real-world locomotion, in order to be able to move along a path or avoid an obstacle, continuous changes in self-motion direction (i.e. heading) are needed. Control of heading changes during locomotion requires the integration of multiple signals (i.e., visual, somatomotor, vestibular). Recent fMRI studies have shown that both somatomotor areas (human PEc [hPEc], human PE [hPE], primary somatosensory cortex [S-I]) and egomotion visual regions (cingulate sulcus visual area [CSv], posterior cingulate area [pCi], posterior insular cortex [PIC]) respond to either leg movements and egomotion-compatible visual stimulations, suggesting a role in the analysis of both visual attributes of egomotion and somatomotor signals with the aim of guiding locomotion. However, whether these regions are able to integrate egomotion-related visual signals with somatomotor inputs coming from leg movements during heading changes remains an open question. Here we used a combined approach of individual functional localizers and task-evoked activity by fMRI. In thirty subjects we first localized three egomotion areas (CSv, pCi, PIC) and three somatomotor regions (S-I, hPE, hPEc). Then, we tested their responses in a multisensory integration experiment combining visual and somatomotor signals relevant to locomotion in congruent or incongruent trials. We used an fMR-adaptation paradigm to explore the sensitivity to the repeated presentation of these bimodal stimuli in the six regions of interest. Results revealed that hPE, S-I and CSv showed an adaptation effect regardless of congruency, while PIC, pCi and hPEc showed sensitivity to congruency. PIC exhibited a preference for congruent trials compared to incongruent trials. Areas pCi and hPEc exhibited an adaptation effect only for congruent and incongruent trials, respectively. PIC, pCi and hPEc sensitivity to the congruency relationship between visual (locomotion-compatible) cues and (leg-related) somatomotor inputs suggests that these regions are involved in multisensory integration processes, likely in order to guide/adjust leg movements during heading changes.

The macaque ventral intraparietal area has expanded into three homologue human parietal areas

The macaque ventral intraparietal area (VIP) in the fundus of the intraparietal sulcus has been implicated in a diverse range of sensorimotor and cognitive functions such as motion processing, multisensory integration, processing of head peripersonal space, defensive behavior, and numerosity coding. Here, we exhaustively review macaque VIP function, cytoarchitectonics, and anatomical connectivity and integrate it with human studies that have attempted to identify a potential human VIP homologue. We show that human VIP research has consistently identified three, rather than one, bilateral parietal areas that each appear to subsume some, but not all, of the macaque area's functionality. Available evidence suggests that this human "VIP complex" has evolved as an expansion of the macaque area, but that some precursory specialization within macaque VIP has been previously overlooked. The three human areas are dominated, roughly, by coding the head or self in the environment, visual heading direction, and the peripersonal environment around the head, respectively. A unifying functional principle may be best described as prediction in space and time, linking VIP to state estimation as a key parietal sensorimotor function. VIP's expansive differentiation of head and self-related processing may have been key in the emergence of human bodily self-consciousness.

Optic flow selectivity in the macaque parieto-occipital sulcus

In humans, several neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates higher-level motion areas, like V6 and the cingulate sulcus visual area (CSv). In macaque, there are few studies on the sensitivity of V6 and CSv to egomotion compatible optic flow. The only fMRI study on this issue revealed selectivity to egomotion compatible optic flow in macaque CSv but not in V6 (Cotterau et al. Cereb Cortex 27(1):330-343, 2017, but see Fan et al. J Neurosci. 35:16303-16314, 2015). Yet, it is unknown whether monkey visual motion areas MT + and V6 display any distinctive fMRI functional profile relative to the optic flow stimulation, as it is the case for the homologous human areas (Pitzalis et al., Cereb Cortex 20(2):411-424, 2010). Here, we described the sensitivity of the monkey brain to two motion stimuli (radial rings and flow fields) originally used in humans to functionally map the motion middle temporal area MT + (Tootell et al. J Neurosci 15: 3215-3230, 1995a; Nature 375:139-141, 1995b) and the motion medial parietal area V6 (Pitzalis et al. 2010), respectively. In both animals, we found regions responding only to optic flow or radial rings stimulation, and regions responding to both stimuli. A region in the parieto-occipital sulcus (likely including V6) was one of the most highly selective area for coherently moving fields of dots, further demonstrating the power of this type of stimulation to activate V6 in both humans and monkeys. We did not find any evidence that putative macaque CSv responds to Flow Fields.

Activity Strength within Optic Flow-Sensitive Cortical Regions Is Associated with Visual Path Integration Accuracy in Aged Adults

Spatial navigation is a cognitive skill fundamental to successful interaction with our environment, and aging is associated with weaknesses in this skill. Identifying mechanisms underlying individual differences in navigation ability in aged adults is important to understanding these age-related weaknesses. One understudied factor involved in spatial navigation is self-motion perception. Important to self-motion perception is optic flow–the global pattern of visual motion experienced while moving through our environment. A set of optic flow-sensitive (OF-sensitive) cortical regions was defined in a group of young (n = 29) and aged (n = 22) adults. Brain activity was measured in this set of OF-sensitive regions and control regions using functional magnetic resonance imaging while participants performed visual path integration (VPI) and turn counting (TC) tasks. Aged adults had stronger activity in RMT+ during both tasks compared to young adults. Stronger activity in the OF-sensitive regions LMT+ and RpVIP during VPI, not TC, was associated with greater VPI accuracy in aged adults. The activity strength in these two OF-sensitive regions measured during VPI explained 42% of the variance in VPI task performance in aged adults. The results of this study provide novel support for global motion processing as a mechanism underlying visual path integration in normal aging.

Preference for locomotion-compatible curved paths and forward direction of self-motion in somatomotor and visual areas

During locomotion, leg movements define the direction of walking (forward or backward) and the path one is taking (straight or curved). These aspects of locomotion produce characteristic visual motion patterns during movement. Here, we tested whether cortical regions responding to either egomotion-compatible visual motion, or leg movements, or both, are sensitive to these locomotion-relevant aspects of visual motion. We compared a curved path (typically the visual feedback of a changing direction of movement in the environment) to a linear path for simulated forward and backward motion in an event-related fMRI experiment. We used an individual surface-based approach and two functional localizers to define (1) six egomotion-related areas (V6+, V3A, intraparietal motion area [IPSmot], cingulate sulcus visual area [CSv], posterior cingulate area [pCi], posterior insular cortex [PIC]) using the flow field stimulus and (2) three leg-related cortical regions (human PEc [hPEc], human PE [hPE] and primary somatosensory cortex [S-I]) using a somatomotor task. Then, we extracted the response from all these regions with respect to the main event-related fMRI experiment, consisting of passive viewing of an optic flow stimulus, simulating a forward or backward direction of self-motion in either linear or curved path. Results showed that some regions have a significant preference for the curved path motion (hPEc, hPE, S-I, IPSmot) or a preference for the forward motion (V3A), while other regions have both a significant preference for the curved path motion and for the forward compared to backward motion (V6+, CSv, pCi). We did not find any significant effects of the present stimuli in PIC. Since controlling locomotion mainly means controlling changes of walking direction in the environment during forward self-motion, such a differential functional profile among these cortical regions suggests that they play a differentiated role in the visual guidance of locomotion.

A common neural substrate for processing scenes and egomotion-compatible visual motion

Neuroimaging studies have revealed two separate classes of category-selective regions specialized in optic flow (egomotion-compatible) processing and in scene/place perception. Despite the importance of both optic flow and scene/place recognition to estimate changes in position and orientation within the environment during self-motion, the possible functional link between egomotion- and scene-selective regions has not yet been established. Here we reanalyzed functional magnetic resonance images from a large sample of participants performing two well-known “localizer” fMRI experiments, consisting in passive viewing of navigationally relevant stimuli such as buildings and places (scene/place stimulus) and coherently moving fields of dots simulating the visual stimulation during self-motion (flow fields). After interrogating the egomotion-selective areas with respect to the scene/place stimulus and the scene-selective areas with respect to flow fields, we found that the egomotion-selective areas V6+ and pIPS/V3A responded bilaterally more to scenes/places compared to faces, and all the scene-selective areas (parahippocampal place area or PPA, retrosplenial complex or RSC, and occipital place area or OPA) responded more to egomotion-compatible optic flow compared to random motion. The conjunction analysis between scene/place and flow field stimuli revealed that the most important focus of common activation was found in the dorsolateral parieto-occipital cortex, spanning the scene-selective OPA and the egomotion-selective pIPS/V3A. Individual inspection of the relative locations of these two regions revealed a partial overlap and a similar response profile to an independent low-level visual motion stimulus, suggesting that OPA and pIPS/V3A may be part of a unique motion-selective complex specialized in encoding both egomotion- and scene-relevant information, likely for the control of navigation in a structured environment.

Predictive coding in a multisensory path integration task: An fMRI study

During self-motion through an environment, our sensory systems are confronted with a constant flow of information from different modalities. To successfully navigate, self-induced sensory signals have to be dissociated from externally induced sensory signals. Previous studies have suggested that the processing of self-induced sensory information is modulated by means of predictive coding mechanisms. However, the neural correlates of processing self-induced sensory information from different modalities during self-motion are largely unknown. Here, we asked if and how the processing of visually simulated self-motion and/or associated auditory stimuli is modulated by self-controlled action. Participants were asked to actively reproduce a previously observed simulated self-displacement (path integration). Blood oxygen level-dependent (BOLD) activation during this path integration was compared with BOLD activation during a condition in which we passively replayed the exact sensory stimulus that had been produced by the participants in previous trials. We found supramodal BOLD suppression in parietal and frontal regions. Remarkably, BOLD contrast in sensory areas was enhanced in a modality-specific manner. We conclude that the effect of action on sensory processing is strictly dependent on the respective behavioral task and its relevance.

Integration of Motion and Form Cues for the Perception of Self-Motion in the Human Brain

When moving around in the world, the human visual system uses both motion and form information to estimate the direction of self-motion (i.e., heading). However, little is known about cortical areas in charge of this task. This brain-imaging study addressed this question by using visual stimuli consisting of randomly distributed dot pairs oriented toward a locus on a screen (the form-defined focus of expansion [FoE]) but moved away from a different locus (the motion-defined FoE) to simulate observer translation. We first fixed the motion-defined FoE location and shifted the form-defined FoE location. We then made the locations of the motion- and the form-defined FoEs either congruent (at the same location in the display) or incongruent (on the opposite sides of the display). The motion- or the form-defined FoE shift was the same in the two types of stimuli, but the perceived heading direction shifted for the congruent, but not for the incongruent stimuli. Participants (both sexes) made a task-irrelevant (contrast discrimination) judgment during scanning. Searchlight and ROI-based multivoxel pattern analysis revealed that early visual areas V1, V2, and V3 responded to either the motion- or the form-defined FoE shift. After V3, only the dorsal areas V3a and V3B/KO responded to such shifts. Furthermore, area V3B/KO shows a significantly higher decoding accuracy for the congruent than the incongruent stimuli. Our results provide direct evidence showing that area V3B/KO does not simply respond to motion and form cues but integrates these two cues for the perception of heading.SIGNIFICANCE STATEMENT Human survival relies on accurate perception of self-motion. The visual system uses both motion (optic flow) and form cues for the perception of the direction of self-motion (heading). Although human brain areas for processing optic flow and form structure are well identified, the areas responsible for integrating these two cues for the perception of self-motion remain unknown. We conducted fMRI experiments and used multivoxel pattern analysis technique to find human brain areas that can decode the shift in heading specified by each cue alone and the two cues combined. We found that motion and form cues are first processed in the early visual areas and then are likely integrated in the higher dorsal area V3B/KO for the final estimation of heading.

Neural bases of self- and object-motion in a naturalistic vision

To plan movements toward objects our brain must recognize whether retinal displacement is due to self-motion and/or to object-motion. Here, we aimed to test whether motion areas are able to segregate these types of motion. We combined an event-related functional magnetic resonance imaging experiment, brain mapping techniques, and wide-field stimulation to study the responsivity of motion-sensitive areas to pure and combined self- and object-motion conditions during virtual movies of a train running within a realistic landscape. We observed a selective response in MT to the pure object-motion condition, and in medial (PEc, pCi, CSv, and CMA) and lateral (PIC and LOR) areas to the pure self-motion condition. Some other regions (like V6) responded more to complex visual stimulation where both object- and self-motion were present. Among all, we found that some motion regions (V3A, LOR, MT, V6, and IPSmot) could extract object-motion information from the overall motion, recognizing the real movement of the train even when the images remain still (on the screen), or moved, because of self-movements. We propose that these motion areas might be good candidates for the "flow parsing mechanism," that is the capability to extract object-motion information from retinal motion signals by subtracting out the optic flow components.

Connectivity of the Cingulate Sulcus Visual Area (CSv) in the Human Cerebral Cortex

The human cingulate sulcus visual area (CSv) responds selectively to visual and vestibular cues to self-motion. Although it is more selective for visual self-motion cues than any other brain region studied, it is not known whether CSv mediates perception of self-motion. An alternative hypothesis, based on its location, is that it provides sensory information to the motor system for use in guiding locomotion. To evaluate this hypothesis we studied the connectivity pattern of CSv, which is completely unknown, with a combination of diffusion MRI and resting-state functional MRI. Converging results from the 2 approaches suggest that visual drive is provided primarily by areas hV6, pVIP (putative intraparietal cortex) and PIC (posterior insular cortex). A strong connection with the medial portion of the somatosensory cortex, which represents the legs and feet, suggests that CSv may receive locomotion-relevant proprioceptive information as well as visual and vestibular signals. However, the dominant connections of CSv are with specific components of the motor system, in particular the cingulate motor areas and the supplementary motor area. We propose that CSv may provide a previously unknown link between perception and action that serves the online control of locomotion.

Brain networks require a network-conscious psychopathological approach

In experimental psychology and neuroscience, technological advances and multisensory research have contributed to gradually dismiss a version of reductionism. Empirical results no longer support a brain model in which distinct "modules" perform discrete functions, but rather, a brain of partially overlapping networks. A similarly changed brain model is extending to psychopathology and clinical psychology, and partly accounts for the problems of reductionism.

Egomotion-related visual areas respond to active leg movements

Monkey neurophysiology and human neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates a cortical network of temporal, parietal, insular, and cingulate visual motion regions. Here, we tested whether the human visual motion areas involved in processing optic flow signals simulating self-motion are also activated by active lower limb movements, and hence are likely involved in guiding human locomotion. To this aim, we used a combined approach of task-evoked activity and resting-state functional connectivity by fMRI. We localized a set of six egomotion-responsive visual areas (V6+, V3A, intraparietal motion/ventral intraparietal [IPSmot/VIP], cingulate sulcus visual area [CSv], posterior cingulate sulcus area [pCi], posterior insular cortex [PIC]) by using optic flow. We tested their response to a motor task implying long-range active leg movements. Results revealed that, among these visually defined areas, CSv, pCi, and PIC responded to leg movements (visuomotor areas), while V6+, V3A, and IPSmot/VIP did not (visual areas). Functional connectivity analysis showed that visuomotor areas are connected to the cingulate motor areas, the supplementary motor area, and notably to the medial portion of the somatosensory cortex, which represents legs and feet. We suggest that CSv, pCi, and PIC perform the visual analysis of egomotion-like signals to provide sensory information to the motor system with the aim of guiding locomotion.

Decoding rule search domain in the left inferior frontal gyrus

Traditionally, the left hemisphere has been thought to extract mainly verbal patterns of information, but recent evidence has shown that the left Inferior Frontal Gyrus (IFG) is active during inductive reasoning in both the verbal and spatial domains. We aimed to understand whether the left IFG supports inductive reasoning in a domain-specific or domain-general fashion. To do this we used Multi-Voxel Pattern Analysis to decode the representation of domain during a rule search task. Thirteen participants were asked to extract the rule underlying streams of letters presented in different spatial locations. Each rule was either verbal (letters forming words) or spatial (positions forming geometric figures). Our results show that domain was decodable in the left prefrontal cortex, suggesting that this region represents domain-specific information, rather than processes common to the two domains. A replication study with the same participants tested two years later confirmed these findings, though the individual representations changed, providing evidence for the flexible nature of representations. This study extends our knowledge on the neural basis of goal-directed behaviors and on how information relevant for rule extraction is flexibly mapped in the prefrontal cortex.

Mapping the complex topological organization of the human parietal face area

The macaque monkey ventral intraparietal area (VIP) contains neurons with aligned visual-tactile receptive fields anchored to the face and upper body. Our previous fMRI studies using standard head coils found a human parietal face area (VIP+ complex; putative macaque VIP homologue) containing superimposed topological maps of the face and near-face visual space. Here, we construct high signal-to-noise surface coils and used phase-encoded air puffs and looming stimuli to map topological organization of the parietal face area at higher resolution. This area is consistently identified as a region extending between the superior postcentral sulcus and the upper bank of the anterior intraparietal sulcus (IPS), avoiding the fundus of IPS. Using smaller voxel sizes, our surface coils picked up strong fMRI signals in response to tactile and visual stimuli. By analyzing tactile and visual maps in our current and previous studies, we constructed a set of topological models illustrating commonalities and differences in map organization across subjects. The most consistent topological feature of the VIP+ complex is a central-anterior upper face (and upper visual field) representation adjoined by lower face (and lower visual field) representations ventrally (laterally) and/or dorsally (medially), potentially forming two subdivisions VIPv (ventral) and VIPd (dorsal). The lower visual field representations typically extend laterally into the anterior IPS to adjoin human area AIP, and medially to overlap with the parietal body areas at the superior parietal ridge. Significant individual variations are then illustrated to provide an accurate and comprehensive view of the topological organization of the parietal face area.

Global Motion Processing in Human Visual Cortical Areas V2 and V3

Global motion perception entails the ability to extract the central direction tendency from an extended area of visual space containing widely disparate local directions. A substantial body of evidence suggests that local motion signals generated in primary visual cortex (V1) are spatially integrated to provide perception of global motion, beginning in the middle temporal area (MT) in macaques and its counterpart in humans, hMT. However, V2 and V3 also contain motion-sensitive neurons that have larger receptive fields than those found in V1, giving the potential for spatial integration of motion signals. Despite this, V2 and V3 have been overlooked as sites of global motion processing. To test, free of local-global confounds, whether human V2 and V3 are important for encoding global motion, we developed a visual stimulus that yields a global direction yet includes all possible local directions and is perfectly balanced at the local motion level. We then attempted to decode global motion direction in such stimuli with multivariate pattern classification of fMRI data. We found strong sensitivity to global motion in hMT, as expected, and also in several higher visual areas known to encode optic flow. Crucially, we found that global motion direction could be decoded in human V2 and, particularly, in V3. The results suggest the surprising conclusion that global motion processing is a key function of cortical visual areas V2 and V3. A possible purpose is to provide global motion signals to V6.

SIGNIFICANCE STATEMENT

Humans can readily detect the overall direction of movement in a flock of birds despite large differences in the directions of individual birds at a given moment. This ability to combine disparate motion signals across space underlies many aspects of visual motion perception and has therefore received considerable research attention. The received wisdom is that spatial integration of motion signals occurs in the cortical motion complex MT+ in both human and nonhuman primates. We show here that areas V2 and V3 in humans are also able to perform this function. We suggest that different cortical areas integrate motion signals in different ways for different purposes.

Differential processing of the direction and focus of expansion of optic flow stimuli in areas MST and V3A of the human visual cortex

Human neuropsychological and neuroimaging studies have raised the possibility that different attributes of optic flow stimuli, namely radial direction and the position of the focus of expansion (FOE), are processed within separate cortical areas. In the human brain, visual areas V5/MT+ and V3A have been proposed as integral to the analysis of these different attributes of optic flow stimuli. To establish direct causal relationships between neural activity in human (h)V5/MT+ and V3A and the perception of radial motion direction and FOE position, we used transcranial magnetic stimulation (TMS) to disrupt cortical activity in these areas while participants performed behavioral tasks dependent on these different aspects of optic flow stimuli. The cortical regions of interest were identified in seven human participants using standard functional MRI retinotopic mapping techniques and functional localizers. TMS to area V3A was found to disrupt FOE positional judgments but not radial direction discrimination, whereas the application of TMS to an anterior subdivision of hV5/MT+, MST/TO-2 produced the reverse effects, disrupting radial direction discrimination but eliciting no effect on the FOE positional judgment task. This double dissociation demonstrates that FOE position and radial direction of optic flow stimuli are signaled independently by neural activity in areas hV5/MT+ and V3A.NEW & NOTEWORTHY Optic flow constitutes a biologically relevant visual cue as we move through any environment. With the use of neuroimaging and brain-stimulation techniques, this study demonstrates that separate human brain areas are involved in the analysis of the direction of radial motion and the focus of expansion in optic flow. This dissociation reveals the existence of separate processing pathways for the analysis of different attributes of optic flow that are important for the guidance of self-locomotion and object avoidance.

Distributed Visual–Vestibular Processing in the Cerebral Cortex of Man and Macaque

Recent advances in understanding the neurobiological underpinnings of visual–vestibular interactions underlying self-motion perception are reviewed with an emphasis on comparisons between the macaque and human brains. In both species, several distinct cortical regions have been identified that are active during both visual and vestibular stimulation and in some of these there is clear evidence for sensory integration. Several possible cross-species homologies between cortical regions are identified. A key feature of cortical organization is that the same information is apparently represented in multiple, anatomically diverse cortical regions, suggesting that information about self-motion is used for different purposes in different brain regions.

Cortical Correlates of the Simulated Viewpoint Oscillation Advantage for Vection

Behavioural studies have consistently found stronger vection responses for oscillating, compared to smooth/constant, patterns of radial flow (the simulated viewpoint oscillation advantage for vection). Traditional accounts predict that simulated viewpoint oscillation should impair vection by increasing visual–vestibular conflicts in stationary observers (as this visual oscillation simulates self-accelerations that should strongly stimulate the vestibular apparatus). However, support for increased vestibular activity during accelerating vection has been mixed in the brain imaging literature. This fMRI study examined BOLD activity in visual (cingulate sulcus visual area — CSv; medial temporal complex — MT+; V6; precuneus motion area — PcM) and vestibular regions (parieto-insular vestibular cortex — PIVC/posterior insular cortex — PIC; ventral intraparietal region — VIP) when stationary observers were exposed to vection-inducing optic flow (i.e., globally coherent oscillating and smooth self-motion displays) as well as two suitable control displays. In line with earlier studies in which no vection occurred, CSv and PIVC/PIC both showed significantly increased BOLD activity during oscillating global motion compared to the other motion conditions (although this effect was found for fewer subjects in PIVC/PIC). The increase in BOLD activity in PIVC/PIC during prolonged exposure to the oscillating (compared to smooth) patterns of global optical flow appears consistent with vestibular facilitation.

An fMRI Investigation of Preparatory Set in the Human Cerebral Cortex and Superior Colliculus for Pro- and Anti-Saccades

Previous studies have identified several cortical regions that show larger BOLD responses during preparation and execution of anti-saccades than pro-saccades. We confirmed this finding with a greater BOLD response for anti-saccades than pro-saccades during the preparation phase in the FEF, IPS and DLPFC and in the FEF and IPS in the execution phase. We then applied multi-voxel pattern analysis (MVPA) to establish whether different neural populations are involved in the two types of saccade. Pro-saccades and anti-saccades were reliably decoded during saccade execution in all three cortical regions (FEF, DLPFC and IPS) and in IPS during saccade preparation. This indicates neural specialization, for programming the desired response depending on the task rule, in these regions. In a further study tailored for imaging the superior colliculus in the midbrain a similar magnitude BOLD response was observed for pro-saccades and anti-saccades and the two saccade types could not be decoded with MVPA. This was the case both for activity related to the preparation phase and also for that elicited during the execution phase. We conclude that separate cortical neural populations are involved in the task-specific programming of a saccade while in contrast, the SC has a role in response preparation but may be less involved in high-level, task-specific aspects of the control of saccades.

Differential Responses to a Visual Self-Motion Signal in Human Medial Cortical Regions Revealed by Wide-View Stimulation

Vision is important for estimating self-motion, which is thought to involve optic-flow processing. Here, we investigated the fMRI response profiles in visual area V6, the precuneus motion area (PcM), and the cingulate sulcus visual area (CSv)—three medial brain regions recently shown to be sensitive to optic-flow. We used wide-view stereoscopic stimulation to induce robust self-motion processing. Stimuli included static, randomly moving, and coherently moving dots (simulating forward self-motion). We varied the stimulus size and the presence of stereoscopic information. A combination of univariate and multi-voxel pattern analyses (MVPA) revealed that fMRI responses in the three regions differed from each other. The univariate analysis identified optic-flow selectivity and an effect of stimulus size in V6, PcM, and CSv, among which only CSv showed a significantly lower response to random motion stimuli compared with static conditions. Furthermore, MVPA revealed an optic-flow specific multi-voxel pattern in the PcM and CSv, where the discrimination of coherent motion from both random motion and static conditions showed above-chance prediction accuracy, but that of random motion from static conditions did not. Additionally, while area V6 successfully classified different stimulus sizes regardless of motion pattern, this classification was only partial in PcM and was absent in CSv. This may reflect the known retinotopic representation in V6 and the absence of such clear visuospatial representation in CSv. We also found significant correlations between the strength of subjective self-motion and univariate activation in all examined regions except for primary visual cortex (V1). This neuro-perceptual correlation was significantly higher for V6, PcM, and CSv when compared with V1, and higher for CSv when compared with the visual motion area hMT+. Our convergent results suggest the significant involvement of CSv in self-motion processing, which may give rise to its percept.

Egocentric Direction and Position Perceptions are Dissociable Based on Only Static Lane Edge Information

When observers perceive several objects in a space, at the same time, they should effectively perceive their own position as a viewpoint. However, little is known about observers' percepts of their own spatial location based on the visual scene information viewed from them. Previous studies indicate that two distinct visual spatial processes exist in the locomotion situation: the egocentric position perception and egocentric direction perception. Those studies examined such perceptions in information rich visual environments where much dynamic and static visual information was available. This study examined these two perceptions in information of impoverished environments, including only static lane edge information (i.e., limited information). We investigated the visual factors associated with static lane edge information that may affect these perceptions. Especially, we examined the effects of the two factors on egocentric direction and position perceptions. One is the "uprightness factor" that "far" visual information is seen at upper location than "near" visual information. The other is the "central vision factor" that observers usually look at "far" visual information using central vision (i.e., foveal vision) whereas 'near' visual information using peripheral vision. Experiment 1 examined the effect of the "uprightness factor" using normal and inverted road images. Experiment 2 examined the effect of the "central vision factor" using normal and transposed road images where the upper half of the normal image was presented under the lower half. Experiment 3 aimed to replicate the results of Experiments 1 and 2. Results showed that egocentric direction perception is interfered with image inversion or image transposition, whereas egocentric position perception is robust against these image transformations. That is, both "uprightness" and "central vision" factors are important for egocentric direction perception, but not for egocentric position perception. Therefore, the two visual spatial perceptions about observers' own viewpoints are fundamentally dissociable.

Neural mechanisms for discounting head-roll-induced retinal motion

An extensive series of physiological studies in macaques shows the existence of neurons in three multisensory cortical regions, dorsal medial superior temporal area (MSTd), ventral intraparietal area (VIP), and visual posterior sylvian area (VPS), that are tuned for direction of self-motion in both visual and vestibular modalities. Some neurons have congruent direction preferences, suggesting integration of signals for optimum encoding of self-motion trajectory; others have opposite preferences and could be used for discounting retinal motion that arises from perceptually irrelevant head motion. Whether such a system exists in humans is unknown. Here, artificial vestibular stimulation was administered to human participants during fMRI scanning in conjunction with carefully calibrated visual stimulation that emulated either congruent or opposite stimulation conditions. Direction and speed varied sinusoidally, such that the two conditions contained identical vestibular stimulation and identical retinal stimulation, differing only in the relative phase of the two components. In human MST and putative VIP, multivoxel pattern analysis permitted classification of stimulus phase based on fMRI time-series data, consistent with the existence of separate neuron populations responsive to congruent and opposite cue combinations. Decoding was also possible in the vicinity of parieto-insular vestibular cortex, possibly in a homolog of macaque VPS.

Neural substrates underlying the passive observation and active control of translational egomotion

Moving or static obstacles often get in the way while walking in daily life. Avoiding obstacles involves both perceptual processing of motion information and controlling appropriate defensive movements. Several higher-level motion areas, including the ventral intraparietal area (VIP), medial superior temporal area, parieto-insular vestibular cortex (PIVC), areas V6 and V6A, and cingulate sulcus visual area, have been identified in humans by passive viewing of optic flow patterns that simulate egomotion and object motion. However, the roles of these areas in the active control of egomotion in the real world remain unclear. Here, we used functional magnetic resonance imaging (fMRI) to map the neural substrates underlying the passive observation and active control of translational egomotion in humans. A wide-field virtual reality environment simulated a daily scenario where doors randomly swing outward while walking in a hallway. The stimuli of door-dodging events were essentially the same in two event-related fMRI experiments, which compared passive and active dodges in response to swinging doors. Passive dodges were controlled by a computer program, while active dodges were controlled by the subject. Passive dodges activated several higher-level areas distributed across three dorsal motion streams in the temporal, parietal, and cingulate cortex. Active dodges most strongly activated the temporal-vestibular stream, with peak activation located in the right PIVC. Other higher-level motion areas including VIP showed weaker to no activation in active dodges. These results suggest that PIVC plays an active role in sensing and guiding translational egomotion that moves an observer aside from impending obstacles.

Distributed cognitive maps reflecting real distances between places and views in the human brain

KEEPING ORIENTED IN THE ENVIRONMENT IS A MULTIFACETED ABILITY THAT REQUIRES KNOWLEDGE OF AT LEAST THREE PIECES OF INFORMATION: one's own location ("place") and orientation ("heading") within the environment, and which location in the environment one is looking at ("view"). We used functional magnetic resonance imaging (fMRI) in humans to examine the neural signatures of these information. Participants were scanned while viewing snapshots which varied for place, view and heading within a virtual room. We observed adaptation effects, proportional to the physical distances between consecutive places and views, in scene-responsive (retrosplenial complex and parahippocampal gyrus), fronto-parietal and lateral occipital regions. Multivoxel pattern classification of signals in scene-responsive regions and in the hippocampus allowed supra-chance decoding of place, view and heading, and revealed the existence of map-like representations, where places and views closer in physical space entailed activity patterns more similar in neural representational space. The pattern of hippocampal activity reflected both view- and place-based distances, the pattern of parahippocampal activity preferentially discriminated between views, and the pattern of retrosplenial activity combined place and view information, while the fronto-parietal cortex only showed transient effects of changes in place, view, and heading. Our findings provide evidence for the presence of map-like spatial representations which reflect metric distances in terms of both one's own and landmark locations.