Differential Responses to a Visual Self-Motion Signal in Human Medial Cortical Regions Revealed by Wide-View Stimulation

Motion sickness resistant people showed suppressed steady-state visually evoked potential (SSVEP) under vection-inducing stimulation

Visual stimulation can generate illusory self-motion perception (vection) and cause motion sickness among susceptible people, but the underlying neural mechanism is not fully understood. In this study, SSVEP responses to visual stimuli presented in different parts of the visual field are examined in individuals with different susceptibilities to motion sickness to identify correlates of motion sickness. Alpha band SSVEP data were collected from fifteen university students when they were watching roll-vection-inducing visual stimulation containing: (1) an achromatic checkerboard flickering at 8.6 Hz in the central visual field (CVF) and (2) rotating dots pattern flickering at 12 Hz in the peripheral visual field. Rotating visual stimuli provoked explicit roll-vection perception in all participants. The motion sickness resistant participants showed reduced SSVEP response to CVF checkerboard during vection, while the motion sickness susceptible participants showed increased SSVEP response. The changes of SSVEP in the presence of vection significantly correlated with individual motion sickness susceptibility and rated scores on simulator sickness symptoms. Discussion on how the findings can support the sensory conflict theory is presented. Results offer a new perspective on vection and motion sickness susceptibility.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-023-09991-7.

Common and specific activations supporting optic flow processing and navigation as revealed by a meta-analysis of neuroimaging studies

Optic flow provides useful information in service of spatial navigation. However, whether brain networks supporting these two functions overlap is still unclear. Here we used Activation Likelihood Estimation (ALE) to assess the correspondence between brain correlates of optic flow processing and spatial navigation and their specific neural activations. Since computational and connectivity evidence suggests that visual input from optic flow provides information mainly during egocentric navigation, we further tested the correspondence between brain correlates of optic flow processing and that of both egocentric and allocentric navigation. Optic flow processing shared activation with egocentric (but not allocentric) navigation in the anterior precuneus, suggesting its role in providing information about self-motion, as derived from the analysis of optic flow, in service of egocentric navigation. We further documented that optic flow perception and navigation are partially segregated into two functional and anatomical networks, i.e., the dorsal and the ventromedial networks. Present results point to a dynamic interplay between the dorsal and ventral visual pathways aimed at coordinating visually guided navigation in the environment.

Neural sensitivity to translational self- and object-motion velocities

The ability to detect and assess world-relative object-motion is a critical computation performed by the visual system. This computation, however, is greatly complicated by the observer's movements, which generate a global pattern of motion on the observer's retina. How the visual system implements this computation is poorly understood. Since we are potentially able to detect a moving object if its motion differs in velocity (or direction) from the expected optic flow generated by our own motion, here we manipulated the relative motion velocity between the observer and the object within a stationary scene as a strategy to test how the brain accomplishes object-motion detection. Specifically, we tested the neural sensitivity of brain regions that are known to respond to egomotion-compatible visual motion (i.e., egomotion areas: cingulate sulcus visual area, posterior cingulate sulcus area, posterior insular cortex [PIC], V6+, V3A, IPSmot/VIP, and MT+) to a combination of different velocities of visually induced translational self- and object-motion within a virtual scene while participants were instructed to detect object-motion. To this aim, we combined individual surface-based brain mapping, task-evoked activity by functional magnetic resonance imaging, and parametric and representational similarity analyses. We found that all the egomotion regions (except area PIC) responded to all the possible combinations of self- and object-motion and were modulated by the self-motion velocity. Interestingly, we found that, among all the egomotion areas, only MT+, V6+, and V3A were further modulated by object-motion velocities, hence reflecting their possible role in discriminating between distinct velocities of self- and object-motion. We suggest that these egomotion regions may be involved in the complex computation required for detecting scene-relative object-motion during self-motion.

EEG analysis of the visual motion activated vection network in left- and right-handers

Visually-induced self-motion perception (vection) relies on interaction of the visual and vestibular systems. Neuroimaging studies have identified a lateralization of the thalamo-cortical multisensory vestibular network, with left-handers exhibiting a dominance of the left hemisphere and right-handers exhibiting a dominance of the right hemisphere. Using electroencephalography (EEG), we compare the early processing of a vection-consistent visual motion stimulus against a vection-inconsistent stimulus, to investigate the temporal activation of the vection network by visual motion stimulation and the lateralization of these processes in left- versus right-handers. In both groups, vection-consistent stimulation evoked attenuated central event-related potentials (ERPs) in an early (160-220 ms) and a late (260-300 ms) time window. Differences in estimated source activity were found across visual, sensorimotor, and multisensory vestibular cortex in the early window, and were observed primarily in the posterior cingulate, retrosplenial cortex, and precuneus in the late window. Group comparisons revealed a larger ERP condition difference (i.e. vection-consistent stimulation minus vection-inconsistent stimulation) in left-handers, which was accompanied by group differences in the cingulate sulcus visual (CSv) area. Together, these results suggest that handedness may influence ERP responses and activity in area CSv during vection-consistent and vection-inconsistent visual motion stimulation.

Cortical visual area CSv as a cingulate motor area: a sensorimotor interface for the control of locomotion

The response properties, connectivity and function of the cingulate sulcus visual area (CSv) are reviewed. Cortical area CSv has been identified in both human and macaque brains. It has similar response properties and connectivity in the two species. It is situated bilaterally in the cingulate sulcus close to an established group of medial motor/premotor areas. It has strong connectivity with these areas, particularly the cingulate motor areas and the supplementary motor area, suggesting that it is involved in motor control. CSv is active during visual stimulation but only if that stimulation is indicative of self-motion. It is also active during vestibular stimulation and connectivity data suggest that it receives proprioceptive input. Connectivity with topographically organized somatosensory and motor regions strongly emphasizes the legs over the arms. Together these properties suggest that CSv provides a key interface between the sensory and motor systems in the control of locomotion. It is likely that its role involves online control and adjustment of ongoing locomotory movements, including obstacle avoidance and maintaining the intended trajectory. It is proposed that CSv is best seen as part of the cingulate motor complex. In the human case, a modification of the influential scheme of Picard and Strick (Picard and Strick, Cereb Cortex 6:342-353, 1996) is proposed to reflect this.

Optic flow selectivity in the macaque parieto-occipital sulcus

In humans, several neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates higher-level motion areas, like V6 and the cingulate sulcus visual area (CSv). In macaque, there are few studies on the sensitivity of V6 and CSv to egomotion compatible optic flow. The only fMRI study on this issue revealed selectivity to egomotion compatible optic flow in macaque CSv but not in V6 (Cotterau et al. Cereb Cortex 27(1):330-343, 2017, but see Fan et al. J Neurosci. 35:16303-16314, 2015). Yet, it is unknown whether monkey visual motion areas MT + and V6 display any distinctive fMRI functional profile relative to the optic flow stimulation, as it is the case for the homologous human areas (Pitzalis et al., Cereb Cortex 20(2):411-424, 2010). Here, we described the sensitivity of the monkey brain to two motion stimuli (radial rings and flow fields) originally used in humans to functionally map the motion middle temporal area MT + (Tootell et al. J Neurosci 15: 3215-3230, 1995a; Nature 375:139-141, 1995b) and the motion medial parietal area V6 (Pitzalis et al. 2010), respectively. In both animals, we found regions responding only to optic flow or radial rings stimulation, and regions responding to both stimuli. A region in the parieto-occipital sulcus (likely including V6) was one of the most highly selective area for coherently moving fields of dots, further demonstrating the power of this type of stimulation to activate V6 in both humans and monkeys. We did not find any evidence that putative macaque CSv responds to Flow Fields.

Preference for locomotion-compatible curved paths and forward direction of self-motion in somatomotor and visual areas

During locomotion, leg movements define the direction of walking (forward or backward) and the path one is taking (straight or curved). These aspects of locomotion produce characteristic visual motion patterns during movement. Here, we tested whether cortical regions responding to either egomotion-compatible visual motion, or leg movements, or both, are sensitive to these locomotion-relevant aspects of visual motion. We compared a curved path (typically the visual feedback of a changing direction of movement in the environment) to a linear path for simulated forward and backward motion in an event-related fMRI experiment. We used an individual surface-based approach and two functional localizers to define (1) six egomotion-related areas (V6+, V3A, intraparietal motion area [IPSmot], cingulate sulcus visual area [CSv], posterior cingulate area [pCi], posterior insular cortex [PIC]) using the flow field stimulus and (2) three leg-related cortical regions (human PEc [hPEc], human PE [hPE] and primary somatosensory cortex [S-I]) using a somatomotor task. Then, we extracted the response from all these regions with respect to the main event-related fMRI experiment, consisting of passive viewing of an optic flow stimulus, simulating a forward or backward direction of self-motion in either linear or curved path. Results showed that some regions have a significant preference for the curved path motion (hPEc, hPE, S-I, IPSmot) or a preference for the forward motion (V3A), while other regions have both a significant preference for the curved path motion and for the forward compared to backward motion (V6+, CSv, pCi). We did not find any significant effects of the present stimuli in PIC. Since controlling locomotion mainly means controlling changes of walking direction in the environment during forward self-motion, such a differential functional profile among these cortical regions suggests that they play a differentiated role in the visual guidance of locomotion.

Classification of evoked responses to inverted faces reveals both spatial and temporal cortical response abnormalities in Autism spectrum disorder

The neurophysiology of face processing has been studied extensively in the context of social impairments associated with autism spectrum disorder (ASD), but the existing studies have concentrated mainly on univariate analyses of responses to upright faces, and, less frequently, inverted faces. The small number of existing studies on neurophysiological responses to inverted face in ASD have used univariate approaches, with divergent results. Here, we used a data-driven, classification-based, multivariate machine learning decoding approach to investigate the temporal and spatial properties of the neurophysiological evoked response for upright and inverted faces, relative to the neurophysiological evoked response for houses, a neutral stimulus. 21 (2 females) ASD and 29 (4 females) TD participants ages 7 to 19 took part in this study. Group level classification accuracies were obtained for each condition, using first the temporal domain of the evoked responses, and then the spatial distribution of the evoked responses on the cortical surface, each separately. We found that classification of responses to inverted neutral faces vs. houses was less accurate in ASD compared to TD, in both the temporal and spatial domains. In contrast, there were no group differences in the classification of evoked responses to upright neutral faces relative to houses. Using the classification in the temporal domain, lower decoding accuracies in ASD were found around 120 ms and 170 ms, corresponding the known components of the evoked responses to faces. Using the classification in the spatial domain, lower decoding accuracies in ASD were found in the right superior marginal gyrus (SMG), intra-parietal sulcus (IPS) and posterior superior temporal sulcus (pSTS), but not in core face processing areas. Importantly, individual classification accuracies from both the temporal and spatial classifiers correlated with ASD severity, confirming the relevance of the results to the ASD phenotype.

Neural activity underlying the detection of an object movement by an observer during forward self-motion: Dynamic decoding and temporal evolution of directional cortical connectivity

Relatively little is known about how the human brain identifies movement of objects while the observer is also moving in the environment. This is, ecologically, one of the most fundamental motion processing problems, critical for survival. To study this problem, we used a task which involved nine textured spheres moving in depth, eight simulating the observer's forward motion while the ninth, the target, moved independently with a different speed towards or away from the observer. Capitalizing on the high temporal resolution of magnetoencephalography (MEG) we trained a Support Vector Classifier (SVC) using the sensor-level data to identify correct and incorrect responses. Using the same MEG data, we addressed the dynamics of cortical processes involved in the detection of the independently moving object and investigated whether we could obtain confirmatory evidence for the brain activity patterns used by the classifier. Our findings indicate that response correctness could be reliably predicted by the SVC, with the highest accuracy during the blank period after motion and preceding the response. The spatial distribution of the areas critical for the correct prediction was similar but not exclusive to areas underlying the evoked activity. Importantly, SVC identified frontal areas otherwise not detected with evoked activity that seem to be important for the successful performance in the task. Dynamic connectivity further supported the involvement of frontal and occipital-temporal areas during the task periods. This is the first study to dynamically map cortical areas using a fully data-driven approach in order to investigate the neural mechanisms involved in the detection of moving objects during observer's self-motion.

Motion sickness-susceptible participants exposed to coherent rotating dot patterns show excessive N2 amplitudes and impaired theta-band phase synchronization

Visually induced motion sickness (VIMS) can occur via prolonged exposure to visual stimulation that generates the illusion of self-motion (vection). Not everyone is susceptible to VIMS and the neural mechanism underlying susceptibility is unclear. This study explored the differences of electroencephalographic (EEG) signatures between VIMS-susceptible and VIMS-resistant groups. Thirty-two-channel EEG data were recorded from 12 VIMS-susceptible and 15 VIMS-resistant university students while they were watching two patterns of moving dots: (1) a coherent rotation pattern (vection-inducing and potentially VIMS-provoking pattern), and (2) a random movement pattern (non-VIMS-provoking control). The VIMS-susceptible group exhibited a significantly larger increase in the parietal N2 response when exposed to the coherent rotating pattern than when exposed to control patterns. In members of the VIMS-resistant group, before vection onset, global connectivity from all other EEG electrodes to the right-temporal-parietal and to the right-central areas increased, whereas after vection onset the global connectivity to the right-frontal area reduced. Such changes were not observed in the susceptible group. Further, the increases in N2 amplitude and the identified phase synchronization index were significantly correlated with individual motion sickness susceptibility. Results suggest that VIMS susceptibility is associated with systematic impairment of dynamic cortical coordination as captured by the phase synchronization of cortical activities. Analyses of dynamic EEG signatures could be a means to unlock the neural mechanism of VIMS.

Neural bases of self- and object-motion in a naturalistic vision

To plan movements toward objects our brain must recognize whether retinal displacement is due to self-motion and/or to object-motion. Here, we aimed to test whether motion areas are able to segregate these types of motion. We combined an event-related functional magnetic resonance imaging experiment, brain mapping techniques, and wide-field stimulation to study the responsivity of motion-sensitive areas to pure and combined self- and object-motion conditions during virtual movies of a train running within a realistic landscape. We observed a selective response in MT to the pure object-motion condition, and in medial (PEc, pCi, CSv, and CMA) and lateral (PIC and LOR) areas to the pure self-motion condition. Some other regions (like V6) responded more to complex visual stimulation where both object- and self-motion were present. Among all, we found that some motion regions (V3A, LOR, MT, V6, and IPSmot) could extract object-motion information from the overall motion, recognizing the real movement of the train even when the images remain still (on the screen), or moved, because of self-movements. We propose that these motion areas might be good candidates for the "flow parsing mechanism," that is the capability to extract object-motion information from retinal motion signals by subtracting out the optic flow components.

Egomotion-related visual areas respond to active leg movements

Monkey neurophysiology and human neuroimaging studies have demonstrated that passive viewing of optic flow stimuli activates a cortical network of temporal, parietal, insular, and cingulate visual motion regions. Here, we tested whether the human visual motion areas involved in processing optic flow signals simulating self-motion are also activated by active lower limb movements, and hence are likely involved in guiding human locomotion. To this aim, we used a combined approach of task-evoked activity and resting-state functional connectivity by fMRI. We localized a set of six egomotion-responsive visual areas (V6+, V3A, intraparietal motion/ventral intraparietal [IPSmot/VIP], cingulate sulcus visual area [CSv], posterior cingulate sulcus area [pCi], posterior insular cortex [PIC]) by using optic flow. We tested their response to a motor task implying long-range active leg movements. Results revealed that, among these visually defined areas, CSv, pCi, and PIC responded to leg movements (visuomotor areas), while V6+, V3A, and IPSmot/VIP did not (visual areas). Functional connectivity analysis showed that visuomotor areas are connected to the cingulate motor areas, the supplementary motor area, and notably to the medial portion of the somatosensory cortex, which represents legs and feet. We suggest that CSv, pCi, and PIC perform the visual analysis of egomotion-like signals to provide sensory information to the motor system with the aim of guiding locomotion.

Driving Ability in Alzheimer Disease Spectrum: Neural Basis, Assessment, and Potential Use of Optic Flow Event-Related Potentials

Driving requires multiple cognitive functions including visuospatial perception and recruits widespread brain networks. Recently, traffic accidents in dementia, particularly in Alzheimer disease spectrum (ADS), have increased and become an urgent social problem. Therefore, it is necessary to develop the objective and reliable biomarkers for driving ability in patients with ADS. Interestingly, even in the early stage of the disease, patients with ADS are characterized by the impairment of visuospatial function such as radial optic flow (OF) perception related to self-motion perception. For the last decade, we have studied the feasibility of event-related potentials (ERPs) in response to radial OF in ADS and proposed that OF-ERPs provided an additional information on the alteration of visuospatial perception in ADS (1, 2). Hence, we hypothesized that OF-ERPs can be a possible predictive biomarker of driving ability in ADS. In this review, the recent concept of neural substrates of driving in healthy humans are firstly outlined. Second, we mention the alterations of driving performance and its brain network in ADS. Third, the current status of assessment tools for driving ability is stated. Fourth, we describe ERP studies related to driving ability in ADS. Further, the neural basis of OF processing and OF-ERPs in healthy humans are mentioned. Finally, the application of OF-ERPs to ADS is described. The aim of this review was to introduce the potential use of OF-ERPs for assessment of driving ability in ADS.

The parieto-insular vestibular cortex in humans: more than a single area?

Here, we review the structure and function of a core region in the vestibular cortex of humans that is located in the midposterior Sylvian fissure and referred to as the parieto-insular vestibular cortex (PIVC). Previous studies have investigated PIVC by using vestibular or visual motion stimuli and have observed activations that were distributed across multiple anatomical structures, including the temporo-parietal junction, retroinsula, parietal operculum, and posterior insula. However, it has remained unclear whether all of these anatomical areas correspond to PIVC and whether PIVC responds to both vestibular and visual stimuli. Recent results suggest that the region that has been referred to as PIVC in previous studies consists of multiple areas with different anatomical correlates and different functional specializations. Specifically, a vestibular but not visual area is located in the parietal operculum, close to the posterior insula, and likely corresponds to the nonhuman primate PIVC, while a visual-vestibular area is located in the retroinsular cortex and is referred to, for historical reasons, as the posterior insular cortex area (PIC). In this article, we review the anatomy, connectivity, and function of PIVC and PIC and propose that the core of the human vestibular cortex consists of at least two separate areas, which we refer to together as PIVC+. We also review the organization in the nonhuman primate brain and show that there are parallels to the proposed organization in humans.

Cortical BOLD responses to moderate- and high-speed motion in the human visual cortex

We investigated the BOLD response of visual cortical and sub-cortical regions to fast drifting motion presented over wide fields, including the far periphery. Stimuli were sinusoidal gratings of 50% contrast moving at moderate and very high speeds (38 and 570 °/s), projected to a large field of view (~60°). Both stimuli generated strong and balanced responses in the lateral geniculate nucleus and the superior colliculus. In visual cortical areas, responses were evaluated at three different eccentricities: central 0-15°; peripheral 20-30°; and extreme peripheral 30-60°. "Ventral stream" areas (V2, V3, V4) preferred moderate-speeds in the central visual field, while motion area MT+ responded equally well to both speeds at all eccentricities. In all other areas and eccentricities BOLD responses were significant and equally strong for both types of moving stimuli. Support vector machine showed that the direction of the fast-speed motion could be successfully decoded from the BOLD response in all visual areas, suggesting that responses are mediated by motion mechanisms rather than being an unspecific preference for fast rate of flicker. The results show that the visual cortex responds to very fast motion, at speeds generated when we move our eyes rapidly, or when moving objects pass by closely.

Spatiotemporal integration of looming visual and tactile stimuli near the face

Real-world objects approaching or passing by an observer often generate visual, auditory, and tactile signals with different onsets and durations. Prompt detection and avoidance of an impending threat depend on precise binding of looming signals across modalities. Here we constructed a multisensory apparatus to study the spatiotemporal integration of looming visual and tactile stimuli near the face. In a psychophysical experiment, subjects assessed the subjective synchrony between a looming ball and an air puff delivered to the same side of the face with a varying temporal offset. Multisensory stimuli with similar onset times were perceived as completely out of sync and assessed with the lowest subjective synchrony index (SSI). Across subjects, the SSI peaked at an offset between 800 and 1,000 ms, where the multisensory stimuli were perceived as optimally in sync. In an fMRI experiment, tactile, visual, tactile-visual out-of-sync (TVoS), and tactile-visual in-sync (TViS) stimuli were delivered to either side of the face in randomized events. Group-average statistical responses to different stimuli were compared within each surface-based region of interest (sROI) outlined on the cortical surface. Most sROIs showed a preference for contralateral stimuli and higher responses to multisensory than unisensory stimuli. In several bilateral sROIs, particularly the human MT+ complex and V6A, responses to spatially aligned multisensory stimuli (TVoS) were further enhanced when the stimuli were in-sync (TViS), as expressed by TVoS < TViS. This study demonstrates the perceptual and neural mechanisms of multisensory integration near the face, which has potential applications in the development of multisensory entertainment systems and media.

Computational neuroanatomy of human stratum proprium of interparietal sulcus

Recent advances in diffusion-weighted MRI (dMRI) and tractography have enabled identification of major long-range white matter tracts in the human brain. Yet, our understanding of shorter tracts, such as those within the parietal lobe, remains limited. Over a century ago, a tract connecting the superior and inferior parts of the parietal cortex was identified in a post-mortem study: stratum proprium of interparietal sulcus (SIPS; Sachs, Das hemisphärenmark des menschlichen grosshirns. Verlag von georg thieme, Leipzig, 1892). The tract has since been replicated in another fibre dissection study (Vergani et al., Cortex 56:145-156, 2014), however, it has not been fully investigated in the living human brain and its precise anatomical properties are yet to be described. We used dMRI and tractography to identify and characterise SIPS in vivo, and explored its spatial proximity to the cortical areas associated with optic-flow processing using fMRI. SIPS was identified bilaterally in all subjects, and its anatomical position and trajectory are consistent with previous post-mortem studies. Subsequent evaluation of the tractography results using the linear fascicle evaluation and virtual lesion analysis yielded strong statistical evidence for SIPS. We also found that the SIPS endpoints are adjacent to the optic-flow selective areas. In sum, we show that SIPS is a short-range tract connecting the superior and inferior parts of the parietal cortex, wrapping around the intraparietal sulcus, and that it may be a crucial anatomy underlying optic-flow processing. In vivo identification and characterisation of SIPS will facilitate further research on SIPS in relation to cortical functions, their development, and diseases that affect them.

Binasal Occlusion (BNO), Visual Motion Sensitivity (VMS), and the Visually-Evoked Potential (VEP) in mild Traumatic Brain Injury and Traumatic Brain Injury (mTBI/TBI)

The diagnosis and treatment of the possible visual sequelae in those with traumatic brain injury (TBI) represents an important area of health care in this special population. One of their most prevalent yet elusive visual symptoms is visual motion sensitivity (VMS). In this review, we present the basic VMS phenomenon and its related symptoms, clinical studies in the area, clinical research investigations using the visual-evoked potential (VEP) as a cortical probe, and possible mechanisms and related neurophysiology that may underlie VMS. Lastly, therapeutic interventions are briefly described, as well as future directions for clinical research and patient care in those with VMS and TBI.

Cortical Correlates of the Simulated Viewpoint Oscillation Advantage for Vection

Behavioural studies have consistently found stronger vection responses for oscillating, compared to smooth/constant, patterns of radial flow (the simulated viewpoint oscillation advantage for vection). Traditional accounts predict that simulated viewpoint oscillation should impair vection by increasing visual–vestibular conflicts in stationary observers (as this visual oscillation simulates self-accelerations that should strongly stimulate the vestibular apparatus). However, support for increased vestibular activity during accelerating vection has been mixed in the brain imaging literature. This fMRI study examined BOLD activity in visual (cingulate sulcus visual area — CSv; medial temporal complex — MT+; V6; precuneus motion area — PcM) and vestibular regions (parieto-insular vestibular cortex — PIVC/posterior insular cortex — PIC; ventral intraparietal region — VIP) when stationary observers were exposed to vection-inducing optic flow (i.e., globally coherent oscillating and smooth self-motion displays) as well as two suitable control displays. In line with earlier studies in which no vection occurred, CSv and PIVC/PIC both showed significantly increased BOLD activity during oscillating global motion compared to the other motion conditions (although this effect was found for fewer subjects in PIVC/PIC). The increase in BOLD activity in PIVC/PIC during prolonged exposure to the oscillating (compared to smooth) patterns of global optical flow appears consistent with vestibular facilitation.