The retinotopic organization of the human middle temporal area MT/V5 and its cortical neighbors

Exploring oculomotor functions in a pilot study with healthy controls: Insights from eye-tracking and fMRI

Eye-tracking techniques have gained widespread application in various fields including research on the visual system, neurosciences, psychology, and human-computer interaction, with emerging clinical implications. In this preliminary phase of our study, we introduce a pilot test of innovative virtual reality technology designed for tracking head and eye movements among healthy individuals. This tool was developed to assess the presence of mild traumatic brain injury (mTBI), given the frequent association of oculomotor function deficits with such injuries. Alongside eye-tracking, we also integrated fMRI due to the complementary nature of these techniques, offering insights into both neural activation patterns and behavioural responses, thereby providing a comprehensive understanding of oculomotor function. We used fMRI with tasks evaluating oculomotor functions: Smooth Pursuit (SP), Saccades, Anti-Saccades, and Optokinetic Nystagmus (OKN). Prior to the scanning, the testing with a system of VR goggles with integrated eye and head tracking was used where subjects performed the same tasks as those used in fMRI. 31 healthy adult controls (HCs) were tested with the purpose of identifying brain regions associated with these tasks and collecting preliminary norms for later comparison with concussed subjects. HCs' fMRI results showed following peak activation regions: SP-cuneus, superior parietal lobule, paracentral lobule, inferior parietal lobule (IPL), cerebellartonsil (CT); Saccades-middle frontal gyrus (MFG), postcentral gyrus, medial frontal gyrus; Anti-saccades-precuneus, IPL, MFG; OKN-middle temporal gyrus, ACC, postcentral gyrus, MFG, CT. These results demonstrated brain regions associated with the performance on oculomotor tasks in healthy controls and most of the highlighted areas are corresponding with those affected in concussion. This suggests that the involvement of brain areas susceptible to mTBI in implementing oculomotor evaluation, taken together with commonly reported oculomotor difficulties post-concussion, may lead to finding objective biomarkers using eye-tracking tasks.

Common and specific activations supporting optic flow processing and navigation as revealed by a meta-analysis of neuroimaging studies

Optic flow provides useful information in service of spatial navigation. However, whether brain networks supporting these two functions overlap is still unclear. Here we used Activation Likelihood Estimation (ALE) to assess the correspondence between brain correlates of optic flow processing and spatial navigation and their specific neural activations. Since computational and connectivity evidence suggests that visual input from optic flow provides information mainly during egocentric navigation, we further tested the correspondence between brain correlates of optic flow processing and that of both egocentric and allocentric navigation. Optic flow processing shared activation with egocentric (but not allocentric) navigation in the anterior precuneus, suggesting its role in providing information about self-motion, as derived from the analysis of optic flow, in service of egocentric navigation. We further documented that optic flow perception and navigation are partially segregated into two functional and anatomical networks, i.e., the dorsal and the ventromedial networks. Present results point to a dynamic interplay between the dorsal and ventral visual pathways aimed at coordinating visually guided navigation in the environment.

Orienting role of the putative human posterior infero-temporal area in visual attention

The dorsal attention network (DAN) is a network of brain regions essential for attentional orienting, which includes the lateral intraparietal area (LIP) and frontal eye field (FEF). Recently, the putative human dorsal posterior infero-temporal area (phPITd) has been identified as a new node of the DAN. However, its functional relationship with other areas of the DAN and its specific role in visual attention remained unclear. In this study, we analyzed a large publicly available neuroimaging dataset to investigate the intrinsic functional connectivities (FCs) of the phPITd with other brain areas. The results showed that the intrinsic FCs of the phPITd with the areas of the visual network and the DAN were significantly stronger than those with the ventral attention network (VAN) areas and areas of other networks. We further conducted individual difference analyses with a sample size of 295 participants and a series of attentional tasks to investigate which attentional components each phPITd-based DAN edge predicts. Our findings revealed that the intrinsic FC of the left phPITd with the LIPv could predict individual ability in attentional orienting, but not in alerting, executive control, and distractor suppression. Our results not only provide direct evidence of the phPITd's functional relationship with the LIPv, but also offer a comprehensive understanding of its specific role in visual attention.

Neural Representations of Observed Interpersonal Synchrony/Asynchrony in the Social Perception Network

The visual perception of individuals is thought to be mediated by a network of regions in the occipitotemporal cortex that supports specialized processing of faces, bodies, and actions. In comparison, we know relatively little about the neural mechanisms that support the perception of multiple individuals and the interactions between them. The present study sought to elucidate the visual processing of social interactions by identifying which regions of the social perception network represent interpersonal synchrony. In an fMRI study with 32 human participants (26 female, 6 male), we used multivoxel pattern analysis to investigate whether activity in face-selective, body-selective, and interaction-sensitive regions across the social perception network supports the decoding of synchronous versus asynchronous head-nodding and head-shaking. Several regions were found to support significant decoding of synchrony/asynchrony, including extrastriate body area (EBA), face-selective and interaction-sensitive mid/posterior right superior temporal sulcus, and occipital face area. We also saw robust cross-classification across actions in the EBA, suggestive of movement-invariant representations of synchrony/asynchrony. Exploratory whole-brain analyses also identified a region of the right fusiform cortex that responded more strongly to synchronous than to asynchronous motion. Critically, perceiving interpersonal synchrony/asynchrony requires the simultaneous extraction and integration of dynamic information from more than one person. Hence, the representation of synchrony/asynchrony cannot be attributed to augmented or additive processing of individual actors. Our findings therefore provide important new evidence that social interactions recruit dedicated visual processing within the social perception network that extends beyond that engaged by the faces and bodies of the constituent individuals.

Impaired visual-motor functional connectivity in first-episode medication-naïve patients with major depressive disorder

The perceptual dysfunctions have been fundamental causes of cognitive and emotional problems in patients with major depressive disorder. However, visual system impairment in depression has been underexplored. Here, we explored functional connectivity in a large cohort of first-episode medication-naïve patients with major depressive disorder (n = 190) and compared it with age- and sex-matched healthy controls (n = 190). A recently developed individual-oriented approach was applied to parcellate the cerebral cortex into 92 regions of interest using resting-state functional magnetic resonance imaging data. Significant reductions in functional connectivities were observed between the right lateral occipitotemporal junction within the visual network and 2 regions of interest within the sensorimotor network in patients. The volume of right lateral occipitotemporal junction was also significantly reduced in major depressive disorder patients, indicating that this visual region is anatomically and functionally impaired. Behavioral correlation analysis showed that the reduced functional connectivities were significantly associated with inhibition control in visual-motor processing in patients. Taken together, our data suggest that functional connectivity between visual network and sensorimotor network already shows a significant reduction in the first episode of major depressive disorder, which may interfere with the inhibition control in visual-motor processing. The lateral occipitotemporal junction may be a hub of disconnection and may play a role in the pathophysiology of major depressive disorder.

Neuroimaging evidence of visual-vestibular interaction accounting for perceptual mislocalization induced by head rotation

Significance

A fleeting flash aligned vertically with an object remaining stationary in the head-centered space would be perceived as lagging behind the object during the observer's horizontal head rotation. This perceptual mislocalization is an illusion named head-rotation-induced flash-lag effect (hFLE). While many studies have investigated the neural mechanism of the classical visual FLE, the hFLE has been hardly investigated.

Aim

We measured the cortical activity corresponding to the hFLE on participants experiencing passive head rotations using functional near-infrared spectroscopy.

Approach

Participants were asked to judge the relative position of a flash to a fixed reference while being horizontally rotated or staying static in a swivel chair. Meanwhile, functional near-infrared spectroscopy signals were recorded in temporal-parietal areas. The flash duration was manipulated to provide control conditions.

Results

Brain activity specific to the hFLE was found around the right middle/inferior temporal gyri, and bilateral supramarginal gyri and superior temporal gyri areas. The activation was positively correlated with the rotation velocity of the participant around the supramarginal gyrus and negatively related to the hFLE intensity around the middle temporal gyrus.

Conclusions

These results suggest that the mechanism underlying the hFLE involves multiple aspects of visual-vestibular interactions including the processing of multisensory conflicts mediated by the temporoparietal junction and the modulation of vestibular signals on object position perception in the human middle temporal complex.

A human cortical adaptive mutual inhibition circuit underlying competition for perceptual decision and repetition suppression reversal

A model based on inhibitory coupling has been proposed to explain perceptual oscillations. This 'adapting reciprocal inhibition' model postulates that it is the strength of inhibitory coupling that determines the fate of competition between percepts. Here, we used an fMRI-based adaptation technique to reveal the influence of neighboring neuronal populations, such as reciprocal inhibition, in motion-selective hMT+/V5. If reciprocal inhibition exists in this region, the following predictions should hold: 1. stimulus-driven response would not simply decrease, as predicted by simple repetition-suppression of neuronal populations, but instead, increase due to the activity from adjacent populations; 2. perceptual decision involving competing representations, should reflect decreased reciprocal inhibition by adaptation; 3. neural activity for the competing percept should also later on increase upon adaptation. Our results confirm these three predictions, showing that a model of perceptual decision based on adapting reciprocal inhibition holds true. Finally, they also show that the net effect of the well-known repetition suppression phenomenon can be reversed by this mechanism.

Neural sensitivity to translational self- and object-motion velocities

The ability to detect and assess world-relative object-motion is a critical computation performed by the visual system. This computation, however, is greatly complicated by the observer's movements, which generate a global pattern of motion on the observer's retina. How the visual system implements this computation is poorly understood. Since we are potentially able to detect a moving object if its motion differs in velocity (or direction) from the expected optic flow generated by our own motion, here we manipulated the relative motion velocity between the observer and the object within a stationary scene as a strategy to test how the brain accomplishes object-motion detection. Specifically, we tested the neural sensitivity of brain regions that are known to respond to egomotion-compatible visual motion (i.e., egomotion areas: cingulate sulcus visual area, posterior cingulate sulcus area, posterior insular cortex [PIC], V6+, V3A, IPSmot/VIP, and MT+) to a combination of different velocities of visually induced translational self- and object-motion within a virtual scene while participants were instructed to detect object-motion. To this aim, we combined individual surface-based brain mapping, task-evoked activity by functional magnetic resonance imaging, and parametric and representational similarity analyses. We found that all the egomotion regions (except area PIC) responded to all the possible combinations of self- and object-motion and were modulated by the self-motion velocity. Interestingly, we found that, among all the egomotion areas, only MT+, V6+, and V3A were further modulated by object-motion velocities, hence reflecting their possible role in discriminating between distinct velocities of self- and object-motion. We suggest that these egomotion regions may be involved in the complex computation required for detecting scene-relative object-motion during self-motion.

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Inhibitory TMS over Visual Area V5/MT Disrupts Visual Speech Recognition

During face-to-face communication, the perception and recognition of facial movements can facilitate individuals' understanding of what is said. Facial movements are a form of complex biological motion. Separate neural pathways are thought to processing (1) simple, nonbiological motion with an obligatory waypoint in the motion-sensitive visual middle temporal area (V5/MT); and (2) complex biological motion. Here, we present findings that challenge this dichotomy. Neuronavigated offline transcranial magnetic stimulation (TMS) over V5/MT on 24 participants (17 females and 7 males) led to increased response times in the recognition of simple, nonbiological motion as well as visual speech recognition compared with TMS over the vertex, an active control region. TMS of area V5/MT also reduced practice effects on response times, that are typically observed in both visual speech and motion recognition tasks over time. Our findings provide the first indication that area V5/MT causally influences the recognition of visual speech.SIGNIFICANCE STATEMENT In everyday face-to-face communication, speech comprehension is often facilitated by viewing a speaker's facial movements. Several brain areas contribute to the recognition of visual speech. One area of interest is the motion-sensitive visual medial temporal area (V5/MT), which has been associated with the perception of simple, nonbiological motion such as moving dots, as well as more complex, biological motion such as visual speech. Here, we demonstrate using noninvasive brain stimulation that area V5/MT is causally relevant in recognizing visual speech. This finding provides new insights into the neural mechanisms that support the perception of human communication signals, which will help guide future research in typically developed individuals and populations with communication difficulties.

Dissociating representations of affect and motion in visual cortices

While a delicious dessert being presented to us may elicit strong feelings of happiness and excitement, the same treat falling slowly away can lead to sadness and disappointment. Our emotional response to the item depends on its visual motion direction. Despite this importance, it remains unclear whether (and how) cortical areas devoted to decoding motion direction represents or integrates emotion with perceived motion direction. Motion-selective visual area V5/MT+ sits, both functionally and anatomically, at the nexus of dorsal and ventral visual streams. These pathways, however, differ in how they are modulated by emotional cues. The current study was designed to disentangle how emotion and motion perception interact, as well as use emotion-dependent modulation of visual cortices to understand the relation of V5/MT+ to canonical processing streams. During functional magnetic resonance imaging (fMRI), approaching, receding, or static motion after-effects (MAEs) were induced on stationary positive, negative, and neutral stimuli. An independent localizer scan was conducted to identify the visual-motion area V5/MT+. Through univariate and multivariate analyses, we demonstrated that emotion representations in V5/MT+ share a more similar response profile to that observed in ventral visual than dorsal, visual structures. Specifically, V5/MT+ and ventral structures were sensitive to the emotional content of visual stimuli, whereas dorsal visual structures were not. Overall, this work highlights the critical role of V5/MT+ in the representation and processing of visually acquired emotional content. It further suggests a role for this region in utilizing affectively salient visual information to augment motion perception of biologically relevant stimuli.

Lateralization of the cerebral network of inhibition in children before and after cognitive training

Inhibitory control (IC) plays a critical role in cognitive and socio-emotional development. IC relies on a lateralized cortico-subcortical brain network including the inferior frontal cortex, anterior parts of insula, anterior cingulate cortex, caudate nucleus and putamen. Brain asymmetries play a critical role for IC efficiency. In parallel to age-related changes, IC can be improved following training. The aim of this study was to (1) assess the lateralization of IC network in children (N = 60, 9-10 y.o.) and (2) examine possible changes in neural asymmetry of this network from anatomical (structural MRI) and functional (resting-state fMRI) levels after 5-week computerized IC vs. active control (AC) training. We observed that IC training, but not AC training, led to a leftward lateralization of the putamen anatomy, similarly to what is observed in adults, supporting that training could accelerate the maturation of this structure.

The Bouma law accounts for crowding in 50 observers

Crowding is the failure to recognize an object due to surrounding clutter. Our visual crowding survey measured 13 crowding distances (or "critical spacings") twice in each of 50 observers. The survey includes three eccentricities (0, 5, and 10 deg), four cardinal meridians, two orientations (radial and tangential), and two fonts (Sloan and Pelli). The survey also tested foveal acuity, twice. Remarkably, fitting a two-parameter model-the well-known Bouma law, where crowding distance grows linearly with eccentricity-explains 82% of the variance for all 13 × 50 measured log crowding distances, cross-validated. An enhanced Bouma law, with factors for meridian, crowding orientation, target kind, and observer, explains 94% of the variance, again cross-validated. These additional factors reveal several asymmetries, consistent with previous reports, which can be expressed as crowding-distance ratios: 0.62 horizontal:vertical, 0.79 lower:upper, 0.78 right:left, 0.55 tangential:radial, and 0.78 Sloan-font:Pelli-font. Across our observers, peripheral crowding is independent of foveal crowding and acuity. Evaluation of the Bouma factor, b (the slope of the Bouma law), as a biomarker of visual health would be easier if there were a way to compare results across crowding studies that use different methods. We define a standardized Bouma factor b' that corrects for differences from Bouma's 25 choice alternatives, 75% threshold criterion, and linearly symmetric flanker placement. For radial crowding on the right meridian, the standardized Bouma factor b' is 0.24 for this study, 0.35 for Bouma (1970), and 0.30 for the geometric mean across five representative modern studies, including this one, showing good agreement across labs, including Bouma's. Simulations, confirmed by data, show that peeking can skew estimates of crowding (e.g., greatly decreasing the mean or doubling the SD of log b). Using gaze tracking to prevent peeking, individual differences are robust, as evidenced by the much larger 0.08 SD of log b across observers than the mere 0.03 test-retest SD of log b measured in half an hour. The ease of measurement of crowding enhances its promise as a biomarker for dyslexia and visual health.

Imaging the columnar functional organization of human area MT+ to axis-of-motion stimuli using VASO at 7 Tesla

Cortical columns of direction-selective neurons in the motion sensitive area (MT) have been successfully established as a microscopic feature of the neocortex in animals. The same property has been investigated at mesoscale (<1 mm) in the homologous brain area (hMT+, V5) in living humans by using ultra-high field functional magnetic resonance imaging (fMRI). Despite the reproducibility of the selective response to axis-of-motion stimuli, clear quantitative evidence for the columnar organization of hMT+ is still lacking. Using cerebral blood volume (CBV)-sensitive fMRI at 7 Tesla with submillimeter resolution and high spatial specificity to microvasculature, we investigate the columnar functional organization of hMT+ in 5 participants perceiving axis-of-motion stimuli for both blood oxygenation level dependent (BOLD) and vascular space occupancy (VASO) contrast mechanisms provided by the used slice-selective slab-inversion (SS-SI)-VASO sequence. With the development of a new searchlight algorithm for column detection, we provide the first quantitative columnarity map that characterizes the entire 3D hMT+ volume. Using voxel-wise measures of sensitivity and specificity, we demonstrate the advantage of using CBV-sensitive fMRI to detect mesoscopic cortical features by revealing higher specificity of axis-of-motion cortical columns for VASO as compared to BOLD contrast. These voxel-wise metrics also provide further insights on how to mitigate the highly debated draining veins effect. We conclude that using CBV-VASO fMRI together with voxel-wise measurements of sensitivity, specificity and columnarity offers a promising avenue to quantify the mesoscopic organization of hMT+ with respect to axis-of-motion stimuli. Furthermore, our approach and methodological developments are generalizable and applicable to other human brain areas where similar mesoscopic research questions are addressed.

Homotopic local-global parcellation of the human cerebral cortex from resting-state functional connectivity

Resting-state fMRI is commonly used to derive brain parcellations, which are widely used for dimensionality reduction and interpreting human neuroscience studies. We previously developed a model that integrates local and global approaches for estimating areal-level cortical parcellations. The resulting local-global parcellations are often referred to as the Schaefer parcellations. However, the lack of homotopic correspondence between left and right Schaefer parcels has limited their use for brain lateralization studies. Here, we extend our previous model to derive homotopic areal-level parcellations. Using resting-fMRI and task-fMRI across diverse scanners, acquisition protocols, preprocessing and demographics, we show that the resulting homotopic parcellations are as homogeneous as the Schaefer parcellations, while being more homogeneous than five publicly available parcellations. Furthermore, weaker correlations between homotopic parcels are associated with greater lateralization in resting network organization, as well as lateralization in language and motor task activation. Finally, the homotopic parcellations agree with the boundaries of a number of cortical areas estimated from histology and visuotopic fMRI, while capturing sub-areal (e.g., somatotopic and visuotopic) features. Overall, these results suggest that the homotopic local-global parcellations represent neurobiologically meaningful subdivisions of the human cerebral cortex and will be a useful resource for future studies. Multi-resolution parcellations estimated from 1479 participants are publicly available (https://github.com/ThomasYeoLab/CBIG/tree/master/stable_projects/brain_parcellation/Yan2023_homotopic).

Structural and functional asymmetry of the neonatal cerebral cortex

Features of brain asymmetry have been implicated in a broad range of cognitive processes; however, their origins are still poorly understood. Here we investigated cortical asymmetries in 442 healthy term-born neonates using structural and functional magnetic resonance images from the Developing Human Connectome Project. Our results demonstrate that the neonatal cortex is markedly asymmetric in both structure and function. Cortical asymmetries observed in the term cohort were contextualized in two ways: by comparing them against cortical asymmetries observed in 103 preterm neonates scanned at term-equivalent age, and by comparing structural asymmetries against those observed in 1,110 healthy young adults from the Human Connectome Project. While associations with preterm birth and biological sex were minimal, significant differences exist between birth and adulthood.

Mechanisms of speed encoding in the human middle temporal cortex measured by 7T fMRI

Perception of dynamic scenes in our environment results from the evaluation of visual features such as the fundamental spatial and temporal frequency components of a moving object. The ratio between these two components represents the object's speed of motion. The human middle temporal cortex hMT+ has a crucial biological role in the direct encoding of object speed. However, the link between hMT+ speed encoding and the spatiotemporal frequency components of a moving object is still under explored. Here, we recorded high resolution 7T blood oxygen level-dependent BOLD responses to different visual motion stimuli as a function of their fundamental spatial and temporal frequency components. We fitted each hMT+ BOLD response with a 2D Gaussian model allowing for two different speed encoding mechanisms: (1) distinct and independent selectivity for the spatial and temporal frequencies of the visual motion stimuli; (2) pure tuning for the speed of motion. We show that both mechanisms occur but in different neuronal groups within hMT+, with the largest subregion of the complex showing separable tuning for the spatial and temporal frequency of the visual stimuli. Both mechanisms were highly reproducible within participants, reconciling single cell recordings from MT in animals that have showed both encoding mechanisms. Our findings confirm that a more complex process is involved in the perception of speed than initially thought and suggest that hMT+ plays a primary role in the evaluation of the spatial features of the moving visual input.

The human posterior parietal cortex: effective connectome, and its relation to function

The effective connectivity between 21 regions in the human posterior parietal cortex, and 360 cortical regions was measured in 171 Human Connectome Project (HCP) participants using the HCP atlas, and complemented with functional connectivity and diffusion tractography. Intraparietal areas LIP, VIP, MIP, and AIP have connectivity from early cortical visual regions, and to visuomotor regions such as the frontal eye fields, consistent with functions in eye saccades and tracking. Five superior parietal area 7 regions receive from similar areas and from the intraparietal areas, but also receive somatosensory inputs and connect with premotor areas including area 6, consistent with functions in performing actions to reach for, grasp, and manipulate objects. In the anterior inferior parietal cortex, PFop, PFt, and PFcm are mainly somatosensory, and PF in addition receives visuo-motor and visual object information, and is implicated in multimodal shape and body image representations. In the posterior inferior parietal cortex, PFm and PGs combine visuo-motor, visual object, and reward input and connect with the hippocampal system. PGi in addition provides a route to motion-related superior temporal sulcus regions involved in social interactions. PGp has connectivity with intraparietal regions involved in coordinate transforms and may be involved in idiothetic update of hippocampal visual scene representations.

Seeing and extrapolating motion trajectories share common informative activation patterns in primary visual cortex

The natural environment is dynamic and moving objects become constantly occluded, engaging the brain in a challenging completion process to estimate where and when the object might reappear. Although motion extrapolation is critical in daily life-imagine crossing the street while an approaching car is occluded by a larger standing vehicle-its neural underpinnings are still not well understood. While the engagement of low-level visual cortex during dynamic occlusion has been postulated, most of the previous group-level fMRI-studies failed to find evidence for an involvement of low-level visual areas during occlusion. In this fMRI-study, we therefore used individually defined retinotopic maps and multivariate pattern analysis to characterize the neural basis of visible and occluded changes in motion direction in humans. To this end, participants learned velocity-direction change pairings (slow motion-upwards; fast motion-downwards or vice versa) during a training phase without occlusion and judged the change in stimulus direction, based on its velocity, during a following test phase with occlusion. We find that occluded motion direction can be predicted from the activity patterns during visible motion within low-level visual areas, supporting the notion of a mental representation of motion trajectory in these regions during occlusion.

A Large Video Set of Natural Human Actions for Visual and Cognitive Neuroscience Studies and Its Validation with fMRI

The investigation of the perception of others' actions and underlying neural mechanisms has been hampered by the lack of a comprehensive stimulus set covering the human behavioral repertoire. To fill this void, we present a video set showing 100 human actions recorded in natural settings, covering the human repertoire except for emotion-driven (e.g., sexual) actions and those involving implements (e.g., tools). We validated the set using fMRI and showed that observation of the 100 actions activated the well-established action observation network. We also quantified the videos' low-level visual features (luminance, optic flow, and edges). Thus, this comprehensive video set is a valuable resource for perceptual and neuronal studies.

Cortical adaptation of the night monkey to a nocturnal niche environment: a comparative non-invasive T1w/T2w myelin study

Night monkeys (Aotus) are the only genus of monkeys within the Simian lineage that successfully occupy a nocturnal environmental niche. Their behavior is supported by their sensory organs' distinctive morphological features; however, little is known about their evolutionary adaptations in sensory regions of the cerebral cortex. Here, we investigate this question by exploring the cortical organization of night monkeys using high-resolution in-vivo brain MRI and comparative cortical-surface T1w/T2w myeloarchitectonic mapping. Our results show that the night monkey cerebral cortex has a qualitatively similar but quantitatively different pattern of cortical myelin compared to the diurnal macaque and marmoset monkeys. T1w/T2w myelin and its gradient allowed us to parcellate high myelin areas, including the middle temporal complex (MT +) and auditory cortex, and a low-myelin area, Brodmann area 7 (BA7) in the three species, despite species differences in cortical convolutions. Relative to the total cortical-surface area, those of MT + and the auditory cortex are significantly larger in night monkeys than diurnal monkeys, whereas area BA7 occupies a similar fraction of the cortical sheet in all three species. We propose that the selective expansion of sensory areas dedicated to visual motion and auditory processing in night monkeys may reflect cortical adaptations to a nocturnal environment.

What do we see in pictures? The sensory individuals of picture perception

When I am looking at an apple, I perceptually attribute certain properties to certain entities. Two questions arise: what are these entities (what is it that I perceptually represent as having properties) and what are these properties (what properties I perceive this entity as having)? This paper is about the former, less widely explored, question: what does our perceptual system attribute properties to? In other words, what are these 'sensory individuals'. There have been important debates in philosophy of perception about what sensory individuals would be the most plausible candidates for which sense modalities. The aim of this paper is to ask a related question about picture perception: what is the sensory individual of picture perception? When we look at a picture and see an apple depicted in it, what kind of entity do we see? What do we perceptually attribute properties to? I argue that the most straightforward candidates (ordinary objects, sui generis sensory individuals, no sensory individuals) are all problematic and that the most plausible candidate for the sensory individuals of picture perception are spatiotemporal regions.

Driver's turning intent recognition model based on brain activation and contextual information

Traffic situations like turning at intersections are destined for safety-critical situations and accidents. Human errors are one of the main reasons for accidents in these situations. A model that recognizes the driver's turning intent could help to reduce accidents by warning the driver or stopping the vehicle before a dangerous turning maneuver. Most models that aim at predicting the probability of a driver's turning intent use only contextual information, such as gap size or waiting time. The objective of this study is to investigate whether the combination of context information and brain activation measurements enhances the recognition of turning intent. We conducted a driving simulator study while simultaneously measuring brain activation using high-density fNIRS. A neural network model for turning intent recognition was trained on the fNIRS and contextual data. The input variables were analyzed using SHAP (SHapley Additive exPlanations) feature importance analysis to show the positive effect of the inclusion of brain activation data. Both the model's evaluation and the feature importance analysis suggest that the combination of context information and brain activation leads to an improved turning intent recognition. The fNIRS results showed increased brain activation differences during the "turn" decision-making phase before turning execution in parts of the left motor cortices, such as the primary motor cortex (PMC; putative BA 4), premotor area (PMA; putative BA 6), and supplementary motor area (SMA; putative BA 8). Furthermore, we also observed increased activation differences in the left prefrontal areas, potentially in the left middle frontal gyrus (putative BA 9), which has been associated with the control of executive functions, such as decision-making and action planning. We hypothesize that brain activation measurements could be a more direct indicator with potentially high specificity for the turning behavior and thus help to increase the recognition model's performance.

Parcellating the human brain using resting-state dynamic functional connectivity

Brain cartography has expanded substantially over the past decade. In this regard, resting-state functional connectivity (FC) plays a key role in identifying the locations of putative functional borders. However, scant attention has been paid to the dynamic nature of functional interactions in the human brain. Indeed, FC is typically assumed to be stationary across time, which may obscure potential or subtle functional boundaries, particularly in regions with high flexibility and adaptability. In this study, we developed a dynamic FC (dFC)-based parcellation framework, established a new functional human brain atlas termed D-BFA (DFC-based Brain Functional Atlas), and verified its neurophysiological plausibility by stereo-EEG data. As the first dFC-based whole-brain atlas, the proposed D-BFA delineates finer functional boundaries that cannot be captured by static FC, and is further supported by good correspondence with cytoarchitectonic areas and task activation maps. Moreover, the D-BFA reveals the spatial distribution of dynamic variability across the brain and generates more homogenous parcels compared with most alternative parcellations. Our results demonstrate the superiority and practicability of dFC in brain parcellation, providing a new template to exploit brain topographic organization from a dynamic perspective. The D-BFA will be publicly available for download at https://github.com/sliderplm/D-BFA-618.

The human middle temporal cortex responds to both active leg movements and egomotion-compatible visual motion

The human middle-temporal region MT+ is highly specialized in processing visual motion. However, recent studies have shown that this region is modulated by extraretinal signals, suggesting a possible involvement in processing motion information also from non-visual modalities. Here, we used functional MRI data to investigate the influence of retinal and extraretinal signals on MT+ in a large sample of subjects. Moreover, we used resting-state functional MRI to assess how the subdivisions of MT+ (i.e., MST, FST, MT, and V4t) are functionally connected. We first compared responses in MST, FST, MT, and V4t to coherent vs. random visual motion. We found that only MST and FST were positively activated by coherent motion. Furthermore, regional analyses revealed that MST and FST were positively activated by leg, but not arm, movements, while MT and V4t were deactivated by arm, but not leg, movements. Taken together, regional analyses revealed a visuomotor role for the anterior areas MST and FST and a pure visual role for the anterior areas MT and V4t. These findings were mirrored by the pattern of functional connections between these areas and the rest of the brain. Visual and visuomotor regions showed distinct patterns of functional connectivity, with the latter preferentially connected with the somatosensory and motor areas representing leg and foot. Overall, these findings reveal a functional sensitivity for coherent visual motion and lower-limb movements in MST and FST, suggesting their possible involvement in integrating sensory and motor information to perform locomotion.

Multiple cortical visual streams in humans

The effective connectivity between 55 visual cortical regions and 360 cortical regions was measured in 171 HCP participants using the HCP-MMP atlas, and complemented with functional connectivity and diffusion tractography. A Ventrolateral Visual "What" Stream for object and face recognition projects hierarchically to the inferior temporal visual cortex, which projects to the orbitofrontal cortex for reward value and emotion, and to the hippocampal memory system. A Ventromedial Visual "Where" Stream for scene representations connects to the parahippocampal gyrus and hippocampus. An Inferior STS (superior temporal sulcus) cortex Semantic Stream receives from the Ventrolateral Visual Stream, from visual inferior parietal PGi, and from the ventromedial-prefrontal reward system and connects to language systems. A Dorsal Visual Stream connects via V2 and V3A to MT+ Complex regions (including MT and MST), which connect to intraparietal regions (including LIP, VIP and MIP) involved in visual motion and actions in space. It performs coordinate transforms for idiothetic update of Ventromedial Stream scene representations. A Superior STS cortex Semantic Stream receives visual inputs from the Inferior STS Visual Stream, PGi, and STV, and auditory inputs from A5, is activated by face expression, motion and vocalization, and is important in social behaviour, and connects to language systems.

Facilitation and inhibition effects of anodal and cathodal tDCS over areas MT+ on the flash-lag effect

The perceived position of a moving object in vision entails an accumulation of neural signals over space and time. Due to neural signal transmission delays, the visual system can not acquire immediate information about the moving object's position. Although physiological and psychophysical studies on the flash-lag effect (FLE), a moving object is perceived ahead of a flash even they are aligned at the same location, have shown that the visual system develops the mechanisms of predicting the object's location to compensate for the neural delays, the neural mechanisms of motion-induced location prediction are not still understood well. Here, we investigated the role of neural activity changes in areas MT+ (specialized for motion processing) and the potential contralateral processing preference of MT+ in modulating the FLE. Using transcranial direct current stimulations (tDCS) over the left and right MT+ between pre-and post-tests of the FLE in different motion directions, we measured the effects of tDCS on the FLE. The results found that anodal and cathodal tDCS enhanced and reduced the FLE with the moving object heading to but not deviating from the side of the brain stimulated, respectively, compared to sham tDCS. These findings suggest a causal role of area MT+ in motion-induced location prediction, which may involve the integration of position information.

Topological Maps and Brain Computations From Low to High

We first briefly summarize data from microelectrode studies on visual maps in non-human primates and other mammals, and characterize differences among the features of the approximately topological maps in the three main sensory modalities. We then explore the almost 50% of human neocortex that contains straightforward topological visual, auditory, and somatomotor maps by presenting a new parcellation as well as a movie atlas of cortical area maps on the FreeSurfer average surface, fsaverage. Third, we review data on moveable map phenomena as well as a recent study showing that cortical activity during sensorimotor actions may involve spatially locally coherent traveling wave and bump activity. Finally, by analogy with remapping phenomena and sensorimotor activity, we speculate briefly on the testable possibility that coherent localized spatial activity patterns might be able to ‘escape’ from topologically mapped cortex during ‘serial assembly of content’ operations such as scene and language comprehension, to form composite ‘molecular’ patterns that can move across some cortical areas and possibly return to topologically mapped cortex to generate motor output there.

The retrocalcarine sulcus maps different retinotopic representations in macaques and humans

Primate cerebral cortex is highly convoluted with much of the cortical surface buried in sulcal folds. The origins of cortical folding and its functional relevance have been a major focus of systems and cognitive neuroscience, especially when considering stereotyped patterns of cortical folding that are shared across individuals within a primate species and across multiple species. However, foundational questions regarding organizing principles shared across species remain unanswered. Taking a cross-species comparative approach with a careful consideration of historical observations, we investigate cortical folding relative to primary visual cortex (area V1). We identify two macroanatomical structures-the retrocalcarine and external calcarine sulci-in 24 humans and 6 macaque monkeys. We show that within species, these sulci are identifiable in all individuals, fall on a similar part of the V1 retinotopic map, and thus, serve as anatomical landmarks predictive of functional organization. Yet, across species, the underlying eccentricity representations corresponding to these macroanatomical structures differ strikingly across humans and macaques. Thus, the correspondence between retinotopic representation and cortical folding for an evolutionarily old structure like V1 is species-specific and suggests potential differences in developmental and experiential constraints across primates.

Mesoscopic landscape of cortical functions revealed by through-skull wide-field optical imaging in marmoset monkeys

The primate cerebral cortex is organized into specialized areas representing different modalities and functions along a continuous surface. The functional maps across the cortex, however, are often investigated a single modality at a time (e.g., audition or vision). To advance our understanding of the complex landscape of primate cortical functions, here we develop a polarization-gated wide-field optical imaging method for measuring cortical functions through the un-thinned intact skull in awake marmoset monkeys (Callithrix jacchus), a primate species featuring a smooth cortex. Using this method, adjacent auditory, visual, and somatosensory cortices are noninvasively parcellated in individual subjects with detailed tonotopy, retinotopy, and somatotopy. An additional pure-tone-responsive tonotopic gradient is discovered in auditory cortex and a face-patch sensitive to motion in the lower-center visual field is localized near an auditory region representing frequencies of conspecific vocalizations. This through-skull landscape-mapping approach provides new opportunities for understanding how the primate cortex is organized and coordinated to enable real-world behaviors.

Express arm responses appear bilaterally on upper-limb muscles in an arm choice reaching task

When required, humans can generate very short latency reaches toward visual targets, such as catching a falling cellphone. During such rapid reaches, express arm responses are the first wave of upper limb muscle recruitment, occurring ∼80-100 ms after target appearance. There is accumulating evidence that express arm responses arise from signaling along the tecto-reticulo-spinal tract, but the involvement of the reticulospinal tract has not been well studied. Since the reticulospinal tract projects bilaterally, we studied whether express arm responses would be generated bilaterally. Human participants (n = 14; 7 females) performed visually guided reaches in a modified emerging target paradigm where either arm could intercept the target. We recorded electromyographic activity bilaterally from the pectoralis major muscle. Our analysis focused on target locations where participants reached with the right arm on some trials, and the left arm on others. In support of the involvement of the reticulospinal tract, express arm responses persisted bilaterally regardless of which arm reached to the target. The latency and magnitude of the express arm response did not depend on whether the arm was chosen to reach or not. However, on the reaching arm, the magnitude of the express arm response was correlated to the level of anticipatory activity. The bilateral generation of express arm responses supports the involvement of the reticulospinal tract. We surmise that the correlation between anticipatory activity and the magnitude of express arm responses on the reaching arm arises from convergence of cortically derived signals with a parallel subcortical pathway mediating the express arm response.NEW & NOTEWORTHY Express arm responses have been proposed to arise from the tecto-reticulo-spinal tract originating within the superior colliculus, but the involvement of the reticulospinal tract has not been well studied. Here, we show these responses appear bilaterally in a task where either arm can reach to a newly appearing stimulus. Our results suggest that the most rapid visuomotor transformations for reaching are performed by a subcortical pathway.

The integrated information theory of consciousness: Unmasked and identified

In our response to a truly diverse set of commentaries, we first summarize the principal topical themes around which they cluster, then address two "outlier" positions (the problem of consciousness has been solved vs. is intractable). Next, we address ways in which commentaries by non-integrated information theory (IIT) authors engage with the specifics of our IIT critique, turning finally to the four commentaries by IIT authors.

Adaptive and maladaptive brain functional network reorganization after stroke in hemianopia patients: an EEG-tracking study

OBJECTIVE

Hemianopia following occipital stroke is believed to be mainly due to local damage at or near the lesion site. Yet, MRI studies suggest functional connectivity network (FCN) reorganization also in distant brain regions. Because it is unclear if reorganization is adaptive or maladaptive, compensating for, or aggravating vision loss, we characterized FCNs electrophysiologically to explore local and global brain plasticity and correlated FCN reorganization with visual performance.

METHODS

Resting-state EEG was recorded in chronic, unilateral stroke patients and healthy age-matched controls (n=24 each). The correlation of oscillating EEG activity was calculated with the imaginary part of coherence between pairs of interested regions, and FCN graph theory metrics (degree, strength, clustering coefficient) were correlated with stimulus detection and reaction time.

RESULTS

Stroke brains showed altered FCNs in the alpha- and beta-band in numerous occipital, temporal and frontal brain structures. On a global level, FCN had a less efficient network organization while on the local level node networks reorganized especially in the intact hemisphere. Here, the occipital network was 58% more rigid (with a more "regular" network structure) while the temporal network was 32% more efficient (showing greater "small-worldness"), both of which correlated with worse or better visual processing, respectively.

CONCLUSIONS

Occipital stroke is associated with both local and global FCN reorganization, but this can be both, adaptive and maladaptive. We propose that the more "regular" FCN structure in the intact visual cortex indicates maladaptive plasticity where less processing efficacy with reduced signal/noise ratio may cause perceptual deficits in the intact visual field. In contrast, reorganization in intact temporal brain regions is presumably adaptive, possibly supporting enhanced peripheral movement perception.

Cortical pathways during Postural Control: new insights from functional EEG source connectivity

Postural control is a complex feedback system that relies on vast array of sensory inputs in order to maintain a stable upright stance. The brain cortex plays a crucial role in the processing of this information and in the elaboration of a successful adaptive strategy to external stimulation preventing loss of balance and falls. In the present work, the participants postural control system was challenged by disrupting the upright stance via a mechanical skeletal muscle vibration applied to the calves. The EEG source connectivity method was used to investigate the cortical response to the external stimulation and highlight the brain network primarily involved in high-level coordination of the postural control system. The cortical network reconfiguration was assessed during two experimental conditions of eyes open and eyes closed and the network flexibility (i.e. its dynamic reconfiguration over time) was correlated with the sample entropy of the stabilogram sway. The results highlight two different cortical strategies in the alpha band: the predominance of frontal lobe connections during open eyes and the strengthening of temporal-parietal network connections in the absence of visual cues. Furthermore, a high correlation emerges between the flexibility in the regions surrounding the right temporo-parietal junction and the sample entropy of the CoP sway, suggesting their centrality in the postural control system. These results open the possibility to employ network-based flexibility metrics as markers of a healthy postural control system, with implications in the diagnosis and treatment of postural impairing diseases.

Task-Relevant Representations and Cognitive Control Demands Modulate Functional Connectivity from Ventral Occipito-Temporal Cortex During Object Recognition Tasks

The left ventral occipito-temporal cortex (vOTC) supports extraction and processing of visual features. However, it has remained unclear whether left vOTC-based functional connectivity (FC) differs according to task-relevant representations (e.g., lexical, visual) and control demands imposed by the task, even when similar visual-semantic processing is required for object identification. Here, neural responses to the same set of pictures of meaningful objects were measured, while the type of task that participants had to perform (picture naming versus size-judgment task), and the level of cognitive control required by the picture naming task (high versus low interference contexts) were manipulated. Explicit retrieval of lexical representations in the picture naming task facilitated activation of lexical/phonological representations, modulating FC between left vOTC and dorsal anterior-cingulate-cortex/pre-supplementary-motor-area. This effect was not observed in the size-judgment task, which did not require explicit word-retrieval of object names. Furthermore, retrieving the very same lexical/phonological representation in the high versus low interference contexts during picture naming increased FC between left vOTC and left caudate. These findings support the proposal that vOTC functional specialization emerges from interactions with task-relevant brain regions.

The "vestibular neuromatrix": A proposed, expanded vestibular network from graph theory in post-concussive vestibular dysfunction

Convergent clinical and neuroimaging evidence suggests that higher vestibular function is subserved by a distributed network including visuospatial, cognitive-affective, proprioceptive, and integrative brain regions. Clinical vestibular syndromes may perturb this network, resulting in deficits across a variety of functional domains. Here, we leverage structural and functional neuroimaging to characterize this extended network in healthy control participants and patients with post-concussive vestibular dysfunction (PCVD). Then, 27 healthy control subjects (15 females) and 18 patients with subacute PCVD (12 female) were selected for participation. Eighty-two regions of interest (network nodes) were identified based on previous publications, group-wise differences in BOLD signal amplitude and connectivity, and multivariate pattern analysis on affective tests. Group-specific "core" networks, as well as a "consensus" network comprised of connections common to all participants, were then generated based on probabilistic tractography and functional connectivity between the 82 nodes and subjected to analyses of node centrality and community structure. Whereas the consensus network was comprised of affective, integrative, and vestibular nodes, PCVD participants exhibited diminished integration and centrality among vestibular and affective nodes and increased centrality of visual, supplementary motor, and frontal and cingulate eye field nodes. Clinical outcomes, derived from dynamic posturography, were associated with approximately 62% of all connections but best predicted by amygdalar, prefrontal, and cingulate connectivity. No group-wise differences in diffusion metrics or tractography were noted. These findings indicate that cognitive, affective, and proprioceptive substrates contribute to vestibular processing and performance and highlight the need to consider these domains during clinical diagnosis and treatment planning.

Cross-dataset reproducibility of human retinotopic maps

Population receptive field (pRF) models fit to fMRI data are used to non-invasively measure retinotopic maps in human visual cortex, and these maps are a fundamental component of visual neuroscience experiments. Here, we examined the reproducibility of retinotopic maps across two datasets: a newly acquired retinotopy dataset from New York University (NYU) (n = 44) and a public dataset from the Human Connectome Project (HCP) (n = 181). Our goal was to assess the degree to which pRF properties are similar across datasets, despite substantial differences in their experimental protocols. The two datasets simultaneously differ in their stimulus apertures, participant pool, fMRI protocol, MRI field strength, and preprocessing pipeline. We assessed the cross-dataset reproducibility of the two datasets in terms of the similarity of vertex-wise pRF estimates and in terms of large-scale polar angle asymmetries in cortical magnification. Within V1, V2, V3, and hV4, the group-median NYU and HCP vertex-wise polar angle estimates were nearly identical. Both eccentricity and pRF size estimates were also strongly correlated between the two datasets, but with a slope different from 1; the eccentricity and pRF size estimates were systematically greater in the NYU data. Next, to compare large-scale map properties, we quantified two polar angle asymmetries in V1 cortical magnification previously identified in the HCP data. The NYU dataset confirms earlier reports that more cortical surface area represents horizontal than vertical visual field meridian, and lower than upper vertical visual field meridian. Together, our findings show that the retinotopic properties of V1, V2, V3, and hV4 can be reliably measured across two datasets, despite numerous differences in their experimental design. fMRI-derived retinotopic maps are reproducible because they rely on an explicit computational model of the fMRI response. In the case of pRF mapping, the model is grounded in physiological evidence of how visual receptive fields are organized, allowing one to quantitatively characterize the BOLD signal in terms of stimulus properties (i.e., location and size). The new NYU Retinotopy Dataset will serve as a useful benchmark for testing hypotheses about the organization of visual areas and for comparison to the HCP 7T Retinotopy Dataset.

Population receptive fields in non-human primates from whole-brain fMRI and large-scale neurophysiology in visual cortex

Population receptive field (pRF) modeling is a popular fMRI method to map the retinotopic organization of the human brain. While fMRI-based pRF maps are qualitatively similar to invasively recorded single-cell receptive fields in animals, it remains unclear what neuronal signal they represent. We addressed this question in awake nonhuman primates comparing whole-brain fMRI and large-scale neurophysiological recordings in areas V1 and V4 of the visual cortex. We examined the fits of several pRF models based on the fMRI blood-oxygen-level-dependent (BOLD) signal, multi-unit spiking activity (MUA), and local field potential (LFP) power in different frequency bands. We found that pRFs derived from BOLD-fMRI were most similar to MUA-pRFs in V1 and V4, while pRFs based on LFP gamma power also gave a good approximation. fMRI-based pRFs thus reliably reflect neuronal receptive field properties in the primate brain. In addition to our results in V1 and V4, the whole-brain fMRI measurements revealed retinotopic tuning in many other cortical and subcortical areas with a consistent increase in pRF size with increasing eccentricity, as well as a retinotopically specific deactivation of default mode network nodes similar to previous observations in humans.

Gait-Related Brain Activation During Motor Imagery of Complex and Simple Ambulation in Parkinson's Disease With Freezing of Gait

Background: Freezing of gait (FOG) in Parkinson's disease (PD) is a devastating clinical phenomenon that has a detrimental impact on patients. It tends to be triggered more often during turning (complex) than during forwarding straight (simple) walking. The neural mechanism underlying this phenomenon remains unclear and requires further elucidation.

Objective: To investigate the differences in cerebral functional magnetic resonance imaging responses between PD patients with and without FOG during explicitly video-guided motor imagery (MI) of various complex (normal, freezing) and simple (normal, freezing) walking conditions.

Methods: We recruited 34 PD patients, namely, 20 with FOG and 14 without FOG, and 15 normal controls. Participants underwent video-guided MI of turning and straight walking, with and without freezing, while their brain blood oxygen level-dependent (BOLD) activities were measured. Gait analysis was performed.

Results: While comparing FOG turning with FOG straight walking, freezers showed higher activation of the superior occipital gyrus, left precentral gyrus, and right postcentral gyrus compared with non-freezers. Normal controls also manifest similar findings compared with non-freezers, except no difference was noted in occipital gyrus activity between the two groups. Freezers also displayed a higher effect size in the locomotor regions than non-freezers during imagery of normal turning.

Conclusions: Our findings suggest that freezers require a higher drive of cortical and locomotion regions to overcome the overinhibition of the pathways in freezers than in non-freezers. Compared with simple walking, increased dorsal visual pathway and deep locomotion region activities might play pivotal roles in tackling FOG in freezers during complex walking.

Shape-centered representations of bounded regions of space mediate the perception of objects

We report the study of a woman who perceives 2D bounded regions of space ("shapes") defined by sharp edges of medium to high contrast as if they were rotated by 90, 180 degrees around their centre, mirrored across their own axes, or both. In contrast, her perception of 3D, strongly blurred or very low contrast shapes, and of stimuli emerging from a collection of shapes, is intact. This suggests that a stage in the process of constructing the conscious visual representation of a scene consists of representing mutually exclusive bounded regions extracted from the initial retinotopic space in "shape-centered" frames of reference. The selectivity of the disorder to shapes originally biased toward the parvocellular subcortical pathway, and the absence of any other type of error, additionally invite new hypotheses about the operations involved in computing these "intermediate shape-centered representations" and in mapping them onto higher frames for perception and action.

Increased Visual Sensitivity and Occipital Activity in Patients With Hemianopia Following Vision Rehabilitation

Hemianopia, loss of vision in half of the visual field, results from damage to the visual pathway posterior to the optic chiasm. Despite negative effects on quality of life, few rehabilitation options are currently available. Recently, several long-term training programs have been developed that show visual improvement within the blind field, although little is known of the underlying neural changes. Here, we have investigated functional and structural changes in the brain associated with visual rehabilitation. Seven human participants with occipital lobe damage enrolled in a visual training program to distinguish which of two intervals contained a drifting Gabor patch presented within the blind field. Participants performed ∼25 min of training each day for 3-6 months and undertook psychophysical tests and a magnetic resonance imaging scan before and after training. A control group undertook psychophysical tests before and after an equivalent period without training. Participants who were not at ceiling on baseline tests showed on average 9.6% improvement in Gabor detection, 8.3% in detection of moving dots, and 9.9% improvement in direction discrimination after training. Importantly, psychophysical improvement only correlated with improvement in Humphrey perimetry in the trained region of the visual field. Whole-brain analysis showed an increased neural response to moving stimuli in the blind visual field in motion area V5/hMT. Using a region-of-interest approach, training had a significant effect on the blood oxygenation level-dependent signal compared with baseline. Moreover, baseline V5/hMT activity was correlated to the amount of improvement in visual sensitivity using psychophysical and perimetry tests. This study, identifying a critical role for V5/hMT in boosting visual function, may allow us to determine which patients may benefit most from training and design adjunct interventions to increase training effects.SIGNIFICANCE STATEMENT Homonymous visual field loss is a common consequence of brain injury and is estimated to affect more than 230,000 people in the United Kingdom. Despite its high prevalence and well-described impact on quality of life, treatments to improve visual sensitivity remain experimental, and deficits are considered permanent after 6 months. Our study shows that behavioral changes following vision rehabilitation are associated with enhanced visually-evoked occipital activity to stimuli in the blind visual field. Unlike previous behavioral studies, we observe clinical changes that are specific to the trained region of vision. This lends significant weight to such training paradigms and offers a mechanism by which visual function can be improved despite damage to the primary visual pathway.

Dedifferentiation of Functional Brain Activation Associated With Greater Visual Discrimination Accuracy in Middle-Aged and Older Adults

Neural dedifferentiation refers to an age-related phenomenon whereby brain functions that are localized to specific, distinct, and differentiated brain areas in young adults become less so as people reach more advanced age. Older adults tend to exhibit greater spread of cortical activation on fMRI during cognitive processing compared to younger adults, with evidence that this occurs during visuoperceptual processing. Some age-related functional changes are considered compensatory, but whether dedifferentiation is compensatory is not clearly understood. The current study assessed dedifferentiation and visual discrimination performance during simultaneous match-to-sample tasks from the Visual Assessment Battery (VAB) among 40 healthy middle-aged and older adults using fMRI. Task-relevant regions of interest (ROIs) were created in the dorsal stream for discrimination of spatial location, the ventral stream for shape, and an area encompassing V5 for velocity. Dedifferentiation, or less specificity in functional activation, was associated with greater discrimination accuracy and more years of education. Secondary analyses showed that reduced functional activation in task-relevant ROIs was associated with faster discrimination speed. Age was unassociated with functional activation. Results suggest that dedifferentiation is compensatory. Lack of age effects suggest that other factors beyond age, such as cognitive or brain reserve, may better predict performance when considering cognitive skills that are relatively stable as adults age, such as visual discrimination.

Reading: The Confluence of Vision and Language

The scientific study of reading has a rich history that spans disciplines from vision science to linguistics, psychology, cognitive neuroscience, neurology, and education. The study of reading can elucidate important general mechanisms in spatial vision, attentional control, object recognition, and perceptual learning, as well as the principles of plasticity and cortical topography. However, literacy also prompts the development of specific neural circuits to process a unique and artificial stimulus. In this review, we describe the sequence of operations that transforms visual features into language, how the key neural circuits are sculpted by experience during development, and what goes awry in children for whom learning to read is a struggle. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Inferior Occipital Gyrus Is Organized along Common Gradients of Spatial and Face-Part Selectivity

The ventral visual stream of the human brain is subdivided into patches with categorical stimulus preferences, like faces or scenes. However, the functional organization within these areas is less clear. Here, we used functional magnetic resonance imaging and vertex-wise tuning models to independently probe spatial and face-part preferences in the inferior occipital gyrus (IOG) of healthy adult males and females. The majority of responses were well explained by Gaussian population tuning curves for both retinotopic location and the preferred relative position within a face. Parameter maps revealed a common gradient of spatial and face-part selectivity, with the width of tuning curves drastically increasing from posterior to anterior IOG. Tuning peaks clustered more idiosyncratically but were also correlated across maps of visual and face space. Preferences for the upper visual field went along with significantly increased coverage of the upper half of the face, matching recently discovered biases in human perception. Our findings reveal a broad range of neural face-part selectivity in IOG, ranging from narrow to "holistic." IOG is functionally organized along this gradient, which in turn is correlated with retinotopy.SIGNIFICANCE STATEMENT Brain imaging has revealed a lot about the large-scale organization of the human brain and visual system. For example, occipital cortex contains map-like representations of the visual field, while neurons in ventral areas cluster into patches with categorical preferences, like faces or scenes. Much less is known about the functional organization within these areas. Here, we focused on a well established face-preferring area-the inferior occipital gyrus (IOG). A novel neuroimaging paradigm allowed us to map the retinotopic and face-part tuning of many recording sites in IOG independently. We found a steep posterior-anterior gradient of decreasing face-part selectivity, which correlated with retinotopy. This suggests the functional role of ventral areas is not uniform and may follow retinotopic "protomaps."

Early recurrence enables figure border ownership

Rubin's face-vase illusion demonstrates how one can switch back and forth between two different interpretations depending on how the figure outlines are assigned. In the primate visual system, assigning ownership along figure borders is encoded by neurons called the border ownership (BO) cells. Studies show that the responses of these neurons not only depend on the local features within their receptive fields, but also on contextual information. Despite two decades of studies on BO neurons, the ownership assignment mechanism in the brain is still unknown. Here, we propose a hierarchical recurrent model grounded on the hypothesis that neurons in the dorsal stream provide the context required for ownership assignment. Our proposed model incorporates early recurrence from the dorsal pathway as well as lateral modulations within the ventral stream. While dorsal modulations initiate the response difference to figure on either side of the border, lateral modulations enhance the difference. We found responses of our dorsally-modulated BO cells, similar to their biological counterparts, are invariant to size, position and solid/outlined figures. Moreover, our model BO cells exhibit comparable levels of reliability in the ownership signal to biological BO neurons. We found dorsal modulations result in high levels of accuracy and robustness for BO assignments in complex scenes compared to previous models based on ventral feedback. Finally, our experiments with illusory contours suggest that BO encoding could explain the perception of such contours in higher processing stages in the brain.

Short- and Long-Term Stroboscopic Training Effects on Visuomotor Performance in Elite Youth Sports. Part 2: Brain-Behavior Mechanisms

PURPOSE

Stroboscopic training has repeatedly been shown to improve visuomotor abilities. However, although performance improvements were attributed to visual processes, information on the neurophysiological mechanisms is missing. Part 2 of this study investigated the effects of stroboscopic training on neural visual and motor functions and its contribution to training-induced changes in visuomotor reaction time.

METHODS

Forty-five young elite badminton athletes participated in this study, of which 32 (age, 13.7 yr) were included in the final data analysis. Participants were assigned to an intervention (stroboscopic vision) or control group (normal vision). Before and after a 10-wk training and after a 6-wk retention period, participants performed visual perception and reaction tasks in response to visual motion stimuli. The N2 and N2-r motion onset visual-evoked potentials, its linear combination (Vlc), and the BA6 negativity potential were determined using a 64-channel EEG.

RESULTS

A significant TIME-GROUP effect was observed for the Vlc score (P = 0.019, ηp2 = 0.18), indicating a lower Vlc in the intervention group. However, post hoc tests did not reach significance. Within-subject correlation analyses revealed that changes in reaction speed were related to latency changes in N2 (r = 0.59, P < 0.001), N2-r (r = -0.64, P < 0.001), and the combined Vlc (r = 0.68, P < 0.001). Regression analyses across participants including multiple (N2/N2-r) or single (Vlc) predictors provided an explained variance of >60% (N2/N2-r, r2 = 0.62; Vlc, r2 = 0.64). No training effects or correlations were observed for the BA6 negativity.

CONCLUSIONS

The results indicate that faster visuomotor reactions after stroboscopic training are accompanied by accelerated visual perception and processing, whereas motor processes seemed to be unaffected. Stroboscopic training may be promising to specifically address the visual system in visuomotor-demanding sports.

An fMRI study of age-associated changes in basic visual discrimination

Clinical neuropsychology lacks tests of basic visuoperceptual and spatial skills that have well-controlled administration and sophisticated measurement methods. Items from the Visual Assessment Battery (VAB), a simultaneous match-to-sample task, assessed visual discrimination in 40 healthy adults aged 51-91 during fMRI. The tasks were designed to isolate discrimination of either location, shape, or velocity, and they each had three levels of difficulty. The Location task uniquely activated the dorsal visual processing stream, the Shape task the ventral stream, and the Velocity task an area encompassing V5. Greater age was associated with greater neural recruitment, particularly in frontal areas. Behaviorally, greater age was associated with prolonged response times, but not reduced accuracy. Increased difficulty was associated with slower responses and reduced accuracy, regardless of age. Results validated the specialization of brain regions for spatial, perceptual, and movement discriminations and the use of the VAB to assess functioning localized to these regions. Visual discrimination ability does not change dramatically with age, but like many cognitive processes, performance slows. Anterior neural recruitment during visual discrimination increases with age.

Visual Perception and Visuomotor Reaction Speed Are Independent of the Individual Alpha Frequency

While the resting-state individual alpha frequency (IAF) is related to the cognitive performance and temporal resolution of visual perception, it remains unclear how it affects the neural correlates of visual perception and reaction processes. This study aimed to unravel the relation between IAF, visual perception, and visuomotor reaction time. One hundred forty-eight (148) participants (28 non-athletes, 39 table tennis players, and 81 badminton players) investigated in three previous studies were considered. During a visuomotor reaction task, the visuomotor reaction time (VMRT) and EMG onset were determined. In addition, a 64-channel EEG system identified the N2, N2-r, and BA6 negativity potentials representing the visual and motor processes related to visuomotor reactions. Resting-state individual alpha frequency (IAF) in visual and motor regions was compared based on sport experience (athletes vs. non-athletes), discipline (badminton vs. table tennis), and reaction performance (fast vs. medium vs. slow reaction time). Further, the differences in the IAF were determined in relation to the speed of neural visual (high vs. medium vs. low N2/N2-r latency) and motor (high vs. medium vs. low BA6 negativity latency). Group comparisons did not reveal any difference in the IAF between athletes and non-athletes (p = 0.352, η _p ² = 0.02) or badminton and table tennis players (p = 0.221, η _p ² = 0.02). Similarly, classification based on the behavioral or neural performance indicators did not reveal any effects on the IAF (p ≥ 0.158, η _p ² ≤ 0.027). IAF was not correlated to any of the behavioral or neural parameters (r ≤ 0.10, p ≥ 0.221). In contrast to behavioral results on cognitive performance and visual temporal resolution, the resting state IAF seemed unrelated to the visual perception and visuomotor reaction speed in simple reaction tasks. Considering the previous results on the correlations between the IAF, cognitive abilities, and temporal sampling of visual information, the results suggest that a higher IAF may facilitate the amount and frequency but not the speed of information transfer.

From Observed Action Identity to Social Affordances

Others' observed actions cause continuously changing retinal images, making it challenging to build neural representations of action identity. The monkey anterior intraparietal area (AIP) and its putative human homologue (phAIP) host neurons selective for observed manipulative actions (OMAs). The neuronal activity of both AIP and phAIP allows a stable readout of OMA identity across visual formats, but human neurons exhibit greater invariance and generalize from observed actions to action verbs. These properties stem from the convergence in AIP of superior temporal signals concerning: (i) observed body movements; and (ii) the changes in the body-object relationship. We propose that evolutionarily preserved mechanisms underlie the specification of observed-actions identity and the selection of motor responses afforded by them, thereby promoting social behavior.