Visual topography of human intraparietal sulcus

Trying Harder: How Cognitive Effort Sculpts Neural Representations during Working Memory

While the exertion of mental effort improves performance on cognitive tasks, the neural mechanisms by which motivational factors impact cognition remain unknown. Here, we used fMRI to test how changes in cognitive effort, induced by changes in task difficulty, impact neural representations of working memory (WM). Participants (both sexes) were precued whether WM difficulty would be hard or easy. We hypothesized that hard trials demanded more effort as a later decision required finer mnemonic precision. Behaviorally, pupil size was larger and response times were slower on hard compared with easy trials suggesting our manipulation of effort succeeded. Neurally, we observed robust persistent activity during delay periods in the prefrontal cortex (PFC), especially during hard trials. Yet, details of the memoranda could not be decoded from patterns in prefrontal activity. In the patterns of activity in the visual cortex, however, we found strong decoding of memorized targets, where accuracy was higher on hard trials. To potentially link these across-region effects, we hypothesized that effort, carried by persistent activity in the PFC, impacts the quality of WM representations encoded in the visual cortex. Indeed, we found that the amplitude of delay period activity in the frontal cortex predicted decoded accuracy in the visual cortex on a trial-wise basis. These results indicate that effort-related feedback signals sculpt population activity in the visual cortex, improving mnemonic fidelity.

Rethinking simultaneous suppression in visual cortex via compressive spatiotemporal population receptive fields

When multiple visual stimuli are presented simultaneously in the receptive field, the neural response is suppressed compared to presenting the same stimuli sequentially. The prevailing hypothesis suggests that this suppression is due to competition among multiple stimuli for limited resources within receptive fields, governed by task demands. However, it is unknown how stimulus-driven computations may give rise to simultaneous suppression. Using fMRI, we find simultaneous suppression in single voxels, which varies with both stimulus size and timing, and progressively increases up the visual hierarchy. Using population receptive field (pRF) models, we find that compressive spatiotemporal summation rather than compressive spatial summation predicts simultaneous suppression, and that increased simultaneous suppression is linked to larger pRF sizes and stronger compressive nonlinearities. These results necessitate a rethinking of simultaneous suppression as the outcome of stimulus-driven compressive spatiotemporal computations within pRFs, and open new opportunities to study visual processing capacity across space and time.

A previously undescribed scene-selective site is the key to encoding ego-motion in naturalistic environments

Current models of scene processing in the human brain include three scene-selective areas: the parahippocampal place area (or the temporal place areas), the restrosplenial cortex (or the medial place area), and the transverse occipital sulcus (or the occipital place area). Here, we challenged this model by showing that at least one other scene-selective site can also be detected within the human posterior intraparietal gyrus. Despite the smaller size of this site compared to the other scene-selective areas, the posterior intraparietal gyrus scene-selective (PIGS) site was detected consistently in a large pool of subjects (n = 59; 33 females). The reproducibility of this finding was tested based on multiple criteria, including comparing the results across sessions, utilizing different scanners (3T and 7T) and stimulus sets. Furthermore, we found that this site (but not the other three scene-selective areas) is significantly sensitive to ego-motion in scenes, thus distinguishing the role of PIGS in scene perception relative to other scene-selective areas. These results highlight the importance of including finer scale scene-selective sites in models of scene processing - a crucial step toward a more comprehensive understanding of how scenes are encoded under dynamic conditions.

A retinotopic code structures the interaction between perception and memory systems

Conventional views of brain organization suggest that regions at the top of the cortical hierarchy processes internally oriented information using an abstract amodal neural code. Despite this, recent reports have described the presence of retinotopic coding at the cortical apex, including the default mode network. What is the functional role of retinotopic coding atop the cortical hierarchy? Here we report that retinotopic coding structures interactions between internally oriented (mnemonic) and externally oriented (perceptual) brain areas. Using functional magnetic resonance imaging, we observed robust inverted (negative) retinotopic coding in category-selective memory areas at the cortical apex, which is functionally linked to the classic (positive) retinotopic coding in category-selective perceptual areas in high-level visual cortex. These functionally linked retinotopic populations in mnemonic and perceptual areas exhibit spatially specific opponent responses during both bottom-up perception and top-down recall, suggesting that these areas are interlocked in a mutually inhibitory dynamic. These results show that retinotopic coding structures interactions between perceptual and mnemonic neural systems, providing a scaffold for their dynamic interaction.

Dynamic categorization rules alter representations in human visual cortex

Everyday perceptual tasks require sensory stimuli to be dynamically encoded and analyzed according to changing behavioral goals. For example, when searching for an apple at the supermarket, one might first find the Granny Smith apples by separating all visible apples into the categories "green" and "non-green". However, suddenly remembering that your family actually likes Fuji apples would necessitate reconfiguring the boundary to separate "red" from "red-yellow" objects. This flexible processing enables identical sensory stimuli to elicit varied behaviors based on the current task context. While this phenomenon is ubiquitous in nature, little is known about the neural mechanisms that underlie such flexible computation. Traditionally, sensory regions have been viewed as mainly devoted to processing inputs, with limited involvement in adapting to varying task contexts. However, from the standpoint of efficient computation, it is plausible that sensory regions integrate inputs with current task goals, facilitating more effective information relay to higher-level cortical areas. Here we test this possibility by asking human participants to visually categorize novel shape stimuli based on different linear and non-linear boundaries. Using fMRI and multivariate analyses of retinotopically-defined visual areas, we found that shape representations in visual cortex became more distinct across relevant decision boundaries in a context-dependent manner, with the largest changes in discriminability observed for stimuli near the decision boundary. Importantly, these context-driven modulations were associated with improved categorization performance. Together, these findings demonstrate that codes in visual cortex are adaptively modulated to optimize object separability based on currently relevant decision boundaries.

Category Learning Selectively Enhances Representations of Boundary-Adjacent Exemplars in Early Visual Cortex

Category learning and visual perception are fundamentally interactive processes, such that successful categorization often depends on the ability to make fine visual discriminations between stimuli that vary on continuously valued dimensions. Research suggests that category learning can improve perceptual discrimination along the stimulus dimensions that predict category membership and that these perceptual enhancements are a byproduct of functional plasticity in the visual system. However, the precise mechanisms underlying learning-dependent sensory modulation in categorization are not well understood. We hypothesized that category learning leads to a representational sharpening of underlying sensory populations tuned to values at or near the category boundary. Furthermore, such sharpening should occur largely during active learning of new categories. These hypotheses were tested using fMRI and a theoretically constrained model of vision to quantify changes in the shape of orientation representations while human adult subjects learned to categorize physically identical stimuli based on either an orientation rule (N = 12) or an orthogonal spatial frequency rule (N = 13). Consistent with our predictions, modeling results revealed relatively enhanced reconstructed representations of stimulus orientation in visual cortex (V1-V3) only for orientation rule learners. Moreover, these reconstructed representations varied as a function of distance from the category boundary, such that representations for challenging stimuli near the boundary were significantly sharper than those for stimuli at the category centers. These results support an efficient model of plasticity wherein only the sensory populations tuned to the most behaviorally relevant regions of feature space are enhanced during category learning.

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Feature-Specific Salience Maps in Human Cortex

Priority map theory is a leading framework for understanding how various aspects of stimulus displays and task demands guide visual attention. Per this theory, the visual system computes a priority map, which is a representation of visual space indexing the relative importance, or priority, of locations in the environment. Priority is computed based on both salience, defined based on image-computable properties; and relevance, defined by an individual's current goals, and is used to direct attention to the highest-priority locations for further processing. Computational theories suggest that priority maps identify salient locations based on individual feature dimensions (e.g., color, motion), which are integrated into an aggregate priority map. While widely accepted, a core assumption of this framework, the existence of independent feature dimension maps in visual cortex, remains untested. Here, we tested the hypothesis that retinotopic regions selective for specific feature dimensions (color or motion) in human cortex act as neural feature dimension maps, indexing salient locations based on their preferred feature. We used fMRI activation patterns to reconstruct spatial maps while male and female human participants viewed stimuli with salient regions defined by relative color or motion direction. Activation in reconstructed spatial maps was localized to the salient stimulus position in the display. Moreover, the strength of the stimulus representation was strongest in the ROI selective for the salience-defining feature. Together, these results suggest that feature-selective extrastriate visual regions highlight salient locations based on local feature contrast within their preferred feature dimensions, supporting their role as neural feature dimension maps.SIGNIFICANCE STATEMENT Identifying salient information is important for navigating the world. For example, it is critical to detect a quickly approaching car when crossing the street. Leading models of computer vision and visual search rely on compartmentalized salience computations based on individual features; however, there has been no direct empirical demonstration identifying neural regions as responsible for performing these dissociable operations. Here, we provide evidence of a critical double dissociation that neural activation patterns from color-selective regions prioritize the location of color-defined salience while minimally representing motion-defined salience, whereas motion-selective regions show the complementary result. These findings reveal that specialized cortical regions act as neural "feature dimension maps" that are used to index salient locations based on specific features to guide attention.

Trying harder: how cognitive effort sculpts neural representations during working memory

The neural mechanisms by which motivational factors influence cognition remain unknown. Using fMRI, we tested how cognitive effort impacts working memory (WM). Participants were precued whether WM difficulty would be hard or easy. Hard trials demanded more effort as a later decision required finer mnemonic precision. Behaviorally, pupil size was larger and response times were slower on hard trials suggesting our manipulation of effort succeeded. Neurally, we observed robust persistent activity in prefrontal cortex, especially during hard trials. We found strong decoding of location in visual cortex, where accuracy was higher on hard trials. Connecting these across-region effects, we found that the amplitude of delay period activity in frontal cortex predicted decoded accuracy in visual cortex on a trial-wise basis. We conclude that the gain of persistent activity in frontal cortex may be the source of effort-related feedback signals that improve the quality of WM representations stored in visual cortex.

Retinotopic connectivity maps of human visual cortex with unconstrained eye movements

Human visual cortex contains topographic visual field maps whose organization can be revealed with retinotopic mapping. Unfortunately, constraints posed by standard mapping hinder its use in patients, atypical subject groups, and individuals at either end of the lifespan. This severely limits the conclusions we can draw about visual processing in such individuals. Here, we present a novel data-driven method to estimate connective fields, resulting in fine-grained maps of the functional connectivity between brain areas. We find that inhibitory connectivity fields accompany, and often surround facilitatory fields. The visual field extent of these inhibitory subfields falls off with cortical magnification. We further show that our method is robust to large eye movements and myopic defocus. Importantly, freed from the controlled stimulus conditions in standard mapping experiments, using entertaining stimuli and unconstrained eye movements our approach can generate retinotopic maps, including the periphery visual field hitherto only possible to map with special stimulus displays. Generally, our results show that the connective field method can gain knowledge about retinotopic architecture of visual cortex in patients and participants where this is at best difficult and confounded, if not impossible, with current methods.

Parietal-driven visual working memory representation in occipito-temporal cortex

Human fMRI studies have documented extensively that the content of visual working memory (VWM) can be reliably decoded from fMRI voxel response patterns during the delay period in both the occipito-temporal cortex (OTC), including early visual areas (EVC), and the posterior parietal cortex (PPC).1,2,3,4 Further work has revealed that VWM signal in OTC is largely sustained by feedback from associative areas such as prefrontal cortex (PFC) and PPC.4,5,6,7,8,9 It is unclear, however, if feedback during VWM simply restores sensory representations initially formed in OTC or if it can reshape the representational content of OTC during VWM delay. Taking advantage of a recent finding showing that object representational geometry differs between OTC and PPC in perception,10 here we find that, during VWM delay, the object representational geometry in OTC becomes more aligned with that of PPC during perception than with itself during perception. This finding supports the role of feedback in shaping the content of VWM in OTC, with the VWM content of OTC more determined by information retained in PPC than by the sensory information initially encoded in OTC.

A retinotopic code structures the interaction between perception and memory systems

Conventional views of brain organization suggest that the cortical apex processes internally-oriented information using an abstract, amodal neural code. Yet, recent reports have described the presence of retinotopic coding at the cortical apex, including the default mode network. What is the functional role of retinotopic coding atop the cortical hierarchy? Here, we report that retinotopic coding structures interactions between internally-oriented (mnemonic) and externally-oriented (perceptual) brain areas. Using fMRI, we observed robust, inverted (negative) retinotopic coding in category-selective memory areas at the cortical apex, which is functionally linked to the classic (positive) retinotopic coding in category-selective perceptual areas in high-level visual cortex. Specifically, these functionally-linked retinotopic populations in mnemonic and perceptual areas exhibit spatially-specific opponent responses during both bottom-up perception and top-down recall, suggesting that these areas are interlocked in a mutually-inhibitory dynamic. Together, these results show that retinotopic coding structures interactions between perceptual and mnemonic neural systems, thereby scaffolding their dynamic interaction.

Dynamic changes in spatial representation within the posterior parietal cortex in response to visuomotor adaptation

Recent studies used functional magnetic resonance imaging (fMRI) population receptive field (pRF) mapping to demonstrate that retinotopic organization extends from the primary visual cortex to ventral and dorsal visual pathways, by quantifying visual field maps, receptive field size, and laterality throughout multiple areas. Visuospatial representation in the posterior parietal cortex (PPC) is modulated by attentional deployment, raising the question of whether spatial representation in the PPC is dynamic and flexible, and whether this flexibility contributes to visuospatial learning. To answer this question, changes in spatial representation within the PPC and early visual cortex were recorded with pRF mapping before and after prism adaptation (PA)-a well-established visuomotor technique that modulates visuospatial attention according to the direction of the visual displacement. As predicted, results showed that adaptation to left-shifting prisms increases pRF size in left PPC, while leaving space representation in the early visual cortex unchanged. This is the first evidence that PA drives a dynamic reorganization of response profiles in the PPC. These findings show that spatial representations in the PPC not only reflect changes driven by attentional deployment but dynamically change in response to modulation of external factors such as manipulation of the visuospatial input during visuomotor adaptation.

Dynamic Visualization of Gyral and Sulcal Stereoelectroencephalographic contacts in Humans

Stereoelectroencephalography (SEEG) is a neurosurgical method to survey electrophysiological activity within the brain to treat disorders such as Epilepsy. In this stereotactic approach, leads are implanted through straight trajectories to survey both cortical and sub-cortical activity. Visualizing the recorded locations covering sulcal and gyral activity while staying true to the cortical architecture is challenging due to the folded, three-dimensional nature of the human cortex. To overcome this challenge, we developed a novel visualization concept, allowing investigators to dynamically morph between the subjects' cortical reconstruction and an inflated cortex representation. This inflated view, in which gyri and sulci are viewed on a smooth surface, allows better visualization of electrodes buried within the sulcus while staying true to the underlying cortical architecture.

Clinical relevance—

These visualization techniques might also help guide clinical decision-making when defining seizure onset zones or resections for patients undergoing SEEG monitoring for intractable epilepsy.

Topographic organization of eye-position dependent gain fields in human visual cortex

The ability to move has introduced animals with the problem of sensory ambiguity: the position of an external stimulus could change over time because the stimulus moved, or because the animal moved its receptors. This ambiguity can be resolved with a change in neural response gain as a function of receptor orientation. Here, we developed an encoding model to capture gain modulation of visual responses in high field (7 T) fMRI data. We characterized population eye-position dependent gain fields (pEGF). The information contained in the pEGFs allowed us to reconstruct eye positions over time across the visual hierarchy. We discovered a systematic distribution of pEGF centers: pEGF centers shift from contra- to ipsilateral following pRF eccentricity. Such a topographical organization suggests that signals beyond pure retinotopy are accessible early in the visual hierarchy, providing the potential to solve sensory ambiguity and optimize sensory processing information for functionally relevant behavior.

Interdigitated Columnar Representation of Personal Space and Visual Space in Human Parietal Cortex

Personal space (PS) is the space around the body that people prefer to maintain between themselves and unfamiliar others. Intrusion into personal space evokes discomfort and an urge to move away. Physiologic studies in nonhuman primates suggest that defensive responses to intruding stimuli involve the parietal cortex. We hypothesized that the spatial encoding of interpersonal distance is initially transformed from purely sensory to more egocentric mapping within human parietal cortex. This hypothesis was tested using 7 Tesla (7T) fMRI at high spatial resolution (1.1 mm isotropic), in seven subjects (four females, three males). In response to visual stimuli presented at a range of virtual distances, we found two categories of distance encoding in two corresponding radially-extending columns of activity within parietal cortex. One set of columns (P columns) responded selectively to moving and stationary face images presented at virtual distances that were nearer (but not farther) than each subject's behaviorally-defined personal space boundary. In most P columns, BOLD response amplitudes increased monotonically and nonlinearly with increasing virtual face proximity. In the remaining P columns, BOLD responses decreased with increasing proximity. A second set of parietal columns (D columns) responded selectively to disparity-based distance cues (near or far) in random dot stimuli, similar to disparity-selective columns described previously in occipital cortex. Critically, in parietal cortex, P columns were topographically interdigitated (nonoverlapping) with D columns. These results suggest that visual spatial information is transformed from visual to body-centered (or person-centered) dimensions in multiple local sites within human parietal cortex.SIGNIFICANCE STATEMENT Recent COVID-related social distancing practices highlight the need to better understand brain mechanisms which regulate "personal space" (PS), which is defined by the closest interpersonal distance that is comfortable for an individual. Using high spatial resolution brain imaging, we tested whether a map of external space is transformed from purely visual (3D-based) information to a more egocentric map (related to personal space) in human parietal cortex. We confirmed this transformation and further showed that it was mediated by two mutually segregated sets of columns: one which encoded interpersonal distance and another that encoded visual distance. These results suggest that the cortical transformation of sensory-centered to person-centered encoding of space near the body involves short-range communication across interdigitated columns within parietal cortex.

Predicting Identity-Preserving Object Transformations in Human Posterior Parietal Cortex and Convolutional Neural Networks

Previous research shows that, within human occipito-temporal cortex (OTC), we can use a general linear mapping function to link visual object responses across nonidentity feature changes, including Euclidean features (e.g., position and size) and non-Euclidean features (e.g., image statistics and spatial frequency). Although the learned mapping is capable of predicting responses of objects not included in training, these predictions are better for categories included than those not included in training. These findings demonstrate a near-orthogonal representation of object identity and nonidentity features throughout human OTC. Here, we extended these findings to examine the mapping across both Euclidean and non-Euclidean feature changes in human posterior parietal cortex (PPC), including functionally defined regions in inferior and superior intraparietal sulcus. We additionally examined responses in five convolutional neural networks (CNNs) pretrained with object classification, as CNNs are considered as the current best model of the primate ventral visual system. We separately compared results from PPC and CNNs with those of OTC. We found that a linear mapping function could successfully link object responses in different states of nonidentity transformations in human PPC and CNNs for both Euclidean and non-Euclidean features. Overall, we found that object identity and nonidentity features are represented in a near-orthogonal, rather than complete-orthogonal, manner in PPC and CNNs, just like they do in OTC. Meanwhile, some differences existed among OTC, PPC, and CNNs. These results demonstrate the similarities and differences in how visual object information across an identity-preserving image transformation may be represented in OTC, PPC, and CNNs.

The spatial properties of adaptation-induced distance compression

Exposure to a dynamic texture reduces the perceived separation between objects, altering the mapping between physical relations in the environment and their neural representations. Here we investigated the spatial tuning and spatial frame of reference of this aftereffect to understand the stage(s) of processing where adaptation-induced changes occur. In Experiment 1, we measured apparent separation at different positions relative to the adapted area, revealing a strong but tightly tuned compression effect. We next tested the spatial frame of reference of the effect, either by introducing a gaze shift between adaptation and test phase (Experiment 2) or by decoupling the spatial selectivity of adaptation in retinotopic and world-centered coordinates (Experiment 3). Results across the two experiments indicated that both retinotopic and world-centered adaptation effects can occur independently. Spatial attention to the location of the adaptor alone could not account for the world-centered transfer we observed, and retinotopic adaptation did not transfer to world-centered coordinates after a saccade (Experiment 4). Finally, we found that aftereffects in different reference frames have a similar, narrow spatial tuning profile (Experiment 5). Together, our results suggest that the neural representation of local separation resides early in the visual cortex, but it can also be modulated by activity in higher visual areas.

Understanding transformation tolerant visual object representations in the human brain and convolutional neural networks

Forming transformation-tolerant object representations is critical to high-level primate vision. Despite its significance, many details of tolerance in the human brain remain unknown. Likewise, despite the ability of convolutional neural networks (CNNs) to exhibit human-like object categorization performance, whether CNNs form tolerance similar to that of the human brain is unknown. Here we provide the first comprehensive documentation and comparison of three tolerance measures in the human brain and CNNs. We measured fMRI responses from human ventral visual areas to real-world objects across both Euclidean and non-Euclidean feature changes. In single fMRI voxels in higher visual areas, we observed robust object response rank-order preservation across feature changes. This is indicative of functional smoothness in tolerance at the fMRI meso-scale level that has never been reported before. At the voxel population level, we found highly consistent object representational structure across feature changes towards the end of ventral processing. Rank-order preservation, consistency, and a third tolerance measure, cross-decoding success (i.e., a linear classifier's ability to generalize performance across feature changes) showed an overall tight coupling. These tolerance measures were in general lower for Euclidean than non-Euclidean feature changes in lower visual areas, but increased over the course of ventral processing for all feature changes. These characteristics of tolerance, however, were absent in eight CNNs pretrained with ImageNet images with varying network architecture, depth, the presence/absence of recurrent processing, or whether a network was pretrained with the original or stylized ImageNet images that encouraged shape processing. CNNs do not appear to develop the same kind of tolerance as the human brain over the course of visual processing.

Action planning modulates the representation of object features in human fronto-parietal and occipital cortex

The visual cortex has been extensively studied to investigate its role in object recognition but to a lesser degree to determine how action planning influences the representation of objects' features. We used functional MRI and pattern classification methods to determine if during action planning, object features (orientation and location) could be decoded in an action‐dependent way. Sixteen human participants used their right dominant hand to perform movements (Align or Open reach) towards one of two 3D‐real oriented objects that were simultaneously presented and placed on either side of a fixation cross. While both movements required aiming towards target location, Align but not Open reach movements required participants to precisely adjust hand orientation. Therefore, we hypothesized that if the representation of object features is modulated by the upcoming action, pre‐movement activity pattern would allow more accurate dissociation between object features in Align than Open reach tasks. We found such dissociation in the anterior and posterior parietal cortex, as well as in the dorsal premotor cortex, suggesting that visuomotor processing is modulated by the upcoming task. The early visual cortex showed significant decoding accuracy for the dissociation between object features in the Align but not Open reach task. However, there was no significant difference between the decoding accuracy in the two tasks. These results demonstrate that movement‐specific preparatory signals modulate object representation in the frontal and parietal cortex, and to a lesser extent in the early visual cortex, likely through feedback functional connections.

Topological Maps and Brain Computations From Low to High

We first briefly summarize data from microelectrode studies on visual maps in non-human primates and other mammals, and characterize differences among the features of the approximately topological maps in the three main sensory modalities. We then explore the almost 50% of human neocortex that contains straightforward topological visual, auditory, and somatomotor maps by presenting a new parcellation as well as a movie atlas of cortical area maps on the FreeSurfer average surface, fsaverage. Third, we review data on moveable map phenomena as well as a recent study showing that cortical activity during sensorimotor actions may involve spatially locally coherent traveling wave and bump activity. Finally, by analogy with remapping phenomena and sensorimotor activity, we speculate briefly on the testable possibility that coherent localized spatial activity patterns might be able to ‘escape’ from topologically mapped cortex during ‘serial assembly of content’ operations such as scene and language comprehension, to form composite ‘molecular’ patterns that can move across some cortical areas and possibly return to topologically mapped cortex to generate motor output there.

Complex tools and motor-to-mechanical transformations

The ability to use complex tools is thought to depend on multifaceted motor-to-mechanical transformations within the left inferior parietal lobule (IPL), linked to cognitive control over compound actions. Here we show using neuroimaging that demanding transformations of finger movements into proper mechanical movements of functional parts of complex tools invoke significantly the right rather than left rostral IPL, and bilateral posterior-to-mid and left anterior intraparietal sulci. These findings emerged during the functional grasp and tool-use programming phase. The expected engagement of left IPL was partly revealed by traditional region-of-interest analyses, and further modeling/estimations at the hand-independent level. Thus, our results point to a special role of right IPL in supporting sensory-motor spatial mechanisms which enable an effective control of fingers in skillful handling of complex tools. The resulting motor-to-mechanical transformations involve dynamic hand-centered to target-centered reference frame conversions indispensable for efficient interactions with the environment.

Flexible utilization of spatial- and motor-based codes for the storage of visuo-spatial information

Working memory provides flexible storage of information in service of upcoming behavioral goals. Some models propose specific fixed loci and mechanisms for the storage of visual information in working memory, such as sustained spiking in parietal and prefrontal cortex during working memory maintenance. An alternative view is that information can be remembered in a flexible format that best suits current behavioral goals. For example, remembered visual information might be stored in sensory areas for easier comparison to future sensory inputs, or might be re-coded into a more abstract action-oriented format and stored in motor areas. Here, we tested this hypothesis using a visuo-spatial working memory task where the required behavioral response was either known or unknown during the memory delay period. Using functional magnetic resonance imaging (fMRI) and multivariate decoding, we found that there was less information about remembered spatial position in early visual and parietal regions when the required response was known versus unknown. Furthermore, a representation of the planned motor action emerged in primary somatosensory, primary motor, and premotor cortex during the same task condition where spatial information was reduced in early visual cortex. These results suggest that the neural networks supporting working memory can be strategically reconfigured depending on specific behavioral requirements during a canonical visual working memory paradigm.

TMS intensity and focality correlation with coil orientation at three non-motor regions

Objective. The aim of this study is to define the best coil orientations for transcranial magnetic stimulation (TMS) for three clinically relevant brain areas: pre-supplementary motor area (pre-SMA), inferior frontal gyrus (IFG), and posterior parietal cortex (PPC), by means of simulations in 12 realistic head models of the electric field (E-field). Methods. We computed the E-field generated by TMS in our three volumes of interest (VOI) that were delineated based on published atlases. We then analysed the maximum intensity and spatial focality for the normal and absolute components of the E-field considering different percentile thresholds. Lastly, we correlated these results with the different anatomical properties of our VOIs. Results. Overall, the spatial focality of the E-field for the three VOIs varied depending on the orientation of the coil. Further analysis showed that differences in individual brain anatomy were related to the amount of focality achieved. In general, a larger percentage of sulcus resulted in better spatial focality. Additionally, a higher normal E-field intensity was achieved when the coil axis was placed perpendicular to the predominant orientations of the gyri of each VOI. A positive correlation between spatial focality and E-field intensity was found for PPC and IFG but not for pre-SMA. Conclusions. For a rough approximation, better coil orientations can be based on the individual’s specific brain morphology at the VOI. Moreover, TMS computational models should be employed to obtain better coil orientations in non-motor regions of interest. Significance. Finding better coil orientations in non-motor regions is a challenge in TMS and seeks to reduce interindividual variability. Our individualized TMS simulation pipeline leads to fewer inter-individual variability in the focality, likely enhancing the efficacy of the stimulation and reducing the risk of stimulating adjacent, non-targeted areas.

Relative precision of top-down attentional modulations is lower in early visual cortex compared to mid- and high-level visual areas

Top-down spatial attention enhances cortical representations of behaviorally relevant visual information and increases the precision of perceptual reports. However, little is known about the relative precision of top-down attentional modulations in different visual areas, especially compared with the highly precise stimulus-driven responses that are observed in early visual cortex. For example, the precision of attentional modulations in early visual areas may be limited by the relatively coarse spatial selectivity and the anatomical connectivity of the areas in prefrontal cortex that generate and relay the top-down signals. Here, we used functional MRI (fMRI) and human participants to assess the precision of bottom-up spatial representations evoked by high-contrast stimuli across the visual hierarchy. Then, we examined the relative precision of top-down attentional modulations in the absence of spatially specific bottom-up drive. Whereas V1 showed the largest relative difference between the precision of top-down attentional modulations and the precision of bottom-up modulations, midlevel areas such as V4 showed relatively smaller differences between the precision of top-down and bottom-up modulations. Overall, this interaction between visual areas (e.g., V1 vs. V4) and the relative precision of top-down and bottom-up modulations suggests that the precision of top-down attentional modulations is limited by the representational fidelity of areas that generate and relay top-down feedback signals.NEW & NOTEWORTHY When the relative precision of purely top-down and bottom-up signals were compared across visual areas, early visual areas like V1 showed higher bottom-up precision compared with top-down precision. In contrast, midlevel areas showed similar levels of top-down and bottom-up precision. This result suggests that the precision of top-down attentional modulations may be limited by the relatively coarse spatial selectivity and the anatomical connectivity of the areas generating and relaying the signals.

Mental imagery can generate and regulate acquired differential fear conditioned reactivity

Mental imagery is an important tool in the cognitive control of emotion. The present study tests the prediction that visual imagery can generate and regulate differential fear conditioning via the activation and prioritization of stimulus representations in early visual cortices. We combined differential fear conditioning with manipulations of viewing and imagining basic visual stimuli in humans. We discovered that mental imagery of a fear-conditioned stimulus compared to imagery of a safe conditioned stimulus generated a significantly greater conditioned response as measured by self-reported fear, the skin conductance response, and right anterior insula activity (experiment 1). Moreover, mental imagery effectively down- and up-regulated the fear conditioned responses (experiment 2). Multivariate classification using the functional magnetic resonance imaging data from retinotopically defined early visual regions revealed significant decoding of the imagined stimuli in V2 and V3 (experiment 1) but significantly reduced decoding in these regions during imagery-based regulation (experiment 2). Together, the present findings indicate that mental imagery can generate and regulate a differential fear conditioned response via mechanisms of the depictive theory of imagery and the biased-competition theory of attention. These findings also highlight the potential importance of mental imagery in the manifestation and treatment of psychological illnesses.

Concurrent TMS-fMRI: Technical Challenges, Developments, and Overview of Previous Studies

Transcranial magnetic stimulation (TMS) is a promising treatment modality for psychiatric and neurological disorders. Repetitive TMS (rTMS) is widely used for the treatment of psychiatric and neurological diseases, such as depression, motor stroke, and neuropathic pain. However, the underlying mechanisms of rTMS-mediated neuronal modulation are not fully understood. In this respect, concurrent or simultaneous TMS-fMRI, in which TMS is applied during functional magnetic resonance imaging (fMRI), is a viable tool to gain insights, as it enables an investigation of the immediate effects of TMS. Concurrent application of TMS during neuroimaging usually causes severe artifacts due to magnetic field inhomogeneities induced by TMS. However, by carefully interleaving the TMS pulses with MR signal acquisition in the way that these are far enough apart, we can avoid any image distortions. While the very first feasibility studies date back to the 1990s, recent developments in coil hardware and acquisition techniques have boosted the number of TMS-fMRI applications. As such, a concurrent application requires expertise in both TMS and MRI mechanisms and sequencing, and the hurdle of initial technical set up and maintenance remains high. This review gives a comprehensive overview of concurrent TMS-fMRI techniques by collecting (1) basic information, (2) technical challenges and developments, (3) an overview of findings reported so far using concurrent TMS-fMRI, and (4) current limitations and our suggestions for improvement. By sharing this review, we hope to attract the interest of researchers from various backgrounds and create an educational knowledge base.

Predicting the retinotopic organization of human visual cortex from anatomy using geometric deep learning

Whether it be in a single neuron or a more complex biological system like the human brain, form and function are often directly related. The functional organization of human visual cortex, for instance, is tightly coupled with the underlying anatomy with cortical shape having been shown to be a useful predictor of the retinotopic organization in early visual cortex. Although the current state-of-the-art in predicting retinotopic maps is able to account for gross individual differences, such models are unable to account for any idiosyncratic differences in the structure-function relationship from anatomical information alone due to their initial assumption of a template. Here we developed a geometric deep learning model capable of exploiting the actual structure of the cortex to learn the complex relationship between brain function and anatomy in human visual cortex such that more realistic and idiosyncratic maps could be predicted. We show that our neural network was not only able to predict the functional organization throughout the visual cortical hierarchy, but that it was also able to predict nuanced variations across individuals. Although we demonstrate its utility for modeling the relationship between structure and function in human visual cortex, our approach is flexible and well-suited for a range of other applications involving data structured in non-Euclidean spaces.

Left parietal involvement in motion sickness susceptibility revealed by multimodal magnetic resonance imaging

Susceptibility to motion sickness varies greatly across individuals. However, the neural mechanisms underlying this susceptibility remain largely unclear. To address this gap, the current study aimed to identify the neural correlates of motion sickness susceptibility using multimodal MRI. First, we compared resting-state functional connectivity between healthy individuals who were highly susceptible to motion sickness (N = 36) and age/sex-matched controls who showed low susceptibility (N = 36). Seed-based analysis revealed between-group differences in functional connectivity of core vestibular regions in the left posterior Sylvian fissure. A data-driven approach using intrinsic connectivity contrast found greater network centrality of the left intraparietal sulcus in high- rather than in low-susceptible individuals. Moreover, exploratory structural connectivity analysis uncovered an association between motion sickness susceptibility and white matter integrity in the left inferior fronto-occipital fasciculus. Taken together, our data indicate left parietal involvement in motion sickness susceptibility.

Predicting Identity-Preserving Object Transformations across the Human Ventral Visual Stream

In everyday life, we have no trouble categorizing objects varying in position, size, and orientation. Previous fMRI research shows that higher-level object processing regions in the human lateral occipital cortex may link object responses from different affine states (i.e., size and viewpoint) through a general linear mapping function capable of predicting responses to novel objects. In this study, we extended this approach to examine the mapping for both Euclidean (e.g., position and size) and non-Euclidean (e.g., image statistics and spatial frequency) transformations across the human ventral visual processing hierarchy, including areas V1, V2, V3, V4, ventral occipitotemporal cortex, and lateral occipitotemporal cortex. The predicted pattern generated from a linear mapping function could capture a significant amount of the changes associated with the transformations throughout the ventral visual stream. The derived linear mapping functions were not category independent as performance was better for the categories included than those not included in training and better between two similar versus two dissimilar categories in both lower and higher visual regions. Consistent with object representations being stronger in higher than in lower visual regions, pattern selectivity and object category representational structure were somewhat better preserved in the predicted patterns in higher than in lower visual regions. There were no notable differences between Euclidean and non-Euclidean transformations. These findings demonstrate a near-orthogonal representation of object identity and these nonidentity features throughout the human ventral visual processing pathway with these nonidentity features largely untangled from the identity features early in visual processing.SIGNIFICANCE STATEMENT Presently we still do not fully understand how object identity and nonidentity (e.g., position, size) information are simultaneously represented in the primate ventral visual system to form invariant representations. Previous work suggests that the human lateral occipital cortex may be linking different affine states of object representations through general linear mapping functions. Here, we show that across the entire human ventral processing pathway, we could link object responses in different states of nonidentity transformations through linear mapping functions for both Euclidean and non-Euclidean transformations. These mapping functions are not identity independent, suggesting that object identity and nonidentity features are represented in a near rather than a completely orthogonal manner.

Working memory representations in visual cortex mediate distraction effects

Although the contents of working memory can be decoded from visual cortex activity, these representations may play a limited role if they are not robust to distraction. We used model-based fMRI to estimate the impact of distracting visual tasks on working memory representations in several visual field maps in visual and frontoparietal association cortex. Here, we show distraction causes the fidelity of working memory representations to briefly dip when both the memorandum and distractor are jointly encoded by the population activities. Distraction induces small biases in memory errors which can be predicted by biases in neural decoding in early visual cortex, but not other regions. Although distraction briefly disrupts working memory representations, the widespread redundancy with which working memory information is encoded may protect against catastrophic loss. In early visual cortex, the neural representation of information in working memory and behavioral performance are intertwined, solidifying its importance in visual memory.

The relative roles of visual, parietal, and frontal cortex in working memory have been actively debated. Here, the authors show that distraction impacts visual working memory representations in primary visual areas, indicating that these regions play a key role in the maintenance of working memory.

Individual Subject Approaches to Mapping Sensory-Biased and Multiple-Demand Regions in Human Frontal Cortex

Sensory modality, widely accepted as a key factor in the functional organization of posterior cortical areas, also shapes the organization of human frontal lobes. 'Deep imaging,' or the practice of collecting a sizable amount of data on individual subjects, offers significant advantages in revealing fine-scale aspects of functional organization of the human brain. Here, we review deep imaging approaches to mapping multiple sensory-biased and multiple-demand regions within human lateral frontal cortex. In addition, we discuss how deep imaging methods can be transferred to large public data sets to further extend functional mapping at the group level. We also review how 'connectome fingerprinting' approaches, combined with deep imaging, can be used to localize fine-grained functional organization in individual subjects using resting-state data. Finally, we summarize current 'best practices' for deep imaging.

Errors in visuospatial working memory across space and time

Visuospatial working memory (VSWM) involves cortical regions along the dorsal visual pathway, which are topographically organized with respect to the visual space. However, it remains unclear how such functional organization may constrain VSWM behavior across space and time. Here, we systematically mapped VSWM performance across the 2-dimensional (2D) space in various retention intervals in human subjects using the memory-guided and visually guided saccade tasks in two experiments. Relative to visually guided saccades, memory-guided saccades showed significant increases in unsystematic errors, or response variability, with increasing target eccentricity (3°–13° of visual angle). Unsystematic errors also increased with increasing delay (1.5–3 s, Experiment 1; 0.5–5 s, Experiment 2), while there was little or no interaction between delay and eccentricity. Continuous bump attractor modeling suggested neurophysiological and functional organization factors in the increasing unsystematic errors in VSWM across space and time. These findings indicate that: (1) VSWM representation may be limited by the functional topology of the visual pathway for the 2D space; (2) Unsystematic errors may reflect accumulated noise from memory maintenance while systematic errors may originate from non-mnemonic processes such as noisy sensorimotor transformation; (3) There may be independent mechanisms supporting the spatial and temporal processing of VSWM.

Aberrant visual population receptive fields in human albinism

Retinotopic organization is a fundamental feature of visual cortex thought to play a vital role in encoding spatial information. One important aspect of normal retinotopy is the representation of the right and left hemifields in contralateral visual cortex. However, in human albinism, many temporal retinal afferents decussate aberrantly at the optic chiasm resulting in partially superimposed representations of opposite hemifields in each hemisphere of visual cortex. Previous functional magnetic resonance imaging (fMRI) studies in human albinism suggest that the right and left hemifield representations are superimposed in a mirror-symmetric manner. This should produce imaging voxels which respond to two separate locations mirrored across the vertical meridian. However, it is not yet clear how retino-cortical miswiring in albinism manifests at the level of single voxel population receptive fields (pRFs). Here, we used pRF modeling to fit both single and dual pRF models to the visual responses of voxels in visual areas V1 to V3 of five subjects with albinism. We found that subjects with albinism (but not controls) have sizable clusters of voxels with unequivocal dual pRFs consistently corresponding to, but not fully coextensive with, regions of hemifield overlap. These dual pRFs were typically positioned at locations roughly mirrored across the vertical meridian and were uniquely clustered within a portion of the visual field for each subject.

Limits to visual representational correspondence between convolutional neural networks and the human brain

Convolutional neural networks (CNNs) are increasingly used to model human vision due to their high object categorization capabilities and general correspondence with human brain responses. Here we evaluate the performance of 14 different CNNs compared with human fMRI responses to natural and artificial images using representational similarity analysis. Despite the presence of some CNN-brain correspondence and CNNs' impressive ability to fully capture lower level visual representation of real-world objects, we show that CNNs do not fully capture higher level visual representations of real-world objects, nor those of artificial objects, either at lower or higher levels of visual representations. The latter is particularly critical, as the processing of both real-world and artificial visual stimuli engages the same neural circuits. We report similar results regardless of differences in CNN architecture, training, or the presence of recurrent processing. This indicates some fundamental differences exist in how the brain and CNNs represent visual information.

Examining the Coding Strength of Object Identity and Nonidentity Features in Human Occipito-Temporal Cortex and Convolutional Neural Networks

A visual object is characterized by multiple visual features, including its identity, position and size. Despite the usefulness of identity and nonidentity features in vision and their joint coding throughout the primate ventral visual processing pathway, they have so far been studied relatively independently. Here in both female and male human participants, the coding of identity and nonidentity features was examined together across the human ventral visual pathway. The nonidentity features tested included two Euclidean features (position and size) and two non-Euclidean features (image statistics and spatial frequency (SF) content of an image). Overall, identity representation increased and nonidentity feature representation decreased along the ventral visual pathway, with identity outweighing the non-Euclidean but not the Euclidean features at higher levels of visual processing. In 14 convolutional neural networks (CNNs) pretrained for object categorization with varying architecture, depth, and with/without recurrent processing, nonidentity feature representation showed an initial large increase from early to mid-stage of processing, followed by a decrease at later stages of processing, different from brain responses. Additionally, from lower to higher levels of visual processing, position became more underrepresented and image statistics and SF became more overrepresented compared with identity in CNNs than in the human brain. Similar results were obtained in a CNN trained with stylized images that emphasized shape representations. Overall, by measuring the coding strength of object identity and nonidentity features together, our approach provides a new tool for characterizing feature coding in the human brain and the correspondence between the brain and CNNs.SIGNIFICANCE STATEMENT This study examined the coding strength of object identity and four types of nonidentity features along the human ventral visual processing pathway and compared brain responses with those of 14 convolutional neural networks (CNNs) pretrained to perform object categorization. Overall, identity representation increased and nonidentity feature representation decreased along the ventral visual pathway, with some notable differences among the different nonidentity features. CNNs differed from the brain in a number of aspects in their representations of identity and nonidentity features over the course of visual processing. Our approach provides a new tool for characterizing feature coding in the human brain and the correspondence between the brain and CNNs.

Representation of Contralateral Visual Space in the Human Hippocampus

The initial encoding of visual information primarily from the contralateral visual field is a fundamental organizing principle of the primate visual system. Recently, the presence of such retinotopic sensitivity has been shown to extend well beyond early visual cortex to regions not historically considered retinotopically sensitive. In particular, human scene-selective regions in parahippocampal and medial parietal cortex exhibit prominent biases for the contralateral visual field. Here, we used fMRI to test the hypothesis that the human hippocampus, which is thought to be anatomically connected with these scene-selective regions, would also exhibit a biased representation of contralateral visual space. First, population receptive field (pRF) mapping with scene stimuli revealed strong biases for the contralateral visual field in bilateral hippocampus. Second, the distribution of retinotopic sensitivity suggested a more prominent representation in anterior medial portions of the hippocampus. Finally, the contralateral bias was confirmed in independent data taken from the Human Connectome Project (HCP) initiative. The presence of contralateral biases in the hippocampus, a structure considered by many as the apex of the visual hierarchy, highlights the truly pervasive influence of retinotopy. Moreover, this finding has important implications for understanding how visual information relates to the allocentric global spatial representations known to be encoded therein.SIGNIFICANCE STATEMENT Retinotopic encoding of visual information is an organizing principle of visual cortex. Recent work demonstrates this sensitivity in structures far beyond early visual cortex, including those anatomically connected to the hippocampus. Here, using population receptive field (pRF) modeling in two independent sets of data we demonstrate a consistent bias for the contralateral visual field in bilateral hippocampus. Such a bias highlights the truly pervasive influence of retinotopy, with important implications for understanding how the presence of retinotopy relates to more allocentric spatial representations.

Representation of visual numerosity information during working memory in humans: An fMRI decoding study

Both animal and human studies on numerosity have shown the importance of the parietal cortex for numerosity processing. However, most studies have focused on the perceptual processing of numerosity. Still, it is unclear how and where numerosity information is coded when this information is retained during a working memory delay phase. Such temporal storage could be realized by the same structures as perceptual processes, or be transformed to a more abstract representation, potentially involving prefrontal regions. FMRI decoding studies allow the identification of brain areas that exhibit multi‐voxel activation patterns specific to the content of working memory. Here, we used an assumption‐free searchlight‐decoding approach to test where numerosity‐specific codes can be found during a 12 s retention period. Participants (n = 24) performed a retro‐cue delayed match‐to‐sample task, in which numerosity information was presented as visual dot arrays. We found mnemonic numerosity‐specific activation in the right lateral portion of the intraparietal sulcus; an area well‐known for perceptual processing of numerosity. The applied retro‐cue design dissociated working memory delay activity from perceptual processes and showed that the intraparietal sulcus also maintained working memory representation independent of perception.

Modulating the interhemispheric activity balance in the intraparietal sulcus using real-time fMRI neurofeedback: Development and proof-of-concept

The intraparietal sulcus (IPS) plays a key role in the distribution of attention across the visual field. In stroke patients, an imbalance between left and right IPS activity has been related to a spatial bias in visual attention characteristic of hemispatial neglect. In this study, we describe the development and implementation of a real-time functional magnetic resonance imaging neurofeedback protocol to noninvasively and volitionally control the interhemispheric IPS activity balance in neurologically healthy participants. Six participants performed three neurofeedback training sessions across three weeks. Half of them trained to voluntarily increase brain activity in left relative to right IPS, while the other half trained to regulate the IPS activity balance in the opposite direction. Before and after the training, we estimated the distribution of attention across the visual field using a whole and partial report task. Over the course of the training, two of the three participants in the left-IPS group increased the activity in the left relative to the right IPS, while the participants in the right-IPS group were not able to regulate the interhemispheric IPS activity balance. We found no evidence for a decrease in resting-state functional connectivity between left and right IPS, and the spatial distribution of attention did not change over the course of the experiment. This study indicates the possibility to voluntarily modulate the interhemispheric IPS activity balance. Further research is warranted to examine the effectiveness of this technique in the rehabilitation of post-stroke hemispatial neglect.

Scotopic Vision Is Selectively Processed in Thick-Type Columns in Human Extrastriate Cortex

In humans, visual stimuli can be perceived across an enormous range of light levels. Evidence suggests that different neural mechanisms process different subdivisions of this range. For instance, in the retina, stimuli presented at very low (scotopic) light levels activate rod photoreceptors, whereas cone photoreceptors are activated relatively more at higher (photopic) light levels. Similarly, different retinal ganglion cells are activated by scotopic versus photopic stimuli. However, in the brain, it remains unknown whether scotopic versus photopic information is: 1) processed in distinct channels, or 2) neurally merged. Using high-resolution functional magnetic resonance imaging at 7 T, we confirmed the first hypothesis. We first localized thick versus thin-type columns within areas V2, V3, and V4, based on photopic selectivity to motion versus color, respectively. Next, we found that scotopic stimuli selectively activated thick- (compared to thin-) type columns in V2 and V3 (in measurements of both overlap and amplitude) and V4 (based on overlap). Finally, we found stronger resting-state functional connections between scotopically dominated area MT with thick- (compared to thin-) type columns in areas V2, V3, and V4. We conclude that scotopic stimuli are processed in partially segregated parallel streams, emphasizing magnocellular influence, from retina through middle stages of visual cortex.

A reassessment of the pseudoneglect effect: Attention allocation systems are selectively engaged by semantic and spatial processing

Healthy individuals display systematic inaccuracies when allocating attention to perceptual space. Under many conditions, optimized spatial attention processing of the right hemisphere’s frontoparietal attention network directs more attention to the left side of perceptual space than the right. This is the pseudoneglect effect. We present evidence reshaping our fundamental understanding of this neural mechanism. We describe a previously unrecognized, but reliable, attention bias to the right side of perceptual space that is associated with semantic object processing. Using an object bisection task, we revealed a significant rightward bias distinct from the leftward bias elicited by the traditional line bisection task. In Experiment 2, object-like shapes that were not easily recognizable exhibited an attention bias between that of horizontal lines and objects. Our results support our proposal that the rightward attention bias is a product of semantic processing and its lateralization in the left hemisphere. In Experiment 3, our novel object-based adaptation of the landmark task further supported this proposition and revealed temporal dynamics of the effect. This research provides novel and crucial insight into the systems supporting intricate and complex attention allocation and provides impetus for a shift toward studying attention in ways that increasingly reflect our complex environments.

This study describes a previously unrecognized but reliable spatial attention bias that is associated with the processing of the semantic meaning of objects. This counters the spatial attention bias well-known as the pseudoneglect effect. Our findings implicate a crucial role for the understudied left frontoparietal cortex in distributing attention, and open new, exciting areas for research. This work also reveals a mechanism that potentially enables our attention to be directed equally to different areas of space in daily life.

Wide-field retinotopy reveals a new visuotopic cluster in macaque posterior parietal cortex

We investigated the visuotopic organization of macaque posterior parietal cortex (PPC) by combining functional imaging (fMRI) and wide-field retinotopic mapping in two macaque monkeys. Whole brain blood-oxygen-level-dependent (BOLD) signal was recorded while monkeys maintained central fixation during the presentation of large rotating wedges and expending/contracting annulus of a "shaking" fruit basket, designed to maximize the recruitment of PPC neurons. Results of the surface-based population receptive field (pRF) analysis reveal a new cluster of four visuotopic areas at the confluence of the parieto-occipital and intra-parietal sulci, in a location previously defined histologically and anatomically as the posterior intra-parietal (PIP) region. This PIP cluster groups together two recently described areas (CIP1/2) laterally and two newly identified ones (PIP1/2) medially, whose foveal representations merge in the fundus of the intra-parietal sulcus. The cluster shares borders with other visuotopic areas: V3d posteriorly, V3A/DP laterally, V6/V6A medially and LIP anteriorly. Together, these results show that monkey PPC is endowed with a dense set of visuotopic areas, as its human counterpart. The fact that fMRI and wide-field stimulation allows a functional parsing of monkey PPC offers a new framework for studying functional homologies with human PPC.

Selective Modulation of Early Visual Cortical Activity by Movement Intention

The primate visual system contains myriad feedback projections from higher- to lower-order cortical areas, an architecture that has been implicated in the top-down modulation of early visual areas during working memory and attention. Here we tested the hypothesis that these feedback projections also modulate early visual cortical activity during the planning of visually guided actions. We show, across three separate human functional magnetic resonance imaging (fMRI) studies involving object-directed movements, that information related to the motor effector to be used (i.e., limb, eye) and action goal to be performed (i.e., grasp, reach) can be selectively decoded-prior to movement-from the retinotopic representation of the target object(s) in early visual cortex. We also find that during the planning of sequential actions involving objects in two different spatial locations, that motor-related information can be decoded from both locations in retinotopic cortex. Together, these findings indicate that movement planning selectively modulates early visual cortical activity patterns in an effector-specific, target-centric, and task-dependent manner. These findings offer a neural account of how motor-relevant target features are enhanced during action planning and suggest a possible role for early visual cortex in instituting a sensorimotor estimate of the visual consequences of movement.

Controlling Brain State Prior to Stimulation of Parietal Cortex Prevents Deterioration of Sustained Attention

Sustained attention is a limited resource which declines during daily tasks. Such decay is exacerbated in clinical and aging populations. Inhibition of the intraparietal sulcus (IPS), using low-frequency repetitive transcranial magnetic stimulation (LF-rTMS), can lead to an upregulation of functional communication within the attention network. Attributed to functional compensation for the inhibited node, this boost lasts for tens of minutes poststimulation. Despite the neural change, no behavioral correlate has been found in healthy subjects, a necessary direct evidence of functional compensation. To understand the functional significance of neuromodulatory induced fluctuations on attention, we sought to boost the impact of LF-rTMS to impact behavior. We controlled brain state prior to LF-rTMS using high-frequency transcranial random noise stimulation (HF-tRNS), shown to increase and stabilize neuronal excitability. Using fMRI-guided stimulation protocols combining HF-tRNS and LF-rTMS, we tested the poststimulation impact on sustained attention with multiple object tracking (MOT). While attention deteriorated across time in control conditions, HF-tRNS followed by LF-rTMS doubled sustained attention capacity to 94 min. Multimethod stimulation was more effective when targeting right IPS, supporting specialized attention processing in the right hemisphere. Used in cognitive domains dependent on network-wide neural activity, this tool may cause lasting neural compensation useful for clinical rehabilitation.

What Does Dorsal Cortex Contribute to Perception?

According to the influential "Two Visual Pathways" hypothesis, the cortical visual system is segregated into two pathways, with the ventral, occipitotemporal pathway subserving object perception, and the dorsal, occipitoparietal pathway subserving the visuomotor control of action. However, growing evidence suggests that the dorsal pathway also plays a functional role in object perception. In the current article, we present evidence that the dorsal pathway contributes uniquely to the perception of a range of visuospatial attributes that are not redundant with representations in ventral cortex. We describe how dorsal cortex is recruited automatically during perception, even when no explicit visuomotor response is required. Importantly, we propose that dorsal cortex may selectively process visual attributes that can inform the perception of potential actions on objects and environments, and we consider plausible developmental and cognitive mechanisms that might give rise to these representations. As such, we consider whether naturalistic stimuli, such as real-world solid objects, might engage dorsal cortex more so than simplified or artificial stimuli such as images that do not afford action, and how the use of suboptimal stimuli might limit our understanding of the functional contribution of dorsal cortex to visual perception.

Distinct auditory and visual tool regions with multisensory response properties in human parietal cortex

Left parietal cortex has been associated with the human-specific ability of sophisticated tool use. Yet, it is unclear how tool information is represented across senses. Here, we compared auditory and visual tool-specific activations within healthy human subjects to probe the relation of tool-specific networks, uni- and multisensory response properties, and functional and structural connectivity using functional and diffusion-weighted MRI. In each subject, we identified an auditory tool network with regions in left anterior inferior parietal cortex (aud-aIPL), bilateral posterior lateral sulcus, and left inferior precentral sulcus, and a visual tool network with regions in left aIPL (vis-aIPL) and bilateral inferior temporal gyrus. Aud-aIPL was largely separate and anterior/inferior from vis-aIPL, with varying degrees of overlap across subjects. Both regions displayed a strong preference for tools versus other stimuli presented within the same modality. Despite their modality preference, aud-aIPL and vis-aIPL and a region in left inferior precentral sulcus displayed multisensory response properties, as revealed in multivariate analyses. Thus, two largely separate tool networks are engaged by the visual and auditory modalities with nodes in parietal and prefrontal cortex potentially integrating information across senses. The diversification of tool processing in human parietal cortex underpins its critical role in complex object processing.

Causal Inference in Audiovisual Perception

In our natural environment the senses are continuously flooded with a myriad of signals. To form a coherent representation of the world, the brain needs to integrate sensory signals arising from a common cause and segregate signals coming from separate causes. An unresolved question is how the brain solves this binding or causal inference problem and determines the causal structure of the sensory signals. In this functional magnetic resonance imaging (fMRI) study human observers (female and male) were presented with synchronous auditory and visual signals at the same location (i.e., common cause) or different locations (i.e., separate causes). On each trial, observers decided whether signals come from common or separate sources(i.e., "causal decisions"). To dissociate participants' causal inference from the spatial correspondence cues we adjusted the audiovisual disparity of the signals individually for each participant to threshold accuracy. Multivariate fMRI pattern analysis revealed the lateral prefrontal cortex as the only region that encodes predominantly the outcome of observers' causal inference (i.e., common vs separate causes). By contrast, the frontal eye field (FEF) and the intraparietal sulcus (IPS0-4) form a circuitry that concurrently encodes spatial (auditory and visual stimulus locations), decisional (causal inference), and motor response dimensions. These results suggest that the lateral prefrontal cortex plays a key role in inferring and making explicit decisions about the causal structure that generates sensory signals in our environment. By contrast, informed by observers' inferred causal structure, the FEF-IPS circuitry integrates auditory and visual spatial signals into representations that guide motor responses.SIGNIFICANCE STATEMENT In our natural environment, our senses are continuously flooded with a myriad of signals. Transforming this barrage of sensory signals into a coherent percept of the world relies inherently on solving the causal inference problem, deciding whether sensory signals arise from a common cause and should hence be integrated or else be segregated. This functional magnetic resonance imaging study shows that the lateral prefrontal cortex plays a key role in inferring the causal structure of the environment. Crucially, informed by the spatial correspondence cues and the inferred causal structure the frontal eye field and the intraparietal sulcus form a circuitry that integrates auditory and visual spatial signals into representations that guide motor responses.

Gradients of functional organization in posterior parietal cortex revealed by visual attention, visual short-term memory, and intrinsic functional connectivity

Visual attention and visual working memory tasks recruit a common network of lateral frontal cortical (LFC) and posterior parietal cortical (PPC) regions. Here, we examine finer-scale organization of this frontoparietal network. Three LFC regions recruited by visual cognition tasks, superior precentral sulcus (sPCS), inferior precentral sulcus (iPCS), and mid inferior frontal sulcus (midIFS) exhibit differential patterns of resting-state functional connectivity to PPC. A broad dorsomedial to ventrolateral gradient is observed, with sPCS connectivity dominating in the dorsomedial PPC band, iPCS dominating in the middle band, and midIFS dominating in the ventrolateral band. These connectivity-defined subregions of PPC capture differential task activation between a pair of visual attention and working memory tasks. The relative functional connectivity of sPCS and iPCS also varies along the rostral-caudal axis of the retinotopic regions of PPC. iPCS connectivity is relatively stronger near the IPS0/IPS1 and IPS2/IPS3 borders, especially on the lateral portions of these borders, which each preferentially encode central visual field representations. In contrast, sPCS connectivity is relatively stronger elsewhere in retinotopic IPS regions which preferentially encode peripheral visual field representations. These findings reveal fine-scale gradients in functional connectivity within the frontoparietal visual network that capture a high-degree of specificity in PPC functional organization.