Visual field map clusters in human frontoparietal cortex

A Whole-Brain Topographic Ontology

It is a common view that the intricate array of specialized domains in the ventral visual pathway is innately prespecified. What this review postulates is that it is not. We explore the origins of domain specificity, hypothesizing that the adult brain emerges from an interplay between a domain-general map-based architecture, shaped by intrinsic mechanisms, and experience. We argue that the most fundamental innate organization of cortex in general, and not just the visual pathway, is a map-based topography that governs how the environment maps onto the brain, how brain areas interconnect, and ultimately, how the brain processes information.

Trying Harder: How Cognitive Effort Sculpts Neural Representations during Working Memory

While the exertion of mental effort improves performance on cognitive tasks, the neural mechanisms by which motivational factors impact cognition remain unknown. Here, we used fMRI to test how changes in cognitive effort, induced by changes in task difficulty, impact neural representations of working memory (WM). Participants (both sexes) were precued whether WM difficulty would be hard or easy. We hypothesized that hard trials demanded more effort as a later decision required finer mnemonic precision. Behaviorally, pupil size was larger and response times were slower on hard compared with easy trials suggesting our manipulation of effort succeeded. Neurally, we observed robust persistent activity during delay periods in the prefrontal cortex (PFC), especially during hard trials. Yet, details of the memoranda could not be decoded from patterns in prefrontal activity. In the patterns of activity in the visual cortex, however, we found strong decoding of memorized targets, where accuracy was higher on hard trials. To potentially link these across-region effects, we hypothesized that effort, carried by persistent activity in the PFC, impacts the quality of WM representations encoded in the visual cortex. Indeed, we found that the amplitude of delay period activity in the frontal cortex predicted decoded accuracy in the visual cortex on a trial-wise basis. These results indicate that effort-related feedback signals sculpt population activity in the visual cortex, improving mnemonic fidelity.

Visual working memories are abstractions of percepts

During perception, decoding the orientation of gratings depends on complex interactions between the orientation of the grating, aperture edges, and topographic structure of the visual map. Here, we aimed to test how aperture biases described during perception affect working memory (WM) decoding. For memoranda, we used gratings multiplied by radial and angular modulators to generate orthogonal aperture biases for identical orientations. Therefore, if WM representations are simply maintained sensory representations, they would have similar aperture biases. If they are abstractions of sensory features, they would be unbiased and the modulator would have no effect on orientation decoding. Neural patterns of delay period activity while maintaining the orientation of gratings with one modulator (e.g. radial) were interchangeable with patterns while maintaining gratings with the other modulator (e.g. angular) in visual and parietal cortex, suggesting that WM representations are insensitive to aperture biases during perception. Then, we visualized memory abstractions of stimuli using models of visual field map properties. Regardless of aperture biases, WM representations of both modulated gratings were recoded into a single oriented line. These results provide strong evidence that visual WM representations are abstractions of percepts, immune to perceptual aperture biases, and compel revisions of WM theory.

Updating the sulcal landscape of the human lateral parieto-occipital junction provides anatomical, functional, and cognitive insights

Recent work has uncovered relationships between evolutionarily new small and shallow cerebral indentations, or sulci, and human behavior. Yet, this relationship remains unexplored in the lateral parietal cortex (LPC) and the lateral parieto-occipital junction (LPOJ). After defining thousands of sulci in a young adult cohort, we revised the previous LPC/LPOJ sulcal landscape to include four previously overlooked, small, shallow, and variable sulci. One of these sulci (ventral supralateral occipital sulcus, slocs-v) is present in nearly every hemisphere and is morphologically, architecturally, and functionally dissociable from neighboring sulci. A data-driven, model-based approach, relating sulcal depth to behavior further revealed that the morphology of only a subset of LPC/LPOJ sulci, including the slocs-v, is related to performance on a spatial orientation task. Our findings build on classic neuroanatomical theories and identify new neuroanatomical targets for future "precision imaging" studies exploring the relationship among brain structure, brain function, and cognitive abilities in individual participants.

Neural mechanisms of resource allocation in working memory

To mitigate capacity limits of working memory, people allocate resources according to an item's relevance. However, the neural mechanisms supporting such a critical operation remain unknown. Here, we developed computational neuroimaging methods to decode and demix neural responses associated with multiple items in working memory with different priorities. In striate and extrastriate cortex, the gain of neural responses tracked the priority of memoranda. Higher-priority memoranda were decoded with smaller error and lower uncertainty. Moreover, these neural differences predicted behavioral differences in memory prioritization. Remarkably, trialwise variability in the magnitude of delay activity in frontal cortex predicted differences in decoded precision between low and high-priority items in visual cortex. These results suggest a model in which feedback signals broadcast from frontal cortex sculpt the gain of memory representations in visual cortex according to behavioral relevance, thus, identifying a neural mechanism for resource allocation.

Feedback scales the spatial tuning of cortical responses during visual memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex, suggesting that memory uses encoding mechanisms shared with perception. While previous research has largely focused on how perception and memory are similar, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each of these conditions, BOLD responses were spatially tuned and were aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width systematically up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the widths of tuned responses were broad across the visual hierarchy during working memory and long-term memory, matched to the widths in perception in later visual field maps but much broader in V1. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources. Moreover, these tuned responses when biased (clockwise or counterclockwise of target) predicted matched biases in memory, suggesting that the readout of maintained and reinstated mnemonic responses influences memory guided behavior. We conclude that feedback constrains spatial tuning during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.

Visual working memories are abstractions of percepts

Pioneering studies demonstrating that the contents of visual working memory (WM) can be decoded from the patterns of multivoxel activity in early visual cortex transformed not only how we study WM, but theories of how memories are stored. For instance, the ability to decode the orientation of memorized gratings is hypothesized to depend on the recruitment of the same neural encoding machinery used for perceiving orientations. However, decoding evidence cannot be used to test the so-called sensory recruitment hypothesis without understanding the underlying nature of what is being decoded. Although unknown during WM, during perception decoding the orientation of gratings does not simply depend on activities of orientation tuned neurons. Rather, it depends on complex interactions between the orientation of the grating, the aperture edges, and the topographic structure of the visual map. Here, our goals are to 1) test how these aperture biases described during perception may affect WM decoding, and 2) leverage carefully manipulated visual stimulus properties of gratings to test how sensory-like are WM codes. For memoranda, we used gratings multiplied by radial and angular modulators to generate orthogonal aperture biases despite having identical orientations. Therefore, if WM representations are simply maintained sensory representations, they would have similar aperture biases. If they are abstractions of sensory features, they would be unbiased and the modulator would have no effect on orientation decoding. Results indicated that fMRI patterns of delay period activity while maintaining the orientation of a grating with one modulator (eg, radial) were interchangeable with patterns while maintaining a grating with the other modulator (eg, angular). We found significant cross-classification in visual and parietal cortex, suggesting that WM representations are insensitive to aperture biases during perception. Then, we visualized memory abstractions of stimuli using a population receptive field model of the visual field maps. Regardless of aperture biases, WM representations of both modulated gratings were recoded into a single oriented line. These results provide strong evidence that visual WM representations are abstractions of percepts, immune to perceptual aperture biases, and compel revisions of WM theory.

Feature-Specific Salience Maps in Human Cortex

Priority map theory is a leading framework for understanding how various aspects of stimulus displays and task demands guide visual attention. Per this theory, the visual system computes a priority map, which is a representation of visual space indexing the relative importance, or priority, of locations in the environment. Priority is computed based on both salience, defined based on image-computable properties; and relevance, defined by an individual's current goals, and is used to direct attention to the highest-priority locations for further processing. Computational theories suggest that priority maps identify salient locations based on individual feature dimensions (e.g., color, motion), which are integrated into an aggregate priority map. While widely accepted, a core assumption of this framework, the existence of independent feature dimension maps in visual cortex, remains untested. Here, we tested the hypothesis that retinotopic regions selective for specific feature dimensions (color or motion) in human cortex act as neural feature dimension maps, indexing salient locations based on their preferred feature. We used fMRI activation patterns to reconstruct spatial maps while male and female human participants viewed stimuli with salient regions defined by relative color or motion direction. Activation in reconstructed spatial maps was localized to the salient stimulus position in the display. Moreover, the strength of the stimulus representation was strongest in the ROI selective for the salience-defining feature. Together, these results suggest that feature-selective extrastriate visual regions highlight salient locations based on local feature contrast within their preferred feature dimensions, supporting their role as neural feature dimension maps.SIGNIFICANCE STATEMENT Identifying salient information is important for navigating the world. For example, it is critical to detect a quickly approaching car when crossing the street. Leading models of computer vision and visual search rely on compartmentalized salience computations based on individual features; however, there has been no direct empirical demonstration identifying neural regions as responsible for performing these dissociable operations. Here, we provide evidence of a critical double dissociation that neural activation patterns from color-selective regions prioritize the location of color-defined salience while minimally representing motion-defined salience, whereas motion-selective regions show the complementary result. These findings reveal that specialized cortical regions act as neural "feature dimension maps" that are used to index salient locations based on specific features to guide attention.

Trying harder: how cognitive effort sculpts neural representations during working memory

The neural mechanisms by which motivational factors influence cognition remain unknown. Using fMRI, we tested how cognitive effort impacts working memory (WM). Participants were precued whether WM difficulty would be hard or easy. Hard trials demanded more effort as a later decision required finer mnemonic precision. Behaviorally, pupil size was larger and response times were slower on hard trials suggesting our manipulation of effort succeeded. Neurally, we observed robust persistent activity in prefrontal cortex, especially during hard trials. We found strong decoding of location in visual cortex, where accuracy was higher on hard trials. Connecting these across-region effects, we found that the amplitude of delay period activity in frontal cortex predicted decoded accuracy in visual cortex on a trial-wise basis. We conclude that the gain of persistent activity in frontal cortex may be the source of effort-related feedback signals that improve the quality of WM representations stored in visual cortex.

Neural population dynamics of human working memory

The activity of neurons in macaque prefrontal cortex (PFC) persists during working memory (WM) delays, providing a mechanism for memory.1,2,3,4,5,6,7,8,9,10,11 Although theory,11,12 including formal network models,13,14 assumes that WM codes are stable over time, PFC neurons exhibit dynamics inconsistent with these assumptions.15,16,17,18,19 Recently, multivariate reanalyses revealed the coexistence of both stable and dynamic WM codes in macaque PFC.20,21,22,23 Human EEG studies also suggest that WM might contain dynamics.24,25 Nonetheless, how WM dynamics vary across the cortical hierarchy and which factors drive dynamics remain unknown. To elucidate WM dynamics in humans, we decoded WM content from fMRI responses across multiple cortical visual field maps.26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48 We found coexisting stable and dynamic neural representations of WM during a memory-guided saccade task. Geometric analyses of neural subspaces revealed that early visual cortex exhibited stronger dynamics than high-level visual and frontoparietal cortex. Leveraging models of population receptive fields, we visualized and made the neural dynamics interpretable. We found that during WM delays, V1 population initially encoded a narrowly tuned bump of activation centered on the peripheral memory target. Remarkably, this bump then spread inward toward foveal locations, forming a vector along the trajectory of the forthcoming memory-guided saccade. In other words, the neural code transformed into an abstraction of the stimulus more proximal to memory-guided behavior. Therefore, theories of WM must consider both sensory features and their task-relevant abstractions because changes in the format of memoranda naturally drive neural dynamics.

Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention

Shortly before saccadic eye movements, visual sensitivity at the saccade target is enhanced, at the expense of sensitivity elsewhere. Some behavioral and neural correlates of this presaccadic shift of attention resemble those of covert attention, deployed during fixation. Microstimulation in non-human primates has shown that presaccadic attention modulates perception via feedback from oculomotor to visual areas. This mechanism also seems plausible in humans, as both oculomotor and visual areas are active during saccade planning. We investigated this hypothesis by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show their causal and differential roles in contralateral presaccadic attention effects: Whereas rFEF+ stimulation enhanced sensitivity opposite the saccade target throughout saccade preparation, V1/V2 stimulation reduced sensitivity at the saccade target only shortly before saccade onset. These findings are consistent with presaccadic attention modulating perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.

Shape, perspective, and what is and is not perceived: Comment on Morales, Bax, and Firestone (2020)

Psychology and philosophy have long reflected on the role of perspective in vision. Since the dawn of modern vision science-roughly, since Helmholtz in the late 1800s-scientific explanations in vision have focused on understanding the computations that transform the sensed retinal image into percepts of the three-dimensional environment. The standard view in the science is that distal properties-viewpoint-independent properties of the environment (object shape) and viewpoint-dependent relational properties (3D orientation relative to the viewer)-are perceptually represented and that properties of the proximal stimulus (in vision, the retinal image) are not. This view is woven into the nature of scientific explanation in perceptual psychology, and has guided impressive advances over the past 150 years. A recently published article suggests that in shape perception, the standard view must be revised. It argues, on the basis of new empirical data, that a new entity-perspectival shape-should be introduced into scientific explanations of shape perception. Specifically, the article's centrally advertised claim is that, in addition to distal shape, perspectival shape is perceived. We argue that this claim rests on a series of mistakes. Problems in experimental design entail that the article provides no empirical support for any claims regarding either perspective or the perception of shape. There are further problems in scientific reasoning and conceptual development. Detailing these criticisms and explaining how science treats these issues are meant to clarify method and theory, and to improve exchanges between the science and philosophy of perception. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Mnemonic representations in human lateral geniculate nucleus

There is a growing appreciation for the role of the thalamus in high-level cognition. Motivated by findings that internal cognitive state drives activity in feedback layers of primary visual cortex (V1) that target the lateral geniculate nucleus (LGN), we investigated the role of LGN in working memory (WM). Specifically, we leveraged model-based neuroimaging approaches to test the hypothesis that human LGN encodes information about spatial locations temporarily encoded in WM. First, we localized and derived a detailed topographic organization in LGN that accords well with previous findings in humans and non-human primates. Next, we used models constructed on the spatial preferences of LGN populations in order to reconstruct spatial locations stored in WM as subjects performed modified memory-guided saccade tasks. We found that population LGN activity faithfully encoded the spatial locations held in memory in all subjects. Importantly, our tasks and models allowed us to dissociate the locations of retinal stimulation and the motor metrics of memory-guided saccades from the maintained spatial locations, thus confirming that human LGN represents true WM information. These findings add LGN to the growing list of subcortical regions involved in WM, and suggest a key pathway by which memories may influence incoming processing at the earliest levels of the visual hierarchy.

Accurate localization and coactivation profiles of the frontal eye field and inferior frontal junction: an ALE and MACM fMRI meta-analysis

The frontal eye field (FEF) and the inferior frontal junction (IFJ) are prefrontal structures involved in mediating multiple aspects of goal-driven behavior. Despite being recognized as prominent nodes of the networks underlying spatial attention and oculomotor control, and working memory and cognitive control, respectively, the limited quantitative evidence on their precise localization has considerably impeded the detailed understanding of their structure and connectivity. In this study, we performed an activation likelihood estimation (ALE) fMRI meta-analysis by selecting studies that employed standard paradigms to accurately infer the localization of these regions in stereotaxic space. For the FEF, we found the highest spatial convergence of activations for prosaccade and antisaccade paradigms at the junction of the precentral sulcus and superior frontal sulcus. For the IFJ, we found consistent activations across oddball/attention, working memory, task-switching and Stroop paradigms at the junction of the inferior precentral sulcus and inferior frontal sulcus. We related these clusters to previous meta-analyses, sulcal/gyral neuroanatomy, and a comprehensive brain parcellation, highlighting important differences compared to their results and taxonomy. Finally, we leveraged the ALE peak coordinates as seeds to perform a meta-analytic connectivity modeling (MACM) analysis, which revealed systematic coactivation patterns spanning the frontal, parietal, and temporal cortices. We decoded the behavioral domains associated with these coactivations, suggesting that these may allow FEF and IFJ to support their specialized roles in flexible behavior. Our study provides the meta-analytic groundwork for investigating the relationship between functional specialization and connectivity of two crucial control structures of the prefrontal cortex.

White matter BOLD signals at 7 Tesla reveal visual field maps in optic radiation and vertical occipital fasciculus

There is growing evidence that blood-oxygen-level-dependent (BOLD) activity in the white matter (WM) can be detected by functional magnetic resonance imaging (fMRI). However, the functional relevance and significance of WM BOLD signals remain controversial. Here we investigated whether 7T BOLD fMRI can reveal fine-scale functional organizations of a WM bundle. Population receptive field (pRF) analyses of the 7T retinotopy dataset from the Human Connectome Project revealed clear contralateral retinotopic organizations of two visual WM bundles: the optic radiation (OR) and the vertical occipital fasciculus (VOF). The retinotopic maps of OR are highly consistent with post-mortem dissections and diffusion tractographies, while the VOF maps are compatible with the dorsal and ventral visual areas connected by the WM. Similar to the grey matter (GM) visual areas, both WM bundles show over-representations of the central visual field and increasing pRF size with eccentricity. Hemodynamic response functions of visual WM were slower and wider compared with those of GM areas. These findings clearly demonstrate that WM BOLD at 7 Tesla is closely coupled with neural activity related to axons, encoding highly specific information that can be used to characterize fine-scale functional organizations of a WM bundle.

Transcranial magnetic stimulation to frontal but not occipital cortex disrupts endogenous attention

Covert endogenous (voluntary) attention improves visual performance. Human neuroimaging studies suggest that the putative human homolog of macaque frontal eye fields (FEF+) is critical for this improvement, whereas early visual areas are not. Yet, correlational MRI methods do not manipulate brain function. We investigated whether rFEF+ or V1/V2 plays a causal role in endogenous attention. We used transcranial magnetic stimulation (TMS) to alter activity in the visual cortex or rFEF+ when observers performed an orientation discrimination task while attention was manipulated. On every trial, they received double-pulse TMS at a predetermined site (stimulated region) around V1/V2 or rFEF+. Two cortically magnified gratings were presented, one in the stimulated region (contralateral to the stimulated area) and another in the symmetric (ipsilateral) nonstimulated region. Grating contrast was varied to measure contrast response functions (CRFs) for all attention and stimulation combinations. In experiment 1, the CRFs were similar at the stimulated and nonstimulated regions, indicating that early visual areas do not modulate endogenous attention during stimulus presentation. In contrast, occipital TMS eliminates exogenous (involuntary) attention effects on performance [A. Fernández, M. Carrasco,Curr. Biol. 30, 4078-4084 (2020)]. In experiment 2, rFEF+ stimulation decreased the overall attentional effect; neither benefits at the attended location nor costs at the unattended location were significant. The frequency and directionality of microsaccades mimicked this pattern: Whereas occipital stimulation did not affect microsaccades, rFEF+ stimulation caused a higher microsaccade rate directed toward the stimulated hemifield. These results provide causal evidence of the role of this frontal region for endogenous attention.

Dissociable roles of human frontal eye fields and early visual cortex in presaccadic attention - evidence from TMS

Shortly before each saccadic eye movement, presaccadic attention improves visual sensitivity at the saccade target 1-5 at the expense of lowered sensitivity at non-target locations 6-11 . Some behavioral and neural correlates of presaccadic attention and covert attention -which likewise enhances sensitivity, but during fixation 12 -are similar 13 . This resemblance has led to the debatable 13-18 notion that presaccadic and covert attention are functionally equivalent and rely on the same neural circuitry 19-21 . At a broad scale, oculomotor brain structures (e.g., FEF) are also modulated during covert attention 22-24 - yet by distinct neuronal subpopulations 25-28 . Perceptual benefits of presaccadic attention rely on feedback from oculomotor structures to visual cortices 29,30 ( Fig. 1a ); micro-stimulation of FEF in non-human primates affects activity in visual cortex 31-34 and enhances visual sensitivity at the movement field of the stimulated neurons 35-37 . Similar feedback projections seem to exist in humans: FEF+ activation precedes occipital activation during saccade preparation 38,39 and FEF TMS modulates activity in visual cortex 40-42 and enhances perceived contrast in the contralateral hemifield 40 . We investigated presaccadic feedback in humans by applying TMS to frontal or visual areas during saccade preparation. By simultaneously measuring perceptual performance, we show the causal and differential roles of these brain regions in contralateral presaccadic benefits at the saccade target and costs at non-targets: Whereas rFEF+ stimulation reduced presaccadic costs throughout saccade preparation, V1/V2 stimulation reduced benefits only shortly before saccade onset. These effects provide causal evidence that presaccadic attention modulates perception through cortico-cortical feedback and further dissociate presaccadic and covert attention.

Neural substrates of spatial processing and navigation in blindness: An activation likelihood estimation meta-analysis

Even though vision is considered the best suited sensory modality to acquire spatial information, blind individuals can form spatial representations to navigate and orient themselves efficiently in space. Consequently, many studies support the amodality hypothesis of spatial representations since sensory modalities other than vision contribute to the formation of spatial representations, independently of visual experience and imagery. However, given the high variability in abilities and deficits observed in blind populations, a clear consensus about the neural representations of space has yet to be established. To this end, we performed a meta-analysis of the literature on the neural correlates of spatial processing and navigation via sensory modalities other than vision, like touch and audition, in individuals with early and late onset blindness. An activation likelihood estimation (ALE) analysis of the neuroimaging literature revealed that early blind individuals and sighted controls activate the same neural networks in the processing of non-visual spatial information and navigation, including the posterior parietal cortex, frontal eye fields, insula, and the hippocampal complex. Furthermore, blind individuals also recruit primary and associative occipital areas involved in visuo-spatial processing via cross-modal plasticity mechanisms. The scarcity of studies involving late blind individuals did not allow us to establish a clear consensus about the neural substrates of spatial representations in this specific population. In conclusion, the results of our analysis on neuroimaging studies involving early blind individuals support the amodality hypothesis of spatial representations.

Perception and memory have distinct spatial tuning properties in human visual cortex

Reactivation of earlier perceptual activity is thought to underlie long-term memory recall. Despite evidence for this view, it is unclear whether mnemonic activity exhibits the same tuning properties as feedforward perceptual activity. Here, we leverage population receptive field models to parameterize fMRI activity in human visual cortex during spatial memory retrieval. Though retinotopic organization is present during both perception and memory, large systematic differences in tuning are also evident. Whereas there is a three-fold decline in spatial precision from early to late visual areas during perception, this pattern is not observed during memory retrieval. This difference cannot be explained by reduced signal-to-noise or poor performance on memory trials. Instead, by simulating top-down activity in a network model of cortex, we demonstrate that this property is well explained by the hierarchical structure of the visual system. Together, modeling and empirical results suggest that computational constraints imposed by visual system architecture limit the fidelity of memory reactivation in sensory cortex.

Common Neural Mechanisms Control Attention and Working Memory

Although previous studies point to qualitative similarities between working memory (WM) and attention, the degree to which these two constructs rely on shared neural mechanisms remains unknown. Focusing on one such potentially shared mechanism, we tested the hypothesis that selecting an item within WM utilizes similar neural mechanisms as selecting a visible item via a shift of attention. We used fMRI and machine learning to decode both the selection among items visually available and the selection among items stored in WM in human subjects (both sexes). Patterns of activity in visual, parietal, and to a lesser extent frontal cortex predicted the locations of the selected items. Critically, these patterns were strikingly interchangeable; classifiers trained on data during attentional selection predicted selection from WM, and classifiers trained on data during selection from memory predicted attentional selection. Using models of voxel receptive fields, we visualized topographic population activity that revealed gain enhancements at the locations of the externally and internally selected items. Our results suggest that selecting among perceived items and selecting among items in WM share a common mechanism. This common mechanism, analogous to a shift of spatial attention, controls the relative gains of neural populations that encode behaviorally relevant information.SIGNIFICANCE STATEMENT How we allocate our attention to external stimuli that we see and to internal representations of stimuli stored in memory might rely on a common mechanism. Supporting this hypothesis, we demonstrated that not only could patterns of human brain activity predict which items were selected during perception and memory, but that these patterns were interchangeable during external and internal selection. Additionally, this generalized selection mechanism operates by changes in the gains of the neural populations both encoding attended sensory representations and storing relevant memory representations.

Visual timing-tuned responses in human association cortices and response dynamics in early visual cortex

Quantifying the timing (duration and frequency) of brief visual events is vital to human perception, multisensory integration and action planning. Tuned neural responses to visual event timing have been found in association cortices, in areas implicated in these processes. Here we ask how these timing-tuned responses are related to the responses of early visual cortex, which monotonically increase with event duration and frequency. Using 7-Tesla functional magnetic resonance imaging and neural model-based analyses, we find a gradual transition from monotonically increasing to timing-tuned neural responses beginning in the medial temporal area (MT/V5). Therefore, across successive stages of visual processing, timing-tuned response components gradually become dominant over inherent sensory response modulation by event timing. This additional timing-tuned response component is independent of retinotopic location. We propose that this hierarchical emergence of timing-tuned responses from sensory processing areas quantifies sensory event timing while abstracting temporal representations from spatial properties of their inputs.

Early visual cortical responses increase with event duration and frequency, while later timing-tuned responses quantify event timing. Here, the authors show timing tuning gradually emerges up the visual hierarchy, and separates temporal and spatial event features.

Abnormal effective connectivity in visual cortices underlies stereopsis defects in amblyopia

•

Abnormal effective connectivity inherent stereopsis defects in amblyopia was studied.

•

A weakened connection from V2v to LO2 relates to stereopsis defects in amblyopia.

•

Higher-order visual cortices may serve as key nodes to the stereopsis defects.

•

An independent longitudinal dataset was used to validate the obtained results.

The neural basis underlying stereopsis defects in patients with amblyopia remains unclear, which hinders the development of clinical therapy. This study aimed to investigate visual network abnormalities in patients with amblyopia and their associations with stereopsis function. Spectral dynamic causal modeling methods were employed for resting-state functional magnetic resonance imaging data to investigate the effective connectivity (EC) among 14 predefined regions of interest in the dorsal and ventral visual pathways. We adopted two independent datasets, including a cross-sectional and a longitudinal dataset. In the cross-sectional dataset, we compared group differences in EC between 31 patients with amblyopia (mean age: 26.39 years old) and 31 healthy controls (mean age: 25.71 years old) and investigated the association between EC and stereoacuity. In addition, we explored EC changes after perceptual learning in a novel longitudinal dataset including 9 patients with amblyopia (mean age: 15.78 years old). We found consistent evidence from the two datasets indicating that the aberrant EC from V2v to LO2 is crucial for the stereoscopic deficits in the patients with amblyopia: it was weaker in the patients than in the controls, showed a positive linear relationship with the stereoscopic function, and increased after perceptual learning in the patients. In addition, higher-level dorsal (V3d, V3A, and V3B) and ventral areas (LO1 and LO2) were important nodes in the network of abnormal ECs associated with stereoscopic deficits in the patients with amblyopia. Our research provides insights into the neural mechanism underlying stereopsis deficits in patients with amblyopia and provides candidate targets for focused stimulus interventions to enhance the efficacy of clinical treatment for the improvement of stereopsis deficiency.

Spectral Distribution Dynamics across Different Attentional Priority States

Anticipatory covert spatial attention improves performance on tests of visual detection and discrimination, and shifts are accompanied by decreases and increases of α band power at electroencephalography (EEG) electrodes corresponding to the attended and unattended location, respectively. Although the increase at the unattended location is often interpreted as an active mechanism (e.g., inhibiting processing at the unattended location), most experiments cannot rule out the alternative possibility that it is a secondary consequence of selection elsewhere. To adjudicate between these accounts, we designed a Posner-style visual cueing task in which male and female human participants made orientation judgments of targets appearing at one of four locations: up, down, right, or left. Critically, trials were blocked such that within a block the locations along one meridian alternated in status between attended and unattended, and targets never appeared at the other two, making them irrelevant. Analyses of the concurrently measured EEG signal were conducted on "traditional" narrowband α (8-14 Hz), as well as on two components resulting from the decomposition of this signal: "periodic" α; and the slope of the aperiodic 1/f-like component. Although data from right-left blocks replicated the familiar pattern of lateralized asymmetry in narrowband α power, with neither α signal could we find evidence for any difference in the time course at unattended versus irrelevant locations, an outcome consistent with the secondary-consequence interpretation of attention-related dynamics in the α band. Additionally, 1/f slope was shallower at attended and unattended locations, relative to irrelevant, suggesting a tonic adjustment of physiological state.SIGNIFICANCE STATEMENT Visual spatial attention, the prioritization of one location in the visual field, is critical for guiding behavior in cluttered environments. Although influential theories posit an important role for α band oscillations in the inhibition of processing at unattended locations, we used a novel procedure to find evidence for an alternative interpretation: selection of one location may simply result in a return to physiological baseline at all others. In addition to determining one way that attention does not work (important for future progress in this field), we also discovered novel evidence for one way that it does work: by modifying the tonic physiological state (indexed by an aperiodic component of the electroencephalography (EEG)] at locations where spatial selection is likely to occur.

The role of temporal cortex in the control of attention

Attention is an indispensable component of active vision. Contrary to the widely accepted notion that temporal cortex processing primarily focusses on passive object recognition, a series of very recent studies emphasize the role of temporal cortex structures, specifically the superior temporal sulcus (STS) and inferotemporal (IT) cortex, in guiding attention and implementing cognitive programs relevant for behavioral tasks. The goal of this theoretical paper is to advance the hypothesis that the temporal cortex attention network (TAN) entails necessary components to actively participate in attentional control in a flexible task-dependent manner. First, we will briefly discuss the general architecture of the temporal cortex with a focus on the STS and IT cortex of monkeys and their modulation with attention. Then we will review evidence from behavioral and neurophysiological studies that support their guidance of attention in the presence of cognitive control signals. Next, we propose a mechanistic framework for executive control of attention in the temporal cortex. Finally, we summarize the role of temporal cortex in implementing cognitive programs and discuss how they contribute to the dynamic nature of visual attention to ensure flexible behavior.

Dynamic causal interactions between occipital and parietal cortex explain how endogenous spatial attention and stimulus-driven salience jointly shape the distribution of processing priorities in 2D visual space

Visuo-spatial attention prioritizes the processing of relevant inputs via different types of signals, including current goals and stimulus salience. Complex mixtures of these signals engage in everyday life situations, but little is known about how these signals jointly modulate distributed patterns of activity across the occipital regions that represent visual space. Here, we measured spatio-topic, quadrant-specific occipital activity during the processing of visual displays containing both task-relevant targets and salient color-singletons. We computed spatial bias vectors indexing the effect of attention in 2D space, as coded by distributed activity in the occipital cortex. We found that goal-directed spatial attention biased activity towards the target and that salience further modulated this endogenous effect: salient distractors decreased the spatial bias, while salient targets increased it. Analyses of effective connectivity revealed that the processing of salient distractors relied on the modulation of the bidirectional connectivity between the occipital and the posterior parietal cortex, as well as the modulation of the lateral interactions within the occipital cortex. These findings demonstrate that goal-directed attention and salience jointly contribute to shaping processing priorities in the occipital cortex and highlight that multiple functional paths determine how spatial information about these signals is distributed across occipital regions.

Unveiling the abstract format of mnemonic representations

Working memory (WM) enables information storage for future use, bridging the gap between perception and behavior. We hypothesize that WM representations are abstractions of low-level perceptual features. However, the neural nature of these putative abstract representations has thus far remained impenetrable. Here, we demonstrate that distinct visual stimuli (oriented gratings and moving dots) are flexibly recoded into the same WM format in visual and parietal cortices when that representation is useful for memory-guided behavior. Specifically, the behaviorally relevant features of the stimuli (orientation and direction) were extracted and recoded into a shared mnemonic format that takes the form of an abstract line-like pattern. We conclude that mnemonic representations are abstractions of percepts that are more efficient than and proximal to the behaviors they guide.

Numerosity tuning in human association cortices and local image contrast representations in early visual cortex

Human early visual cortex response amplitudes monotonically increase with numerosity (object number), regardless of object size and spacing. However, numerosity is typically considered a high-level visual or cognitive feature, while early visual responses follow image contrast in the spatial frequency domain. We find that, at fixed contrast, aggregate Fourier power (at all orientations and spatial frequencies) follows numerosity closely but nonlinearly with little effect of object size, spacing or shape. This would allow straightforward numerosity estimation from spatial frequency domain image representations. Using 7T fMRI, we show monotonic responses originate in primary visual cortex (V1) at the stimulus's retinotopic location. Responses here and in neural network models follow aggregate Fourier power more closely than numerosity. Truly numerosity tuned responses emerge after lateral occipital cortex and are independent of retinotopic location. We propose numerosity's straightforward perception and neural responses may result from the pervasive spatial frequency analyses of early visual processing.

Behavioral Prioritization Enhances Working Memory Precision and Neural Population Gain

Humans allocate visual working memory (WM) resource according to behavioral relevance, resulting in more precise memories for more important items. Theoretically, items may be maintained by feature-tuned neural populations, where the relative gain of the populations encoding each item determines precision. To test this hypothesis, we compared the amplitudes of delay period activity in the different parts of retinotopic maps representing each of several WM items, predicting the amplitudes would track behavioral priority. Using fMRI, we scanned participants while they remembered the location of multiple items over a WM delay and then reported the location of one probed item using a memory-guided saccade. Importantly, items were not equally probable to be probed (0.6, 0.3, 0.1, 0.0), which was indicated with a precue. We analyzed fMRI activity in 10 visual field maps in occipital, parietal, and frontal cortex known to be important for visual WM. In early visual cortex, but not association cortex, the amplitude of BOLD activation within voxels corresponding to the retinotopic location of visual WM items increased with the priority of the item. Interestingly, these results were contrasted with a common finding that higher-level brain regions had greater delay period activity, demonstrating a dissociation between the absolute amount of activity in a brain area and the activity of different spatially selective populations within it. These results suggest that the distribution of WM resources according to priority sculpts the relative gains of neural populations that encode items, offering a neural mechanism for how prioritization impacts memory precision.

Cross-dataset reproducibility of human retinotopic maps

Population receptive field (pRF) models fit to fMRI data are used to non-invasively measure retinotopic maps in human visual cortex, and these maps are a fundamental component of visual neuroscience experiments. Here, we examined the reproducibility of retinotopic maps across two datasets: a newly acquired retinotopy dataset from New York University (NYU) (n = 44) and a public dataset from the Human Connectome Project (HCP) (n = 181). Our goal was to assess the degree to which pRF properties are similar across datasets, despite substantial differences in their experimental protocols. The two datasets simultaneously differ in their stimulus apertures, participant pool, fMRI protocol, MRI field strength, and preprocessing pipeline. We assessed the cross-dataset reproducibility of the two datasets in terms of the similarity of vertex-wise pRF estimates and in terms of large-scale polar angle asymmetries in cortical magnification. Within V1, V2, V3, and hV4, the group-median NYU and HCP vertex-wise polar angle estimates were nearly identical. Both eccentricity and pRF size estimates were also strongly correlated between the two datasets, but with a slope different from 1; the eccentricity and pRF size estimates were systematically greater in the NYU data. Next, to compare large-scale map properties, we quantified two polar angle asymmetries in V1 cortical magnification previously identified in the HCP data. The NYU dataset confirms earlier reports that more cortical surface area represents horizontal than vertical visual field meridian, and lower than upper vertical visual field meridian. Together, our findings show that the retinotopic properties of V1, V2, V3, and hV4 can be reliably measured across two datasets, despite numerous differences in their experimental design. fMRI-derived retinotopic maps are reproducible because they rely on an explicit computational model of the fMRI response. In the case of pRF mapping, the model is grounded in physiological evidence of how visual receptive fields are organized, allowing one to quantitatively characterize the BOLD signal in terms of stimulus properties (i.e., location and size). The new NYU Retinotopy Dataset will serve as a useful benchmark for testing hypotheses about the organization of visual areas and for comparison to the HCP 7T Retinotopy Dataset.

Visuospatial coding as ubiquitous scaffolding for human cognition

For more than 100 years we have known that the visual field is mapped onto the surface of visual cortex, imposing an inherently spatial reference frame on visual information processing. Recent studies highlight visuospatial coding not only throughout visual cortex, but also brain areas not typically considered visual. Such widespread access to visuospatial coding raises important questions about its role in wider cognitive functioning. Here, we synthesise these recent developments and propose that visuospatial coding scaffolds human cognition by providing a reference frame through which neural computations interface with environmental statistics and task demands via perception-action loops.

Joint representation of working memory and uncertainty in human cortex

Neural representations of visual working memory (VWM) are noisy, and thus, decisions based on VWM are inevitably subject to uncertainty. However, the mechanisms by which the brain simultaneously represents the content and uncertainty of memory remain largely unknown. Here, inspired by the theory of probabilistic population codes, we test the hypothesis that the human brain represents an item maintained in VWM as a probability distribution over stimulus feature space, thereby capturing both its content and uncertainty. We used a neural generative model to decode probability distributions over memorized locations from fMRI activation patterns. We found that the mean of the probability distribution decoded from retinotopic cortical areas predicted memory reports on a trial-by-trial basis. Moreover, in several of the same mid-dorsal stream areas, the spread of the distribution predicted subjective trial-by-trial uncertainty judgments. These results provide evidence that VWM content and uncertainty are jointly represented by probabilistic neural codes.

Working memory representations in visual cortex mediate distraction effects

Although the contents of working memory can be decoded from visual cortex activity, these representations may play a limited role if they are not robust to distraction. We used model-based fMRI to estimate the impact of distracting visual tasks on working memory representations in several visual field maps in visual and frontoparietal association cortex. Here, we show distraction causes the fidelity of working memory representations to briefly dip when both the memorandum and distractor are jointly encoded by the population activities. Distraction induces small biases in memory errors which can be predicted by biases in neural decoding in early visual cortex, but not other regions. Although distraction briefly disrupts working memory representations, the widespread redundancy with which working memory information is encoded may protect against catastrophic loss. In early visual cortex, the neural representation of information in working memory and behavioral performance are intertwined, solidifying its importance in visual memory.

The relative roles of visual, parietal, and frontal cortex in working memory have been actively debated. Here, the authors show that distraction impacts visual working memory representations in primary visual areas, indicating that these regions play a key role in the maintenance of working memory.

Persistent Activity During Working Memory From Front to Back

Working memory (WM) extends the duration over which information is available for processing. Given its importance in supporting a wide-array of high level cognitive abilities, uncovering the neural mechanisms that underlie WM has been a primary goal of neuroscience research over the past century. Here, we critically review what we consider the two major "arcs" of inquiry, with a specific focus on findings that were theoretically transformative. For the first arc, we briefly review classic studies that led to the canonical WM theory that cast the prefrontal cortex (PFC) as a central player utilizing persistent activity of neurons as a mechanism for memory storage. We then consider recent challenges to the theory regarding the role of persistent neural activity. The second arc, which evolved over the last decade, stemmed from sophisticated computational neuroimaging approaches enabling researchers to decode the contents of WM from the patterns of neural activity in many parts of the brain including early visual cortex. We summarize key findings from these studies, their implications for WM theory, and finally the challenges these findings pose. Our goal in doing so is to identify barriers to developing a comprehensive theory of WM that will require a unification of these two "arcs" of research.

Structure, function and connectivity fingerprints of the frontal eye field versus the inferior frontal junction: A comprehensive comparison

The human prefrontal cortex contains two prominent areas, the frontal eye field and the inferior frontal junction, that are crucially involved in the orchestrating functions of attention, working memory and cognitive control. Motivated by comparative evidence in non-human primates, we review the human neuroimaging literature, suggesting that the functions of these regions can be clearly dissociated. We found remarkable differences in how these regions relate to sensory domains and visual topography, top-down and bottom-up spatial attention, spatial versus non-spatial (i.e., feature- and object-based) attention and working memory and, finally, the multiple-demand system. Functional magnetic resonance imaging (fMRI) studies using multivariate pattern analysis reveal the selectivity of the frontal eye field and inferior frontal junction to spatial and non-spatial information, respectively. The analysis of functional and effective connectivity provides evidence of the modulation of the activity in downstream visual areas from the frontal eye field and inferior frontal junction and sheds light on their reciprocal influences. We therefore suggest that future studies should aim at disentangling more explicitly the role of these regions in the control of spatial and non-spatial selection. We propose that the analysis of the structural and functional connectivity (i.e., the connectivity fingerprints) of the frontal eye field and inferior frontal junction may be used to further characterize their involvement in a spatial ('where') and a non-spatial ('what') network, respectively, highlighting segregated brain networks that allow biasing visual selection and working memory performance to support goal-driven behaviour.

Reading: The Confluence of Vision and Language

The scientific study of reading has a rich history that spans disciplines from vision science to linguistics, psychology, cognitive neuroscience, neurology, and education. The study of reading can elucidate important general mechanisms in spatial vision, attentional control, object recognition, and perceptual learning, as well as the principles of plasticity and cortical topography. However, literacy also prompts the development of specific neural circuits to process a unique and artificial stimulus. In this review, we describe the sequence of operations that transforms visual features into language, how the key neural circuits are sculpted by experience during development, and what goes awry in children for whom learning to read is a struggle. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Representation of Contralateral Visual Space in the Human Hippocampus

The initial encoding of visual information primarily from the contralateral visual field is a fundamental organizing principle of the primate visual system. Recently, the presence of such retinotopic sensitivity has been shown to extend well beyond early visual cortex to regions not historically considered retinotopically sensitive. In particular, human scene-selective regions in parahippocampal and medial parietal cortex exhibit prominent biases for the contralateral visual field. Here, we used fMRI to test the hypothesis that the human hippocampus, which is thought to be anatomically connected with these scene-selective regions, would also exhibit a biased representation of contralateral visual space. First, population receptive field (pRF) mapping with scene stimuli revealed strong biases for the contralateral visual field in bilateral hippocampus. Second, the distribution of retinotopic sensitivity suggested a more prominent representation in anterior medial portions of the hippocampus. Finally, the contralateral bias was confirmed in independent data taken from the Human Connectome Project (HCP) initiative. The presence of contralateral biases in the hippocampus, a structure considered by many as the apex of the visual hierarchy, highlights the truly pervasive influence of retinotopy. Moreover, this finding has important implications for understanding how visual information relates to the allocentric global spatial representations known to be encoded therein.SIGNIFICANCE STATEMENT Retinotopic encoding of visual information is an organizing principle of visual cortex. Recent work demonstrates this sensitivity in structures far beyond early visual cortex, including those anatomically connected to the hippocampus. Here, using population receptive field (pRF) modeling in two independent sets of data we demonstrate a consistent bias for the contralateral visual field in bilateral hippocampus. Such a bias highlights the truly pervasive influence of retinotopy, with important implications for understanding how the presence of retinotopy relates to more allocentric spatial representations.

Representation of visual numerosity information during working memory in humans: An fMRI decoding study

Both animal and human studies on numerosity have shown the importance of the parietal cortex for numerosity processing. However, most studies have focused on the perceptual processing of numerosity. Still, it is unclear how and where numerosity information is coded when this information is retained during a working memory delay phase. Such temporal storage could be realized by the same structures as perceptual processes, or be transformed to a more abstract representation, potentially involving prefrontal regions. FMRI decoding studies allow the identification of brain areas that exhibit multi‐voxel activation patterns specific to the content of working memory. Here, we used an assumption‐free searchlight‐decoding approach to test where numerosity‐specific codes can be found during a 12 s retention period. Participants (n = 24) performed a retro‐cue delayed match‐to‐sample task, in which numerosity information was presented as visual dot arrays. We found mnemonic numerosity‐specific activation in the right lateral portion of the intraparietal sulcus; an area well‐known for perceptual processing of numerosity. The applied retro‐cue design dissociated working memory delay activity from perceptual processes and showed that the intraparietal sulcus also maintained working memory representation independent of perception.

Overlooked Tertiary Sulci Serve as a Meso-Scale Link between Microstructural and Functional Properties of Human Lateral Prefrontal Cortex

Understanding the relationship between neuroanatomy and function in portions of cortex that perform functions largely specific to humans such as lateral prefrontal cortex (LPFC) is of major interest in systems and cognitive neuroscience. When considering neuroanatomical-functional relationships in LPFC, shallow indentations in cortex known as tertiary sulci have been largely unexplored. Here, by implementing a multimodal approach and manually defining 936 neuroanatomical structures in 72 hemispheres (in both males and females), we show that a subset of these overlooked tertiary sulci serve as a meso-scale link between microstructural (myelin content) and functional (network connectivity) properties of human LPFC in individual participants. For example, the posterior middle frontal sulcus (pmfs) is a tertiary sulcus with three components that differ in their myelin content, resting-state connectivity profiles, and engagement across meta-analyses of 83 cognitive tasks. Further, generating microstructural profiles of myelin content across cortical depths for each pmfs component and the surrounding middle frontal gyrus (MFG) shows that both gyral and sulcal components of the MFG have greater myelin content in deeper compared with superficial layers and that the myelin content in superficial layers of the gyral components is greater than sulcal components. These findings support a classic, yet largely unconsidered theory that tertiary sulci may serve as landmarks in association cortices, as well as a modern cognitive neuroscience theory proposing a functional hierarchy in LPFC. As there is a growing need for computational tools that automatically define tertiary sulci throughout cortex, we share pmfs probabilistic sulcal maps with the field.SIGNIFICANCE STATEMENT Lateral prefrontal cortex (LPFC) is critical for functions that are thought to be specific to humans compared with other mammals. However, relationships between fine-scale neuroanatomical structures largely specific to hominoid cortex and functional properties of LPFC remain elusive. Here, we show that these structures, which have been largely unexplored throughout history, surprisingly serve as markers for anatomical and functional organization in human LPFC. These findings have theoretical, methodological, developmental, and evolutionary implications for improved understanding of neuroanatomical-functional relationships not only in LPFC, but also in association cortices more broadly. Finally, these findings ignite new questions regarding how morphological features of these neglected neuroanatomical structures contribute to functions of association cortices that are critical for human-specific aspects of cognition.

Topographic connectivity reveals task-dependent retinotopic processing throughout the human brain

The human visual system is organized as a hierarchy of maps that share the topography of the retina. Known retinotopic maps have been identified using simple visual stimuli under strict fixation, conditions different from everyday vision which is active, dynamic, and complex. This means that it remains unknown how much of the brain is truly visually organized. Here I demonstrate widespread stable visual organization beyond the traditional visual system, in default-mode network and hippocampus. Detailed topographic connectivity with primary visual cortex during movie-watching, resting-state, and retinotopic-mapping experiments revealed that visual-spatial representations throughout the brain are warped by cognitive state. Specifically, traditionally visual regions alternate with default-mode network and hippocampus in preferentially representing the center of the visual field. This visual role of default-mode network and hippocampus would allow these regions to interface between abstract memories and concrete sensory impressions. Together, these results indicate that visual-spatial organization is a fundamental coding principle that structures the communication between distant brain regions.

Differential impact of endogenous and exogenous attention on activity in human visual cortex

How do endogenous (voluntary) and exogenous (involuntary) attention modulate activity in visual cortex? Using ROI-based fMRI analysis, we measured fMRI activity for valid and invalid trials (target at cued/un-cued location, respectively), pre- or post-cueing endogenous or exogenous attention, while participants performed the same orientation discrimination task. We found stronger modulation in contralateral than ipsilateral visual regions, and higher activity in valid- than invalid-trials. For endogenous attention, modulation of stimulus-evoked activity due to a pre-cue increased along the visual hierarchy, but was constant due to a post-cue. For exogenous attention, modulation of stimulus-evoked activity due to a pre-cue was constant along the visual hierarchy, but was not modulated due to a post-cue. These findings reveal that endogenous and exogenous attention distinctly modulate activity in visuo-occipital areas during orienting and reorienting; endogenous attention facilitates both the encoding and the readout of visual information whereas exogenous attention only facilitates the encoding of information.

Spatially Specific Working Memory Activity in the Human Superior Colliculus

Theoretically, working memory (WM) representations are encoded by population activity of neurons with distributed tuning across the stored feature. Here, we leverage computational neuroimaging approaches to map the topographic organization of human superior colliculus (SC) and model how population activity in SC encodes WM representations. We first modeled receptive field properties of voxels in SC, deriving a detailed topographic organization resembling that of the primate SC. Neural activity within human (5 male and 1 female) SC persisted throughout a retention interval of several types of modified memory-guided saccade tasks. Assuming an underlying neural architecture of the SC based on its retinotopic organization, we used an encoding model to show that the pattern of activity in human SC represents locations stored in WM. Our tasks and models allowed us to dissociate the locations of visual targets and the motor metrics of memory-guided saccades from the spatial locations stored in WM, thus confirming that human SC represents true WM information. These data have several important implications. They add the SC to a growing number of cortical and subcortical brain areas that form distributed networks supporting WM functions. Moreover, they specify a clear neural mechanism by which topographically organized SC encodes WM representations.

SIGNIFICANCE STATEMENT Using computational neuroimaging approaches, we mapped the topographic organization of human superior colliculus (SC) and modeled how population activity in SC encodes working memory (WM) representations, rather than simpler visual or motor properties that have been traditionally associated with the laminar maps in the primate SC. Together, these data both position the human SC into a distributed network of brain areas supporting WM and elucidate the neural mechanisms by which the SC supports WM.

Number Adaptation Can Be Dissociated From Density Adaptation

Rapidly judging the number of objects in a scene is an important perceptual ability. Recent debates have centered on whether number perception is accomplished by dedicated mechanisms and, in particular, on whether number-adaptation aftereffects reflect adaptation of number per se or adaptation of related stimulus properties, such as density. Here, we report an adaptation experiment (N = 8) for which the predictions of number and density theories are diametrically opposed. We found that when a reference stimulus has higher density than an adaptation stimulus but contains fewer elements, adaptation reduces the perceived number of elements in the reference stimulus. This is consistent with number adaptation and inconsistent with density adaptation. Thus, number-adaptation aftereffects are more than a by-product of density adaptation: When density and number are dissociated, adaptation effects are in the direction predicted by adaptation to number, not density.

From ATOM to GradiATOM: Cortical gradients support time and space processing as revealed by a meta-analysis of neuroimaging studies

According to the ATOM (A Theory Of Magnitude), formulated by Walsh more than fifteen years ago, there is a general system of magnitude in the brain that comprises regions, such as the parietal cortex, shared by space, time and other magnitudes. The present meta-analysis of neuroimaging studies used the Activation Likelihood Estimation (ALE) method in order to determine the set of regions commonly activated in space and time processing and to establish the neural activations specific to each magnitude domain. Following PRISMA guidelines, we included in the analysis a total of 112 and 114 experiments, exploring space and time processing, respectively. We clearly identified the presence of a system of brain regions commonly recruited in both space and time that includes: bilateral insula, the pre-supplementary motor area (pre-SMA), the right frontal operculum and the intraparietal sulci. These regions might be the best candidates to form the core magnitude neural system. Surprisingly, along each of these regions but the insula, ALE values progressed in a cortical gradient from time to space. The SMA exhibited an anterior-posterior gradient, with space activating more-anterior regions (i.e., pre-SMA) and time activating more-posterior regions (i.e., SMA-proper). Frontal and parietal regions showed a dorsal-ventral gradient: space is mediated by dorsal frontal and parietal regions, and time recruits ventral frontal and parietal regions. Our study supports but also expands the ATOM theory. Therefore, we here re-named it the 'GradiATOM' theory (Gradient Theory of Magnitude), proposing that gradient organization can facilitate the transformations and integrations of magnitude representations by allowing space- and time-related neural populations to interact with each other over minimal distances.

Area 8A within the Posterior Middle Frontal Gyrus Underlies Cognitive Selection between Competing Visual Targets

There are several distinct areas in the granular part of the lateral frontal cortex, and these areas provide high-level regulation of cognitive processing. Lesions of the dorsolateral frontal cortex that include area 8A in the human brain and lesions restricted to area 8A in the macaque monkey have demonstrated impairments in tasks requiring selection between visual targets based on rules, such as conditional if/then rules. These same subjects show no impairment in the ability to discriminate between visual stimuli nor in the ability to learn selection rules in general. Area 8A can be considered as a key area for the top-down control of attentional selection. The present functional neuroimaging study demonstrates that activity in area 8A that lies on the posterior part of the middle frontal gyrus underlies the trial-to-trial selection between competing visual targets based on previously acquired conditional rules. Critically, the activity of area 8A could clearly be dissociated from activity related to the performance of eye movements per se that lies posterior to it. Thus, area 8A with its rich corticocortical connections with the posterior parietal region involved in spatial processing and the multisensory temporal cortex appears to be the key prefrontal area for the higher order selection between competing stimuli in the environment, most likely by the allocation of attention.

Deficits and compensation: Attentional control cortical networks in schizophrenia

•

Examined attention systems in SzP with resting-state connectivity and task fMRI.

•

SzP have functional connectivity deficits in late visual cortex and prefrontal areas.

•

Task performance correlated with ventral attention network deactivation in SzP only.

•

This relationship is mediated by connectivity of key attentional control components.

•

Results reveal deficits and potential compensation in SzP visual processing/attention.

Visual processing and attention deficits are responsible for a substantial portion of the disability caused by schizophrenia, but the source of these deficits remains unclear. In 35 schizophrenia patients (SzP) and 34 healthy controls (HC), we used a rapid serial visual presentation (RSVP) visual search task designed to activate/deactivate the cortical components of the attentional control system (i.e. the dorsal and ventral attention networks, lateral prefrontal regions in the frontoparietal network, and cingulo-opercular/salience networks), along with resting state functional connectivity, to examine the integrity of these components. While we find that behavioral performance and activation/deactivation of the RSVP task are largely similar between groups, SzP exhibited decreased functional connectivity within late visual components and between prefrontal and other components. We also find that performance correlates with the deactivation of the ventral attention network in SzP only. This relationship is mediated by the functional connectivity of critical components of the attentional control system. In summary, our results suggest that the attentional control system is potentially used to compensate for visual cortex deficits. Furthermore, prefrontal deficits in SzP may interfere with this compensatory use of the attentional control system. In addition to highlighting focal deficits and potential compensatory mechanisms in visual processing and attention, our findings point to the attentional control system as a potential target for rehabilitation and neuromodulation-based treatments for visual processing deficits in SzP.

Gradients of functional organization in posterior parietal cortex revealed by visual attention, visual short-term memory, and intrinsic functional connectivity

Visual attention and visual working memory tasks recruit a common network of lateral frontal cortical (LFC) and posterior parietal cortical (PPC) regions. Here, we examine finer-scale organization of this frontoparietal network. Three LFC regions recruited by visual cognition tasks, superior precentral sulcus (sPCS), inferior precentral sulcus (iPCS), and mid inferior frontal sulcus (midIFS) exhibit differential patterns of resting-state functional connectivity to PPC. A broad dorsomedial to ventrolateral gradient is observed, with sPCS connectivity dominating in the dorsomedial PPC band, iPCS dominating in the middle band, and midIFS dominating in the ventrolateral band. These connectivity-defined subregions of PPC capture differential task activation between a pair of visual attention and working memory tasks. The relative functional connectivity of sPCS and iPCS also varies along the rostral-caudal axis of the retinotopic regions of PPC. iPCS connectivity is relatively stronger near the IPS0/IPS1 and IPS2/IPS3 borders, especially on the lateral portions of these borders, which each preferentially encode central visual field representations. In contrast, sPCS connectivity is relatively stronger elsewhere in retinotopic IPS regions which preferentially encode peripheral visual field representations. These findings reveal fine-scale gradients in functional connectivity within the frontoparietal visual network that capture a high-degree of specificity in PPC functional organization.

A Network of Topographic Maps in Human Association Cortex Hierarchically Transforms Visual Timing-Selective Responses

Accurately timing sub-second sensory events is crucial when perceiving our dynamic world. This ability allows complex human behaviors that require timing-dependent multisensory integration and action planning. Such behaviors include perception and performance of speech, music, driving, and many sports. How are responses to sensory event timing processed for multisensory integration and action planning? We measured responses to viewing systematically changing visual event timing using ultra-high-field fMRI. We analyzed these responses with neural population response models selective for event duration and frequency, following behavioral, computational, and macaque action planning results and comparisons to alternative models. We found systematic local changes in timing preferences (recently described in supplementary motor area) in an extensive network of topographic timing maps, mirroring sensory cortices and other quantity processing networks. These timing maps were partially left lateralized and widely spread, from occipital visual areas through parietal multisensory areas to frontal action planning areas. Responses to event duration and frequency were closely linked. As in sensory cortical maps, response precision varied systematically with timing preferences, and timing selectivity systematically varied between maps. Progressing from posterior to anterior maps, responses to multiple events were increasingly integrated, response selectivity narrowed, and responses focused increasingly on the middle of the presented timing range. These timing maps largely overlap with numerosity and visual field map networks. In both visual timing map and visual field map networks, selective responses and topographic map organization may facilitate hierarchical transformations by allowing neural populations to interact over minimal distances.

•

Many brain areas show neural responses to specific ranges of visual event timing

•

Timing preferences change gradually in these areas, forming topographic timing maps

•

Neural response properties hierarchically transform from visual to premotor areas

•

Timing, numerosity, and visual field map networks are distinct but largely overlap

Cortical topological network changes following optic neuritis

OBJECTIVE

To differentiate between visual cortical network topology changes following optic neuritis (ON) stemming from different inflammatory disease types, we used mathematical graph theory-based tools to analyze functional imaging data.

METHODS

Sixty-two patients were recruited into this cross-sectional study, 23 of whom had neuromyelitis optica spectrum disorder (NMOSD) with ON, 18 with clinically isolated syndrome (CIS)-ON, and 21 with other CIS episodes. Twenty-six healthy controls (HCs) were also recruited. All participants underwent resting-state functional MRI. Visual networks were defined using 50 visual regions of interest. Analysis included graph theory metrics, including degree, density, modularity, and local and global efficiency.

RESULTS

Visual network density shows decreased connectivity in all patient groups compared with controls. A higher degree of connections is seen in both ON groups (CIS and NMOSD) compared with the the non-ON group. This pattern is most pronounced in dorsal-lateral regions. Information transfer efficiency and modularity were reduced in both CIS groups, but not in the NMOSD group, compared with the HC group.

CONCLUSIONS

Visual network density appears affected by the neurologic deficit sustained (ON), and connectivity changes are more evident in dorsal-lateral regions. Efficiency and modularity appear to be associated with the specific disease type (CIS vs NMOSD). Thus, topological cortical changes in the visual system are associated with the type of neurologic deficit within the limits set on them by the underlying pathophysiology. We suggest that cortical patterns of activity should be considered in the outcome of the patients despite the localized nature of ON.

The Importance of Considering Model Choices When Interpreting Results in Computational Neuroimaging

Model-based analyses open exciting opportunities for understanding neural information processing. In a commentary published in eNeuro, Gardner and Liu (2019) discuss the role of model specification in interpreting results derived from complex models of neural data. As a case study, they suggest that one such analysis, the inverted encoding model (IEM), should not be used to assay properties of "stimulus representations" because the ability to apply linear transformations at various stages of the analysis procedure renders results "arbitrary." Here, we argue that the specification of all models is arbitrary to the extent that an experimenter makes choices based on current knowledge of the model system. However, the results derived from any given model, such as the reconstructed channel response profiles obtained from an IEM analysis, are uniquely defined and are arbitrary only in the sense that changes in the model can predictably change results. IEM-based channel response profiles should therefore not be considered arbitrary when the model is clearly specified and guided by our best understanding of neural population representations in the brain regions being analyzed. Intuitions derived from this case study are important to consider when interpreting results from all model-based analyses, which are similarly contingent upon the specification of the models used.