Cortical connections of inferior temporal area TEO in macaque monkeys

Horizontal cortical connections shape intrinsic traveling waves into feature-selective motifs that regulate perceptual sensitivity

Intrinsic cortical activity forms traveling waves that modulate sensory-evoked responses and perceptual sensitivity. These intrinsic traveling waves (iTWs) may arise from the coordination of synaptic activity through long-range feature-dependent horizontal connectivity within cortical areas. In a spiking network model that incorporates feature-selective patchy connections, we observe iTW motifs that result from shifts in excitatory/inhibitory balance as action potentials traverse these patchy connections. To test whether feature-selective motifs occur in vivo, we examined data recorded in the middle temporal visual area (Area MT) of marmosets performing a visual detection task. We find that some iTWs form motifs that are feature selective, exhibiting direction-selective modulations in spiking activity. Further, motifs modulate the gain of target-evoked responses and perceptual sensitivity if the target matches the preference of the motif. These results suggest that iTWs are shaped by the patchy horizontal fiber projections in the cortex and can regulate neural and perceptual sensitivity in a feature-selective manner.

Orienting role of the putative human posterior infero-temporal area in visual attention

The dorsal attention network (DAN) is a network of brain regions essential for attentional orienting, which includes the lateral intraparietal area (LIP) and frontal eye field (FEF). Recently, the putative human dorsal posterior infero-temporal area (phPITd) has been identified as a new node of the DAN. However, its functional relationship with other areas of the DAN and its specific role in visual attention remained unclear. In this study, we analyzed a large publicly available neuroimaging dataset to investigate the intrinsic functional connectivities (FCs) of the phPITd with other brain areas. The results showed that the intrinsic FCs of the phPITd with the areas of the visual network and the DAN were significantly stronger than those with the ventral attention network (VAN) areas and areas of other networks. We further conducted individual difference analyses with a sample size of 295 participants and a series of attentional tasks to investigate which attentional components each phPITd-based DAN edge predicts. Our findings revealed that the intrinsic FC of the left phPITd with the LIPv could predict individual ability in attentional orienting, but not in alerting, executive control, and distractor suppression. Our results not only provide direct evidence of the phPITd's functional relationship with the LIPv, but also offer a comprehensive understanding of its specific role in visual attention.

The impact of early and late blindness on language and verbal working memory: A brain-constrained neural model

Neural circuits related to language exhibit a remarkable ability to reorganize and adapt in response to visual deprivation. Particularly, early and late blindness induce distinct neuroplastic changes in the visual cortex, repurposing it for language and semantic processing. Interestingly, these functional changes provoke a unique cognitive advantage - enhanced verbal working memory, particularly in early blindness. Yet, the underlying neuromechanisms and the impact on language and memory-related circuits remain not fully understood. Here, we applied a brain-constrained neural network mimicking the structural and functional features of the frontotemporal-occipital cortices, to model conceptual acquisition in early and late blindness. The results revealed differential expansion of conceptual-related neural circuits into deprived visual areas depending on the timing of visual loss, which is most prominent in early blindness. This neural recruitment is fundamentally governed by the biological principles of neural circuit expansion and the absence of uncorrelated sensory input. Critically, the degree of these changes is constrained by the availability of neural matter previously allocated to visual experiences, as in the case of late blindness. Moreover, we shed light on the implication of visual deprivation on the neural underpinnings of verbal working memory, revealing longer reverberatory neural activity in 'blind models' as compared to the sighted ones. These findings provide a better understanding of the interplay between visual deprivations, neuroplasticity, language processing and verbal working memory.

Breakdown of category-specific word representations in a brain-constrained neurocomputational model of semantic dementia

The neurobiological nature of semantic knowledge, i.e., the encoding and storage of conceptual information in the human brain, remains a poorly understood and hotly debated subject. Clinical data on semantic deficits and neuroimaging evidence from healthy individuals have suggested multiple cortical regions to be involved in the processing of meaning. These include semantic hubs (most notably, anterior temporal lobe, ATL) that take part in semantic processing in general as well as sensorimotor areas that process specific aspects/categories according to their modality. Biologically inspired neurocomputational models can help elucidate the exact roles of these regions in the functioning of the semantic system and, importantly, in its breakdown in neurological deficits. We used a neuroanatomically constrained computational model of frontotemporal cortices implicated in word acquisition and processing, and adapted it to simulate and explain the effects of semantic dementia (SD) on word processing abilities. SD is a devastating, yet insufficiently understood progressive neurodegenerative disease, characterised by semantic knowledge deterioration that is hypothesised to be specifically related to neural damage in the ATL. The behaviour of our brain-based model is in full accordance with clinical data-namely, word comprehension performance decreases as SD lesions in ATL progress, whereas word repetition abilities remain less affected. Furthermore, our model makes predictions about lesion- and category-specific effects of SD: our simulation results indicate that word processing should be more impaired for object- than for action-related words, and that degradation of white matter should produce more severe consequences than the same proportion of grey matter decay. In sum, the present results provide a neuromechanistic explanatory account of cortical-level language impairments observed during the onset and progress of semantic dementia.

Laminar compartmentalization of attention modulation in area V4 aligns with the demands of visual processing hierarchy in the cortex

Attention selectively enhances neural responses to low contrast stimuli in visual area V4, a critical hub that sends projections both up and down the visual hierarchy. Veridical encoding of contrast information is a key computation in early visual areas, while later stages encoding higher level features benefit from improved sensitivity to low contrast. How area V4 meets these distinct information processing demands in the attentive state is unknown. We found that attentional modulation in V4 is cortical layer and cell-class specific. Putative excitatory neurons in the superficial layers show enhanced boosting of low contrast information, while those of deep layers exhibit contrast-independent scaling. Computational modeling suggested the extent of spatial integration of inhibitory neurons as the mechanism behind such laminar differences. Considering that superficial neurons are known to project to higher areas and deep layers to early visual areas, our findings suggest that the interactions between attention and contrast in V4 are compartmentalized, in alignment with the demands of the visual processing hierarchy.

Increasing associative plasticity in temporo-occipital back-projections improves visual perception of emotions

The posterior superior temporal sulcus (pSTS) is a critical node in a network specialized for perceiving emotional facial expressions that is reciprocally connected with early visual cortices (V1/V2). Current models of perceptual decision-making increasingly assign relevance to recursive processing for visual recognition. However, it is unknown whether inducing plasticity into reentrant connections from pSTS to V1/V2 impacts emotion perception. Using a combination of electrophysiological and neurostimulation methods, we demonstrate that strengthening the connectivity from pSTS to V1/V2 selectively increases the ability to perceive facial expressions associated with emotions. This behavior is associated with increased electrophysiological activity in both these brain regions, particularly in V1/V2, and depends on specific temporal parameters of stimulation that follow Hebbian principles. Therefore, we provide evidence that pSTS-to-V1/V2 back-projections are instrumental to perception of emotion from facial stimuli and functionally malleable via manipulation of associative plasticity.

Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates

The visual system must reconstruct the dynamic, three-dimensional (3D) world from ambiguous two-dimensional (2D) retinal images. In this review, we synthesize current literature on how the visual system of nonhuman primates performs this transformation through multiple channels within the classically defined dorsal (where) and ventral (what) pathways. Each of these channels is specialized for processing different 3D features (e.g., the shape, orientation, or motion of objects, or the larger scene structure). Despite the common goal of 3D reconstruction, neurocomputational differences between the channels impose distinct information-limiting constraints on perception. Convergent evidence further points to the little-studied area V3A as a potential branchpoint from which multiple 3D-fugal processing channels diverge. We speculate that the expansion of V3A in humans may have supported the emergence of advanced 3D spatial reasoning skills. Lastly, we discuss future directions for exploring 3D information transmission across brain areas and experimental approaches that can further advance the understanding of 3D vision.

Dissociating distinct cortical networks associated with subregions of the human medial temporal lobe using precision neuroimaging

Tract-tracing studies in primates indicate that different subregions of the medial temporal lobe (MTL) are connected with multiple brain regions. However, no clear framework defining the distributed anatomy associated with the human MTL exists. This gap in knowledge originates in notoriously low MRI data quality in the anterior human MTL and in group-level blurring of idiosyncratic anatomy between adjacent brain regions, such as entorhinal and perirhinal cortices, and parahippocampal areas TH/TF. Using MRI, we intensively scanned four human individuals and collected whole-brain data with unprecedented MTL signal quality. Following detailed exploration of cortical networks associated with MTL subregions within each individual, we discovered three biologically meaningful networks associated with the entorhinal cortex, perirhinal cortex, and parahippocampal area TH, respectively. Our findings define the anatomical constraints within which human mnemonic functions must operate and are insightful for examining the evolutionary trajectory of the MTL connectivity across species.

Disrupting nociceptive information processing flow through transcranial focused ultrasound neuromodulation of thalamic nuclei

BACKGROUND

MRI-guided transcranial focused ultrasound (MRgFUS) as a next-generation neuromodulation tool can precisely target and stimulate deep brain regions with high spatial selectivity. Combined with MR-ARFI (acoustic radiation force imaging) and using fMRI BOLD signal as functional readouts, our previous studies have shown that low-intensity FUS can excite or suppress neural activity in the somatosensory cortex.

OBJECTIVE

To investigate whether low-intensity FUS can suppress nociceptive heat stimulation-induced responses in thalamic nuclei during hand stimulation, and to determine how this suppression influences the information processing flow within nociception networks.

FINDINGS

BOLD fMRI activations evoked by 47.5 °C heat stimulation of hand were detected in 24 cortical regions, which belong to sensory, affective, and cognitive nociceptive networks. Concurrent delivery of low-intensity FUS pulses (650 kHz, 550 kPa) to the predefined heat nociceptive stimulus-responsive thalamic centromedial_parafascicular (CM_para), mediodorsal (MD), ventral_lateral (VL_ and ventral_lateral_posteroventral (VLpv) nuclei suppressed their heat responses. Off-target cortical areas exhibited reduced, enhanced, or no significant fMRI signal changes, depending on the specific areas. Differentiable thalamocortical information flow during the processing of nociceptive heat input was observed, as indicated by the time to reach 10% or 30% of the heat-evoked BOLD signal peak. Suppression of thalamic heat responses significantly altered nociceptive processing flow and direction between the thalamus and cortical areas. Modulation of contralateral versus ipsilateral areas by unilateral thalamic activity differed. Signals detected in high-order cortical areas, such as dorsal frontal (DFC) and ventrolateral prefrontal (vlPFC) cortices, exhibited faster response latencies than sensory areas.

CONCLUSIONS

The concurrent delivery of FUS suppressed nociceptive heat response in thalamic nuclei and disrupted the nociceptive network. This study offers new insights into the causal functional connections within the thalamocortical networks and demonstrates the modulatory effects of low-intensity FUS on nociceptive information processing.

Laminar mechanisms of saccadic suppression in primate visual cortex

Saccadic eye movements are known to cause saccadic suppression, a temporary reduction in visual sensitivity and visual cortical firing rates. While saccadic suppression has been well characterized at the level of perception and single neurons, relatively little is known about the visual cortical networks governing this phenomenon. Here we examine the effects of saccadic suppression on distinct neural subpopulations within visual area V4. We find subpopulation-specific differences in the magnitude and timing of peri-saccadic modulation. Input-layer neurons show changes in firing rate and inter-neuronal correlations prior to saccade onset, and putative inhibitory interneurons in the input layer elevate their firing rate during saccades. A computational model of this circuit recapitulates our empirical observations and demonstrates that an input-layer-targeting pathway can initiate saccadic suppression by enhancing local inhibitory activity. Collectively, our results provide a mechanistic understanding of how eye movement signaling interacts with cortical circuitry to enforce visual stability.

Episodic Memory formation: A review of complex Hippocampus input pathways

Memories of everyday experiences involve the encoding of a rich and dynamic representation of present objects and their contextual features. Traditionally, the resulting mnemonic trace is referred to as Episodic Memory, i.e. the "what", "where" and "when" of a lived episode. The journey for such memory trace encoding begins with the perceptual data of an experienced episode handled in sensory brain regions. The information is then streamed to cortical areas located in the ventral Medio Temporal Lobe, which produces multi-modal representations concerning either the objects (in the Perirhinal cortex) or the spatial and contextual features (in the parahippocampal region) of the episode. Then, this high-level data is gated through the Entorhinal Cortex and forwarded to the Hippocampal Formation, where all the pieces get bound together. Eventually, the resulting encoded neural pattern is relayed back to the Neocortex for a stable consolidation. This review will detail these different stages and provide a systematic overview of the major cortical streams toward the Hippocampus relevant for Episodic Memory encoding.

Abnormal cortical morphology in children and adolescents with intermittent exotropia

Purpose

To investigate cortical differences, age-related cortical differences, and structural covariance differences between children with intermittent exotropia (IXT) and healthy controls (HCs) using high-resolution magnetic resonance imaging (MRI).

Methods

Sixteen IXT patients and 16 HCs underwent MRI using a 3-T MR scanner. FreeSurfer software was used to obtain measures of cortical volume, thickness, and surface area. Group differences in cortical thickness, volume and surface area were examined using a general linear model with intracranial volume (ICV), age and sex as covariates. Then, the age-related cortical differences between the two groups and structural covariance in abnormal morphometric changes were examined.

Results

Compared to HCs, IXT patients demonstrated significantly decreased surface area in the left primary visual cortex (PVC), and increased surface area in the left inferior temporal cortex (ITC). We also found increased cortical thickness in the left orbitofrontal cortex (OFC), right middle temporal cortex (MT), and right inferior frontal cortex (IFC). No significant differences were found in cortical volume between the two groups. There were several negative correlations between neuroanatomic measurements and age in the HC group that were not observed in the IXT group. In addition, we identified altered patterns of structural correlations across brain regions in patients with IXT.

Conclusion

To our knowledge, this study is the first to characterize the cortical morphometry of the children and adolescents with IXT. Based on our results, children and adolescents with IXT exhibited significant alterations in the PVC and association cortices, different cortical morphometric development patterns, and disrupted structural covariance across brain regions.

Multisensory information about changing object properties can be used to quickly correct predictive force scaling for object lifting

Sensory information about object properties, such as size or material, can be used to make an estimate of object weight and to generate an accurate motor plan to lift the object. When object properties change, the motor plan needs to be corrected based on the new information. The current study investigated whether such corrections could be made quickly, after the movement was initiated. Participants had to grasp and lift objects of different weights that could be indicated with different cues. During the reaching phase, the cue could change to indicate a different weight and participants had to quickly adjust their planned forces in order to lift the object skilfully. The object weight was cued with different object sizes (Experiment 1) or materials (Experiment 2) and the cue was presented in different sensory modality conditions: visually, haptically or both (visuohaptic). Results showed that participants could adjust their planned forces based on both size and material. Furthermore, corrections could be made in the visual, haptic and visuohaptic conditions, although the multisensory condition did not outperform the conditions with one sensory modality. These results suggest that motor plans can be quickly corrected based on sensory information about object properties from different sensory modalities. These findings provide insights into the information that can be shared between brain areas for the online control of hand-object interactions.

The retrocalcarine sulcus maps different retinotopic representations in macaques and humans

Primate cerebral cortex is highly convoluted with much of the cortical surface buried in sulcal folds. The origins of cortical folding and its functional relevance have been a major focus of systems and cognitive neuroscience, especially when considering stereotyped patterns of cortical folding that are shared across individuals within a primate species and across multiple species. However, foundational questions regarding organizing principles shared across species remain unanswered. Taking a cross-species comparative approach with a careful consideration of historical observations, we investigate cortical folding relative to primary visual cortex (area V1). We identify two macroanatomical structures-the retrocalcarine and external calcarine sulci-in 24 humans and 6 macaque monkeys. We show that within species, these sulci are identifiable in all individuals, fall on a similar part of the V1 retinotopic map, and thus, serve as anatomical landmarks predictive of functional organization. Yet, across species, the underlying eccentricity representations corresponding to these macroanatomical structures differ strikingly across humans and macaques. Thus, the correspondence between retinotopic representation and cortical folding for an evolutionarily old structure like V1 is species-specific and suggests potential differences in developmental and experiential constraints across primates.

The role of temporal cortex in the control of attention

Attention is an indispensable component of active vision. Contrary to the widely accepted notion that temporal cortex processing primarily focusses on passive object recognition, a series of very recent studies emphasize the role of temporal cortex structures, specifically the superior temporal sulcus (STS) and inferotemporal (IT) cortex, in guiding attention and implementing cognitive programs relevant for behavioral tasks. The goal of this theoretical paper is to advance the hypothesis that the temporal cortex attention network (TAN) entails necessary components to actively participate in attentional control in a flexible task-dependent manner. First, we will briefly discuss the general architecture of the temporal cortex with a focus on the STS and IT cortex of monkeys and their modulation with attention. Then we will review evidence from behavioral and neurophysiological studies that support their guidance of attention in the presence of cognitive control signals. Next, we propose a mechanistic framework for executive control of attention in the temporal cortex. Finally, we summarize the role of temporal cortex in implementing cognitive programs and discuss how they contribute to the dynamic nature of visual attention to ensure flexible behavior.

Information Exchange between Cortical Areas: The Visual System as a Model

As nearly all brain functions, perception, motion, and higher-order cognitive functions require coordinated neural information processing within distributed cortical networks. Over the past decades, new theories and techniques emerged that advanced our understanding of how information is transferred between cortical areas. This review surveys critical aspects of interareal information exchange. We begin by examining the brain’s structural connectivity, which provides the basic framework for interareal communication. We then illustrate information exchange between cortical areas using the visual system as an example. Next, well-studied and newly proposed theories that may underlie principles of neural communication are reviewed, highlighting recent work that offers new perspectives on interareal information exchange. We finally discuss open questions in the study of the neural mechanisms underlying interareal information exchange.

Reunification of Object and View-Center Background Information in the Primate Medial Temporal Lobe

Recent work has shown that the medial temporal lobe (MTL), including the hippocampus (HPC) and its surrounding limbic cortices, plays a role in scene perception in addition to episodic memory. The two basic factors of scene perception are the object (“what”) and location (“where”). In this review, we first summarize the anatomical knowledge related to visual inputs to the MTL and physiological studies examining object-related information processed along the ventral pathway briefly. Thereafter, we discuss the space-related information, the processing of which was unclear, presumably because of its multiple aspects and a lack of appropriate task paradigm in contrast to object-related information. Based on recent electrophysiological studies using non-human primates and the existing literature, we proposed the “reunification theory,” which explains brain mechanisms which construct object-location signals at each gaze. In this reunification theory, the ventral pathway signals a large-scale background image of the retina at each gaze position. This view-center background signal reflects the first person’s perspective and specifies the allocentric location in the environment by similarity matching between images. The spatially invariant object signal and view-center background signal, both of which are derived from the same retinal image, are integrated again (i.e., reunification) along the ventral pathway-MTL stream, particularly in the perirhinal cortex. The conjunctive signal, which represents a particular object at a particular location, may play a role in scene perception in the HPC as a key constituent element of an entire scene.

The Arcuate Fasciculus and language origins: Disentangling existing conceptions that influence evolutionary accounts

The Arcuate Fasciculus (AF) is of considerable interdisciplinary interest, because of its major implication in language processing. Theories about language brain evolution are based on anatomical differences in the AF across primates. However, changing methodologies and nomenclatures have resulted in conflicting findings regarding interspecies AF differences: Historical knowledge about the AF originated from human blunt dissections and later from monkey tract-tracing studies. Contemporary tractography studies reinvestigate the fasciculus' morphology, but remain heavily bound to unclear anatomical priors and methodological limitations. First, we aim to disentangle the influences of these three epistemological steps on existing AF conceptions, and to propose a contemporary model to guide future work. Second, considering the influence of various AF conceptions, we discuss four key evolutionary changes that propagated current views about language evolution: 1) frontal terminations, 2) temporal terminations, 3) greater Dorsal- versus Ventral Pathway expansion, 4) lateralisation. We conclude that new data point towards a more shared AF anatomy across primates than previously described. Language evolution theories should incorporate this continuous AF evolution across primates.

Visual prototypes in the ventral stream are attuned to complexity and gaze behavior

Early theories of efficient coding suggested the visual system could compress the world by learning to represent features where information was concentrated, such as contours. This view was validated by the discovery that neurons in posterior visual cortex respond to edges and curvature. Still, it remains unclear what other information-rich features are encoded by neurons in more anterior cortical regions (e.g., inferotemporal cortex). Here, we use a generative deep neural network to synthesize images guided by neuronal responses from across the visuocortical hierarchy, using floating microelectrode arrays in areas V1, V4 and inferotemporal cortex of two macaque monkeys. We hypothesize these images ("prototypes") represent such predicted information-rich features. Prototypes vary across areas, show moderate complexity, and resemble salient visual attributes and semantic content of natural images, as indicated by the animals' gaze behavior. This suggests the code for object recognition represents compressed features of behavioral relevance, an underexplored aspect of efficient coding.

Modelling concrete and abstract concepts using brain-constrained deep neural networks

A neurobiologically constrained deep neural network mimicking cortical areas relevant for sensorimotor, linguistic and conceptual processing was used to investigate the putative biological mechanisms underlying conceptual category formation and semantic feature extraction. Networks were trained to learn neural patterns representing specific objects and actions relevant to semantically 'ground' concrete and abstract concepts. Grounding sets consisted of three grounding patterns with neurons representing specific perceptual or action-related features; neurons were either unique to one pattern or shared between patterns of the same set. Concrete categories were modelled as pattern triplets overlapping in their 'shared neurons', thus implementing semantic feature sharing of all instances of a category. In contrast, abstract concepts had partially shared feature neurons common to only pairs of category instances, thus, exhibiting family resemblance, but lacking full feature overlap. Stimulation with concrete and abstract conceptual patterns and biologically realistic unsupervised learning caused formation of strongly connected cell assemblies (CAs) specific to individual grounding patterns, whose neurons were spread out across all areas of the deep network. After learning, the shared neurons of the instances of concrete concepts were more prominent in central areas when compared with peripheral sensorimotor ones, whereas for abstract concepts the converse pattern of results was observed, with central areas exhibiting relatively fewer neurons shared between pairs of category members. We interpret these results in light of the current knowledge about the relative difficulty children show when learning abstract words. Implications for future neurocomputational modelling experiments as well as neurobiological theories of semantic representation are discussed.

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Contributions of the Monkey Inferior Temporal Areas TE and TEO to Visual Categorization

The ability to categorize images is thought to depend on neural processing within the ventral visual stream. Recently, we reported that after removal of architectonic area TE, the terminal region of the ventral stream, monkeys were still able to categorize images as cats or dogs moderately well. Here, we investigate the contribution of TEO, the architectonically defined region located one step earlier than area TE in the ventral stream. Bilateral removal of TEO caused only a mild impairment in categorization. However, combined TE + TEO removal was followed by a severe, long-lasting impairment in categorization. All of the monkeys tested, including those with combined TE + TEO removals, had normal low-level visual functions, such as visual acuity. These results support the conclusion that categorization based on visual similarity is processed in parallel in TE and TEO.

Differential neurodynamics and connectivity in the dorsal and ventral visual pathways during perception of emotional crowds and individuals: a MEG study

Reading the prevailing emotion of groups of people ("crowd emotion") is critical to understanding their overall intention and disposition. It alerts us to potential dangers, such as angry mobs or panicked crowds, giving us time to escape. A critical aspect of processing crowd emotion is that it must occur rapidly, because delays often are costly. Although knowing the timing of neural events is crucial for understanding how the brain guides behaviors using coherent signals from a glimpse of multiple faces, this information is currently lacking in the literature on face ensemble coding. Therefore, we used magnetoencephalography to examine the neurodynamics in the dorsal and ventral visual streams and the periamygdaloid cortex to compare perception of groups of faces versus individual faces. Forty-six participants compared two groups of four faces or two individual faces with varying emotional expressions and chose which group or individual they would avoid. We found that the dorsal stream was activated as early as 68 msec after the onset of stimuli containing groups of faces. In contrast, the ventral stream was activated later and predominantly for individual face stimuli. The latencies of the dorsal stream activation peaks correlated with participants' response times for facial crowds. We also found enhanced connectivity earlier between the periamygdaloid cortex and the dorsal stream regions for crowd emotion perception. Our findings suggest that ensemble coding of facial crowds proceeds rapidly and in parallel by engaging the dorsal stream to mediate adaptive social behaviors, via a distinct route from single face perception.

Neural Selectivity for Visual Motion in Macaque Area V3A

The processing of visual motion is conducted by dedicated pathways in the primate brain. These pathways originate with populations of direction-selective neurons in the primary visual cortex, which projects to dorsal structures like the middle temporal (MT) and medial superior temporal (MST) areas. Anatomical and imaging studies have suggested that area V3A might also be specialized for motion processing, but there have been very few studies of single-neuron direction selectivity in this area. We have therefore performed electrophysiological recordings from V3A neurons in two macaque monkeys (one male and one female) and measured responses to a large battery of motion stimuli that includes translation motion, as well as more complex optic flow patterns. For comparison, we simultaneously recorded the responses of MT neurons to the same stimuli. Surprisingly, we find that overall levels of direction selectivity are similar in V3A and MT and moreover that the population of V3A neurons exhibits somewhat greater selectivity for optic flow patterns. These results suggest that V3A should be considered as part of the motion processing machinery of the visual cortex, in both human and non-human primates.

Egocentric and allocentric spatial representations in a patient with Bálint-like syndrome: A single-case study

Previous studies suggested that egocentric and allocentric spatial representations are supported by neural networks in the occipito-parietal (dorsal) and occipito-temporal (ventral) streams, respectively. The present study aimed to explore the integrity of ego- and allo-centric spatial representations in a patient (GP) who presented bilateral occipito-parietal damage consistent with the picture of a Bálint-like syndrome. GP and healthy controls were asked to provide memory-based spatial judgments on triads of objects after a short (1.5sec) or long (5sec) delay. The results showed that GP's performance was selectively impaired in the Ego/1.5sec delay condition. As a whole, our findings suggest that GP's spared ventral stream could generate short- and long-term allocentric representations. Furthermore, the stored perceptual representation processed within the ventral stream might have been used to generate long-term egocentric representation. Conversely, the generation of short-term egocentric representation appeared to be selectively undermined by the damage of the dorsal stream.

The role of the anterior intraparietal sulcus and the lateral occipital cortex in fingertip force scaling and weight perception during object lifting

Skillful object lifting relies on scaling fingertip forces according to the object’s weight. When no visual cues about weight are available, force planning relies on previous lifting experience. Recently, we showed that previously lifted objects also affect weight estimation, as objects are perceived to be lighter when lifted after heavy objects compared with after light ones. Here, we investigated the underlying neural mechanisms mediating these effects. We asked participants to lift objects and estimate their weight. Simultaneously, we applied transcranial magnetic stimulation (TMS) during the dynamic loading or static holding phase. Two subject groups received TMS over either the anterior intraparietal sulcus (aIPS) or the lateral occipital area (LO), known to be important nodes in object grasping and perception. We hypothesized that TMS over aIPS and LO during object lifting would alter force scaling and weight perception. Contrary to our hypothesis, we did not find effects of aIPS or LO stimulation on force planning or weight estimation caused by previous lifting experience. However, we found that TMS over both areas increased grip forces, but only when applied during dynamic loading, and decreased weight estimation, but only when applied during static holding, suggesting time-specific effects. Interestingly, our results also indicate that TMS over LO, but not aIPS, affected load force scaling specifically for heavy objects, which further indicates that load and grip forces might be controlled differently. These findings provide new insights on the interactions between brain networks mediating action and perception during object manipulation.

NEW & NOTEWORTHY This article provides new insights into the neural mechanisms underlying object lifting and perception. Using transcranial magnetic stimulation during object lifting, we show that effects of previous experience on force scaling and weight perception are not mediated by the anterior intraparietal sulcus or the lateral occipital cortex (LO). In contrast, we highlight a unique role for LO in load force scaling, suggesting different brain processes for grip and load force scaling in object manipulation.

Neural Interactions Underlying Visuomotor Associations in the Human Brain

Rapid and flexible learning during behavioral choices is critical to our daily endeavors and constitutes a hallmark of dynamic reasoning. An important paradigm to examine flexible behavior involves learning new arbitrary associations mapping visual inputs to motor outputs. We conjectured that visuomotor rules are instantiated by translating visual signals into actions through dynamic interactions between visual, frontal and motor cortex. We evaluated the neural representation of such visuomotor rules by performing intracranial field potential recordings in epilepsy subjects during a rule-learning delayed match-to-behavior task. Learning new visuomotor mappings led to the emergence of specific responses associating visual signals with motor outputs in 3 anatomical clusters in frontal, anteroventral temporal and posterior parietal cortex. After learning, mapping selective signals during the delay period showed interactions with visual and motor signals. These observations provide initial steps towards elucidating the dynamic circuits underlying flexible behavior and how communication between subregions of frontal, temporal, and parietal cortex leads to rapid learning of task-relevant choices.

Comparative neuroanatomy: Integrating classic and modern methods to understand association fibers connecting dorsal and ventral visual cortex

Comparative neuroanatomy studies improve understanding of brain structure and function and provide insight regarding brain development, evolution, and also what features of the brain are uniquely human. With modern methods such as diffusion MRI (dMRI) and quantitative MRI (qMRI), we are able to measure structural features of the brain with the same methods across human and non-human primates. In this review article, we discuss how recent dMRI measurements of vertical occipital connections in humans and macaques can be compared with previous findings from invasive anatomical studies that examined connectivity, including relatively forgotten classic strychnine neuronography studies. We then review recent progress in understanding the neuroanatomy of vertical connections within the occipitotemporal cortex by combining modern quantitative MRI and classical histological measurements in human and macaque. Finally, we a) discuss current limitations of dMRI and tractography and b) consider potential paths for future investigations using dMRI and tractography for comparative neuroanatomical studies of white matter tracts between species. While we focus on vertical association connections in visual cortex in the present paper, this same approach can be applied to other white matter tracts. Similar efforts are likely to continue to advance our understanding of the neuroanatomical features of the brain that are shared across species, as well as to distinguish the features that are uniquely human.

Representation of shape, space, and attention in monkey cortex

Attentional deficits are core to numerous developmental, neurological, and psychiatric disorders. At the single-cell level, much knowledge has been garnered from studies of shape and spatial properties, as well as from numerous demonstrations of attentional modulation of those properties. Despite this wealth of knowledge of single-cell responses across many brain regions, little is known about how these cellular characteristics relate to population level representations and how such representations relate to behavior; in particular, how these cellular responses relate to the representation of shape, space, and attention, and how these representations differ across cortical areas and streams. Here we will emphasize the role of population coding as a missing link for connecting single-cell properties with behavior. Using a data-driven intrinsic approach to population decoding, we show that both 'what' and 'where' cortical visual streams encode shape, space, and attention, yet demonstrate striking differences in these representations. We suggest that both pathways fully process shape and space, but that differences in representation may arise due to their differing functions and input and output constraints. Moreover, differences in the effects of attention on shape and spatial population representations in the two visual streams suggest two distinct strategies: in a ventral area, attention or task demands modulate the population representations themselves (perhaps to expand or enhance one part at the expense of other parts) while in a dorsal area, at a population representation level, attention effects are weak and nearly non-existent, perhaps in order to maintain veridical representations needed for visuomotor control. We show that an intrinsic approach, as opposed to theory-driven and labeled approaches, is useful for understanding how representations develop and differ across brain regions. Most importantly, these approaches help link cellular properties more tightly with behavior, a much-needed step to better understand and interpret cellular findings and key to providing insights to improve interventions in human disorders.

Visual cortex recruitment during language processing in blind individuals is explained by Hebbian learning

In blind people, the visual cortex takes on higher cognitive functions, including language. Why this functional reorganisation mechanistically emerges at the neuronal circuit level is still unclear. Here, we use a biologically constrained network model implementing features of anatomical structure, neurophysiological function and connectivity of fronto-temporal-occipital areas to simulate word-meaning acquisition in visually deprived and undeprived brains. We observed that, only under visual deprivation, distributed word-related neural circuits 'grew into' the deprived visual areas, which therefore adopted a linguistic-semantic role. Three factors are crucial for explaining this deprivation-related growth: changes in the network's activity balance brought about by the absence of uncorrelated sensory input, the connectivity structure of the network, and Hebbian correlation learning. In addition, the blind model revealed long-lasting spiking neural activity compared to the sighted model during word recognition, which is a neural correlate of enhanced verbal working memory. The present neurocomputational model offers a neurobiological account for neural changes following sensory deprivation, thus closing the gap between cellular-level mechanisms, system-level linguistic and semantic function.

Functionally defined white matter of the macaque monkey brain reveals a dorso-ventral attention network

Classical studies of attention have identified areas of parietal and frontal cortex as sources of attentional control. Recently, a ventral region in the macaque temporal cortex, the posterior infero-temporal dorsal area PITd, has been suggested as a third attentional control area. This raises the question of whether and how spatially distant areas coordinate a joint focus of attention. Here we tested the hypothesis that parieto-frontal attention areas and PITd are directly interconnected. By combining functional MRI with ex-vivo high-resolution diffusion MRI, we found that PITd and dorsal attention areas are all directly connected through three specific fascicles. These results ascribe a new function, the communication of attention signals, to two known fiber-bundles, highlight the importance of vertical interactions across the two visual streams, and imply that the control of endogenous attention, hitherto thought to reside in macaque dorsal cortical areas, is exerted by a dorso-ventral network.

A Neurobiologically Constrained Cortex Model of Semantic Grounding With Spiking Neurons and Brain-Like Connectivity

One of the most controversial debates in cognitive neuroscience concerns the cortical locus of semantic knowledge and processing in the human brain. Experimental data revealed the existence of various cortical regions relevant for meaning processing, ranging from semantic hubs generally involved in semantic processing to modality-preferential sensorimotor areas involved in the processing of specific conceptual categories. Why and how the brain uses such complex organization for conceptualization can be investigated using biologically constrained neurocomputational models. Here, we improve pre-existing neurocomputational models of semantics by incorporating spiking neurons and a rich connectivity structure between the model ‘areas’ to mimic important features of the underlying neural substrate. Semantic learning and symbol grounding in action and perception were simulated by associative learning between co-activated neuron populations in frontal, temporal and occipital areas. As a result of Hebbian learning of the correlation structure of symbol, perception and action information, distributed cell assembly circuits emerged across various cortices of the network. These semantic circuits showed category-specific topographical distributions, reaching into motor and visual areas for action- and visually-related words, respectively. All types of semantic circuits included large numbers of neurons in multimodal connector hub areas, which is explained by cortical connectivity structure and the resultant convergence of phonological and semantic information on these zones. Importantly, these semantic hub areas exhibited some category-specificity, which was less pronounced than that observed in primary and secondary modality-preferential cortices. The present neurocomputational model integrates seemingly divergent experimental results about conceptualization and explains both semantic hubs and category-specific areas as an emergent process causally determined by two major factors: neuroanatomical connectivity structure and correlated neuronal activation during language learning.

A multi-scale layer-resolved spiking network model of resting-state dynamics in macaque visual cortical areas

Cortical activity has distinct features across scales, from the spiking statistics of individual cells to global resting-state networks. We here describe the first full-density multi-area spiking network model of cortex, using macaque visual cortex as a test system. The model represents each area by a microcircuit with area-specific architecture and features layer- and population-resolved connectivity between areas. Simulations reveal a structured asynchronous irregular ground state. In a metastable regime, the network reproduces spiking statistics from electrophysiological recordings and cortico-cortical interaction patterns in fMRI functional connectivity under resting-state conditions. Stable inter-area propagation is supported by cortico-cortical synapses that are moderately strong onto excitatory neurons and stronger onto inhibitory neurons. Causal interactions depend on both cortical structure and the dynamical state of populations. Activity propagates mainly in the feedback direction, similar to experimental results associated with visual imagery and sleep. The model unifies local and large-scale accounts of cortex, and clarifies how the detailed connectivity of cortex shapes its dynamics on multiple scales. Based on our simulations, we hypothesize that in the spontaneous condition the brain operates in a metastable regime where cortico-cortical projections target excitatory and inhibitory populations in a balanced manner that produces substantial inter-area interactions while maintaining global stability.

The mammalian cortex fulfills its complex tasks by operating on multiple temporal and spatial scales from single cells to entire areas comprising millions of cells. These multi-scale dynamics are supported by specific network structures at all levels of organization. Since models of cortex hitherto tend to concentrate on a single scale, little is known about how cortical structure shapes the multi-scale dynamics of the network. We here present dynamical simulations of a multi-area network model at neuronal and synaptic resolution with population-specific connectivity based on extensive experimental data which accounts for a wide range of dynamical phenomena. Our model elucidates relationships between local and global scales in cortex and provides a platform for future studies of cortical function.

Higher visual responses in the temporal cortex of mice

The visual cortex of mice is a useful model for investigating the mammalian visual system. In primates, higher visual areas are classified into two parts, the dorsal stream (“where” pathway) and ventral stream (“what” pathway). The ventral stream is known to include a part of the temporal cortex. In mice, however, some cortical areas adjacent to the primary visual area (V1) in the occipital cortex are thought to be comparable to the ventral stream in primates, although the whole picture of the mouse ventral stream has never been elucidated. We performed wide-field Ca²⁺ imaging in awake mice to investigate visual responses in the mouse temporal cortex, and found that the postrhinal cortex (POR), posterior to the auditory cortex (AC), and the ectorhinal and temporal association cortices (ECT), ventral to the AC, showed clear visual responses to moving visual objects. The retinotopic maps in the POR and ECT were not clearly observed, and the amplitudes of the visual responses in the POR and ECT were less sensitive to the size of the objects, compared to visual responses in the V1. In the ECT, objects of different sizes activated different subareas. These findings strongly suggest that the mouse ventral stream extends to the ECT ventral to the AC, and that it has characteristic response properties that are markedly different from the response properties in the V1.

How the Brain's Navigation System Shapes Our Visual Experience

We explore the environment not only by navigating, but also by viewing our surroundings with our eyes. Here we review growing evidence that the mammalian hippocampal formation, extensively studied in the context of navigation and memory, mediates a representation of visual space that is stably anchored to the external world. This visual representation puts the hippocampal formation in a central position to guide viewing behavior and to modulate visual processing beyond the medial temporal lobe (MTL). We suggest that vision and navigation share several key computational challenges that are solved by overlapping and potentially common neural systems, making vision an optimal domain to explore whether and how the MTL supports cognitive operations beyond navigation.

Sensitivity to Faces with Typical and Atypical Part Configurations within Regions of the Face-processing Network: An fMRI Study

Perception of faces has been shown to engage a domain-specific set of brain regions, including the occipital face area (OFA) and the fusiform face area (FFA). It is commonly held that the OFA is responsible for the detection of faces in the environment, whereas the FFA is responsible for processing the identity of the face. However, an alternative model posits that the FFA is responsible for face detection and subsequently recruits the OFA to analyze the face parts in the service of identification. An essential prediction of the former model is that the OFA is not sensitive to the arrangement of internal face parts. In the current fMRI study, we test the sensitivity of the OFA and FFA to the configuration of face parts. Participants were shown faces in which the internal parts were presented in a typical configuration (two eyes above a nose above a mouth) or in an atypical configuration (the locations of individual parts were shuffled within the face outline). Perception of the atypical faces evoked a significantly larger response than typical faces in the OFA and in a wide swath of the surrounding posterior occipitotemporal cortices. Surprisingly, typical faces did not evoke a significantly larger response than atypical faces anywhere in the brain, including the FFA (although some subthreshold differences were observed). We propose that face processing in the FFA results in inhibitory sculpting of activation in the OFA, which accounts for this region's weaker response to typical than to atypical configurations.

Multi-scale account of the network structure of macaque visual cortex

Cortical network structure has been extensively characterized at the level of local circuits and in terms of long-range connectivity, but seldom in a manner that integrates both of these scales. Furthermore, while the connectivity of cortex is known to be related to its architecture, this knowledge has not been used to derive a comprehensive cortical connectivity map. In this study, we integrate data on cortical architecture and axonal tracing data into a consistent multi-scale framework of the structure of one hemisphere of macaque vision-related cortex. The connectivity model predicts the connection probability between any two neurons based on their types and locations within areas and layers. Our analysis reveals regularities of cortical structure. We confirm that cortical thickness decays with cell density. A gradual reduction in neuron density together with the relative constancy of the volume density of synapses across cortical areas yields denser connectivity in visual areas more remote from sensory inputs and of lower structural differentiation. Further, we find a systematic relation between laminar patterns on source and target sides of cortical projections, extending previous findings from combined anterograde and retrograde tracing experiments. Going beyond the classical schemes, we statistically assign synapses to target neurons based on anatomical reconstructions, which suggests that layer 4 neurons receive substantial feedback input. Our derived connectivity exhibits a community structure that corresponds more closely with known functional groupings than previous connectivity maps and identifies layer-specific directional differences in cortico-cortical pathways. The resulting network can form the basis for studies relating structure to neural dynamics in mammalian cortex at multiple scales.

The Sander parallelogram illusion dissociates action and perception despite control for the litany of past confounds

The two visual systems hypothesis proposes that human vision is supported by an occipito-temporal network for the conscious visual perception of the world and a fronto-parietal network for visually-guided, object-directed actions. Two specific claims about the fronto-parietal network's role in sensorimotor control have generated much data and controversy: (1) the network relies primarily on the absolute metrics of target objects, which it rapidly transforms into effector-specific frames of reference to guide the fingers, hands, and limbs, and (2) the network is largely unaffected by scene-based information extracted by the occipito-temporal network for those same targets. These two claims lead to the counter-intuitive prediction that in-flight anticipatory configuration of the fingers during object-directed grasping will resist the influence of pictorial illusions. The research confirming this prediction has been criticized for confounding the difference between grasping and explicit estimates of object size with differences in attention, sensory feedback, obstacle avoidance, metric sensitivity, and priming. Here, we address and eliminate each of these confounds. We asked participants to reach out and pick up 3D target bars resting on a picture of the Sander Parallelogram illusion and to make explicit estimates of the length of those bars. Participants performed their grasps without visual feedback, and were permitted to grasp the targets after making their size-estimates to afford them an opportunity to reduce illusory error with haptic feedback. The results show unequivocally that the effect of the illusion is stronger on perceptual judgments than on grasping. Our findings from the normally-sighted population provide strong support for the proposal that human vision is comprised of functionally and anatomically dissociable systems.

Primary Generators of Visually Evoked Field Potentials Recorded in the Macaque Auditory Cortex

Prior studies have reported "local" field potential (LFP) responses to faces in the macaque auditory cortex and have suggested that such face-LFPs may be substrates of audiovisual integration. However, although field potentials (FPs) may reflect the synaptic currents of neurons near the recording electrode, due to the use of a distant reference electrode, they often reflect those of synaptic activity occurring in distant sites as well. Thus, FP recordings within a given brain region (e.g., auditory cortex) may be "contaminated" by activity generated elsewhere in the brain. To determine whether face responses are indeed generated within macaque auditory cortex, we recorded FPs and concomitant multiunit activity with linear array multielectrodes across auditory cortex in three macaques (one female), and applied current source density (CSD) analysis to the laminar FP profile. CSD analysis revealed no appreciable local generator contribution to the visual FP in auditory cortex, although we did note an increase in the amplitude of visual FP with cortical depth, suggesting that their generators are located below auditory cortex. In the underlying inferotemporal cortex, we found polarity inversions of the main visual FP components accompanied by robust CSD responses and large-amplitude multiunit activity. These results indicate that face-evoked FP responses in auditory cortex are not generated locally but are volume-conducted from other face-responsive regions. In broader terms, our results underscore the caution that, unless far-field contamination is removed, LFPs in general may reflect such "far-field" activity, in addition to, or in absence of, local synaptic responses.SIGNIFICANCE STATEMENT Field potentials (FPs) can index neuronal population activity that is not evident in action potentials. However, due to volume conduction, FPs may reflect activity in distant neurons superimposed upon that of neurons close to the recording electrode. This is problematic as the default assumption is that FPs originate from local activity, and thus are termed "local" (LFP). We examine this general problem in the context of previously reported face-evoked FPs in macaque auditory cortex. Our findings suggest that face-FPs are indeed generated in the underlying inferotemporal cortex and volume-conducted to the auditory cortex. The note of caution raised by these findings is of particular importance for studies that seek to assign FP/LFP recordings to specific cortical layers.

Attentive Motion Discrimination Recruits an Area in Inferotemporal Cortex

Attentional selection requires the interplay of multiple brain areas. Theoretical accounts of selective attention predict different areas with different functional properties to support endogenous covert attention. To test these predictions, we devised a demanding attention task requiring motion discrimination and spatial selection and performed whole-brain imaging in macaque monkeys. Attention modulated the early visual cortex, motion-selective dorsal stream areas, the lateral intraparietal area, and the frontal eye fields. This pattern of activation supports early selection, feature-based, and biased-competition attention accounts, as well as the frontoparietal theory of attentional control. While high-level motion-selective dorsal stream areas did not exhibit strong attentional modulation, ventral stream areas V4d and the dorsal posterior inferotemporal cortex (PITd) did. The PITd in fact was, consistently across task variations, the most significantly and most strongly attention-modulated area, even though it did not exhibit signs of motion selectivity. Thus the recruitment of the PITd in attention tasks involving different kinds of motion analysis is not predicted by any theoretical account of attention. These functional data, together with known anatomical connections, suggest a general and possibly critical role of the PITd in attentional selection.

SIGNIFICANCE STATEMENT

Attention is the key cognitive function that selects sensory information relevant to the current goals, relegating other information to the shadows of consciousness. To better understand the neural mechanisms of this interplay between sensory processing and internal cognitive state, we must learn more about the brain areas supporting attentional selection. Here, to test theoretical accounts of attentional selection, we used a novel task requiring sustained attention to motion. We found that, surprisingly, among the most strongly attention-modulated areas is one that is neither selective for the sensory feature relevant for current goals nor one hitherto thought to be involved in attentional control. This discovery suggests a need for an extension of current theoretical accounts of the brain circuits for attentional selection.

Occipital White Matter Tracts in Human and Macaque

We compare several major white-matter tracts in human and macaque occipital lobe using diffusion magnetic resonance imaging. The comparison suggests similarities but also significant differences in the tracts. There are several apparently homologous tracts in the 2 species, including the vertical occipital fasciculus (VOF), optic radiation, forceps major, and inferior longitudinal fasciculus (ILF). There is one large human tract, the inferior fronto-occipital fasciculus, with no corresponding fasciculus in macaque. We could identify the macaque VOF (mVOF), which has been little studied. Its position is consistent with classical invasive anatomical studies by Wernicke. VOF homology is supported by similarity of the endpoints in V3A and ventral V4 across species. The mVOF fibers intertwine with the dorsal segment of the ILF, but the human VOF appears to be lateral to the ILF. These similarities and differences between the occipital lobe tracts will be useful in establishing which circuitry in the macaque can serve as an accurate model for human visual cortex.

How do the two visual streams interact with each other?

The current consensus divides primate cortical visual processing into two broad networks or "streams" composed of highly interconnected areas (Milner and Goodale 2006, 2008; Goodale 2014). The ventral stream, passing from primary visual cortex (V1) through to inferior parts of the temporal lobe, is considered to mediate the transformation of the contents of the visual signal into the mental furniture that guides memory, recognition and conscious perception. In contrast the dorsal stream, passing from V1 through to various areas in the posterior parietal lobe, is generally considered to mediate the visual guidance of action, primarily in real time. The brain, however, does not work through mutually insulated subsystems, and indeed there are well-documented interconnections between the two streams. Evidence for contributions from ventral stream systems to the dorsal stream comes from human neuropsychological and neuroimaging research, and indicates a crucial role in mediating complex and flexible visuomotor skills. Complementary evidence points to a role for posterior dorsal-stream visual analysis in certain aspects of 3-D perceptual function in the ventral stream. A series of studies of a patient with visual form agnosia has been instrumental in shaping our knowledge of what each stream can achieve in isolation; but it has also helped us to tease apart the relative dependence of parietal visuomotor systems on direct bottom-up visual inputs versus inputs redirected via perceptual systems within the ventral stream.

Posterior Inferotemporal Cortex Cells Use Multiple Input Pathways for Shape Encoding

In the macaque monkey brain, posterior inferior temporal (PIT) cortex cells contribute to visual object recognition. They receive concurrent inputs from visual areas V4, V3, and V2. We asked how these different anatomical pathways shape PIT response properties by deactivating them while monitoring PIT activity in two male macaques. We found that cooling of V4 or V2|3 did not lead to consistent changes in population excitatory drive; however, population pattern analyses showed that V4-based pathways were more important than V2|3-based pathways. We did not find any image features that predicted decoding accuracy differences between both interventions. Using the HMAX hierarchical model of visual recognition, we found that different groups of simulated "PIT" units with different input histories (lacking "V2|3" or "V4" input) allowed for comparable levels of object-decoding performance and that removing a large fraction of "PIT" activity resulted in similar drops in performance as in the cooling experiments. We conclude that distinct input pathways to PIT relay similar types of shape information, with V1-dependent V4 cells providing more quantitatively useful information for overall encoding than cells in V2 projecting directly to PIT.SIGNIFICANCE STATEMENT Convolutional neural networks are the best models of the visual system, but most emphasize input transformations across a serial hierarchy akin to the primary "ventral stream" (V1 → V2 → V4 → IT). However, the ventral stream also comprises parallel "bypass" pathways: V1 also connects to V4, and V2 to IT. To explore the advantages of mixing long and short pathways in the macaque brain, we used cortical cooling to silence inputs to posterior IT and compared the findings with an HMAX model with parallel pathways.

A Spiking Neurocomputational Model of High-Frequency Oscillatory Brain Responses to Words and Pseudowords

Experimental evidence indicates that neurophysiological responses to well-known meaningful sensory items and symbols (such as familiar objects, faces, or words) differ from those to matched but novel and senseless materials (unknown objects, scrambled faces, and pseudowords). Spectral responses in the high beta- and gamma-band have been observed to be generally stronger to familiar stimuli than to unfamiliar ones. These differences have been hypothesized to be caused by the activation of distributed neuronal circuits or cell assemblies, which act as long-term memory traces for learned familiar items only. Here, we simulated word learning using a biologically constrained neurocomputational model of the left-hemispheric cortical areas known to be relevant for language and conceptual processing. The 12-area spiking neural-network architecture implemented replicates physiological and connectivity features of primary, secondary, and higher-association cortices in the frontal, temporal, and occipital lobes of the human brain. We simulated elementary aspects of word learning in it, focussing specifically on semantic grounding in action and perception. As a result of spike-driven Hebbian synaptic plasticity mechanisms, distributed, stimulus-specific cell-assembly (CA) circuits spontaneously emerged in the network. After training, presentation of one of the learned "word" forms to the model correlate of primary auditory cortex induced periodic bursts of activity within the corresponding CA, leading to oscillatory phenomena in the entire network and spontaneous across-area neural synchronization. Crucially, Morlet wavelet analysis of the network's responses recorded during presentation of learned meaningful "word" and novel, senseless "pseudoword" patterns revealed stronger induced spectral power in the gamma-band for the former than the latter, closely mirroring differences found in neurophysiological data. Furthermore, coherence analysis of the simulated responses uncovered dissociated category specific patterns of synchronous oscillations in distant cortical areas, including indirectly connected primary sensorimotor areas. Bridging the gap between cellular-level mechanisms, neuronal-population behavior, and cognitive function, the present model constitutes the first spiking, neurobiologically, and anatomically realistic model able to explain high-frequency oscillatory phenomena indexing language processing on the basis of dynamics and competitive interactions of distributed cell-assembly circuits which emerge in the brain as a result of Hebbian learning and sensorimotor experience.