Early Visual Cortex as a Multiscale Cognitive Blackboard

Why motor imagery is not really motoric: towards a re-conceptualization in terms of effect-based action control

Overt and imagined action seem inextricably linked. Both have similar timing, activate shared brain circuits, and motor imagery influences overt action and vice versa. Motor imagery is, therefore, often assumed to recruit the same motor processes that govern action execution, and which allow one to play through or simulate actions offline. Here, we advance a very different conceptualization. Accordingly, the links between imagery and overt action do not arise because action imagery is intrinsically motoric, but because action planning is intrinsically imaginistic and occurs in terms of the perceptual effects one want to achieve. Seen like this, the term 'motor imagery' is a misnomer of what is more appropriately portrayed as 'effect imagery'. In this article, we review the long-standing arguments for effect-based accounts of action, which are often ignored in motor imagery research. We show that such views provide a straightforward account of motor imagery. We review the evidence for imagery-execution overlaps through this new lens and argue that they indeed emerge because every action we execute is planned, initiated and controlled through an imagery-like process. We highlight findings that this new view can now explain and point out open questions.

Faster bi-stable visual switching in psychosis

Bi-stable stimuli evoke two distinct perceptual interpretations that alternate and compete for dominance. Bi-stable perception is thought to be driven at least in part by mutual suppression between distinct neural populations that represent each percept. Abnormal visual perception has been observed among people with psychotic psychopathology (PwPP), and there is evidence to suggest that these visual deficits may depend on impaired neural suppression in the visual cortex. However, it is not yet clear whether bi-stable visual perception is abnormal among PwPP. Here, we examined bi-stable perception in a visual structure-from-motion task using a rotating cylinder illusion in a group of 65 PwPP, 44 first-degree biological relatives, and 43 healthy controls. Data from a 'real switch' task, in which physical depth cues signaled real switches in rotation direction were used to exclude individuals who did not show adequate task performance. In addition, we measured concentrations of neurochemicals, including glutamate, glutamine, and γ-amino butyric acid (GABA), involved in excitatory and inhibitory neurotransmission. These neurochemicals were measured non-invasively in the visual cortex using 7 tesla MR spectroscopy. We found that PwPP and their relatives showed faster bi-stable switch rates than healthy controls. Faster switch rates also correlated with significantly higher psychiatric symptom levels, specifically disorganization, across all participants. However, we did not observe any significant relationships across individuals between neurochemical concentrations and SFM switch rates. Our results are consistent with a reduction in suppressive neural processes during structure-from-motion perception in PwPP, and suggest that genetic liability for psychosis is associated with disrupted bi-stable perception.

Recurrent neural networks that learn multi-step visual routines with reinforcement learning

Many cognitive problems can be decomposed into series of subproblems that are solved sequentially by the brain. When subproblems are solved, relevant intermediate results need to be stored by neurons and propagated to the next subproblem, until the overarching goal has been completed. We will here consider visual tasks, which can be decomposed into sequences of elemental visual operations. Experimental evidence suggests that intermediate results of the elemental operations are stored in working memory as an enhancement of neural activity in the visual cortex. The focus of enhanced activity is then available for subsequent operations to act upon. The main question at stake is how the elemental operations and their sequencing can emerge in neural networks that are trained with only rewards, in a reinforcement learning setting. We here propose a new recurrent neural network architecture that can learn composite visual tasks that require the application of successive elemental operations. Specifically, we selected three tasks for which electrophysiological recordings of monkeys' visual cortex are available. To train the networks, we used RELEARNN, a biologically plausible four-factor Hebbian learning rule, which is local both in time and space. We report that networks learn elemental operations, such as contour grouping and visual search, and execute sequences of operations, solely based on the characteristics of the visual stimuli and the reward structure of a task. After training was completed, the activity of the units of the neural network elicited by behaviorally relevant image items was stronger than that elicited by irrelevant ones, just as has been observed in the visual cortex of monkeys solving the same tasks. Relevant information that needed to be exchanged between subroutines was maintained as a focus of enhanced activity and passed on to the subsequent subroutines. Our results demonstrate how a biologically plausible learning rule can train a recurrent neural network on multistep visual tasks.

Embodied Cross-Modal Interactions Based on an Altercentric Reference Frame

Accurate comprehension of others' thoughts and intentions is crucial for smooth social interactions, wherein understanding their perceptual experiences serves as a fundamental basis for this high-level social cognition. However, previous research has predominantly focused on the visual modality when investigating perceptual processing from others' perspectives, leaving the exploration of multisensory inputs during this process largely unexplored. By incorporating auditory stimuli into visual perspective-taking (VPT) tasks, we have designed a novel experimental paradigm in which the spatial correspondence between visual and auditory stimuli was limited to the altercentric rather than the egocentric reference frame. Overall, we found that when individuals engaged in explicit or implicit VPT to process visual stimuli from an avatar's viewpoint, the concomitantly presented auditory stimuli were also processed within this avatar-centered reference frame, revealing altercentric cross-modal interactions.

Lesion network guided delta frequency neuromodulation improves cognition in patients with psychosis spectrum disorders: A pilot study

BACKGROUND

Transcranial electric stimulation (tES) may improve cognition in psychosis spectrum disorders. However, few studies have used novel tES approaches, such as high definition tES (HD-tES) to target specific brain circuits. Recently, the extrastriate visual cortex (V5/MT) has been causally linked to visual hallucinations through lesion network mapping and this may be a promising approach for improving cognition.

OBJECTIVE

We aim to determine if causal lesion network guided HD-tES to V5/MT improves cognitive performance as measured by the Brief Assessment of Cognition in Schizophrenia (BACS).

METHODS

A single-blind pilot study with a within-subjects crossover design was performed to characterize the effect of cathodal HD-transcranial direct current stimulation (tDCS) and 2 Hz HD-transcranial alternating current stimulation (tACS) on cognition. Enrolled patients received 20 mins of HD-tES twice daily for 5 consecutive days applied bilaterally to V5/MT with a washout between conditions. BACS assessments were performed at baseline, day-5, and 1-month.

RESULTS

6 participants with psychosis spectrum disorder were enrolled. 6 individuals received cathodal HD-tDCS. 4 individuals received 2 Hz HD-tACS. HD-tACS resulted in significant (p < 0.1 baseline to 1-month improvements for Digit Sequencing, Verbal Fluency, and Tower of London. HD-tDCS did not result in significant improvement on any task.

CONCLUSIONS

HD-tACS targeting V5/MT may be a promising treatment to improve cognitive abilities in individuals with psychosis. By promoting delta oscillations, tACS may enhance cortico-cortico communications across brain networks to improve verbal working memory, processing speed, and executive function. Large-scale investigations are needed to replicate these results.

Decoding Reach Direction in Early "Visual" Cortex of Congenitally Blind Individuals

Motor actions, such as reaching or grasping, can be decoded from fMRI activity of early visual cortex (EVC) in sighted humans. This effect can depend on vision or visual imagery, or alternatively, could be driven by mechanisms independent of visual experience. Here, we show that the actions of reaching in different directions can be reliably decoded from fMRI activity of EVC in congenitally blind humans (both sexes). Thus, neither visual experience nor visual imagery is necessary for EVC to represent action-related information. We also demonstrate that, within EVC of blind humans, the accuracy of reach direction decoding is highest in areas typically representing foveal vision and gradually decreases in areas typically representing peripheral vision. We propose that this might indicate the existence of a predictive, hard-wired mechanism of aligning action and visual spaces. This mechanism might send action-related information primarily to the high-resolution foveal visual areas, which are critical for guiding and online correction of motor actions. Finally, we show that, beyond EVC, the decoding of reach direction in blind humans is most accurate in dorsal stream areas known to be critical for visuo-spatial and visuo-motor integration in the sighted. Thus, these areas can develop space and action representations even in the lifelong absence of vision. Overall, our findings in congenitally blind humans match previous research on the action system in the sighted, and suggest that the development of action representations in the human brain might be largely independent of visual experience.SIGNIFICANCE STATEMENT Early visual cortex (EVC) was traditionally thought to process only visual signals from the retina. Recent studies proved this account incomplete, and showed EVC involvement in many activities not directly related to incoming visual information, such as memory, sound, or action processing. Is EVC involved in these activities because of visual imagery? Here, we show robust reach direction representation in EVC of humans born blind. This demonstrates that EVC can represent actions independently of vision and visual imagery. Beyond EVC, we found that reach direction representation in blind humans is strongest in dorsal brain areas, critical for action processing in the sighted. This suggests that the development of action representations in the human brain is largely independent of visual experience.

Temporal hierarchy of observed goal-directed actions

During social interactions, we continuously integrate current and previous information over varying timescales to infer other people's action intentions. Motor cognition theories argue for a hierarchical organization of goal-directed actions based on temporal scales. Accordingly, transient motor primitives are represented at lower levels of the hierarchy, a combination of primitives building motor sequences at subordinate levels, and more stable overarching action goals at superordinate levels. A neural topography of hierarchal timescales for information accumulation was previously shown in the visual and auditory domains. However, whether such a temporal hierarchy can also account for observed goal-directed action representations in motor pathways remains to be determined. Thus, the current study examined the neural architecture underlying the processing of observed goal-directed actions using inter-subject correlation (ISC) of fMRI activity. Observers (n = 24) viewed sequential hand movements presented in their intact order or piecewise scrambled at three timescales pertaining to goal-directed action evolution (Primitives: ± 1.5 s, Sub-Goals: ± 4 s, and High-Goals: ± 10 s). The results revealed differential intrinsic temporal capacities for integrating goal-directed action information across brain areas engaged in action observation. Longer timescales (> ± 10 s) were found in the posterior parietal and dorsal premotor compared to the ventral premotor (± 4 s) and anterior parietal (± 1.5 s) cortex. Moreover, our results revealed a hemispheric bias with more extended timescales in the right MT+, primary somatosensory, and early visual cortices compared to their homotopic regions in the left hemisphere. Our findings corroborate a hierarchical neural mapping of observed actions based on temporal scales of goals and provide further support for a ubiquitous time-dependent neural organization of information processing across multiple modalities.

Learning heterogeneous delays in a layer of spiking neurons for fast motion detection

The precise timing of spikes emitted by neurons plays a crucial role in shaping the response of efferent biological neurons. This temporal dimension of neural activity holds significant importance in understanding information processing in neurobiology, especially for the performance of neuromorphic hardware, such as event-based cameras. Nonetheless, many artificial neural models disregard this critical temporal dimension of neural activity. In this study, we present a model designed to efficiently detect temporal spiking motifs using a layer of spiking neurons equipped with heterogeneous synaptic delays. Our model capitalizes on the diverse synaptic delays present on the dendritic tree, enabling specific arrangements of temporally precise synaptic inputs to synchronize upon reaching the basal dendritic tree. We formalize this process as a time-invariant logistic regression, which can be trained using labeled data. To demonstrate its practical efficacy, we apply the model to naturalistic videos transformed into event streams, simulating the output of the biological retina or event-based cameras. To evaluate the robustness of the model in detecting visual motion, we conduct experiments by selectively pruning weights and demonstrate that the model remains efficient even under significantly reduced workloads. In conclusion, by providing a comprehensive, event-driven computational building block, the incorporation of heterogeneous delays has the potential to greatly improve the performance of future spiking neural network algorithms, particularly in the context of neuromorphic chips.

Feedforward attentional selection in sensory cortex

Salient objects grab attention because they stand out from their surroundings. Whether this phenomenon is accomplished by bottom-up sensory processing or requires top-down guidance is debated. We tested these alternative hypotheses by measuring how early and in which cortical layer(s) neural spiking distinguished a target from a distractor. We measured synaptic and spiking activity across cortical columns in mid-level area V4 of male macaque monkeys performing visual search for a color singleton. A neural signature of attentional capture was observed in the earliest response in the input layer 4. The magnitude of this response predicted response time and accuracy. Errant behavior followed errant selection. Because this response preceded top-down influences and arose in the cortical layer not targeted by top-down connections, these findings demonstrate that feedforward activation of sensory cortex can underlie attentional priority.

The representation of occluded image regions in area V1 of monkeys and humans

Neuronal activity in the primary visual cortex (V1) is driven by feedforward input from within the neurons' receptive fields (RFs) and modulated by contextual information in regions surrounding the RF. The effect of contextual information on spiking activity occurs rapidly and is therefore challenging to dissociate from feedforward input. To address this challenge, we recorded the spiking activity of V1 neurons in monkeys viewing either natural scenes or scenes where the information in the RF was occluded, effectively removing the feedforward input. We found that V1 neurons responded rapidly and selectively to occluded scenes. V1 responses elicited by occluded stimuli could be used to decode individual scenes and could be predicted from those elicited by non-occluded images, indicating that there is an overlap between visually driven and contextual responses. We used representational similarity analysis to show that the structure of V1 representations of occluded scenes measured with electrophysiology in monkeys correlates strongly with the representations of the same scenes in humans measured with functional magnetic resonance imaging (fMRI). Our results reveal that contextual influences rapidly alter V1 spiking activity in monkeys over distances of several degrees in the visual field, carry information about individual scenes, and resemble those in human V1. VIDEO ABSTRACT.

Different levels of visuospatial abilities linked to differential brain correlates underlying visual mental segmentation processes in autism

The neural underpinnings of enhanced locally oriented visual processing that are specific to autistics with a Wechsler's Block Design (BD) peak are largely unknown. Here, we investigated the brain correlates underlying visual segmentation associated with the well-established autistic superior visuospatial abilities in distinct subgroups using functional magnetic resonance imaging. This study included 31 male autistic adults (15 with (AUTp) and 16 without (AUTnp) a BD peak) and 28 male adults with typical development (TYP). Participants completed a computerized adapted BD task with models having low and high perceptual cohesiveness (PC). Despite similar behavioral performances, AUTp and AUTnp showed generally higher occipital activation compared with TYP participants. Compared with both AUTnp and TYP participants, the AUTp group showed enhanced task-related functional connectivity within posterior visuoperceptual regions and decreased functional connectivity between frontal and occipital-temporal regions. A diminished modulation in frontal and parietal regions in response to increased PC was also found in AUTp participants, suggesting heavier reliance on low-level processing of global figures. This study demonstrates that enhanced visual functioning is specific to a cognitive phenotypic subgroup of autistics with superior visuospatial abilities and reinforces the need to address autistic heterogeneity by good cognitive characterization of samples in future studies.

Targeted visual cortex stimulation (TVCS): a novel neuro-navigated repetitive transcranial magnetic stimulation mode for improving cognitive function in bipolar disorder

A more effective and better-tolerated site for repetitive transcranial magnetic stimulation (rTMS) for treating cognitive dysfunction in patients with bipolar disorder (BD) is needed. The primary visual cortex (V1) may represent a suitable site. To investigate the use of the V1, which is functionally linked to the dorsolateral prefrontal cortex (DLPFC) and anterior cingulate cortex (ACC), as a potential site for improving cognitive function in BD. Seed-based functional connectivity (FC) analysis was used to locate targets in the V1 that had significant FC with the DLPFC and ACC. Subjects were randomly assigned to 4 groups, namely, the DLPFC active-sham rTMS (A1), DLPFC sham-active rTMS (A2), ACC active-sham rTMS (B1), and ACC sham-active rTMS groups (B2). The intervention included the rTMS treatment once daily, with five treatments a week for four weeks. The A1 and B1 groups received 10 days of active rTMS treatment followed by 10 days of sham rTMS treatment. The A2 and B2 groups received the opposite. The primary outcomes were changes in the scores of five tests in the THINC-integrated tool (THINC-it) at week 2 (W2) and week 4 (W4). The secondary outcomes were changes in the FC between the DLPFC/ACC and the whole brain at W2 and W4. Of the original 93 patients with BD recruited, 86 were finally included, and 73 finished the trial. Significant interactions between time and intervention type (Active/Sham) were observed in the scores of the accuracy of the Symbol Check in the THINC-it tests at baseline (W0) and W2 in groups B1 and B2 (F = 4.736, p = 0.037) using a repeated-measures analysis of covariance approach. Group B1 scored higher in the accuracy of Symbol Check at W2 compared with W0 (p < 0.001), while the scores of group B2 did not differ significantly between W0 and W2. No significant interactions between time and intervention mode were seen between groups A1 and A2, nor was any within-group significance of FC between DLPFC/ACC and the whole brain observed between baseline (W0) and W2/W4 in any group. One participant in group B1 experienced disease progression after 10 active and 2 sham rTMS sessions. The present study demonstrated that V1, functionally correlated with ACC, is a potentially effective rTMS stimulation target for improving neurocognitive function in BD patients. Further investigation using larger samples is required to confirm the clinical efficacy of TVCS.

The lack of temporal brain dynamics asymmetry as a signature of impaired consciousness states

Life is a constant battle against equilibrium. From the cellular level to the macroscopic scale, living organisms as dissipative systems require the violation of their detailed balance, i.e. metabolic enzymatic reactions, in order to survive. We present a framework based on temporal asymmetry as a measure of non-equilibrium. By means of statistical physics, it was discovered that temporal asymmetries establish an arrow of time useful for assessing the reversibility in human brain time series. Previous studies in human and non-human primates have shown that decreased consciousness states such as sleep and anaesthesia result in brain dynamics closer to the equilibrium. Furthermore, there is growing interest in the analysis of brain symmetry based on neuroimaging recordings and since it is a non-invasive technique, it can be extended to different brain imaging modalities and applied at different temporo-spatial scales. In the present study, we provide a detailed description of our methodological approach, paying special attention to the theories that motivated this work. We test, for the first time, the reversibility analysis in human functional magnetic resonance imaging data in patients suffering from disorder of consciousness. We verify that the tendency of a decrease in the asymmetry of the brain signal together with the decrease in non-stationarity are key characteristics of impaired consciousness states. We expect that this work will open the way for assessing biomarkers for patients' improvement and classification, as well as motivating further research on the mechanistic understanding underlying states of impaired consciousness.

Faster bi-stable visual switching in psychosis

Bi-stable stimuli evoke two distinct perceptual interpretations that alternate and compete for dominance. Bi-stable perception is thought to be driven at least in part by mutual suppression between distinct neural populations that represent each percept. Abnormal visual perception is observed among people with psychotic psychopathology (PwPP), and there is evidence to suggest that these visual deficits may depend on impaired neural suppression in visual cortex. However, it is not yet clear whether bi-stable visual perception is abnormal among PwPP. Here, we examined bi-stable perception in a visual structure-from-motion task using a rotating cylinder illusion in a group of 65 PwPP, 44 first-degree biological relatives, and 43 healthy controls. Data from a 'real switch' task, in which physical depth cues signaled real switches in rotation direction were used to exclude individuals who did not show adequate task performance. In addition, we measured concentrations of neurochemicals, including glutamate, glutamine, and γ-amino butyric acid (GABA), involved in excitatory and inhibitory neurotransmission. These neurochemicals were measured non-invasively in visual cortex using 7 tesla MR spectroscopy. We found that PwPP and their relatives showed faster bi-stable switch rates than healthy controls. Faster switch rates also correlated with significantly higher psychiatric symptom levels across all participants. However, we did not observe any significant relationships across individuals between neurochemical concentrations and SFM switch rates. Our results are consistent with a reduction in suppressive neural processes during structure-from-motion perception in PwPP, and suggest that genetic liability for psychosis is associated with disrupted bi-stable perception.

Engaging in word recognition elicits highly specific modulations in visual cortex

A person's cognitive state determines how their brain responds to visual stimuli. The most common such effect is a response enhancement when stimuli are task relevant and attended rather than ignored. In this fMRI study, we report a surprising twist on such attention effects in the visual word form area (VWFA), a region that plays a key role in reading. We presented participants with strings of letters and visually similar shapes, which were either relevant for a specific task (lexical decision or gap localization) or ignored (during a fixation dot color task). In the VWFA, the enhancement of responses to attended stimuli occurred only for letter strings, whereas non-letter shapes evoked smaller responses when attended than when ignored. The enhancement of VWFA activity was accompanied by strengthened functional connectivity with higher-level language regions. These task-dependent modulations of response magnitude and functional connectivity were specific to the VWFA and absent in the rest of visual cortex. We suggest that language regions send targeted excitatory feedback into the VWFA only when the observer is trying to read. This feedback enables the discrimination of familiar and nonsense words and is distinct from generic effects of visual attention.

Solving the binding problem: Assemblies form when neurons enhance their firing rate-they don't need to oscillate or synchronize

When we look at an image, its features are represented in our visual system in a highly distributed manner, calling for a mechanism that binds them into coherent object representations. There have been different proposals for the neuronal mechanisms that can mediate binding. One hypothesis is that binding is achieved by oscillations that synchronize neurons representing features of the same perceptual object. This view allows separate communication channels between different brain areas. Another hypothesis is that binding of features that are represented in different brain regions occurs when the neurons in these areas that respond to the same object simultaneously enhance their firing rate, which would correspond to directing object-based attention to these features. This review summarizes evidence in favor of and against these two hypotheses, examining the neuronal correlates of binding and assessing the time course of perceptual grouping. I conclude that enhanced neuronal firing rates bind features into coherent object representations, whereas oscillations and synchrony are unrelated to binding.

Distributed context-dependent choice information in mouse posterior cortex

Choice information appears in multi-area brain networks mixed with sensory, motor, and cognitive variables. In the posterior cortex-traditionally implicated in decision computations-the presence, strength, and area specificity of choice signals are highly variable, limiting a cohesive understanding of their computational significance. Examining the mesoscale activity in the mouse posterior cortex during a visual task, we found that choice signals defined a decision variable in a low-dimensional embedding space with a prominent contribution along the ventral visual stream. Their subspace was near-orthogonal to concurrently represented sensory and motor-related activations, with modulations by task difficulty and by the animals' attention state. A recurrent neural network trained with animals' choices revealed an equivalent decision variable whose context-dependent dynamics agreed with that of the neural data. Our results demonstrated an independent, multi-area decision variable in the posterior cortex, controlled by task features and cognitive demands, possibly linked to contextual inference computations in dynamic animal-environment interactions.

A blinking focal pattern of re-entrant activity in the avian tectum

Re-entrant connections are inherent to nervous system organization; however, a comprehensive understanding of their operation is still lacking. In birds, topographically organized re-entrant signals, carried by axons from the nucleus-isthmi-parvocellularis (Ipc), are distinctly recorded as bursting discharges across the optic tectum (TeO). Here, we used up to 48 microelectrodes regularly spaced on the superficial tectal layers of anesthetized pigeons to characterize the spatial-temporal pattern of this axonal re-entrant activity in response to different visual stimulation. We found that a brief luminous spot triggered repetitive waves of bursting discharges that, appearing from initial sources, propagated horizontally to areas representing up to 28° of visual space, widely exceeding the area activated by the retinal fibers. In response to visual motion, successive burst waves started along and around the stimulated tectal path, tracking the stimulus in discontinuous steps. When two stimuli were presented, the burst-wave sources alternated between the activated tectal loci, as if only one source could be active at any given time. Because these re-entrant signals boost the retinal input to higher visual areas, their peculiar dynamics mimic a blinking "spotlight," similar to the internal searching mechanism classically used to explain spatial attention. Tectal re-entry from Ipc is thus highly structured and intrinsically discontinuous, and higher tectofugal areas, which lack retinotopic organization, will thus receive incoming visual activity in a sequential and piecemeal fashion. We anticipate that analogous re-entrant patterns, perhaps hidden in less bi-dimensionally organized topographies, may organize the flow of neural activity in other parts of the brain as well.

Cerebral blood flow changes and their genetic mechanisms in major depressive disorder: a combined neuroimaging and transcriptome study

BACKGROUND

Extensive research has shown abnormal cerebral blood flow (CBF) in patients with major depressive disorder (MDD) that is a heritable disease. The objective of this study was to investigate the genetic mechanisms of CBF abnormalities in MDD.

METHODS

To achieve a more thorough characterization of CBF changes in MDD, we performed a comprehensive neuroimaging meta-analysis of previous literature as well as examined group CBF differences in an independent sample of 133 MDD patients and 133 controls. In combination with the Allen Human Brain Atlas, transcriptome-neuroimaging spatial association analyses were conducted to identify genes whose expression correlated with CBF changes in MDD, followed by a set of gene functional feature analyses.

RESULTS

We found increased CBF in the reward circuitry and default-mode network and decreased CBF in the visual system in MDD patients. Moreover, these CBF changes were spatially associated with expression of 1532 genes, which were enriched for important molecular functions, biological processes, and cellular components of the cerebral cortex as well as several common mental disorders. Concurrently, these genes were specifically expressed in the brain tissue, in immune cells and neurons, and during nearly all developmental stages. Regarding behavioral relevance, these genes were associated with domains involving emotion and sensation. In addition, these genes could construct a protein-protein interaction network supported by 60 putative hub genes with functional significance.

CONCLUSIONS

Our findings suggest a cerebral perfusion redistribution in MDD, which may be a consequence of complex interactions of a wide range of genes with diverse functional features.

Calibrating Vision: Concepts and Questions

The idea that visual coding and perception are shaped by experience and adjust to changes in the environment or the observer is universally recognized as a cornerstone of visual processing, yet the functions and processes mediating these calibrations remain in many ways poorly understood. In this article we review a number of facets and issues surrounding the general notion of calibration, with a focus on plasticity within the encoding and representational stages of visual processing. These include how many types of calibrations there are - and how we decide; how plasticity for encoding is intertwined with other principles of sensory coding; how it is instantiated at the level of the dynamic networks mediating vision; how it varies with development or between individuals; and the factors that may limit the form or degree of the adjustments. Our goal is to give a small glimpse of an enormous and fundamental dimension of vision, and to point to some of the unresolved questions in our understanding of how and why ongoing calibrations are a pervasive and essential element of vision.

Multisensory representations of space and time in sensory cortices

Clear evidence demonstrated a supramodal organization of sensory cortices with multisensory processing occurring even at early stages of information encoding. Within this context, early recruitment of sensory areas is necessary for the development of fine domain-specific (i.e., spatial or temporal) skills regardless of the sensory modality involved, with auditory areas playing a crucial role in temporal processing and visual areas in spatial processing. Given the domain-specificity and the multisensory nature of sensory areas, in this study, we hypothesized that preferential domains of representation (i.e., space and time) of visual and auditory cortices are also evident in the early processing of multisensory information. Thus, we measured the event-related potential (ERP) responses of 16 participants while performing multisensory spatial and temporal bisection tasks. Audiovisual stimuli occurred at three different spatial positions and time lags and participants had to evaluate whether the second stimulus was spatially (spatial bisection task) or temporally (temporal bisection task) farther from the first or third audiovisual stimulus. As predicted, the second audiovisual stimulus of both spatial and temporal bisection tasks elicited an early ERP response (time window 50-90 ms) in visual and auditory regions. However, this early ERP component was more substantial in the occipital areas during the spatial bisection task, and in the temporal regions during the temporal bisection task. Overall, these results confirmed the domain specificity of visual and auditory cortices and revealed that this aspect selectively modulates also the cortical activity in response to multisensory stimuli.

Foveal vision anticipates defining features of eye movement targets

High-acuity foveal processing is vital for human vision. Nonetheless, little is known about how the preparation of large-scale rapid eye movements (saccades) affects visual sensitivity in the center of gaze. Based on findings from passive fixation tasks, we hypothesized that during saccade preparation, foveal processing anticipates soon-to-be fixated visual features. Using a dynamic large-field noise paradigm, we indeed demonstrate that defining features of an eye movement target are enhanced in the pre-saccadic center of gaze. Enhancement manifested as higher Hit Rates for foveal probes with target-congruent orientation and a sensitization to incidental, target-like orientation information in foveally presented noise. Enhancement was spatially confined to the center of gaze and its immediate vicinity, even after parafoveal task performance had been raised to a foveal level. Moreover, foveal enhancement during saccade preparation was more pronounced and developed faster than enhancement during passive fixation. Based on these findings, we suggest a crucial contribution of foveal processing to trans-saccadic visual continuity: Foveal processing of saccade targets commences before the movement is executed and thereby enables a seamless transition once the center of gaze reaches the target.

Statistical Learning in Vision

Vision and learning have long been considered to be two areas of research linked only distantly. However, recent developments in vision research have changed the conceptual definition of vision from a signal-evaluating process to a goal-oriented interpreting process, and this shift binds learning, together with the resulting internal representations, intimately to vision. In this review, we consider various types of learning (perceptual, statistical, and rule/abstract) associated with vision in the past decades and argue that they represent differently specialized versions of the fundamental learning process, which must be captured in its entirety when applied to complex visual processes. We show why the generalized version of statistical learning can provide the appropriate setup for such a unified treatment of learning in vision, what computational framework best accommodates this kind of statistical learning, and what plausible neural scheme could feasibly implement this framework. Finally, we list the challenges that the field of statistical learning faces in fulfilling the promise of being the right vehicle for advancing our understanding of vision in its entirety. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Flexible recoding of visual input for memory storage

Working memory enables us to maintain relevant past information for future behavior. In this issue of Neuron, Kwak and Curtis (2022) demonstrate that early visual areas do not simply maintain but flexibly recode sensory percepts into mnemonic codes containing goal-relevant information.

A multi-scale neurodynamic implementation of incremental grouping

Incremental grouping is a process entailing serial binding of distal image elements into a unified object representation. At the neural level, incremental grouping involves propagation of the enhanced firing rate among feature-tuned neurons in the early visual cortex. Here, we developed a multi-resolution neural model of incremental grouping. In the model, propagation of the enhanced firing rate is achieved by computing the activity difference between two sets of units: attentional or A-units, whose firing rate is modulated by their horizontal collaterals, and non-attentional or N-units that receive only feedforward input. The activity difference is computed on dendrites that act as independent computational subunits. The proposed model employs multiple spatial scales to account for a variable speed of incremental grouping. In addition, the model incorporates the L-junction detection network that enables incremental grouping over L-junctions. Computer simulations show that the timing of attentional modulations in the model is comparable with neurophysiological measurements in monkey primary visual cortex.

Unveiling the abstract format of mnemonic representations

Working memory (WM) enables information storage for future use, bridging the gap between perception and behavior. We hypothesize that WM representations are abstractions of low-level perceptual features. However, the neural nature of these putative abstract representations has thus far remained impenetrable. Here, we demonstrate that distinct visual stimuli (oriented gratings and moving dots) are flexibly recoded into the same WM format in visual and parietal cortices when that representation is useful for memory-guided behavior. Specifically, the behaviorally relevant features of the stimuli (orientation and direction) were extracted and recoded into a shared mnemonic format that takes the form of an abstract line-like pattern. We conclude that mnemonic representations are abstractions of percepts that are more efficient than and proximal to the behaviors they guide.

Processing time affects sequential memory performance beginning at the level of visual encoding

Electrophysiological studies have demonstrated that theta-band activity is useful for investigating neural mechanisms of memory. However, mechanisms specifically driving memory performance remain poorly understood. In sequential memory, performance can be artificially attenuated by shortening the inter-stimulus interval (ISI) between memory item presentations. Therefore, we sought to clarify the mechanisms of sequential memory performance by analyzing theta-band (4–8 Hz) activity recorded via magnetoencephalogram in 33 participants during performance of a sequential memory task where memory items were presented at either slow or fast rates in accordance with longer or shorter ISIs, respectively. Particularly in the slow task, theta activity clearly modulated in accordance with the presentation of memory items. Common cortical target regions in the occipital and frontal cortex were identified in both tasks and related to visual encoding and memory maintenance, respectively. Compared to the slow task, occipital-theta activity was significantly lower in the fast task from the midterm until the ending of encoding, in correspondence with significantly lower recall for memory items in this same period. Meanwhile, despite a loss of clarity in responsiveness to individual memory items in the fast task, frontal-theta activity was not different between tasks and exhibited particularly strong responses in both tasks during the holding period prior to recall. Our results indicate that shorter processing time erodes sequential memory performance beginning at the level of visual encoding.

Robust effects of corticothalamic feedback and behavioral state on movie responses in mouse dLGN

Neurons in the dorsolateral geniculate nucleus (dLGN) of the thalamus receive a substantial proportion of modulatory inputs from corticothalamic (CT) feedback and brain stem nuclei. Hypothesizing that these modulatory influences might be differentially engaged depending on the visual stimulus and behavioral state, we performed in vivo extracellular recordings from mouse dLGN while optogenetically suppressing CT feedback and monitoring behavioral state by locomotion and pupil dilation. For naturalistic movie clips, we found CT feedback to consistently increase dLGN response gain and promote tonic firing. In contrast, for gratings, CT feedback effects on firing rates were mixed. For both stimulus types, the neural signatures of CT feedback closely resembled those of behavioral state, yet effects of behavioral state on responses to movies persisted even when CT feedback was suppressed. We conclude that CT feedback modulates visual information on its way to cortex in a stimulus-dependent manner, but largely independently of behavioral state.

EXPRESS: Is Implicit Level-2 Visual perspective taking embodied? Spontaneous perceptual simulation of others' perspectives is not impaired by motor restriction

Visual perspective taking may rely on the ability to mentally rotate one's own body into that of another. Here we test whether participants' ability to make active body movements plays a causal role in visual perspective taking. We utilized our recent task that measures whether participants spontaneously represent another's visual perspective in a (quasi-)perceptual format that can drive own perceptual decision making. Participants reported whether alphanumeric characters, presented in different orientations, are shown in their normal or mirror-inverted form (e.g., "R" vs. "Я"). Between trials, we manipulated whether another person was sitting either left or right of the character and whether participants' movement was restricted with a chin rest or they could move freely. As in our previous research, participants spontaneously took the visual perspective of the other person, recognizing rotated letters more rapidly when they appeared upright to the other person in the scene, compared to when they faced away from that person, and these effects increased with age but were (weakly) negatively related to Schizotypy and not to autistic traits or social skills. Restricting participants' ability to make active body movements did not influence these effects. The results therefore rule out that active physical movement plays a causal role in computing another's visual perspective, either to create alignment between own and other's perspective or to trigger perspective-taking processes. The postural adjustments people sometimes make when making judgements from another's perspective may instead be a bodily consequence of mentally transforming one's actual to an imagined position in space.

Multi-Scale Memetic Image Registration

Many technological applications of our time rely on images captured by multiple cameras. Such applications include the detection and recognition of objects in captured images, the tracking of objects and analysis of their motion, and the detection of changes in appearance. The alignment of images captured at different times and/or from different angles is a key processing step in these applications. One of the most challenging tasks is to develop fast algorithms to accurately align images perturbed by various types of transformations. The paper reports a new method used to register images in the case of geometric perturbations that include rotations, translations, and non-uniform scaling. The input images can be monochrome or colored, and they are preprocessed by a noise-insensitive edge detector to obtain binarized versions. Isotropic scaling transformations are used to compute multi-scale representations of the binarized inputs. The algorithm is of memetic type and exploits the fact that the computation carried out in reduced representations usually produces promising initial solutions very fast. The proposed method combines bio-inspired and evolutionary computation techniques with clustered search and implements a procedure specially tailored to address the premature convergence issue in various scaled representations. A long series of tests on perturbed images were performed, evidencing the efficiency of our memetic multi-scale approach. In addition, a comparative analysis has proved that the proposed algorithm outperforms some well-known registration procedures both in terms of accuracy and runtime.

Transcranial direct current stimulation of the occipital lobes with adjunct lithium attenuates the progression of cognitive impairment in patients with first episode schizophrenia

BACKGROUND

There is no standard effective treatment for schizophrenia-associated cognitive impairment. Efforts to use non-invasive brain stimulation for this purpose have been focused mostly on the frontal cortex, with little attention being given to the occipital lobe.

MATERIALS AND METHODS

We compared the effects of nine intervention strategies on cognitive performance in psychometric measures and brain connectivity measured obtained from functional magnetic resonance imaging analyses. The strategies consisted of transcranial direct current stimulation (t-DCS) or repetitive transcranial magnetic stimulation (r-TMS) of the frontal lobe or of the occipital alone or with adjunct lithium, or lithium monotherapy. We measured global functional connectivity density (gFCD) voxel-wise.

RESULTS

Although all nine patient groups showed significant improvements in global disability scores (GDSs) following the intervention period (vs. before), the greatest improvement in GDS was observed for the group that received occipital lobe-targeted t-DCS with adjunct lithium therapy. tDCS of the occipital lobe improved gFCD throughout the brain, including in the frontal lobes, whereas stimulation of the frontal lobes had less far-reaching benefits on gFCD in the brain. Adverse secondary effects (ASEs) such as heading, dizziness, and nausea, were commonly experienced by patients treated with t-DCS and r-TMS, with or without lithium, whereas ASEs were rare with lithium alone.

CONCLUSION

The most effective treatment strategy for impacting cognitive impairment and brain communication was t-DCS stimulation of the occipital lobe with adjunct lithium therapy, though patients often experienced headache with dizziness and nausea after treatment sessions.

Cognitive function mediates the relationship between visual contrast sensitivity and functional outcome in schizophrenia

BACKGROUND

Individuals with schizophrenia exhibit deficits in visual contrast processing, though less is known about how these deficits impact neurocognition and functional outcomes. This study investigated effects of contrast sensitivity (CS) on cognition and capacity for independent living in schizophrenia.

METHODS

Participants were 58 patients with schizophrenia (n = 49) and schizoaffective disorder (n = 9). Patients completed a psychophysical paradigm to obtain CS with stimuli consisting of grating patterns of low (0.5 and 1 cycles/degree) and high spatial frequencies (4, 7, 21 cycles/degree). Patients completed the MATRICS Consensus Cognitive Battery and Wechsler Adult Intelligence Scales, Third Edition to assess cognition, and the problem-solving factor of the Independent Living Scales to assess functional capacity. We computed bivariate correlation coefficients for all pairs of variables and tested mediation models with CS to low (CS-LSF) and high spatial frequencies (CS-HSF) as predictors, cognitive measures as mediators, and capacity for independent living as an outcome.

RESULTS

Cognition mediated the relationship between CS and independent living with CS-LSF a stronger predictor than CS-HSF. Mediation effects were strongest for perceptual organization and memory-related domains. In an expanded moderated mediation model, CS-HSF was found to be a significant predictor of independent living through perceptual organization as a mediator and CS-LSF as a moderator of this relationship.

CONCLUSION

CS relates to functional capacity in schizophrenia through neurocognition. These relationships may inform novel visual remediation interventions.

Genetic Architecture Underlying Differential Resting-state Functional Connectivity of Subregions Within the Human Visual Cortex

The human visual cortex is a heterogeneous entity that has multiple subregions showing substantial variability in their functions and connections. We aimed to identify genes associated with resting-state functional connectivity (rsFC) of visual subregions using transcriptome-neuroimaging spatial correlations in discovery and validation datasets. Results showed that rsFC of eight visual subregions were associated with expression measures of eight gene sets, which were specifically expressed in brain tissue and showed the strongest correlations with visual behavioral processes. Moreover, there was a significant divergence in these gene sets and their functional features between medial and lateral visual subregions. Relative to those associated with lateral subregions, more genes associated with medial subregions were found to be enriched for neuropsychiatric diseases and more diverse biological functions and pathways, and to be specifically expressed in multiple types of neurons and immune cells and during the middle and late stages of cortical development. In addition to shared behavioral processes, lateral subregion associated genes were uniquely correlated with high-order cognition. These findings of commonalities and differences in the identified rsFC-related genes and their functional features across visual subregions may improve our understanding of the functional heterogeneity of the visual cortex from the perspective of underlying genetic architecture.

Perceived and mentally rotated contents are differentially represented in cortical depth of V1

Primary visual cortex (V1) in humans is known to represent both veridically perceived external input and internally-generated contents underlying imagery and mental rotation. However, it is unknown how the brain keeps these contents separate thus avoiding a mixture of the perceived and the imagined which could lead to potentially detrimental consequences. Inspired by neuroanatomical studies showing that feedforward and feedback connections in V1 terminate in different cortical layers, we hypothesized that this anatomical compartmentalization underlies functional segregation of external and internally-generated visual contents, respectively. We used high-resolution layer-specific fMRI to test this hypothesis in a mental rotation task. We found that rotated contents were predominant at outer cortical depth bins (i.e. superficial and deep). At the same time perceived contents were represented stronger at the middle cortical bin. These results identify how through cortical depth compartmentalization V1 functionally segregates rather than confuses external from internally-generated visual contents. These results indicate that feedforward and feedback manifest in distinct subdivisions of the early visual cortex, thereby reflecting a general strategy for implementing multiple cognitive functions within a single brain region.

Decision-related feedback in visual cortex lacks spatial selectivity

Feedback in the brain is thought to convey contextual information that underlies our flexibility to perform different tasks. Empirical and computational work on the visual system suggests this is achieved by targeting task-relevant neuronal subpopulations. We combine two tasks, each resulting in selective modulation by feedback, to test whether the feedback reflected the combination of both selectivities. We used visual feature-discrimination specified at one of two possible locations and uncoupled the decision formation from motor plans to report it, while recording in macaque mid-level visual areas. Here we show that although the behavior is spatially selective, using only task-relevant information, modulation by decision-related feedback is spatially unselective. Population responses reveal similar stimulus-choice alignments irrespective of stimulus relevance. The results suggest a common mechanism across tasks, independent of the spatial selectivity these tasks demand. This may reflect biological constraints and facilitate generalization across tasks. Our findings also support a previously hypothesized link between feature-based attention and decision-related activity.

Feedback modulates visual neurons, thought to help achieve flexible task performance. Here, the authors show decision-related feedback is not only relayed to task-relevant neurons, suggesting a broader mechanism and supporting a previously hypothesized link to feature-based attention.

A self-supervised deep neural network for image completion resembles early visual cortex fMRI activity patterns for occluded scenes

The promise of artificial intelligence in understanding biological vision relies on the comparison of computational models with brain data with the goal of capturing functional principles of visual information processing. Convolutional neural networks (CNN) have successfully matched the transformations in hierarchical processing occurring along the brain's feedforward visual pathway, extending into ventral temporal cortex. However, we are still to learn if CNNs can successfully describe feedback processes in early visual cortex. Here, we investigated similarities between human early visual cortex and a CNN with encoder/decoder architecture, trained with self-supervised learning to fill occlusions and reconstruct an unseen image. Using representational similarity analysis (RSA), we compared 3T functional magnetic resonance imaging (fMRI) data from a nonstimulated patch of early visual cortex in human participants viewing partially occluded images, with the different CNN layer activations from the same images. Results show that our self-supervised image-completion network outperforms a classical object-recognition supervised network (VGG16) in terms of similarity to fMRI data. This work provides additional evidence that optimal models of the visual system might come from less feedforward architectures trained with less supervision. We also find that CNN decoder pathway activations are more similar to brain processing compared to encoder activations, suggesting an integration of mid- and low/middle-level features in early visual cortex. Challenging an artificial intelligence model to learn natural image representations via self-supervised learning and comparing them with brain data can help us to constrain our understanding of information processing, such as neuronal predictive coding.

Abstraction and analogy-making in artificial intelligence

Conceptual abstraction and analogy-making are key abilities underlying humans' abilities to learn, reason, and robustly adapt their knowledge to new domains. Despite a long history of research on constructing artificial intelligence (AI) systems with these abilities, no current AI system is anywhere close to a capability of forming humanlike abstractions or analogies. This paper reviews the advantages and limitations of several approaches toward this goal, including symbolic methods, deep learning, and probabilistic program induction. The paper concludes with several proposals for designing challenge tasks and evaluation measures in order to make quantifiable and generalizable progress in this area.

The essential role of recurrent processing for figure-ground perception in mice

The segregation of figures from the background is an important step in visual perception. In primary visual cortex, figures evoke stronger activity than backgrounds during a delayed phase of the neuronal responses, but it is unknown how this figure-ground modulation (FGM) arises and whether it is necessary for perception. Here, we show, using optogenetic silencing in mice, that the delayed V1 response phase is necessary for figure-ground segregation. Neurons in higher visual areas also exhibit FGM and optogenetic silencing of higher areas reduced FGM in V1. In V1, figures elicited higher activity of vasoactive intestinal peptide-expressing (VIP) interneurons than the background, whereas figures suppressed somatostatin-positive interneurons, resulting in an increased activation of pyramidal cells. Optogenetic silencing of VIP neurons reduced FGM in V1, indicating that disinhibitory circuits contribute to FGM. Our results provide insight into how lower and higher areas of the visual cortex interact to shape visual perception.

The Role of Unimodal Feedback Pathways in Gender Perception During Activation of Voice and Face Areas

Cross-modal effects provide a model framework for investigating hierarchical inter-areal processing, particularly, under conditions where unimodal cortical areas receive contextual feedback from other modalities. Here, using complementary behavioral and brain imaging techniques, we investigated the functional networks participating in face and voice processing during gender perception, a high-level feature of voice and face perception. Within the framework of a signal detection decision model, Maximum likelihood conjoint measurement (MLCM) was used to estimate the contributions of the face and voice to gender comparisons between pairs of audio-visual stimuli in which the face and voice were independently modulated. Top–down contributions were varied by instructing participants to make judgments based on the gender of either the face, the voice or both modalities (N = 12 for each task). Estimated face and voice contributions to the judgments of the stimulus pairs were not independent; both contributed to all tasks, but their respective weights varied over a 40-fold range due to top–down influences. Models that best described the modal contributions required the inclusion of two different top–down interactions: (i) an interaction that depended on gender congruence across modalities (i.e., difference between face and voice modalities for each stimulus); (ii) an interaction that depended on the within modalities’ gender magnitude. The significance of these interactions was task dependent. Specifically, gender congruence interaction was significant for the face and voice tasks while the gender magnitude interaction was significant for the face and stimulus tasks. Subsequently, we used the same stimuli and related tasks in a functional magnetic resonance imaging (fMRI) paradigm (N = 12) to explore the neural correlates of these perceptual processes, analyzed with Dynamic Causal Modeling (DCM) and Bayesian Model Selection. Results revealed changes in effective connectivity between the unimodal Fusiform Face Area (FFA) and Temporal Voice Area (TVA) in a fashion that paralleled the face and voice behavioral interactions observed in the psychophysical data. These findings explore the role in perception of multiple unimodal parallel feedback pathways.

The Neural Codes Underlying Internally Generated Representations in Visual Working Memory

Humans can construct rich subjective experience even when no information is available in the external world. Here, we investigated the neural representation of purely internally generated stimulus-like information during visual working memory. Participants performed delayed recall of oriented gratings embedded in noise with varying contrast during fMRI scanning. Their trialwise behavioral responses provided an estimate of their mental representation of the to-be-reported orientation. We used multivariate inverted encoding models to reconstruct the neural representations of orientation in reference to the response. We found that response orientation could be successfully reconstructed from activity in early visual cortex, even on 0% contrast trials when no orientation information was actually presented, suggesting the existence of a purely internally generated neural code in early visual cortex. In addition, cross-generalization and multidimensional scaling analyses demonstrated that information derived from internal sources was represented differently from typical working memory representations, which receive influences from both external and internal sources. Similar results were also observed in intraparietal sulcus, with slightly different cross-generalization patterns. These results suggest a potential mechanism for how externally driven and internally generated information is maintained in working memory.

Occipital gamma-aminobutyric acid and glutamate-glutamine alterations in major depressive disorder: An mrs study and meta-analysis

The neurotransmitters GABA and glutamate have been suggested to play a role in Major Depressive Disorder (MDD) through an imbalance between cortical inhibition and excitation. This effect has been highlighted in higher brain areas, such as the prefrontal cortex, but has also been posited in basic sensory cortices. Based on this, magnetic resonance spectroscopy (MRS) was used to investigate potential changes to GABA+ and glutamate+glutamine (Glx) concentrations within the occipital cortex in MDD patients (n = 25) and healthy controls (n = 25). No difference in occipital GABA+ or Glx concentrations, nor in the GABA+/Glx ratio, was found between groups. An analysis of an extended MDD patient and unmatched control dataset (n = 90) found no correlation between metabolite concentrations and depressive symptoms. These results were integrated with prior studies through metabolite-specific meta-analyses, revealing no difference in occipital GABA and Glx concentrations between patients and controls. An effect of publication year on GABA group differences was found, suggesting that previously reported results may have been artifacts of measurement accuracy. Taken together, our results suggest that, contrary to some prior reports, MRS measurements of occipital GABA and Glx do not differ between MDD patients and controls.

Penetrabilidad cognitiva en la percepción visual temprana: Evidencia empírica en humanos

Con base en un trasfondo teórico sobre las concepciones modulares de la mente de Fodor (2001) y Pinker (2005), el objetivo del presente texto es analizar cualitativemente la solidez de la evidencia experimental de una muestra de artículos publicados entre 2002 y 2017 que apoyan la tesis de la penetrabilidad cognitiva en la percepción visual temprana. El estudio se justifica por las implicaciones que pueden tener los resultados de estas investigaciones para las diferentes concepciones sobre arquitectura mental en funciones perceptuales, procesamiento de la información intra e intermodular e isomorfismo entre arquitectura mental y cerebral. La metodología que se utilizó para realizar este estudio implicó establecimiento de la tesis y de los criterios de inclusión de los artículos a revisar, selección final de los artículos más representativos sobre las subáreas seleccionadas, análisis de la calidad metodológica y de los resultados de éstos, identificación de aportes específicos de cada estudio a la tesis planteada e interpretación y síntesis de los hallazgos. De 26 artículos revisados sobre el tema, se reportan y analizan 7, que se consideran representativos de 4 subáreas: penetrabilidad de expectativas, de percepción del color, de rasgos faciales y de reconocimiento de objetos. Se concluye que hay amplia y sólida evidencia convergente (perceptual y neurofisiológica) a favor de los fenómenos penetrativos en la visión temprana, lo cual apoyaría indirectamente la hipótesis de permeabilidad de los módulos mentales de Pinker. Se formulan recomendaciones sobre aspectos por investigar y variables a controlar en experimentos sobre este tema.

Cortical hierarchy, dual counterstream architecture and the importance of top-down generative networks

Hierarchy is a major organizational principle of the cortex and underscores modern computational theories of cortical function. The local microcircuit amplifies long-distance inter-areal input, which show distance-dependent changes in their laminar profiles. Statistical modeling of these changes in laminar profiles demonstrates that inputs from multiple hierarchical levels to their target areas show remarkable consistency, allowing the construction of a cortical hierarchy based on a principle of hierarchical distance. The statistical modeling that is applied to structure can also be applied to laminar differences in the oscillatory coherence between areas thereby determining a functional hierarchy of the cortex. Close examination of the anatomy of inter-areal connectivity reveals a dual counterstream architecture with well-defined distance-dependent feedback and feedforward pathways in both the supra- and infragranular layers, suggesting a multiplicity of feedback pathways with well-defined functional properties. These findings are consistent with feedback connections providing a generative network involved in a wide range of cognitive functions. A dynamical model constrained by connectivity data sheds insight into the experimentally observed signatures of frequency-dependent Granger causality for feedforward versus feedback signaling. Concerted experiments capitalizing on recent technical advances and combining tract-tracing, high-resolution fMRI, optogenetics and mathematical modeling hold the promise of a much improved understanding of lamina-constrained mechanisms of neural computation and cognition. However, because inter-areal interactions involve cortical layers that have been the target of important evolutionary changes in the primate lineage, these investigations will need to include human and non-human primate comparisons.

Amplitude modulations of cortical sensory responses in pulsatile evidence accumulation

How does the brain internally represent a sequence of sensory information that jointly drives a decision-making behavior? Studies of perceptual decision-making have often assumed that sensory cortices provide noisy but otherwise veridical sensory inputs to downstream processes that accumulate and drive decisions. However, sensory processing in even the earliest sensory cortices can be systematically modified by various external and internal contexts. We recorded from neuronal populations across posterior cortex as mice performed a navigational decision-making task based on accumulating randomly timed pulses of visual evidence. Even in V1, only a small fraction of active neurons had sensory-like responses time-locked to each pulse. Here, we focus on how these 'cue-locked' neurons exhibited a variety of amplitude modulations from sensory to cognitive, notably by choice and accumulated evidence. These task-related modulations affected a large fraction of cue-locked neurons across posterior cortex, suggesting that future models of behavior should account for such influences.

Parallel fast and slow recurrent cortical processing mediates target and distractor selection in visual search

Visual search has been commonly used to study the neural correlates of attentional allocation in space. Recent electrophysiological research has disentangled distractor processing from target processing, showing that these mechanisms appear to operate in parallel and show electric fields of opposite polarity. Nevertheless, the localization and exact nature of this activity is unknown. Here, using MEG in humans, we provide a spatiotemporal characterization of target and distractor processing in visual cortex. We demonstrate that source activity underlying target- and distractor-processing propagates in parallel as fast and slow sweep from higher to lower hierarchical levels in visual cortex. Importantly, the fast propagating target-related source activity bypasses intermediate levels to go directly to V1, and this V1 activity correlates with behavioral performance. These findings suggest that reentrant processing is important for both selection and attenuation of stimuli, and such processing operates in parallel feedback loops.

Sarah E. Donohue et al. characterize the spatiotemporal propagation of target and distractor processing in the human visual cortex. They show that these signals propagate in parallel as fast and slow sweeps from higher to lower hierarchical levels, and that the fast target processing signal can bypass intermediate levels correlating with behavioral performance.

Gaze direction influences grasping actions towards unseen, haptically explored, objects

Haptic exploration produces mental object representations that can be memorized for subsequent object-directed behaviour. Storage of haptically-acquired object images (HOIs), engages, besides canonical somatosensory areas, the early visual cortex (EVC). Clear evidence for a causal contribution of EVC to HOI representation is still lacking. The use of visual information by the grasping system undergoes necessarily a frame of reference shift by integrating eye-position. We hypothesize that if the motor system uses HOIs stored in a retinotopic coding in the visual cortex, then its use is likely to depend at least in part on eye position. We measured the kinematics of 4 fingers in the right hand of 15 healthy participants during the task of grasping different unseen objects behind an opaque panel, that had been previously explored haptically. The participants never saw the object and operated exclusively based on haptic information. The position of the object was fixed, in front of the participant, but the subject’s gaze varied from trial to trial between 3 possible positions, towards the unseen object or away from it, on either side. Results showed that the middle and little fingers’ kinematics during reaching for the unseen object changed significantly according to gaze position. In a control experiment we showed that intransitive hand movements were not modulated by gaze direction. Manipulating eye-position produces small but significant configuration errors, (behavioural errors due to shifts in frame of reference) possibly related to an eye-centered frame of reference, despite the absence of visual information, indicating sharing of resources between the haptic and the visual/oculomotor system to delayed haptic grasping.

Tuning of olfactory cortex ventral tenia tecta neurons to distinct task elements of goal-directed behavior

The ventral tenia tecta (vTT) is a component of the olfactory cortex and receives both bottom-up odor signals and top-down signals. However, the roles of the vTT in odor-coding and integration of inputs are poorly understood. Here, we investigated the involvement of the vTT in these processes by recording the activity from individual vTT neurons during the performance of learned odor-guided reward-directed tasks in mice. We report that individual vTT cells are highly tuned to a specific behavioral epoch of learned tasks, whereby the duration of increased firing correlated with the temporal length of the behavioral epoch. The peak time for increased firing among recorded vTT cells encompassed almost the entire temporal window of the tasks. Collectively, our results indicate that vTT cells are selectively activated during a specific behavioral context and that the function of the vTT changes dynamically in a context-dependent manner during goal-directed behaviors.

Memories of Visual Events Can Be Formed Without Specific Spatial Coordinates

To what extent does specific spatiotopic location accompany the remembered representation of a visual event? Feature integration theory suggests that identifying a multi-feature object requires focusing on its spatial location to integrate those features. Moreover, single unit data from anterior ventral stream neurons that fire preferentially to complex objects indicates that they have retinotopic receptive fields. It can, therefore, be predicted that location information of features of a complex stimulus is inherent in the memory of a perceived visual stimulus’ representation. To evaluate this prediction, we presented participants with a brief array of characters with instructions to identify and locate the solitary letter among a set of digits. Surprisingly, analysis of trials in which the target identity was accurately reported indicated that in more than 15% of trials (i.e., in Experiments 2b & 2c) participants were almost completely uninformed about the location of the letter that they had just identified. Further analysis showed that there were two main sources of these location errors; misbinding the target to the distractors’ locations and extremely poor spatial representation of the target’s location to an extent that was indistinguishable from guessing. The latter finding indicates that consciously accessible representations of visual events can form despite being untethered to robust and spatially-specific representations, implying that the specific location was either not quite encoded into working memory, or was rapidly forgotten. However, when the target was marked by a single feature (color), there was no evidence of remembering the target identity without remembering its location even with strong masking.

The Correlation of Neuronal Signals with Behavior at Different Levels of Visual Cortex and Their Relative Reliability for Behavioral Decisions

Behavior can be guided by neuronal activity in visual, auditory, or somatosensory cerebral cortex, depending on task requirements. In contrast to this flexible access of cortical signals, several observations suggest that behaviors depend more on neurons in later areas of visual cortex than those in earlier areas, although neurons in earlier areas would provide more reliable signals for many tasks. We recorded from neurons in different levels of visual cortex of 2 male rhesus monkeys while the animals did a visual discrimination task and examined trial-to-trial correlations between neuronal and behavioral responses. These correlations became stronger in primary visual cortex as neuronal signals in that area became more reliable relative to the other areas. The results suggest that the mechanisms that read signals from cortex might access any cortical area depending on the relative value of those signals for the task at hand.SIGNIFICANCE STATEMENT Information is encoded by the action potentials of neurons in various cortical areas in a hierarchical manner such that increasingly complex stimulus features are encoded in successive stages. The brain must extract information from the response of appropriate neurons to drive optimal behavior. A widely held view of this decoding process is that the brain relies on the output of later cortical areas to make decisions, although neurons in earlier areas can provide more reliable signals. We examined correlations between perceptual decisions and the responses of neurons in different levels of monkey visual cortex. The results suggest that the brain may access signals in any cortical area depending on the relative value of those signals for the task at hand.