Active vision in parietal and extrastriate cortex

Spatiotopic and retinotopic memory in the context of natural images

Neural responses throughout the visual cortex encode stimulus location in a retinotopic (i.e., eye-centered) reference frame, and memory for stimulus position is most precise in retinal coordinates. Yet visual perception is spatiotopic: objects are perceived as stationary, even though eye movements cause frequent displacement of their location on the retina. Previous studies found that, after a single saccade, memory of retinotopic locations is more accurate than memory of spatiotopic locations. However, it is not known whether various aspects of natural viewing affect the retinotopic reference frame advantage. We found that the retinotopic advantage may in part depend on a retinal afterimage, which can be effectively nullified through backwards masking. Moreover, in the presence of natural scenes, spatiotopic memory is more accurate than retinotopic memory, but only when subjects are provided sufficient time to process the scene before the eye movement. Our results demonstrate that retinotopic memory is not always more accurate than spatiotopic memory and that the fidelity of memory traces in both reference frames are sensitive to the presence of contextual cues.

Refocusing neuroscience: moving away from mental categories and towards complex behaviours

Mental terms-such as perception, cognition, action, emotion, as well as attention, memory, decision-making-are epistemically sterile. We support our thesis based on extensive comparative neuroanatomy knowledge of the organization of the vertebrate brain. Evolutionary pressures have moulded the central nervous system to promote survival. Careful characterization of the vertebrate brain shows that its architecture supports an enormous amount of communication and integration of signals, especially in birds and mammals. The general architecture supports a degree of 'computational flexibility' that enables animals to cope successfully with complex and ever-changing environments. Here, we suggest that the vertebrate neuroarchitecture does not respect the boundaries of standard mental terms, and propose that neuroscience should aim to unravel the dynamic coupling between large-scale brain circuits and complex, naturalistic behaviours. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.

Resolving visual motion through perceptual gaps

Perceptual gaps can be caused by objects in the foreground temporarily occluding objects in the background or by eyeblinks, which briefly but frequently interrupt visual information. Resolving visual motion across perceptual gaps is particularly challenging, as object position changes during the gap. We examine how visual motion is maintained and updated through externally driven (occlusion) and internally driven (eyeblinks) perceptual gaps. Focusing on both phenomenology and potential mechanisms such as suppression, extrapolation, and integration, we present a framework for how perceptual gaps are resolved over space and time. We finish by highlighting critical questions and directions for future work.

The extrafoveal preview paradigm as a measure of predictive, active sampling in visual perception

A key feature of visual processing in humans is the use of saccadic eye movements to look around the environment. Saccades are typically used to bring relevant information, which is glimpsed with extrafoveal vision, into the high-resolution fovea for further processing. With the exception of some unusual circumstances, such as the first fixation when walking into a room, our saccades are mainly guided based on this extrafoveal preview. In contrast, the majority of experimental studies in vision science have investigated "passive" behavioral and neural responses to suddenly appearing and often temporally or spatially unpredictable stimuli. As reviewed here, a growing number of studies have investigated visual processing of objects under more natural viewing conditions in which observers move their eyes to a stationary stimulus, visible previously in extrafoveal vision, during each trial. These studies demonstrate that the extrafoveal preview has a profound influence on visual processing of objects, both for behavior and neural activity. Starting from the preview effect in reading research we follow subsequent developments in vision research more generally and finally argue that taking such evidence seriously leads to a reconceptualization of the nature of human visual perception that incorporates the strong influence of prediction and action on sensory processing. We review theoretical perspectives on visual perception under naturalistic viewing conditions, including theories of active vision, active sensing, and sampling. Although the extrafoveal preview paradigm has already provided useful information about the timing of, and potential mechanisms for, the close interaction of the oculomotor and visual systems while reading and in natural scenes, the findings thus far also raise many new questions for future research.

Occipital cortex is modulated by transsaccadic changes in spatial frequency: an fMRI study

Previous neuroimaging studies have shown that inferior parietal and ventral occipital cortex are involved in the transsaccadic processing of visual object orientation. Here, we investigated whether the same areas are also involved in transsaccadic processing of a different feature, namely, spatial frequency. We employed a functional magnetic resonance imaging paradigm where participants briefly viewed a grating stimulus with a specific spatial frequency that later reappeared with the same or different frequency, after a saccade or continuous fixation. First, using a whole-brain Saccade > Fixation contrast, we localized two frontal (left precentral sulcus and right medial superior frontal gyrus), four parietal (bilateral superior parietal lobule and precuneus), and four occipital (bilateral cuneus and lingual gyri) regions. Whereas the frontoparietal sites showed task specificity, the occipital sites were also modulated in a saccade control task. Only occipital cortex showed transsaccadic feature modulations, with significant repetition enhancement in right cuneus. These observations (parietal task specificity, occipital enhancement, right lateralization) are consistent with previous transsaccadic studies. However, the specific regions differed (ventrolateral for orientation, dorsomedial for spatial frequency). Overall, this study supports a general role for occipital and parietal cortex in transsaccadic vision, with a specific role for cuneus in spatial frequency processing.

Circadian Responses to Light-Flash Exposure: Conceptualization and New Data Guiding Future Directions

A growing number of studies document circadian phase-shifting after exposure to millisecond light flashes. When strung together by intervening periods of darkness, these stimuli evoke pacemaker responses rivaling or outmatching those created by steady luminance, suggesting that the circadian system's relationship to light can be contextualized outside the principle of simple dose-dependence. In the current review, we present a brief chronology of this work. We then develop a conceptual model around it that attempts to relate the circadian effects of flashes to a natural integrative process the pacemaker uses to intermittently sample the photic information available at dawn and dusk. Presumably, these snapshots are employed as building blocks in the construction of a coherent representation of twilight the pacemaker consults to orient the next day's physiology (in that way, flash-resetting of pacemaker rhythms might be less an example of a circadian visual illusion and more an example of the kinds of gestalt inferences that the image-forming system routinely makes when identifying objects within the visual field; i.e., closure). We conclude our review with a discussion on the role of cones in the pacemaker's twilight predictions, providing new electrophysiological data suggesting that classical photoreceptors—but not melanopsin—are necessary for millisecond, intermediate-intensity flash responses in ipRGCs (intrinsically photosensitive retinal ganglion cells). Future investigations are necessary to confirm this “Cone Sentinel Model” of circadian flash-integration and twilight-prediction, and to further define the contribution of cones vs. rods in transducing pacemaker flash signals.

Larger Volume and Different Activation of the Brain in Response to Threat in Military Officers

Introduction:

Military missions involve stressful and life-threatening situations; however, soldiers should have a healthy cognition on the battlefield despite their high-stress levels. This is an ability that should be gained during prior military training. Successful and influential training is suggested to be associated with structural and functional improvements of the brain.

Methods:

This study investigated the pattern of brain activation while observing videos relevant to life-threatening situations, in addition to brain structure. Accordingly, the obtained data were compared between 20 military members and 26 healthy controls. The study participants were all male, aged between 19 to 24 years, right-handed, studying BSc, and from the same socioeconomic status.

Results:

The obtained data presented a larger volume in a total number of 1103 voxels of the brain (in 5 brain areas) in the military group. Furthermore, the military group suggested higher brain activation in the visual processing areas of the brain when observing real combat videos; however, this increment was mostly in the areas associated with motor processing and executive functions in the controls.

Conclusion:

This study indicated that military training is associated with positive structural changes in the brain. Besides, it provided a different brain activation in response to stressful situations. These findings highlighted the importance of qualified military training.

Dissociating neural activity associated with the subjective phenomenology of monocular stereopsis: An EEG study

The subjective phenomenology associated with stereopsis, of solid tangible objects separated by a palpable negative space, is conventionally thought to be a by-product of the derivation of depth from binocular disparity. However, the same qualitative impression has been reported in the absence of disparity, e.g., when viewing pictorial images monocularly through an aperture. Here we aimed to explore if we could identify dissociable neural activity associated with the qualitative impression of stereopsis in the absence of the processing of binocular disparities. We measured EEG activity while subjects viewed pictorial (non-stereoscopic) images of 2D and 3D geometric forms under four different viewing conditions (binocular, monocular, binocular aperture, monocular aperture). EEG activity was analysed by oscillatory source localization (beamformer technique) to examine power change in occipital and parietal regions across viewing and stimulus conditions in targeted frequency bands (alpha: 8-13 Hz & gamma: 60-90 Hz). We observed expected event-related gamma synchronization and alpha desynchronization in occipital cortex and predominant gamma synchronization in parietal cortex across viewing and stimulus conditions. However, only the viewing condition predicted to generate the strongest impression of stereopsis (monocular aperture) revealed significantly elevated gamma synchronization within the parietal cortex for the critical contrasts (3D vs. 2D form). These findings suggest dissociable neural processes specific to the qualitative impression of stereopsis as distinguished from disparity processing.

V1 connections reveal a series of elongated higher visual areas in the California ground squirrel, Otospermophilus beecheyi

For studies of visual cortex organization, mouse is becoming an increasingly more often used model. In addition to its genetic tractability, the relatively small area of cortical surface devoted to visual processing simplifies efforts in relating the structure of visual cortex to visual function. However, the nature of this compact organization can make some comparisons to the much larger non-human primate visual cortex difficult. The squirrel, as a highly visual rodent offers a useful means for better understanding how mouse and monkey cortical organization compares. More in line with primates than their nocturnal rodent cousin, squirrels rely much more on sight and have evolved a larger expanse of cortex devoted to visual processing. To reveal the detailed organization of visual cortex in squirrels, we injected a highly sensitive monosynaptic retrograde tracer (glycoprotein deleted rabies virus) into several locations of primary visual cortex (V1) in California ground squirrels. The resulting pattern of connectivity revealed an organizational scheme in the squirrel that retains some of the basic features of the mouse visual cortex along the medial and posterior borders of V1, but unlike mouse has an elaborate and extensive pattern laterally that is more similar to the early visual cortex organization found in monkeys. In this way, we show that the squirrel can serve as a useful model for comparison to both mouse and primate visual systems, and may help facilitate comparisons between these two very different yet widely used animal models of visual processing.

Alterations in the functional neural circuitry supporting flexible choice behavior in autism spectrum disorders

Restricted and repetitive behaviors, and a pronounced preference for behavioral and environmental consistency, are distinctive characteristics of autism spectrum disorder (ASD). Alterations in frontostriatal circuitry that supports flexible behavior might underlie this behavioral impairment. In an functional magnetic resonance imaging study of 17 individuals with ASD, and 23 age-, gender- and IQ-matched typically developing control participants, reversal learning tasks were used to assess behavioral flexibility as participants switched from one learned response choice to a different response choice when task contingencies changed. When choice outcome after reversal was uncertain, the ASD group demonstrated reduced activation in both frontal cortex and ventral striatum, in the absence of task performance differences. When the outcomes of novel responses were certain, there was no difference in brain activation between groups. Reduced activation in frontal cortex and ventral striatum suggest problems in decision-making and response planning, and in processing reinforcement cues, respectively. These processes, and their integration, are essential for flexible behavior. Alterations in these systems may therefore contribute to a rigid adherence to preferred behavioral patterns in individuals with an ASD. These findings provide an additional impetus for the use of reversal learning paradigms as a translational model for treatment development targeting the domain of restricted and repetitive behaviors in ASD.

Saccade Preparation Reshapes Sensory Tuning

Human observers make large rapid eye movements-saccades-to bring behaviorally relevant information into the fovea, where spatial resolution is high. In some visual tasks [1-4], performance at the location of a saccade target improves before the eyes move. Although these findings provide evidence that extra-retinal signals evoked by saccades can enhance visual perception, it remains unknown whether and how presaccadic modulations change the processing of feature information and thus modulate visual representations. To answer this question, one must go beyond the use of methods that only probe performance accuracy (d') in different tasks. Here, using a psychophysical reverse correlation approach [5-8], we investigated how saccade preparation influences the processing of orientation and spatial frequency-two building blocks of early vision. We found that saccade preparation selectively enhanced the gain of high spatial frequency information and narrowed orientation tuning at the upcoming saccade landing position. These modulations were time locked to saccade onset, peaking right before the eyes moved (-50-0 ms). Moreover, merely deploying covert attention within the same temporal interval without preparing a saccade did not alter performance. The observed presaccadic tuning changes may correspond to the presaccadic enhancement [9-11] and receptive field shifts reported in neurophysiological studies [12-14]. Saccade preparation may support transaccadic integration by reshaping the representation of the saccade target to be more fovea-like just before the eyes move. The presaccadic modulations on spatial frequency and orientation processing illustrate a strong perception-action coupling by revealing that the visual system dynamically reshapes feature selectivity contingent upon eye movements.

Nonretinotopic visual processing in the brain

A basic principle in visual neuroscience is the retinotopic organization of neural receptive fields. Here, we review behavioral, neurophysiological, and neuroimaging evidence for nonretinotopic processing of visual stimuli. A number of behavioral studies have shown perception depending on object or external-space coordinate systems, in addition to retinal coordinates. Both single-cell neurophysiology and neuroimaging have provided evidence for the modulation of neural firing by gaze position and processing of visual information based on craniotopic or spatiotopic coordinates. Transient remapping of the spatial and temporal properties of neurons contingent on saccadic eye movements has been demonstrated in visual cortex, as well as frontal and parietal areas involved in saliency/priority maps, and is a good candidate to mediate some of the spatial invariance demonstrated by perception. Recent studies suggest that spatiotopic selectivity depends on a low spatial resolution system of maps that operates over a longer time frame than retinotopic processing and is strongly modulated by high-level cognitive factors such as attention. The interaction of an initial and rapid retinotopic processing stage, tied to new fixations, and a longer lasting but less precise nonretinotopic level of visual representation could underlie the perception of both a detailed and a stable visual world across saccadic eye movements.

Saccade abnormalities associated with focal cerebral lesions - How cortical and basal ganglia commands shape saccades in humans

OBJECTIVE

To study saccade abnormalities associated with focal cerebral lesions, including the cerebral cortex and basal ganglia (BG).

METHODS

We studied the latency and amplitude of reflexive and voluntary saccades in 37 patients with focal lesions of the frontal and parietal cortices and BG (caudate and putamen), and 51 age-matched controls, along with the ability to inhibit unwanted reflexive saccades.

RESULTS

Latencies of reflexive saccades were prolonged in patients with parietal lesions involving the parietal eye field (PEF), whereas their amplitude was decreased with parietal or putaminal lesions. In contrast, latency of voluntary saccades was prolonged and their success rate reduced with frontal lesions including the frontal eye field (FEF) or its outflow tract as well as the dorsolateral/medial prefrontal cortex, and caudate lesions, whereas their amplitude was decreased with parietal lesions. Inhibitory control of reflexive saccades was impaired with frontal, caudate and, less prominently, parietal lesions.

CONCLUSIONS

PEF is important in triggering reflexive saccades, also determining their amplitude. Whereas FEF and the caudate emit commands for initiating voluntary saccades, their amplitude is mainly determined by PEF. Commands not only from FEF and dorsolateral/medial prefrontal cortex but also from the caudate and PEF serve to inhibit unnecessary reflexive saccades.

SIGNIFICANCE

The findings suggested how cortical and BG commands shape reflexive and voluntary saccades in humans.

Topographic representation of numerosity in the human parietal cortex

Numerosity, the set size of a group of items, is processed by the association cortex, but certain aspects mirror the properties of primary senses. Sensory cortices contain topographic maps reflecting the structure of sensory organs. Are the cortical representation and processing of numerosity organized topographically, even though no sensory organ has a numerical structure? Using high-field functional magnetic resonance imaging (at a field strength of 7 teslas), we described neural populations tuned to small numerosities in the human parietal cortex. They are organized topographically, forming a numerosity map that is robust to changes in low-level stimulus features. The cortical surface area devoted to specific numerosities decreases with increasing numerosity, and the tuning width increases with preferred numerosity. These organizational properties extend topographic principles to the representation of higher-order abstract features in the association cortex.

The role of transverse occipital sulcus in scene perception and its relationship to object individuation in inferior intraparietal sulcus

The parietal cortex has been functionally divided into various subregions; however, very little is known about how these areas relate to each other. Two such regions are the transverse occipital sulcus (TOS) scene area and inferior intraparietal sulcus (IPS). TOS exhibits similar activation patterns to the scene selective parahippocampal place area, suggesting its role in scene perception. Inferior IPS, in contrast, has been shown to participate in object individuation and selection via location. Interestingly, both regions have been localized to the same general area of the brain. If these two were actually the same brain region, it would have important implications regarding these regions' role in cognition. To explore this, we first localized TOS and inferior IPS in individual participants and examined the degree of overlap between these regions in each participant. We found that TOS showed only a minor degree of overlap with inferior IPS (∼10%). We then directly explored the role of TOS and inferior IPS in object individuation and scene perception by examining their responses to furnished rooms, empty rooms, isolated furniture, and multiple isolated objects. If TOS and inferior IPS were the same region, we would expect to see similar response patterns in both. Instead, the response of TOS was predominantly scene selective, whereas activity in inferior IPS was primarily driven by the number of objects present in the display, regardless of scene context. These results show that TOS and inferior IPS are nearby but distinct regions, with different functional roles in visual cognition.

Embodied cognition

Traditional views in philosophy of mind and cognitive science depict the mind as an information processor, one whose connections with the body and the world are of little theoretical importance. On the contrary, mounting empirical evidence shows that bodily states and modality-specific systems for perception and action underlie information processing, and that embodiment contributes to various aspects and effects of mental phenomena. This article will briefly review and discuss some of this evidence and what it implies. By challenging mainstream accounts of mind and cognition, embodiment views offer new ways of conceptualizing knowledge and suggest novel perspectives on cognitive variation and mind-body reductionism. WIREs Cogn Sci 2013, 4:319-325. doi: 10.1002/wcs.1226 For further resources related to this article, please visit the WIREs website.

Division of labor in frontal eye field neurons during presaccadic remapping of visual receptive fields

Our percept of visual stability across saccadic eye movements may be mediated by presaccadic remapping. Just before a saccade, neurons that remap become visually responsive at a future field (FF), which anticipates the saccade vector. Hence, the neurons use corollary discharge of saccades. Many of the neurons also decrease their response at the receptive field (RF). Presaccadic remapping occurs in several brain areas including the frontal eye field (FEF), which receives corollary discharge of saccades in its layer IV from a collicular-thalamic pathway. We studied, at two levels, the microcircuitry of remapping in the FEF. At the laminar level, we compared remapping between layers IV and V. At the cellular level, we compared remapping between different neuron types of layer IV. In the FEF in four monkeys (Macaca mulatta), we identified 27 layer IV neurons with orthodromic stimulation and 57 layer V neurons with antidromic stimulation from the superior colliculus. With the use of established criteria, we classified the layer IV neurons as putative excitatory (n = 11), putative inhibitory (n = 12), or ambiguous (n = 4). We found that just before a saccade, putative excitatory neurons increased their visual response at the RF, putative inhibitory neurons showed no change, and ambiguous neurons increased their visual response at the FF. None of the neurons showed presaccadic visual changes at both RF and FF. In contrast, neurons in layer V showed full remapping (at both the RF and FF). Our data suggest that elemental signals for remapping are distributed across neuron types in early cortical processing and combined in later stages of cortical microcircuitry.

Simulating the cortical 3D visuomotor transformation of reach depth

We effortlessly perform reach movements to objects in different directions and depths. However, how networks of cortical neurons compute reach depth from binocular visual inputs remains largely unknown. To bridge the gap between behavior and neurophysiology, we trained a feed-forward artificial neural network to uncover potential mechanisms that might underlie the 3D transformation of reach depth. Our physiologically-inspired 4-layer network receives distributed 3D visual inputs (1^st layer) along with eye, head and vergence signals. The desired motor plan was coded in a population (3^rd layer) that we read out (4^th layer) using an optimal linear estimator. After training, our network was able to reproduce all known single-unit recording evidence on depth coding in the parietal cortex. Network analyses predict the presence of eye/head and vergence changes of depth tuning, pointing towards a gain-modulation mechanism of depth transformation. In addition, reach depth was computed directly from eye-centered (relative) visual distances, without explicit absolute depth coding. We suggest that these effects should be observable in parietal and pre-motor areas.

Transfer of predictive signals across saccades

Predicting visual information facilitates efficient processing of visual signals. Higher visual areas can support the processing of incoming visual information by generating predictive models that are fed back to lower visual areas. Functional brain imaging has previously shown that predictions interact with visual input already at the level of the primary visual cortex (V1; Harrison et al., 2007; Alink et al., 2010). Given that fixation changes up to four times a second in natural viewing conditions, cortical predictions are effective in V1 only if they are fed back in time for the processing of the next stimulus and at the corresponding new retinotopic position. Here, we tested whether spatio-temporal predictions are updated before, during, or shortly after an inter-hemifield saccade is executed, and thus, whether the predictive signal is transferred swiftly across hemifields. Using an apparent motion illusion, we induced an internal motion model that is known to produce a spatio-temporal prediction signal along the apparent motion trace in V1 (Muckli et al., 2005; Alink et al., 2010). We presented participants with both visually predictable and unpredictable targets on the apparent motion trace. During the task, participants saccaded across the illusion whilst detecting the target. As found previously, predictable stimuli were detected more frequently than unpredictable stimuli. Furthermore, we found that the detection advantage of predictable targets is detectable as early as 50-100 ms after saccade offset. This result demonstrates the rapid nature of the transfer of a spatio-temporally precise predictive signal across hemifields, in a paradigm previously shown to modulate V1.

Vision and the representation of the surroundings in spatial memory

One of the paradoxes of vision is that the world as it appears to us and the image on the retina at any moment are not much like each other. The visual world seems to be extensive and continuous across time. However, the manner in which we sample the visual environment is neither extensive nor continuous. How does the brain reconcile these differences? Here, we consider existing evidence from both static and dynamic viewing paradigms together with the logical requirements of any representational scheme that would be able to support active behaviour. While static scene viewing paradigms favour extensive, but perhaps abstracted, memory representations, dynamic settings suggest sparser and task-selective representation. We suggest that in dynamic settings where movement within extended environments is required to complete a task, the combination of visual input, egocentric and allocentric representations work together to allow efficient behaviour. The egocentric model serves as a coding scheme in which actions can be planned, but also offers a potential means of providing the perceptual stability that we experience.

Visual stability

Our vision remains stable even though the movements of our eyes, head and bodies create a motion pattern on the retina. One of the most important, yet basic, feats of the visual system is to correctly determine whether this retinal motion is owing to real movement in the world or rather our own self-movement. This problem has occupied many great thinkers, such as Descartes and Helmholtz, at least since the time of Alhazen. This theme issue brings together leading researchers from animal neurophysiology, clinical neurology, psychophysics and cognitive neuroscience to summarize the state of the art in the study of visual stability. Recently, there has been significant progress in understanding the limits of visual stability in humans and in identifying many of the brain circuits involved in maintaining a stable percept of the world. Clinical studies and new experimental methods, such as transcranial magnetic stimulation, now make it possible to test the causal role of different brain regions in creating visual stability and also allow us to measure the consequences when the mechanisms of visual stability break down.

Thalamic pathways for active vision

Active vision requires the integration of information coming from the retina with that generated internally within the brain, especially by saccadic eye movements. Just as visual information reaches cortex via the lateral geniculate nucleus of the thalamus, this internal information reaches the cerebral cortex through other higher-order nuclei of the thalamus. This review summarizes recent work on four of these thalamic nuclei. The first two pathways convey internal information about upcoming saccades (a corollary discharge) and probably contribute to the neuronal mechanisms that underlie stable visual perception. The second two pathways might contribute to the neuronal mechanisms underlying visual spatial attention in cortex and in the thalamus itself.

Visual attention and stability

In the present review, we address the relationship between attention and visual stability. Even though with each eye, head and body movement the retinal image changes dramatically, we perceive the world as stable and are able to perform visually guided actions. However, visual stability is not as complete as introspection would lead us to believe. We attend to only a few items at a time and stability is maintained only for those items. There appear to be two distinct mechanisms underlying visual stability. The first is a passive mechanism: the visual system assumes the world to be stable, unless there is a clear discrepancy between the pre- and post-saccadic image of the region surrounding the saccade target. This is related to the pre-saccadic shift of attention, which allows for an accurate preview of the saccade target. The second is an active mechanism: information about attended objects is remapped within retinotopic maps to compensate for eye movements. The locus of attention itself, which is also characterized by localized retinotopic activity, is remapped as well. We conclude that visual attention is crucial in our perception of a stable world.

Dissociation between intentional and automatic remapping: different levels of inter-hemispheric transfer

In order to efficiently interact with our environment we need to constantly to update the spatial representation of visual targets for movement. This is required not only when we move our eyes but also when we want to reach toward a location different from the actual physical target (for example symmetrical). These two types of remapping are very different in nature, one being automatic, and the other intentional. However, they both have been shown to involve the posterior parietal cortex (PPC). To further investigate the role of this brain region in automatic and intentional remapping processes and the level of inter-hemispheric transfer of visuo-motor information in these two conditions of reaching, we tested two patients with unilateral optic ataxia (OA) in two different tasks: reaching to a memorised visual target after an intervening eye movement (trans-saccadic remapping) and an anti-reaching task. We showed that lesions of the PPC had different implications for these two tasks. In the trans-saccadic remapping task, movements toward the contralesional field were disrupted, even when the visual target was presented in the ipsilesional field. In contrast, in the anti-reaching task, the patients were mostly impaired in conditions where the target was presented in the contralesional field, even if the movement was executed toward the ipsilesional field. We postulate that the transfer of the visuo-motor information between hemispheres occurs before the parietal cortex in trans-saccadic remapping (transfer of visual information), and at the parietal level or after in anti-reaching (transfer of visuo-motor information).

Human reversal learning under conditions of certain versus uncertain outcomes

Reversal learning tasks assess behavioral flexibility by requiring subjects to switch from one learned response choice to a different response choice when task contingencies change. This requires both the processing of negative feedback once a learned response is no longer reinforced, and the capacity for flexible response selection. In 2-choice reversal learning tasks, subjects switch between only two responses. Multiple choice reversal learning is qualitatively different in that at reversal, it requires subjects to respond to non-reinforcement of a learned response by selecting a new response from among several alternatives that have uncertain consequences. While activity in brain regions responsible for processing unexpected negative feedback is known to increase in relation to the hedonic value of the reward itself, it is not known whether the uncertainty of reinforcement for future response choices also modulates these responses. In an fMRI study, 15 participants performed 2- and 4-choice reversal learning tasks. Upon reversal in both tasks, activation was observed in brain regions associated with processing changing reinforcement contingencies (midbrain, ventral striatum, insula), as well as in neocortical regions that support cognitive control and behavioral planning (prefrontal, premotor, posterior parietal, and anterior cingulate cortices). Activation in both systems was greater in the 4- than in the 2-choice task. Therefore, reinforcement uncertainty for future responses enhanced activity in brain systems that process performance feedback, as well as in areas supporting behavioral planning of future response choices. A mutually facilitative integration of responses in motivational and cognitive brain systems might enhance behavioral flexibility and decision making in conditions for which outcomes for future response choices are uncertain.

Retinotopic coding of extraretinal pursuit signals in early visual cortex

During smooth pursuit, the image of the target is stabilized on the fovea, implying that speed judgments made during pursuit must rely on an extraretinal signal providing precise eye speed information. To characterize the introduction of such extraretinal signal into the human visual system, we performed a factorial, functional magnetic resonance imaging experiment, in which we manipulated the factor eye movement, with "fixation" and "pursuit" as levels, and the factor task, with "speed" and "form" judgments as levels. We hypothesized that the extraretinal speed signal is reflected as an interaction between speed judgments and pursuit. Random effects analysis yielded an interaction only in dorsal early visual cortex. Retinotopic mapping localized this interaction on the horizontal meridian (HM) between dorsal areas visual 2 and 3 (V2/V3) at 1-2 degrees azimuth. This corresponded to the position the pursuit target would have reached, if moving retinotopically, at the time of the subject's speed judgment. Because the 2 V2/V3 HMs are redundant, both may be involved in speed judgments, the ventral one involving judgments based on retinal motion and the dorsal one judgments requiring an internal signal. These results indicate that an extraretinal speed signal is injected into early visual cortex during pursuit.

A neural model of the temporal dynamics of figure-ground segregation in motion perception

How does the visual system manage to segment a visual scene into surfaces and objects and manage to attend to a target object? Based on psychological and physiological investigations, it has been proposed that the perceptual organization and segmentation of a scene is achieved by the processing at different levels of the visual cortical hierarchy. According to this, motion onset detection, motion-defined shape segregation, and target selection are accomplished by processes which bind together simple features into fragments of increasingly complex configurations at different levels in the processing hierarchy. As an alternative to this hierarchical processing hypothesis, it has been proposed that the processing stages for feature detection and segregation are reflected in different temporal episodes in the response patterns of individual neurons. Such temporal epochs have been observed in the activation pattern of neurons as low as in area V1. Here, we present a neural network model of motion detection, figure-ground segregation and attentive selection which explains these response patterns in an unifying framework. Based on known principles of functional architecture of the visual cortex, we propose that initial motion and motion boundaries are detected at different and hierarchically organized stages in the dorsal pathway. Visual shapes that are defined by boundaries, which were generated from juxtaposed opponent motions, are represented at different stages in the ventral pathway. Model areas in the different pathways interact through feedforward and modulating feedback, while mutual interactions enable the communication between motion and form representations. Selective attention is devoted to shape representations by sending modulating feedback signals from higher levels (working memory) to intermediate levels to enhance their responses. Areas in the motion and form pathway are coupled through top-down feedback with V1 cells at the bottom end of the hierarchy. We propose that the different temporal episodes in the response pattern of V1 cells, as recorded in recent experiments, reflect the strength of modulating feedback signals. This feedback results from the consolidated shape representations from coherent motion patterns and the attentive modulation of responses along the cortical hierarchy. The model makes testable predictions concerning the duration and delay of the temporal episodes of V1 cell responses as well as their response variations that were caused by modulating feedback signals.

Physical activity and memory functions: an interventional study

Previous studies have suggested beneficial effects of physical activity on cognition. Here, we asked in an interventional approach if physical activity performed at different intensity levels would differentially affect episodic memory function. Additionally, we tried to identify mechanisms mediating these changes. Sixty-two healthy elderly individuals were assessed for level of physical activity, aerobic fitness, episodic memory score, neurotrophin and catecholamine levels, and received a magnetic resonance image of the brain at baseline and after a six months intervention of medium or low-intensity physical activity or control. Increase in total physical activity was positively associated with increase in memory score over the entire cohort, without significant differences between intensity groups. It was also positively associated with increases in local gray matter volume in prefrontal and cingulate cortex, and BDNF levels (trend). In conclusion, we showed that physical activity conveys the beneficial effects on memory function independently of its intensity, possibly mediated by local gray matter volume and neurotrophic factors. Our findings may carry significant implications for prevention of cognitive decline in the elderly.

Neuroanatomical pattern of mitochondrial complex I pathology varies between schizophrenia, bipolar disorder and major depression

Background

Mitochondrial dysfunction was reported in schizophrenia, bipolar disorderand major depression. The present study investigated whether mitochondrial complex I abnormalities show disease-specific characteristics.

Methodology/Principal Findings

mRNA and protein levels of complex I subunits NDUFV1, NDUFV2 and NADUFS1, were assessed in striatal and lateral cerebellar hemisphere postmortem specimens and analyzed together with our previous data from prefrontal and parieto-occipital cortices specimens of patients with schizophrenia, bipolar disorder, major depression and healthy subjects. A disease-specific anatomical pattern in complex I subunits alterations was found. Schizophrenia-specific reductions were observed in the prefrontal cortex and in the striatum. The depressed group showed consistent reductions in all three subunits in the cerebellum. The bipolar group, however, showed increased expression in the parieto-occipital cortex, similar to those observed in schizophrenia, and reductions in the cerebellum, yet less consistent than the depressed group.

Conclusions/Significance

These results suggest that the neuroanatomical pattern of complex I pathology parallels the diversity and similarities in clinical symptoms of these mental disorders.

Decoding the cortical transformations for visually guided reaching in 3D space

To explore the possible cortical mechanisms underlying the 3-dimensional (3D) visuomotor transformation for reaching, we trained a 4-layer feed-forward artificial neural network to compute a reach vector (output) from the visual positions of both the hand and target viewed from different eye and head orientations (inputs). The emergent properties of the intermediate layers reflected several known neurophysiological findings, for example, gain field-like modulations and position-dependent shifting of receptive fields (RFs). We performed a reference frame analysis for each individual network unit, simulating standard electrophysiological experiments, that is, RF mapping (unit input), motor field mapping, and microstimulation effects (unit outputs). At the level of individual units (in both intermediate layers), the 3 different electrophysiological approaches identified different reference frames, demonstrating that these techniques reveal different neuronal properties and suggesting that a comparison across these techniques is required to understand the neural code of physiological networks. This analysis showed fixed input-output relationships within each layer and, more importantly, within each unit. These local reference frame transformation modules provide the basic elements for the global transformation; their parallel contributions are combined in a gain field-like fashion at the population level to implement both the linear and nonlinear elements of the 3D visuomotor transformation.

Spatial updating: how the brain keeps track of changing object locations during observer motion

As you move through an environment, the positions of surrounding objects relative to your body constantly change. Updating these locations is a central feature of situational awareness and readiness to act. Here, we used functional magnetic resonance imaging and a virtual environment to test how the human brain uses optic flow to monitor changing object coordinates. Only activation profiles in the precuneus and the dorsal premotor cortex (PMd) were indicative of an updating process operating on a memorized egocentric map of space. A subsequent eye movement study argued against the alternative explanation that activation in PMd could be driven by oculomotor signals. Finally, introducing a verbal response mode revealed a dissociation between the two regions, with the PMd only showing updating-related responses when participants responded by pointing. We conclude that visual spatial updating relies on the construction of updated representations in the precuneus and the context-dependent planning of motor actions in PMd.

Pre-emptive perception

How can an action to a target be selected without yet knowing what it is? Pre-emptive perception (PEP) is a framework which orders neuronal mechanisms in association with voluntary actions before an action is started and until it is completed. It is assumed that PEP serves the purpose of perception, but a conscious, perceptual identification of the goal is not obligatorily completed during the time period of PEP itself. The concept of PEP is that the brain pre-emptively optimizes an action plan to maximize eventual perception, even before being sure what the goal is. Experimental studies of voluntary saccadic eye movements are considered as prototypic activity within the framework of PEP. The core concept of pre-emption is that a particular saccade is selected while a large number of other possible actions are deselected. Pre-emptive computations include mechanisms associated with internal context and reward. Neurophysiological studies which show anatomically and functionally separate cortical and some subcortical neuronal groups in computing saccades are summarized. There is a potential relationship of PEP as a neurobiological framework and some philosophical concepts. Terms for processes between planning and action, such as intention, anticipation, and attention, are often incongruent in everyday language and in epistemology. It is proposed here that a scrutiny of these terms can be rigorously approached by temporal subdivision of PEP and conversely, clear definitions of these terms can lead to organized experimental designs of cognitive neurobiology. The temporal subdivision of PEP allows a critique of The Will in the definition of Schopenhauer and distinguishes it from the 'free will'.

Human updating of visual motion direction during head rotations

Previous studies have demonstrated that human subjects update the location of visual targets for saccades after head and body movements and in the absence of visual feedback. This phenomenon is known as spatial updating. Here we investigated whether a similar mechanism exists for the perception of motion direction. We recorded eye positions in three dimensions and behavioral responses in seven subjects during a motion task in two different conditions: when the subject's head remained stationary and when subjects rotated their heads around an anteroposterior axis (head tilt). We demonstrated that after head-tilt subjects updated the direction of saccades made in the perceived stimulus direction (direction of motion updating), the amount of updating varied across subjects and stimulus directions, the amount of motion direction updating was highly correlated with the amount of spatial updating during a memory-guided saccade task, subjects updated the stimulus direction during a two-alternative forced-choice direction discrimination task in the absence of saccadic eye movements (perceptual updating), perceptual updating was more accurate than motion direction updating involving saccades, and subjects updated motion direction similarly during active and passive head rotation. These results demonstrate the existence of an updating mechanism for the perception of motion direction in the human brain that operates during active and passive head rotations and that resembles the one of spatial updating. Such a mechanism operates during different tasks involving different motor and perceptual skills (saccade and motion direction discrimination) with different degrees of accuracy.

Ventral visual cortex in humans: cytoarchitectonic mapping of two extrastriate areas

The extrastriate visual cortex forms a complex system enabling the analysis of visually presented objects. To gain deeper insight into the anatomical basis of this system, we cytoarchitectonically mapped the ventral occipital cortex lateral to BA 18/V2 in 10 human postmortem brains. The anatomical characterization of this part of the ventral stream was performed by examination of cell-body-stained histological sections using quantitative cytoarchitectonic analysis. First, the gray level index (GLI) was measured in the ventral occipital lobe. Cytoarchitectonic borders, i.e., significant changes in the cortical lamination pattern, were then identified using an observer-independent algorithm based on multivariate analysis of GLI profiles. Two distinct cytoarchitectonic areas (hOC3v, hOC4v) were characterized in the ventral extrastriate cortex lateral to BA 18/V2. Area hOC3v was found in the collateral sulcus. hOC4v was located in this sulcus and also covered the fusiform gyrus in more occipital sections. Topographically, these areas thus seem to represent the anatomical substrates of functionally defined areas, VP/V3v and V4/V4v. Following histological analysis, the delineated cytoarchitectonic areas were transferred to 3D reconstructions of the respective postmortem brains, which in turn were spatially normalized to the Montreal Neurological Institute reference space. A probabilistic map was generated for each area which describes how many brains had a representation of this area in a particular voxel. These maps can now be used to identify the anatomical correlates of functional activations observed in neuroimaging experiments to enable a more informed investigation into the many open questions regarding the organization of the human visual cortex.

From physiological principles to computational models of the cortex

Understanding the brain goes through the assimilation of an increasing amount of biological data going from single cell recording to brain imaging studies and behavioral analysis. The description of cognition at these three levels provides us with a grid of analysis that can be exploited for the design of computational models. Beyond data related to specific tasks to be emulated by models, each of these levels also lays emphasis on principles of computation that must be obeyed to really implement biologically inspired computations. Similarly, the advantages of such a joint approach are twofold: computational models are a powerful tool to experiment brain theories and assess them on the implementation of realistic tasks, such as visual search tasks. They are also a way to explore and exploit an original formalism of asynchronous, distributed and adaptive computations with such precious properties as self-organization, emergence, robustness and more generally abilities to cope with an intelligent interaction with the world. In this article, we first discuss three levels at which a cortical circuit might be observed to provide a modeler with sufficient information to design a computational model and illustrate this principle with an application to the control of visual attention.

The effects of inverting prisms on the horizontal-vertical illusion: a systematic effect of downward gaze

The purpose of this work is to compare the relative contributions from the extraocular and sensory systems on the magnitude of the horizontal-vertical illusion (HVI). The visual HVI refers to the general tendency to overestimate vertical extensions of small-scale lines on a picture plane relative to the horizontal by 4-16% depending on the method of measurement. The HVI line stimuli consisted of luminous vertical and horizontal lines forming "L-profiles" located in the frontoparallel plane at a 45 cm viewing distance, collinearly with a binocular gaze. The home position of gaze was aligned to the center of the screen with the ear-eye angle concordant with the environmental horizontal. Illusion strength was quantified when subjects fixated the HVI line stimuli in four quadrants of the visual field. The HVI was also viewed through prism lenses that inverted the retinal images by 180 degrees, thereby dissociating the sensory "up-down" direction from the oculomotor up-down frame of reference. The results revealed a systematically lower magnitude of the HVI in the bottom visual field regardless of whether subjects fixated the HVI with the distorting prisms or without. Taken together, these results suggest that the HVI is sensitive to small-angle gaze shifts. In agreement with several recent findings, these results are interpreted as implying that the brain imposes an enhanced analytic structure on the ascending sensory information during downward gaze.

Predictive remapping of visual features precedes saccadic eye movements

The frequent occurrence of saccadic eye movements raises the question of how information is combined across separate glances into a stable, continuous percept. Here I show that visual form processing is altered at both the current fixation position and the location of the saccadic target before the saccade. When human observers prepared to follow a displacement of the stimulus with the eyes, visual form adaptation was transferred from current fixation to the future gaze position. This transfer of adaptation also influenced the perception of test stimuli shown at an intermediate position between fixation and saccadic target. Additionally, I found a presaccadic transfer of adaptation when observers prepared to move their eyes toward a stationary adapting stimulus in peripheral vision. The remapping of visual processing, demonstrated here with form adaptation, may help to explain our impression of a smooth transition, with no temporal delay, of visual perception across glances.

Visual topography of human intraparietal sulcus

Human parietal cortex is implicated in a wide variety of sensory and cognitive functions, yet its precise organization remains unclear. Visual field maps provide a potential structural basis for descriptions of functional organization. Here, we detail the topography of a series of five maps of the contralateral visual hemifield within human posterior parietal cortex. These maps are located along the medial bank of the intraparietal sulcus (IPS) and are revealed by direct visual stimulation during functional magnetic resonance imaging, allowing these parietal regions to be routinely and reliably identified simultaneously with occipital visual areas. Two of these maps (IPS3 and IPS4) are novel, whereas two others (IPS1 and IPS2) have previously been revealed only by higher-order cognitive tasks. Area V7, a previously identified visual map, is observed to lie within posterior IPS and to share a foveal representation with IPS1. These parietal maps are reliably observed across scan sessions; however, their precise topography varies between individuals. The multimodal organization of posterior IPS mirrors this variability in visual topography, with complementary tactile activations found immediately adjacent to the visual maps both medially and laterally. These visual maps may provide a practical framework in which to characterize the functional organization of human IPS.

Remapping in human visual cortex

With each eye movement, stationary objects in the world change position on the retina, yet we perceive the world as stable. Spatial updating, or remapping, is one neural mechanism by which the brain compensates for shifts in the retinal image caused by voluntary eye movements. Remapping of a visual representation is believed to arise from a widespread neural circuit including parietal and frontal cortex. The current experiment tests the hypothesis that extrastriate visual areas in human cortex have access to remapped spatial information. We tested this hypothesis using functional magnetic resonance imaging (fMRI). We first identified the borders of several occipital lobe visual areas using standard retinotopic techniques. We then tested subjects while they performed a single-step saccade task analogous to the task used in neurophysiological studies in monkeys, and two conditions that control for visual and motor effects. We analyzed the fMRI time series data with a nonlinear, fully Bayesian hierarchical statistical model. We identified remapping as activity in the single-step task that could not be attributed to purely visual or oculomotor effects. The strength of remapping was roughly monotonic with position in the visual hierarchy: remapped responses were largest in areas V3A and hV4 and smallest in V1 and V2. These results demonstrate that updated visual representations are present in cortical areas that are directly linked to visual perception.