Attention and active vision

The meso-connectomes of mouse, marmoset, and macaque: network organization and the emergence of higher cognition

The recent publications of the inter-areal connectomes for mouse, marmoset, and macaque cortex have allowed deeper comparisons across rodent vs. primate cortical organization. In general, these show that the mouse has very widespread, "all-to-all" inter-areal connectivity (i.e. a "highly dense" connectome in a graph theoretical framework), while primates have a more modular organization. In this review, we highlight the relevance of these differences to function, including the example of primary visual cortex (V1) which, in the mouse, is interconnected with all other areas, therefore including other primary sensory and frontal areas. We argue that this dense inter-areal connectivity benefits multimodal associations, at the cost of reduced functional segregation. Conversely, primates have expanded cortices with a modular connectivity structure, where V1 is almost exclusively interconnected with other visual cortices, themselves organized in relatively segregated streams, and hierarchically higher cortical areas such as prefrontal cortex provide top-down regulation for specifying precise information for working memory storage and manipulation. Increased complexity in cytoarchitecture, connectivity, dendritic spine density, and receptor expression additionally reveal a sharper hierarchical organization in primate cortex. Together, we argue that these primate specializations permit separable deconstruction and selective reconstruction of representations, which is essential to higher cognition.

A conflict between spatial selection and evidence accumulation in area LIP

The lateral intraparietal area (LIP) contains spatially selective neurons that help guide eye movements and, according to numerous studies, do so by accumulating sensory evidence in favor of one choice (e.g., look left) or another (look right). To examine this functional link, we trained two monkeys on an urgent motion discrimination task, a task with which the evolution of both the recorded neuronal activity and the subject's choice can be tracked millisecond by millisecond. We found that while choice accuracy increased steeply with increasing sensory evidence, at the same time, the LIP selection signal became progressively weaker, as if it hindered performance. This effect was consistent with the transient deployment of spatial attention to disparate locations away from the relevant sensory cue. The results demonstrate that spatial selection in LIP is dissociable from, and may even conflict with, evidence accumulation during informed saccadic choices.

Transsaccadic integration of visual information is predictive, attention-based, and spatially precise

Eye movements produce shifts in the positions of objects in the retinal image, but observers are able to integrate these shifting retinal images into a coherent representation of visual space. This ability is thought to be mediated by attention-dependent saccade-related neural activity that is used by the visual system to anticipate the retinal consequences of impending eye movements. Previous investigations of the perceptual consequences of this predictive activity typically infer attentional allocation using indirect measures such as accuracy or reaction time. Here, we investigated the perceptual consequences of saccades using an objective measure of attentional allocation, reverse correlation. Human observers executed a saccade while monitoring a flickering target object flanked by flickering distractors and reported whether the average luminance of the target was lighter or darker than the background. Successful task performance required subjects to integrate visual information across the saccade. A reverse correlation analysis yielded a spatiotemporal "psychophysical kernel" characterizing how different parts of the stimulus contributed to the luminance decision throughout each trial. Just before the saccade, observers integrated luminance information from a distractor located at the post-saccadic retinal position of the target, indicating a predictive perceptual updating of the target. Observers did not integrate information from distractors placed in alternative locations, even when they were nearer to the target object. We also observed simultaneous predictive perceptual updating for two spatially distinct targets. These findings suggest both that shifting neural representations mediate the coherent representation of visual space, and that these shifts have significant consequences for transsaccadic perception.

Reorganization of spatial configurations in visual working memory

Human beings have to constantly process multiple objects in visual working memory (VWM). Positional relations to other objects known as spatial configurations contribute significantly to the organization of information in VWM. The aim of our study was to clarify whether spatial configurations can be reorganized to a subset of objects during maintenance. Participants were shown an array of objects, and afterwards the objects disappeared. A valid cue was shown either during encoding or maintenance to highlight the side of the following probed object. Afterwards, the objects reappeared and participants were instructed to detect whether or not a particular object changed its location. We manipulated the configurations at retrieval regarding the number of objects, ranging from all objects to a single object. Our first and second experiment investigated reorganization for a number of six and 12 objects, respectively. In the third experiment, we used a retro cue only and manipulated eye movements (free view vs. enforced fixation). While showing that reorganization of spatial configurations during maintenance is possible in principle, we found some boundary conditions. There was no spatial configuration effect when participants had to fixate. Thus, eye movements are required for a configuration effect to occur.

Corollary Discharge Contributions to Perceptual Continuity Across Saccades

Our vision depends upon shifting our high-resolution fovea to objects of interest in the visual field. Each saccade displaces the image on the retina, which should produce a chaotic scene with jerks occurring several times per second. It does not. This review examines how an internal signal in the primate brain (a corollary discharge) contributes to visual continuity across saccades. The article begins with a review of evidence for a corollary discharge in the monkey and evidence from inactivation experiments that it contributes to perception. The next section examines a specific neuronal mechanism for visual continuity, based on corollary discharge that is referred to as visual remapping. Both the basic characteristics of this anticipatory remapping and the factors that control it are enumerated. The last section considers hypotheses relating remapping to the perceived visual continuity across saccades, including remapping's contribution to perceived visual stability across saccades.

Left-Lateralized Contributions of Saccades to Cortical Activity During a One-Back Word Recognition Task

Saccadic eye movements are an inherent component of natural reading, yet their contribution to information processing at subsequent fixation remains elusive. Here we use anatomically-constrained magnetoencephalography (MEG) to examine cortical activity following saccades as healthy human subjects engaged in a one-back word recognition task. This activity was compared with activity following external visual stimulation that mimicked saccades. A combination of procedures was employed to eliminate saccadic ocular artifacts from the MEG signal. Both saccades and saccade-like external visual stimulation produced early-latency responses beginning ~70 ms after onset in occipital cortex and spreading through the ventral and dorsal visual streams to temporal, parietal and frontal cortices. Robust differential activity following the onset of saccades vs. similar external visual stimulation emerged during 150-350 ms in a left-lateralized cortical network. This network included: (i) left lateral occipitotemporal (LOT) and nearby inferotemporal (IT) cortex; (ii) left posterior Sylvian fissure (PSF) and nearby multimodal cortex; and (iii) medial parietooccipital (PO), posterior cingulate and retrosplenial cortices. Moreover, this left-lateralized network colocalized with word repetition priming effects. Together, results suggest that central saccadic mechanisms influence a left-lateralized language network in occipitotemporal and temporal cortex above and beyond saccadic influences at preceding stages of information processing during visual word recognition.

Presaccadic motion integration between current and future retinotopic locations of attended objects

Object tracking across eye movements is thought to rely on presaccadic updating of attention between the object's current and its "remapped" location (i.e., the postsaccadic retinotopic location). We report evidence for a bifocal, presaccadic sampling between these two positions. While preparing a saccade, participants viewed four spatially separated random dot kinematograms, one of which was cued by a colored flash. They reported the direction of a coherent motion signal at the cued location while a second signal occurred simultaneously either at the cue's remapped location or at one of several control locations. Motion integration between the signals occurred only when the two motion signals were congruent and were shown at the cue and at its remapped location. This shows that the visual system integrates features between both the current and the future retinotopic locations of an attended object and that such presaccadic sampling is feature specific.

Visual-auditory integration for visual search: a behavioral study in barn owls

Barn owls are nocturnal predators that rely on both vision and hearing for survival. The optic tectum of barn owls, a midbrain structure involved in selective attention, has been used as a model for studying visual-auditory integration at the neuronal level. However, behavioral data on visual-auditory integration in barn owls are lacking. The goal of this study was to examine if the integration of visual and auditory signals contributes to the process of guiding attention toward salient stimuli. We attached miniature wireless video cameras on barn owls' heads (OwlCam) to track their target of gaze. We first provide evidence that the area centralis (a retinal area with a maximal density of photoreceptors) is used as a functional fovea in barn owls. Thus, by mapping the projection of the area centralis on the OwlCam's video frame, it is possible to extract the target of gaze. For the experiment, owls were positioned on a high perch and four food items were scattered in a large arena on the floor. In addition, a hidden loudspeaker was positioned in the arena. The positions of the food items and speaker were changed every session. Video sequences from the OwlCam were saved for offline analysis while the owls spontaneously scanned the room and the food items with abrupt gaze shifts (head saccades). From time to time during the experiment, a brief sound was emitted from the speaker. The fixation points immediately following the sounds were extracted and the distances between the gaze position and the nearest items and loudspeaker were measured. The head saccades were rarely toward the location of the sound source but to salient visual features in the room, such as the door knob or the food items. However, among the food items, the one closest to the loudspeaker had the highest probability of attracting a gaze shift. This result supports the notion that auditory signals are integrated with visual information for the selection of the next visual search target.

Forced to remember: when memory is biased by salient information

The last decades have seen a rapid growing in the attempt to understand the key factors involved in the internal memory representation of the external world. Visual salience have been found to provide a major contribution in predicting the probability for an item/object embedded in a complex setting (i.e., a natural scene) to be encoded and then remembered later on. Here I review the existing literature highlighting the impact of perceptual- (based on low-level sensory features) and semantics-related salience (based on high-level knowledge) on short-term memory representation, along with the neural mechanisms underpinning the interplay between these factors. The available evidence reveal that both perceptual- and semantics-related factors affect attention selection mechanisms during the encoding of natural scenes. Biasing internal memory representation, both perceptual and semantics factors increase the probability to remember high- to the detriment of low-saliency items. The available evidence also highlight an interplay between these factors, with a reduced impact of perceptual-related salience in biasing memory representation as a function of the increasing availability of semantics-related salient information. The neural mechanisms underpinning this interplay involve the activation of different portions of the frontoparietal attention control network. Ventral regions support the assignment of selection/encoding priorities based on high-level semantics, while the involvement of dorsal regions reflects priorities assignment based on low-level sensory features.

Effects of nicotine and nicotine expectancy on attentional bias for emotional stimuli

INTRODUCTION

Nicotine's effects on mood are thought to enhance its addictive potential. However, the mechanisms underlying the effects of nicotine on affect regulation have not been reliably demonstrated in human laboratory studies. We investigated the effects of nicotine abstinence (Experiment 1), and nicotine challenge and expectancy (Experiment 2) on attentional bias towards facial emotional stimuli differing in emotional valence.

METHODS

In Experiment 1, 46 nicotine-deprived smokers were randomized to either continue to abstain from smoking or to smoke immediately before testing. In Experiment 2, 96 nicotine-deprived smokers were randomized to smoke a nicotinized or denicotinized cigarette and to be told that the cigarette did or did not contain nicotine. In both experiments participants completed a visual probe task, where positively valenced (happy) and negatively valenced (sad) facial expressions were presented, together with neutral facial expressions.

RESULTS

In Experiment 1, there was evidence of an interaction between probe location and abstinence on reaction time, indicating that abstinent smokers showed an attentional bias for neutral stimuli. In Experiment 2, there was evidence of an interaction between probe location, nicotine challenge and expectation on reaction time, indicating that smokers receiving nicotine, but told that they did not receive nicotine, showed an attentional bias for emotional stimuli.

CONCLUSIONS

Our data suggest that nicotine abstinence appears to disrupt attentional bias towards emotional facial stimuli. These data provide support for nicotine's modulation of attentional bias as a central mechanism for maintaining affect regulation in cigarette smoking.

Spatial ranking strategy and enhanced peripheral vision discrimination optimize performance and efficiency of visual sequential search

Visual sequential search might use a peripheral spatial ranking of the scene to put the next target of the sequence in the correct order. This strategy, indeed, might enhance the discriminative capacity of the human peripheral vision and spare neural resources associated with foveation. However, it is not known how exactly the peripheral vision sustains sequential search and whether the sparing of neural resources has a cost in terms of performance. To elucidate these issues, we compared strategy and performance during an alpha-numeric sequential task where peripheral vision was modulated in three different conditions: normal, blurred, or obscured. If spatial ranking is applied to increase the peripheral discrimination, its use as a strategy in visual sequencing should differ according to the degree of discriminative information that can be obtained from the periphery. Moreover, if this strategy spares neural resources without impairing the performance, its use should be associated with better performance. We found that spatial ranking was applied when peripheral vision was fully available, reducing the number and time of explorative fixations. When the periphery was obscured, explorative fixations were numerous and sparse; when the periphery was blurred, explorative fixations were longer and often located close to the items. Performance was significantly improved by this strategy. Our results demonstrated that spatial ranking is an efficient strategy adopted by the brain in visual sequencing to highlight peripheral detection and discrimination; it reduces the neural cost by avoiding unnecessary foveations, and promotes sequential search by facilitating the onset of a new saccade.

A soft handoff of attention between cerebral hemispheres

Each cerebral hemisphere initially processes one half of the visual world. How are moving objects seamlessly tracked when they traverse visual hemifields? Covert tracking of lateralized objects evokes a difference between slow-wave electrophysiological activity observed from contralateral and ipsilateral electrodes in occipitoparietal regions. This event-related potentials (ERP) waveform, known as contralateral delay activity (CDA) [1, 2], is sensitive to the number of objects tracked [1, 2] and responds dynamically to changes in this quantity [3]. When a tracked object crosses the midline, an inversion in CDA polarity revealed the dropping of the object's representation by one hemisphere and its acquisition by the other. Importantly, our data suggest that the initially tracking hemisphere continues to represent the object for a period after that object crosses the midline. Meanwhile, the receiving hemisphere begins to represent the object before the object crosses the midline, leading to a period in which the object is represented by both hemispheres. Further, this overlap in representation is reduced if the midline crossing is unpredictable. Thus, this process is sensitive to observer expectations and does not simply reflect overlapping receptive fields near the midline.

Shape selectivity and remapping in dorsal stream visual area LIP

We explore the visual world by making rapid eye movements (saccades) to focus on objects and locations of interest. Despite abrupt retinal image shifts, we see the world as stable. Remapping contributes to visual stability by updating the internal image with every saccade. Neurons in macaque lateral intraparietal cortex (LIP) and other brain areas update information about salient locations around the time of a saccade. The depth of information transfer remains to be thoroughly investigated. Area LIP, as part of the dorsal visual stream, is regarded as a spatially selective area, yet there is evidence that LIP neurons also encode object features. We sought to determine whether LIP remaps shape information. This knowledge is important for understanding what information is retained from each glance. We identified 82 remapping neurons. First, we presented shapes within the receptive field and tested for shape selectivity in a fixation task. Among the remapping neurons, 28 neurons (34%) were selective for shape. Second, we presented the same shapes in the future location of the receptive field around the time of the saccade and tested for shape selectivity during remapping. Thirty-one (38%) neurons were selective for shape. Of 11 neurons that were shape selective in both tasks, 5 showed significant correlation between shape selectivity in the two tasks. Across the population, there was a weak but significant correlation between responses to shape in the two tasks. Our results provide neurophysiological evidence that remapped responses in area LIP can encode shape information as well as spatial information.

Plasticity in the human visual cortex: an ophthalmology-based perspective

Neuroplasticity refers to the ability of the brain to reorganize the function and structure of its connections in response to changes in the environment. Adult human visual cortex shows several manifestations of plasticity, such as perceptual learning and adaptation, working under the top-down influence of attention. Plasticity results from the interplay of several mechanisms, including the GABAergic system, epigenetic factors, mitochondrial activity, and structural remodeling of synaptic connectivity. There is also a downside of plasticity, that is, maladaptive plasticity, in which there are behavioral losses resulting from plasticity changes in the human brain. Understanding plasticity mechanisms could have major implications in the diagnosis and treatment of ocular diseases, such as retinal disorders, cataract and refractive surgery, amblyopia, and in the evaluation of surgical materials and techniques. Furthermore, eliciting plasticity could open new perspectives in the development of strategies that trigger plasticity for better medical and surgical outcomes.

Visual salience improves spatial working memory via enhanced parieto-temporal functional connectivity

In everyday life, the brain is bombarded with a multitude of concurrent and competing stimuli. Only some of these enter consciousness and memory. Attention selects relevant signals for in-depth processing depending on current goals, but also on the intrinsic properties of stimuli. We combined behavior, computational modeling, and functional imaging to investigate mechanisms supporting access to memory based on intrinsic sensory properties. During fMRI scanning, human subjects were presented with pictures of naturalistic scenes that entailed high levels of competition between possible target objects. Following a retention interval of 8 s, participants judged the location (same/different) of a target object extracted from the initial scene. We found that memory performance at retrieval increased with increasing object salience at encoding, indicating a "prior entry" for salient information. fMRI analyses revealed encoding-related activation in the posterior parietal cortex, selectively for salient objects that were later remembered. Moreover, parietal cortex showed increased functional coupling with the medial-temporal lobe, for remembered objects only. These findings reveal a parietotemporal circuit that integrates available sensory cues (based on attention-grabbing saliency signals) and current memory requirements (storing objects' locations) to encode object-related spatial information in working memory.

Visual search and line bisection in hemianopia: computational modelling of cortical compensatory mechanisms and comparison with hemineglect

Hemianopia patients have lost vision from the contralateral hemifield, but make behavioural adjustments to compensate for this field loss. As a result, their visual performance and behaviour contrast with those of hemineglect patients who fail to attend to objects contralateral to their lesion. These conditions differ in their ocular fixations and perceptual judgments. During visual search, hemianopic patients make more fixations in contralesional space while hemineglect patients make fewer. During line bisection, hemianopic patients fixate the contralesional line segment more and make a small contralesional bisection error, while hemineglect patients make few contralesional fixations and a larger ipsilesional bisection error. Hence, there is an attentional failure for contralesional space in hemineglect but a compensatory adaptation to attend more to the blind side in hemianopia. A challenge for models of visual attentional processes is to show how compensation is achieved in hemianopia, and why such processes are hindered or inaccessible in hemineglect. We used a neurophysiology-derived computational model to examine possible cortical compensatory processes in simulated hemianopia from a V1 lesion and compared results with those obtained with the same processes under conditions of simulated hemineglect from a parietal lesion. A spatial compensatory bias to increase attention contralesionally replicated hemianopic scanning patterns during visual search but not during line bisection. To reproduce the latter required a second process, an extrastriate lateral connectivity facilitating form completion into the blind field: this allowed accurate placement of fixations on contralesional stimuli and reproduced fixation patterns and the contralesional bisection error of hemianopia. Neither of these two cortical compensatory processes was effective in ameliorating the ipsilesional bias in the hemineglect model. Our results replicate normal and pathological patterns of visual scanning, line bisection, and differences between hemianopia and hemineglect, and may explain why compensatory processes that counter the effects of hemianopia are ineffective in hemineglect.

Eye movements and attention: the role of pre-saccadic shifts of attention in perception, memory and the control of saccades

Saccadic eye movements and perceptual attention work in a coordinated fashion to allow selection of the objects, features or regions with the greatest momentary need for limited visual processing resources. This study investigates perceptual characteristics of pre-saccadic shifts of attention during a sequence of saccades using the visual manipulations employed to study mechanisms of attention during maintained fixation. The first part of this paper reviews studies of the connections between saccades and attention, and their significance for both saccadic control and perception. The second part presents three experiments that examine the effects of pre-saccadic shifts of attention on vision during sequences of saccades. Perceptual enhancements at the saccadic goal location relative to non-goal locations were found across a range of stimulus contrasts, with either perceptual discrimination or detection tasks, with either single or multiple perceptual targets, and regardless of the presence of external noise. The results show that the preparation of saccades can evoke a variety of attentional effects, including attentionally-mediated changes in the strength of perceptual representations, selection of targets for encoding in visual memory, exclusion of external noise, or changes in the levels of internal visual noise. The visual changes evoked by saccadic planning make it possible for the visual system to effectively use saccadic eye movements to explore the visual environment.

Insights from neuropsychology: pinpointing the role of the posterior parietal cortex in episodic and working memory

The role of posterior parietal cortex (PPC) in various forms of memory is a current topic of interest in the broader field of cognitive neuroscience. This large cortical region has been linked with a wide range of mnemonic functions affecting each stage of memory processing: encoding, maintenance, and retrieval. Yet, the precise role of the PPC in memory remains mysterious and controversial. Progress in understanding PPC function will require researchers to incorporate findings in a convergent manner from multiple experimental techniques rather than emphasizing a particular type of data. To facilitate this process, here, we review findings from the human neuropsychological research and examine the consequences to memory following PPC damage. Recent patient-based research findings have investigated two typically disconnected fields: working memory (WM) and episodic memory. The findings from patient participants with unilateral and bilateral PPC lesions performing diverse experimental paradigms are summarized. These findings are then related to findings from other techniques including neurostimulation (TMS and tDCS) and the influential and more abundant functional neuroimaging literature. We then review the strengths and weaknesses of hypotheses proposed to account for PPC function in these forms of memory. Finally, we address what missing evidence is needed to clarify the role(s) of the PPC in memory.

Eye movements modulate the spatiotemporal dynamics of word processing

Active reading requires coordination between frequent eye movements (saccades) and short fixations in text. Yet, the impact of saccades on word processing remains unknown, as neuroimaging studies typically employ constant eye fixation. Here we investigate eye-movement effects on word recognition processes in healthy human subjects using anatomically constrained magnetoencephalography, psychophysical measurements, and saccade detection in real time. Word recognition was slower and brain responses were reduced to words presented early versus late after saccades, suggesting an overall transient impairment of word processing after eye movements. Response reductions occurred early in visual cortices and later in language regions, where they colocalized with repetition priming effects. Qualitatively similar effects occurred when words appeared early versus late after background movement that mimicked saccades, suggesting that retinal motion contributes to postsaccadic inhibition. Further, differences in postsaccadic and background-movement effects suggest that central mechanisms also contribute to postsaccadic modulation. Together, these results suggest a complex interplay between visual and central saccadic mechanisms during reading.

Remapping of the line motion illusion across eye movements

Although motion processing in the brain has been classically studied in terms of retinotopically defined receptive fields, recent evidence suggests that motion perception can occur in a spatiotopic reference frame. We investigated the underlying mechanisms of spatiotopic motion perception by examining the role of saccade metrics as well as the capacity of trans-saccadic motion. To this end, we used the line motion illusion (LMI), in which a straight line briefly shown after a high contrast stimulus (inducer) is perceived as expanding away from the inducer position. This illusion provides an interesting test of spatiotopic motion because the neural correlates of this phenomenon have been found early in the visual cortex and the effect does not require focused attention. We measured the strength of LMI both with stable fixation and when participants were asked to perform a 10° saccade during the blank ISI between the inducer and the line. A strong motion illusion was found across saccades in spatiotopic coordinates. When the inducer was presented near in time to the saccade cue, saccadic latencies were longer, saccade amplitudes were shorter, and the strength of reported LMI was consistently reduced. We also measured the capacity of the trans-saccadic LMI by varying the number of inducers. In contrast to a visual-spatial memory task, we found that the LMI was largely eliminated by saccades when two or more inducers were displayed. Together, these results suggest that motion perceived in non-retinotopic coordinates depends on an active, saccade-dependent remapping process with a strictly limited capacity.

Eye movements: the past 25 years

This article reviews the past 25 years of research on eye movements (1986-2011). Emphasis is on three oculomotor behaviors: gaze control, smooth pursuit and saccades, and on their interactions with vision. Focus over the past 25 years has remained on the fundamental and classical questions: What are the mechanisms that keep gaze stable with either stationary or moving targets? How does the motion of the image on the retina affect vision? Where do we look - and why - when performing a complex task? How can the world appear clear and stable despite continual movements of the eyes? The past 25 years of investigation of these questions has seen progress and transformations at all levels due to new approaches (behavioral, neural and theoretical) aimed at studying how eye movements cope with real-world visual and cognitive demands. The work has led to a better understanding of how prediction, learning and attention work with sensory signals to contribute to the effective operation of eye movements in visually rich environments.

Projections to early visual areas v1 and v2 in the calcarine fissure from parietal association areas in the macaque

Non-extrastriate projections to area V1 in monkeys, now demonstrated by several anatomical studies, are potential substrates of physiologically documented multisensory effects in primary sensory areas. The full network of projections among association and primary areas, however, is likely to be complex and is still only partially understood. In the present report, we used the anterograde tracer biotinylated dextran amine to investigate projections to areas V1 and V2 from subdivisions of the parietal association cortex in macaque. Parietal cortex was chosen to allow comparisons between projections from this higher association area and from other previously reported areas. In addition, we were interested in further elucidating pathways to areas V1 and V2 from parietal areas, as potentially contributing to attention and active vision. Of eight cases, three brains had projections only to area V2, and the five others projected to both areas V1 and V2. Terminations in area V1 were sparse. These were located in supragranular layers I, II, upper III; occasionally in IVB; and in layer VI. Terminations in V2 were denser, and slightly more prevalent in the supragranular layers. For both areas, terminations were in the calcarine region, corresponding to the representation of the peripheral visual field. By reconstructions of single axons, we demonstrated that four of nine axons had collaterals, either to V1 and V2 (n = 1) or to area V1 and a ventral area likely to be TEO (n = 3). In area V1, axons extended divergently in layer VI as well as layer I. Overall, these and previous results suggest a nested connectivity architecture, consisting of multiple direct and indirect recurrent projections from association areas to area V1. Terminations in area V1 are not abundant, but could be potentiated by the network of indirect connections.

Cingulate, frontal, and parietal cortical dysfunction in attention-deficit/hyperactivity disorder

Functional and structural neuroimaging have identified abnormalities of the brain that are likely to contribute to the neuropathophysiology of attention-deficit/hyperactivity disorder (ADHD). In particular, hypofunction of the brain regions comprising the cingulo-frontal-parietal cognitive-attention network have been consistently observed across studies. These are major components of neural systems that are relevant to ADHD, including cognitive/attention networks, motor systems, and reward/feedback-based processing systems. Moreover, these areas interact with other brain circuits that have been implicated in ADHD, such as the "default mode" resting state network. The ADHD imaging data related to cingulo-frontal-parietal network dysfunction will be selectively highlighted here to help facilitate its integration with the other information presented in this special issue. Together, these reviews will help shed light on the neurobiology of ADHD.

Right-hemispheric dominance for visual remapping in humans

We review evidence showing a right-hemispheric dominance for visuo-spatial processing and representation in humans. Accordingly, visual disorganization symptoms (intuitively related to remapping impairments) are observed in both neglect and constructional apraxia. More specifically, we review findings from the intervening saccade paradigm in humans--and present additional original data--which suggest a specific role of the asymmetrical network at the temporo-parietal junction (TPJ) in the right hemisphere in visual remapping: following damage to the right dorsal posterior parietal cortex (PPC) as well as part of the corpus callosum connecting the PPC to the frontal lobes, patient OK in a double-step saccadic task exhibited an impairment when the second saccade had to be directed rightward. This singular and lateralized deficit cannot result solely from the patient's cortical lesion and, therefore, we propose that it is due to his callosal lesion that may specifically interrupt the interhemispheric transfer of information necessary to execute accurate rightward saccades towards a remapped target location. This suggests a specialized right-hemispheric network for visuo-spatial remapping that subsequently transfers target location information to downstream planning regions, which are symmetrically organized.

Toward an integrated approach to perception and action: conference report and future directions

This article was motivated by the conference entitled “Perception & Action – An Interdisciplinary Approach to Cognitive Systems Theory,” which took place September 14–16, 2010 at the Santa Fe Institute, NM, USA. The goal of the conference was to bring together an interdisciplinary group of neuroscientists, roboticists, and theorists to discuss the extent and implications of action–perception integration in the brain. The motivation for the conference was the realization that it is a widespread approach in biological, theoretical, and computational neuroscience to investigate sensory and motor function of the brain in isolation from one another, while at the same time, it is generally appreciated that sensory and motor processing cannot be fully separated. Our article summarizes the key findings of the conference, provides a hypothetical model that integrates the major themes and concepts presented at the conference, and concludes with a perspective on future challenges in the field.

The eye dominates in guiding attention during simultaneous eye and hand movements

Prior to the onset of a saccade or a reach, attention is directed to the goal of the upcoming movement. However, it remains unknown whether attentional resources are shared across effectors for simultaneous eye and hand movements. Using a 4-AFC shape discrimination task, we investigated attentional allocation during the planning of a saccade alone, reach alone, or combined saccade and reach to one of five peripheral locations. Target discrimination was better when the probe appeared at the goal of the impending movement than when it appeared elsewhere. However, discrimination performance at the movement goal was not better for combined eye-hand movements compared to either effector alone, suggesting a shared limited attentional resource rather than separate pools of effector-specific attention. To test which effector dominates in guiding attention, we then separated eye and hand movement goals in two conditions: (1) cued reach/fixed saccade--subjects made saccades to the same peripheral location throughout the block, while the reach goal was cued and (2) cued saccade/fixed reach--subjects made reaches to the same location, while the saccade goal was cued. For both conditions, discrimination performance was consistently better at the eye goal than the hand goal. This indicates that shared attentional resources are guided predominantly by the eye during the planning of eye and hand movements.

Oscillations and filtering networks support flexible routing of information

The mammalian brain exhibits profuse interregional connectivity. How information flow is rapidly and flexibly switched among connected areas remains poorly understood. Task-dependent changes in the power and interregion coherence of network oscillations suggest that such oscillations play a role in signal routing. We show that switching one of several convergent pathways from an asynchronous to an oscillatory state allows accurate selective transmission of population-coded information, which can be extracted even when other convergent pathways fire asynchronously at comparable rates. We further show that the band-pass filtering required to perform this information extraction can be implemented in a simple spiking network model with a single feed-forward interneuron layer. This constitutes a mechanism for flexible signal routing in neural circuits, which exploits sparsely synchronized network oscillations and temporal filtering by feed-forward inhibition.

Branched thalamic afferents: what are the messages that they relay to the cortex?

Many of the axons that carry messages to the thalamus for relay to the cerebral cortex are branched in a pattern long known from Golgi preparations. They send one branch to the thalamus and the other to motor centers of the brainstem or spinal cord. Because the thalamic branches necessarily carry copies of the motor instructions their messages have the properties of efference copies. That is, they can be regarded as providing reliable information about impending instructions contributing to movements that will produce changes in inputs to receptors, thus allowing neural centers to compensate for these changes of input. We consider how a sensory pathway like the medial lemniscus, the spinothalamic tract or the optic tract can also be seen to act as a pathway for an efference copy. The direct connections that ascending and cortical inputs to the thalamus also establish to motor outputs create sensorimotor relationships that provide cortex with a model of activity in lower circuits and link the sensory and the motor sides of behavior more tightly than can be expected from motor outputs with a single, central origin. These transthalamic connectional patterns differ from classical models of separate neural pathways for carrying efference copies of actions generated at higher levels, and introduce some different functional possibilities.

Representation of the ipsilateral visual field by neurons in the macaque lateral intraparietal cortex depends on the forebrain commissures

Our eyes are constantly moving, allowing us to attend to different visual objects in the environment. With each eye movement, a given object activates an entirely new set of visual neurons, yet we perceive a stable scene. One neural mechanism that may contribute to visual stability is remapping. Neurons in several brain regions respond to visual stimuli presented outside the receptive field when an eye movement brings the stimulated location into the receptive field. The stored representation of a visual stimulus is remapped, or updated, in conjunction with the saccade. Remapping depends on neurons being able to receive visual information from outside the classic receptive field. In previous studies, we asked whether remapping across hemifields depends on the forebrain commissures. We found that, when the forebrain commissures are transected, behavior dependent on accurate spatial updating is initially impaired but recovers over time. Moreover, neurons in lateral intraparietal cortex (LIP) continue to remap information across hemifields in the absence of the forebrain commissures. One possible explanation for the preserved across-hemifield remapping in split-brain animals is that neurons in a single hemisphere could represent visual information from both visual fields. In the present study, we measured receptive fields of LIP neurons in split-brain monkeys and compared them with receptive fields in intact monkeys. We found a small number of neurons with bilateral receptive fields in the intact monkeys. In contrast, we found no such neurons in the split-brain animals. We conclude that bilateral representations in area LIP following forebrain commissures transection cannot account for remapping across hemifields.

Spatial updating in monkey superior colliculus in the absence of the forebrain commissures: dissociation between superficial and intermediate layers

In previous studies, we demonstrated that the forebrain commissures are the primary pathway for remapping from one hemifield to the other. Nonetheless, remapping in lateral intraparietal cortex (LIP) across hemifield is still present in split brain monkeys. This finding indicates that a subcortical structure must contribute to remapping. The primary goal of the current study was to characterize remapping activity in the superior colliculus in intact and split brain monkeys. We recorded neurons in both the superficial and intermediate layers of the SC. We found that across-hemifield remapping was reduced in magnitude and delayed compared with within-hemifield remapping in the intermediate layers of the SC in split brain monkeys. These results mirror our previous findings in area LIP. In contrast, we found no difference in the magnitude or latency for within- compared with across-hemifield remapping in the superficial layers. At the behavioral level, we compared the performance of the monkeys on two conditions of a double-step task. When the second target remained within a single hemifield, performance remained accurate. When the second target had to be updated across hemifields, the split brain monkeys' performance was impaired. Remapping activity in the intermediate layers was correlated with the accuracy and latency of the second saccade during the across-hemifield trials. Remapping in the superficial layers was correlated with latency of the second saccade during the within- and across-hemifield trials. The differences between the layers suggest that different circuits underlie remapping in the superficial and intermediate layers of the superior colliculus.

Getting real-sensory processing of natural stimuli

Normal sensory experience rarely presents us with isolated bars, gratings, or other stimuli that have shaped our knowledge of sensory representations. Instead, typical input adheres to certain statistical regularities, which make it 'natural' and cannot be adequately modeled by linear superposition of simple stimuli. Natural stimuli necessitate a paradigm shift with a focus on downstream processing. This shift currently follows three main lines: quantification of the information a downstream area can read out (decoding); describing a representation as the optimization of computational principles with respect to natural input (normative approach); understanding the sensory representation as optimal for the systems' tasks and intended actions (behavioral context). The interaction between representational levels, intermediate-level features, and bidirectional coupling through attention are key elements for sensory processing.

A deficit of spatial remapping in constructional apraxia after right-hemisphere stroke

Constructional apraxia refers to the inability of patients to copy accurately drawings or three-dimensional constructions. It is a common disorder after right parietal stroke, often persisting after initial problems such as visuospatial neglect have resolved. However, there has been very little experimental investigation regarding mechanisms that might contribute to the syndrome. Here, we examined whether a key deficit might be failure to integrate visual information correctly from one fixation to the next. Specifically, we tested whether this deficit might concern remapping of spatial locations across saccades. Right-hemisphere stroke patients with constructional apraxia were compared to patients without constructional problems and neurologically healthy controls. Participants judged whether a pattern shifted position (spatial task) or changed in pattern (non-spatial task) across two saccades, compared to a control condition with an equivalent delay but without intervening eye movements. Patients with constructional apraxia were found to be significantly impaired in position judgements with intervening saccades, particularly when the first saccade of the sequence was to the right. The importance of these remapping deficits in constructional apraxia was confirmed through a highly significant correlation between saccade task performance and constructional impairment on standard neuropsychological tasks. A second study revealed that even single saccades to the right can impair constructional apraxia patients' perception of location shifts. These data are consistent with the view that rightward eye movements result in loss of remembered spatial information from previous fixations, presumably due to constructional apraxia patients' damage to the right-hemisphere regions involved in remapping locations across saccades. These findings provide the first evidence for a deficit in remapping visual information across saccades underlying right-hemisphere constructional apraxia.

Visual stability based on remapping of attention pointers

When we move our eyes, we easily keep track of where relevant things are in the world. Recent proposals link this stability to the shifting of receptive fields of neurons in eye movement and attention control areas. Reports of 'spatiotopic' visual aftereffects have also been claimed to support this shifting connectivity even at an early level, but these results have been challenged. Here, the process of updating visual location is described as predictive shifts of location 'pointers' to attended targets, analogous to predictive activation seen cross-modally. We argue that these location pointers, the core operators of spatial attention, are linked to identity information and that such a link is necessary to establish a workable visual architecture and to explain frequently reported positive spatiotopic biases.

Attention-deficit/hyperactivity disorder and attention networks

Research attempting to elucidate the neuropathophysiology of attention-deficit/hyperactivity disorder (ADHD) has not only shed light on the disorder itself, it has simultaneously provided new insights into the mechanisms of normal cognition and attention. This review will highlight and integrate this bidirectional flow of information. Following a brief overview of ADHD clinical phenomenology, ADHD studies will be placed into a wider historical perspective by providing illustrative examples of how major models of attention have influenced the development of neurocircuitry models of ADHD. The review will then identify major components of neural systems potentially relevant to ADHD, including attention networks, reward/feedback-based processing systems, as well as a 'default mode' resting state network. Further, it will suggest ways in which these systems may interact and be influenced by neuromodulatory factors. Recent ADHD imaging data will be selectively provided to both illustrate the field's current level of knowledge and to show how such data can inform our understanding of normal brain functions. The review will conclude by suggesting possible avenues for future research.