The neural basis of visual attention

The use of the eye-fixation-related potential to investigate visual perception in professional domains with high attentional demand: a literature review

INTRODUCTION

Visual attention is a cognitive skill related to visual perception and neural activity, and also moderated by expertise, in time-constrained professional domains (e.g., aviation, driving, sport, surgery). However, the contribution of both perceptual and neural processes on performance has been studied separately in the literature.

DEVELOPMENT

We defend an integration of visual and neural signals to offer a more complete picture of the visual attention displayed by professionals of different skill levels when performing free-viewing tasks. Specifically, we propose to zoom the analysis in data related to the quiet eye and P300 component jointly, as a novel signal processing approach to evaluate professionals' visual attention.

CONCLUSION

This review highlights the advantages of using portable eye trackers and electroencephalogram systems altogether, as a promising technique for a better understanding of early cognitive components related to attentional processes. Altogether, the eye-fixation-related potentials method may provide a better understanding of the cognitive mechanisms employed by the participants in natural settings, revealing what visual information is of interest for participants and distinguishing the neural bases of visual attention between targets and non-targets whenever they perceive a stimulus during free viewing experiments.

EEG Microstate Associated with Trait Nostalgia

Nostalgia, a self-related emotion characterized by its bittersweet yet predominantly positive nature, plays a vital role in shaping individual psychology and behavior. This includes impacts on mental and physical health, behavioral patterns, and cognitive functions. However, higher levels of trait nostalgia may be linked to potential adverse outcomes, such as increased loneliness, heightened neuroticism, and more intense experiences of grief. The specific electroencephalography (EEG) feature associated with individuals exhibiting trait nostalgia, and how it differs from others, remains an area of uncertainty. To address this, our study employs microstate analysis to investigate the differences in resting-state EEG between individuals with varying levels of trait nostalgia. We assessed trait nostalgia in 63 participants using the Personal Inventory of Nostalgia and collected their resting-state EEG signals with eyes closed. The results of the regression analysis indicate a significant correlation between trait nostalgia and the temporal characteristics of microstates A, B, and C. Further, the occurrence of microstate B was significantly more frequent in the high trait nostalgia group than in the low trait nostalgia group. Independent samples t-test results showed that the transition probability between microstates A and B was significantly higher in the high trait nostalgia group. These results support the hypothesis that trait nostalgia is reflected in the resting state brain activity. Furthermore, they reveal a deeper sensory immersion in nostalgia experiences among individuals with high levels of trait nostalgia, and highlight the critical role of self-referential and autobiographical memory processes in nostalgia.

A different perspective on avian hippocampus function: Visual-spatial perception

The behavioral and neural mechanisms that support spatial cognition have been an enduring interest of psychologists, and much of that enduring interest is attributable to the groundbreaking research of Ken Cheng. One manifestation of this interest, inspired by the idea of studying spatial cognition under natural field conditions, has been research carried out to understand the role of the avian hippocampal formation (HF) in supporting homing pigeon navigation. Emerging from that research has been the conclusion that the role of HF in homing pigeon navigation aligns well with the canonical narrative of a hippocampus important for spatial memory and the implementation of such memories to support navigation. However, recently an accumulation of disparate observations has prompted a rethinking of the avian HF as a structure also important in shaping visual-spatial perception or attention antecedent to any memory processing. In this perspective paper, we summarize field observations contrasting the behavior of intact and HF-lesioned homing pigeons from several studies, based primarily on GPS-recorded flight paths, that support a recharacterization of HF's functional profile to include visual-spatial perception. Although admittedly still speculative, we hope the offered perspective will motivate controlled, experimental-laboratory studies to further test the hypothesis of a HF important for visual-perceptual integration, or scene construction, of landscape elements in support of navigation.

Pre-saccadic Neural Enhancements in Marmoset Area MT

Each time we make an eye movement, attention moves before the eyes, resulting in a perceptual enhancement at the target. Recent psychophysical studies suggest that this pre-saccadic attention enhances the visual features at the saccade target, whereas covert attention causes only spatially selective enhancements. While previous nonhuman primate studies have found that pre-saccadic attention does enhance neural responses spatially, no studies have tested whether changes in neural tuning reflect an automatic feature enhancement. Here we examined pre-saccadic attention using a saccade foraging task developed for marmoset monkeys (one male and one female). We recorded from neurons in the middle temporal area with peripheral receptive fields that contained a motion stimulus, which would either be the target of a saccade or a distracter as a saccade was made to another location. We established that marmosets, like macaques, show enhanced pre-saccadic neural responses for saccades toward the receptive field, including increases in firing rate and motion information. We then examined if the specific changes in neural tuning might support feature enhancements for the target. Neurons exhibited diverse changes in tuning but predominantly showed additive and multiplicative increases that were uniformly applied across motion directions. These findings confirm that marmoset monkeys, like macaques, exhibit pre-saccadic neural enhancements during saccade foraging tasks with minimal training requirements. However, at the level of individual neurons, the lack of feature-tuned enhancements is similar to neural effects reported during covert spatial attention.

A focus on the multiple interfaces between action and perception and their neural correlates

Successful behaviour relies on the appropriate interplay between action and perception. The well-established dorsal and ventral stream theories depicted two distinct functional pathways for the processes of action and perception, respectively. In physiological conditions, the two pathways closely cooperate in order to produce successful adaptive behaviour. As the coupling between perception and action exists, this requires an interface that is responsible for a common reading of the two functions. Several studies have proposed different types of perception and action interfaces, suggesting their role in the creation of the shared interaction channel. In the present review, we describe three possible perception and action interfaces: i) the motor code, including common coding approaches, ii) attention, and iii) object affordance; we highlight their potential neural correlates. From this overview, a recurrent neural substrate that underlies all these interface functions appears to be crucial: the parieto-frontal circuit. This network is involved in the mirror mechanism which underlies the perception and action interfaces identified as common coding and motor code theories. The same network is also involved in the spotlight of attention and in the encoding of potential action towards objects; these are manifested in the perception and action interfaces for common attention and object affordance, respectively. Within this framework, most studies were dedicated to the description of the role of the inferior parietal lobule; growing evidence, however, suggests that the superior parietal lobule also plays a crucial role in the interplay between action and perception. The present review proposes a novel model that is inclusive of the superior parietal regions and their relative contribution to the different action and perception interfaces.

A representation of abstract linguistic categories in the visual system underlies successful lipreading

There is considerable debate over how visual speech is processed in the absence of sound and whether neural activity supporting lipreading occurs in visual brain areas. Much of the ambiguity stems from a lack of behavioral grounding and neurophysiological analyses that cannot disentangle high-level linguistic and phonetic/energetic contributions from visual speech. To address this, we recorded EEG from human observers as they watched silent videos, half of which were novel and half of which were previously rehearsed with the accompanying audio. We modeled how the EEG responses to novel and rehearsed silent speech reflected the processing of low-level visual features (motion, lip movements) and a higher-level categorical representation of linguistic units, known as visemes. The ability of these visemes to account for the EEG - beyond the motion and lip movements - was significantly enhanced for rehearsed videos in a way that correlated with participants' trial-by-trial ability to lipread that speech. Source localization of viseme processing showed clear contributions from visual cortex, with no strong evidence for the involvement of auditory areas. We interpret this as support for the idea that the visual system produces its own specialized representation of speech that is (1) well-described by categorical linguistic features, (2) dissociable from lip movements, and (3) predictive of lipreading ability. We also suggest a reinterpretation of previous findings of auditory cortical activation during silent speech that is consistent with hierarchical accounts of visual and audiovisual speech perception.

Performing a vibrotactile discrimination task modulates finger representations in primary somatosensory cortex

It is well established that vibrotactile stimuli are represented in somatotopic maps. However, less is known about whether these somatotopic representations are modulated by task demands and maybe even in the absence of tactile input. Here, we used a vibrotactile discrimination task as a tool to investigate these questions in further detail. Participants were required to actively perceive and process tactile stimuli in comparison to a no-task control condition where identical stimuli were passively perceived (no-memory condition). Importantly, both vibrotactile stimuli were either applied to the right index or little finger, allowing us to investigate whether cognitive task demands shape finger representations in primary somatosensory cortex (S1). Using multivoxel pattern analysis and representational similarity analysis, we found that S1 finger representations were more distinct during the memory than the no-memory condition. Interestingly, this effect was not only observed while tactile stimuli were presented but also during the delay period (i.e., in the absence of tactile stimulation). Our findings imply that when individuals are required to focus on tactile stimuli, retain them in their memory, and engage in active processing of distinctive stimulus features, this exerts a modulatory effect on the finger representations present in S1.NEW & NOTEWORTHY Using multivoxel pattern analysis, we found that discrimination task demands shape finger representations in the contralateral primary somatosensory cortex (S1), and that somatotopic representations are modulated by task demands not only during tactile stimulation but also to a certain extent in the absence of tactile input.

The Architecture of Object-Based Attention

The allocation of attention to objects raises several intriguing questions: What are objects, how does attention access them, what anatomical regions are involved? Here, we review recent progress in the field to determine the mechanisms underlying object-based attention. First, findings from unconscious priming and cueing suggest that the preattentive targets of object-based attention can be fully developed object representations that have reached the level of identity. Next, the control of object-based attention appears to come from ventral visual areas specialized in object analysis that project downward to early visual areas. How feedback from object areas can accurately target the object's specific locations and features is unknown but recent work in autoencoding has made this plausible. Finally, we suggest that the three classic modes of attention may not be as independent as is commonly considered, and instead could all rely on object-based attention. Specifically, studies show that attention can be allocated to the separated members of a group-without affecting the space between them-matching the defining property of feature-based attention. At the same time, object-based attention directed to a single small item has the properties of space-based attention. We outline the architecture of object-based attention, the novel predictions it brings, and discuss how it works in parallel with other attention pathways.

Integrated effects of top-down attention and statistical learning during visual search: An EEG study

The present study aims to investigate how the competition between visual elements is solved by top-down and/or statistical learning (SL) attentional control (AC) mechanisms when active together. We hypothesized that the "winner" element that will undergo further processing is selected either by one AC mechanism that prevails over the other, or by the joint activity of both mechanisms. To test these hypotheses, we conducted a visual search experiment that combined an endogenous cueing protocol (valid vs. neutral cue) and an imbalance of target frequency distribution across locations (high- vs. low-frequency location). The unique and combined effects of top-down control and SL mechanisms were measured on behaviour and amplitudes of three evoked-response potential (ERP) components (i.e., N2pc, P1, CNV) related to attentional processing. Our behavioural results showed better performance for validly cued targets and for targets in the high-frequency location. The two factors were found to interact, so that SL effects emerged only in the absence of top-down guidance. Whereas the CNV and P1 only displayed a main effect of cueing, for the N2pc we observed an interaction between cueing and SL, revealing a cueing effect for targets in the low-frequency condition, but not in the high-frequency condition. Thus, our data support the view that top-down control and SL work in a conjoint, integrated manner during target selection. In particular, SL mechanisms are reduced or even absent when a fully reliable top-down guidance of attention is at play.

Spike rates of frontal eye field neurons predict reaction times in a spatial attention task

Which neuronal signal(s) predict reaction times when subjects respond to a target at covertly attended locations? Although recent studies showed that spike rates are not predictive, it remains a highly contested question. Therefore, we record single-unit activity from frontal eye field (FEF) neurons while macaques are performing a covert spatial attention task. We find that the attentional modulation of spike rates of FEF neurons is strongly correlated with behavioral reaction times. Moreover, this correlation already emerges 1 s before target dimming, which triggers the behavioral responses. This prediction of reaction times by spike rates is found in neurons showing attention-dependent enhanced and suppressed activity for targets and distractors, respectively, yet in varying degrees across subjects. Thus, spike rates of FEF neurons can predict reaction times persistently and well before the operant behavior during selective attention tasks. Such long prediction windows will be useful for developing spike-based brain-machine interfaces.

Emotional design pictures: Pleasant but too weak to evoke arousal and attract attention?

A new field of research builds on the theoretical assumption that distinct design manipulations, such as human-like features with appealing colors (emotional design), foster multimedia learning by influencing the learners' affective state (i.e., valence and arousal) and attention. Empirical studies, however, provide inconsistent findings of the affective potential of emotional design, underlining the need for psychophysiological measurements to assess the affective state and attention more objectively. The effects of differently designed stimuli (picture-text combinations with anthropomorphic pictures in bright and saturated colors [emotional design], picture-text combinations with non-anthropomorphic pictures in grayscale [neutral design], and plain text [control design]) on junior high school students' valence (N = 15), arousal (N = 18), and attention (N = 27) were examined. Valence was determined by students' judgments on a rating scale; arousal and attention were assessed by psychophysiological parameters (electrodermal activity of students and their dwell time on stimuli, respectively). To allow the examination of valence and arousal as separate dimensions, two independent experiments were conducted. Results of experiment I show that students perceived emotional design stimuli as more pleasant than stimuli in neutral or control design. Besides, an interaction with the content of the stimuli was found. While the positive effect of the emotional design was found for concepts that could be interpreted as potentially positive (e.g., sunlight) or neutral (e.g., consumer), stimuli representing potentially negative concepts (e.g., dead consumer) were not perceived as more pleasant if presented in emotional design. Experiment II shows that emotional design did not induce higher arousal than neutral and control designs and did not attract more attention. Instead, the text within picture-text combinations (emotional and neutral designs) attracted more attention when pictures were presented in neutral than in emotional design. By investigating the emotional state more differentiated and by examining arousal and attention using psychophysiological parameters, the present study helps to understand the heterogeneous findings of previous studies.

Frontal eye fields in macaque monkeys: prefrontal and premotor contributions to visually guided saccades

Neuronal spiking was sampled from the frontal eye field (FEF) and from the rostral part of area 6 that reaches to the superior limb of the arcuate sulcus, dorsal to the arcuate spur when present (F2vr) in macaque monkeys performing memory-guided saccades and visually guided saccades for visual search. Neuronal spiking modulation in F2vr resembled that in FEF in many but not all respects. A new consensus clustering algorithm of neuronal modulation patterns revealed that F2vr and FEF contain a greater variety of modulation patterns than previously reported. The areas differ in the proportions of visuomotor neuron types, the proportions of neurons discriminating a target from distractors during visual search, and the consistency of modulation patterns across tasks. However, between F2vr and FEF we found no difference in the magnitude of delay period activity, the timing of the peak discharge rate relative to saccades, or the time of search target selection. The observed similarities and differences between the 2 cortical regions contribute to other work establishing the organization of eye fields in the frontal lobe and may help explain why FEF in monkeys is identified within granular prefrontal area 8 but in humans is identified within agranular premotor area 6.

Temporal order judgments and presaccadic shifts of attention: What can prior entry teach us about the premotor theory?

A temporal order judgment (TOJ) 2-alternative forced choice design was used to examine presaccadic shifts of attention. Prior work on the premotor theory of attention (PTA) has predominantly focused on single-target discrimination tasks as a tool to measure accuracy and shifts of attention. It is important to demonstrate that the PTA is effective across attentional tasks that have been shown to be reliable in other contexts. Therefore, it was decided to use a perceptual task that probes multiple locations simultaneously and can equally be used to examine spatial spread of attention in more detail. In typical TOJ studies, prior entry is the metric used to measure an attentional effect. Prior entry is the biasing of temporal perception toward an attentionally cued location. This generally manifests as observers processing events at the cued location more rapidly, altering their perspective of temporal order. Participants were required to prepare saccades toward one of four targets, two of which would light up either synchronously or sequentially after a GO signal but before saccadic execution. Results demonstrated that in conditions with critical stimulus onset asynchronies, saccade preparation had a significant effect on performance. Prior entry effects were observed at saccade congruent locations with probes at these locations being typically perceived earlier than probes presented at a neutral location. These effects were not observed in control trials without a saccade. A further spatial effect was demonstrated for the attentional modulation, suggesting that this effect is restricted predominantly to horizontal configurations. Overall, results demonstrated that presaccadic attention is effective at eliciting a prior entry effect in TOJ designs and that such effects are more pronounced when the probes are distributed across the two lateral hemifields.

Look twice: A generalist computational model predicts return fixations across tasks and species

Primates constantly explore their surroundings via saccadic eye movements that bring different parts of an image into high resolution. In addition to exploring new regions in the visual field, primates also make frequent return fixations, revisiting previously foveated locations. We systematically studied a total of 44,328 return fixations out of 217,440 fixations. Return fixations were ubiquitous across different behavioral tasks, in monkeys and humans, both when subjects viewed static images and when subjects performed natural behaviors. Return fixations locations were consistent across subjects, tended to occur within short temporal offsets, and typically followed a 180-degree turn in saccadic direction. To understand the origin of return fixations, we propose a proof-of-principle, biologically-inspired and image-computable neural network model. The model combines five key modules: an image feature extractor, bottom-up saliency cues, task-relevant visual features, finite inhibition-of-return, and saccade size constraints. Even though there are no free parameters that are fine-tuned for each specific task, species, or condition, the model produces fixation sequences resembling the universal properties of return fixations. These results provide initial steps towards a mechanistic understanding of the trade-off between rapid foveal recognition and the need to scrutinize previous fixation locations.

Emotional scene remembering: A combination of disturbing and facilitating effects of emotion?

An emotion-induced memory trade-off effect is frequently reported when participants have to memorize complex items that include both neutral and emotional features. This bias corresponds to better remembering of central emotional information accompanied by poor performance related to neutral background information. Although the trade-off effect has been mainly associated with attentional bias toward emotional content, findings suggest that other non-attentional cognitive processes could also be involved. The aim of this work was to assess whether emotional effects would be reported apart from their influence on attentional processing in an immediate delay memory task. Three studies were conducted. In Study 1, manipulation of the diffusion quality of emotional content allowed us to select focal emotional pictures vs. diffuse emotional pictures, which prevented attentional focus. The two studies that followed consisted of a recognition task of low- and high-complexity pictures in which we used partial visual cues during the test that could display either the emotional elements (i.e., central patch cues, Study 2) or the peripheral elements (i.e., peripheral patch cues, Study 3) of the focal emotional pictures. Results from Studies 2 and 3 replicated traditional trade-off effects only for high-complexity pictures. In addition, diffuse emotional pictures were associated with lower memory performance than were neutral pictures, suggesting that emotion features could both disturb and enhance (via their attentional effect) encoding processes.

Emphasizing speed or accuracy in an eye-tracking version of the Trail-Making-Test: Towards experimental diagnostics for decomposing executive functions

The Trail-Making-Test (TMT) is one of the most widely used neuropsychological tests for assessing executive functions, the brain functions underlying cognitively controlled thought and action. Obtaining a number of test scores at once, the TMT allows to characterize an assortment of executive functions efficiently. Critically, however, as most test scores are derived from test completion times, the scores only provide a summary measure of various cognitive control processes. To address this problem, we extended the TMT in two ways. First, using a computerized eye-tracking version of the TMT, we added specific eye movement measures that deliver a richer set of data with a higher degree of cognitive process specificity. Second, we included an experimental manipulation of a fundamental executive function, namely participants’ ability to emphasize speed or accuracy in task performance. Our study of healthy participants showed that eye movement measures differed between TMT conditions that are usually compared to assess the cognitive control process of alternating between task sets for action control. This demonstrates that eye movement measures are indeed sensitive to executive functions implicated in the TMT. Crucially, comparing performance under cognitive control sets of speed vs. accuracy emphasis revealed which test scores primarily varied due to this manipulation (e.g., trial duration, number of fixations), and which were still more sensitive to other differences between individuals (e.g., fixation duration, saccade amplitude). This provided an experimental construct validation of the test scores by distinguishing scores primarily reflecting the executive function of emphasizing speed vs. accuracy and those independent from it. In sum, both the inclusion of eye movement measures and of the experimental manipulation of executive functions in the TMT enabled a more specific interpretation of the TMT in terms of cognitive functions and mechanisms, which offers more precise diagnoses in clinical applications and basic research.

Beyond the brain-computer interface: Decoding brain activity as a tool to understand neuronal mechanisms subtending cognition and behavior

One of the major challenges in system neurosciences consists in developing techniques for estimating the cognitive information content in brain activity. This has an enormous potential in different domains spanning from clinical applications, cognitive enhancement to a better understanding of the neural bases of cognition. In this context, the inclusion of machine learning techniques to decode different aspects of human cognition and behavior and its use to develop brain–computer interfaces for applications in neuroprosthetics has supported a genuine revolution in the field. However, while these approaches have been shown quite successful for the study of the motor and sensory functions, success is still far from being reached when it comes to covert cognitive functions such as attention, motivation and decision making. While improvement in this field of BCIs is growing fast, a new research focus has emerged from the development of strategies for decoding neural activity. In this review, we aim at exploring how the advanced in decoding of brain activity is becoming a major neuroscience tool moving forward our understanding of brain functions, providing a robust theoretical framework to test predictions on the relationship between brain activity and cognition and behavior.

The perceived duration of expected events depends on how the expectation is formed

Repeated events can seem shortened. It has been suggested that this results from an inverse relationship between predictability and perceived duration, with more predictable events seeming shorter. Some evidence disputes this generalisation, as there are cases where this relationship has been nullified, or even reversed. This study sought to combine different factors that encourage expectation into a single paradigm, to directly compare their effects. We find that when people are asked to declare a prediction (i.e., to predict which colour sequence will ensue), guess-confirming events can seem relatively protracted. This augmented a positive time-order error, with the first of two sequential presentations already seeming protracted. We did not observe a contraction of perceived duration for more probable or for repeated events. Overall, our results are inconsistent with a simple mapping between predictability and perceived duration. Whether the perceived duration of an expected event will seem relatively contracted or expanded seems to be contingent on the causal origin of expectation.

Visual Attention in the Prefrontal Cortex

Voluntary attention selects behaviorally relevant signals for further processing while filtering out distracter signals. Neural correlates of voluntary visual attention have been reported across multiple areas of the primate visual processing streams, with the earliest and strongest effects isolated in the prefrontal cortex. In this article, I review evidence supporting the hypothesis that signals guiding the allocation of voluntary attention emerge in areas of the prefrontal cortex and reach upstream areas to modulate the processing of incoming visual information according to its behavioral relevance. Areas located anterior and dorsal to the arcuate sulcus and the frontal eye fields produce signals that guide the allocation of spatial attention. Areas located anterior and ventral to the arcuate sulcus produce signals for feature-based attention. Prefrontal microcircuits are particularly suited to supporting voluntary attention because of their ability to generate attentional template signals and implement signal gating and their extensive connectivity with the rest of the brain. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Learning induces coordinated neuronal plasticity of metabolic demands and functional brain networks

The neurobiological basis of learning is reflected in adaptations of brain structure, network organization and energy metabolism. However, it is still unknown how different neuroplastic mechanisms act together and if cognitive advancements relate to general or task-specific changes. Therefore, we tested how hierarchical network interactions contribute to improvements in the performance of a visuo-spatial processing task by employing simultaneous PET/MR neuroimaging before and after a 4-week learning period. We combined functional PET and metabolic connectivity mapping (MCM) to infer directional interactions across brain regions. Learning altered the top-down regulation of the salience network onto the occipital cortex, with increases in MCM at resting-state and decreases during task execution. Accordingly, a higher divergence between resting-state and task-specific effects was associated with better cognitive performance, indicating that these adaptations are complementary and both required for successful visuo-spatial skill learning. Simulations further showed that changes at resting-state were dependent on glucose metabolism, whereas those during task performance were driven by functional connectivity between salience and visual networks. Referring to previous work, we suggest that learning establishes a metabolically expensive skill engram at rest, whose retrieval serves for efficient task execution by minimizing prediction errors between neuronal representations of brain regions on different hierarchical levels.

Brain network analyses reveal coupled changes between functional connectivity and metabolic demands that relate to cognitive performance improvements induced by learning a challenging visuo-spatial task for four weeks.

The Ecological View of Selective Attention

Accumulating evidence is supporting the hypothesis that our selective attention is a manifestation of mechanisms that evolved early in evolution and are shared by many organisms from different taxa. This surge of new data calls for the re-examination of our notions about attention, which have been dominated mostly by human psychology. Here, we present an hypothesis that challenges, based on evolutionary grounds, a common view of attention as a means to manage limited brain resources. We begin by arguing that evolutionary considerations do not favor the basic proposition of the limited brain resources view of attention, namely, that the capacity of the sensory organs to provide information exceeds the capacity of the brain to process this information. Moreover, physiological studies in animals and humans show that mechanisms of selective attention are highly demanding of brain resources, making it paradoxical to see attention as a means to release brain resources. Next, we build on the above arguments to address the question why attention evolved in evolution. We hypothesize that, to a certain extent, limiting sensory processing is adaptive irrespective of brain capacity. We call this hypothesis the ecological view of attention (EVA) because it is centered on interactions of an animal with its environment rather than on internal brain resources. In its essence is the notion that inherently noisy and degraded sensory inputs serve the animal’s adaptive, dynamic interactions with its environment. Attention primarily functions to resolve behavioral conflicts and false distractions. Hence, we evolved to focus on a particular target at the expense of others, not because of internal limitations, but to ensure that behavior is properly oriented and committed to its goals. Here, we expand on this notion and review evidence supporting it. We show how common results in human psychophysics and physiology can be reconciled with an EVA and discuss possible implications of the notion for interpreting current results and guiding future research.

Transient neuronal suppression for exploitation of new sensory evidence

In noisy but stationary environments, decisions should be based on the temporal integration of sequentially sampled evidence. This strategy has been supported by many behavioral studies and is qualitatively consistent with neural activity in multiple brain areas. By contrast, decision-making in the face of non-stationary sensory evidence remains poorly understood. Here, we trained monkeys to identify and respond via saccade to the dominant color of a dynamically refreshed bicolor patch that becomes informative after a variable delay. Animals’ behavioral responses were briefly suppressed after evidence changes, and many neurons in the frontal eye field displayed a corresponding dip in activity at this time, similar to that frequently observed after stimulus onset but sensitive to stimulus strength. Generalized drift-diffusion models revealed consistency of behavior and neural activity with brief suppression of motor output, but not with pausing or resetting of evidence accumulation. These results suggest that momentary arrest of motor preparation is important for dynamic perceptual decision making.

While evidence is constantly changing during real-world decisions, little is known about how the brain deals with such changes. Here, the authors show that the brain strategically suppresses motor output via the frontal eye fields in response to stimulus changes.

Visual Search Asymmetry: Deep Nets and Humans Share Similar Inherent Biases

Visual search is a ubiquitous and often challenging daily task, exemplified by looking for the car keys at home or a friend in a crowd. An intriguing property of some classical search tasks is an asymmetry such that finding a target A among distractors B can be easier than finding B among A. To elucidate the mechanisms responsible for asymmetry in visual search, we propose a computational model that takes a target and a search image as inputs and produces a sequence of eye movements until the target is found. The model integrates eccentricity-dependent visual recognition with target-dependent top-down cues. We compared the model against human behavior in six paradigmatic search tasks that show asymmetry in humans. Without prior exposure to the stimuli or task-specific training, the model provides a plausible mechanism for search asymmetry. We hypothesized that the polarity of search asymmetry arises from experience with the natural environment. We tested this hypothesis by training the model on augmented versions of ImageNet where the biases of natural images were either removed or reversed. The polarity of search asymmetry disappeared or was altered depending on the training protocol. This study highlights how classical perceptual properties can emerge in neural network models, without the need for task-specific training, but rather as a consequence of the statistical properties of the developmental diet fed to the model. All source code and data are publicly available at https://github.com/kreimanlab/VisualSearchAsymmetry.

Eye Direction Detection and Perception as Premises of a Social Brain: A Narrative Review of Behavioral and Neural Data

The eyes and the gaze are important stimuli for social interaction in humans. Impaired recognition of facial identity, facial emotions, and inference of the intentions of others may result from difficulties in extracting information relevant to the eye region, mainly the direction of gaze. Therefore, a review of these data is of interest. Behavioral data demonstrating the importance of the eye region and how humans respond to gaze direction are reviewed narratively, and several theoretical models on how visual information on gaze is processed are discussed to propose a unified hypothesis. Several issues that have not yet been investigated are identified. The authors tentatively suggest experiments that might help progress research in this area. The neural aspects are subsequently reviewed to best describe the low-level and higher-level visual information processing stages in the targeted subcortical and cortical areas. A specific neural network is proposed on the basis of the literature. Various gray areas, such as the temporality of the processing of visual information, the question of salience priority, and the coordination between the two hemispheres, remain unclear and require further investigations. Finally, disordered gaze direction detection mechanisms and their consequences on social cognition and behavior are discussed as key deficiencies in several conditions, such as autism spectrum disorder, 22q11.2 deletion, schizophrenia, and social anxiety disorder. This narrative review provides significant additional data showing that the detection and perception of someone's gaze is an essential part of the development of our social brain.

Attention reduces the burstiness of V1 neurons involved in attended target enhancement

Attention-dependent reduction in the tendency for neurons to fire bursts (burstiness) is widely observed in the visual cortex. However, the underlying mechanism and the functional role of this phenomenon remain unclear. We recorded well-isolated single-unit activities in primary visual cortex (V1) from two primates (Macaca mulatta) while they performed a detection task engaging spatial attention with two levels of difficulty (hard/easy). We found that attention modulated burstiness of V1 neurons in a cell-type specific manner. For neurons whose net response enhanced with the increase of task difficulty (difficulty-enhanced neuron), representing their involvement in boosting the signal of the attended stimulus, attention led to a reduction in burstiness during hard task but not during easy task. In contrast, regardless of the level of task difficulty, attention-dependent reduction in burstiness was not observed in neurons that showed a net suppression in firing rate with the increase of task difficulty (difficulty-suppressed neuron), indicating their commitment in filtering out the interference of distractor. This differentiation in the effects of attentional modulation on burstiness among the cells with distinct functional roles in attention suggests that the reduction in burstiness by attention is linked to target enhancement and is not associated with distractor suppression.

Dissociable Cortical and Subcortical Mechanisms for Mediating the Influences of Visual Cues on Microsaccadic Eye Movements

Visual selection in primates is intricately linked to eye movements, which are generated by a network of cortical and subcortical neural circuits. When visual selection is performed covertly, without foveating eye movements toward the selected targets, a class of fixational eye movements, called microsaccades, is still involved. Microsaccades are small saccades that occur when maintaining precise gaze fixation on a stationary point, and they exhibit robust modulations in peripheral cueing paradigms used to investigate covert visual selection mechanisms. These modulations consist of changes in both microsaccade directions and frequencies after cue onsets. Over the past two decades, the properties and functional implications of these modulations have been heavily studied, revealing a potentially important role for microsaccades in mediating covert visual selection effects. However, the neural mechanisms underlying cueing effects on microsaccades are only beginning to be investigated. Here we review the available causal manipulation evidence for these effects' cortical and subcortical substrates. In the superior colliculus (SC), activity representing peripheral visual cues strongly influences microsaccade direction, but not frequency, modulations. In the cortical frontal eye fields (FEF), activity only compensates for early reflexive effects of cues on microsaccades. Using evidence from behavior, theoretical modeling, and preliminary lesion data from the primary visual cortex and microstimulation data from the lower brainstem, we argue that the early reflexive microsaccade effects arise subcortically, downstream of the SC. Overall, studying cueing effects on microsaccades in primates represents an important opportunity to link perception, cognition, and action through unaddressed cortical-subcortical neural interactions. These interactions are also likely relevant in other sensory and motor modalities during other active behaviors.

Role of vergence eye movements in the visual recognition of long time duration

When viewing dichoptic stimuli in long time duration, visual percepts are always the alternation between the left and right eye inputs, while not the combination. This is known as binocular rivalry. An efficient coding theory reported that binocular visual inputs can be combined into binocular summation (S₊) and difference (S_-) channels in V1 brain area. In this study, we used specially designed stimuli as the previous study, in which monocular inputs caused ambiguous percepts, but S₊ and S_- channels had unambiguous percepts. We aim to investigate whether the visual percepts alter between S₊ and S_- channels in long time duration and whether vergence eye movements are involved in the process. To do so, the stimuli were presented in 300-s time duration in a trial, and a binocular eye tracker was used to record eye information. Participants' real-time behavioral responses about the visual percepts and binocular information were recorded simultaneously. The results show there are perceptual flips between S₊ and S_- channels in both central and long time viewing conditions. More importantly, in central vision there are vergence eye movements before perceptual flips, suggesting the involvement of high level visual attention; the time of a perceptual flip from S₊ is shorter than that of a flip from S_-, which might be due to different involvements of visual attention, indicating a bias of feedback connection from higher brain areas for visual attention to S₊ channel. Since S₊ and S_- dominated signals can be carried by different types of binocular neurons, our results provide new insights into high level visual attention and binocular neurons in V1 brain area by using specially designed dichoptic stimuli and eye vergence as measuring tools.

Functional connectivity at rest captures individual differences in visual search

Brain functional connectivity is supposed to capture personal and lifetime learning experiences and contribute to generating individual differences in cognitive abilities. We tested this possibility using the visual search task as a measure of visual information processing and the functioning of the visual attention control system. Forty-two undergraduate students completed a functional MRI study with a resting-state session and a visual search task scan. The visual attention and control systems were studied by investigating the functional connectivity of the primary visual area, the posterior parietal cortex, the dorsolateral prefrontal cortex, and the dorsal anterior cingulate cortex because these areas have been closely related to the visual search task. A pairwise resting-state functional connectivity analysis was conducted between these regions, followed by a correlation analysis with the behavioral measures from the visual search task. Results showed that higher connectivity values between the posterior parietal cortex and the dorsal anterior cingulate cortex were positively correlated with faster response speed. The posterior parietal cortex has been related to the formation of priority maps and the integration of sensory and executive information. Inhibitory control, performance monitoring during top-down cognitive tasks, and target detection have been associated with the dorsal anterior cingulate cortex. In light of these results, we suggest that a priori enhanced connectivity between these regions defines individual differences in visual information processing and the ability to adapt to cognitive demands.

Visual processing speed in hemianopia patients secondary to acquired brain injury: a new assessment methodology

Background

There is a clinical need to identify diagnostic parameters that objectively quantify and monitor the effective visual ability of patients with homonymous visual field defects (HVFDs). Visual processing speed (VPS) is an objective measure of visual ability. It is the reaction time (RT) needed to correctly search and/or reach for a visual stimulus. VPS depends on six main brain processing systems: auditory-cognitive, attentional, working memory, visuocognitive, visuomotor, and executive. We designed a new assessment methodology capable of activating these six systems and measuring RTs to determine the VPS of patients with HVFDs.

Methods

New software was designed for assessing subject visual stimulus search and reach times (S-RT and R-RT respectively), measured in seconds. Thirty-two different everyday visual stimuli were divided in four complexity groups that were presented along 8 radial visual field positions at three different eccentricities (10^o, 20^o, and 30^o). Thus, for each HVFD and control subject, 96 S- and R-RT measures related to VPS were registered. Three additional variables were measured to gather objective data on the validity of the test: eye-hand coordination mistakes (ehcM), eye-hand coordination accuracy (ehcA), and degrees of head movement (dHM, measured by a head-tracker system). HVFD patients and healthy controls (30 each) matched by age and gender were included. Each subject was assessed in a single visit. VPS measurements for HFVD patients and control subjects were compared for the complete test, for each stimulus complexity group, and for each eccentricity.

Results

VPS was significantly slower (p < 0.0001) in the HVFD group for the complete test, each stimulus complexity group, and each eccentricity. For the complete test, the VPS of the HVFD patients was 73.0% slower than controls. They also had 335.6% more ehcMs, 41.3% worse ehcA, and 189.0% more dHMs than the controls.

Conclusions

Measurement of VPS by this new assessment methodology could be an effective tool for objectively quantifying the visual ability of HVFD patients. Future research should evaluate the effectiveness of this novel method for measuring the impact that any specific neurovisual rehabilitation program has for these patients.

Visual Attention Modulates Phenomenal Consciousness: Evidence From a Change Detection Study

The distinction between phenomenal and access consciousness has been influential in the field of consciousness studies. Both Block and Lamme proposed that access consciousness, or narrow cognitive accessibility, is related to a limited capacity working memory, and that phenomenal consciousness, or broad cognitive accessibility, is related to iconic memory or, more recently, to a fragile (intermediate) short-term memory store with a larger capacity than working memory. They have also highlighted the preattentive nature of phenomenal consciousness and of the related iconic and fragile visual short-term stores, thus selectively linking attention with access consciousness, in line with Baars and Dehaene, among others. However, a range of electrophysiological and neurophysiological studies suggest that visual attention can affect early responses of neurons in visual cortex, before conscious access. Furthermore, some theories and neurocomputational models suggest earlier attentional biases related to phenomenal consciousness. To solve this controversy, and to shed light on the relationships of attention with iconic memory and subsequent stages of visual maintenance, we conducted an experiment with a novel procedure of change detection based on delayed cueing of the target for report with high- and low-priority objects marked by color. In line with our hypothesis, the results show an attentional bias toward high-priority objects in the memory array with the longer (600 and 1,200 ms) cueing delays associated with a fragile (intermediate) visual short-term memory, but not with the shorter cueing delays (16.6 and 200 ms) associated with iconic memory. These findings therefore suggest two stages of phenomenal consciousness before access consciousness: a first preattentive stage related to iconic memory and a second stage related to fragile visual short-term memory intermediate between iconic and visual working memory, which is modulated by visual attention in a time-dependent manner. Finally, our results suggest the dissociation between a mid-level visual attention modulating phenomenal consciousness and a central attention directing access consciousness.

Challenging the neurobiological link between number sense and symbolic numerical abilities

A significant body of research links individual differences in symbolic numerical abilities, such as arithmetic, to number sense, the neurobiological system used to approximate and manipulate quantities without language or symbols. However, recent findings from cognitive neuroscience challenge this influential theory. Our current review presents an overview of evidence for the number sense account of symbolic numerical abilities and then reviews recent studies that challenge this account, organized around the following four assertions. (1) There is no number sense as traditionally conceived. (2) Neural substrates of number sense are more widely distributed than common consensus asserts, complicating the neurobiological evidence linking number sense to numerical abilities. (3) The most common measures of number sense are confounded by other cognitive demands, which drive key correlations. (4) Number sense and symbolic number systems (Arabic digits, number words, and so on) rely on distinct neural mechanisms and follow independent developmental trajectories. The review follows each assertion with comments on future directions that may bring resolution to these issues.

Populations Norms for "SLURP"-An iPad App for Quantification of Visuomotor Coordination Testing

Currently the integrity of brain function that drives behavior is predominantly measured in terms of pure motor function, yet most human behavior is visually driven. A means of easily quantifying such visually-driven brain function for comparison against population norms is lacking. Analysis of eye-hand coordination (EHC) using a digital game-like situation with downloadable spatio-temporal details has potential for clinicians and researchers. A simplified protocol for the Lee-Ryan EHC (Slurp) Test app for iPad® has been developed to monitor EHC. The two subtests selected, each of six quickly completed items with appeal to all ages, were found equivalent in terms of total errors/time and sensitive to developmental and aging milestones known to affect EHC. The sensitivity of outcomes due to the type of stylus being used during testing was also explored. Populations norms on 221 participants aged 5 to 80⁺years are presented for each test item according to two commonly used stylus types. The Slurp app uses two-dimensional space and is suited to clinicians for pre/post-intervention testing and to researchers in psychological, medical, and educational domains who are interested in understanding brain function.

Neuronal Effects of Spatial and Feature Attention Differ Due to Normalization

Although spatial and feature attention have differing effects on neuronal responses in visual cortex, it remains unclear why. Response normalization has been implicated in both types of attention (Carandini and Heeger, 2011), and single-unit studies have demonstrated that the magnitude of spatial attention effects on neuronal responses covaries with the magnitude of normalization effects. However, the relationship between feature attention and normalization remains largely unexplored. We recorded from individual neurons in the middle temporal area of rhesus monkeys using a task that allowed us to isolate the effects of feature attention, spatial attention, and normalization on the responses of each neuron. We found that the magnitudes of neuronal response modulations due to spatial attention and feature attention are correlated; however, whereas modulations due to spatial attention are correlated with normalization strength, those due to feature attention are not. Additionally, spatial attention modulations are stronger with multiple stimuli in the receptive field, whereas feature attention modulations are not. These findings are captured by a model in which spatial and feature attention share common top-down attention signals that nonetheless result in differing sensory neuron response modulations because of a spatially tuned sensory normalization mechanism. This model explains previously reported commonalities and differences between these two types of attention by clarifying the relationship between top-down attention signals and sensory normalization. We conclude that similar top-down signals to visual cortex can have distinct effects on neuronal responses due to distinct interactions with sensory mechanisms.SIGNIFICANCE STATEMENT Subjects use attention to improve their visual perception in several ways, including by attending to a location in space or to a visual feature. Prior studies have found both commonalities and differences between the effects of spatial and feature attention on neuronal responses in visual cortex, although it is unclear what mechanisms could explain this range of effects. Normalization, a computation by which neuronal responses are modified by stimulus context, has been implicated in many neuronal mechanisms throughout the brain. Here we propose that normalization provides a simple explanation for how spatial and feature attention could share common top-down attention signals that still affect sensory neuron responses differently.

The influence of joint attention and partner trustworthiness on cross-modal sensory cueing

Joint attention refers to the coordinated attention between social partners to an object of shared interest, usually involving shared gaze toward the object. In the laboratory, however, joint attention is often investigated using computerized gaze cueing tasks that do not allow shared gaze. Instead, these computerized tasks require the participant to maintain fixation on the virtual partner's face, while the partner gazes to the left or right. Here we designed a modified gaze cueing task that better simulates a natural joint attention episode by allowing shared gaze, while still maintaining tight experimental control. In our computerized task the participant's gaze and the gaze of a virtual partner were manipulated independently, resulting in shared or unshared gaze. Following each gaze shift of the virtual partner a touch stimulus was delivered on one of the cheeks of the participant. We analyzed behavioral and neural (electro-encephalography) responses to the touch. Faster reaction-times and stronger lateralization of alpha power were observed when the touched cheek was in a jointly attended hemispace compared with a singly attended or unattended hemispace. Importantly, these effects were unique to joint attention and could not be explained as the additive effects of own gaze and gaze cue direction. Underlining its social nature, we found that the behavioral effect was absent when we repeated our experiment with nonsocial cues (arrows) instead of gaze cues. Furthermore, when we compared trustworthy with untrustworthy virtual partners (trustworthiness judgements based on facial appearance) we found the effect only for trustworthy and not for untrustworthy virtual partners. We conclude that joint attention based on shared gaze influences attentional orienting such that cross-modal sensory processing at the jointly attended location is facilitated, particularly when the partner is trustworthy. This indicates that social interactions and trustworthiness judgements affect cortical and behavioral responses to sensory information.

Desynchronizing to be faster? Perceptual- and attentional-modulation of brain rhythms at the sub-millisecond scale

Neural oscillatory signals has been associated with many high-level functions (e.g. attention and working memory), because they reflect correlated behaviors of neural population that would facilitate the information transfer in the brain. On the other hand, a decreased power of oscillation (event-related desynchronization, ERD) has been associated with an irregular state in which many neurons behave in an uncorrelated manner. In contrast to this view, here we show that the human ERD is linked to the increased regularity of oscillatory signals. Using magnetoencephalography, we found that presenting a visual stimulus not only induced a decrease in power of alpha (8-12 Hz) to beta (13-30 Hz) rhythms in the contralateral visual cortex but also reduced the mean and variance of their inter-peak intervals (IPIs). This indicates that the suppressed alpha/beta rhythms became faster (reduced mean) and more regular (reduced variance) during visual stimulation. The same changes in IPIs, especially those of beta rhythm, were observed when subjects allocated their attention to a contralateral visual field. Those results revealed a new role of the event-related decrease in alpha/beta power and further suggested that our brain regulates and accelerates a clock for neural computations by actively suppressing the oscillation amplitude in task-relevant regions.

Clinical Validation of Eye Vergence as an Objective Marker for Diagnosis of ADHD in Children

OBJECTIVE

ADHD youth show poor oculomotor control. Recent research shows that attention-related eye vergence is weak in ADHD children.

METHOD

To validate vergence as a marker to classify ADHD, we assessed the modulation in the angle of vergence of children ( n = 43) previously diagnosed with ADHD while performing an attention task and compared the results with age-matched clinical controls ( n = 19) and healthy peers ( n = 30).

RESULTS

We observed strong vergence responses in healthy participants and weak vergence in the clinical controls. ADHD children showed no significant vergence responses. Machine-learning models classified ADHD patients ( n = 21) from healthy controls ( n = 21) with an accuracy of 96.3% (false positive [FP]: 5.12%; false negative [FN]: 0%; area under the curve [AUC]: 0.99) and ADHD children ( n = 11) from clinical controls ( n = 14) with an accuracy of 85.7% (FP: 4.5%; FN: 19.2%, AUC: 0.90).

CONCLUSION

In combination with an attention task, vergence responses can be used as an objective marker to detect ADHD in children.

The cerebral bases of the bouba-kiki effect

The crossmodal correspondence between some speech sounds and some geometrical shapes, known as the bouba-kiki (BK) effect, constitutes a remarkable exception to the general arbitrariness of the links between word meaning and word sounds. We have analyzed the association of shapes and sounds in order to determine whether it occurs at a perceptual or at a decisional level, and whether it takes place in sensory cortices or in supramodal regions. First, using an Implicit Association Test (IAT), we have shown that the BK effect may occur without participants making any explicit decision relative to sound-shape associations. Second, looking for the brain correlates of implicit BK matching, we have found that intermodal matching influences activations in both auditory and visual sensory cortices. Moreover, we found stronger prefrontal activation to mismatching than to matching stimuli, presumably reflecting a modulation of executive processes by crossmodal correspondence. Thus, through its roots in the physiology of object categorization and crossmodal matching, the BK effect provides a unique insight into some non-linguistic components of word formation.

Attention to number: The convergence of numerical magnitude processing, attention, and mathematics in the inferior frontal gyrus

Research indicates that the neurocognitive system representing nonsymbolic numerical magnitudes is foundational for the development of mathematical competence. However, recent studies found that the most common task used to measure numerical acuity, the nonsymbolic number comparison task, is heavily influenced by non-numerical visual parameters of stimuli that increase executive function demands. Further, this influence may be a confound invalidating theoretical accounts of the relation between number comparison performance and mathematical competence. Instead of acuity, the relation may depend on one's ability to attend to numerical information in the face of competing, non-numerical cues. The current study investigated this issue by measuring neural activity associated with numerical magnitude processing acuity, domain-general attention, and selective attention to number via functional magnetic resonance imaging while children 8-11 years old completed a nonsymbolic number comparison task and a flanker task. Results showed that activation in the right inferior frontal gyrus during incongruent versus congruent trials of the comparison task, our construct for attention to number, predicted mathematics achievement after controlling for verbal IQ, flanker accuracy rate, and the neural congruency effect from the flanker task. In contrast, activity in frontal and parietal regions responding to differences in difficulty of numerical comparisons, our construct for numerical magnitude processing acuity, did not correlate with achievement. Together, these findings suggest a need to reframe existing models of the relation between number processing and math competence to include the interaction between attention and use of numerical information, or in other words "attention to number."

Functional dissociation of the inferior frontal junction from the dorsal attention network in top-down attentional control

The posterior lateral prefrontal cortex-specifically, the inferior frontal junction (IFJ)-is thought to exert a key role in the control of attention. However, the precise nature of that role remains elusive. During the voluntary deployment and maintenance of visuospatial attention, the IFJ is typically coactivated with a core dorsal network consisting of the frontal eye field and superior parietal cortex. During stimulus-driven attention, IFJ instead couples with a ventrolateral network, suggesting that IFJ plays a role in attention distinct from the dorsal network. Because IFJ rapidly switches activation patterns to accommodate conditions of goal-directed and stimulus-driven attention (Asplund CL, Todd JJ, Snyder AP, Marois R. Nat Neurosci 13: 507-512, 2010), we hypothesized that IFJ's primary role is to dynamically reconfigure attention rather than to maintain attention under steady-state conditions. This hypothesis predicts that in a goal-directed visuospatial cuing paradigm IFJ would transiently deploy attention toward the cued location, whereas the dorsal attention network would maintain attentional weights during the delay between cue and target presentation. Here we tested this hypothesis with functional magnetic resonance imaging while subjects were engaged in a Posner cuing task with variable cue-target delays. Both IFJ and dorsal network regions were involved in transient processes, but sustained activity was far more evident in the dorsal network than in IFJ. These results support the account that IFJ primarily acts to shift attention whereas the dorsal network is the main locus for the maintenance of stable attentional states. NEW & NOTEWORTHY Goal-directed visuospatial attention is controlled by a dorsal fronto-parietal network and lateral prefrontal cortex. However, the relative roles of these regions in goal-directed attention are unknown. Here we present evidence for their dissociable roles in the transient reconfiguration and sustained maintenance of attentional settings: while maintenance of attentional settings is confined to the dorsal network, the configuration of these settings at the beginning of an attentional episode is a function of lateral prefrontal cortex.

Brain gray and white matter abnormalities in preterm-born adolescents: A meta-analysis of voxel-based morphometry studies

Introduction

Studies using voxel-based morphometry report variable and inconsistent abnormalities of gray matter volume (GMV) and white matter volume (WMV) in brains of preterm-born adolescents (PBA). In such circumstances a meta-analysis can help identify the most prominent and consistent abnormalities.

Method

We identified 9 eligible studies by systematic search of the literature up to October 2017. We used Seed-based d Mapping to analyze GMV and WMV alterations between PBA and healthy controls.

Results

In the GMV meta-analysis, PBA compared to healthy controls showed: increased GMV in left cuneus cortex, left superior frontal gyrus, and right anterior cingulate cortex; decreased GMV in bilateral inferior temporal gyrus (ITG), left superior frontal gyrus, and right caudate nucleus. In the WMV meta-analysis, PBA showed: increased WMV in right fusiform gyrus and precuneus; decreased WMV in bilateral ITG, and right inferior frontal gyrus. In meta-regression analysis, the percentage of male PBA negatively correlated with decreased GMV of bilateral ITG.

Interpretation

PBA show widespread GMV and WMV alterations in the default mode network, visual recognition network, and salience network. These changes may be causally relevant to socialization difficulties and cognitive impairments. The meta-regression results perhaps reveal the structural underpinning of the cognition-related sex differences in PBA.

Finding any Waldo with zero-shot invariant and efficient visual search

Searching for a target object in a cluttered scene constitutes a fundamental challenge in daily vision. Visual search must be selective enough to discriminate the target from distractors, invariant to changes in the appearance of the target, efficient to avoid exhaustive exploration of the image, and must generalize to locate novel target objects with zero-shot training. Previous work on visual search has focused on searching for perfect matches of a target after extensive category-specific training. Here, we show for the first time that humans can efficiently and invariantly search for natural objects in complex scenes. To gain insight into the mechanisms that guide visual search, we propose a biologically inspired computational model that can locate targets without exhaustive sampling and which can generalize to novel objects. The model provides an approximation to the mechanisms integrating bottom-up and top-down signals during search in natural scenes.

Neural Circuits That Mediate Selective Attention: A Comparative Perspective

Selective attention is central to cognition. Dramatic advances have been made in understanding the neural circuits that mediate selective attention. Forebrain networks, most elaborated in primates, control all forms of attention based on task demands and the physical salience of stimuli. These networks contain circuits that distribute top-down signals to sensory processing areas and enhance information processing in those areas. A midbrain network, most elaborated in birds, controls spatial attention. It contains circuits that continuously compute the highest priority stimulus location and route sensory information from the selected location to forebrain networks that make cognitive decisions. The identification of these circuits, their functions and mechanisms represent a major advance in our understanding of how the vertebrate brain mediates selective attention.

Novel Functional MRI Task for Studying the Neural Correlates of Upper Limb Tremor

Introduction: Tremor of the upper limbs is a disabling symptom that is present during several neurological disorders and is currently without treatment. Functional MRI (fMRI) is an essential tool to investigate the pathophysiology of tremor and aid the development of treatment options. However, no adequately or standardized protocols for fMRI exists at present. Here we present a novel, online available fMRI task that could be used to assess the in vivo pathology of tremor.

Objective: This study aims to validate the tremor-evoking potential of the fMRI task in a small group of tremor patients outside the scanner and assess the reproducibility of the fMRI task related activation in healthy controls.

Methods: Twelve HCs were scanned at two time points (baseline and after 6-weeks). There were two runs of multi-band fMRI and the tasks included a “brick-breaker” joystick game. The game consisted of three conditions designed to control for most of the activation related to performing the task by contrasting the conditions: WATCH (look at the game without moving joystick), MOVE (rhythmic left/right movement of joystick without game), and PLAY (playing the game). Task fMRI was analyzed using FSL FEAT to determine clusters of activation during the different conditions. Maximum activation within the clusters was used to assess the ability to control for task related activation and reproducibility. Four tremor patients have been included to test ecological and construct validity of the joystick task by assessing tremor frequencies captured by the joystick.

Results: In HCs the game activated areas corresponding to motor, attention and visual areas. Most areas of activation by our game showed moderate to good reproducibility (intraclass correlation coefficient (ICC) 0.531–0.906) with only inferior parietal lobe activation showing poor reproducibility (ICC 0.446). Furthermore, the joystick captured significantly more tremulous movement in tremor patients compared to HCs (p = 0.01) during PLAY, but not during MOVE.

Conclusion: Validation of our novel task confirmed tremor-evoking potential and reproducibility analyses yielded acceptable results to continue further investigations into the pathophysiology of tremor. The use of this technique in studies with tremor patient will no doubt provide significant insights into the treatment options.

Comparing Pupil Light Response Modulation between Saccade Planning and Working Memory

The signature of spatial attention effects has been demonstrated through saccade planning and working memory. Although saccade planning and working memory have been commonly linked to attention, the comparison of effects resulting from saccade planning and working memory is less explored. It has recently been shown that spatial attention interacts with local luminance at the attended location. When bright and dark patch stimuli are presented simultaneously in the periphery, thereby producing no change in global luminance, pupil size is nonetheless smaller when the locus of attention overlaps with the bright, compared to the dark patch stimulus (referred to as the local luminance modulation). Here, we used the local luminance modulation to directly compare the effects of saccade planning and spatial working memory. Participants were required to make a saccade towards a visual target location (visual-delay) or a remembered target location (memory-delay) after a variable delay, and the bright and dark patch stimuli were presented during the delay period between target onset and go signal. Greater pupil constriction was observed when the bright patch, compared to the dark patch, was spatially aligned with the target location in both tasks. However, the effects were diminished when there was no contingency implemented between the patch and target locations, particularly in the memory-delay task. Together, our results suggest the involvement of similar, but not identical, attentional mechanisms through saccade planning and working memory, and highlight a promising potential of local pupil luminance responses for probing visuospatial processing.

Real-time decoding of covert attention in higher-order visual areas

Brain-computer-interfaces (BCI) provide a means of using human brain activations to control devices for communication. Until now this has only been demonstrated in primary motor and sensory brain regions, using surgical implants or non-invasive neuroimaging techniques. Here, we provide proof-of-principle for the use of higher-order brain regions involved in complex cognitive processes such as attention. Using realtime fMRI, we implemented an online 'winner-takes-all approach' with quadrant-specific parameter estimates, to achieve single-block classification of brain activations. These were linked to the covert allocation of attention to real-world images presented at 4-quadrant locations. Accuracies in three target regions were significantly above chance, with individual decoding accuracies reaching upto 70%. By utilising higher order mental processes, 'cognitive BCIs' access varied and therefore more versatile information, potentially providing a platform for communication in patients who are unable to speak or move due to brain injury.

Selection history: How reward modulates selectivity of visual attention

Visual attention enables us to selectively prioritize or suppress information in the environment. Prominent models concerned with the control of visual attention differentiate between goal-directed, top-down and stimulus-driven, bottom-up control, with the former determined by current selection goals and the latter determined by physical salience. In the current review, we discuss recent studies that demonstrate that attentional selection does not need to be the result of top-down or bottom-up processing but, instead, is often driven by lingering biases due to the "history" of former attention deployments. This review mainly focuses on reward-based history effects; yet other types of history effects such as (intertrial) priming, statistical learning and affective conditioning are also discussed. We argue that evidence from behavioral, eye-movement and neuroimaging studies supports the idea that selection history modulates the topographical landscape of spatial "priority" maps, such that attention is biased toward locations having the highest activation on this map.

How neuroscience can inform the study of individual differences in cognitive abilities

Theories of human mental abilities should be consistent with what is known in neuroscience. Currently, tests of human mental abilities are modeled by cognitive constructs such as attention, working memory, and speed of information processing. These constructs are in turn related to a single general ability. However, brains are very complex systems and whether most of the variability between the operations of different brains can be ascribed to a single factor is questionable. Research in neuroscience suggests that psychological processes such as perception, attention, decision, and executive control are emergent properties of interacting distributed networks. The modules that make up these networks use similar computational processes that involve multiple forms of neural plasticity, each having different time constants. Accordingly, these networks might best be characterized in terms of the information they process rather than in terms of abstract psychological processes such as working memory and executive control.

Clinical response to Vim's thalamic stereotactic radiosurgery for essential tremor is associated with distinctive functional connectivity patterns

INTRODUCTION

Essential tremor (ET) is the most common movement disorder. Drug-resistant ET can benefit from standard surgical stereotactic procedures (deep brain stimulation, thalamotomy) or minimally invasive high-intensity focused ultrasound (HIFU) or stereotactic radiosurgical thalamotomy (SRS-T). Resting-state fMRI (rs-fMRI) is a non-invasive imaging method acquired in absence of a task. We examined whether rs-fMRI correlates with tremor score on the treated hand (TSTH) improvement 1 year after SRS-T.

METHODS

We included 17 consecutive patients treated with left unilateral SRS-T in Marseille, France. Tremor score evaluation and rs-fMRI were acquired at baseline and 1 year after SRS-T. Resting-state data (34 scans) were analyzed without a priori hypothesis, in Lausanne, Switzerland. Based on degree of improvement in TSTH, to consider SRS-T at least as effective as medication, we separated two groups: 1, ≤ 50% (n = 6, 35.3%); 2, > 50% (n = 11, 64.7%). They did not differ statistically by age (p = 0.86), duration of symptoms (p = 0.41), or lesion volume at 1 year (p = 0.06).

RESULTS

We report TSTH improvement correlated with interconnectivity strength between salience network with the left claustrum and putamen, as well as between bilateral motor cortices, frontal eye fields and left cerebellum lobule VI with right visual association area (the former also with lesion volume). Longitudinal changes showed additional associations in interconnectivity strength between right dorsal attention network with ventro-lateral prefrontal cortex and a reminiscent salience network with fusiform gyrus.

CONCLUSIONS

Brain connectivity measured by resting-state fMRI relates to clinical response after SRS-T. Relevant networks are visual, motor, and attention. Interconnectivity between visual and motor areas is a novel finding, revealing implication in movement sensory guidance.

Task-dependent enhancement of facial expression and identity representations in human cortex

What cortical mechanisms allow humans to easily discern the expression or identity of a face? Subjects detected changes in expression or identity of a stream of dynamic faces while we measured BOLD responses from topographically and functionally defined areas throughout the visual hierarchy. Responses in dorsal areas increased during the expression task, whereas responses in ventral areas increased during the identity task, consistent with previous studies. Similar to ventral areas, early visual areas showed increased activity during the identity task. If visual responses are weighted by perceptual mechanisms according to their magnitude, these increased responses would lead to improved attentional selection of the task-appropriate facial aspect. Alternatively, increased responses could be a signature of a sensitivity enhancement mechanism that improves representations of the attended facial aspect. Consistent with the latter sensitivity enhancement mechanism, attending to expression led to enhanced decoding of exemplars of expression both in early visual and dorsal areas relative to attending identity. Similarly, decoding identity exemplars when attending to identity was improved in dorsal and ventral areas. We conclude that attending to expression or identity of dynamic faces is associated with increased selectivity in representations consistent with sensitivity enhancement.

European starlings use their acute vision to check on feline predators but not on conspecifics

Head movements allow birds with laterally placed eyes to move their centers of acute vision around and align them with objects of interest. Consequently, head movements have been used as indicator of fixation behavior (where gaze is maintained). However, studies on head movement behavior have not elucidated the degree to which birds use high-acuity or low-acuity vision. We studied how European starlings (Sturnus vulgaris) used high-acuity vision in the early stages of visual exploration of a stuffed cat (common terrestrial predator), a taxidermy Cooper’s hawk (common aerial predator), and a stuffed study skin of a conspecific. We found that starlings tended to use their high acuity vision when looking at predators, particularly, the cat was above chance levels. However, when they viewed a conspecific, they used high acuity vision as expected by chance. We did not observe a preference for the left or right center of acute vision. Our findings suggest that starlings exposed to a predator (particularly cats) may employ selective attention by using high-acuity vision to obtain quickly detailed information useful for a potential escape, but exposed to a social context may use divided attention by allocating similar levels high- and low-quality vision to monitor both conspecifics and the rest of the environment.