Decomposing the neural mechanisms of visual search through model-based analysis of fMRI: Top-down excitation, active ignoring and the use of saliency by the right TPJ

Top-down modulation of DLPFC in visual search: a study based on fMRI and TMS

Effective visual search is essential for daily life, and attention orientation as well as inhibition of return play a significant role in visual search. Researches have established the involvement of dorsolateral prefrontal cortex in cognitive control during selective attention. However, neural evidence regarding dorsolateral prefrontal cortex modulates inhibition of return in visual search is still insufficient. In this study, we employed event-related functional magnetic resonance imaging and dynamic causal modeling to develop modulation models for two types of visual search tasks. In the region of interest analyses, we found that the right dorsolateral prefrontal cortex and temporoparietal junction were selectively activated in the main effect of search type. Dynamic causal modeling results indicated that temporoparietal junction received sensory inputs and only dorsolateral prefrontal cortex →temporoparietal junction connection was modulated in serial search. Such neural modulation presents a significant positive correlation with behavioral reaction time. Furthermore, theta burst stimulation via transcranial magnetic stimulation was utilized to modulate the dorsolateral prefrontal cortex region, resulting in the disappearance of the inhibition of return effect during serial search after receiving continuous theta burst stimulation. Our findings provide a new line of causal evidence that the top-down modulation by dorsolateral prefrontal cortex influences the inhibition of return effect during serial search possibly through the retention of inhibitory tagging via working memory storage.

Neural correlates of autobiographical memory retrieval: An SDM neuroimaging meta-analysis

Autobiographical memory (AM) is a type of episodic memory that involves the recollection and re-experiencing of personal life events. AM retrieval is a complex process requiring the coordination of multiple memory processes across the brain. Important questions remain regarding the degree to which specific brain regions are consistently recruited during AM retrieval and the influence of methodological factors such as type of AM retrieval task and control task. Neuroimaging meta-analyses can summarize the brain regions associated with AM retrieval, addressing these questions by revealing consistent findings across multiple studies. We used a coordinate-based neuroimaging meta-analysis method, seed-based d mapping (SDM), to assess the largest set of neuroimaging studies of AM retrieval to date. An important advantage of SDM over other methods is that it factors in the effect sizes of the activation coordinates from studies, yielding a more representative summary of activations. Studies were selected if they elicited AM retrieval in the scanner, contrasted AM retrieval with a matched control task, and used univariate whole-brain analyses, yielding a set of 50 papers with 963 participants and 891 foci. The findings confirmed the recruitment of many previously identified core AM retrieval regions including the prefrontal cortex (PFC), hippocampus and parahippocampal cortex, retrosplenial cortex and posterior cingulate, and angular gyrus, and revealed additional regions, including bilateral inferior parietal lobule and greater activation extent through the PFC, including lateral PFC activation. Results were robust across different types of AM retrieval tasks (previously rehearsed cues vs. novel cues), and robust across different control tasks (visual/attention vs. semantic retrieval). To maximize the utility of the meta-analysis, all results image files are available online. In summary, the current meta-analysis provides an updated and more representative characterization of the neural correlates of autobiographical memory retrieval and how these neural correlates are affected by important experimental factors.

The role of right temporo-parietal junction in stimulus evaluation

A predominant model of the temporo-parietal junction (TPJ) claims that this region is critical for attentional orienting/reorienting toward an unexpected, but behaviorally significant stimulus. However, recent studies have suggested that the TPJ is also involved in the process of evaluating stimulus, especially matching between external sensory inputs and internal representations. While some studies provide evidence for the involvement of the TPJ in stimulus evaluation, the nature of the evaluative process mediated by the TPJ remains unclear. To address this issue, we tested whether the TPJ activation amplitude and its peak latency is proportional to the demand of the evaluative process. We found that when the amount of sensory evidence for the matching process was abundant, the TPJ was transiently activated. Importantly, the TPJ activation showed a greater and more sustained pattern while the sensory evidence was accumulating for a longer period of time. These findings suggest that the TPJ function is associated with the evaluative process of matching sensory inputs with internal representations, as well as attentional reorienting.

Frontoparietal activation during visual conjunction search: Effects of bottom-up guidance and adult age

We conducted functional magnetic resonance imaging (fMRI) with a visual search paradigm to test the hypothesis that aging is associated with increased frontoparietal involvement in both target detection and bottom-up attentional guidance (featural salience). Participants were 68 healthy adults, distributed continuously across 19 to 78 years of age. Frontoparietal regions of interest (ROIs) were defined from resting-state scans obtained prior to task-related fMRI. The search target was defined by a conjunction of color and orientation. Each display contained one item that was larger than the others (i.e., a size singleton) but was not informative regarding target identity. Analyses of search reaction time (RT) indicated that bottom-up attentional guidance from the size singleton (when coincident with the target) was relatively constant as a function of age. Frontoparietal fMRI activation related to target detection was constant as a function of age, as was the reduction in activation associated with salient targets. However, for individuals 35 years of age and older, engagement of the left frontal eye field (FEF) in bottom-up guidance was more prominent than for younger individuals. Further, the age-related differences in left FEF activation were a consequence of decreasing resting-state functional connectivity in visual sensory regions. These findings indicate that age-related compensatory effects may be expressed in the relation between activation and behavior, rather than in the magnitude of activation, and that relevant changes in the activation-RT relation may begin at a relatively early point in adulthood. Hum Brain Mapp 38:2128-2149, 2017. © 2017 Wiley Periodicals, Inc.

The determinants of food choice

Health nudge interventions to steer people into healthier lifestyles are increasingly applied by governments worldwide, and it is natural to look to such approaches to improve health by altering what people choose to eat. However, to produce policy recommendations that are likely to be effective, we need to be able to make valid predictions about the consequences of proposed interventions, and for this, we need a better understanding of the determinants of food choice. These determinants include dietary components (e.g. highly palatable foods and alcohol), but also diverse cultural and social pressures, cognitive-affective factors (perceived stress, health attitude, anxiety and depression), and familial, genetic and epigenetic influences on personality characteristics. In addition, our choices are influenced by an array of physiological mechanisms, including signals to the brain from the gastrointestinal tract and adipose tissue, which affect not only our hunger and satiety but also our motivation to eat particular nutrients, and the reward we experience from eating. Thus, to develop the evidence base necessary for effective policies, we need to build bridges across different levels of knowledge and understanding. This requires experimental models that can fill in the gaps in our understanding that are needed to inform policy, translational models that connect mechanistic understanding from laboratory studies to the real life human condition, and formal models that encapsulate scientific knowledge from diverse disciplines, and which embed understanding in a way that enables policy-relevant predictions to be made. Here we review recent developments in these areas.

Competition between Visual Events Modulates the Influence of Salience during Free-Viewing of Naturalistic Videos

In daily life the brain is exposed to a large amount of external signals that compete for processing resources. The attentional system can select relevant information based on many possible combinations of goal-directed and stimulus-driven control signals. Here, we investigate the behavioral and physiological effects of competition between distinctive visual events during free-viewing of naturalistic videos. Nineteen healthy subjects underwent functional magnetic resonance imaging (fMRI) while viewing short video-clips of everyday life situations, without any explicit goal-directed task. Each video contained either a single semantically-relevant event on the left or right side (Lat-trials), or multiple distinctive events in both hemifields (Multi-trials). For each video, we computed a salience index to quantify the lateralization bias due to stimulus-driven signals, and a gaze index (based on eye-tracking data) to quantify the efficacy of the stimuli in capturing attention to either side. Behaviorally, our results showed that stimulus-driven salience influenced spatial orienting only in presence of multiple competing events (Multi-trials). fMRI results showed that the processing of competing events engaged the ventral attention network, including the right temporoparietal junction (R TPJ) and the right inferior frontal cortex. Salience was found to modulate activity in the visual cortex, but only in the presence of competing events; while the orienting efficacy of Multi-trials affected activity in both the visual cortex and posterior parietal cortex (PPC). We conclude that in presence of multiple competing events, the ventral attention system detects semantically-relevant events, while regions of the dorsal system make use of saliency signals to select relevant locations and guide spatial orienting.

Functional MRI mapping of visual function and selective attention for performance assessment and presurgical planning using conjunctive visual search

BACKGROUND

Accurate mapping of visual function and selective attention using fMRI is important in the study of human performance as well as in presurgical treatment planning of lesions in or near visual centers of the brain. Conjunctive visual search (CVS) is a useful tool for mapping visual function during fMRI because of its greater activation extent compared with high-capacity parallel search processes.

AIMS

The purpose of this work was to develop and evaluate a CVS that was capable of generating consistent activation in the basic and higher level visual areas of the brain by using a high number of distractors as well as an optimized contrast condition.

MATERIALS AND METHODS

Images from 10 healthy volunteers were analyzed and brain regions of greatest activation and deactivation were determined using a nonbiased decomposition of the results at the hemisphere, lobe, and gyrus levels. The results were quantified in terms of activation and deactivation extent and mean z-statistic.

RESULTS

The proposed CVS was found to generate robust activation of the occipital lobe, as well as regions in the middle frontal gyrus associated with coordinating eye movements and in regions of the insula associated with task-level control and focal attention. As expected, the task demonstrated deactivation patterns commonly implicated in the default-mode network. Further deactivation was noted in the posterior region of the cerebellum, most likely associated with the formation of optimal search strategy.

CONCLUSION

We believe the task will be useful in studies of visual and selective attention in the neuroscience community as well as in mapping visual function in clinical fMRI.

The contribution of stimulus-driven and goal-driven mechanisms to feature-based selection in patients with spatial attention deficits

When people search a display for a target defined by a unique feature, fast saccades are predominantly stimulus-driven whereas slower saccades are primarily goal-driven. Here we use this dissociative pattern to assess whether feature-based selection in patients with lateralized spatial attention deficits is impaired in stimulus-driven processing, goal-driven processing, or both. A group of patients suffering from extinction or neglect after parietal damage, and a group of healthy, age-matched controls, were instructed to make a saccade to a uniquely oriented target line which was presented simultaneously with a differently oriented distractor line. We systematically varied the salience of the target and distractor by changing the orientation of background elements, and used a time-based model to extract stimulus-driven (salience) and goal-driven (target set) components of selection. The results show that the patients exhibited reduced stimulus-driven processing only in the contralesional hemifield, while goal-driven processing was reduced across both hemifields.

Across-study and within-subject functional connectivity of a right temporo-parietal junction subregion involved in stimulus-context integration

Bidirectional integration between sensory stimuli and contextual framing is fundamental to action control. Stimuli may entail context-dependent actions, while temporal or spatial characteristics of a stimulus train may establish a contextual framework for upcoming stimuli. Here we aimed at identifying core areas for stimulus-context integration and delineated their functional connectivity (FC) using meta-analytic connectivity modeling (MACM) and analysis of resting-state networks. In a multi-study conjunction, consistently increased activity under higher demands on stimulus-context integration was predominantly found in the right temporo-parietal junction (TPJ), which represented the largest cluster of overlap and was thus used as the seed for the FC analyses. The conjunction between task-dependent (MACM) and task-free (resting state) FC of the right TPJ revealed a shared network comprising bilaterally inferior parietal and frontal cortices, anterior insula, premotor cortex, putamen and cerebellum, i.e., a 'ventral' action/attention network. Stronger task-dependent (vs. task-free) connectivity was observed with the pre-SMA, dorsal premotor cortex, intraparietal sulcus, basal ganglia and primary sensori motor cortex, while stronger resting-state (vs. task-dependent) connectivity was found with the dorsolateral prefrontal and medial parietal cortex. Our data provide strong evidence that the right TPJ may represent a key region for the integration of sensory stimuli and contextual frames in action control. Task-dependent associations with regions related to stimulus processing and motor responses indicate that the right TPJ may integrate 'collaterals' of sensory processing and apply (ensuing) contextual frames, most likely via modulation of preparatory loops. Given the pattern of resting-state connectivity, internal states and goal representations may provide the substrates for the contextual integration within the TPJ in the absence of a specific task.

Separating neural correlates of allocentric and egocentric neglect: distinct cortical sites and common white matter disconnections

Insights into the functional nature and neuroanatomy of spatial attention have come from research in neglect patients but to date many conflicting results have been reported. The novelty of the current study is that we used voxel-wise analyses based on information from segmented grey and white matter tissue combined with diffusion tensor imaging to decompose neural substrates of different neglect symptoms. Allocentric neglect was associated with damage to posterior cortical regions (posterior superior temporal sulcus, angular, middle temporal and middle occipital gyri). In contrast, egocentric neglect was associated with more anterior cortical damage (middle frontal, postcentral, supramarginal, and superior temporal gyri) and damage within subcortical structures. Damage to intraparietal sulcus (IPS) and the temporo-parietal junction (TPJ) was associated with both forms of neglect. Importantly, we showed that both disorders were associated with white matter lesions suggesting damage within long association and projection pathways such as the superior longitudinal, superior fronto-occipital, inferior longitudinal, and inferior fronto-occipital fascicule, thalamic radiation, and corona radiata. We conclude that distinct cortical regions control attention (a) across space (using an egocentric frame of reference) and (b) within objects (using an allocentric frame of reference), while common cortical regions (TPJ, IPS) and common white matter pathways support interactions across the different cortical regions.

Comparing segmentation by time and by motion in visual search: an FMRI investigation

Brain activity was recorded while participants engaged in a difficult visual search task for a target defined by the spatial configuration of its component elements. The search displays were segmented by time (a preview then a search display), by motion, or were unsegmented. A preparatory network showed activity to the preview display, in the time but not in the motion segmentation condition. A region of the precuneus showed (i) higher activation when displays were segmented by time or by motion, and (ii) correlated activity with larger segmentation benefits behaviorally, regardless of the cue. Additionally, the results revealed that success in temporal segmentation was correlated with reduced activation in early visual areas, including V1. The results depict partially overlapping brain networks for segmentation in search by time and motion, with both cue-independent and cue-specific mechanisms.