Sequential activation of human oculomotor centers during planning of visually-guided eye movements: a combined fMRI-MEG study

Neuroimaging evidence supporting a dual-network architecture for the control of visuospatial attention in the human brain: a mini review

Neuroimaging studies conducted in the last three decades have distinguished two frontoparietal networks responsible for the control of visuospatial attention. The present review summarizes recent findings on the neurophysiological mechanisms implemented in both networks and describes the evolution from a model centered on the distinction between top-down and bottom-up attention to a model that emphasizes the dynamic interplay between the two networks based on attentional demands. The role of the dorsal attention network (DAN) in attentional orienting, by boosting behavioral performance, has been investigated with multiple experimental approaches. This research effort allowed us to trace a distinction between DAN regions involved in shifting vs. maintenance of attention, gather evidence for the modulatory influence exerted by the DAN over sensory cortices, and identify the electrophysiological correlates of the orienting function. Simultaneously, other studies have contributed to reframing our understanding of the functions of the ventral attention network (VAN) and its relevance for behavior. The VAN is not simply involved in bottom-up attentional capture but interacts with the DAN during reorienting to behaviorally relevant targets, exhibiting a general resetting function. Further studies have confirmed the selective rightward asymmetry of the VAN, proposed a functional dissociation along the anteroposterior axis, and suggested hypotheses about its emergence during the evolution of the primate brain. Finally, novel models of network interactions explain the expression of complex attentional functions and the emergence and restorations of symptoms characterizing unilateral spatial neglect. These latter studies emphasize the importance of considering patterns of network interactions for understanding the consequences of brain lesions.

Two hours in Hollywood: A manually annotated ground truth data set of eye movements during movie clip watching

In this short article we present our manual annotation of the eye movement events in a subset of the large-scale eye tracking data set Hollywood2. Our labels include fixations, saccades, and smooth pursuits, as well as a noise event type (the latter representing either blinks, loss of tracking, or physically implausible signals). In order to achieve more consistent annotations, the gaze samples were labelled by a novice rater based on rudimentary algorithmic suggestions, and subsequently corrected by an expert rater. Overall, we annotated eye movement events in the recordings corresponding to 50 randomly selected test set clips and 6 training set clips from Hollywood2, which were viewed by 16 observers and amount to a total of approximately 130 minutes of gaze data. In these labels, 62.4% of the samples were attributed to fixations, 9.1% – to saccades, and, notably, 24.2% – to pursuit (the remainder marked as noise). After evaluation of 15 published eye movement classification algorithms on our newly collected annotated data set, we found that the most recent algorithms perform very well on average, and even reach human-level labelling quality for fixations and saccades, but all have a much larger room for improvement when it comes to smooth pursuit classification. The data set is made available at https://gin.g-node.org/ioannis.agtzidis/hollywood2_em.

The Neural Representation of Visually Evoked Emotion Is High-Dimensional, Categorical, and Distributed across Transmodal Brain Regions

Central to our subjective lives is the experience of different emotions. Recent behavioral work mapping emotional responses to 2,185 videos found that people experience upward of 27 distinct emotions occupying a high-dimensional space, and that emotion categories, more so than affective dimensions (e.g., valence), organize self-reports of subjective experience. Here, we sought to identify the neural substrates of this high-dimensional space of emotional experience using fMRI responses to all 2,185 videos. Our analyses demonstrated that (1) dozens of video-evoked emotions were accurately predicted from fMRI patterns in multiple brain regions with different regional configurations for individual emotions; (2) emotion categories better predicted cortical and subcortical responses than affective dimensions, outperforming visual and semantic covariates in transmodal regions; and (3) emotion-related fMRI responses had a cluster-like organization efficiently characterized by distinct categories. These results support an emerging theory of the high-dimensional emotion space, illuminating its neural foundations distributed across transmodal regions.

Mapping neural dynamics underlying saccade preparation and execution and their relation to reaction time and direction errors

Our ability to control and inhibit automatic behaviors is crucial for negotiating complex environments, all of which require rapid communication between sensory, motor, and cognitive networks. Here, we measured neuromagnetic brain activity to investigate the neural timing of cortical areas needed for inhibitory control, while 14 healthy young adults performed an interleaved prosaccade (look at a peripheral visual stimulus) and antisaccade (look away from stimulus) task. Analysis of how neural activity relates to saccade reaction time (SRT) and occurrence of direction errors (look at stimulus on antisaccade trials) provides insight into inhibitory control. Neuromagnetic source activity was used to extract stimulus‐aligned and saccade‐aligned activity to examine temporal differences between prosaccade and antisaccade trials in brain regions associated with saccade control. For stimulus‐aligned antisaccade trials, a longer SRT was associated with delayed onset of neural activity within the ipsilateral parietal eye field (PEF) and bilateral frontal eye field (FEF). Saccade‐aligned activity demonstrated peak activation 10ms before saccade‐onset within the contralateral PEF for prosaccade trials and within the bilateral FEF for antisaccade trials. In addition, failure to inhibit prosaccades on anti‐saccade trials was associated with increased activity prior to saccade onset within the FEF contralateral to the peripheral stimulus. This work on dynamic activity adds to our knowledge that direction errors were due, at least in part, to a failure to inhibit automatic prosaccades. These findings provide novel evidence in humans regarding the temporal dynamics within oculomotor areas needed for saccade programming and the role frontal brain regions have on top‐down inhibitory control.

An fMRI-Neuronavigated Chronometric TMS Investigation of V5 and Intraparietal Cortex in Motion Driven Attention

The timing of networked brain activity subserving motion driven attention in humans is currently unclear. Functional MRI (fMRI)-neuronavigated chronometric transcranial magnetic stimulation (TMS) was used to investigate critical times of parietal cortex involvement in motion driven attention. In particular, we were interested in the relative critical times for two intraparietal sulcus (IPS) sites in comparison to that previously identified for motion processing in area V5, and to explore potential earlier times of involvement. fMRI was used to individually localize V5 and middle and posterior intraparietal sulcus (mIPS; pIPS) areas active for a motion driven attention task, prior to TMS neuronavigation. Paired-pulse TMS was applied during performance of the same task at stimulus onset asynchronies (SOAs) ranging from 0 to 180 ms. There were no statistically significant decreases in performance accuracy for trials where TMS was applied to V5 at any SOA, though stimulation intensity was lower for this site than for the parietal sites. For TMS applied to mIPS, there was a trend toward a relative decrease in performance accuracy at the 150 ms SOA, as well as a relative increase at 180 ms. There was no statistically significant effect overall of TMS applied to pIPS, however, there appeared a potential trend toward a decrease in performance at the 0 ms SOA. Overall, these results provide some patterns of potential theoretical interest to follow up in future studies.

Perceptual integration rapidly activates dorsal visual pathway to guide local processing in early visual areas

Rapidly grouping local elements into an organized object (i.e., perceptual integration) is a fundamental yet challenging task, especially in noisy contexts. Previous studies demonstrate that ventral visual pathway, which is widely known to mediate object recognition, engages in the process by conveying object-level information processed in high-level areas to modulate low-level sensory areas. Meanwhile, recent evidence suggests that the dorsal visual pathway, which is not typically attributable to object recognition, is also involved in the process. However, the underlying whole-brain fine spatiotemporal neuronal dynamics remains unknown. Here we used magnetoencephalography (MEG) recordings in combination with a temporal response function (TRF) approach to dissociate the time-resolved neuronal response that specifically tracks the perceptual grouping course. We demonstrate that perceptual integration initiates robust and rapid responses along the dorsal visual pathway in a reversed hierarchical manner, faster than the ventral pathway. Specifically, the anterior intraparietal sulcus (IPS) responds first (i.e., within 100 ms), followed by activities backpropagating along the dorsal pathway to early visual areas (EVAs). The IPS activity causally modulates the EVA response, even when the global form information is task-irrelevant. The IPS-to-EVA response profile fails to appear when the global form could not be perceived. Our results support the crucial function of the dorsal visual pathway in perceptual integration, by quickly extracting a coarse global template (i.e., an initial object representation) within first 100 ms to guide subsequent local sensory processing so that the ambiguities in the visual inputs can be efficiently resolved.

How the brain integrates local elements into a global object (i.e., perceptual integration) in noisy contexts constitutes a fundamental yet challenging question in cognitive neuroscience. Here, we recorded brain activity by using magnetoencephalography from human subjects watching glass-pattern stimuli to examine the fine spatiotemporal neuronal responses during perceptual integration. We demonstrate that high-level brain regions initially extract a coarse global form of the inputs, which is then relayed along the dorsal visual pathway in a reversed hierarchical manner to low-level areas to modulate local analysis. This global-to-local modulation mechanism is especially beneficial in noisy environments by rapidly making an “initial guess” to guide detail analysis so that the ambiguities in inputs can be efficiently resolved.

Impaired Activation of Visual Attention Network for Motion Salience Is Accompanied by Reduced Functional Connectivity between Frontal Eye Fields and Visual Cortex in Strabismic Amblyopia

Strabismic amblyopia is now acknowledged to be more than a simple loss of acuity and to involve alterations in visually driven attention, though whether this applies to both stimulus-driven and goal-directed attention has not been explored. Hence we investigated monocular threshold performance during a motion salience-driven attention task involving detection of a coherent dot motion target in one of four quadrants in adult controls and those with strabismic amblyopia. Psychophysical motion thresholds were impaired for the strabismic amblyopic eye, requiring longer inspection time and consequently slower target speed for detection compared to the fellow eye or control eyes. We compared fMRI activation and functional connectivity between four ROIs of the occipital-parieto-frontal visual attention network [primary visual cortex (V1), motion sensitive area V5, intraparietal sulcus (IPS) and frontal eye fields (FEF)], during a suprathreshold version of the motion-driven attention task, and also a simple goal-directed task, requiring voluntary saccades to targets randomly appearing along a horizontal line. Activation was compared when viewed monocularly by controls and the amblyopic and its fellow eye in strabismics. BOLD activation was weaker in IPS, FEF and V5 for both tasks when viewing through the amblyopic eye compared to viewing through the fellow eye or control participants' non-dominant eye. No difference in V1 activation was seen between the amblyopic and fellow eye, nor between the two eyes of control participants during the motion salience task, though V1 activation was significantly less through the amblyopic eye than through the fellow eye and control group non-dominant eye viewing during the voluntary saccade task. Functional correlations of ROIs within the attention network were impaired through the amblyopic eye during the motion salience task, whereas this was not the case during the voluntary saccade task. Specifically, FEF showed reduced functional connectivity with visual cortical nodes during the motion salience task through the amblyopic eye, despite suprathreshold detection performance. This suggests that the reduced ability of the amblyopic eye to activate the frontal components of the attention networks may help explain the aberrant control of visual attention and eye movements in amblyopes.

Disassociation between brain activation and executive function in fragile X premutation females

Executive dysfunction has been demonstrated among premutation (PM) carriers (55-199 CGG repeats) of the Fragile X mental retardation 1 (FMR1) gene. Further, alterations to neural activation patterns have been reported during memory and comparison based functional magnetic resonance imaging (fMRI) tasks in these carriers. For the first time, the relationships between fMRI neural activation during an interleaved ocular motor prosaccade/antisaccade paradigm, and concurrent task performance (saccade measures of latency, accuracy and error rate) in PM females were examined. Although no differences were found in whole brain activation patterns, regions of interest (ROI) analyses revealed reduced activation in the right ventrolateral prefrontal cortex (VLPFC) during antisaccade trials for PM females. Further, a series of divergent and group specific relationships were found between ROI activation and saccade measures. Specifically, for control females, activation within the right VLPFC and supramarginal gyrus correlated negatively with antisaccade latencies, while for PM females, activation within these regions was found to negatively correlate with antisaccade accuracy and error rate (right VLPFC only). For control females, activation within frontal and supplementary eye fields and bilateral intraparietal sulci correlated with prosaccade latency and accuracy; however, no significant prosaccade correlations were found for PM females. This exploratory study extends previous reports of altered prefrontal neural engagement in PM carriers, and clearly demonstrates dissociation between control and PM females in the transformation of neural activation into overt measures of executive dysfunction. Hum Brain Mapp 38:1056-1067, 2017. © 2016 Wiley Periodicals, Inc.

Is Granger causality a viable technique for analyzing fMRI data?

Multivariate neural data provide the basis for assessing interactions in brain networks. Among myriad connectivity measures, Granger causality (GC) has proven to be statistically intuitive, easy to implement, and generate meaningful results. Although its application to functional MRI (fMRI) data is increasing, several factors have been identified that appear to hinder its neural interpretability: (a) latency differences in hemodynamic response function (HRF) across different brain regions, (b) low-sampling rates, and (c) noise. Recognizing that in basic and clinical neuroscience, it is often the change of a dependent variable (e.g., GC) between experimental conditions and between normal and pathology that is of interest, we address the question of whether there exist systematic relationships between GC at the fMRI level and that at the neural level. Simulated neural signals were convolved with a canonical HRF, down-sampled, and noise-added to generate simulated fMRI data. As the coupling parameters in the model were varied, fMRI GC and neural GC were calculated, and their relationship examined. Three main results were found: (1) GC following HRF convolution is a monotonically increasing function of neural GC; (2) this monotonicity can be reliably detected as a positive correlation when realistic fMRI temporal resolution and noise level were used; and (3) although the detectability of monotonicity declined due to the presence of HRF latency differences, substantial recovery of detectability occurred after correcting for latency differences. These results suggest that Granger causality is a viable technique for analyzing fMRI data when the questions are appropriately formulated.

New perspectives on adolescent motivated behavior: attention and conditioning

Adolescence is a critical transition period, during which fundamental changes prepare the adolescent for becoming an adult. Heuristic models of the neurobiology of adolescent behavior have emerged, promoting the central role of reward and motivation, coupled with cognitive immaturities. Here, we bring focus to two basic sets of processes, attention and conditioning, which are essential for adaptive behavior. Using the dual-attention model developed by Corbetta and Shulman (2002), which identifies a stimulus-driven and a goal-driven attention network, we propose a balance that favors stimulus-driven attention over goal-driven attention in youth. Regarding conditioning, we hypothesize that stronger associations tend to be made between environmental cues and appetitive stimuli, and weaker associations with aversive stimuli, in youth relative to adults. An attention system geared to prioritize stimulus-driven attention, together with more powerful associative learning with appetitive incentives, contribute to shape patterns of adolescent motivated behavior. This proposed bias in attention and conditioning function could facilitate the impulsive, novelty-seeking and risk-taking behavior that is typical of many adolescents.

Anxiety, a benefit and detriment to cognition: behavioral and magnetoencephalographic evidence from a mixed-saccade task

Anxiety is typically considered an impediment to cognition. We propose anxiety-related impairments in cognitive-behavioral performance are the consequences of enhanced stimulus-driven attention. Accordingly, reflexive, habitual behaviors that rely on stimulus-driven mechanisms should be facilitated in an anxious state, while novel, flexible behaviors that compete with the former should be impaired. To test these predictions, healthy adults (N=17) performed a mixed-saccade task, which pits habitual actions (pro-saccades) against atypical ones (anti-saccades), under anxiety-inducing threat of shock and safe conditions. Whole-head magnetoencephalography (MEG) captured oscillatory responses in the preparatory interval preceding target onset and saccade execution. Results showed threat-induced anxiety differentially impacted response times based on the type of saccade initiated, slowing anti-saccades but facilitating erroneous pro-saccades on anti-saccade trials. MEG source analyses revealed that successful suppression of reflexive pro-saccades and correct initiation of anti-saccades during threat was marked by increased theta power in right ventrolateral prefrontal cortical and midbrain regions (superior colliculi) implicated in stimulus-driven attention. Theta activity may delay stimulus-driven processes to enable generation of an anti-saccade. Moreover, compared to safety, threat reduced beta desynchronization in inferior parietal cortices during anti-saccade preparation but increased it during pro-saccade preparation. Differential effects in inferior parietal cortices indicate a greater readiness to execute anti-saccades during safety and to execute pro-saccades during threat. These findings suggest that, in an anxiety state, reduced cognitive-behavioral flexibility may stem from enhanced stimulus-driven attention, which may serve the adaptive function of optimizing threat detection.

Illusions of visual motion elicited by electrical stimulation of human MT complex

Human cortical area MT(+) (hMT(+)) is known to respond to visual motion stimuli, but its causal role in the conscious experience of motion remains largely unexplored. Studies in non-human primates demonstrate that altering activity in area MT can influence motion perception judgments, but animal studies are inherently limited in assessing subjective conscious experience. In the current study, we use functional magnetic resonance imaging (fMRI), intracranial electrocorticography (ECoG), and electrical brain stimulation (EBS) in three patients implanted with intracranial electrodes to address the role of area hMT(+) in conscious visual motion perception. We show that in conscious human subjects, reproducible illusory motion can be elicited by electrical stimulation of hMT(+). These visual motion percepts only occurred when the site of stimulation overlapped directly with the region of the brain that had increased fMRI and electrophysiological activity during moving compared to static visual stimuli in the same individual subjects. Electrical stimulation in neighboring regions failed to produce illusory motion. Our study provides evidence for the sufficient causal link between the hMT(+) network and the human conscious experience of visual motion. It also suggests a clear spatial relationship between fMRI signal and ECoG activity in the human brain.

Functional neuroanatomy of mirroring during a unimanual force generation task

Performance of a unimanual motor task often induces involuntary mirror electromyographic (EMG) activity in the opposite, resting hand. In spite of the ubiquitous presence of mirroring, little is known regarding the underlying cortical contributions. Here, we used functional magnetic resonance imaging (fMRI) to study brain regions activated in association with parametric increases in right isometric wrist flexion force (10%, 20%, 30%, and 70%) in 12 healthy volunteers. During scanning, EMG activity was recorded bilaterally from flexor carpi radialis (FCR), extensor carpi radialis (ECR), biceps brachii (BB), and triceps brachii (TB). Mirror EMG was observed in left FCR during 20%, 30%, and 70% of force. Left ECR, BB, and TB showed mirror EMG only at 70% of force. Increasing force was associated with a linear increase of blood-oxygen-level-dependent (BOLD) signal in bilateral primary motor cortex (M1), supplementary motor area (SMA), caudal cingulate, and cerebellum. Mirroring in the left FCR correlated with activity in bilateral M1, SMA, and the cerebellum. Overall, our results suggest that activity in these regions might reflect sensorimotor processes operating in association with mirroring and suggest caution when interpreting fMRI activity in studies that involve unilateral force generation tasks in the absence of simultaneous bilateral EMG/kinematics measurements.

A step towards non-invasive characterization of the human frontal eye fields of individual subjects

BACKGROUND

Identifying eye movement related areas in the frontal lobe has a long history, with microstimulation in monkeys producing the most clear-cut results. For humans, however, there is still no consensus about the location and the extent of the frontal eye field (FEF). There is also no simple non-invasive method for unambiguously defining the FEF in individual subjects, a prerequisite for clinical applications. Here we explore the use of magnetoencephalography (MEG) for the non-invasive identification and characterization of FEF activity in an individual subject.

METHODS

We mapped human brain activity before, during and after saccades by applying tomographic analysis to MEG data. Statistical parametric maps and circular statistics produced plausible FEF loci, but no unambiguous definition for individual subjects. Here we first computed the spectral decomposition and correlation with electrooculogram (EOG) of the tomographic brain activations. For each of these two measures statistical comparisons were made between different saccades.

RESULTS

In this paper, we first review the frontal cortex activations identified in earlier animal and human studies and place the putative human FEFs in a well-defined anatomical framework. This framework is then used as reference for describing the results of new Fourier analysis of the tomographic solutions comparing active saccade tasks and their controls. The most consistent change in the dorsal frontal cortex was at the putative left FEF, for both saccades to the left and right. The asymmetric result is consistent with the 1-way callosal traffic theory. We also showed that the new correlation analysis had its most consistent change in the contralateral putative FEF. This result was obtained for EOG latencies before saccade onset with delays of a few hundreds of milliseconds (FEF activity leading the EOG) and only for visual cues signaling the execution of a saccade in a previously defined saccade direction.

CONCLUSIONS

The FEF definition derived from microstimulation describes only one of the areas in the dorsal lateral frontal lobe that act together to plan, prepare and execute a saccade. The definition and characterization of these areas in an individual subject can be obtained from non-invasive MEG measurements.

The reorienting system of the human brain: from environment to theory of mind

Survival can depend on the ability to change a current course of action to respond to potentially advantageous or threatening stimuli. This "reorienting" response involves the coordinated action of a right hemisphere dominant ventral frontoparietal network that interrupts and resets ongoing activity and a dorsal frontoparietal network specialized for selecting and linking stimuli and responses. At rest, each network is distinct and internally correlated, but when attention is focused, the ventral network is suppressed to prevent reorienting to distracting events. These different patterns of recruitment may reflect inputs to the ventral attention network from the locus coeruleus/norepinephrine system. While originally conceptualized as a system for redirecting attention from one object to another, recent evidence suggests a more general role in switching between networks, which may explain recent evidence of its involvement in functions such as social cognition.