Activity in primary visual cortex predicts performance in a visual detection task

On the role of suppression in spatial attention: evidence from negative BOLD in human subcortical and cortical structures

There is clear evidence that spatial attention increases neural responses to attended stimuli in extrastriate visual areas and, to a lesser degree, in earlier visual areas. Other evidence shows that neurons representing unattended locations can also be suppressed. However, the extent to which enhancement and suppression is observed, their stimulus dependence, and the stages of the visual system at which they are expressed remains poorly understood. Using fMRI we set out to characterize both the task and stimulus dependence of neural responses in the lateral geniculate nucleus (LGN), primary visual cortex (V1), and visual motion area (V5) in humans to determine where suppressive and facilitatory effects of spatial attention are expressed. Subjects viewed a lateralized drifting grating stimulus, presented at multiple stimulus contrasts, and performed one of three tasks designed to alter the spatial location of their attention. In retinotopic representations of the stimulus location, we observed increasing attention-dependent facilitation and decreasing dependence on stimulus contrast moving up the visual hierarchy from the LGN to V5. However, in the representations of unattended locations of the LGN and V1, we observed suppression, which was not significantly dependent on the attended stimulus contrast. These suppressive effects were also found in the pulvinar, which has been frequently associated with attention. We provide evidence, therefore, for a spatially selective suppressive mechanism that acts at a subcortical level.

Pupil-linked arousal determines variability in perceptual decision making

Decision making between several alternatives is thought to involve the gradual accumulation of evidence in favor of each available choice. This process is profoundly variable even for nominally identical stimuli, yet the neuro-cognitive substrates that determine the magnitude of this variability are poorly understood. Here, we demonstrate that arousal state is a powerful determinant of variability in perceptual decision making. We measured pupil size, a highly sensitive index of arousal, while human subjects performed a motion-discrimination task, and decomposed task behavior into latent decision making parameters using an established computational model of the decision process. In direct contrast to previous theoretical accounts specifying a role for arousal in several discrete aspects of decision making, we found that pupil diameter was uniquely related to a model parameter representing variability in the rate of decision evidence accumulation: Periods of increased pupil size, reflecting heightened arousal, were characterized by greater variability in accumulation rate. Pupil diameter also correlated trial-by-trial with specific patterns of behavior that collectively are diagnostic of changing accumulation rate variability, and explained substantial individual differences in this computational quantity. These findings provide a uniquely clear account of how arousal state impacts decision making, and may point to a relationship between pupil-linked neuromodulation and behavioral variability. They also pave the way for future studies aimed at augmenting the precision with which people make decisions.

Variability is a hallmark of how we make decisions between different alternatives: Even when we are presented with identical repetitions of a stimulus, the timing and accuracy of our associated decisions vary dramatically. Representations of variability or ‘noise’ have necessarily been a prominent feature of how cognitive scientists model the decision making process. However, very little is known about the underlying neural processes or psychophysiological states that determine the magnitude of this variability. In this study, we measured people's pupil size as an indicator of their physiological arousal state during performance of a challenging motion-discrimination task, and modelled decisions on this task using an established computational model of the decision process in which evidence gradually accumulates toward a response threshold. We found that arousal state was tightly and uniquely linked to a computational parameter that specifically represents variability in the rate at which people accumulate evidence to inform their decisions: Larger pupil size, both within- and between-individuals, corresponded to greater variability in this critical aspect of decision making. Our findings uncover a potent source of variability in how people make decisions, and forge a new link between the classical construct of arousal and modern theories of decision making.

Effects of spatial and feature attention on disparity-rendered structure-from-motion stimuli in the human visual cortex

An important advance in the study of visual attention has been the identification of a non-spatial component of attention that enhances the response to similar features or objects across the visual field. Here we test whether this non-spatial component can co-select individual features that are perceptually bound into a coherent object. We combined human psychophysics and functional magnetic resonance imaging (fMRI) to demonstrate the ability to co-select individual features from perceptually coherent objects. Our study used binocular disparity and visual motion to define disparity structure-from-motion (dSFM) stimuli. Although the spatial attention system induced strong modulations of the fMRI response in visual regions, the non-spatial system’s ability to co-select features of the dSFM stimulus was less pronounced and variable across subjects. Our results demonstrate that feature and global feature attention effects are variable across participants, suggesting that the feature attention system may be limited in its ability to automatically select features within the attended object. Careful comparison of the task design suggests that even minor differences in the perceptual task may be critical in revealing the presence of global feature attention.

Individual differences in attentional modulation of cortical responses correlate with selective attention performance

Many studies have shown that attention modulates the cortical representation of an auditory scene, emphasizing an attended source while suppressing competing sources. Yet, individual differences in the strength of this attentional modulation and their relationship with selective attention ability are poorly understood. Here, we ask whether differences in how strongly attention modulates cortical responses reflect differences in normal-hearing listeners' selective auditory attention ability. We asked listeners to attend to one of three competing melodies and identify its pitch contour while we measured cortical electroencephalographic responses. The three melodies were either from widely separated pitch ranges ("easy trials"), or from a narrow, overlapping pitch range ("hard trials"). The melodies started at slightly different times; listeners attended either the leading or lagging melody. Because of the timing of the onsets, the leading melody drew attention exogenously. In contrast, attending the lagging melody required listeners to direct top-down attention volitionally. We quantified how attention amplified auditory N1 response to the attended melody and found large individual differences in the N1 amplification, even though only correctly answered trials were used to quantify the ERP gain. Importantly, listeners with the strongest amplification of N1 response to the lagging melody in the easy trials were the best performers across other types of trials. Our results raise the possibility that individual differences in the strength of top-down gain control reflect inherent differences in the ability to control top-down attention.

Task preparation and neural activation in stimulus-specific brain regions: an fMRI study with the cued task-switching paradigm

To investigate the role of posterior brain regions related to task-relevant stimulus processing in task preparation, we used a cued task-switching paradigm in which a pre-cue informed participants about the upcoming task on a trial: face discrimination or number comparison. Employing an event-related fMRI design, we examined for changes of activity in face- and number-related posterior brain regions (right fusiform face area (FFA) and right intraparietal sulcus (IPSnum), respectively), and explored the functional connectivity of these areas with other brain regions, during the (preparation) interval between cue onset and onset of the (to-be-responded) target stimulus. The results revealed task-relevant posterior brain regions to be modulated during this period: activation in task-relevant stimulus-specific regions was selectively enhanced and their functional connectivity to task-relevant anterior brain regions strengthened (right FFA - face task, right IPSnum - number task) while participants prepared for the cued task. Additionally, activity in task-relevant posterior brain regions was influenced by residual activation from the preceding trial in the right FFA and the right IPSnum, respectively. These findings indicate that, during task preparation, the activation pattern in currently task-relevant posterior brain regions is shaped by residual activation as well as preparatory modulation prior to the onset of the critical stimulus, even without participants being instructed to imagine the stimulus.

Endogenous attention signals evoked by threshold contrast detection in human superior colliculus

Human superior colliculus (SC) responds in a retinotopically selective manner when attention is deployed on a high-contrast visual stimulus using a discrimination task. To further elucidate the role of SC in endogenous visual attention, high-resolution fMRI was used to demonstrate that SC also exhibits a retinotopically selective response for covert attention in the absence of significant visual stimulation using a threshold-contrast detection task. SC neurons have a laminar organization according to their function, with visually responsive neurons present in the superficial layers and visuomotor neurons in the intermediate layers. The results show that the response evoked by the threshold-contrast detection task is significantly deeper than the response evoked by the high-contrast speed discrimination task, reflecting a functional dissociation of the attentional enhancement of visuomotor and visual neurons, respectively. Such a functional dissociation of attention within SC laminae provides a subcortical basis for the oculomotor theory of attention.

Coarse-scale biases for spirals and orientation in human visual cortex

Multivariate decoding analyses are widely applied to functional magnetic resonance imaging (fMRI) data, but there is controversy over their interpretation. Orientation decoding in primary visual cortex (V1) reflects coarse-scale biases, including an over-representation of radial orientations. But fMRI responses to clockwise and counter-clockwise spirals can also be decoded. Because these stimuli are matched for radial orientation, while differing in local orientation, it has been argued that fine-scale columnar selectivity for orientation contributes to orientation decoding. We measured fMRI responses in human V1 to both oriented gratings and spirals. Responses to oriented gratings exhibited a complex topography, including a radial bias that was most pronounced in the peripheral representation, and a near-vertical bias that was most pronounced near the foveal representation. Responses to clockwise and counter-clockwise spirals also exhibited coarse-scale organization, at the scale of entire visual quadrants. The preference of each voxel for clockwise or counter-clockwise spirals was predicted from the preferences of that voxel for orientation and spatial position (i.e., within the retinotopic map). Our results demonstrate a bias for local stimulus orientation that has a coarse spatial scale, is robust across stimulus classes (spirals and gratings), and suffices to explain decoding from fMRI responses in V1.

Spontaneous neuronal activity predicts intersubject variations in executive control of attention

Executive control of attention regulates our thoughts, emotion and behavior. Individual differences in executive control are associated with task-related differences in brain activity. But it is unknown whether attentional differences depend on endogenous (resting state) brain activity and to what extent regional fluctuations and functional connectivity contribute to individual variations in executive control processing. Here, we explored the potential contribution of intrinsic brain activity to executive control by using resting-state functional magnetic resonance imaging (fMRI). Using the amplitude of low-frequency fluctuations (ALFF) as an index of spontaneous brain activity, we found that ALFF in the right precuneus (PCUN) and the medial part of left superior frontal gyrus (msFC) was significantly correlated with the efficiency of executive control processing. Crucially, the strengths of functional connectivity between the right PCUN/left msFC and distributed brain regions, including the left fusiform gyrus, right inferior frontal gyrus, left superior frontal gyrus and right precentral gyrus, were correlated with individual differences in executive performance. Together, the ALFF and functional connectivity accounted for 67% of the variability in behavioral performance. Moreover, the strength of functional connectivity between specific regions could predict more individual variability in executive control performance than regionally specific fluctuations. In conclusion, our findings suggest that spontaneous brain activity may reflect or underpin executive control of attention. It will provide new insights into the origins of inter-individual variability in human executive control processing.

Prestimulus alpha power predicts fidelity of sensory encoding in perceptual decision making

Pre-stimulus α power has been shown to correlate with the behavioral accuracy of perceptual decisions. In most cases, these correlations have been observed by comparing α power for different behavioral outcomes (e.g. correct vs incorrect trials). In this paper we investigate such covariation within the context of behaviorally-latent fluctuations in task-relevant post-stimulus neural activity. Specially we consider variations of pre-stimulus α power with post-stimulus EEG components in a two alternative forced choice visual discrimination task. EEG components, discriminative of stimulus class, are identified using a linear multivariate classifier and only the variability of the components for correct trials (regardless of stimulus class, and for nominally identical stimuli) are correlated with the corresponding pre-stimulus α power. We find a significant relationship between the mean and variance of the pre-stimulus α power and the variation of the trial-to-trial magnitude of an early post-stimulus EEG component. This relationship is not seen for a later EEG component that is also discriminative of stimulus class and which has been previously linked to the quality of evidence driving the decision process. Our results suggest that early perceptual representations, rather than temporally later neural correlates of the perceptual decision, are modulated by pre-stimulus state.

Prediction of rat behavior outcomes in memory tasks using functional connections among neurons

BACKGROUND

Analyzing the neuronal organizational structures and studying the changes in the behavior of the organism is key to understanding cognitive functions of the brain. Although some studies have indicated that spatiotemporal firing patterns of neuronal populations have a certain relationship with the behavioral responses, the issues of whether there are any relationships between the functional networks comprised of these cortical neurons and behavioral tasks and whether it is possible to take advantage of these networks to predict correct and incorrect outcomes of single trials of animals are still unresolved.

METHODOLOGY/PRINCIPAL FINDINGS

This paper presents a new method of analyzing the structures of whole-recorded neuronal functional networks (WNFNs) and local neuronal circuit groups (LNCGs). The activity of these neurons was recorded in several rats. The rats performed two different behavioral tasks, the Y-maze task and the U-maze task. Using the results of the assessment of the WNFNs and LNCGs, this paper describes a realization procedure for predicting the behavioral outcomes of single trials. The methodology consists of four main parts: construction of WNFNs from recorded neuronal spike trains, partitioning the WNFNs into the optimal LNCGs using social community analysis, unsupervised clustering of all trials from each dataset into two different clusters, and predicting the behavioral outcomes of single trials. The results show that WNFNs and LNCGs correlate with the behavior of the animal. The U-maze datasets show higher accuracy for unsupervised clustering results than those from the Y-maze task, and these datasets can be used to predict behavioral responses effectively.

CONCLUSIONS/SIGNIFICANCE

The results of the present study suggest that a methodology proposed in this paper is suitable for analysis of the characteristics of neuronal functional networks and the prediction of rat behavior. These types of structures in cortical ensemble activity may be critical to information representation during the execution of behavior.

The differential effects of reward on space- and object-based attentional allocation

Estimating reward contingencies and allocating attentional resources to a subset of relevant information are the most important contributors to increasing adaptability of an organism. Although recent evidence suggests that reward- and attention-based guidance recruits overlapping cortical regions and has similar effects on sensory responses, the exact nature of the relationship between the two remains elusive. Here, using event-related fMRI on human participants, we contrasted the effects of reward on space- and object-based selection in the same experimental setting. Reward was either distributed randomly or biased a particular object. Behavioral and neuroimaging results show that space- and object-based attention is influenced by reward differentially. Space-based attentional allocation is mandatory, integrating reward information over time, whereas object-based attentional allocation is a default setting that is completely replaced by the reward signal. Nonadditivity of the effects of reward and object-based attention was observed consistently at multiple levels of analysis in early visual areas as well as in control regions. These results provide strong evidence that space- and object-based allocation are two independent attentional mechanisms, and suggest that reward serves to constrain attentional selection.

Unconscious Priming Requires Early Visual Cortex at Specific Temporal Phases of Processing

Although examples of unconscious shape priming have been well documented, whether such priming requires early visual cortex (V1/V2) has not been established. In the current study, we used TMS of V1/V2 at varying temporal intervals to suppress the visibility of preceding shape primes while the interval between primes and targets was kept constant. Our results show that, although conscious perception requires V1/V2, unconscious priming can occur without V1/V2 at an intermediate temporal interval but not at early (5–25 msec) or later (65–125 msec) stages of processing. Because the later time window of unconscious priming suppression has been proposed to interfere with feedback processing, our results further suggest that feedback processing is also essential for unconscious priming and may not be a sufficient condition for conscious vision.

Temporal dynamics of visual attention measured with event-related potentials

How attentional modulation on brain activities determines behavioral performance has been one of the most important issues in cognitive neuroscience. This issue has been addressed by comparing the temporal relationship between attentional modulations on neural activities and behavior. Our previous study measured the time course of attention with amplitude and phase coherence of steady-state visual evoked potential (SSVEP) and found that the modulation latency of phase coherence rather than that of amplitude was consistent with the latency of behavioral performance. In this study, as a complementary report, we compared the time course of visual attention shift measured by event-related potentials (ERPs) with that by target detection task. We developed a novel technique to compare ERPs with behavioral results and analyzed the EEG data in our previous study. Two sets of flickering stimulus at different frequencies were presented in the left and right visual hemifields, and a target or distracter pattern was presented randomly at various moments after an attention-cue presentation. The observers were asked to detect targets on the attended stimulus after the cue. We found that two ERP components, P300 and N2pc, were elicited by the target presented at the attended location. Time-course analyses revealed that attentional modulation of the P300 and N2pc amplitudes increased gradually until reaching a maximum and lasted at least 1.5 s after the cue onset, which is similar to the temporal dynamics of behavioral performance. However, attentional modulation of these ERP components started later than that of behavioral performance. Rather, the time course of attentional modulation of behavioral performance was more closely associated with that of the concurrently recorded SSVEPs analyzed. These results suggest that neural activities reflected not by either the P300 or N2pc, but by the SSVEPs, are the source of attentional modulation of behavioral performance.

Redundancy gains in retinotopic cortex

It is widely claimed that interactions among simultaneously presented visual stimuli are suppressive and that these interactions primarily occur when stimuli fall within the same receptive field (Desimone and Duncan 1995). Here, we show evidence for a novel form of interaction between simultaneously presented but distant stimuli that does not fit either pattern. To examine interactions between simultaneously presented stimuli, we measure the response to a single stimulus as a function of whether or not other stimuli are also presented simultaneously, and we further ask how the response to a given stimulus is affected by whether the simultaneously present stimuli are identical or different from each other. Our method reveals a new phenomenon of "redundancy gain:" the visual response to a stimulus is higher when accompanied by identical stimuli than when that stimulus is presented alone, even though the stimuli are displayed in separate visual quadrants. This pattern is observed throughout the visual hierarchy, including V1 and V2, and we show that it is distinct from the well-known simultaneous suppression effect (Kastner et al. 1998). We propose that the redundancy gain in early retinotopic cortex results from feedback from higher visual areas and may underlie perceptual averaging and other ensemble coding phenomena observed behaviorally.

Visual crowding in V1

In peripheral vision, objects in clutter are difficult to identify. The exact cause of this "crowding" effect is unclear. To perceive coherent shapes in clutter, the visual system must integrate certain local features across receptive fields while preventing others from being combined. It is believed that this selective feature integration-segmentation process is impaired in peripheral vision, leading to crowding. We used functional magnetic resonance imaging (fMRI) to investigate the neural origin of crowding. We found that crowding was associated with suppressed fMRI signal as early as V1, regardless of whether attention was directed toward or away from a target stimulus. This suppression in early visual cortex was greatest for stimuli that produced the strongest crowding. In contrast, the pattern of activity was mixed in higher level visual areas, such as the lateral occipital cortex. These results support the view that the deficiency in feature integration and segmentation in peripheral vision is present at the earliest stages of cortical processing.

A functional and perceptual signature of the second visual area in primates

There is no generally accepted account of the function of the second visual cortical area (V2), partly because no simple response properties robustly distinguish V2 neurons from those in primary visual cortex (V1). We constructed synthetic stimuli replicating the higher-order statistical dependencies found in natural texture images and used them to stimulate macaque V1 and V2 neurons. Most V2 cells responded more vigorously to these textures than to control stimuli lacking naturalistic structure; V1 cells did not. Functional magnetic resonance imaging (fMRI) measurements in humans revealed differences between V1 and V2 that paralleled the neuronal measurements. The ability of human observers to detect naturalistic structure in different types of texture was well predicted by the strength of neuronal and fMRI responses in V2 but not in V1. Together, these results reveal a particular functional role for V2 in the representation of natural image structure.

Human decision making based on variations in internal noise: an EEG study

Perceptual decision making is prone to errors, especially near threshold. Physiological, behavioural and modeling studies suggest this is due to the intrinsic or ‘internal’ noise in neural systems, which derives from a mixture of bottom-up and top-down sources. We show here that internal noise can form the basis of perceptual decision making when the external signal lacks the required information for the decision. We recorded electroencephalographic (EEG) activity in listeners attempting to discriminate between identical tones. Since the acoustic signal was constant, bottom-up and top-down influences were under experimental control. We found that early cortical responses to the identical stimuli varied in global field power and topography according to the perceptual decision made, and activity preceding stimulus presentation could predict both later activity and behavioural decision. Our results suggest that activity variations induced by internal noise of both sensory and cognitive origin are sufficient to drive discrimination judgments.

Neocortical correlates of vibrotactile detection in humans

This study examined the cortical representation of vibrotactile detection in humans using event-related fMRI paired with psychophysics. Suprathreshold vibrotactile stimulation activated several areas, including primary (SI) and second somatosensory cortices (SII/PV). For threshold-level stimuli, poststimulus activity in contralateral and ipsilateral SII/PV was the best correlate of detection success. In these areas, evoked signals on hit trials were significantly greater than on missed trials in all participants, and the relative activity level across stimulation amplitudes matched perceptual performance. Activity in the anterior insula and superior temporal gyrus also correlated with hits and misses, suggesting that a "ventral stream" of somatosensory representations may play a crucial role in detection. In contrast, poststimulus activity in Area SI was not well correlated with perception and showed an overall negative response profile for threshold-level stimulation. A different correlate of detection success was, however, observed in SI. Activity in this representation immediately before stimulus onset predicted performance, a finding that was unique to SI. These findings emphasize the potential role of SII/PV in detection, the importance of state dynamics in SI for perception, and the possibility that changes in the temporal and spatial pattern of SI activity may be essential to the optimal representation of threshold-level stimuli for detection.

Brain modifications after acute alcohol consumption analyzed by resting state fMRI

Resting-state functional magnetic resonance imaging (fMRI) is a recent breakthrough in neuroimaging research able to describe "in vivo" the spontaneous baseline neuronal activity characterized by blood oxygen level dependent (BOLD) signal fluctuations at slow frequency (0.01-0.1Hz) that, in the absence of any task, forms spatially distributed functional connectivity networks, called resting state networks (RSNs). The aim of this study was to investigate, in the young and healthy population, the changing of the RSNs after acute ingestion of an alcohol dose able to determine a blood concentration (0.5g/L) that barely exceeds the legal limits for driving in the majority of European Countries. Fifteen healthy volunteers underwent two fMRI sessions using a 1.5T MR scanner before and after alcohol oral consumption. The main sequence acquired was EPI 2D BOLD, one per each session. To prevent the excessive alcohol consumption the subjects underwent the estimation of blood rate by breath test and after the stabilization of blood alcohol level (BAL) at 0.5g/L the subjects underwent the second fMRI session. Functional data elaboration was carried out using the probabilistic independent component analysis (PICA). Spatial maps so obtained were further organized, with MELODIC multisession temporal concatenation FSL option, in a cluster representing the group of pre-alcohol sessions and the group of post-alcohol sessions, followed by the dual regression approach in order to evaluate the increase or decrease in terms of connectivity in the RSNs between the two sessions at group level. The results we obtained reveal that acute consumption of alcohol reduces in a significant way the BOLD signal fluctuations in the resting brain selectively in the sub-callosal cortex (SCC), in left temporal fusiform cortex (TFC) and left inferior temporal gyrus (ITG), which are cognitive regions known to be part of the reward brain network and the ventral visual system.

The role of prestimulus activity in visual extinction

Patients with visual extinction following right-hemisphere damage sometimes see and sometimes miss stimuli in the left visual field, particularly when stimuli are presented simultaneously to both visual fields. Awareness of left visual field stimuli is associated with increased activity in bilateral parietal and frontal cortex. However, it is unknown why patients see or miss these stimuli. Previous neuroimaging studies in healthy adults show that prestimulus activity biases perceptual decisions, and biases in visual perception can be attributed to fluctuations in prestimulus activity in task relevant brain regions. Here, we used functional MRI to investigate whether prestimulus activity affected perception in the context of visual extinction following stroke. We measured prestimulus activity in stimulus-responsive cortical areas during an extinction paradigm in a patient with unilateral right parietal damage and visual extinction. This allowed us to compare prestimulus activity on physically identical bilateral trials that either did or did not lead to visual extinction. We found significantly increased activity prior to stimulus presentation in two areas that were also activated by visual stimulation: the left calcarine sulcus and right occipital inferior cortex. Using dynamic causal modelling (DCM) we found that both these differences in prestimulus activity and stimulus evoked responses could be explained by enhanced effective connectivity within and between visual areas, prior to stimulus presentation. Thus, we provide evidence for the idea that differences in ongoing neural activity in visually responsive areas prior to stimulus onset affect awareness in visual extinction, and that these differences are mediated by fluctuations in extrinsic and intrinsic connectivity.

•

Prestimulus activity in visual extinction affects perception.

•

The BOLD signal in two visual areas is indicative of perception in bilateral trials.

•

Intrinsic and extrinsic connectivity is elevated prior to perceived trials.

Anticipation increases tactile stimulus processing in the ipsilateral primary somatosensory cortex

Stimulus anticipation improves perception. To account for this improvement, we investigated how stimulus processing is altered by anticipation. In contrast to a large body of previous work, we employed a demanding perceptual task and investigated sensory responses that occur beyond early evoked activity in contralateral primary sensory areas: Stimulus-induced modulations of neural oscillations. For this, we recorded magnetoencephalography in 19 humans while they performed a cued tactile identification task involving the identification of either a proximal or a distal stimulation on the fingertips. We varied the cue-target interval between 0 and 1000 ms such that tactile targets occurred at various degrees of anticipation. This allowed us to investigate the influence of anticipation on stimulus processing in a parametric fashion. We observed that anticipation increases the stimulus-induced response (suppression of beta-band oscillations) originating from the ipsilateral primary somatosensory cortex. This occurs in the period in which the tactile memory trace is analyzed and is correlated with the anticipation-induced improvement in tactile perception. We propose that this ipsilateral response indicates distributed processing across bilateral primary sensory cortices, of which the extent increases with anticipation. This constitutes a new and potentially important mechanism contributing to perception and its improvement following anticipation.

Top-down influences on visual processing

Re-entrant or feedback pathways between cortical areas carry rich and varied information about behavioural context, including attention, expectation, perceptual tasks, working memory and motor commands. Neurons receiving such inputs effectively function as adaptive processors that are able to assume different functional states according to the task being executed. Recent data suggest that the selection of particular inputs, representing different components of an association field, enable neurons to take on different functional roles. In this Review, we discuss the various top-down influences exerted on the visual cortical pathways and highlight the dynamic nature of the receptive field, which allows neurons to carry information that is relevant to the current perceptual demands.

Improving visual perception through neurofeedback

Perception depends on the interplay of ongoing spontaneous activity and stimulus-evoked activity in sensory cortices. This raises the possibility that training ongoing spontaneous activity alone might be sufficient for enhancing perceptual sensitivity. To test this, we trained human participants to control ongoing spontaneous activity in circumscribed regions of retinotopic visual cortex using real-time functional MRI-based neurofeedback. After training, we tested participants using a new and previously untrained visual detection task that was presented at the visual field location corresponding to the trained region of visual cortex. Perceptual sensitivity was significantly enhanced only when participants who had previously learned control over ongoing activity were now exercising control and only for that region of visual cortex. Our new approach allows us to non-invasively and non-pharmacologically manipulate regionally specific brain activity and thus provide "brain training" to deliver particular perceptual enhancements.

Neural dynamics of neglected targets in patients with right hemisphere damage

We studied the neural correlates of target omissions in five patients with right hemisphere damage and varying signs of left spatial neglect. Benefiting from the high temporal resolution of magneto-encephalography, we directly compared brain regional synchrony events of detected and omitted left-sided targets. Results showed that before stimulus presentation, a low beta synchronization activity was specifically increased within left frontal areas before pathological response omissions of left-sided targets. In the same pre-stimulus period, there were no such beta oscillations when patients correctly detected the target, or when no target was presented. Our findings emphasize the importance of neural activity during the pre-stimulus period on subsequent stimulus processing, and highlight the consequences of episodic interruptions of large-scale interhemispheric networks on target detection. Furthermore, our data suggest that prefrontal activity is not necessarily beneficial to target detection, but can be detrimental to it.

Spatial and object-based attention modulates broadband high-frequency responses across the human visual cortical hierarchy

One of the puzzling aspects in the visual attention literature is the discrepancy between electrophysiological and fMRI findings: whereas fMRI studies reveal strong attentional modulation in the earliest visual areas, single-unit and local field potential studies yielded mixed results. In addition, it is not clear to what extent spatial attention effects extend from early to high-order visual areas. Here we addressed these issues using electrocorticography recordings in epileptic patients. The patients performed a task that allowed simultaneous manipulation of both spatial and object-based attention. They were presented with composite stimuli, consisting of a small object (face or house) superimposed on a large one, and in separate blocks, were instructed to attend one of the objects. We found a consistent increase in broadband high-frequency (30-90 Hz) power, but not in visual evoked potentials, associated with spatial attention starting with V1/V2 and continuing throughout the visual hierarchy. The magnitude of the attentional modulation was correlated with the spatial selectivity of each electrode and its distance from the occipital pole. Interestingly, the latency of the attentional modulation showed a significant decrease along the visual hierarchy. In addition, electrodes placed over high-order visual areas (e.g., fusiform gyrus) showed both effects of spatial and object-based attention. Overall, our results help to reconcile previous observations of discrepancy between fMRI and electrophysiology. They also imply that spatial attention effects can be found both in early and high-order visual cortical areas, in parallel with their stimulus tuning properties.

Roles of default-mode network and supplementary motor area in human vigilance performance: evidence from real-time fMRI

We used real-time functional magnetic resonance imaging (fMRI) to determine which regions of the human brain have a role in vigilance as measured by reaction time (RT) to variably timed stimuli. We first identified brain regions where activation before stimulus presentation predicted RT. Slower RT was preceded by greater activation in the default-mode network, including lateral parietal, precuneus, and medial prefrontal cortices; faster RT was preceded by greater activation in the supplementary motor area (SMA). We examined the roles of these brain regions in vigilance by triggering trials based on brain states defined by blood oxygenation level-dependent activation measured using real-time fMRI. When activation of relevant neural systems indicated either a good brain state (increased activation of SMA) or a bad brain state (increased activation of lateral parietal cortex and precuneus) for performance, a target was presented and RT was measured. RTs on trials triggered by a good brain state were significantly faster than RTs on trials triggered by a bad brain state. Thus human performance was controlled by monitoring brain states that indicated high or low vigilance. These findings identify neural systems that have a role in vigilance and provide direct evidence that the default-mode network has a role in human performance. The ability to control and enhance human behavior based on brain state may have broad implications.

Perceptual learning selectively refines orientation representations in early visual cortex

Although practice has long been known to improve perceptual performance, the neural basis of this improvement in humans remains unclear. Using fMRI in conjunction with a novel signal detection-based analysis, we show that extensive practice selectively enhances the neural representation of trained orientations in the human visual cortex. Twelve observers practiced discriminating small changes in the orientation of a laterally presented grating over 20 or more daily 1 h training sessions. Training on average led to a twofold improvement in discrimination sensitivity, specific to the trained orientation and the trained location, with minimal improvement found for untrained orthogonal orientations or for orientations presented in the untrained hemifield. We measured the strength of orientation-selective responses in individual voxels in early visual areas (V1-V4) using signal detection measures, both before and after training. Although the overall amplitude of the BOLD response was no greater after training, practice nonetheless specifically enhanced the neural representation of the trained orientation at the trained location. This training-specific enhancement of orientation-selective responses was observed in the primary visual cortex (V1) as well as higher extrastriate visual areas V2-V4, and moreover, reliably predicted individual differences in the behavioral effects of perceptual learning. These results demonstrate that extensive training can lead to targeted functional reorganization of the human visual cortex, refining the cortical representation of behaviorally relevant information.

Two critical and functionally distinct stages of face and body perception

Cortical regions that respond preferentially to particular object categories, such as faces and bodies, are essential for visual perception of these object categories. However, precisely when these regions play a causal role in recognition of their preferred categories is unclear. Here we addressed this question using transcranial magnetic stimulation (TMS). Across a series of experiments, TMS was delivered over the functionally localized right occipital face area (rOFA) or right extrastriate body area (rEBA) at different latencies, up to 150 ms, after stimulus onset while adult human participants performed delayed match-to-sample tasks on face and body stimuli. Results showed that TMS disrupted task performance during two temporally distinct time periods after stimulus onset, the first at 40/50 ms and the second at 100/110 ms. These two time periods exhibited functionally distinct patterns of impairment: TMS delivered during the early time period (at 40/50 ms) disrupted task performance for both preferred (faces at rOFA and bodies at rEBA) and nonpreferred (bodies at rOFA and faces at rEBA) categories. In contrast, TMS delivered during the later time period (at 100/110 ms) disrupted task performance for the preferred category only of each area (faces at rOFA and bodies at rEBA). These results indicate that category-selective cortical regions are critical for two functionally distinct stages of visual object recognition: an early, presumably preparatory stage that is not category selective occurring almost immediately after stimulus onset, followed by a later stage of category-specific perceptual processing.

Strength of retinotopic representation of visual memories is modulated by strategy

Human visual cortex shows retinotopic organization during both perception and attention, but whether this remains true for visual short-term memory (VSTM) is uncertain. In 2 functional magnetic resonance imaging experiments, we separated retinotopic activation during perception, attention, and VSTM maintenance. The 2 experiments differed in whether spatial encoding of the VSTM stimuli and prospective attention to the locations of the remembered items was encouraged or discouraged. Using multivoxel pattern analysis to extract a measure of spatial coding in early visual cortex, we saw sensory and attentional retinotopic coding in both experiments. However, significant spatial coding during memory maintenance was only seen where a spatial strategy was encouraged. Furthermore, individual differences in attentional spatial coding predicted performance in both experiments, while individual differences in maintenance spatial coding predicted performance in neither. We conclude that retinotopic coding in the early visual cortex during VSTM maintenance is not obligatory, that attentional processes during stimulus perception modulate memory performance, and that different attentional strategies are used depending on the task in hand.

Predicting errors from reconfiguration patterns in human brain networks

Task preparation is a complex cognitive process that implements anticipatory adjustments to facilitate future task performance. Little is known about quantitative network parameters governing this process in humans. Using functional magnetic resonance imaging (fMRI) and functional connectivity measurements, we show that the large-scale topology of the brain network involved in task preparation shows a pattern of dynamic reconfigurations that guides optimal behavior. This network could be decomposed into two distinct topological structures, an error-resilient core acting as a major hub that integrates most of the network's communication and a predominantly sensory periphery showing more flexible network adaptations. During task preparation, core-periphery interactions were dynamically adjusted. Task-relevant visual areas showed a higher topological proximity to the network core and an enhancement in their local centrality and interconnectivity. Failure to reconfigure the network topology was predictive for errors, indicating that anticipatory network reconfigurations are crucial for successful task performance. On the basis of a unique network decoding approach, we also develop a general framework for the identification of characteristic patterns in complex networks, which is applicable to other fields in neuroscience that relate dynamic network properties to behavior.

Willed action, free will, and the stochastic neurodynamics of decision-making

It is shown that the randomness of the firing times of neurons in decision-making attractor neuronal networks that is present before the decision cues are applied can cause statistical fluctuations that influence the decision that will be taken. In this rigorous sense, it is possible to partially predict decisions before they are made. This raises issues about free will and determinism. There are many decision-making networks in the brain. Some decision systems operate to choose between gene-specified rewards such as taste, touch, and beauty (in for example the peacock's tail). Other processes capable of planning ahead with multiple steps held in working memory may require correction by higher order thoughts that may involve explicit, conscious, processing. The explicit system can allow the gene-specified rewards not to be selected or deferred. The decisions between the selfish gene-specified rewards, and the explicitly calculated rewards that are in the interests of the individual, the phenotype, may themselves be influenced by noise in the brain. When the explicit planning system does take the decision, it can report on its decision-making, and can provide a causal account rather than a confabulation about the decision process. We might use the terms "willed action" and "free will" to refer to the operation of the planning system that can think ahead over several steps held in working memory with which it can take explicit decisions. Reduced connectivity in some of the default mode cortical regions including the precuneus that are active during self-initiated action appears to be related to the reduction in the sense of self and agency, of causing willed actions, that can be present in schizophrenia.

Contextual task difficulty modulates stimulus discrimination: electrophysiological evidence for interaction between sensory and executive processes

The occipital-temporal N1 component of the event-related potential (ERP) has previously been shown to index a stimulus discrimination process. However, the N1 has not consistently been shown to be sensitive to the difficulty of stimulus discrimination. Here, we manipulated the difficulty of stimulus discrimination by modulating the similarity between serially presented targets and nontargets. The same target stimulus was employed in both easy and difficult discrimination contexts, and these physically identical target stimuli elicited a larger N1 and smaller P3b in the difficult task context. Moreover, when targets were incorrectly categorized, N1 amplitude was diminished and a P3b was not elicited. These findings provide evidence that the N1 component reflects a sensory discrimination process that is modulated by executive control, and that this component can index discrimination errors when stimulus discrimination is difficult.

The neuroimaging signal is a linear sum of neurally distinct stimulus- and task-related components

Neuroimaging (for example, functional magnetic resonance imaging) signals are taken as a uniform proxy for local neural activity. By simultaneously recording electrode and neuroimaging (intrinsic optical imaging) signals in alert, task-engaged macaque visual cortex, we recently observed a large anticipatory trial-related neuroimaging signal that was poorly related to local spiking or field potentials. We used these same techniques to study the interactions of this trial-related signal with stimulus-evoked responses over the full range of stimulus intensities, including total darkness. We found that the two signals could be separated, and added linearly over this full range. The stimulus-evoked component was related linearly to local spiking and, consequently, could be used to obtain precise and reliable estimates of local neural activity. The trial-related signal likely has a distinct neural mechanism, however, and failure to account for it properly could lead to substantial errors when estimating local neural spiking from the neuroimaging signal.

Attentional modulations related to spatial gating but not to allocation of limited resources in primate V1

Attention can modulate neural responses in sensory cortical areas and improve behavioral performance in perceptual tasks. However, the nature and purpose of these modulations remain under debate. Here we used voltage-sensitive dye imaging (VSDI) to measure V1 population responses while monkeys performed a difficult detection task under focal or distributed attention. We found that V1 responses at attended locations are significantly elevated relative to actively ignored or irrelevant locations, consistent with the hypothesis that an important goal of attention in V1 is to highlight task-relevant information. Surprisingly, these modulations were indistinguishable under focal and distributed attention, suggesting a minor or no role for attention as a mechanism for allocating limited representational resources in V1. The response elevation at attended locations is additive, is widespread, and starts shortly before stimulus onset. This elevation could contribute to spatial gating by biasing competition in subsequent processing stages in favor of attended stimuli.

Intrinsic resting-state activity predicts working memory brain activation and behavioral performance

Although resting-state brain activity has been demonstrated to correspond with task-evoked brain activation, the relationship between intrinsic and evoked brain activity has not been fully characterized. For example, it is unclear whether intrinsic activity can also predict task-evoked deactivation and whether the rest-task relationship is dependent on task load. In this study, we addressed these issues on 40 healthy control subjects using resting-state and task-driven [N-back working memory (WM) task] functional magnetic resonance imaging data collected in the same session. Using amplitude of low-frequency fluctuation (ALFF) as an index of intrinsic resting-state activity, we found that ALFF in the middle frontal gyrus and inferior/superior parietal lobules was positively correlated with WM task-evoked activation, while ALFF in the medial prefrontal cortex, posterior cingulate cortex, superior frontal gyrus, superior temporal gyrus, and fusiform gyrus was negatively correlated with WM task-evoked deactivation. Further, the relationship between the intrinsic resting-state activity and task-evoked activation in lateral/superior frontal gyri, inferior/superior parietal lobules, superior temporal gyrus, and midline regions was stronger at higher WM task loads. In addition, both resting-state activity and the task-evoked activation in the superior parietal lobule/precuneus were significantly correlated with the WM task behavioral performance, explaining similar portions of intersubject performance variance. Together, these findings suggest that intrinsic resting-state activity facilitates or is permissive of specific brain circuit engagement to perform a cognitive task, and that resting activity can predict subsequent task-evoked brain responses and behavioral performance.

Functional connectivity in the cognitive control network and the default mode network in late-life depression

BACKGROUND

Abnormalities have been identified in the Cognitive Control Network (CCN) and the Default Mode Network (DMN) during episodes of late-life depression. This study examined whether functional connectivity at rest (FC) within these networks characterizes late-life depression and predicts antidepressant response.

METHODS

26 non-demented, non-MCI older adults were studied. Of these, 16 had major depression and 10 had no psychopathology. Depressed patients were treated with escitalopram (target dose 20 mg) for 12 weeks after a 2-week placebo phase. Resting state time series was determined prior to treatment. FC within the CCN was determined by placing seeds in the dACC and the DLPFC bilaterally. FC within the DMN was assessed from a seed placed in the posterior cingulate.

RESULTS

Low resting FC within the CCN and high resting FC within the DMN distinguished depressed from normal elderly subjects. Beyond this "double dissociation", low resting FC within the CCN predicted low remission rate and persistence of depressive symptoms and signs, apathy, and dysexecutive behavior after treatment with escitalopram. In contrast, resting FC within the DMN was correlated with pessimism but did not predict treatment response.

CONCLUSIONS

If confirmed, these findings may serve as a signature of the brain's functional topography characterizing late-life depression and sustaining its symptoms. By identifying the network abnormalities underlying biologically meaningful characteristics (apathy, dysexecutive behavior, pessimism) and sustaining late-life depression, these findings can provide a novel target on which new somatic and psychosocial treatments can be tested.

Spatial pattern of BOLD fMRI activation reveals cross-modal information in auditory cortex

Recent findings suggest that neural representations in early auditory cortex reflect not only the physical properties of a stimulus, but also high-level, top-down, and even cross-modal information. However, the nature of cross-modal information in auditory cortex remains poorly understood. Here, we used pattern analyses of fMRI data to ask whether early auditory cortex contains information about the visual environment. Our data show that 1) early auditory cortex contained information about a visual stimulus when there was no bottom-up auditory signal, and that 2) no influence of visual stimulation was observed in auditory cortex when visual stimuli did not provide a context relevant to audition. Our findings attest to the capacity of auditory cortex to reflect high-level, top-down, and cross-modal information and indicate that the spatial patterns of activation in auditory cortex reflect contextual/implied auditory information but not visual information per se.

β functional connectivity modulation during the maintenance of motion information in working memory: importance of the familiarity of the visual context

The purpose of this study was to examine whether mechanisms, involved during the maintenance of familiar movement information in memory, were influenced by the degree of familiarity of the display in which the movements were embedded. Twelve gymnasts who possessed high visual and motor familiarity with the movements employed in this study, were recruited. They were invited to retain for a short period of time familiar movements viewed previously and presented under different displays with the aim of recognizing them at a later stage. The first display was a realistic, familiar display which presented videos of movements. The second display was an unfamiliar impoverished display never experienced in every day life which showed point-light movements. Activity during the maintenance period was considered in five frequency bands (4-8 Hz, 8-10 Hz, 10-13 Hz, 13-20 Hz, 20-30 Hz) using a non-linear measure of functional connectivity. The results in the 13-20 Hz frequency band showed that functional connectivity was greater within the frontal and right temporal areas during the unfamiliar display (i.e., point-light maintenance condition) compared to the familiar display (i.e., video maintenance condition). Differences in functional connectivity between the two maintenance conditions in the beta frequency band are mainly discussed in the light of the process of anticipation. Subjects' perception of the expected difficulty of the upcoming recognition task is discussed.

Noise in brain activity engenders perception and influences discrimination sensitivity

Behavioral and brain responses to identical stimuli can vary with experimental and task parameters, including the context of stimulus presentation or attention. More surprisingly, computational models suggest that noise-related random fluctuations in brain responses to stimuli would alone be sufficient to engender perceptual differences between physically identical stimuli. In two experiments combining psychophysics and EEG in healthy humans, we investigated brain mechanisms whereby identical stimuli are (erroneously) perceived as different (higher vs lower in pitch or longer vs shorter in duration) in the absence of any change in the experimental context. Even though, as expected, participants' percepts to identical stimuli varied randomly, a classification algorithm based on a mixture of Gaussians model (GMM) showed that there was sufficient information in single-trial EEG to reliably predict participants' judgments of the stimulus dimension. By contrasting electrical neuroimaging analyses of auditory evoked potentials (AEPs) to the identical stimuli as a function of participants' percepts, we identified the precise timing and neural correlates (strength vs topographic modulations) as well as intracranial sources of these erroneous perceptions. In both experiments, AEP differences first occurred ~100 ms after stimulus onset and were the result of topographic modulations following from changes in the configuration of active brain networks. Source estimations localized the origin of variations in perceived pitch of identical stimuli within right temporal and left frontal areas and of variations in perceived duration within right temporoparietal areas. We discuss our results in terms of providing neurophysiologic evidence for the contribution of random fluctuations in brain activity to conscious perception.

On the neural mechanisms subserving consciousness and attention

Consciousness, as described in the experimental literature, is a multi-faceted phenomenon, that impinges on other well-studied concepts such as attention and control. Do consciousness and attention refer to different aspects of the same core phenomenon, or do they correspond to distinct functions? One possibility to address this question is to examine the neural mechanisms underlying consciousness and attention. If consciousness and attention pertain to the same concept, they should rely on shared neural mechanisms. Conversely, if their underlying mechanisms are distinct, then consciousness and attention should be considered as distinct entities. This paper therefore reviews neurophysiological facts arguing in favor or against a tight relationship between consciousness and attention. Three neural mechanisms that have been associated with both attention and consciousness are examined (neural amplification, involvement of the fronto-parietal network, and oscillatory synchrony), to conclude that the commonalities between attention and consciousness at the neural level may have been overestimated. Last but not least, experiments in which both attention and consciousness were probed at the neural level point toward a dissociation between the two concepts. It therefore appears from this review that consciousness and attention rely on distinct neural properties, although they can interact at the behavioral level. It is proposed that a “cumulative influence model,” in which attention and consciousness correspond to distinct neural mechanisms feeding a single decisional process leading to behavior, fits best with available neural and behavioral data. In this view, consciousness should not be considered as a top-level executive function but should rather be defined by its experiential properties.

Spikes, BOLD, attention, and awareness: a comparison of electrophysiological and fMRI signals in V1

Early fMRI studies comparing results from fMRI and electrophysiological experiments support the notion that the blood oxygen level-dependent (BOLD) signal reliably follows the spiking activity of an underlying neuronal population averaged across a small region in space and a brief period in time. However, more recent studies focusing on higher level cognitive factors such as attention and visual awareness report striking discrepancies between the fMRI response in humans and electrophysiological signals in macaque early visual areas. Four hypotheses are discussed that can explain the discrepancies between the two methods: (1) the BOLD signal follows local field potential (LFP) signals closer than spikes, and only the LFP is modulated by top-down factors, (2) the BOLD signal is reflecting electrophysiological signals that are occurring later in time due to feedback delay, (3) the BOLD signal is more sensitive than traditional electrophysiological methods due to massive pooling by the hemodynamic coupling process, and finally (4) there is no real discrepancy, and instead, weak but reliable effects on firing rates may be obscured by differences in experimental design and interpretation of results across methods.

Spatiotemporal and frequency domain analysis of auditory paired stimuli processing in schizophrenia and bipolar disorder with psychosis

Individuals with schizophrenia (SZ) or bipolar disorder with psychosis (BPP) may share neurophysiological abnormalities as measured in auditory paired-stimuli paradigms with electroencephalography (EEG). Such investigations have been limited, however, by quantifying only event-related potential peaks and/or broad frequency bands at limited scalp locations without considering possible mediating factors (e.g., baseline differences). Results from 64-sensor EEG collected in 180 age- and gender-matched participants reveal (i) accentuated prestimulus gamma oscillations and (ii) reduced P2 amplitudes and theta/alpha oscillations to S1 among participants with both SZ and BPP. Conversely, (iii) N1s in those with SZ to S1 were reduced compared to healthy volunteers and those with BPP, whereas (iv) beta range oscillations 200-300 ms following S2 were accentuated in those with BPP but not those with SZ. Results reveal a pattern of both unique and shared neurophysiological phenotypes occurring within major psychotic diagnoses.

Olfactory predictive codes and stimulus templates in piriform cortex

Neuroscientific models of sensory perception suggest that the brain utilizes predictive codes in advance of a stimulus encounter, enabling organisms to infer forthcoming sensory events. However, it is poorly understood how such mechanisms are implemented in the olfactory system. Combining high-resolution functional magnetic resonance imaging with multivariate (pattern-based) analyses, we examined the spatiotemporal evolution of odor perception in the human brain during an olfactory search task. Ensemble activity patterns in anterior piriform cortex (APC) and orbitofrontal cortex (OFC) reflected the attended odor target both before and after stimulus onset. In contrast, prestimulus ensemble representations of the odor target in posterior piriform cortex (PPC) gave way to poststimulus representations of the odor itself. Critically, the robustness of target-related patterns in PPC predicted subsequent behavioral performance. Our findings directly show that the brain generates predictive templates or "search images" in PPC, with physical correspondence to odor-specific pattern representations, to augment olfactory perception.