First Steps in Using Multi-Voxel Pattern Analysis to Disentangle Neural Processes Underlying Generalization of Spider Fear

A core symptom of anxiety disorders is the tendency to interpret ambiguous information as threatening. Using electroencephalography and blood oxygenation level dependent magnetic resonance imaging (BOLD-MRI), several studies have begun to elucidate brain processes involved in fear-related perceptual biases, but thus far mainly found evidence for general hypervigilance in high fearful individuals. Recently, multi-voxel pattern analysis (MVPA) has become popular for decoding cognitive states from distributed patterns of neural activation. Here, we used this technique to assess whether biased fear generalization, characteristic of clinical fear, is already present during the initial perception and categorization of a stimulus, or emerges during the subsequent interpretation of a stimulus. Individuals with low spider fear (n = 20) and high spider fear (n = 18) underwent functional MRI scanning while viewing series of schematic flowers morphing to spiders. In line with previous studies, individuals with high fear of spiders were behaviorally more likely to classify ambiguous morphs as spiders than individuals with low fear of spiders. Univariate analyses of BOLD-MRI data revealed stronger activation toward spider pictures in high fearful individuals compared to low fearful individuals in numerous areas. Yet, neither average activation, nor support vector machine classification (i.e., a form of MVPA) matched the behavioral results – i.e., a biased response toward ambiguous stimuli – in any of the regions of interest. This may point to limitations of the current design, and to challenges associated with classifying emotional and neutral stimuli in groups that differ in their judgment of emotionality. Improvements for future research are suggested.

Are Autistic Traits in the General Population Related to Global and Regional Brain Differences?

There is accumulating evidence that autistic-related traits in the general population lie on a continuum, with autism spectrum disorders representing the extreme end of this distribution. Here, we tested the hypothesis of a possible relationship between autistic traits and brain morphometry in the general population. Participants completed the short autism-spectrum quotient-questionnaire (AQ); T1-anatomical and DWI-scans were acquired. Associations between autistic traits and gray matter, and white matter microstructural-integrity were performed on the exploration-group (N = 204; 105 males, M-age = 22.85), and validated in the validation-group (N = 304; 155 males, M-age = 22.82). No significant associations were found between AQ-scores and brain morphometry in the exploration-group, or after pooling the data. This questions the assumption that autistic traits and their morphological associations do lie on a continuum in the general population.

Machine learning and dyslexia: Classification of individual structural neuro-imaging scans of students with and without dyslexia

Meta-analytic studies suggest that dyslexia is characterized by subtle and spatially distributed variations in brain anatomy, although many variations failed to be significant after corrections of multiple comparisons. To circumvent issues of significance which are characteristic for conventional analysis techniques, and to provide predictive value, we applied a machine learning technique--support vector machine--to differentiate between subjects with and without dyslexia. In a sample of 22 students with dyslexia (20 women) and 27 students without dyslexia (25 women) (18-21 years), a classification performance of 80% (p < 0.001; d-prime = 1.67) was achieved on the basis of differences in gray matter (sensitivity 82%, specificity 78%). The voxels that were most reliable for classification were found in the left occipital fusiform gyrus (LOFG), in the right occipital fusiform gyrus (ROFG), and in the left inferior parietal lobule (LIPL). Additionally, we found that classification certainty (e.g. the percentage of times a subject was correctly classified) correlated with severity of dyslexia (r = 0.47). Furthermore, various significant correlations were found between the three anatomical regions and behavioural measures of spelling, phonology and whole-word-reading. No correlations were found with behavioural measures of short-term memory and visual/attentional confusion. These data indicate that the LOFG, ROFG and the LIPL are neuro-endophenotype and potentially biomarkers for types of dyslexia related to reading, spelling and phonology. In a second and independent sample of 876 young adults of a general population, the trained classifier of the first sample was tested, resulting in a classification performance of 59% (p = 0.07; d-prime = 0.65). This decline in classification performance resulted from a large percentage of false alarms. This study provided support for the use of machine learning in anatomical brain imaging.

The time course of natural scene perception with reduced attention

Attention is thought to impose an informational bottleneck on vision by selecting particular information from visual scenes for enhanced processing. Behavioral evidence suggests, however, that some scene information is extracted even when attention is directed elsewhere. Here, we investigated the neural correlates of this ability by examining how attention affects electrophysiological markers of scene perception. In two electro-encephalography (EEG) experiments, human subjects categorized real-world scenes as manmade or natural (full attention condition) or performed tasks on unrelated stimuli in the center or periphery of the scenes (reduced attention conditions). Scene processing was examined in two ways: traditional trial averaging was used to assess the presence of a categorical manmade/natural distinction in event-related potentials, whereas single-trial analyses assessed whether EEG activity was modulated by scene statistics that are diagnostic of naturalness of individual scenes. The results indicated that evoked activity up to 250 ms was unaffected by reduced attention, showing intact categorical differences between manmade and natural scenes and strong modulations of single-trial activity by scene statistics in all conditions. Thus initial processing of both categorical and individual scene information remained intact with reduced attention. Importantly, however, attention did have profound effects on later evoked activity; full attention on the scene resulted in prolonged manmade/natural differences, increased neural sensitivity to scene statistics, and enhanced scene memory. These results show that initial processing of real-world scene information is intact with diminished attention but that the depth of processing of this information does depend on attention.

Dyslexia and voxel-based morphometry: correlations between five behavioural measures of dyslexia and gray and white matter volumes

In voxel-based morphometry studies of dyslexia, the relation between causal theories of dyslexia and gray matter (GM) and white matter (WM) volume alterations is still under debate. Some alterations are consistently reported, but others failed to reach significance. We investigated GM alterations in a large sample of Dutch students (37 dyslexics and 57 non-dyslexics) with two analyses: group differences in local GM and total GM and WM volume and correlations between GM and WM volumes and five behavioural measures. We found no significant group differences after corrections for multiple comparisons although total WM volume was lower in the group of dyslexics when age was partialled out. We presented an overview of uncorrected clusters of voxels (p < 0.05, cluster size k > 200) with reduced or increased GM volume. We found four significant correlations between factors of dyslexia representing various behavioural measures and the clusters found in the first analysis. In the whole sample, a factor related to performances in spelling correlated negatively with GM volume in the left posterior cerebellum. Within the group of dyslexics, a factor related to performances in Dutch-English rhyme words correlated positively with GM volume in the left and right caudate nucleus and negatively with increased total WM volume. Most of our findings were in accordance with previous reports. A relatively new finding was the involvement of the caudate nucleus. We confirmed the multiple cognitive nature of dyslexia and suggested that experience greatly influences anatomical alterations depending on various subtypes of dyslexia, especially in a student sample.

Visual Information Shapes the Dynamics of Corticobasal Ganglia Pathways during Response Selection and Inhibition

Action selection often requires the transformation of visual information into motor plans. Preventing premature responses may entail the suppression of visual input and/or of prepared muscle activity. This study examined how the quality of visual information affects frontobasal ganglia (BG) routes associated with response selection and inhibition. Human fMRI data were collected from a stop task with visually degraded or intact face stimuli. During go trials, degraded spatial frequency information reduced the speed of information accumulation and response cautiousness. Effective connectivity analysis of the fMRI data showed action selection to emerge through the classic direct and indirect BG pathways, with inputs deriving form both prefrontal and visual regions. When stimuli were degraded, visual and prefrontal regions processing the stimulus information increased connectivity strengths toward BG, whereas regions evaluating visual scene content or response strategies reduced connectivity toward BG. Response inhibition during stop trials recruited the indirect and hyperdirect BG pathways, with input from visual and prefrontal regions. Importantly, when stimuli were nondegraded and processed fast, the optimal stop model contained additional connections from prefrontal to visual cortex. Individual differences analysis revealed that stronger prefrontal-to-visual connectivity covaried with faster inhibition times. Therefore, prefrontal-to-visual cortex connections appear to suppress the fast flow of visual input for the go task, such that the inhibition process can finish before the selection process. These results indicate response selection and inhibition within the BG to emerge through the interplay of top–down adjustments from prefrontal and bottom–up input from sensory cortex.

A functional MRI marker may predict the outcome of electroconvulsive therapy in severe and treatment-resistant depression

Electroconvulsive therapy (ECT) is effective even in treatment-resistant patients with major depression. Currently, there are no markers available that can assist in identifying those patients most likely to benefit from ECT. In the present study, we investigated whether resting-state network connectivity can predict treatment outcome for individual patients. We included forty-five patients with severe and treatment-resistant unipolar depression and collected functional magnetic resonance imaging scans before the course of ECT. We extracted resting-state networks and used multivariate pattern analysis to discover networks that predicted recovery from depression. Cross-validation revealed two resting-state networks with significant classification accuracy after correction for multiple comparisons. A network centered in the dorsomedial prefrontal cortex (including the dorsolateral prefrontal cortex, orbitofrontal cortex and posterior cingulate cortex) showed a sensitivity of 84% and specificity of 85%. Another network centered in the anterior cingulate cortex (including the dorsolateral prefrontal cortex, sensorimotor cortex, parahippocampal gyrus and midbrain) showed a sensitivity of 80% and a specificity of 75%. These preliminary results demonstrate that resting-state networks may predict treatment outcome for individual patients and suggest that resting-state networks have the potential to serve as prognostic neuroimaging biomarkers to guide personalized treatment decisions.

NMDA Receptor Antagonist Ketamine Distorts Object Recognition by Reducing Feedback to Early Visual Cortex

It is a well-established fact that top-down processes influence neural representations in lower-level visual areas. Electrophysiological recordings in monkeys as well as theoretical models suggest that these top-down processes depend on NMDA receptor functioning. However, this underlying neural mechanism has not been tested in humans. We used fMRI multivoxel pattern analysis to compare the neural representations of ambiguous Mooney images before and after they were recognized with their unambiguous grayscale version. Additionally, we administered ketamine, an NMDA receptor antagonist, to interfere with this process. Our results demonstrate that after recognition, the pattern of brain activation elicited by a Mooney image is more similar to that of its easily recognizable grayscale version than to the pattern evoked by the identical Mooney image before recognition. Moreover, recognition of Mooney images decreased mean response; however, neural representations of separate images became more dissimilar. So from the neural perspective, unrecognizable Mooney images all "look the same", whereas recognized Mooneys look different. We observed these effects in posterior fusiform part of lateral occipital cortex and in early visual cortex. Ketamine distorted these effects of recognition, but in early visual cortex only. This suggests that top-down processes from higher- to lower-level visual areas might operate via an NMDA pathway.

Visual dictionaries as intermediate features in the human brain

The human visual system is assumed to transform low level visual features to object and scene representations via features of intermediate complexity. How the brain computationally represents intermediate features is still unclear. To further elucidate this, we compared the biologically plausible HMAX model and Bag of Words (BoW) model from computer vision. Both these computational models use visual dictionaries, candidate features of intermediate complexity, to represent visual scenes, and the models have been proven effective in automatic object and scene recognition. These models however differ in the computation of visual dictionaries and pooling techniques. We investigated where in the brain and to what extent human fMRI responses to short video can be accounted for by multiple hierarchical levels of the HMAX and BoW models. Brain activity of 20 subjects obtained while viewing a short video clip was analyzed voxel-wise using a distance-based variation partitioning method. Results revealed that both HMAX and BoW explain a significant amount of brain activity in early visual regions V1, V2, and V3. However, BoW exhibits more consistency across subjects in accounting for brain activity compared to HMAX. Furthermore, visual dictionary representations by HMAX and BoW explain significantly some brain activity in higher areas which are believed to process intermediate features. Overall our results indicate that, although both HMAX and BoW account for activity in the human visual system, the BoW seems to more faithfully represent neural responses in low and intermediate level visual areas of the brain.

Oxytocin tempers calculated greed but not impulsive defense in predator-prey contests

Human cooperation and competition is modulated by oxytocin, a hypothalamic neuropeptide that functions as both hormone and neurotransmitter. Oxytocin's functions can be captured in two explanatory yet largely contradictory frameworks: the fear-dampening (FD) hypothesis that oxytocin has anxiolytic effects and reduces fear-motivated action; and the social approach/avoidance (SAA) hypothesis that oxytocin increases cooperative approach and facilitates protection against aversive stimuli and threat. We tested derivations from both frameworks in a novel predator-prey contest game. Healthy males given oxytocin or placebo invested as predator to win their prey's endowment, or as prey to protect their endowment against predation. Neural activity was registered using 3T-MRI. In prey, (fear-motivated) investments were fast and conditioned on the amygdala. Inconsistent with FD, oxytocin did not modulate neural and behavioral responding in prey. In predators, (greed-motivated) investments were slower, and conditioned on the superior frontal gyrus (SFG). Consistent with SAA, oxytocin reduced predator investment, time to decide and activation in SFG. Thus, whereas oxytocin does not incapacitate the impulsive ability to protect and defend oneself, it lowers the greedy and more calculated appetite for coming out ahead.

Latent memory of unattended stimuli reactivated by practice: an FMRI study on the role of consciousness and attention in learning

Although we can only report about what is in the focus of our attention, much more than that is actually processed. And even when attended, stimuli may not always be reportable, for instance when they are masked. A stimulus can thus be unreportable for different reasons: the absence of attention or the absence of a conscious percept. But to what extent does the brain learn from exposure to these unreportable stimuli? In this fMRI experiment subjects were exposed to textured figure-ground stimuli, of which reportability was manipulated either by masking (which only interferes with consciousness) or with an inattention paradigm (which only interferes with attention). One day later learning was assessed neurally and behaviorally. Positive neural learning effects were found for stimuli presented in the inattention paradigm; for attended yet masked stimuli negative adaptation effects were found. Interestingly, these inattentional learning effects only became apparent in a second session after a behavioral detection task had been administered during which performance feedback was provided. This suggests that the memory trace that is formed during inattention is latent until reactivated by behavioral practice. However, no behavioral learning effects were found, therefore we cannot conclude that perceptual learning has taken place for these unattended stimuli.

Opposing Dorsal/Ventral Stream Dynamics during Figure-ground Segregation

The visual system has been commonly subdivided into two segregated visual processing streams: The dorsal pathway processes mainly spatial information, and the ventral pathway specializes in object perception. Recent findings, however, indicate that different forms of interaction (cross-talk) exist between the dorsal and the ventral stream. Here, we used TMS and concurrent EEG recordings to explore these interactions between the dorsal and ventral stream during figure-ground segregation. In two separate experiments, we used repetitive TMS and single-pulse TMS to disrupt processing in the dorsal (V5/HMT+) and the ventral (lateral occipital area) stream during a motion-defined figure discrimination task. We presented stimuli that made it possible to differentiate between relatively low-level (figure boundary detection) from higher-level (surface segregation) processing steps during figure-ground segregation. Results show that disruption of V5/HMT+ impaired performance related to surface segregation; this effect was mainly found when V5/HMT+ was perturbed in an early time window (100 msec) after stimulus presentation. Surprisingly, disruption of the lateral occipital area resulted in increased performance scores and enhanced neural correlates of surface segregation. This facilitatory effect was also mainly found in an early time window (100 msec) after stimulus presentation. These results suggest a “push–pull” interaction in which dorsal and ventral extrastriate areas are being recruited or inhibited depending on stimulus category and task demands.

From image statistics to scene gist: evoked neural activity reveals transition from low-level natural image structure to scene category

The visual system processes natural scenes in a split second. Part of this process is the extraction of "gist," a global first impression. It is unclear, however, how the human visual system computes this information. Here, we show that, when human observers categorize global information in real-world scenes, the brain exhibits strong sensitivity to low-level summary statistics. Subjects rated a specific instance of a global scene property, naturalness, for a large set of natural scenes while EEG was recorded. For each individual scene, we derived two physiologically plausible summary statistics by spatially pooling local contrast filter outputs: contrast energy (CE), indexing contrast strength, and spatial coherence (SC), indexing scene fragmentation. We show that behavioral performance is directly related to these statistics, with naturalness rating being influenced in particular by SC. At the neural level, both statistics parametrically modulated single-trial event-related potential amplitudes during an early, transient window (100-150 ms), but SC continued to influence activity levels later in time (up to 250 ms). In addition, the magnitude of neural activity that discriminated between man-made versus natural ratings of individual trials was related to SC, but not CE. These results suggest that global scene information may be computed by spatial pooling of responses from early visual areas (e.g., LGN or V1). The increased sensitivity over time to SC in particular, which reflects scene fragmentation, suggests that this statistic is actively exploited to estimate scene naturalness.

NMDA receptor antagonist ketamine impairs feature integration in visual perception

Recurrent interactions between neurons in the visual cortex are crucial for the integration of image elements into coherent objects, such as in figure-ground segregation of textured images. Blocking N-methyl-D-aspartate (NMDA) receptors in monkeys can abolish neural signals related to figure-ground segregation and feature integration. However, it is unknown whether this also affects perceptual integration itself. Therefore, we tested whether ketamine, a non-competitive NMDA receptor antagonist, reduces feature integration in humans. We administered a subanesthetic dose of ketamine to healthy subjects who performed a texture discrimination task in a placebo-controlled double blind within-subject design. We found that ketamine significantly impaired performance on the texture discrimination task compared to the placebo condition, while performance on a control fixation task was much less impaired. This effect is not merely due to task difficulty or a difference in sedation levels. We are the first to show a behavioral effect on feature integration by manipulating the NMDA receptor in humans.

Spatial frequency information modulates response inhibition and decision-making processes

We interact with the world through the assessment of available, but sometimes imperfect, sensory information. However, little is known about how variance in the quality of sensory information affects the regulation of controlled actions. In a series of three experiments, comprising a total of seven behavioral studies, we examined how different types of spatial frequency information affect underlying processes of response inhibition and selection. Participants underwent a stop-signal task, a two choice speed/accuracy balance experiment, and a variant of both these tasks where prior information was given about the nature of stimuli. In all experiments, stimuli were either intact, or contained only high-, or low- spatial frequencies. Overall, drift diffusion model analysis showed a decreased rate of information processing when spatial frequencies were removed, whereas the criterion for information accumulation was lowered. When spatial frequency information was intact, the cost of response inhibition increased (longer SSRT), while a correct response was produced faster (shorter reaction times) and with more certainty (decreased errors). When we manipulated the motivation to respond with a deadline (i.e., be fast or accurate), removal of spatial frequency information slowed response times only when instructions emphasized accuracy. However, the slowing of response times did not improve error rates, when compared to fast instruction trials. These behavioral studies suggest that the removal of spatial frequency information differentially affects the speed of response initiation, inhibition, and the efficiency to balance fast or accurate responses. More generally, the present results indicate a task-independent influence of basic sensory information on strategic adjustments in action control.

The relationship between grey-matter and ASD and ADHD traits in typical adults

We tested whether in 85 healthy adults (18-29 years) there is a relationship between grey-matter (GM) volume and autism and ADHD symptom severity. The structural MRI findings and autism and ADHD self-reports revealed that autism and ADHD symptom severity was correlated with GM volume in the left inferior frontal gyrus. Autism symptom-severity was correlated with the left posterior cingulate, ADHD with the right parietal lobe, right temporal frontal cortex, bilateral thalamus, and left hippocampus/amygdala complex. Symptom severity of both disorders form a continuum extending into the general population, but it seems to be an oversimplification to typify psychiatric disorders such as autism and ADHD solely as extremes of brain structure abnormalities.

Does Perceptual Learning Require Consciousness or Attention?

It has been proposed that visual attention and consciousness are separate [Koch, C., & Tsuchiya, N. Attention and consciousness: Two distinct brain processes. Trends in Cognitive Sciences, 11, 16–22, 2007] and possibly even orthogonal processes [Lamme, V. A. F. Why visual attention and awareness are different. Trends in Cognitive Sciences, 7, 12–18, 2003]. Attention and consciousness converge when conscious visual percepts are attended and hence become available for conscious report. In such a view, a lack of reportability can have two causes: the absence of attention or the absence of a conscious percept. This raises an important question in the field of perceptual learning. It is known that learning can occur in the absence of reportability [Gutnisky, D. A., Hansen, B. J., Iliescu, B. F., & Dragoi, V. Attention alters visual plasticity during exposure-based learning. Current Biology, 19, 555–560, 2009; Seitz, A. R., Kim, D., & Watanabe, T. Rewards evoke learning of unconsciously processed visual stimuli in adult humans. Neuron, 61, 700–707, 2009; Seitz, A. R., & Watanabe, T. Is subliminal learning really passive? Nature, 422, 36, 2003; Watanabe, T., Náñez, J. E., & Sasaki, Y. Perceptual learning without perception. Nature, 413, 844–848, 2001], but it is unclear which of the two ingredients—consciousness or attention—is not necessary for learning. We presented textured figure-ground stimuli and manipulated reportability either by masking (which only interferes with consciousness) or with an inattention paradigm (which only interferes with attention). During the second session (24 hr later), learning was assessed neurally and behaviorally, via differences in figure-ground ERPs and via a detection task. Behavioral and neural learning effects were found for stimuli presented in the inattention paradigm and not for masked stimuli. Interestingly, the behavioral learning effect only became apparent when performance feedback was given on the task to measure learning, suggesting that the memory trace that is formed during inattention is latent until accessed. The results suggest that learning requires consciousness, and not attention, and further strengthen the idea that consciousness is separate from attention.

Neural basis of limb ownership in individuals with body integrity identity disorder

Our body feels like it is ours. However, individuals with body integrity identity disorder (BIID) lack this feeling of ownership for distinct limbs and desire amputation of perfectly healthy body parts. This extremely rare condition provides us with an opportunity to study the neural basis underlying the feeling of limb ownership, since these individuals have a feeling of disownership for a limb in the absence of apparent brain damage. Here we directly compared brain activation between limbs that do and do not feel as part of the body using functional MRI during separate tactile stimulation and motor execution experiments. In comparison to matched controls, individuals with BIID showed heightened responsivity of a large somatosensory network including the parietal cortex and right insula during tactile stimulation, regardless of whether the stimulated leg felt owned or alienated. Importantly, activity in the ventral premotor cortex depended on the feeling of ownership and was reduced during stimulation of the alienated compared to the owned leg. In contrast, no significant differences between groups were observed during the performance of motor actions. These results suggest that altered somatosensory processing in the premotor cortex is associated with the feeling of disownership in BIID, which may be related to altered integration of somatosensory and proprioceptive information.