The architecture of the colour centre in the human visual brain: new results and a review

Misbinding of color and motion in human visual cortex

A fundamental challenge for the visual system is to integrate visual features into a coherent scene, known as the binding problem. The neural mechanisms of feature binding are hard to identify because of difficulties in separating active feature binding from feature co-occurrence. In previous studies on feature binding, visual features were superimposed and presented simultaneously. Neurons throughout the visual cortex are known to code multiple features. Therefore, the observed binding effects could be due to the physical co-occurrence of features and the sensory representation of feature pairings. It is uncertain whether the mechanisms responsible for perceptual binding were actually recruited. To address this issue, we performed psychophysical and fMRI experiments to investigate the neural mechanisms of a steady-state misbinding of color and motion, because feature misbinding is probably the most striking evidence for the active existence of the binding mechanisms. We found that adapting to the color-motion misbinding generated the color-contingent motion aftereffect, as well as the color-contingent motion adaptation effect in visual cortex. Notably, V2 exhibited the strongest adaptation effect, which significantly correlated with the aftereffect across subjects. Furthermore, effective connectivity analysis using dynamic causal modeling showed that the misbinding was closely associated with enhanced feedback from V4 and V5 to V2. These findings provide strong evidence for active feature binding in early visual cortex and suggest a critical role of reentrant connections from specialized intermediate areas to early visual cortex in this process.

Achromatic synesthesias - a functional magnetic resonance imaging study

Grapheme-color synesthetes experience consistent, automatic and idiosyncratic colors associated with specific letters and numbers. Frequently, these specific associations exhibit achromatic synesthetic qualities (e.g. white, black or gray). In this study, we have investigated for the first time the neural basis of achromatic synesthesias, their relationship to chromatic synesthesias and the achromatic congruency effect in order to understand not only synesthetic color but also other components of the synesthetic experience. To achieve this aim, functional magnetic resonance imaging experiments were performed in a group of associator grapheme-color synesthetes and matched controls who were stimulated with real chromatic and achromatic stimuli (Mondrians), and with letters and numbers that elicited different types of grapheme-color synesthesias (i.e. chromatic and achromatic inducers which elicited chromatic but also achromatic synesthesias, as well as congruent and incongruent ones). The information derived from the analysis of Mondrians and chromatic/achromatic synesthesias suggests that real and synesthetic colors/achromaticity do not fully share neural mechanisms. The whole-brain analysis of BOLD signals in response to the complete set of synesthetic inducers revealed that the functional peculiarities of the synesthetic brain are distributed, and reflect different components of the synesthetic experience: a perceptual component, an (attentional) feature binding component, and an emotional component. Additionally, the inclusion of achromatic experiences has provided new evidence in favor of the emotional binding theory, a line of interpretation which constitutes a bridge between grapheme-color synesthesia and other developmental modalities of the phenomenon.

Human cortical areas involved in perception of surface glossiness

Glossiness is the visual appearance of an object's surface as defined by its surface reflectance properties. Despite its ecological importance, little is known about the neural substrates underlying its perception. In this study, we performed the first human neuroimaging experiments that directly investigated where the processing of glossiness resides in the visual cortex. First, we investigated the cortical regions that were more activated by observing high glossiness compared with low glossiness, where the effects of simple luminance and luminance contrast were dissociated by controlling the illumination conditions (Experiment 1). As cortical regions that may be related to the processing of glossiness, V2, V3, hV4, VO-1, VO-2, collateral sulcus (CoS), LO-1, and V3A/B were identified, which also showed significant correlation with the perceived level of glossiness. This result is consistent with the recent monkey studies that identified selective neural response to glossiness in the ventral visual pathway, except for V3A/B in the dorsal visual pathway, whose involvement in the processing of glossiness could be specific to the human visual system. Second, we investigated the cortical regions that were modulated by selective attention to glossiness (Experiment 2). The visual areas that showed higher activation to attention to glossiness than that to either form or orientation were identified as right hV4, right VO-2, and right V3A/B, which were commonly identified in Experiment 1. The results indicate that these commonly identified visual areas in the human visual cortex may play important roles in glossiness perception.

Topological organization of the "small-world" visual attention network in children with attention deficit/hyperactivity disorder (ADHD)

Background: Attention-deficit/hyperactivity disorder (ADHD) is the most commonly diagnosed childhood psychiatric disorder. Disrupted sustained attention is one of the most significant behavioral impairments in this disorder. We mapped systems-level topological properties of the neural network responsible for sustained attention during a visual sustained task, on the premise that strong associations between anomalies in network features and clinical measures of ADHD would emerge.

Methods: Graph theoretic techniques (GTT) and bivariate network-based statistics (NBS) were applied to fMRI data from 22 children with ADHD combined-type and 22 age-matched neurotypicals, to evaluate the topological and nodal-pairing features in the functional brain networks. Correlation testing for relationships between network properties and clinical measures were then performed.

Results: The visual attention network showed significantly reduced local-efficiency and nodal-efficiency in frontal and occipital regions in ADHD. Measures of degree and between-centrality pointed to hyper-functioning in anterior cingulate cortex and hypo-functioning in orbito-frontal, middle-occipital, superior-temporal, supra-central, and supra-marginal gyri in ADHD. NBS demonstrated significantly reduced pair-wise connectivity in an inner-network, encompassing right parietal and temporal lobes and left occipital lobe, in the ADHD group.

Conclusions: These data suggest that atypical topological features of the visual attention network contribute to classic ADHD symptomatology, and may underlie the inattentiveness and hyperactivity/impulsivity that are characteristics of this syndrome.

Varieties of perceptual instability and their neural correlates

We report experiments designed to learn whether different kinds of perceptually unstable visual images engage different neural mechanisms. 21 subjects viewed two types of bi-stable images while we scanned the activity in their brains with functional magnetic resonance imaging (fMRI); in one (intra-categorical type) the two percepts remained within the same category (e.g. face–face) while in the other (cross-categorical type) they crossed categorical boundaries (e.g. face–body). The results showed that cross- and intra-categorical reversals share a common reversal-related neural circuitry, which includes fronto-parietal cortex and primary visual cortex (area V1). Cross-categorical reversals alone engaged additional areas, notably anterior cingulate cortex and superior temporal gyrus, which have been posited to be involved in conflict resolution.

•

fMRI reveals brain mechanisms involved in viewing different types of unstable stimuli.

•

Fronto-parietal cortex and V1 are activated by all visually unstable stimuli.

•

Perception of different categories in unstable stimuli activates ACC and STG.

•

Studies of unstable stimuli give insights into how brain resolves sensory conflicts.

Topographic representation of an occluded object and the effects of spatiotemporal context in human early visual areas

Occlusion is a primary challenge facing the visual system in perceiving object shapes in intricate natural scenes. Although behavior, neurophysiological, and modeling studies have shown that occluded portions of objects may be completed at the early stage of visual processing, we have little knowledge on how and where in the human brain the completion is realized. Here, we provide functional magnetic resonance imaging (fMRI) evidence that the occluded portion of an object is indeed represented topographically in human V1 and V2. Specifically, we find the topographic cortical responses corresponding to the invisible object rotation in V1 and V2. Furthermore, by investigating neural responses for the occluded target rotation within precisely defined cortical subregions, we could dissociate the topographic neural representation of the occluded portion from other types of neural processing such as object edge processing. We further demonstrate that the early topographic representation in V1 can be modulated by prior knowledge of a whole appearance of an object obtained before partial occlusion. These findings suggest that primary "visual" area V1 has the ability to process not only visible or virtually (illusorily) perceived objects but also "invisible" portions of objects without concurrent visual sensation such as luminance enhancement to these portions. The results also suggest that low-level image features and higher preceding cognitive context are integrated into a unified topographic representation of occluded portion in early areas.

A conceptual lemon: theta burst stimulation to the left anterior temporal lobe untangles object representation and its canonical color

Object recognition benefits greatly from our knowledge of typical color (e.g., a lemon is usually yellow). Most research on object color knowledge focuses on whether both knowledge and perception of object color recruit the well-established neural substrates of color vision (the V4 complex). Compared with the intensive investigation of the V4 complex, we know little about where and how neural mechanisms beyond V4 contribute to color knowledge. The anterior temporal lobe (ATL) is thought to act as a "hub" that supports semantic memory by integrating different modality-specific contents into a meaningful entity at a supramodal conceptual level, making it a good candidate zone for mediating the mappings between object attributes. Here, we explore whether the ATL is critical for integrating typical color with other object attributes (object shape and name), akin to its role in combining nonperceptual semantic representations. In separate experimental sessions, we applied TMS to disrupt neural processing in the left ATL and a control site (the occipital pole). Participants performed an object naming task that probes color knowledge and elicits a reliable color congruency effect as well as a control quantity naming task that also elicits a cognitive congruency effect but involves no conceptual integration. Critically, ATL stimulation eliminated the otherwise robust color congruency effect but had no impact on the numerical congruency effect, indicating a selective disruption of object color knowledge. Neither color nor numerical congruency effects were affected by stimulation at the control occipital site, ruling out nonspecific effects of cortical stimulation. Our findings suggest that the ATL is involved in the representation of object concepts that include their canonical colors.

Categorical clustering of the neural representation of color

Cortical activity was measured with functional magnetic resonance imaging (fMRI) while human subjects viewed 12 stimulus colors and performed either a color-naming or diverted attention task. A forward model was used to extract lower dimensional neural color spaces from the high-dimensional fMRI responses. The neural color spaces in two visual areas, human ventral V4 (V4v) and VO1, exhibited clustering (greater similarity between activity patterns evoked by stimulus colors within a perceptual category, compared to between-category colors) for the color-naming task, but not for the diverted attention task. Response amplitudes and signal-to-noise ratios were higher in most visual cortical areas for color naming compared to diverted attention. But only in V4v and VO1 did the cortical representation of color change to a categorical color space. A model is presented that induces such a categorical representation by changing the response gains of subpopulations of color-selective neurons.

Parallel, multi-stage processing of colors, faces and shapes in macaque inferior temporal cortex

Visual-object processing culminates in inferior temporal cortex (IT). To assess the organization of IT, we measured functional magnetic resonance imaging responses in alert monkeys to achromatic images (faces, fruit, bodies and places) and colored gratings. IT contained multiple color-biased regions, which were typically ventral to face patches and yoked to them, spaced regularly at four locations predicted by known anatomy. Color and face selectivity increased for more anterior regions, indicative of a broad hierarchical arrangement. Responses to non-face shapes were found across IT, but were stronger outside color-biased regions and face patches, consistent with multiple parallel streams. IT also contained multiple coarse eccentricity maps: face patches overlapped central representations, color-biased regions spanned mid-peripheral representations and place-biased regions overlapped peripheral representations. These results show that IT comprises parallel, multi-stage processing networks subject to one organizing principle.

Environmental influences on neural systems of relational complexity

Constructivist learning theory contends that we construct knowledge by experience and that environmental context influences learning. To explore this principle, we examined the cognitive process relational complexity (RC), defined as the number of visual dimensions considered during problem solving on a matrix reasoning task and a well-documented measure of mature reasoning capacity. We sought to determine how the visual environment influences RC by examining the influence of color and visual contrast on RC in a neuroimaging task. To specify the contributions of sensory demand and relational integration to reasoning, our participants performed a non-verbal matrix task comprised of color, no-color line, or black-white visual contrast conditions parametrically varied by complexity (relations 0, 1, 2). The use of matrix reasoning is ecologically valid for its psychometric relevance and for its potential to link the processing of psychophysically specific visual properties with various levels of RC during reasoning. The role of these elements is important because matrix tests assess intellectual aptitude based on these seemingly context-less exercises. This experiment is a first step toward examining the psychophysical underpinnings of performance on these types of problems. The importance of this is increased in light of recent evidence that intelligence can be linked to visual discrimination. We submit three main findings. First, color and black-white visual contrast (BWVC) add demand at a basic sensory level, but contributions from color and from BWVC are dissociable in cortex such that color engages a “reasoning heuristic” and BWVC engages a “sensory heuristic.” Second, color supports contextual sense-making by boosting salience resulting in faster problem solving. Lastly, when visual complexity reaches 2-relations, color and visual contrast relinquish salience to other dimensions of problem solving.

General and specific consciousness: a first-order representationalist approach

It is widely acknowledged that a complete theory of consciousness should explain general consciousness (what makes a state conscious at all) and specific consciousness (what gives a conscious state its particular phenomenal quality). We defend first-order representationalism, which argues that consciousness consists of sensory representations directly available to the subject for action selection, belief formation, planning, etc. We provide a neuroscientific framework for this primarily philosophical theory, according to which neural correlates of general consciousness include prefrontal cortex, posterior parietal cortex, and non-specific thalamic nuclei, while neural correlates of specific consciousness include sensory cortex and specific thalamic nuclei. We suggest that recent data support first-order representationalism over biological theory, higher-order representationalism, recurrent processing theory, information integration theory, and global workspace theory.

Functional specialization and generalization for grouping of stimuli based on colour and motion

This study was undertaken to learn whether the principle of functional specialization that is evident at the level of the prestriate visual cortex extends to areas that are involved in grouping visual stimuli according to attribute, and specifically according to colour and motion. Subjects viewed, in an fMRI scanner, visual stimuli composed of moving dots, which could be either coloured or achromatic; in some stimuli the moving coloured dots were randomly distributed or moved in random directions; in others, some of the moving dots were grouped together according to colour or to direction of motion, with the number of groupings varying from 1 to 3. Increased activation was observed in area V4 in response to colour grouping and in V5 in response to motion grouping while both groupings led to activity in separate though contiguous compartments within the intraparietal cortex. The activity in all the above areas was parametrically related to the number of groupings, as was the prominent activity in Crus I of the cerebellum where the activity resulting from the two types of grouping overlapped. This suggests (a) that, the specialized visual areas of the prestriate cortex have functions beyond the processing of visual signals according to attribute, namely that of grouping signals according to colour (V4) or motion (V5); (b) that the functional separation evident in visual cortical areas devoted to motion and colour, respectively, is maintained at the level of parietal cortex, at least as far as grouping according to attribute is concerned; and (c) that, by contrast, this grouping-related functional segregation is not maintained at the level of the cerebellum.

Towards an integrative theory of consciousness: part 2 (an anthology of various other models)

The study of consciousness has today moved beyond neurobiology and cognitive models. In the past few years, there has been a surge of research into various newer areas. The present article looks at the non-neurobiological and non-cognitive theories regarding this complex phenomenon, especially ones that self-psychology, self-theory, artificial intelligence, quantum physics, visual cognitive science and philosophy have to offer. Self-psychology has proposed the need to understand the self and its development, and the ramifications of the self for morality and empathy, which will help us understand consciousness better. There have been inroads made from the fields of computer science, machine technology and artificial intelligence, including robotics, into understanding the consciousness of these machines and their implications for human consciousness. These areas are explored. Visual cortex and emotional theories along with their implications are discussed. The phylogeny and evolution of the phenomenon of consciousness is also highlighted, with theories on the emergence of consciousness in fetal and neonatal life. Quantum physics and its insights into the mind, along with the implications of consciousness and physics and their interface are debated. The role of neurophilosophy to understand human consciousness, the functions of such a concept, embodiment, the dark side of consciousness, future research needs and limitations of a scientific theory of consciousness complete the review. The importance and salient features of each theory are discussed along with certain pitfalls, if present. A need for the integration of various theories to understand consciousness from a holistic perspective is stressed.

Retinotopic and lateralized processing of spatial frequencies in human visual cortex during scene categorization

Using large natural scenes filtered in spatial frequencies, we aimed to demonstrate that spatial frequency processing could not only be retinotopically mapped but could also be lateralized in both hemispheres. For this purpose, participants performed a categorization task using large black and white photographs of natural scenes (indoors vs. outdoors, with a visual angle of 24° × 18°) filtered in low spatial frequencies (LSF), high spatial frequencies (HSF), and nonfiltered scenes, in block-designed fMRI recording sessions. At the group level, the comparison between the spatial frequency content of scenes revealed first that, compared with HSF, LSF scene categorization elicited activation in the anterior half of the calcarine fissures linked to the peripheral visual field, whereas, compared with LSF, HSF scene categorization elicited activation in the posterior part of the occipital lobes, which are linked to the fovea, according to the retinotopic property of visual areas. At the individual level, functional activations projected on retinotopic maps revealed that LSF processing was mapped in the anterior part of V1, whereas HSF processing was mapped in the posterior and ventral part of V2, V3, and V4. Moreover, at the group level, direct interhemispheric comparisons performed on the same fMRI data highlighted a right-sided occipito-temporal predominance for LSF processing and a left-sided temporal cortex predominance for HSF processing, in accordance with hemispheric specialization theories. By using suitable method of analysis on the same data, our results enabled us to demonstrate for the first time that spatial frequencies processing is mapped retinotopically and lateralized in human occipital cortex.

Functional activation of the infant cortex during object processing

A great deal is known about the functional organization of the neural structures that mediate visual object processing in the adult observer. These findings have contributed significantly to our conceptual models of object recognition and identification and provided unique insight into the nature of object representations extracted from visual input. In contrast, little is known about the neural basis of object processing in the infant. The current research used near-infrared spectroscopy (NIRS) as a neuroimaging tool to investigate functional activation of the infant cortex during an object processing task that has been used extensively with infants. The neuroimaging data revealed that the infant cortex is functionally specialized for object processing (i.e., individuation-by-feature) early in the first year but that patterns of activation also change between 3 and 12 months. These changes may reflect functional reorganization of the immature cortex or age-related differences in the cognitive processes engaged during the task.

Separating 4D multi-task fMRI data of multiple subjects by independent component analysis with projection

Independent component analysis (ICA) is a widely accepted method to extract brain networks underlying cognitive processes from functional magnetic resonance imaging (fMRI) data. However, the application of ICA to multi-task fMRI data is limited due to the potential non-independency between task-related components. The ICA with projection (ICAp) method proposed by our group (Hum Brain Mapp 2009;30:417-31) is demonstrated to be able to solve the interactions among task-related components for single subject fMRI data. However, it still must be determined if ICAp is capable of processing multi-task fMRI data over a group of subjects. Moreover, it is unclear whether ICAp can be reliably applied to event-related (ER) fMRI data. In this study, we combined the projection method with the temporal concatenation method reported by Calhoun (Hum Brain Mapp 2008;29:828-38), referred to as group ICAp, to perform the group analysis of multi-task fMRI data. Both a human fMRI rest data-based simulation and real fMRI experiments, of block design and ER design, verified the feasibility and reliability of group ICAp, as well as demonstrated that ICAp had the strength to separate 4D multi-task fMRI data into multiple brain networks engaged in each cognitive task and to adequately find the commonalities and differences among multiple tasks.

Synaesthetic perception of colour and visual space in a blind subject: an fMRI case study

In spatial sequence synaesthesia (SSS) ordinal stimuli are perceived as arranged in peripersonal space. Using fMRI, we examined the neural bases of SSS and colour synaesthesia for spoken words in a late-blind synaesthete, JF. He reported days of the week and months of the year as both coloured and spatially ordered in peripersonal space; parts of the days and festivities of the year were spatially ordered but uncoloured. Words that denote time-units and triggered no concurrents were used in a control condition. Both conditions inducing SSS activated the occipito-parietal, infero-frontal and insular cortex. The colour area hOC4v was engaged when the synaesthetic experience included colour. These results confirm the continued recruitment of visual colour cortex in this late-blind synaesthetes. Synaesthesia also involved activation in inferior frontal cortex, which may be related to spatial memory and detection, and in the insula, which might contribute to audiovisual integration related to the processing of inducers and concurrents.

Toward a unified theory of visual area V4

Visual area V4 is a midtier cortical area in the ventral visual pathway. It is crucial for visual object recognition and has been a focus of many studies on visual attention. However, there is no unifying view of V4's role in visual processing. Neither is there an understanding of how its role in feature processing interfaces with its role in visual attention. This review captures our current knowledge of V4, largely derived from electrophysiological and imaging studies in the macaque monkey. Based on recent discovery of functionally specific domains in V4, we propose that the unifying function of V4 circuitry is to enable selective extraction of specific functional domain-based networks, whether it be by bottom-up specification of object features or by top-down attentionally driven selection.

Cytoarchitectonical analysis and probabilistic mapping of two extrastriate areas of the human posterior fusiform gyrus

The human extrastriate visual cortex comprises numerous functionally defined areas, which are not identified in the widely used cytoarchitectonical map of Brodmann. The ventral part of the extrastriate cortex is particularly devoted to the identification of visual objects, faces and word forms. We analyzed the region immediately antero-lateral to hOc4v in serially sectioned (20 μm) and cell body-stained human brains using a quantitative observer-independent cytoarchitectonical approach to further identify the anatomical organization of the extrastriate cortex. Two novel cytoarchitectonical areas, FG1 and FG2, were identified on the posterior fusiform gyrus. The results of ten postmortem brains were then registered to their MRI volumes (acquired before histological processing), 3D reconstructed, and spatially normalized to the Montreal Neurological Institute reference brain. Finally, probabilistic maps were generated for each cytoarchitectonical area by superimposing the areas of the individual brains in the reference space. Comparison with recent functional imaging studies yielded that both areas are located within the object-related visual cortex. FG1 fills the gap between the retinotopically mapped area VO-1 and a posterior fusiform face patch. FG2 is probably the correlate of this face patch.

Attentional modulation of neuromagnetic evoked responses in early human visual cortex and parietal lobe following a rank-order rule

Top-down voluntary attention modulates the amplitude of magnetic evoked fields in the human visual cortex. Whether such modulation is flexible enough to adapt to the demands of complex tasks in which abstract rules must be applied to select a target in the presence of distracters remains unclear. We recorded brain neuromagnetic activity using whole-head magnetoencephalography in 14 human subjects during a rule-guided target selection task, and applied event-related Synthetic Aperture Magnetometry to image instantaneous changes in neuromagnetic source activity throughout the brain. During the task subjects selected one of two stimuli (the target) and ignored the other (the distracter) based on a color-rank rule (color 1 > color 2 > color 3). Our results revealed that in early visual color-sensitive areas and the parietal cortex visual stimuli evoke activity that scaled following the rank-order rule. This effect was stronger and occurred later in the parietal lobe (~200 ms after target/distracter onset) relative to early visual areas (~180 ms). Moreover, we found that transient changes in the target's motion direction evoked stronger responses relative to similar changes in the distracter at ~180 ms from change onset in contralateral areas hMT+/V5. These results suggest that during target selection and allocation of attention to a stimulus, top-down signals adjust their intensity following complex selection rules according to the organism's priorities, thereby differentially modulating neuromagnetic activity across visual cortical areas.

Longitudinal development of cortical and subcortical gray matter from birth to 2 years

Very little is known about cortical development in the first years of life, a time of rapid cognitive development and risk for neurodevelopmental disorders. We studied regional cortical and subcortical gray matter volume growth in a group of 72 children who underwent magnetic resonance scanning after birth and at ages 1 and 2 years using a novel longitudinal registration/parcellation approach. Overall, cortical gray matter volumes increased substantially (106%) in the first year of life and less so in the second year (18%). We found marked regional differences in developmental rates, with primary motor and sensory cortices growing slower in the first year of life with association cortices growing more rapidly. In the second year of life, primary sensory regions continued to grow more slowly, while frontal and parietal regions developed relatively more quickly. The hippocampus grew less than other subcortical structures such as the amygdala and thalamus in the first year of life. It is likely that these patterns of regional gray matter growth reflect maturation and development of underlying function, as they are consistent with cognitive and functional development in the first years of life.

The interaction between surface color and color knowledge: behavioral and electrophysiological evidence

In this study, we used event-related potentials (ERPs) to evaluate the contribution of surface color and color knowledge information in object identification. We constructed two color-object verification tasks - a surface and a knowledge verification task - using high color diagnostic objects; both typical and atypical color versions of the same object were presented. Continuous electroencephalogram was recorded from 26 subjects. A cluster randomization procedure was used to explore the differences between typical and atypical color objects in each task. In the color knowledge task, we found two significant clusters that were consistent with the N350 and late positive complex (LPC) effects. Atypical color objects elicited more negative ERPs compared to typical color objects. The color effect found in the N350 time window suggests that surface color is an important cue that facilitates the selection of a stored object representation from long-term memory. Moreover, the observed LPC effect suggests that surface color activates associated semantic knowledge about the object, including color knowledge representations. We did not find any significant differences between typical and atypical color objects in the surface color verification task, which indicates that there is little contribution of color knowledge to resolve the surface color verification. Our main results suggest that surface color is an important visual cue that triggers color knowledge, thereby facilitating object identification.

The neural correlates of coloured music: a functional MRI investigation of auditory-visual synaesthesia

In auditory-visual synaesthesia, all kinds of sound can induce additional visual experiences. To identify the brain regions mainly involved in this form of synaesthesia, functional magnetic resonance imaging (fMRI) has been used during non-linguistic sound perception (chords and pure tones) in synaesthetes and non-synaesthetes. Synaesthetes showed increased activation in the left inferior parietal cortex (IPC), an area involved in multimodal integration, feature binding and attention guidance. No significant group-differences could be detected in area V4, which is known to be related to colour vision and form processing. The results support the idea of the parietal cortex acting as sensory nexus area in auditory-visual synaesthesia, and as a common neural correlate for different types of synaesthesia.

Grapheme-color and tone-color synesthesia is associated with structural brain changes in visual regions implicated in color, form, and motion

Synesthesia is a rare condition in which stimulation in one modality leads to a secondary experience in another sensory modality. Varying accounts attribute the condition to either neuroanatomical differences between the synesthetes and non-synesthetes or functional differences in how sensory brain regions interact. This study employed voxel-based morphometry to examine whether synesthetes who experience both grapheme-color and tone-color synesthesia as their evoked sensation show neuroanatomical differences in gray matter volume compared to non-synesthetes. We observed that synesthetes showed an increase in gray matter volume in left posterior fusiform gyrus (FG), but a concomitant decrease in anterior regions of left FG and left MT/V5. These findings imply that synesthesia for color is linked to neuroanatomical changes between adjacent regions of the visual system.

Dissociable effects of natural image structure and color on LFP and spiking activity in the lateral prefrontal cortex and extrastriate visual area V4

Visual perception is mediated by unique contributions of the numerous brain regions that constitute the visual system. We performed simultaneous recordings of local field potentials (LFPs) and single unit activity (SUA) in areas V4 and lateral prefrontal cortex to characterize their contribution to visual processing. Here, we trained monkeys to identify natural images at different degradation levels in a visual recognition task. We parametrically varied color and structural information of natural images while the animals were performing the task. We show that the visual-evoked potential (VEP) of the LFP in V4 is highly sensitive to color, whereas the VEP in prefrontal cortex predominantly depends on image structure. When examining the relationship between VEP and SUA, we found that stimulus sensitivity for SUA was well predicted by the VEP in PF cortex but not in V4. Our results first reveal a functional specialization in both areas at the level of the LFP and further suggest that the degree to which mesoscopic signals, such as the VEP, are representative of the underlying SUA neural processing may be brain region specific within the context of visual recognition.

Development of a novel FMRI compatible visual perception prototype battery to test older people with and without dementia

BACKGROUND

Visuoperceptual deficits in dementia are common and can reduce quality of life. Testing of visuoperceptual function is often confounded by impairments in other cognitive domains and motor dysfunction. We aimed to develop, pilot, and test a novel visuocognitive prototype test battery which addressed these issues, suitable for both clinical and functional imaging use.

METHODS

We recruited 23 participants (14 with dementia, 6 of whom had extrapyramidal motor features, and 9 age-matched controls). The novel Newcastle visual perception prototype battery (NEVIP-B-Prototype) included angle, color, face, motion and form perception tasks, and an adapted response system. It allows for individualized task difficulties. Participants were tested outside and inside the 3T functional magnetic resonance imaging (fMRI) scanner. Functional magnetic resonance imaging data were analyzed using SPM8.

RESULTS

All participants successfully completed the task inside and outside the scanner. Functional magnetic resonance imaging analysis showed activation regions corresponding well to the regional specializations of the visual association cortex. In both groups, there was significant activity in the ventral occipital-temporal region in the face and color tasks, whereas the motion task activated the V5 region. In the control group, the angle task activated the occipitoparietal cortex. Patients and controls showed similar levels of activation, except on the angle task for which occipitoparietal activation was lower in patients than controls.

CONCLUSION

Distinct visuoperceptual functions can be tested in patients with dementia and extrapyramidal motor features when tests use individualized thresholds, adapted tasks, and specialized response systems.

Transformation from image-based to perceptual representation of materials along the human ventral visual pathway

Every object in the world has its own surface quality that is a reflection of the material from which the object is made. We can easily identify and categorize materials (wood, metal, fabric etc.) at a glance, and this ability enables us to decide how to interact appropriately with these objects. Little is known, however, about how materials are represented in the brain, or how that representation is related to material perception or the physical properties of material surface. By combining multivoxel pattern analysis of functional magnetic resonance imaging data with perceptual and image-based physical measures of material properties, we found that the way visual information about materials is coded gradually changes from an image-based representation in early visual areas to a perceptual representation in the ventral higher-order visual areas. We suggest that meaningful information about multimodal aspects of real-world materials reside in the ventral cortex around the fusiform gyrus, where it can be utilized for categorization of materials.

Imaging retinotopic maps in the human brain

A quarter-century ago visual neuroscientists had little information about the number and organization of retinotopic maps in human visual cortex. The advent of functional magnetic resonance imaging (MRI), a non-invasive, spatially-resolved technique for measuring brain activity, provided a wealth of data about human retinotopic maps. Just as there are differences amongst non-human primate maps, the human maps have their own unique properties. Many human maps can be measured reliably in individual subjects during experimental sessions lasting less than an hour. The efficiency of the measurements and the relatively large amplitude of functional MRI signals in visual cortex make it possible to develop quantitative models of functional responses within specific maps in individual subjects. During this last quarter-century, there has also been significant progress in measuring properties of the human brain at a range of length and time scales, including white matter pathways, macroscopic properties of gray and white matter, and cellular and molecular tissue properties. We hope the next 25years will see a great deal of work that aims to integrate these data by modeling the network of visual signals. We do not know what such theories will look like, but the characterization of human retinotopic maps from the last 25years is likely to be an important part of future ideas about visual computations.

Color in the cortex: single- and double-opponent cells

This is a review of the research during the past 25years on cortical processing of color signals. At the beginning of the period the modular view of cortical processing predominated. However, at present an alternative view, that color and form are linked inextricably in visual cortical processing, is more persuasive than it seemed in 1985. Also, the role of the primary visual cortex, V1, in color processing now seems much larger than it did in 1985. The re-evaluation of the important role of V1 in color vision was caused in part by investigations of human V1 responses to color, measured with functional magnetic resonance imaging, fMRI, and in part by the results of numerous studies of single-unit neurophysiology in non-human primates. The neurophysiological results have highlighted the importance of double-opponent cells in V1. Another new concept is population coding of hue, saturation, and brightness in cortical neuronal population activity.

Conceptual distinctiveness supports detailed visual long-term memory for real-world objects

Humans have a massive capacity to store detailed information in visual long-term memory. The present studies explored the fidelity of these visual long-term memory representations and examined how conceptual and perceptual features of object categories support this capacity. Observers viewed 2,800 object images with a different number of exemplars presented from each category. At test, observers indicated which of 2 exemplars they had previously studied. Memory performance was high and remained quite high (82% accuracy) with 16 exemplars from a category in memory, demonstrating a large memory capacity for object exemplars. However, memory performance decreased as more exemplars were held in memory, implying systematic categorical interference. Object categories with conceptually distinctive exemplars showed less interference in memory as the number of exemplars increased. Interference in memory was not predicted by the perceptual distinctiveness of exemplars from an object category, though these perceptual measures predicted visual search rates for an object target among exemplars. These data provide evidence that observers' capacity to remember visual information in long-term memory depends more on conceptual structure than perceptual distinctiveness.

Neural structures and mechanisms involved in scene recognition: a review and interpretation

Since the discovery in 1996 that a region within caudal parahippocampal cortex subserves learning and recall of topographical information, numerous studies aimed at elucidating the structures and pathways involved in scene recognition have been published. Neuroimaging studies, in particular, have revealed the locations and identities of some of the principal cortical structures that mediate these faculties. In the present study the detailed organization of the system is examined, based on a meta-analysis of neuroimaging studies of scene processing in human subjects, combined with reviews of the results of lesions on this type of processing, single neuron studies, and available hodological data in non-human primates. A cortical hierarchy of structures that mediate scene recognition is established based on these data, and an attempt is made to determine the function of the individual components of the system.

Cortical brain regions associated with color processing: an FMRI study

To clarify whether the neural pathways concerning color processing are the same for natural objects, for artifacts objects and for non-objects we examined brain responses measured with functional magnetic resonance imaging (FMRI) during a covert naming task including the factors color (color vs. black&white (B&W)) and stimulus type (natural vs. artifacts vs. non-objects). Our results indicate that the superior parietal lobule and precuneus (BA 7) bilaterally, the right hippocampus and the right fusifom gyrus (V4) make part of a network responsible for color processing both for natural objects and artifacts, but not for non-objects. When color objects (both natural and artifacts) were contrasted with color non-objects we observed activations in the right parahippocampal gyrus (BA 35/36), the superior parietal lobule (BA 7) bilaterally, the left inferior middle temporal region (BA 20/21) and the inferior and superior frontal regions (BA 10/11/47). These additional activations suggest that colored objects recruit brain regions that are related to visual semantic information/retrieval and brain regions related to visuo-spatial processing. Overall, the results suggest that color information is an attribute that can improve object recognition (behavioral results) and activate a specific neural network related to visual semantic information that is more extensive than for B&W objects during object recognition.

Emotional perception: meta-analyses of face and natural scene processing

Functional imaging studies of emotional processing typically contain neutral control conditions that serve to remove simple effects of visual perception, thus revealing the additional emotional process. Here we seek to identify similarities and differences across 100 studies of emotional face processing and 57 studies of emotional scene processing, using a coordinate-based meta-analysis technique. The overlay of significant meta-analyses resulted in extensive overlap in clusters, coupled with offset and unique clusters of reliable activity. The area of greatest overlap is the amygdala, followed by regions of medial prefrontal cortex, inferior frontal/orbitofrontal cortex, inferior temporal cortex, and extrastriate occipital cortex. Emotional face-specific clusters were identified in regions known to be involved in face processing, including anterior fusiform gyrus and middle temporal gyrus, and emotional scene studies were uniquely associated with lateral occipital cortex, as well as pulvinar and the medial dorsal nucleus of the thalamus. One global result of the meta-analysis reveals that a class of visual stimuli (faces vs. scenes) has a considerable impact on the resulting emotion effects, even after removing the basic visual perception effects through subtractive contrasts. Pure effects of emotion may thus be difficult to remove for the particular class of stimuli employed in an experimental paradigm. Whether a researcher chooses to tightly control the various elements of the emotional stimuli, as with posed face photographs, or allow variety and environmental realism into their evocative stimuli, as with natural scenes, will depend on the desired generalizability of their results.

Establishing the boundaries: the hippocampal contribution to imagining scenes

When we visualize scenes, either from our own past or invented, we impose a viewpoint for our "mind's eye" and we experience the resulting image as spatially coherent from that viewpoint. The hippocampus has been implicated in this process, but its precise contribution is unknown. We tested a specific hypothesis based on the spatial firing properties of neurons in the hippocampal formation of rats, that this region supports the construction of spatially coherent mental images by representing the locations of the environmental boundaries surrounding our viewpoint. Using functional magnetic resonance imaging, we show that hippocampal activation increases parametrically with the number of enclosing boundaries in the imagined scene. In contrast, hippocampal activity is not modulated by a nonspatial manipulation of scene complexity nor to increasing difficulty of imagining the scenes in general. Our findings identify a specific computational role for the hippocampus in mental imagery and episodic recollection.

Synaesthetic colour in the brain: beyond colour areas. A functional magnetic resonance imaging study of synaesthetes and matched controls

BACKGROUND

In synaesthesia, sensations in a particular modality cause additional experiences in a second, unstimulated modality (e.g., letters elicit colour). Understanding how synaesthesia is mediated in the brain can help to understand normal processes of perceptual awareness and multisensory integration. In several neuroimaging studies, enhanced brain activity for grapheme-colour synaesthesia has been found in ventral-occipital areas that are also involved in real colour processing. Our question was whether the neural correlates of synaesthetically induced colour and real colour experience are truly shared.

METHODOLOGY/PRINCIPAL FINDINGS

First, in a free viewing functional magnetic resonance imaging (fMRI) experiment, we located main effects of synaesthesia in left superior parietal lobule and in colour related areas. In the left superior parietal lobe, individual differences between synaesthetes (projector-associator distinction) also influenced brain activity, confirming the importance of the left superior parietal lobe for synaesthesia. Next, we applied a repetition suppression paradigm in fMRI, in which a decrease in the BOLD (blood-oxygenated-level-dependent) response is generally observed for repeated stimuli. We hypothesized that synaesthetically induced colours would lead to a reduction in BOLD response for subsequently presented real colours, if the neural correlates were overlapping. We did find BOLD suppression effects induced by synaesthesia, but not within the colour areas.

CONCLUSIONS/SIGNIFICANCE

Because synaesthetically induced colours were not able to suppress BOLD effects for real colour, we conclude that the neural correlates of synaesthetic colour experience and real colour experience are not fully shared. We propose that synaesthetic colour experiences are mediated by higher-order visual pathways that lie beyond the scope of classical, ventral-occipital visual areas. Feedback from these areas, in which the left parietal cortex is likely to play an important role, may induce V4 activation and the percept of synaesthetic colour.

Neural correlates of color-selective metacontrast in human early retinotopic areas

Metacontrast is a visual illusion in which the visibility of a target stimulus is virtually lost when immediately followed by a nonoverlapping mask stimulus. For a colored target, metacontrast is color-selective, with target visibility markedly reduced when the mask and target are the same color, but only slightly reduced when the colors differ. This study investigated neural correlates of color-selective metacontrast for cone-opponent red and green stimuli in the human V1, V2, and V3 using functional magnetic resonance imaging. Neural activity was suppressed when the target was rendered less visible by the same-colored mask, and the suppression was localized in the cortical region retinotopically representing the target, correlating with the perceptual topography of visibility/invisibility rather than the physical topography of the stimulus. Retinotopy-based group analysis found that activity suppression was statistically significant for V2 and V3 and that its localization to the target region was statistically significant for V2. These results suggest that retinotopic color representations in early visual areas, especially in V2, are closely linked to the visibility of color.

Emotion and the motivational brain

Psychophysiological and neuroscience studies of emotional processing undertaken by investigators at the University of Florida Laboratory of the Center for the Study of Emotion and Attention (CSEA) are reviewed, with a focus on reflex reactions, neural structures and functional circuits that mediate emotional expression. The theoretical view shared among the investigators is that expressed emotions are founded on motivational circuits in the brain that developed early in evolutionary history to ensure the survival of individuals and their progeny. These circuits react to appetitive and aversive environmental and memorial cues, mediating appetitive and defensive reflexes that tune sensory systems and mobilize the organism for action and underly negative and positive affects. The research reviewed here assesses the reflex physiology of emotion, both autonomic and somatic, studying affects evoked in picture perception, memory imagery, and in the context of tangible reward and punishment, and using the electroencephalograph (EEG) and functional magnetic resonance imaging (fMRI), explores the brain's motivational circuits that determine human emotion.

Consciousness: reading the neural signature

The brain is the seat of consciousness yet we are unaware of much of our own neural processing. What differentiates conscious and unconscious processes? A new study suggests the answer might lie in the reproducibility of patterns of neural activation.

Implications on visual apperception: energy, duration, structure and synchronization

Although primary visual cortex (V1 or striate) activity per se is not sufficient for visual apperception (normal conscious visual experiences and conscious functions such as detection, discrimination, and recognition), the same is also true for extrastriate visual areas (such as V2, V3, V4/V8/VO, V5/M5/MST, IT, and GF). In the lack of V1 area, visual signals can still reach several extrastriate parts but appear incapable of generating normal conscious visual experiences. It is scarcely emphasized in the scientific literature that conscious perceptions and representations must have also essential energetic conditions. These energetic conditions are achieved by spatiotemporal networks of dynamic mitochondrial distributions inside neurons. However, the highest density of neurons in neocortex (number of neurons per degree of visual angle) devoted to representing the visual field is found in retinotopic V1. It means that the highest mitochondrial (energetic) activity can be achieved in mitochondrial cytochrome oxidase-rich V1 areas. Thus, V1 bear the highest energy allocation for visual representation. In addition, the conscious perceptions also demand structural conditions, presence of adequate duration of information representation, and synchronized neural processes and/or 'interactive hierarchical structuralism.' For visual apperception, various visual areas are involved depending on context such as stimulus characteristics such as color, form/shape, motion, and other features. Here, we focus primarily on V1 where specific mitochondrial-rich retinotopic structures are found; we will concisely discuss V2 where smaller riches of these structures are found. We also point out that residual brain states are not fully reflected in active neural patterns after visual perception. Namely, after visual perception, subliminal residual states are not being reflected in passive neural recording techniques, but require active stimulation to be revealed.