The neuroanatomy of grapheme-color synesthesia

Categorical consistency facilitates implicit learning of color-number associations

In making sense of the environment, we implicitly learn to associate stimulus attributes that frequently occur together. Is such learning favored for categories over individual items? Here, we introduce a novel paradigm for directly comparing category- to item-level learning. In a category-level experiment, even numbers (2,4,6,8) had a high-probability of appearing in blue, and odd numbers (3,5,7,9) in yellow. Associative learning was measured by the relative performance on trials with low-probability (p = .09) to high-probability (p = .91) number colors. There was strong evidence for associative learning: low-probability performance was impaired (40ms RT increase and 8.3% accuracy decrease relative to high-probability). This was not the case in an item-level experiment with a different group of participants, in which high-probability colors were non-categorically assigned (blue: 2,3,6,7; yellow: 4,5,8,9; 9ms RT increase and 1.5% accuracy increase). The categorical advantage was upheld in an explicit color association report (83% accuracy vs. 43% at the item-level). These results support a conceptual view of perception and suggest empirical bases of categorical, not item-level, color labeling of learning materials.

The timing of cortical activation in associator grapheme-colour synaesthetes using MEG

Grapheme-colour synaesthetes experience an anomalous form of perception in which graphemes systematically induce specific colour concurrents in their mind's eye ("associator" type). Although grapheme-colour synaesthesia has been well characterised behaviourally, its neural mechanisms remain largely unresolved. There are currently several competing models, which can primarily be distinguished according to the anatomical and temporal predictions of synaesthesia-inducing neural activity. The first main model (Cross-Activation/Cascaded Cross-Tuning and its variants) posits early recruitment of occipital colour areas in the initial feed-forward sweep of brain activity. The second (Disinhibited Feedback) posits: (i) later involvement of a multisensory convergence zone (for example, in parietal cortices) after graphemes have been processed in their entirety; and (ii) subsequent feedback to early visual areas (i.e., occipital colour areas). In this study, we examine both the timing and anatomical correlates of associator grapheme-colour synaesthetes (n = 6) using MEG. Using innovative and unbiased analysis methods with little a priori assumptions, we applied Independent Component Analysis (ICA) on a single-subject level to identify the dominant patterns of activity corresponding to the induced, synaesthetic percept. We observed evoked activity that significantly dissociates between synaesthesia-inducing and non-inducing graphemes at approximately 190 ms following grapheme presentation. This effect is present in grapheme-colour synaesthetes, but not in matched controls, and exhibits an occipito-parietal topology localised consistently within individuals to extrastriate visual cortices and superior parietal lobes. Due to the observed timing of this evoked activity and its localization, our results support a model predicting relatively late synaesthesia-inducing activity, more akin to the Disinhibited Feedback model.

An evolutionary account of impairment of self in cognitive disorders

Recent research has proposed that certain aspects of psychosis, as experienced in, e.g., schizophrenia (SCZ), but also aspects of other cognitive conditions, such as autism spectrum disorders (ASD) and synesthesia, can be related to a shattered sense of the notion of self. In this paper, our goal is to show that altered processing of self can be attributed to an abnormal functioning of cortico-striatal brain networks supporting, among other, one key human distinctive cognitive ability, namely cross-modality, which plays multiple roles in human cognition and language. Specifically, our hypothesis is that this cognitive mechanism sheds light both on some basic aspects of the minimal self and on some aspects related to higher forms of self, such as the narrative self. We further link the atypical functioning in these conditions to some recent evolutionary changes in our species, specifically, an atypical presentation of human self-domestication (HSD) features. In doing so, we also lean on previous work concerning the link between cognitive disorders and language evolution under the effects of HSD. We further show that this approach can unify both linguistic and non-linguistic symptoms of these conditions through deficits in the notion of self. Our considerations provide further support for the hypothesis that SCZ and ASD are diametrically opposed cognitive conditions, as well for the hypothesis that their etiology is associated with recent human evolution, leading to a deeper understanding of the causes and symptoms of these disorders, and providing new cues, which can be used for an earlier and more accurate diagnostics.

Audiovisual Simultaneity Judgements in Synaesthesia

Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.

"Mickey Mousing" in the Brain: Motion-Sound Synesthesia and the Subcortical Substrate of Audio-Visual Integration

Motion-sound synesthesia is characterized by illusory auditory sensations linked to the pattern and rhythms of motion (dubbed "Mickey Mousing" as in cinema) of visually experienced but soundless object, like an optical flow array, a ball bouncing or a horse galloping. In an MRI study with a group of three synesthetes and a group of eighteen control participants, we found structural changes in the brains of synesthetes in the subcortical multisensory areas of the superior and inferior colliculi. In addition, functional magnetic resonance imaging data showed activity in motion-sensitive regions, as well as temporal and occipital areas, and the cerebellum. However, the synesthetes had a higher activation within the left and right cuneus, with stronger activations when viewing optical flow stimuli. There was also a general difference in connectivity of the colliculi with the above mentioned regions between the two groups. These findings implicate low-level mechanisms within the human neuroaxis as a substrate for local connectivity and cross activity between perceptual processes that are "distant" in terms of cortical topography. The present findings underline the importance of considering the role of subcortical systems and their connectivity to multimodal regions of the cortex and they strengthen a parsimonious account of synesthesia, at the least of the visual-auditory type.

Mixing up the Senses: Sensory Substitution Is Not a Form of Artificially Induced Synaesthesia

Sensory Substitution Devices (SSDs) are typically used to restore functionality of a sensory modality that has been lost, like vision for the blind, by recruiting another sensory modality such as touch or audition. Sensory substitution has given rise to many debates in psychology, neuroscience and philosophy regarding the nature of experience when using SSDs. Questions first arose as to whether the experience of sensory substitution is represented by the substituted information, the substituting information, or a multisensory combination of the two. More recently, parallels have been drawn between sensory substitution and synaesthesia, a rare condition in which individuals involuntarily experience a percept in one sensory or cognitive pathway when another one is stimulated. Here, we explore the efficacy of understanding sensory substitution as a form of 'artificial synaesthesia'. We identify several problems with previous suggestions for a link between these two phenomena. Furthermore, we find that sensory substitution does not fulfil the essential criteria that characterise synaesthesia. We conclude that sensory substitution and synaesthesia are independent of each other and thus, the 'artificial synaesthesia' view of sensory substitution should be rejected.

Reduced perceptual narrowing in synesthesia

Synesthesia is a neurologic trait in which specific inducers, such as sounds, automatically elicit additional idiosyncratic percepts, such as color (thus "colored hearing"). One explanation for this trait-and the one tested here-is that synesthesia results from unusually weak pruning of cortical synaptic hyperconnectivity during early perceptual development. We tested the prediction from this hypothesis that synesthetes would be superior at making discriminations from nonnative categories that are normally weakened by experience-dependent pruning during a critical period early in development-namely, discrimination among nonnative phonemes (Hindi retroflex /d̪a/ and dental /ɖa/), among chimpanzee faces, and among inverted human faces. Like the superiority of 6-mo-old infants over older infants, the synesthetic groups were significantly better than control groups at making all the nonnative discriminations across five samples and three testing sites. The consistent superiority of the synesthetic groups in making discriminations that are normally eliminated during infancy suggests that residual cortical connectivity in synesthesia supports changes in perception that extend beyond the specific synesthetic percepts, consistent with the incomplete pruning hypothesis.

Learning in colour: children with grapheme-colour synaesthesia show cognitive benefits in vocabulary and self-evaluated reading

Cognitive benefits associated with grapheme-colour synaesthesia in adults are well documented, but far less is known about whether such benefits might arise in synaesthetes as children. One previous study on a very small group of randomly sampled child synaesthetes found cognitive benefits in short-term memory and processing speed (the ability to quickly scan an array of images and discriminate between them), but was inconclusive for a test of receptive vocabulary. Using a stratified population sample (Growing Up in Scotland Project, Edinburgh, UK: Scottish Executive, 2007), we investigated the performance of a large cohort of child grapheme-colour synaesthetes using four literacy measures taken at age 10 years. These were three verbal comprehension measures (expressive vocabulary, receptive vocabulary and sentence comprehension) and one measure of academic self-concept in reading (plus one measure of academic self-concept in numeracy as a comparison). After controlling for demographic differences between groups, synaesthetes showed significantly enhanced performance for expressive and receptive vocabulary compared to their peers, but no benefits in sentence comprehension. Child synaesthetes also reported significantly higher academic self-concept for reading, but not for numeracy. Finally, we found that synaesthetes made significantly more progress than controls across the primary school years, although they began school with no a priori advantage. Our study provides powerful new evidence that children with grapheme-colour synaesthesia show vocabulary and literacy differences, which we contextualize within a theory of synaesthetic development. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Stochastic resonance model of synaesthesia

In synaesthesia, stimulation of one sensory modality evokes additional experiences in another modality (e.g. sounds evoking colours). Along with these cross-sensory experiences, there are several cognitive and perceptual differences between synaesthetes and non-synaesthetes. For example, synaesthetes demonstrate enhanced imagery, increased cortical excitability and greater perceptual sensitivity in the concurrent modality. Previous models suggest that synaesthesia results from increased connectivity between corresponding sensory regions or disinhibited feedback from higher cortical areas. While these models explain how one sense can evoke qualitative experiences in another, they fail to predict the broader phenotype of differences observed in synaesthetes. Here, we propose a novel model of synaesthesia based on the principles of stochastic resonance. Specifically, we hypothesize that synaesthetes have greater neural noise in sensory regions, which allows pre-existing multisensory pathways to elicit supra-threshold activation (i.e. synaesthetic experiences). The strengths of this model are (a) it predicts the broader cognitive and perceptual differences in synaesthetes, (b) it provides a unified framework linking developmental and induced synaesthesias, and (c) it explains why synaesthetic associations are inconsistent at onset but stabilize over time. We review research consistent with this model and propose future studies to test its limits. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Reduced Visual and Frontal Cortex Activation During Visual Working Memory in Grapheme-Color Synaesthetes Relative to Young and Older Adults

The sensory recruitment model envisages visual working memory (VWM) as an emergent property that is encoded and maintained in sensory (visual) regions. The model implies that enhanced sensory-perceptual functions, as in synaesthesia, entail a dedicated VWM-system, showing reduced visual cortex activity as a result of neural specificity. By contrast, sensory-perceptual decline, as in old age, is expected to show enhanced visual cortex activity as a result of neural broadening. To test this model, young grapheme-color synaesthetes, older adults and young controls engaged in a delayed pair-associative retrieval and a delayed matching-to-sample task, consisting of achromatic fractal stimuli that do not induce synaesthesia. While a previous analysis of this dataset (Pfeifer et al., 2016) has focused on cued retrieval and recognition of pair-associates (i.e., long-term memory), the current study focuses on visual working memory and considers, for the first time, the crucial delay period in which no visual stimuli are present, but working memory processes are engaged. Participants were trained to criterion and demonstrated comparable behavioral performance on VWM tasks. Whole-brain and region-of-interest-analyses revealed significantly lower activity in synaesthetes’ middle frontal gyrus and visual regions (cuneus, inferior temporal cortex), respectively, suggesting greater neural efficiency relative to young and older adults in both tasks. The results support the sensory recruitment model and can explain age and individual WM-differences based on neural specificity in visual cortex.

Assessing Lateral Interaction in the Synesthetic Visual Brain

In grapheme-color synesthesia, letters and numbers evoke abnormal colored perceptions. Although the underlying mechanisms are not known, it is largely thought that the synesthetic brain is characterized by atypical connectivity throughout various brain regions, including the visual areas. To study the putative impact of synesthesia on the visual brain, we assessed lateral interactions (i.e., local functional connectivity between neighboring neurons in the visual cortex) by recording steady-state visual evoked potentials (ssVEPs) over the occipital region in color-grapheme synesthetes (n = 6) and controls (n = 21) using the windmill/dartboard paradigm. Discrete Fourier Transform analysis was conducted to extract the fundamental frequency and the second harmonics of ssVEP responses from contrast-reversing stimuli presented at 4.27 Hz. Lateral interactions were assessed using two amplitude-based indices: Short-range and long-range lateral interactions. Results indicated that synesthetes had a statistically weaker signal coherence of the fundamental frequency component compared to the controls, but no group differences were observed on lateral interaction indices. However, a significant correlation was found between long-range lateral interactions and the type of synesthesia experience (projector versus associator). We conclude that the occipital activity related to lateral interactions in synesthetes does not substantially differ from that observed in controls. Further investigation is needed to understand the impact of synesthesia on visual processing, specifically in relation to subjective experiences of synesthete individuals.

Gray Bananas and a Red Letter A - From Synesthetic Sensation to Memory Colors

Grapheme-color synesthesia is a condition in which objectively achromatic graphemes induce concurrent color experiences. While it was long thought that the colors emerge during perception, there is growing support for the view that colors are integral to synesthetes' cognitive representations of graphemes. In this work, we review evidence for two opposing theories positing either a perceptual or cognitive origin of concurrent colors: the cross-activation theory and the conceptual-mediation model. The review covers results on inducer and concurrent color processing as well as findings concerning the brain structure and grapheme-color mappings in synesthetes and trained mappings in nonsynesthetes. The results support different aspects of both theories. Finally, we discuss how research on memory colors could provide a new perspective in the debate about the level of processing at which the synesthetic colors occur.

Magnetic resonance imaging does not reveal structural alterations in the brain of grapheme-color synesthetes

Several publications have reported structural changes in the brain of synesthetes compared to controls, either local differences or differences in connectivity. In the present study, we pursued this quest for structural brain differences that might support the subjective experience of synesthesia. In particular, for the first time in this field, we investigated brain folding in comparing 45 sulcal shapes in each hemisphere of control and grapheme-color synesthete populations. To overcome flaws relative to data interpretation based only on p-values, common in the synesthesia literature, we report confidence intervals of effect sizes. Moreover, our statistical maps are displayed without introducing the classical, but misleading, p-value level threshold. We adopt such a methodological procedure to facilitate appropriate data interpretation and promote the "New Statistics" approach. Based on structural or diffusion magnetic resonance imaging data, we did not find any strong cerebral anomaly, in sulci, tissue volume, tissue density or fiber organization that could support synesthetic color experience. Finally, by sharing our complete datasets, we strongly support the multi-center construction of a sufficient large dataset repository for detecting, if any, subtle brain differences that may help understanding how a subjective experience, such as synesthesia, is mentally constructed.

Neuroanatomical basis of number synaesthesias: A voxel-based morphometry study

In synaesthesia, a specific sensory dimension leads to an involuntary sensation in another sensory dimension not commonly associated with it; for example, synaesthetes may experience a specific colour when listening or thinking of numbers or letters. Large-scale behavioural studies provide a rich description of different synaesthesia phenotypes, and a great amount of research has been oriented to uncovering whether a single or multiple brain mechanisms underlie these various synaesthesia phenotypes. Interestingly, most of the synaesthetic inducers are conceptual stimuli such as numbers, letters, and months. However, the impact of these concepts on the synaesthetic brain remains largely unexplored. Numbers appear as the most typical inducer in two common types of synaesthesia: grapheme-colour and sequence-space. Numbers are symbols that denote quantity information and their processing recruits a specific neural network. Therefore, numbers may play an important role in the brain mechanisms underlying some types of synaesthesia. We used voxel-based morphometry (VBM) to compare grey matter (GM) volume in synaesthetes and controls. Relative to controls, synaesthetes showed increase in GM in the right amygdala and in the left cerebellum. Within the synaestheste group, comparing synaesthetes who reported numbers as the inducer with synaesthetes who reported other stimuli as the inducer revealed increase in GM in the left angular gyrus, which is associated with the verbal aspect of number processing. These results reveal neuroanatomical differences between synaesthetes and controls, and show the impact of the type of inducer in the synaesthetic brain. We discuss these findings in line with current neurobiological models of synaesthesia.

Top-down signal transmission and global hyperconnectivity in auditory-visual synesthesia: Evidence from a functional EEG resting-state study

Auditory-visual (AV) synesthesia is a rare phenomenon in which an auditory stimulus induces a "concurrent" color sensation. Current neurophysiological models of synesthesia mainly hypothesize "hyperconnected" and "hyperactivated" brains, but differ in the directionality of signal transmission. The two-stage model proposes bottom-up signal transmission from inducer- to concurrent- to higher-order brain areas, whereas the disinhibited feedback model postulates top-down signal transmission from inducer- to higher-order- to concurrent brain areas. To test the different models of synesthesia, we estimated local current density, directed and undirected connectivity patterns in the intracranial space during 2 min of resting-state (RS) EEG in 11 AV synesthetes and 11 nonsynesthetes. AV synesthetes demonstrated increased parietal theta, alpha, and lower beta current density compared to nonsynesthetes. Furthermore, AV synesthetes were characterized by increased top-down signal transmission from the superior parietal lobe to the left color processing area V4 in the upper beta frequency band. Analyses of undirected connectivity revealed a global, synesthesia-specific hyperconnectivity in the alpha frequency band. The involvement of the superior parietal lobe even during rest is a strong indicator for its key role in AV synesthesia. By demonstrating top-down signal transmission in AV synesthetes, we provide direct support for the disinhibited feedback model of synesthesia. Finally, we suggest that synesthesia is a consequence of global hyperconnectivity. Hum Brain Mapp 39:522-531, 2018. © 2017 Wiley Periodicals, Inc.

Isolating automatic photism generation from strategic photism use in grapheme-colour synaesthesia

Grapheme-colour synaesthesia is a phenomenon in which ordinary black numbers and letters (graphemes) trigger the experience of highly specific colours (photisms). The Synaesthetic Stroop task has been used to demonstrate that graphemes trigger photisms automatically. In the standard Stroop task, congruent trial probability (CTP) has been manipulated to isolate effects of automaticity from higher-order strategic effects, with larger Stroop effects at high CTP attributed to participants strategically attending to the stimulus word to facilitate responding, and smaller Stroop effects at low CTP reflecting automatic word processing. Here we apply this logic for the first time to the Synaesthetic Stroop task. At high CTP we showed larger Stroop effects due to synaesthetes using their synaesthetic colours strategically. At low CTP Stroop effects were reduced but were still significant. We directly isolate automatic processing of graphemes from strategic effects and conclusively show that, in synaesthesia, viewing black graphemes automatically triggers colour experiences.

Creating Colored Letters: Familial Markers of Grapheme–Color Synesthesia in Parietal Lobe Activation and Structure

Perception is inherently subjective, and individual differences in phenomenology are well illustrated by the phenomenon of synesthesia (highly specific, consistent, and automatic cross-modal experiences, in which the external stimulus corresponding to the additional sensation is absent). It is unknown why some people develop synesthesia and others do not. In the current study, we tested whether neural markers related to having synesthesia in the family were evident in brain function and structure. Relatives of synesthetes (who did not have any type of synesthesia themselves) and matched controls read specially prepared books with colored letters for several weeks and were scanned before and after reading using magnetic resonance imaging. Effects of acquired letter–color associations were evident in brain activation. Training-related activation (while viewing black letters) in the right angular gyrus of the parietal lobe was directly related to the strength of the learned letter–color associations (behavioral Stroop effect). Within this obtained angular gyrus ROI, the familial trait of synesthesia related to brain activation differences while participants viewed both black and colored letters. Finally, we compared brain structure using voxel-based morphometry and diffusion tensor imaging to test for group differences and training effects. One cluster in the left superior parietal lobe had significantly more coherent white matter in the relatives compared with controls. No evidence for experience-dependent plasticity was obtained. For the first time, we present evidence suggesting that the (nonsynesthete) relatives of grapheme–color synesthetes show atypical grapheme processing as well as increased brain connectivity.

Cue Integration for Continuous and Categorical Dimensions by Synesthetes

For synesthetes, sensory or cognitive stimuli induce the perception of an additional sensory or cognitive stimulus. Grapheme-color synesthetes, for instance, consciously and consistently experience particular colors (e.g., fluorescent pink) when perceiving letters (e.g., u). As a phenomenon involving multiple stimuli within or across modalities, researchers have posited that synesthetes may integrate sensory cues differently than non-synesthetes. However, findings to date present mixed results concerning this hypothesis, with researchers reporting enhanced, depressed, or normal sensory integration for synesthetes. In this study we quantitatively evaluated the multisensory integration process of synesthetes and non-synesthetes using Bayesian principles, rather than employing multisensory illusions, to make inferences about the sensory integration process. In two studies we investigated synesthetes' sensory integration by comparing human behavior to that of an ideal observer. We found that synesthetes integrated cues for both continuous and categorical dimensions in a statistically optimal manner, matching the sensory integration behavior of controls. These findings suggest that synesthetes and controls utilize similar cue integration mechanisms, despite differences in how they perceive unimodal stimuli.

Color Processing in Synesthesia: What Synesthesia Can and Cannot Tell Us About Mechanisms of Color Processing

Synesthetic experiences of color have been traditionally conceptualized as a perceptual phenomenon. However, recent evidence suggests a role of higher order cognition in the formation of synesthetic experiences. Here, we discuss how synesthetic experiences of color differ from and influence veridical color processing, and how non-perceptual processes such as imagery and color memory might play a role in eliciting synesthetic color experience.

Why Saturday could be both green and red in synesthesia

It has long been observed that certain words induce multiple synesthetic colors, a phenomenon that has remained largely unexplored. We report here on the distinct synesthetic colors two synesthetes experienced with closed sets of concepts (digits, weekdays, months). For example, Saturday was associated with green, like other word starting with s; however, Saturday also had its specific color (red). Auditory priming and Visual Color Stroop tasks were used to understand the cognitive mechanisms supporting the distinct synesthetic colors. Results revealed that processing of word segments and whole words was specifically involved in each type of synesthetic colors. However, these mechanisms differed between participants, as they could relate either to orthography (and written words) or phonology (and spoken words). Further differences concerned the word representations, which varied as to whether or not they encoded serial positions. In addition to clarifying the cognitive mechanisms underlying the distinct synesthetic colors, our results offer some clues for understanding the neurocognitive underpinnings of a rather common form of synesthesia.

The Merit of Synesthesia for Consciousness Research

Synesthesia is a phenomenon in which additional perceptual experiences are elicited by sensory stimuli or cognitive concepts. Synesthetes possess a unique type of phenomenal experiences not directly triggered by sensory stimulation. Therefore, for better understanding of consciousness it is relevant to identify the mental and physiological processes that subserve synesthetic experience. In the present work we suggest several reasons why synesthesia has merit for research on consciousness. We first review the research on the dynamic and rapidly growing field of the studies of synesthesia. We particularly draw attention to the role of semantics in synesthesia, which is important for establishing synesthetic associations in the brain. We then propose that the interplay between semantics and sensory input in synesthesia can be helpful for the study of the neural correlates of consciousness, especially when making use of ambiguous stimuli for inducing synesthesia. Finally, synesthesia-related alterations of brain networks and functional connectivity can be of merit for the study of consciousness.

Migraine in Synesthetes and Nonsynesthetes: A Prevalence Study

Synesthesia is a neurological condition in which an inducer stimulus in one sense leads to a concurrent percept in a second sense. The immune hypothesis of synesthesia links synesthesia to immune-related conditions such as migraine. More specifically, migraine with aura may be linked to grapheme-color synesthesia as both involve cortical hyperexcitability. In this study, 161 female synesthetes, and 92 female nonsynesthetes, completed an online questionnaire about synesthesia and migraine. We found no general link between migraine and synesthesia nor between migraine with aura and grapheme-color synesthesia. Exploratory analyses, however, showed that certain types of synesthetic inducer (non-linguistic visual experiences, scent, taste, emotion and personality) were associated with visual disturbances in headache among female participants, and touch as a concurrent was associated with migraine with aura. On the basis of our exploratory analyses, we hypothesize that specific subtypes of synesthesia are related to migraine. The relationship between these two conditions is likely to become clearer as research on the underlying causes of synesthesia and migraine progresses.

Multisensory integration and cross-modal learning in synaesthesia: A unifying model

Recent research into synaesthesia has highlighted the role of learning, yet synaesthesia is clearly a genetic condition. Here we ask how can the idea that synaesthesia reflects innate, genetic differences be reconciled with models that suggest it is driven by learning. A number of lines of evidence suggest that synaesthesia relies on, or at least interacts with, processes of multisensory integration that are common across all people. These include multisensory activations that arise in early regions of the brain as well as feedback from longer-term cross-modal associations generated in memory. These cognitive processes may interact independently to influence the phenomenology of the synaesthetic experience, as well as the individual differences within particular types of synaesthesia. The theoretical framework presented here is consistent with both an innate difference as the fundamental driver of the condition of synaesthesia, and with experiential and semantic influences on the eventual phenotype that emerges. In particular, it proposes that the internally generated synaesthetic percepts are treated similarly to other sensory information as the brain is learning the multisensory attributes of objects and developing cross-modal associations that merge in the concept of the object.

A critical review of the neuroimaging literature on synesthesia

Synesthesia refers to additional sensations experienced by some people for specific stimulations, such as the systematic arbitrary association of colors to letters for the most studied type. Here, we review all the studies (based mostly on functional and structural magnetic resonance imaging) that have searched for the neural correlates of this subjective experience, as well as structural differences related to synesthesia. Most differences claimed for synesthetes are unsupported, due mainly to low statistical power, statistical errors, and methodological limitations. Our critical review therefore casts some doubts on whether any neural correlate of the synesthetic experience has been established yet. Rather than being a neurological condition (i.e., a structural or functional brain anomaly), synesthesia could be reconsidered as a special kind of childhood memory, whose signature in the brain may be out of reach with present brain imaging techniques.

Rates of white matter hyperintensities compatible with the radiological profile of multiple sclerosis within self-referred synesthete populations

Synesthesia is an inherited condition causing unusual secondary sensations (e.g, sounds might be experienced as both auditory and visual percepts). The condition has been linked with cognitive and perceptual benefits and is considered a benign alternative form of perception. Here, we investigate self-referred synesthete populations and their rates of radiologically determined white matter hyperintensities (WMH) of a type compatible with the McDonald imaging criteria for the diagnosis of multiple sclerosis (MS). MS is a chronic condition resulting in damage to myelination surrounding nerve fibers of the central nervous system (CNS). Magnetic resonance imaging (MRI) features highly suggestive of MS without overt clinical symptoms are termed radiologically isolated syndrome (RIS). We present data showing that the shared MRI profile of MS and RIS has been significantly overrepresented in synesthetes who have participated in neuroimaging research. We present validation of the clinical and MRI status of these synesthetes and an analysis showing the significant probability their unusual numbers may not have arisen by chance. We discuss how to interpret significant data based on small case numbers and consider the implications of our findings for synesthesia's clinical status.

Implicit interactions between number and space in digit-color synesthesia

In digit-color synesthesia, a variant of grapheme-color synesthesia, digits trigger an additional color percept. Recent work on number processing in synesthesia suggests that colors can implicitly elicit numerical representations in digit-color synesthetes implying that synesthesia is bidirectional. Furthermore, morphometric investigations revealed structural differences in the parietal cortex of grapheme-color synesthetes, i.e., in the brain region where interactions between number and space occur in non-synesthetic subjects. Based upon these previous findings, we here examined whether implicitly evoked numerical representations interact with spatial representations in synesthesia in such a way that even a non-numerical, visuo-spatial task (here: line bisection) is modulated, i.e., whether synesthetes exhibit a systematic bisection bias for colored lines. Thirteen digit-color synesthetes were asked to bisect two sets of lines which were colored in their individual synesthetic colors associated with a small or a large digit, respectively. For all colored line stimuli combined, digit-color synesthetes showed--like control subjects (n = 13, matched for age, gender, IQ and handedness)--a pseudo-neglect when bisecting colored lines. Measuring the color-induced change of the bisection bias (i.e., comparing the biases when bisecting lines colored according to a small number vs those lines corresponding to a large number) revealed that only digit-color synesthetes were significantly influenced by line color. The results provide further evidence for the bidirectional nature of synesthesia and support the concept of a mental number line. In addition, they extend previous reports on bidirectionality in synesthesia by showing that even non-numerical, visuo-spatial performance can be modulated by implicit bidirectional processes.

Beyond visual imagery: how modality-specific is enhanced mental imagery in synesthesia?

Synesthesia based in visual modalities has been associated with reports of vivid visual imagery. We extend this finding to consider whether other forms of synesthesia are also associated with enhanced imagery, and whether this enhancement reflects the modality of synesthesia. We used self-report imagery measures across multiple sensory modalities, comparing synesthetes' responses (with a variety of forms of synesthesia) to those of non-synesthete matched controls. Synesthetes reported higher levels of visual, auditory, gustatory, olfactory and tactile imagery and a greater level of imagery use. Furthermore, their reported enhanced imagery is restricted to the modalities involved in the individual's synesthesia. There was also a relationship between the number of forms of synesthesia an individual has, and the reported vividness of their imagery, highlighting the need for future research to consider the impact of multiple forms of synesthesia. We also recommend the use of behavioral measures to validate these self-report findings.

Brain size, sex, and the aging brain

This study was conducted to examine the statistical influence of brain size on cortical, subcortical, and cerebellar compartmental volumes. This brain size influence was especially studied to delineate interactions with Sex and Age. Here, we studied 856 healthy subjects of which 533 are classified as young and 323 as old. Using an automated segmentation procedure cortical (gray and white matter [GM and WM] including the corpus callosum), cerebellar (GM and WM), and subcortical (thalamus, putamen, pallidum, caudatus, hippocampus, amygdala, and accumbens) volumes were measured and subjected to statistical analyses. These analyses revealed that brain size and age exert substantial statistical influences on nearly all compartmental volumes. Analyzing the raw compartmental volumes replicated the frequently reported Sex differences in compartmental volumes with men showing larger volumes. However, when statistically controlling for brain size Sex differences and Sex × Age interactions practically disappear. Thus, brain size is more important than Sex in explaining interindividual differences in compartmental volumes. The influence of brain size is discussed in the context of an allometric scaling of the compartmental volumes.

Achromatic synesthesias - a functional magnetic resonance imaging study

Grapheme-color synesthetes experience consistent, automatic and idiosyncratic colors associated with specific letters and numbers. Frequently, these specific associations exhibit achromatic synesthetic qualities (e.g. white, black or gray). In this study, we have investigated for the first time the neural basis of achromatic synesthesias, their relationship to chromatic synesthesias and the achromatic congruency effect in order to understand not only synesthetic color but also other components of the synesthetic experience. To achieve this aim, functional magnetic resonance imaging experiments were performed in a group of associator grapheme-color synesthetes and matched controls who were stimulated with real chromatic and achromatic stimuli (Mondrians), and with letters and numbers that elicited different types of grapheme-color synesthesias (i.e. chromatic and achromatic inducers which elicited chromatic but also achromatic synesthesias, as well as congruent and incongruent ones). The information derived from the analysis of Mondrians and chromatic/achromatic synesthesias suggests that real and synesthetic colors/achromaticity do not fully share neural mechanisms. The whole-brain analysis of BOLD signals in response to the complete set of synesthetic inducers revealed that the functional peculiarities of the synesthetic brain are distributed, and reflect different components of the synesthetic experience: a perceptual component, an (attentional) feature binding component, and an emotional component. Additionally, the inclusion of achromatic experiences has provided new evidence in favor of the emotional binding theory, a line of interpretation which constitutes a bridge between grapheme-color synesthesia and other developmental modalities of the phenomenon.

Why we are not all synesthetes (not even weakly so)

A little over a decade ago, Martino and Marks (Current Directions in Psychological Science 10:61-65, 2001) put forward the influential claim that cases of intuitive matchings between stimuli in different sensory modalities should be considered as a weak form of synesthesia. Over the intervening years, many other researchers have agreed-at the very least, implicitly-with this position (e.g., Bien, ten Oever, Goebel, & Sack NeuroImage 59:663-672, 2012; Eagleman Cortex 45:1266-1277, 2009; Esterman, Verstynen, Ivry, & Robertson Journal of Cognitive Neuroscience 18:1570-1576, 2006; Ludwig, Adachi, & Matzuzawa Proceedings of the National Academy of Sciences of the United States of America 108:20661-20665, 2011; Mulvenna & Walsh Trends in Cognitive Sciences 10:350-352, 2006; Sagiv & Ward 2006; Zellner, McGarry, Mattern-McClory, & Abreu Chemical Senses 33:211-222:2008). Here, though, we defend the separatist view, arguing that these cases are likely to form distinct kinds of phenomena despite their superficial similarities. We believe that crossmodal correspondences should be studied in their own right and not assimilated, either in terms of the name used or in terms of the explanation given, to synesthesia. To conflate these two phenomena is both inappropriate and potentially misleading. Below, we critically evaluate the evidence concerning the descriptive and constitutive features of crossmodal correspondences and synesthesia and highlight how they differ. Ultimately, we wish to provide a general definition of crossmodal correspondences as acquired, malleable, relative, and transitive pairings between sensory dimensions and to provide a framework in which to integrate the nonsystematic cataloguing of new cases of crossmodal correspondences, a tendency that has increased in recent years.

Is synesthesia more common in patients with Asperger syndrome?

There is increasing evidence from case reports that synesthesia is more common in individuals with autism spectrum conditions (ASC). Further, genes related to synesthesia have also been found to be linked to ASC and, similar to synaesthetes, individuals with ASC show altered brain connectivity and unusual brain activation during sensory processing. However, up to now a systematic investigation of whether synesthesia is more common in ASC patients is missing. The aim of the current pilot study was to test this hypothesis by investigating a group of patients diagnosed with Asperger Syndrome (AS) using questionnaires and standard consistency tests in order to classify them as grapheme-color synaesthetes. The results indicate that there are indeed many more grapheme-color synaesthetes among AS patients. This finding is discussed in relation to different theories regarding the development of synesthesia as well as altered sensory processing in autism.

Combined structural and functional imaging reveals cortical deactivations in grapheme-color synaesthesia

Synaesthesia is a heritable condition in which particular stimuli generate specific and consistent sensory percepts or associations in another modality or processing stream. Functional neuroimaging studies have identified potential correlates of these experiences, including, in some but not all cases, the hyperactivation of visuotemporal areas and of parietal areas thought to be involved in perceptual binding. Structural studies have identified a similarly variable spectrum of differences between synaesthetes and controls. However, it remains unclear the extent to which these neural correlates reflect the synaesthetic experience itself or additional phenotypes associated with the condition. Here, we acquired both structural and functional neuroimaging data comparing thirteen grapheme-color synaesthetes with eleven non-synaesthetes. Using voxel-based morphometry and diffusion tensor imaging, we identify a number of clusters of increased volume of gray matter, of white matter or of increased fractional anisotropy in synaesthetes vs. controls. To assess the possible involvement of these areas in the synaesthetic experience, we used nine areas of increased gray matter volume as regions of interest in an fMRI experiment that characterized the contrast in response to stimuli which induced synaesthesia (i.e., letters) vs. those which did not (non-meaningful symbols). Four of these areas showed sensitivity to this contrast in synaesthetes but not controls. Unexpectedly, in two of them, in left lateral occipital cortex and in postcentral gyrus, the letter stimuli produced a strong negative BOLD signal in synaesthetes. An additional whole-brain fMRI analysis identified 14 areas, three of which were driven mainly by a negative BOLD response to letters in synaesthetes. Our findings suggest that cortical deactivations may be involved in the conscious experience of internally generated synaesthetic percepts.

Impaired acquisition of novel grapheme-color correspondences in synesthesia

Grapheme-color synesthesia is a neurological phenomenon in which letters and numbers (graphemes) consistently evoke particular colors (e.g., A may be experienced as red). These sensations are thought to arise through the cross-activation of grapheme processing regions in the fusiform gyrus and color area V4, supported by anatomical and functional imaging. However, the developmental onset of grapheme-color synesthesia remains elusive as research in this area has largely relied on self-report of these experiences in children. One possible account suggests that synesthesia is present at or near birth and initially binds basic shapes and forms to colors, which are later refined to grapheme-color associations through experience. Consistent with this view, studies show that similarly shaped letters and numbers tend to elicit similar colors in synesthesia and that some synesthetes consciously associate basic shapes with colors; research additionally suggests that synesthetic colors can emerge for newly learned characters with repeated presentation. This model further predicts that the initial shape-color correspondences in synesthesia may persist as implicit associations, driving the acquisition of colors for novel characters. To examine the presence of latent color associations for novel characters, synesthetes and controls were trained on pre-defined associations between colors and complex shapes, on the assumption that the prescribed shape-color correspondences would on average differ from implicit synesthetic associations. Results revealed synesthetes were less accurate than controls to learn novel shape-color associations, consistent with our suggestion that implicit form-color associations conflicted with the learned pairings.

Serotonergic hyperactivity as a potential factor in developmental, acquired and drug-induced synesthesia

Though synesthesia research has seen a huge growth in recent decades, and tremendous progress has been made in terms of understanding the mechanism and cause of synesthesia, we are still left mostly in the dark when it comes to the mechanistic commonalities (if any) among developmental, acquired and drug-induced synesthesia. We know that many forms of synesthesia involve aberrant structural or functional brain connectivity. Proposed mechanisms include direct projection and disinhibited feedback mechanisms, in which information from two otherwise structurally or functionally separate brain regions mix. We also know that synesthesia sometimes runs in families. However, it is unclear what causes its onset. Studies of psychedelic drugs, such as psilocybin, LSD and mescaline, reveal that exposure to these drugs can induce synesthesia. One neurotransmitter suspected to be central to the perceptual changes is serotonin. Excessive serotonin in the brain may cause many of the characteristics of psychedelic intoxication. Excessive serotonin levels may also play a role in synesthesia acquired after brain injury. In brain injury sudden cell death floods local brain regions with serotonin and glutamate. This neurotransmitter flooding could perhaps result in unusual feature binding. Finally, developmental synesthesia that occurs in individuals with autism may be a result of alterations in the serotonergic system, leading to a blockage of regular gating mechanisms. I conclude on these grounds that one commonality among at least some cases of acquired, developmental and drug-induced synesthesia may be the presence of excessive levels of serotonin, which increases the excitability and connectedness of sensory brain regions.

Neural networks of colored sequence synesthesia

Synesthesia is a condition in which normal stimuli can trigger anomalous associations. In this study, we exploit synesthesia to understand how the synesthetic experience can be explained by subtle changes in network properties. Of the many forms of synesthesia, we focus on colored sequence synesthesia, a form in which colors are associated with overlearned sequences, such as numbers and letters (graphemes). Previous studies have characterized synesthesia using resting-state connectivity or stimulus-driven analyses, but it remains unclear how network properties change as synesthetes move from one condition to another. To address this gap, we used functional MRI in humans to identify grapheme-specific brain regions, thereby constructing a functional "synesthetic" network. We then explored functional connectivity of color and grapheme regions during a synesthesia-inducing fMRI paradigm involving rest, auditory grapheme stimulation, and audiovisual grapheme stimulation. Using Markov networks to represent direct relationships between regions, we found that synesthetes had more connections during rest and auditory conditions. We then expanded the network space to include 90 anatomical regions, revealing that synesthetes tightly cluster in visual regions, whereas controls cluster in parietal and frontal regions. Together, these results suggest that synesthetes have increased connectivity between grapheme and color regions, and that synesthetes use visual regions to a greater extent than controls when presented with dynamic grapheme stimulation. These data suggest that synesthesia is better characterized by studying global network dynamics than by individual properties of a single brain region.

Real color captures attention and overrides spatial cues in grapheme-color synesthetes but not in controls

Grapheme-color synesthetes perceive color when reading letters or digits. We investigated oscillatory brain signals of synesthetes vs. controls using magnetoencephalography. Brain oscillations specifically in the alpha band (∼10Hz) have two interesting features: alpha has been linked to inhibitory processes and can act as a marker for attention. The possible role of reduced inhibition as an underlying cause of synesthesia, as well as the precise role of attention in synesthesia is widely discussed. To assess alpha power effects due to synesthesia, synesthetes as well as matched controls viewed synesthesia-inducing graphemes, colored control graphemes, and non-colored control graphemes while brain activity was recorded. Subjects had to report a color change at the end of each trial which allowed us to assess the strength of synesthesia in each synesthete. Since color (synesthetic or real) might allocate attention we also included an attentional cue in our paradigm which could direct covert attention. In controls the attentional cue always caused a lateralization of alpha power with a contralateral decrease and ipsilateral alpha increase over occipital sensors. In synesthetes, however, the influence of the cue was overruled by color: independent of the attentional cue, alpha power decreased contralateral to the color (synesthetic or real). This indicates that in synesthetes color guides attention. This was confirmed by reaction time effects due to color, i.e. faster RTs for the color side independent of the cue. Finally, the stronger the observed color dependent alpha lateralization, the stronger was the manifestation of synesthesia as measured by congruency effects of synesthetic colors on RTs. Behavioral and imaging results indicate that color induces a location-specific, automatic shift of attention towards color in synesthetes but not in controls. We hypothesize that this mechanism can facilitate coupling of grapheme and color during the development of synesthesia.

Pathways to seeing music: enhanced structural connectivity in colored-music synesthesia

Synesthesia, a condition in which a stimulus in one sensory modality consistently and automatically triggers concurrent percepts in another modality, provides a window into the neural correlates of cross-modal associations. While research on grapheme-color synesthesia has provided evidence for both hyperconnectivity-hyperbinding and disinhibited feedback as potential underlying mechanisms, less research has explored the neuroanatomical basis of other forms of synesthesia. In the current study we investigated the white matter correlates of colored-music synesthesia. As these synesthetes report seeing colors upon hearing musical sounds, we hypothesized that they might show unique patterns of connectivity between visual and auditory association areas. We used diffusion tensor imaging to trace the white matter tracts in temporal and occipital lobe regions in 10 synesthetes and 10 matched non-synesthete controls. Results showed that synesthetes possessed hemispheric patterns of fractional anisotropy, an index of white matter integrity, in the inferior fronto-occipital fasciculus (IFOF), a major white matter pathway that connects visual and auditory association areas to frontal regions. Specifically, white matter integrity within the right IFOF was significantly greater in synesthetes than controls. Furthermore, white matter integrity in synesthetes was correlated with scores on audiovisual tests of the Synesthesia Battery, especially in white matter underlying the right fusiform gyrus. Our findings provide the first evidence of a white matter substrate of colored-music synesthesia, and suggest that enhanced white matter connectivity is involved in enhanced cross-modal associations.

Impartiality in humans is predicted by brain structure of dorsomedial prefrontal cortex

The moral force of impartiality (i.e. the equal treatment of all human beings) is imperative for providing justice and fairness. Yet, in reality many people become partial during intergroup interactions; they demonstrate a preferential treatment of ingroup members and a discriminatory treatment of outgroup members. Some people, however, do not show this intergroup bias. The underlying sources of these inter-individual differences are poorly understood. Here we demonstrate that the larger the gray matter volume and thickness of the dorsomedial prefrontal cortex (DMPFC), the more individuals in the role of an uninvolved third-party impartially punish outgroup and ingroup perpetrators. Moreover, we show evidence for a possible mechanism that explains the impact of DMPFC's gray matter volume on impartiality, namely perspective-taking. Large gray matter volume of DMPFC seems to facilitate equal perspective-taking of all sides, which in turn leads to impartial behavior. This is the first evidence demonstrating that brain structure of the DMPFC constitutes an important source underlying an individual's propensity for impartiality.

Cortical mapping by magnetic resonance imaging (MRI) and quantitative cytological analysis in the human brain: a feasibility study in the fusiform gyrus

The cerebral cortex is a layered cellular structure that is tangentially organized into a mosaic of anatomically and functionally distinct fields. In spite of centuries of investigation, the precise localization and classification of many areas in the cerebral cortex remain problematic because the relationship between functional specificity and intra-cortical structure has not been firmly established. Furthermore, it is not yet clear how surface landmarks, visible through gross examination and, more recently, using non-invasive magnetic resonance imaging (MRI), relate to underlying microstructural borders and to the topography of functional activation. We have designed a multi-modal neuroimaging protocol that combines MRI and quantitative microscopic analysis in the same individual to clarify the topography of cytoarchitecture underlying gross anatomical landmarks in the cerebral cortex. We tested our approach in the region of the fusiform gyrus (FG) because, in spite of its seemingly smooth appearance on the ventral aspect of both hemispheres, this structure houses many functionally defined areas whose histological borders remain unclear. In practice, we used MRI-based automated segmentation to define the region of interest from which we could then collect quantitative histological data (specifically, neuronal size and density). A modified stereological approach was used to sample the cortex within the FG without a priori assumptions on the location of architectonic boundaries. The results of these analyses illustrate architectonic variations along the FG and demonstrate that it is possible to correlate quantitative histological data to measures that are obtained in the context of large-scale, non-invasive MRI-based population studies.

Short- and long-range neural synchrony in grapheme-color synesthesia

Grapheme-color synesthesia is a perceptual phenomenon where single graphemes (e.g., the letter "E") induce simultaneous sensations of colors (e.g., the color green) that were not objectively shown. Current models disagree as to whether the color sensations arise from increased short-range connectivity between anatomically adjacent grapheme- and color-processing brain structures or from decreased effectiveness of inhibitory long-range connections feeding back into visual cortex. We addressed this issue by examining neural synchrony obtained from EEG activity, in a sample of grapheme-color synesthetes that were presented with color-inducing versus non-color-inducing graphemes. For color-inducing graphemes, the results showed a decrease in the number of long-range couplings in the theta frequency band (4-7 Hz, 280-540 msec) and a concurrent increase of short-range phase-locking within lower beta band (13-20 Hz, 380-420 msec at occipital electrodes). Because the effects were both found in long-range synchrony and later within the visual processing stream, the results support the idea that reduced inhibition is an important factor for the emergence of synesthetic colors.