Beyond visual imagery: how modality-specific is enhanced mental imagery in synesthesia?

Differences in ongoing thought between autistic and non-autistic adults

Autistic people may be distinguishable from non-autistic individuals in the content and modality of their thoughts. Such differences potentially underlie both psychological vulnerability and strengths, motivating the need to better understand autistic thought patterns. In non-clinical undergraduates, a recent study found that autistic traits were associated with thinking more in words than images. However, it is unclear whether such differences in thought are present in clinically diagnosed autistic individuals. The current study applied the same methods (multidimensional experience sampling during an N-back task) to examine ongoing thought in autistic and non-autistic adults. We found that autistic individuals showed less variability in the modality of their thoughts between easy and difficult task contexts. While both non-autistic and autistic participants tended to report thinking more in words during the difficult task context, the difference between conditions was significantly smaller for the autistic group. In addition, autistic individuals showed a weaker coupling between task performance and off-task social thinking, a finding that may be related to differences in social processing during the off-task state. Overall, our results provide a clinical replication and extension of previous work, highlighting the differential effects of changing external context on internal mental states in autism.

Visual perspective and body ownership modulate vicarious pain and touch: A systematic review

We conducted a systematic review investigating the influence of visual perspective and body ownership (BO) on vicarious brain resonance and vicarious sensations during the observation of pain and touch. Indeed, the way in which brain reactivity and the phenomenological experience can be modulated by blurring the bodily boundaries of self-other distinction is still unclear. We screened Scopus and WebOfScience, and identified 31 articles, published from 2000 to 2022. Results show that assuming an egocentric perspective enhances vicarious resonance and vicarious sensations. Studies on synaesthetes suggest that vicarious conscious experiences are associated with an increased tendency to embody fake body parts, even in the absence of congruent multisensory stimulation. Moreover, immersive virtual reality studies show that the type of embodied virtual body can affect high-order sensations such as appropriateness, unpleasantness, and erogeneity, associated with the touched body part and the toucher's social identity. We conclude that perspective plays a key role in the resonance with others' pain and touch, and full-BO over virtual avatars allows investigation of complex aspects of pain and touch perception which would not be possible in reality.

Investigation of the relationship between neuroplasticity and grapheme-color synesthesia

Grapheme-color synesthesia is a normal and healthy variation of human perception. It is characterized by the association of letters or numbers with color perceptions. The etiology of synesthesia is not yet fully understood. Theories include hyperconnectivity in the brain, cross-activation of adjacent or functionally proximate sensory areas of the brain, or various models of lack of inhibitory function in the brain. The growth factor brain-derived neurotrophic (BDNF) plays an important role in the development of neurons, neuronal pathways, and synapses, as well as in the protection of existing neurons in both the central and peripheral nervous systems. ELISA methods were used to compare BDNF serum concentrations between healthy test subjects with and without grapheme-color synesthesia to establish a connection between concentration and the occurrence of synesthesia. The results showed that grapheme-color synesthetes had an increased BDNF serum level compared to the matched control group. Increased levels of BDNF can enhance the brain's ability to adapt to changing environmental conditions, injuries, or experiences, resulting in positive effects. It is discussed whether the integration of sensory information is associated with or results from increased neuroplasticity. The parallels between neurodegeneration and brain regeneration lead to the conclusion that synesthesia, in the sense of an advanced state of consciousness, is in some cases a more differentiated development of the brain rather than a relic of early childhood.

Subtitled speech: the neural mechanisms of ticker-tape synaesthesia

The acquisition of reading modifies areas of the brain associated with vision and with language, in addition to their connections. These changes enable reciprocal translation between orthography and the sounds and meaning of words. Individual variability in the pre-existing cerebral substrate contributes to the range of eventual reading abilities, extending to atypical developmental patterns, including dyslexia and reading-related synaesthesias. The present study is devoted to the little-studied but highly informative ticker-tape synaesthesia, in which speech perception triggers the vivid and irrepressible perception of words in their written form in the mind's eye. We scanned a group of 17 synaesthetes and 17 matched controls with functional MRI, while they listened to spoken sentences, words, numbers or pseudowords (Experiment 1), viewed images and written words (Experiment 2) or were at rest (Experiment 3). First, we found direct correlates of the ticker-tape synaesthesia phenomenon: during speech perception, as ticker-tape synaesthesia was active, synaesthetes showed over-activation of left perisylvian regions supporting phonology and of the occipitotemporal visual word form area, where orthography is represented. Second, we provided support to the hypothesis that ticker-tape synaesthesia results from atypical relationships between spoken and written language processing: the ticker-tape synaesthesia-related regions overlap closely with cortices activated during reading, and the overlap of speech-related and reading-related areas is larger in synaesthetes than in controls. Furthermore, the regions over-activated in ticker-tape synaesthesia overlap with regions under-activated in dyslexia. Third, during the resting state (i.e. in the absence of current ticker-tape synaesthesia), synaesthetes showed increased functional connectivity between left prefrontal and bilateral occipital regions. This pattern might reflect a lowered threshold for conscious access to visual mental contents and might imply a non-specific predisposition to all synaesthesias with a visual content. These data provide a rich and coherent account of ticker-tape synaesthesia as a non-detrimental developmental condition created by the interaction of reading acquisition with an atypical cerebral substrate.

An Open Science MRI Database of over 100 Synaesthetic Brains and Accompanying Deep Phenotypic Information

We provide a neuroimaging database consisting of 102 synaesthetic brains using state-of-the-art 3 T MRI protocols from the Human Connectome Project (HCP) which is freely available to researchers. This database consists of structural (T1- and T2-weighted) images together with approximately 24 minutes of resting state data per participant. These protocols are designed to be inter-operable and reproducible so that others can add to the dataset or directly compare it against other normative or special samples. In addition, we provide a 'deep phenotype' of our sample which includes detailed information about each participant's synaesthesia together with associated clinical and cognitive measures. This behavioural dataset, which also includes data from (N = 109) non-synaesthetes, is of importance in its own right and is openly available.

How do Different Types of Synesthesia Cluster Together? Implications for Causal Mechanisms

It is unclear whether synesthesia is one condition or many, and this has implications for whether theories should postulate a single cause or multiple independent causes. Study 1 analyses data from a large sample of self-referred synesthetes (N  =  2,925), who answered a questionnaire about N  =  164 potential types of synesthesia. Clustering and factor analysis methods identified around seven coherent groupings of synesthesia, as well as showing that some common types of synesthesia do not fall into any grouping at all (mirror-touch, hearing-motion, tickertape). There was a residual positive correlation between clusters (they tend to associate rather than compete). Moreover, we observed a "snowball effect" whereby the chances of having a given cluster of synesthesia go up in proportion to the number of other clusters a person has (again suggesting non-independence). Clusters tended to be distinguished by shared concurrent experiences rather than shared triggering stimuli (inducers). We speculate that modulatory feedback pathways from the concurrent to inducers may play a key role in the emergence of synesthesia. Study 2 assessed the external validity of these clusters by showing that they predict performance on other measures known to be linked to synesthesia.

What is the Link Between Mental Imagery and Sensory Sensitivity? Insights from Aphantasia

People with aphantasia have impoverished visual imagery so struggle to form mental pictures in the mind's eye. By testing people with and without aphantasia, we investigate the relationship between sensory imagery and sensory sensitivity (i.e., hyper- or hypo-reactivity to incoming signals through the sense organs). In Experiment 1 we first show that people with aphantasia report impaired imagery across multiple domains (e.g., olfactory, gustatory etc.) rather than simply vision. Importantly, we also show that imagery is related to sensory sensitivity: aphantasics reported not only lower imagery, but also lower sensory sensitivity. In Experiment 2, we showed a similar relationship between imagery and sensitivity in the general population. Finally, in Experiment 3 we found behavioural corroboration in a Pattern Glare Task, in which aphantasics experienced less visual discomfort and fewer visual distortions typically associated with sensory sensitivity. Our results suggest for the very first time that sensory imagery and sensory sensitivity are related, and that aphantasics are characterised by both lower imagery, and lower sensitivity. Our results also suggest that aphantasia (absence of visual imagery) may be more accurately defined as a subtype of a broader imagery deficit we name dysikonesia, in which weak or absent imagery occurs across multiple senses.

Synesthesia as (Multimodal) Mental Imagery

It has been repeatedly suggested that synesthesia is intricately connected with unusual ways of exercising one's mental imagery, although it is not always entirely clear what the exact connection is. My aim is to show that all forms of synesthesia are forms of (often very different kinds of) mental imagery and, further, if we consider synesthesia to be a form of mental imagery, we get significant explanatory benefits, especially concerning less central cases of synesthesia where the inducer is not sensory stimulation.

Synesthesia and the Perception of Unseen Realities

Exceptional experiences (ExE) incorporate a range of phenomena including subjective paranormal and transpersonal experiences. Synesthesia and synesthetic experiences are discussed as important variables in understanding the etiologies of ExE. The neural and psychological correlates of synesthetic experiences (associated with hyperconnectivity) are discussed in relation to ExE. It is argued that synesthetic processes enable both the detection and conscious perception of information from a range of sources that are usually unseen or inaccessible, including abstract, unlanguaged, preconscious, and potentially other nonlocal sources.

Do synaesthesia and mental imagery tap into similar cross-modal processes?

Synaesthesia has previously been linked with imagery abilities, although an understanding of a causal role for mental imagery in broader synaesthetic experiences remains elusive. This can be partly attributed to our relatively poor understanding of imagery in sensory domains beyond vision. Investigations into the neural and behavioural underpinnings of mental imagery have nevertheless identified an important role for imagery in perception, particularly in mediating cross-modal interactions. However, the phenomenology of synaesthesia gives rise to the assumption that associated cross-modal interactions may be encapsulated and specific to synaesthesia. As such, evidence for a link between imagery and perception may not generalize to synaesthesia. Here, we present results that challenge this idea: first, we found enhanced somatosensory imagery evoked by visual stimuli of body parts in mirror-touch synaesthetes, relative to other synaesthetes or controls. Moreover, this enhanced imagery generalized to tactile object properties not directly linked to their synaesthetic associations. Second, we report evidence that concurrent experience evoked in grapheme-colour synaesthesia was sufficient to trigger visual-to-tactile correspondences that are common to all. Together, these findings show that enhanced mental imagery is a consistent hallmark of synaesthesia, and suggest the intriguing possibility that imagery may facilitate the cross-modal interactions that underpin synaesthesic experiences. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Exploring the relationship between grapheme colour-picking consistency and mental imagery

Previous research has indicated a potential link between mental imagery and synaesthesia. However, these findings are mainly based on imagery self-report measures and recruitment of self-selected synaesthetes. To avoid issues of self-selection and demand effects, we recruited participants from the general population, rather than synaesthetes specifically, and used colour-picking consistency tests for letters and numbers to assess a 'synaesthete-like' experience. Mental imagery ability and mental rotation ability were assessed using both self-report measures and behavioural assessments. Consistency in colour-picking for letters (but not numbers) was predicted by performance on the visual mental imagery task but not by a mental rotation task or self-report measures. Using the consistency score as a proxy measure of grapheme-colour synaesthesia, we provide more evidence for the suggestion that synaesthetic experience is associated with enhanced mental imagery, even when participants are naive to the research topic. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Stochastic resonance model of synaesthesia

In synaesthesia, stimulation of one sensory modality evokes additional experiences in another modality (e.g. sounds evoking colours). Along with these cross-sensory experiences, there are several cognitive and perceptual differences between synaesthetes and non-synaesthetes. For example, synaesthetes demonstrate enhanced imagery, increased cortical excitability and greater perceptual sensitivity in the concurrent modality. Previous models suggest that synaesthesia results from increased connectivity between corresponding sensory regions or disinhibited feedback from higher cortical areas. While these models explain how one sense can evoke qualitative experiences in another, they fail to predict the broader phenotype of differences observed in synaesthetes. Here, we propose a novel model of synaesthesia based on the principles of stochastic resonance. Specifically, we hypothesize that synaesthetes have greater neural noise in sensory regions, which allows pre-existing multisensory pathways to elicit supra-threshold activation (i.e. synaesthetic experiences). The strengths of this model are (a) it predicts the broader cognitive and perceptual differences in synaesthetes, (b) it provides a unified framework linking developmental and induced synaesthesias, and (c) it explains why synaesthetic associations are inconsistent at onset but stabilize over time. We review research consistent with this model and propose future studies to test its limits. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Synaesthesia: a distinct entity that is an emergent feature of adaptive neurocognitive differences

In this article, I argue that synaesthesia is not on a continuum with neurotypical cognition. Synaesthesia is special: its phenomenology is different; it has distinct causal mechanisms; and is likely to be associated with a distinct neurocognitive profile. However, not all synaesthetes are the same, and there are quantifiable differences between them. In particular, the number of types of synaesthesia that a person possesses is a hitherto underappreciated variable that predicts cognitive differences along a number of dimensions (mental imagery, sensory sensitivity, attention to detail). Together with enhanced memory, this may constitute a common core of abilities that may go some way to explaining why synaesthesia might have evolved. I argue that the direct benefits of synaesthesia are generally limited (i.e. the synaesthetic associations do not convey novel information about the world) but, nevertheless, synaesthesia may develop due to other adaptive functions (e.g. perceptual ability, memory) that necessitate changes to design features of the brain. The article concludes by suggesting that synaesthesia forces us to reconsider what we mean by a 'normal' mind/brain. There may be multiple 'normal' neurodevelopmental trajectories that can sculpt very different ways of experiencing the world, of which synaesthesia is but one. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Synaesthetic colour associations for Japanese Kanji characters: from the perspective of grapheme learning

One of the fundamental questions about grapheme-colour synaesthesia is how specific associations between the graphemes and colours are formed. We addressed this question by focusing on the determinants of synaesthetic colours for Japanese Kanji characters (logographic characters) using a psycholinguistic approach. Study 1 explored the influence meaning has on synaesthetic colours for Kanji characters representing abstract meanings by examining synaesthetic colours for antonym pairs (i.e. characters with meanings opposed to each other) in Japanese synaesthetes. Results showed that semantic relations influenced the grapheme-colour associations for characters representing abstract meanings in the early stages of learning abstract Kanji, while the influence was reduced in the grapheme-colour associations for those learned later. Study 2 examined the effect that learning new sounds or meanings of graphemes has on synaesthetic colours for those graphemes. Japanese synaesthetes were taught new sounds or new meanings for familiar Kanji characters. Results indicated that acquiring new information for graphemes slightly but significantly reduced the test-retest grapheme-colour association consistency, suggesting that synaesthetic colours can be modulated to reflect the synaesthete's latest knowledge about graphemes. Implications of these findings are discussed from the perspective of the relationship between synaesthesia and grapheme learning. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Distinct colours in the 'synaesthetic colour palette'

In grapheme-colour synaesthesia, particular linguistic elements evoke particular colour sensations. Interestingly, when asked, non-synaesthetes can also associate colours to letters, and previous studies show that specific letter-to-colour associations have similar biases to those of synaesthetes. However, it is an open question whether the colours reported by synaesthetes and non-synaesthetes differ overall: is there a 'synaesthetic colour palette'? In this study, we visualize the overall distribution in colour space of colour concurrents in grapheme-colour synaesthetes, and colour associations in non-synaesthetic controls. We confirm the existence of a synaesthetic colour palette: colour concurrents in synaesthetes are different from colour associations in non-synaesthetes. We quantify three factors that distinguish the colour palette of synaesthetes and non-synaesthetes: synaesthetes have an increased over-representation of 'pure' (unmixed) hues, an increased presence of 'warm' (yellow, orange, brown) colours, and an increased presence of achromatic (grey, white, black) colours. Furthermore, we demonstrate that differences in the synaesthetic colour palette can be used to train a machine learning algorithm to reliably classify single subjects as synaesthetes versus non-synaesthetes without using test-retest consistency data. As far as we know, this is the first time an individual could be 'diagnosed' as a synaesthete, based only on his or her colours evoked by letters. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

The Co-occurrence of Mirror-Touch With Other Types of Synaesthesia

People with mirror-touch synaesthesia report tactile experiences on their body when seeing other people touched. Although this has been referred to as a type of synaesthesia, it is unknown whether it co-occurs with more commonly accepted variants of synaesthesia (e.g., grapheme-colour). If it did, then this would imply a common or partly shared causal mechanism. To this end, a sample of verified grapheme-colour synaesthetes ( N = 80) were given a recently developed online diagnostic measure of mirror-touch. The prevalence in this group (∼20%) was around 10 times higher than the general population. Moreover, performance on this measure was significantly related to the self-report of mirror-touch given, on average, 3 years earlier.

A meta-analysis of memory ability in synaesthesia

People with synaesthesia (e.g., experiencing colours for letters and numbers) have been reported to possess enhanced memory relative to the general population. However, there are also inconsistencies in this literature and it is unclear whether this reflects sampling error (exacerbated by low Ns) or more meaningful differences that arise because synaesthesia relates to some aspects of memory more than others. To this end, a multi-level meta-analysis was conducted. Synaesthetes have enhanced long-term (episodic) memory with a medium population effect size ( dˆ  = 0.61), whereas the effects on working memory (short-term memory) were significantly smaller ( dˆ  = 0.36) but still exceeded that of controls. Moderation analyses suggested that, aside from the division between long-term vs. working memory, the effects of synaesthesia are pervasive, i.e., they extend to all kinds of stimuli, and extend to all kinds of test formats. This pattern is hard to reconcile with the view that synaesthetic experiences directly support memory ability: for instance, digit span (where synaesthesia could be helpful) showed a small effect whereas episodic memory for abstract images (where synaesthesia is irrelevant) yielded larger effects. Synaesthesia occupies a unique position of being the only known neurodevelopmental condition linked to a pervasive enhancement of long-term memory.

Double-blind study of visual imagery in grapheme-color synesthesia

Synesthesia is an atypical perceptual phenomenon that has been associated with generalized differences in other cognitive and perceptual domains. Given similarities in the qualitative nature of synesthetic experiences to visual imagery perceptions, several studies have sought to examine whether synesthetes demonstrate increased visual imagery abilities. Using subjective imagery questionnaires, some studies have identified superior imaging abilities in synesthetes, while others have not. However, because most research on synesthesia uses un-blinded group membership prior to data collection, such methods for studying group differences may be prone to participant and experimenter biases (e.g., a motivated synesthete may rate themselves as having stronger visual imagery abilities due to their own bias and perceived experimenter expectations). To address this issue, we demonstrate the feasibility of double-blind designs in synesthesia research, applied here to examine differences in subjectively reported levels of imagery usage and intensity. Prior to identifying synesthetes' and non-synesthetes' group membership (in order to eliminate the potential for bias), subjects completed two common measures of visual imagery experiences. Using this approach, we replicated findings of greater visual imagery usage in synesthetes on the Spontaneous Use of Imagery Scale (SUIS) measure, but not of enhanced imagery abilities on the standardized Vividness of Visual Imagery Questionnaire (VVIQ) measure. The present study strengthens prior evidence that synesthesia is associated with heightened visual imagery and demonstrates the utility of double-blind designs in order to limit biases and promote further replicability of other findings in research on synesthesia.

Reduced Visual and Frontal Cortex Activation During Visual Working Memory in Grapheme-Color Synaesthetes Relative to Young and Older Adults

The sensory recruitment model envisages visual working memory (VWM) as an emergent property that is encoded and maintained in sensory (visual) regions. The model implies that enhanced sensory-perceptual functions, as in synaesthesia, entail a dedicated VWM-system, showing reduced visual cortex activity as a result of neural specificity. By contrast, sensory-perceptual decline, as in old age, is expected to show enhanced visual cortex activity as a result of neural broadening. To test this model, young grapheme-color synaesthetes, older adults and young controls engaged in a delayed pair-associative retrieval and a delayed matching-to-sample task, consisting of achromatic fractal stimuli that do not induce synaesthesia. While a previous analysis of this dataset (Pfeifer et al., 2016) has focused on cued retrieval and recognition of pair-associates (i.e., long-term memory), the current study focuses on visual working memory and considers, for the first time, the crucial delay period in which no visual stimuli are present, but working memory processes are engaged. Participants were trained to criterion and demonstrated comparable behavioral performance on VWM tasks. Whole-brain and region-of-interest-analyses revealed significantly lower activity in synaesthetes’ middle frontal gyrus and visual regions (cuneus, inferior temporal cortex), respectively, suggesting greater neural efficiency relative to young and older adults in both tasks. The results support the sensory recruitment model and can explain age and individual WM-differences based on neural specificity in visual cortex.

A possible key role of vision in the development of schizophrenia

Based on a brief overview of the various aspects of schizophrenia reported by numerous studies, here we hypothesize that schizophrenia may originate (and in part be performed) from visual areas. In other words, it seems that a normal visual system or at least an evanescent visual perception may be an essential prerequisite for the development of schizophrenia as well as of various types of hallucinations. Our study focuses on auditory and visual hallucinations, as they are the most prominent features of schizophrenic hallucinations (and also the most studied types of hallucinations). Here, we evaluate the possible key role of the visual system in the development of schizophrenia.

Synesthesia & autistic features in a large family: Evidence for spatial imagery as a common factor

BACKGROUND

Autism and synesthesia are neurodevelopmental conditions associated with variants of perceptual processing. They also share some genetic variants and include a large magnitude of intra-categorical variation: 60 types for synesthesia, as well as a spectrum for autism. In order to investigate the relationship between these two phenomena, we investigated the family of FC, an autistic individual who also possess savant abilities and synesthesia manifestations.

METHOD

Autistic symptoms were assessed for the entire sample of participants entering the study (39 individuals) using the SRS. Participants above threshold were evaluated with standardized diagnostic tools. Synesthesia was explored in the entire participating sample using a self-reported questionnaire. Consistency tests were used for participants who reported synesthetic manifestations.

RESULTS

In addition to FC, four individuals with ASD were detected. Fifteen participants self-reported synesthesia (15 sequence-space, 4 sound-shape, 4 day-color), among which nine sequence-space synesthetes satisfied the consistency criteria. Two participants possess both autism and synesthesia.

CONCLUSION

This family illustrates the co-segregation of autism and synesthesia. This co-segregation is in favour of a partially overlapping genetic predisposition for both conditions, but also authorizes a large variety of manifestations in both conditions. The high prevalence of sequence-space synesthesia in this family strengthens the previous assumption that this form of synesthesia may be linked to autism. We discuss the potential role of spatial imagery in the development of this form of synesthesia and savant abilities.

Synaesthetes show advantages in savant skill acquisition: Training calendar calculation in sequence-space synaesthesia

Previous research has suggested that synaesthetic experiences may create the foundation for superior skills to emerge of the type found in savant syndrome (e.g., Simner, Mayo, & Spiller, 2009). People with sequence-space synaesthesia experience units of time (e.g., days, months, years) as a pattern in space, either within the mind's eye or as a 3d projection outside of the body. Our study investigates whether sequence-space synaesthesia facilitates the learning of the savant skill known as 'calendar calculation' where an individual can give the correct day of the week for any given date (e.g., 18th September 1990 was a Tuesday). Using a novel experimental methodology, we trained a group of sequence-space synaesthetes as well as non-synaesthete controls how to calendar calculate over two weeks with a final calendar calculation test in the third week. We show for the first time that calendar calculation is relatively easy to acquire: following training sessions totalling 1 h participants could select a day, from a set of several thousand, within ∼10 sec and with ∼80% accuracy. Synaesthetes were not found to have improved abilities from the start, but they outperformed controls in our final calendar calculation test. We suggest that sequence-space synaesthesia may have provided an advantage in performing calendar calculation after the opportunity for initial learning had taken place. This supports the notion of synaesthesia as a foundation for superior, and perhaps sometimes savant-like, skills.

Projectors, associators, visual imagery, and the time course of visual processing in grapheme-color synesthesia

In grapheme-color synesthesia, seeing particular letters or numbers evokes the experience of specific colors. We investigate the brain's real-time processing of words in this population by recording event-related brain potentials (ERPs) from 15 grapheme-color synesthetes and 15 controls as they judged the validity of word pairs ('yellow banana' vs. 'blue banana') presented under high and low visual contrast. Low contrast words elicited delayed P1/N170 visual ERP components in both groups, relative to high contrast. When color concepts were conveyed to synesthetes by individually tailored achromatic grapheme strings ('55555 banana'), visual contrast effects were like those in color words: P1/N170 components were delayed but unchanged in amplitude. When controls saw equivalent colored grapheme strings, visual contrast modulated P1/N170 amplitude but not latency. Color induction in synesthetes thus differs from color perception in controls. Independent from experimental effects, all orthographic stimuli elicited larger N170 and P2 in synesthetes than controls. While P2 (150-250ms) enhancement was similar in all synesthetes, N170 (130-210ms) amplitude varied with individual differences in synesthesia and visual imagery. Results suggest immediate cross-activation in visual areas processing color and shape is most pronounced in so-called projector synesthetes whose concurrent colors are experienced as originating in external space.

Personality predicts the vibrancy of colour imagery: The case of synaesthesia

In this study we show that personality traits predict the physical qualities of mentally generated colours, using the case of synaesthesia. Developmental grapheme-colour synaesthetes have the automatic lifelong association of colours paired to letters or digits. Although these colours are internal mental constructs, they can be measured along physical dimensions such as saturation and luminance. The personality of synaesthetes can also be quantified using self-report questionnaires relating, for example, to the five major traits of Conscientiousness, Extraversion, Agreeableness, Neuroticism, and Openness to Experience. In this paper, we bring together both types of quality by examining whether the personality of individual synaesthetes predicts their synaesthetic colours. Twenty grapheme-colour synaesthetes were tested with the Big Five Inventory (BFI) personality questionnaire. Their synaesthesia was also tested in terms of consistency and average colour saturation and luminance. Two major results were found: although personality did not influence the overall robustness (i.e., consistency) of synaesthesia, it predicted the nature of synaesthetes' colours: the trait of Openness was positively correlated with the saturation of synaesthetic colours. Our study provides evidence that personality and internal perception are intertwined, and suggests future avenues of research for investigating the associations between the two.

Multimodal mental imagery

When I am looking at my coffee machine that makes funny noises, this is an instance of multisensory perception – I perceive this event by means of both vision and audition. But very often we only receive sensory stimulation from a multisensory event by means of one sense modality, for example, when I hear the noisy coffee machine in the next room, that is, without seeing it. The aim of this paper is to bring together empirical findings about multimodal perception and empirical findings about (visual, auditory, tactile) mental imagery and argue that on occasions like this, we have multimodal mental imagery: perceptual processing in one sense modality (here: vision) that is triggered by sensory stimulation in another sense modality (here: audition). Multimodal mental imagery is not a rare and obscure phenomenon. The vast majority of what we perceive are multisensory events: events that can be perceived in more than one sense modality – like the noisy coffee machine. And most of the time we are only acquainted with these multisensory events via a subset of the sense modalities involved – all the other aspects of these multisensory events are represented by means of multisensory mental imagery. This means that multisensory mental imagery is a crucial element of almost all instances of everyday perception.

Atypical sensory sensitivity as a shared feature between synaesthesia and autism

Several studies have suggested that there is a link between synaesthesia and autism but the nature of that link remains poorly characterised. The present study considers whether atypical sensory sensitivity may be a common link between the conditions. Sensory hypersensitivity (aversion to certain sounds, touch, etc., or increased ability to make sensory discriminations) and/or hyposensitivity (desire to stimulate the senses , or a reduced response to sensory stimuli are a recently introduced diagnostic feature of autism spectrum conditions (ASC). Synaesthesia is defined by unusual sensory experiences and has also been linked to a typical cortical hyper-excitability. The Glasgow Sensory Questionnaire (GSQ) was administered to synaesthetes and people with ASC. Both groups reported increased sensory sensitivity relative to controls with a large effect size. Both groups also reported a similar pattern of both increased hyper- and hypo-sensitivities across multiple senses. The AQ (Autism-Spectrum Quotient) scores were elevated in the synaesthetes, and one subscale of this measure (attention to detail) placed synaesthetes within the autistic range. A standard laboratory test of visual stress (the Pattern Glare Test), administered online, corroborated the findings of increased sensitivity to aversive visual stimuli in synaesthetes. We conclude that atypical sensory sensitivity is an important shared feature between autism and synaesthesia.

The prevalence of synaesthesia depends on early language learning

According to one theory, synaesthesia develops, or is preserved, because it helps children learn. If so, it should be more common among adults who faced greater childhood learning challenges. In the largest survey of synaesthesia to date, the incidence of synaesthesia was compared among native speakers of languages with transparent (easier) and opaque (more difficult) orthographies. Contrary to our prediction, native speakers of Czech (transparent) were more likely to be synaesthetes than native speakers of English (opaque). However, exploratory analyses suggested that this was because more Czechs learned non-native second languages, which was strongly associated with synaesthesia, consistent with the learning hypothesis. Furthermore, the incidence of synaesthesia among speakers of opaque languages was double that among speakers of transparent languages other than Czech, also consistent with the learning hypothesis. These findings contribute to an emerging understanding of synaesthetic development as a complex and lengthy process with multiple causal influences.

Synesthesia strengthens sound-symbolic cross-modal correspondences

Synesthesia is a phenomenon in which an experience in one domain is accompanied by an involuntary secondary experience in another, unrelated domain; in classical synesthesia, these associations are arbitrary and idiosyncratic. Cross-modal correspondences refer to universal associations between seemingly unrelated sensory features, e.g., auditory pitch and visual size. Some argue that these phenomena form a continuum, with classical synesthesia being an exaggeration of universal cross-modal correspondences, whereas others contend that the two are quite different, since cross-modal correspondences are non-arbitrary, non-idiosyncratic, and do not involve secondary experiences. Here, we used the implicit association test to compare synesthetes' and non-synesthetes' sensitivity to cross-modal correspondences. We tested the associations between auditory pitch and visual elevation, auditory pitch and visual size, and sound-symbolic correspondences between auditory pseudowords and visual shapes. Synesthetes were more sensitive than non-synesthetes to cross-modal correspondences involving sound-symbolic, but not low-level sensory, associations. We conclude that synesthesia heightens universally experienced cross-modal correspondences, but only when these involve sound symbolism. This is only partly consistent with the idea of a continuum between synesthesia and cross-modal correspondences, but accords with the idea that synesthesia is a high-level, post-perceptual phenomenon, with spillover of the abilities of synesthetes into domains outside their synesthesias. To our knowledge, this is the first demonstration that synesthetes, relative to non-synesthetes, experience stronger cross-modal correspondences outside their synesthetic domains.

Examining the Relationship Between Schizotypy and Self-Reported Visual Imagery Vividness in Grapheme-Color Synaesthesia

Synaesthesia is a condition in which one property of a stimulus triggers a secondary experience not typically associated with the first (e.g., seeing achromatic graphemes can evoke the perception of color). Recent work has explored a variety of cognitive and perceptual traits associated with synaesthesia. One example is in the domain of personality, where higher rates of positive schizotypy and openness to experience and lower agreeableness have been reported in synaesthetes who experience color as their evoked sensation relative to typical adult controls. Additionally, grapheme-color synaesthetes have previously been reported to show elevated mental imagery compared to typical adults. Here, we aimed to further elucidate the relationship between personality, synaesthesia, and other cognitive traits. In Study 1, we examined self-reported schizotypy and self-reported visual imagery vividness in grapheme-color synaesthetes and typical adults. Our results partially replicated previous findings by showing that synaesthesia was associated with greater positive schizotypy and enhanced self-reported imagery vividness. The results also extend previous reports by demonstrating that differences in positive schizotypy and mental imagery vividness are not related in grapheme-color synaesthesia. In Study 2, we sought to build on prior work showing lower agreeableness and increased openness to experience in synaesthetes by examining whether grapheme-color synaesthesia is associated with other conceptually related traits; namely lower self-monitoring and increased sensation seeking. We did not find any differences between synaesthetes and controls on either of these traits. These findings are discussed in relation to potential factors that may contribute to the observed personality profile in grapheme-color synaesthesia.

Are synesthetes exceptional beyond their synesthetic associations? A systematic comparison of creativity, personality, cognition, and mental imagery in synesthetes and controls

Synesthesia has historically been linked with enhanced creativity, but this had never been demonstrated in a systematically recruited sample. The current study offers a broad examination of creativity, personality, cognition, and mental imagery in a small sample of systematically recruited synesthetes and controls (n = 65). Synesthetes scored higher on some measures of creativity, personality traits of absorption and openness, and cognitive abilities of verbal comprehension and mental imagery. The differences were smaller than those reported in the literature, indicating that previous studies may have overestimated group differences, perhaps due to biased recruitment procedures. Nonetheless, most of our results replicated literature findings, yielding two possibilities: (1) our study was influenced by similar biases, or (2) differences between synesthetes and controls, though modest, are robust across recruitment methods. The covariance among our measures warrants interpretation of these differences as a pattern of associations with synesthesia, leaving open the possibility that this pattern could be explained by differences on a single measured trait, or even a hidden, untested trait. More generally, this study highlights the difficulty of comparing groups of people in psychology, not to mention neuropsychology and neuroimaging studies. The requirements discussed here – systematic recruitment procedures, large battery of tests, and large cohorts – are best fulfilled through collaborative efforts and cumulative science.

Multisensory integration and cross-modal learning in synaesthesia: A unifying model

Recent research into synaesthesia has highlighted the role of learning, yet synaesthesia is clearly a genetic condition. Here we ask how can the idea that synaesthesia reflects innate, genetic differences be reconciled with models that suggest it is driven by learning. A number of lines of evidence suggest that synaesthesia relies on, or at least interacts with, processes of multisensory integration that are common across all people. These include multisensory activations that arise in early regions of the brain as well as feedback from longer-term cross-modal associations generated in memory. These cognitive processes may interact independently to influence the phenomenology of the synaesthetic experience, as well as the individual differences within particular types of synaesthesia. The theoretical framework presented here is consistent with both an innate difference as the fundamental driver of the condition of synaesthesia, and with experiential and semantic influences on the eventual phenotype that emerges. In particular, it proposes that the internally generated synaesthetic percepts are treated similarly to other sensory information as the brain is learning the multisensory attributes of objects and developing cross-modal associations that merge in the concept of the object.