Psychophysiological evidence for the genuineness of swimming-style colour synaesthesia

The Stroop effect and mental imagery

The classic Stroop task is very simple: you have to name the color of words printed on a page. If these words are color words (like "red" or "blue"), where the color named and the color it is printed in are different (say, "red" printed in blue), the reaction time increases significantly. My aim is to argue that the existing psychological explanations of the Stroop effect need to be supplemented. The Stroop effect is not exclusively about access to motor control. It is also, to a large extent, about interferences in perceptual processing. To put it briefly, reading the color word triggers-laterally and automatically-visual imagery of the color and this interferes with the processing of the perceived color of the word. In other words, the Stroop effect is to a large extent a sensory phenomenon, and it has less to do with attention, conflict monitoring, or other higher-level phenomena.

Synesthesia as (Multimodal) Mental Imagery

It has been repeatedly suggested that synesthesia is intricately connected with unusual ways of exercising one's mental imagery, although it is not always entirely clear what the exact connection is. My aim is to show that all forms of synesthesia are forms of (often very different kinds of) mental imagery and, further, if we consider synesthesia to be a form of mental imagery, we get significant explanatory benefits, especially concerning less central cases of synesthesia where the inducer is not sensory stimulation.

Neurophenomenology of induced and natural synaesthesia

People with synaesthesia have additional perceptual experiences, which are automatically and consistently triggered by specific inducing stimuli. Synaesthesia therefore offers a unique window into the neurocognitive mechanisms underlying conscious perception. A long-standing question in synaesthesia research is whether it is possible to artificially induce non-synaesthetic individuals to have synaesthesia-like experiences. Although synaesthesia is widely considered a congenital condition, increasing evidence points to the potential of a variety of approaches to induce synaesthesia-like experiences, even in adulthood. Here, we summarize a range of methods for artificially inducing synaesthesia-like experiences, comparing the resulting experiences to the key hallmarks of natural synaesthesia which include consistency, automaticity and a lack of 'perceptual presence'. We conclude that a number of aspects of synaesthesia can be artificially induced in non-synaesthetes. These data suggest the involvement of developmental and/or learning components in the acquisition of synaesthesia, and they extend previous reports of perceptual plasticity leading to dramatic changes in perceptual phenomenology in adults. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

"17" is odd and "seventeen" is even: Meaning and physical form in stimulus-parity synaesthesia

For individuals with stimulus-parity synaesthesia, eliciting stimuli (e.g., shapes, numbers, letters, colours) trigger a compelling feeling of oddness or evenness. Given that (a) many inducers are conceptual and (b) parity is itself a conceptual property, one questions whether stimulus-parity synaesthesia will be a categorically higher subtype, such that the conceptual properties of stimuli will be crucial in determining parity. We explore this question as it applies to Synaesthete R, one of only two stimulus-parity synaesthetes known to the contemporary literature. In Experiments 1 and 2, we examine whether parity is tied to concepts or percepts, asking, for example, whether a rectangle is even regardless of whether it is presented as an image or a word. Our results indicate that the parity of shapes (words and images), numbers (words, digits, and Roman numerals), and letters (lowercase and uppercase) differs according to the stimulus format, supporting a perceptual explanation. In Experiment 3, we examine the parity of colour stimuli, showing a systematic relationship between the measurable physical properties of hue, saturation, and lightness and synaesthetic parity. Despite the conceptual nature of inducers and concurrents, for Synaesthete R, stimulus-parity synaesthesia is a lower subtype; perceptual properties of stimuli determine parity.

Gray Bananas and a Red Letter A - From Synesthetic Sensation to Memory Colors

Grapheme-color synesthesia is a condition in which objectively achromatic graphemes induce concurrent color experiences. While it was long thought that the colors emerge during perception, there is growing support for the view that colors are integral to synesthetes' cognitive representations of graphemes. In this work, we review evidence for two opposing theories positing either a perceptual or cognitive origin of concurrent colors: the cross-activation theory and the conceptual-mediation model. The review covers results on inducer and concurrent color processing as well as findings concerning the brain structure and grapheme-color mappings in synesthetes and trained mappings in nonsynesthetes. The results support different aspects of both theories. Finally, we discuss how research on memory colors could provide a new perspective in the debate about the level of processing at which the synesthetic colors occur.

Sounds from seeing silent motion: Who hears them, and what looks loudest?

Some people hear what they see: car indicator lights, flashing neon shop signs, and people's movements as they walk may all trigger an auditory sensation, which we call the visual-evoked auditory response (vEAR or 'visual ear'). We have conducted the first large-scale online survey (N > 4000) of this little-known phenomenon. We analysed the prevalence of vEAR, what induces it, and what other traits are associated with it. We assessed prevalence by asking whether respondents had previously experienced vEAR. Participants then rated silent videos for vividness of evoked auditory sensations, and answered additional trait questions. Prevalence appeared higher relative to other typical synaesthesias. Prior awareness and video ratings were associated with greater frequency of other synaesthesias, including flashes evoked by sounds, and musical imagery. Higher-rated videos often depicted meaningful events that predicted sounds (e.g., collisions). However, even videos containing abstract flickering or moving patterns could also elicit higher ratings, despite having no predictable association with sounds. Such videos had higher levels of raw 'motion energy' (ME), which we quantified using a simple computational model of motion processing in early visual cortex. Critically, only respondents reporting prior awareness of vEAR tended to show a positive correlation between video ratings and ME. This specific sensitivity to ME suggests that in vEAR, signals from visual motion processing may affect audition relatively directly without requiring higher-level interpretative processes. Our other findings challenge the popular assumption that individuals with synaesthesia are rare and have ideosyncratic patterns of brain hyper-connectivity. Instead, our findings of apparently high prevalence and broad associations with other synaesthesias and traits are jointly consistent with a common dependence on normal variations in physiological mechanisms of disinhibition or excitability of sensory brain areas and their functional connectivity. The prevalence of vEAR makes it easier to test such hypotheses further, and makes the results more relevant to understanding not only synaesthetic anomalies but also normal perception.

Rare variants in axonogenesis genes connect three families with sound-color synesthesia

Synesthesia is a rare nonpathological phenomenon where stimulation of one sense automatically provokes a secondary perception in another. Hypothesized to result from differences in cortical wiring during development, synesthetes show atypical structural and functional neural connectivity, but the underlying molecular mechanisms are unknown. The trait also appears to be more common among people with autism spectrum disorder and savant abilities. Previous linkage studies searching for shared loci of large effect size across multiple families have had limited success. To address the critical lack of candidate genes, we applied whole-exome sequencing to three families with sound-color (auditory-visual) synesthesia affecting multiple relatives across three or more generations. We identified rare genetic variants that fully cosegregate with synesthesia in each family, uncovering 37 genes of interest. Consistent with reports indicating genetic heterogeneity, no variants were shared across families. Gene ontology analyses highlighted six genes-COL4A1, ITGA2, MYO10, ROBO3, SLC9A6, and SLIT2-associated with axonogenesis and expressed during early childhood when synesthetic associations are formed. These results are consistent with neuroimaging-based hypotheses about the role of hyperconnectivity in the etiology of synesthesia and offer a potential entry point into the neurobiology that organizes our sensory experiences.

Automaticity in Stimulus-Parity Synaesthesia

Automaticity is a defining characteristic of synaesthesia. Here, we assess for automaticity in stimulus-parity synaesthesia; a subtype that has been documented only 3 times in the literature. Synaesthete R experiences many (nonnumerical) stimuli as being odd or even. She described a toy shape-sorter, which paired odd shapes with even colour slots (and vice versa) and relayed difficulties with the incongruency created by this simple toy. Inspired by this anecdote, we devised a computerised task in which Synaesthete R (and 10 control participants) indicated the location of a target shape, which was presented on a coloured bar. Synaesthete R (but not control participants) was faster to report the location of target shapes presented on colours of congruent synaesthetic parity, relative to target shapes presented on colours of incongruent synaesthetic parity. These results constitute the first objective demonstration as to the automatic nature of associations in stimulus-parity synaesthesia.

Color Processing in Synesthesia: What Synesthesia Can and Cannot Tell Us About Mechanisms of Color Processing

Synesthetic experiences of color have been traditionally conceptualized as a perceptual phenomenon. However, recent evidence suggests a role of higher order cognition in the formation of synesthetic experiences. Here, we discuss how synesthetic experiences of color differ from and influence veridical color processing, and how non-perceptual processes such as imagery and color memory might play a role in eliciting synesthetic color experience.

Color synesthesia. Insight into perception, emotion, and consciousness

Purpose of review

Synesthesia is an extraordinary perceptual phenomenon, in which individuals experience unusual percepts elicited by the activation of an unrelated sensory modality or by a cognitive process. Emotional reactions are commonly associated. The condition prompted philosophical debates on the nature of perception and impacted the course of art history. It recently generated a considerable interest among neuroscientists, but its clinical significance apparently remains underevaluated. This review focuses on the recent studies regarding variants of color synesthesia, the commonest form of the condition.

Recent findings

Synesthesia is commonly classified as developmental and acquired. Developmental forms predispose to changes in primary sensory processing and cognitive functions, usually with better performances in certain aspects and worse in others, and to heightened creativity. Acquired forms of synesthesia commonly arise from drug ingestion or neurological disorders, including thalamic lesions and sensory deprivation (e.g., blindness). Cerebral exploration using structural and functional imaging has demonstrated distinct patterns in cortical activation and brain connectivity for controls and synesthetes. Artworks of affected painters are most illustrative of the nature of synesthetic experiences.

Summary

Results of the recent investigations on synesthesia offered a remarkable insight into the mechanisms of perception, emotion and consciousness, and deserve attention both from neuroscientists and from clinicians.

Adults can be trained to acquire synesthetic experiences

Synesthesia is a condition where presentation of one perceptual class consistently evokes additional experiences in different perceptual categories. Synesthesia is widely considered a congenital condition, although an alternative view is that it is underpinned by repeated exposure to combined perceptual features at key developmental stages. Here we explore the potential for repeated associative learning to shape and engender synesthetic experiences. Non-synesthetic adult participants engaged in an extensive training regime that involved adaptive memory and reading tasks, designed to reinforce 13 specific letter-color associations. Following training, subjects exhibited a range of standard behavioral and physiological markers for grapheme-color synesthesia; crucially, most also described perceiving color experiences for achromatic letters, inside and outside the lab, where such experiences are usually considered the hallmark of genuine synesthetes. Collectively our results are consistent with developmental accounts of synesthesia and illuminate a previously unsuspected potential for new learning to shape perceptual experience, even in adulthood.

Semantic mechanisms may be responsible for developing synesthesia

Currently, little is known about how synesthesia develops and which aspects of synesthesia can be acquired through a learning process. We review the increasing evidence for the role of semantic representations in the induction of synesthesia, and argue for the thesis that synesthetic abilities are developed and modified by semantic mechanisms. That is, in certain people semantic mechanisms associate concepts with perception-like experiences-and this association occurs in an extraordinary way. This phenomenon can be referred to as "higher" synesthesia or ideasthesia. The present analysis suggests that synesthesia develops during childhood and is being enriched further throughout the synesthetes' lifetime; for example, the already existing concurrents may be adopted by novel inducers or new concurrents may be formed. For a deeper understanding of the origin and nature of synesthesia we propose to focus future research on two aspects: (i) the similarities between synesthesia and ordinary phenomenal experiences based on concepts; and (ii) the tight entanglement of perception, cognition and the conceptualization of the world. Importantly, an explanation of how biological systems get to generate experiences, synesthetic or not, may have to involve an explanation of how semantic networks are formed in general and what their role is in the ability to be aware of the surrounding world.

Developmental aspects of synaesthesia across the adult lifespan

In synaesthesia, stimuli such as sounds, words or letters trigger experiences of colors, shapes or tastes and the consistency of these experiences is a hallmark of this condition. In this study we investigate for the first time whether there are age-related changes in the consistency of synaesthetic experiences. We tested a sample of more than 400 grapheme-color synaesthetes who have color experiences when they see letters and/or digits with a well-established test of consistency. Our results showed a decline in the number of consistent grapheme-color associations across the adult lifespan. We also assessed age-related changes in the breadth of the color spectrum. The results showed that the appearance of primary colors (i.e., red, blue, and green) was mainly age-invariant. However, there was a decline in the occurrence of lurid colors while brown and achromatic tones occurred more often as concurrents in older age. These shifts in the color spectrum suggest that synaesthesia does not simply fade, but rather undergoes more comprehensive changes. We propose that these changes are the result of a combination of both age-related perceptual and memory processing shifts.

Acquiring synaesthesia: insights from training studies

Synaesthesia denotes a condition of remarkable individual differences in experience characterized by specific additional experiences in response to normal sensory input. Synaesthesia seems to (i) run in families which suggests a genetic component, (ii) is associated with marked structural and functional neural differences, and (iii) is usually reported to exist from early childhood. Hence, synaesthesia is generally regarded as a congenital phenomenon. However, most synaesthetic experiences are triggered by cultural artifacts (e.g., letters, musical sounds). Evidence exists to suggest that synaesthetic experiences are triggered by the conceptual representation of their inducer stimuli. Cases were identified for which the specific synaesthetic associations are related to prior experiences and large scale studies show that grapheme-color associations in synaesthesia are not completely random. Hence, a learning component is inherently involved in the development of specific synaesthetic associations. Researchers have hypothesized that associative learning is the critical mechanism. Recently, it has become of scientific and public interest if synaesthetic experiences may be acquired by means of associative training procedures and whether the gains of these trainings are associated with similar cognitive benefits as genuine synaesthetic experiences. In order to shed light on these issues and inform synaesthesia researchers and the general interested public alike, we provide a comprehensive literature review on developmental aspects of synaesthesia and specific training procedures in non-synaesthetes. Under the light of a clear working definition of synaesthesia, we come to the conclusion that synaesthesia can potentially be learned by the appropriate training.

Training synesthetic letter-color associations by reading in color

Synesthesia is a rare condition in which a stimulus from one modality automatically and consistently triggers unusual sensations in the same and/or other modalities. A relatively common and well-studied type is grapheme-color synesthesia, defined as the consistent experience of color when viewing, hearing and thinking about letters, words and numbers. We describe our method for investigating to what extent synesthetic associations between letters and colors can be learned by reading in color in nonsynesthetes. Reading in color is a special method for training associations in the sense that the associations are learned implicitly while the reader reads text as he or she normally would and it does not require explicit computer-directed training methods. In this protocol, participants are given specially prepared books to read in which four high-frequency letters are paired with four high-frequency colors. Participants receive unique sets of letter-color pairs based on their pre-existing preferences for colored letters. A modified Stroop task is administered before and after reading in order to test for learned letter-color associations and changes in brain activation. In addition to objective testing, a reading experience questionnaire is administered that is designed to probe for differences in subjective experience. A subset of questions may predict how well an individual learned the associations from reading in color. Importantly, we are not claiming that this method will cause each individual to develop grapheme-color synesthesia, only that it is possible for certain individuals to form letter-color associations by reading in color and these associations are similar in some aspects to those seen in developmental grapheme-color synesthetes. The method is quite flexible and can be used to investigate different aspects and outcomes of training synesthetic associations, including learning-induced changes in brain function and structure.

Enhanced recognition memory in grapheme-color synaesthesia for different categories of visual stimuli

Memory has been shown to be enhanced in grapheme-color synaesthesia, and this enhancement extends to certain visual stimuli (that don't induce synaesthesia) as well as stimuli comprised of graphemes (which do). Previous studies have used a variety of testing procedures to assess memory in synaesthesia (e.g., free recall, recognition, associative learning) making it hard to know the extent to which memory benefits are attributable to the stimulus properties themselves, the testing method, participant strategies, or some combination of these factors. In the first experiment, we use the same testing procedure (recognition memory) for a variety of stimuli (written words, non-words, scenes, and fractals) and also check which memorization strategies were used. We demonstrate that grapheme-color synaesthetes show enhanced memory across all these stimuli, but this is not found for a non-visual type of synaesthesia (lexical-gustatory). In the second experiment, the memory advantage for scenes is explored further by manipulating the properties of the old and new images (changing color, orientation, or object presence). Again, grapheme-color synaesthetes show a memory advantage for scenes across all manipulations. Although recognition memory is generally enhanced in this study, the largest effects were found for abstract visual images (fractals) and scenes for which color can be used to discriminate old/new status.

Psychophysiology of prospective memory

Prospective memory involves the self-initiated retrieval of an intention upon an appropriate retrieval cue. Cue identification can be considered as an orienting reaction and may thus trigger a psychophysiological response. Here we present two experiments in which skin conductance responses (SCRs) elicited by prospective memory cues were compared to SCRs elicited by aversive stimuli to test whether a single prospective memory cue triggers a similar SCR as an aversive stimulus. In Experiment 2 we also assessed whether cue specificity had a differential influence on prospective memory performance and on SCRs. We found that detecting a single prospective memory cue is as likely to elicit a SCR as an aversive stimulus. Missed prospective memory cues also elicited SCRs. On a behavioural level, specific intentions led to better prospective memory performance. However, on a psychophysiological level specificity had no influence. More generally, the results indicate reliable SCRs for prospective memory cues and point to psychophysiological measures as valuable approach, which offers a new way to study one-off prospective memory tasks. Moreover, the findings are consistent with a theory that posits multiple prospective memory retrieval stages.

Training, hypnosis, and drugs: artificial synaesthesia, or artificial paradises?

The last few years have seen the publication of a number of studies by researchers claiming to have induced "synaesthesia," "pseudo-synaesthesia," or "synaesthesia-like" phenomena in non-synaesthetic participants. Although the intention of these studies has been to try and shed light on the way in which synaesthesia might have been acquired in developmental synaesthestes, we argue that they may only have documented a phenomenon that has elsewhere been accounted for in terms of the acquisition of sensory associations and is not evidently linked to synaesthesia. As synaesthesia remains largely defined in terms of the involuntary elicitation of conscious concurrents, we suggest that the theoretical rapprochement with synaesthesia (in any of its guises) is unnecessary, and potentially distracting. It might therefore, be less confusing if researchers were to avoid referring to synaesthesia when characterizing cases that lack robust evidence of a conscious manifestation. Even in the case of those other conditions for which conscious experiences are better evidenced, when training has been occurred during hypnotic suggestion, or when it has been combined with drugs, we argue that not every conscious manifestation should necessarily be counted as synaesthetic. Finally, we stress that cases of associative learning are unlikely to shed light on two highly specific characteristic of the majority of cases of developmental synaesthesia in terms of learning patterns: First, their resistance to change through exposure once the synaesthetic repertoire has been fixed; Second, the transfer of conditioned responses between concurrents and inducers after training. We conclude by questioning whether, in adulthood, it is ever possible to acquire the kind of synaesthesia that is typically documented in the developmental form of the condition. The available evidence instead seems to point to there being a critical period for the development of synaesthesia, probably only in those with a genetic predisposition to develop the condition.