Double-blind study of visual imagery in grapheme-color synesthesia

Perceptual Dissimilarity Analysis Distinguishes Grapheme-Color Synesthetes from Nonsynesthetes

Synesthetes can be distinguished from nonsynesthetes on a variety of experimental tasks because their concurrent synesthetic experiences can affect task performance if these experiences match or conflict with some aspect of the stimulus. Here, we tested grapheme-color synesthetes and nonsynesthetic control participants using a novel perceptual similarity task to assess whether synesthetes' concurrent color experiences influence perceived grapheme similarity. Participants iteratively arranged graphemes and, separately, their associated synesthetic colors in a display, such that similar items were placed close together and dissimilar items further apart. The resulting relative inter-item distances were used to calculate the pair-wise (dis)similarity between items in the set, and thence to create separate perceptual representational dissimilarity matrices (RDMs) for graphemes and colors, on an individual basis. On the assumption that synesthetes' similarity judgments for graphemes would be influenced by their concurrent color experiences, we predicted that grapheme and color RDMs would be more strongly correlated for synesthetes than nonsynesthetes. We found that the mean grapheme-color RDM correlation was indeed significantly higher in synesthetes than nonsynesthetes; in addition, synesthetes' grapheme-color RDM correlations were more likely to be individually statistically significant, even after correction for multiple tests, than those of nonsynesthetes. Importantly, synesthetes' grapheme-color RDM correlations were scaled with the consistency of their grapheme-color associations as measured by their Synesthesia Battery (SB) scores. By contrast, the relationship between SB scores and grapheme-color RDM correlations for nonsynesthetes was not significant. Thus, dissimilarity analysis quantitatively distinguished synesthetes from nonsynesthetes, in a way that meaningfully reflects a key aspect of synesthetic experience.

Sharing the load: How a personally coloured calculator for grapheme-colour synaesthetes can reduce processing costs

Synaesthesia refers to a diverse group of perceptions. These unusual perceptions are defined by the experience of concurrents; these are conscious experiences that are catalysed by attention to some normally unrelated stimulus, the inducer. In grapheme-colour synaesthesia numbers, letters, and words can all cause colour concurrents, and these are independent of the actual colour with which the graphemes are displayed. For example, when seeing the numeral '3' a person with synaesthesia might experience green as the concurrent irrespective of whether the numeral is printed in blue, black, or red. As a trait, synaesthesia has the potential to cause both positive and negative effects. However, regardless of the end effect, synaesthesia incurs an initial cost when compared with its equivalent example from normal perception; this is the additional processing cost needed to generate the information on the concurrent. We contend that this cost can be reduced by mirroring the concurrent in the environment. We designed the Digital-Colour Calculator (DCC) app, allowing each user to personalise and select the colours with which it displays its digits; it is the first reported example of a device/approach that leverages the concurrent. In this article we report on the reactions to the DCC for a sample of fifty-three synaesthetes and thirty-five non-synaesthetes. The synaesthetes showed a strong preference for the DCC over its normal counterpart. The non-synaesthetes showed no obvious preference. When using the DCC a subsample of the synaesthete group showed consistent improvement in task speed (around 8%) whereas no synaesthete showed a decrement in their speed.

Exploring the relationship between grapheme colour-picking consistency and mental imagery

Previous research has indicated a potential link between mental imagery and synaesthesia. However, these findings are mainly based on imagery self-report measures and recruitment of self-selected synaesthetes. To avoid issues of self-selection and demand effects, we recruited participants from the general population, rather than synaesthetes specifically, and used colour-picking consistency tests for letters and numbers to assess a 'synaesthete-like' experience. Mental imagery ability and mental rotation ability were assessed using both self-report measures and behavioural assessments. Consistency in colour-picking for letters (but not numbers) was predicted by performance on the visual mental imagery task but not by a mental rotation task or self-report measures. Using the consistency score as a proxy measure of grapheme-colour synaesthesia, we provide more evidence for the suggestion that synaesthetic experience is associated with enhanced mental imagery, even when participants are naive to the research topic. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Stochastic resonance model of synaesthesia

In synaesthesia, stimulation of one sensory modality evokes additional experiences in another modality (e.g. sounds evoking colours). Along with these cross-sensory experiences, there are several cognitive and perceptual differences between synaesthetes and non-synaesthetes. For example, synaesthetes demonstrate enhanced imagery, increased cortical excitability and greater perceptual sensitivity in the concurrent modality. Previous models suggest that synaesthesia results from increased connectivity between corresponding sensory regions or disinhibited feedback from higher cortical areas. While these models explain how one sense can evoke qualitative experiences in another, they fail to predict the broader phenotype of differences observed in synaesthetes. Here, we propose a novel model of synaesthesia based on the principles of stochastic resonance. Specifically, we hypothesize that synaesthetes have greater neural noise in sensory regions, which allows pre-existing multisensory pathways to elicit supra-threshold activation (i.e. synaesthetic experiences). The strengths of this model are (a) it predicts the broader cognitive and perceptual differences in synaesthetes, (b) it provides a unified framework linking developmental and induced synaesthesias, and (c) it explains why synaesthetic associations are inconsistent at onset but stabilize over time. We review research consistent with this model and propose future studies to test its limits. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.