Components of Attention in Grapheme-Color Synesthesia: A Modeling Approach

Shape-color associations in an unrestricted color choice paradigm

Since Kandinsky's claim for fundamental shape-color associations, several studies have revealed that those tendencies were not generalizable to the entire population and that different associations were more prevalent. Past studies, however, lacked a methodology that allowed participants to freely report their shape-color preferences. Here, we report data from 7,517 Danish individuals, using a free choice full color wheel for five different geometrical shapes. We find significant shape-hue associations for circle-red/yellow, triangle-green/yellow, square-blue, and pentagon/hexagon-magenta. The significant shape-hue associations are also more saturated than non-significant ones for the circle, triangle, and square. At the conceptual level, basic shapes, which show stronger associations, are linked to primary colors, and non-basic shapes to secondary colors. Shape-color associations seem indeed to follow the Berlin-Kay stages of entry into languages. This pattern had previously been described for graphemes and weekday-color associations. The methodology employed in our study can be repeated in different cultural contexts in the future. We also provide another instance of color associations for ordinal concepts that follow the stages of entry into languages.

Perceptual Dissimilarity Analysis Distinguishes Grapheme-Color Synesthetes from Nonsynesthetes

Synesthetes can be distinguished from nonsynesthetes on a variety of experimental tasks because their concurrent synesthetic experiences can affect task performance if these experiences match or conflict with some aspect of the stimulus. Here, we tested grapheme-color synesthetes and nonsynesthetic control participants using a novel perceptual similarity task to assess whether synesthetes' concurrent color experiences influence perceived grapheme similarity. Participants iteratively arranged graphemes and, separately, their associated synesthetic colors in a display, such that similar items were placed close together and dissimilar items further apart. The resulting relative inter-item distances were used to calculate the pair-wise (dis)similarity between items in the set, and thence to create separate perceptual representational dissimilarity matrices (RDMs) for graphemes and colors, on an individual basis. On the assumption that synesthetes' similarity judgments for graphemes would be influenced by their concurrent color experiences, we predicted that grapheme and color RDMs would be more strongly correlated for synesthetes than nonsynesthetes. We found that the mean grapheme-color RDM correlation was indeed significantly higher in synesthetes than nonsynesthetes; in addition, synesthetes' grapheme-color RDM correlations were more likely to be individually statistically significant, even after correction for multiple tests, than those of nonsynesthetes. Importantly, synesthetes' grapheme-color RDM correlations were scaled with the consistency of their grapheme-color associations as measured by their Synesthesia Battery (SB) scores. By contrast, the relationship between SB scores and grapheme-color RDM correlations for nonsynesthetes was not significant. Thus, dissimilarity analysis quantitatively distinguished synesthetes from nonsynesthetes, in a way that meaningfully reflects a key aspect of synesthetic experience.

Face-Processing Differences Present in Grapheme-Color Synesthetes

Grapheme‐color synesthesia is a heterogeneous neurological phenomenon whereby the experience of a grapheme automatically and involuntarily elicits an experience of color. While the majority of synesthesia research has focused on inducer‐specific influences of synesthetic associations, more recent efforts have examined potential broader differences. Based on spontaneous reports from synesthetes detailing problems with face recognition, in conjunction with the geographical proximity of neurological regions relevant to both synesthesia and face processing, we sought to examine whether synesthetes demonstrated atypical face‐processing abilities.

A total of 16 grapheme‐color synesthetes and 16 age‐and‐gender matched controls (±3 years) completed the Cambridge Face Memory Test (CFMT; Duchaine & Nakayama, 2006) of face memory, the Vanderbilt Holistic Face Processing Task (VHPT‐F; Richler, Floyd, & Gauthier, 2014) of holistic face processing, as well as a standardized self‐report questionnaire the Faces and Emotions Questionnaire (Freeman, Palermo, & Brock, 2015). The results revealed significantly poorer performance in synesthete's ability to recognize faces in the CFMT that was driven by a reduction in upright advantage. Results also revealed a significant reduction in overall accuracy on the VHPT‐F for synesthetes, who despite this displayed a comparable holistic processing advantage compared to matched controls. Finally, synesthetes also rated themselves as significantly worse at face recognition. We suggest that this pattern may reflect differences in the development of individualized perceptual strategies.

Synaesthetic colour associations for Japanese Kanji characters: from the perspective of grapheme learning

One of the fundamental questions about grapheme-colour synaesthesia is how specific associations between the graphemes and colours are formed. We addressed this question by focusing on the determinants of synaesthetic colours for Japanese Kanji characters (logographic characters) using a psycholinguistic approach. Study 1 explored the influence meaning has on synaesthetic colours for Kanji characters representing abstract meanings by examining synaesthetic colours for antonym pairs (i.e. characters with meanings opposed to each other) in Japanese synaesthetes. Results showed that semantic relations influenced the grapheme-colour associations for characters representing abstract meanings in the early stages of learning abstract Kanji, while the influence was reduced in the grapheme-colour associations for those learned later. Study 2 examined the effect that learning new sounds or meanings of graphemes has on synaesthetic colours for those graphemes. Japanese synaesthetes were taught new sounds or new meanings for familiar Kanji characters. Results indicated that acquiring new information for graphemes slightly but significantly reduced the test-retest grapheme-colour association consistency, suggesting that synaesthetic colours can be modulated to reflect the synaesthete's latest knowledge about graphemes. Implications of these findings are discussed from the perspective of the relationship between synaesthesia and grapheme learning. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

A meta-analysis of memory ability in synaesthesia

People with synaesthesia (e.g., experiencing colours for letters and numbers) have been reported to possess enhanced memory relative to the general population. However, there are also inconsistencies in this literature and it is unclear whether this reflects sampling error (exacerbated by low Ns) or more meaningful differences that arise because synaesthesia relates to some aspects of memory more than others. To this end, a multi-level meta-analysis was conducted. Synaesthetes have enhanced long-term (episodic) memory with a medium population effect size ( dˆ  = 0.61), whereas the effects on working memory (short-term memory) were significantly smaller ( dˆ  = 0.36) but still exceeded that of controls. Moderation analyses suggested that, aside from the division between long-term vs. working memory, the effects of synaesthesia are pervasive, i.e., they extend to all kinds of stimuli, and extend to all kinds of test formats. This pattern is hard to reconcile with the view that synaesthetic experiences directly support memory ability: for instance, digit span (where synaesthesia could be helpful) showed a small effect whereas episodic memory for abstract images (where synaesthesia is irrelevant) yielded larger effects. Synaesthesia occupies a unique position of being the only known neurodevelopmental condition linked to a pervasive enhancement of long-term memory.