Synaesthesia: a distinct entity that is an emergent feature of adaptive neurocognitive differences

Synesthesia is linked to large and extensive differences in brain structure and function as determined by whole-brain biomarkers derived from the HCP (Human Connectome Project) cortical parcellation approach

There is considerable interest in understanding the developmental origins and health implications of individual differences in brain structure and function. In this pre-registered study we demonstrate that a hidden subgroup within the general population-people with synesthesia (e.g. who "hear" colors)-show a distinctive behavioral phenotype and wide-ranging differences in brain structure and function. We assess the performance of 13 different brain-based biomarkers (structural and functional MRI) for classifying synesthetes against general population samples, using machine learning models. The features in these models were derived from subject-specific parcellations of the cortex using the Human Connectome Project approach. All biomarkers performed above chance with intracortical myelin being a particularly strong predictor that has not been implicated in synesthesia before. Resting state data show widespread changes in the functional connectome (including less hub-based connectivity). These brain-based individual differences within the neurotypical population can be as large as those that differentiate neurotypical from clinical brain states.

Subtitled speech: the neural mechanisms of ticker-tape synaesthesia

The acquisition of reading modifies areas of the brain associated with vision and with language, in addition to their connections. These changes enable reciprocal translation between orthography and the sounds and meaning of words. Individual variability in the pre-existing cerebral substrate contributes to the range of eventual reading abilities, extending to atypical developmental patterns, including dyslexia and reading-related synaesthesias. The present study is devoted to the little-studied but highly informative ticker-tape synaesthesia, in which speech perception triggers the vivid and irrepressible perception of words in their written form in the mind's eye. We scanned a group of 17 synaesthetes and 17 matched controls with functional MRI, while they listened to spoken sentences, words, numbers or pseudowords (Experiment 1), viewed images and written words (Experiment 2) or were at rest (Experiment 3). First, we found direct correlates of the ticker-tape synaesthesia phenomenon: during speech perception, as ticker-tape synaesthesia was active, synaesthetes showed over-activation of left perisylvian regions supporting phonology and of the occipitotemporal visual word form area, where orthography is represented. Second, we provided support to the hypothesis that ticker-tape synaesthesia results from atypical relationships between spoken and written language processing: the ticker-tape synaesthesia-related regions overlap closely with cortices activated during reading, and the overlap of speech-related and reading-related areas is larger in synaesthetes than in controls. Furthermore, the regions over-activated in ticker-tape synaesthesia overlap with regions under-activated in dyslexia. Third, during the resting state (i.e. in the absence of current ticker-tape synaesthesia), synaesthetes showed increased functional connectivity between left prefrontal and bilateral occipital regions. This pattern might reflect a lowered threshold for conscious access to visual mental contents and might imply a non-specific predisposition to all synaesthesias with a visual content. These data provide a rich and coherent account of ticker-tape synaesthesia as a non-detrimental developmental condition created by the interaction of reading acquisition with an atypical cerebral substrate.

Induced awareness of synesthetic sensations in synesthetically predisposed "Borderline Non-synesthetes"

A long-standing issue concerning synesthesia is whether the trait is continuous or discontinuous with ordinary perception. Here, we found that a substantial proportion of non-synesthetes (>10 % out of >200 unselected participants) spontaneously became aware of their synesthesia by participating in an online survey that forced them to select colors for stimuli that evoke color sensations in synesthetes. Notably, the test-retest consistencies of color sensation in these non-synesthetes were comparable to those in self-claimed synesthetes, revealing their strong though latent synesthetic dispositions. The effect was absent or weak in a matched control survey that did not include the color-picking test. Therefore, the color-picking task likely provided the predisposed "borderline non-synesthetes" with an opportunity to dwell on their tendency toward synesthesia and allowed their subconscious sensations to become conscious ones. The finding suggests that the general population has a continuum of synesthetic disposition that encompasses both synesthetes and non-synesthetes.

synr: An R package for handling synesthesia consistency test data

Synesthesia is a phenomenon where sensory stimuli or cognitive concepts elicit additional perceptual experiences. For instance, in a commonly studied type of synesthesia, stimuli such as words written in black font elicit experiences of other colors, e.g., red. In order to objectively verify synesthesia, participants are asked to choose colors for repeatedly presented stimuli and the consistency of their choices is evaluated (consistency test). Previously, there has been no publicly available and easy-to-use tool for analyzing consistency test results. Here, the R package synr is introduced, which provides an efficient interface for exploring consistency test data and applying common procedures for analyzing them. Importantly, synr also implements a novel method enabling identification of participants whose scores cannot be interpreted, e.g., who only give black or red color responses. To this end, density-based spatial clustering of applications with noise (DBSCAN) is applied in conjunction with a measure of spread in 3D space. An application of synr with pre-existing openly accessible data illustrating how synr is used in practice is presented. Also included is a comparison of synr's data validation procedure and human ratings, which found that synr had high correspondence with human ratings and outperformed human raters in situations where human raters were easily mislead. Challenges for widespread adoption of synr as well as suggestions for using synr within the field of synesthesia and other areas of psychological research are discussed.

An Open Science MRI Database of over 100 Synaesthetic Brains and Accompanying Deep Phenotypic Information

We provide a neuroimaging database consisting of 102 synaesthetic brains using state-of-the-art 3 T MRI protocols from the Human Connectome Project (HCP) which is freely available to researchers. This database consists of structural (T1- and T2-weighted) images together with approximately 24 minutes of resting state data per participant. These protocols are designed to be inter-operable and reproducible so that others can add to the dataset or directly compare it against other normative or special samples. In addition, we provide a 'deep phenotype' of our sample which includes detailed information about each participant's synaesthesia together with associated clinical and cognitive measures. This behavioural dataset, which also includes data from (N = 109) non-synaesthetes, is of importance in its own right and is openly available.

From Puzzle to Progress: How Engaging With Neurodiversity Can Improve Cognitive Science

In cognitive science, there is a tacit norm that phenomena such as cultural variation or synaesthesia are worthy examples of cognitive diversity that contribute to a better understanding of cognition, but that other forms of cognitive diversity (e.g., autism, attention deficit hyperactivity disorder/ADHD, and dyslexia) are primarily interesting only as examples of deficit, dysfunction, or impairment. This status quo is dehumanizing and holds back much-needed research. In contrast, the neurodiversity paradigm argues that such experiences are not necessarily deficits but rather are natural reflections of biodiversity. Here, we propose that neurodiversity is an important topic for future research in cognitive science. We discuss why cognitive science has thus far failed to engage with neurodiversity, why this gap presents both ethical and scientific challenges for the field, and, crucially, why cognitive science will produce better theories of human cognition if the field engages with neurodiversity in the same way that it values other forms of cognitive diversity. Doing so will not only empower marginalized researchers but will also present an opportunity for cognitive science to benefit from the unique contributions of neurodivergent researchers and communities.

Familial aggregation of synaesthesia with autism (but not schizophrenia)

INTRODUCTION

This study determines whether there is a familial aggregation between synaesthesia and two neuropsychiatric conditions (autism and schizophrenia). METHOD We examined the prevalence of autism and schizophrenia among synaesthetes and non-synaesthetic controls, and among their first-degree relatives.

RESULTS

As predicted, autism occurred at elevated levels among synaesthetes and-we document for the first time-amongst their relatives. This was not found for schizophrenia, where a link may be expected, or in a control condition (type 1 diabetes) where we had no a priori reason to assume a link. Synaesthetes, compared to controls, were also more likely to have other synaesthetes in their family. People with three or more types of synaesthesia were more likely (compared to synaesthetes with fewer types) to have synaesthetic relatives and to report autism in themselves. People with two or more types of synaesthesia (compared to synaesthetes with only one type) were more likely to report familial autism.

CONCLUSIONS

The results suggest a shared genetic predisposition between synaesthesia and autism, and more extreme synaesthetes may tend to hail from more neurodiverse families.

Perceptual processing links autism and synesthesia: A co-twin control study

Synesthesia occurs more commonly in individuals fulfilling criteria for an autism spectrum diagnosis than in the general population. It is associated with autistic traits and autism-related perceptual processing characteristics, including a more detail-focused attentional style and altered sensory sensitivity. In addition, these characteristics correlate with the degree of grapheme-color synesthesia (consistency of grapheme-color associations) in non-synesthetes. We investigated a predominantly non-synesthetic twin sample, including individuals fulfilling criteria for an autism spectrum diagnosis or other neurodevelopmental disorders (n = 65, 14-34 years, 60% female). We modelled linear relationships between the degree of grapheme-color synesthesia and autistic traits, sensory sensitivity, and visual perception, both within-twin pairs (22 pairs) where all factors shared by twins are implicitly controlled (including 50-100% genetics), and across the entire cohort. We found that the degree of grapheme-color synesthesia was associated with autistic traits within the domain of Attention to Details and with sensory hyper-, but not hypo-sensitivity. These associations were stronger within-twin pairs than across the sample. Further, twins with a higher degree of grapheme-color synesthesia were better than their co-twins at identifying fragmented images (Fragmented Pictures Test). This is the first twin study on the association between synesthesia and autism-related perceptual features and traits. The results suggest that investigating these associations within-twin pairs, implicitly adjusting for potential confounding factors shared by twins, is more sensitive than doing so in non-related individuals. Consistent with previous findings, the results suggest an association between the degree of grapheme-color synesthesia and autism-related perceptual features, while utilizing a different measure for sensory sensitivity. The novel finding of enhanced fragmented picture integration in twins with a higher degree of grapheme-color synesthesia challenges the view of a generally more detail-focused attentional style in synesthesia and might be related to enhanced memory or mental imagery in more synesthetic individuals.

Perceiving Music Through the Lens of Synaesthesia and Absolute Pitch

Synaesthesia and absolute pitch (AP) are two rare conditions that occur more frequently within populations of artistic professionals. Current thinking surrounding synaesthesia and AP and their relationship to music perception form the focus of this article. Given that synaesthesia has rarely been discussed in the music literature, the article surveys and consolidates general neurobiological, psychological, and behavioural evidence to summarise what is currently known on this topic, in order to link this back to the conditions that most relate to music. In contrast, research on AP is now well established in the music literature, but the important gap of linking AP to other conditions such as synaesthesia has yet to be fully explored. This article investigates the potential relationship between synaesthesia and AP for musicians who possess both conditions by systematically comparing the definitions, classifications, prevalence, diagnoses, and impacts on music perception of synaesthesia and AP and provides insights into the varying states of the literature and knowledge of both conditions. In so doing, this article aims to facilitate a greater understanding of music and auditory forms of synaesthesia and their interaction with AP and encourage increased research effort on this important topic.

Synaesthesia as a model system for understanding variation in the human mind and brain

The aim of this article is to reposition synaesthesia as model system for understanding variation in the construction of the human mind and brain. People with synaesthesia inhabit a remarkable mental world in which numbers can be coloured, words can have tastes, and music is a visual spectacle. Key questions remain unanswered about why it exists, and how the study of synaesthesia might inform theories of the human mind. This article argues we need to rethink synaesthesia as not just representing exceptional experiences, but as a product of an unusual neurodevelopmental cascade from genes to brain to cognition of which synaesthesia is only one outcome. Specifically, differences in the brains of synaesthetes support a distinctive way of thinking (enhanced memory, imagery etc.) and may also predispose towards particular clinical vulnerabilities. In effect, synaesthesia can act as a paradigmatic example of a neuropsychological approach to individual differences.

Language evolution: examining the link between cross-modality and aggression through the lens of disorders

We demonstrate how two linguistic phenomena, figurative language (implicating cross-modality) and derogatory language (implicating aggression), both demand a precise degree of (dis)inhibition in the same cortico-subcortical brain circuits, in particular cortico-striatal networks, whose connectivity has been significantly enhanced in recent evolution. We examine four cognitive disorders/conditions that exhibit abnormal patterns of (dis)inhibition in these networks: schizophrenia (SZ), autism spectrum disorder (ASD), synaesthesia and Tourette's syndrome (TS), with the goal of understanding why the two phenomena altered reactive aggression and altered cross-modality cluster together in these disorders. Our proposal is that enhanced cross-modality (necessary to support language, in particular metaphoricity) was a result, partly a side-effect, of self-domestication (SD). SD targeted the taming of reactive aggression, but reactive impulses are controlled by the same cortico-subcortical networks that are implicated in cross-modality. We further add that this biological process of SD did not act alone, but was engaged in an intense feedback loop with the cultural emergence of early forms of language/grammar, whose high degree of raw metaphoricity and verbal aggression also contributed to increased brain connectivity and cortical control. Consequently, in conjunction with linguistic expressions serving as approximations/'fossils' of the earliest stages of language, these cognitive disorders/conditions serve as confident proxies of brain changes in language evolution, helping us reconstruct certain crucial aspects of early prehistoric languages and cognition, as well as shed new light on the nature of the disorders. This article is part of the theme issue 'Reconstructing prehistoric languages'.

Synaesthesia and autism: Different developmental outcomes from overlapping mechanisms?

Synaesthesia, a mixing of the senses, is more common in individuals with autism. Here, we review the evidence for the association between synaesthesia and autism with regard to their genetic background, brain connectivity, perception, cognitive mechanisms and their contribution to exceptional talents. Currently, the overlap between synaesthesia and autism is established most convincingly at the level of alterations in sensory sensitivity and perception, with synaesthetes showing autism-like profiles of sensory sensitivity and a bias towards details in perception. Shared features may include a predominance of local over global connectivity in the brain. When autism and synaesthesia co-occur in the same individual, the chance of developing heightened cognitive and memory abilities is increased. We discuss how the same theoretical models could potentially explain both conditions. Given the evidence, we believe the phenotypical overlap between autism and synaesthesia has been established clearly enough to invite future research to confirm overlapping mechanisms.

The Relation Between Autistic Traits, the Degree of Synaesthesia, and Local/Global Visual Perception

Synaesthesia is highly prevalent in autism spectrum disorder. We assessed the relation between the degree of autistic traits (Autism Spectrum Quotient, AQ) and the degree of synaesthesia in a neurotypical population, and hypothesized both are related to a local bias in visual perception. A positive correlation between total AQ scores and the degree of synaesthesia was found, extending previous studies in clinical populations. Consistent with our hypothesis, AQ-attention to detail scores were related to increased performance on an Embedded Figures Task and reduced susceptibility to visual illusions. We found no relation between autistic traits and performance on a motion coherence task, and no relation between synaesthesia and local visual perception. Possibly, this relation is reserved for supra-threshold synaesthetes.