The Merit of Synesthesia for Consciousness Research

Action, emotion, and music-colour synaesthesia: an examination of sensorimotor and emotional responses in synaesthetes and non-synaesthetes

Synaesthesia has been conceptualised as a joining of sensory experiences. Taking a holistic, embodied perspective, we investigate in this paper the role of action and emotion, testing hypotheses related to (1) changes to action-related qualities of a musical stimulus affect the resulting synaesthetic experience; (2) a comparable relationship exists between music, sensorimotor and emotional responses in synaesthetes and the general population; and (3) sensorimotor responses are more strongly associated with synaesthesia than emotion. 29 synaesthetes and 33 non-synaesthetes listened to 12 musical excerpts performed on a musical instrument they had first-hand experience playing, an instrument never played before, and a deadpan performance generated by notation software, i.e., a performance without expression. They evaluated the intensity of their experience of the music using a list of dimensions that relate to sensorimotor, emotional or synaesthetic sensations. Results demonstrated that the intensity of listeners' responses was most strongly influenced by whether or not music is performed by a human, more so than familiarity with a particular instrument. Furthermore, our findings reveal a shared relationship between emotional and sensorimotor responses among both synaesthetes and non-synaesthetes. Yet it was sensorimotor intensity that was shown to be fundamentally associated with the intensity of the synaesthetic response. Overall, the research argues for, and gives first evidence of a key role of action in shaping the experiences of music-colour synaesthesia.

synr: An R package for handling synesthesia consistency test data

Synesthesia is a phenomenon where sensory stimuli or cognitive concepts elicit additional perceptual experiences. For instance, in a commonly studied type of synesthesia, stimuli such as words written in black font elicit experiences of other colors, e.g., red. In order to objectively verify synesthesia, participants are asked to choose colors for repeatedly presented stimuli and the consistency of their choices is evaluated (consistency test). Previously, there has been no publicly available and easy-to-use tool for analyzing consistency test results. Here, the R package synr is introduced, which provides an efficient interface for exploring consistency test data and applying common procedures for analyzing them. Importantly, synr also implements a novel method enabling identification of participants whose scores cannot be interpreted, e.g., who only give black or red color responses. To this end, density-based spatial clustering of applications with noise (DBSCAN) is applied in conjunction with a measure of spread in 3D space. An application of synr with pre-existing openly accessible data illustrating how synr is used in practice is presented. Also included is a comparison of synr's data validation procedure and human ratings, which found that synr had high correspondence with human ratings and outperformed human raters in situations where human raters were easily mislead. Challenges for widespread adoption of synr as well as suggestions for using synr within the field of synesthesia and other areas of psychological research are discussed.

The advantage of being a synesthete: The behavioral benefits of ticker-tape synesthesia

As first described by Francis Galton, some persons perceive vividly and automatically in their mind's eye the written form of words that they are hearing. This phenomenon, labeled ticker-tape synesthesia (TTS), is thought to reflect an abnormally strong influence of speech processing in language areas on to orthographic representations in the visual cortex. Considering the relevance of TTS for the study of reading acquisition, we looked for objective behavioral advantages or impairments in 22 synesthetes, as compared to 22 matched control participants. In three auditory tasks relying on orthographic working memory (letters counting, backward spelling, and letter shape decision), we predicted and observed better performance in synesthetes than in controls. In two visual tasks (lexical decision and letter decision) with a concurrent auditory stimulation, we predicted that synesthetes should suffer from a larger interference by irrelevant speech than controls, but eventually found no difference between the groups. Those results, which we discuss in relation to orthographic processing, mental imagery, and working memory, promote TTS from pure subjectivity to an experimentally measurable phenomenon.

On the origins and evolution of qualia: An experience-space perspective

This paper elaborates on a proposal for mapping a configuration space for selector circuits (SCs), defined as the subset of neural correlates of consciousness (NCCs) responsible for evoking particular qualia, to its experiential counterpart, experience-space (E-space), as part of an investigation into the nature of conscious experience as it first emerged in evolution. The dimensionality of E-space, meaning the degrees of freedom required to specify the properties of related sets of qualia, is at least two, but the utility of E-space as a hypothetical construct is much enhanced by assuming it is a large dimensional space, with at least several times as many dimensions as there are categories of qualia to occupy them. Phenomenal consciousness can then be represented as having originated as one or more multidimensional ur-experiences that combined multiple forms of experience together. Taking this as a starting point, questions concerning evolutionary sequence can be addressed, including how the quale best suited to a given sensory modality would have been extracted by evolution from a larger set of possibilities, a process referred to here as dimensional sorting, and how phenomenal consciousness would have been experienced in its earliest manifestations. There is a further question as to whether the E-space formulation is meaningful in analytical terms or simply a descriptive device in graphical form, but in either case it provides a more systematic way of thinking about early stages in the evolution of consciousness than relying on narrative and conjecture alone.

Synesthesia and the Perception of Unseen Realities

Exceptional experiences (ExE) incorporate a range of phenomena including subjective paranormal and transpersonal experiences. Synesthesia and synesthetic experiences are discussed as important variables in understanding the etiologies of ExE. The neural and psychological correlates of synesthetic experiences (associated with hyperconnectivity) are discussed in relation to ExE. It is argued that synesthetic processes enable both the detection and conscious perception of information from a range of sources that are usually unseen or inaccessible, including abstract, unlanguaged, preconscious, and potentially other nonlocal sources.

A possible key role of vision in the development of schizophrenia

Based on a brief overview of the various aspects of schizophrenia reported by numerous studies, here we hypothesize that schizophrenia may originate (and in part be performed) from visual areas. In other words, it seems that a normal visual system or at least an evanescent visual perception may be an essential prerequisite for the development of schizophrenia as well as of various types of hallucinations. Our study focuses on auditory and visual hallucinations, as they are the most prominent features of schizophrenic hallucinations (and also the most studied types of hallucinations). Here, we evaluate the possible key role of the visual system in the development of schizophrenia.

Musical pitch classes have rainbow hues in pitch class-color synesthesia

Synesthesia, an anomalous blending of senses in which stimulation of one sensory modality produces sensation in a different modality, provides a unique opportunity to study how multimodal information is represented in the human brain. We investigated how pitch classes (do, re, mi, etc.) are associated with the three dimensions of color (hue, saturation, and value/brightness) in 15 subjects who possessed "pitch class-color synesthesia". Across-subject averaging of reported colors revealed that pitch classes have rainbow hues, beginning with do-red, re-yellow, and so forth, ending with si-violet, accompanied by a decrease in saturation. Enharmonic pitch classes that referred to the same pitch class with a different name produced color sensations according to the name of the base pitch class, e.g., a reddish color for do-sharp and a yellowish color for re-flat. Thus the main factor producing color sensations was the name, not the sound, of the note; behavioral experiments corroborated this interpretation. Pitch class-color synesthesia represents a newly described type of synesthesia that is distinct from the well-known crossmodal association between pitch height and value/brightness. Findings suggest that the two dimensions of musical pitch, pitch class and pitch height, are mapped to the hue-saturation plane and the value/brightness dimension of color, respectively.

Graphemes Sharing Phonetic Features Tend to Induce Similar Synesthetic Colors

Individuals with grapheme-color synesthesia experience idiosyncratic colors when viewing achromatic letters or digits. Despite large individual differences in grapheme-color association, synesthetes tend to associate graphemes sharing a perceptual feature with similar synesthetic colors. Sound has been suggested as one such feature. In the present study, we investigated whether graphemes of which representative phonemes have similar phonetic features tend to be associated with analogous synesthetic colors. We tested five Korean multilingual synesthetes on a color-matching task using graphemes from Korean, English, and Japanese orthography. We then compared the similarity of synesthetic colors induced by those characters sharing a phonetic feature. Results showed that graphemes associated with the same phonetic feature tend to induce synesthetic color in both within- and cross-script analyses. Moreover, this tendency was consistent for graphemes that are not transliterable into each other as well as graphemes that are. These results suggest that it is the perceptual-i.e., phonetic-properties associated with graphemes, not just conceptual associations such as transliteration, that determine synesthetic color.

Hallucinations as top-down effects on perception

The problem of whether and how information is integrated across hierarchical brain networks embodies a fundamental tension in contemporary cognitive neuroscience, and by extension, cognitive neuropsychiatry. Indeed, the penetrability of perceptual processes in a 'top-down' manner by higher-level cognition-a natural extension of hierarchical models of perception-may contradict a strictly modular view of mental organization. Furthermore, some in the cognitive science community have challenged cognitive penetration as an unlikely, if not impossible, process. We review the evidence for and against top-down influences in perception, informed by a predictive coding model of perception and drawing heavily upon the literature of computational neuroimaging. We extend these findings to propose a way in which these processes may be altered in mental illness. We propose that hallucinations - perceptions without stimulus - can be understood as top-down effects on perception, mediated by inappropriate perceptual priors.