Inducing synesthesia in non-synesthetes: Short-term visual deprivation facilitates auditory-evoked visual percepts

Auditory cortex encodes lipreading information through spatially distributed activity

Watching a speaker's face improves speech perception accuracy. This benefit is enabled, in part, by implicit lipreading abilities present in the general population. While it is established that lipreading can alter the perception of a heard word, it is unknown how these visual signals are represented in the auditory system or how they interact with auditory speech representations. One influential, but untested, hypothesis is that visual speech modulates the population-coded representations of phonetic and phonemic features in the auditory system. This model is largely supported by data showing that silent lipreading evokes activity in the auditory cortex, but these activations could alternatively reflect general effects of arousal or attention or the encoding of non-linguistic features such as visual timing information. This gap limits our understanding of how vision supports speech perception. To test the hypothesis that the auditory system encodes visual speech information, we acquired functional magnetic resonance imaging (fMRI) data from healthy adults and intracranial recordings from electrodes implanted in patients with epilepsy during auditory and visual speech perception tasks. Across both datasets, linear classifiers successfully decoded the identity of silently lipread words using the spatial pattern of auditory cortex responses. Examining the time course of classification using intracranial recordings, lipread words were classified at earlier time points relative to heard words, suggesting a predictive mechanism for facilitating speech. These results support a model in which the auditory system combines the joint neural distributions evoked by heard and lipread words to generate a more precise estimate of what was said.

Modern Aspects of the Complex Interactions between Biodiversity and the Main Neuropsychiatric Disorders

The high incidence of psychopathologies recorded in today's human society, correlated with the high percentages of biodiversity loss, point to the need for an interdisciplinary approach of the scientific fields under study-neuroscience and biodiversity conservation. Thus, our approach here presents, in a synergistic manner, the significant correlation between mental health and the increased values of biodiversity in the ecosystems located in the immediate vicinity, especially those located in the middle of cities. Our approach aims to emphasize the importance of biodiversity conservation in the context of preserving mental health and general well-being. There are a series of recent experimental demonstrations that outline the influence of natural elements on the human psyche and, implicitly, the effects of nature in the prevention and reduction of stress, anxiety, and depression. And beyond the cognitive barriers of humanity in relating to the surrounding biodiversity must lie the desire to know the values of biodiversity and the absolute importance of its conservation. The sustainable relationship between humans and living nature, seen as a complex of biodiversity, is dealt with by a branch of science called human ecology. Therefore, this study emphasizes the crucial need to know and respect the connection between man and nature, based, since time immemorial, on biophilia. And with the regression of ignorance and the correlated approach of several scientific fields, some at the intersection of the humanities and natural sciences, one can observe the progress of preserving the dynamic balance within ecosystems and, implicitly, the preservation of mental health and human well-being.

Idiosyncratic spatial representations of the days of the week in individuals without synesthesia

People with spatial sequence synesthesia have clear and stable mental images of spatial arrays of numbers, days of the week, and months. The shapes of the arrays vary by individual. We conducted an experiment to estimate the shapes of spatial arrays in people without synesthesia. We presented a pair of Japanese characters that represent the days of the week on a display, and asked participants without synesthesia to state which day they thought came later by pressing a key that was congruent with the spatial position of the day shown. We then estimated the shape of the spatial array in the participants' mental space (mental weekday lines) from the distribution of the reaction times. We found that these 'estimated mental weekday lines' differed by individual, and that the shapes (straight or bent lines, U-shapes, zigzags, or triangles) were similar to the spatial arrays found in individuals with synesthesia. We then conducted simulations using a self-organizing map and found that differences in the shapes of the spatial arrays compared with those in individuals with synesthesia could be explained by the inputs to the network. These results support the hypothesis that interactions between spatial and ordinal/cardinal representations in both synesthetes and non-synesthetes develop under the influence of self-organizing learning.

Hearing what you see: Distinct excitatory and disinhibitory mechanisms contribute to visually-evoked auditory sensations

Visual motion or flashing lights can evoke auditory sensations in some people. This large-scale internet study aimed to validate a combined subjective/objective test of the genuineness of this putative form of synaesthesia (visually-evoked auditory response, vEAR). Correlations were measured between each individual's ratings of the vividness of auditory sensations evoked by a series of looping videos, and measurement of the videos' physical low-level motion energy, calculated using Adelson and Bergen's (1985) computational model of low-level visual motion processing. The strength of this association for each individual provided a test of how strongly subjective vEAR was driven by objective motion energy ('ME-sensitivity'). A second aim was to infer whether vEAR depends on cortical excitation and/or disinhibition of early visual and/or auditory brain areas. To achieve this, correlations were measured between the above vEAR measures and visual contrast surround-suppression, which is thought to index lateral inhibition in the early visual system. As predicted by a disinhibition account of vEAR, video ratings were overall higher in individuals showing weaker surround-suppression. Interestingly, surround-suppression and ME-sensitivity did not correlate. Additionally, both surround-suppression and ME-sensitivity each independently predicted different clusters of trait measures selected for their possible association with cortical excitability and/or disinhibition: Surround-suppression was associated with vEAR self-ratings and auditory-evoked visual phosphenes, while ME-sensitivity was independently associated with ratings of other traits including susceptibility to migraine and pattern glare. Altogether, these results suggest there are two independent mechanisms underlying vEAR and its associated traits, based putatively on cortical disinhibition versus excitability.

Synesthesia as (Multimodal) Mental Imagery

It has been repeatedly suggested that synesthesia is intricately connected with unusual ways of exercising one's mental imagery, although it is not always entirely clear what the exact connection is. My aim is to show that all forms of synesthesia are forms of (often very different kinds of) mental imagery and, further, if we consider synesthesia to be a form of mental imagery, we get significant explanatory benefits, especially concerning less central cases of synesthesia where the inducer is not sensory stimulation.

Synesthesia and the Perception of Unseen Realities

Exceptional experiences (ExE) incorporate a range of phenomena including subjective paranormal and transpersonal experiences. Synesthesia and synesthetic experiences are discussed as important variables in understanding the etiologies of ExE. The neural and psychological correlates of synesthetic experiences (associated with hyperconnectivity) are discussed in relation to ExE. It is argued that synesthetic processes enable both the detection and conscious perception of information from a range of sources that are usually unseen or inaccessible, including abstract, unlanguaged, preconscious, and potentially other nonlocal sources.

Substantiating synesthesia: a novel aid in a case of grapheme-colour synesthesia and concomitant dyscalculia

Here we present the case of SP, a 21-year-old female with life-long dyscalculia. SP was subsequently diagnosed with grapheme-color synesthesia, a diagnosis that serendipitously catalyzed our development of a novel aid:The digit-color calculator (DCC). The DCC substantiates SP's color concurrents, dramatically ameliorating her difficulties with basic calculations. We envisage the DCC and its analogues may assist others in educational settings, particularly if they experience difficulties with the acquisition of literacy and numeracy. Further devices that leverage synesthesia may also have the potential to improve the quality of life for others with trait synesthesia regardless of concomitant disorder.

Neurophenomenology of induced and natural synaesthesia

People with synaesthesia have additional perceptual experiences, which are automatically and consistently triggered by specific inducing stimuli. Synaesthesia therefore offers a unique window into the neurocognitive mechanisms underlying conscious perception. A long-standing question in synaesthesia research is whether it is possible to artificially induce non-synaesthetic individuals to have synaesthesia-like experiences. Although synaesthesia is widely considered a congenital condition, increasing evidence points to the potential of a variety of approaches to induce synaesthesia-like experiences, even in adulthood. Here, we summarize a range of methods for artificially inducing synaesthesia-like experiences, comparing the resulting experiences to the key hallmarks of natural synaesthesia which include consistency, automaticity and a lack of 'perceptual presence'. We conclude that a number of aspects of synaesthesia can be artificially induced in non-synaesthetes. These data suggest the involvement of developmental and/or learning components in the acquisition of synaesthesia, and they extend previous reports of perceptual plasticity leading to dramatic changes in perceptual phenomenology in adults. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Stochastic resonance model of synaesthesia

In synaesthesia, stimulation of one sensory modality evokes additional experiences in another modality (e.g. sounds evoking colours). Along with these cross-sensory experiences, there are several cognitive and perceptual differences between synaesthetes and non-synaesthetes. For example, synaesthetes demonstrate enhanced imagery, increased cortical excitability and greater perceptual sensitivity in the concurrent modality. Previous models suggest that synaesthesia results from increased connectivity between corresponding sensory regions or disinhibited feedback from higher cortical areas. While these models explain how one sense can evoke qualitative experiences in another, they fail to predict the broader phenotype of differences observed in synaesthetes. Here, we propose a novel model of synaesthesia based on the principles of stochastic resonance. Specifically, we hypothesize that synaesthetes have greater neural noise in sensory regions, which allows pre-existing multisensory pathways to elicit supra-threshold activation (i.e. synaesthetic experiences). The strengths of this model are (a) it predicts the broader cognitive and perceptual differences in synaesthetes, (b) it provides a unified framework linking developmental and induced synaesthesias, and (c) it explains why synaesthetic associations are inconsistent at onset but stabilize over time. We review research consistent with this model and propose future studies to test its limits. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.