1
|
Borgolte A, Roy M, Sinke C, Wiswede D, Stephan M, Bleich S, Münte TF, Szycik GR. Enhanced attentional processing during speech perception in adult high-functioning autism spectrum disorder: An ERP-study. Neuropsychologia 2021; 161:108022. [PMID: 34530026 DOI: 10.1016/j.neuropsychologia.2021.108022] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Revised: 08/17/2021] [Accepted: 09/09/2021] [Indexed: 12/16/2022]
Abstract
Deficits in audiovisual speech perception have consistently been detected in patients with Autism Spectrum Disorder (ASD). Especially for patients with a highly functional subtype of ASD, it remains uncertain whether these deficits and underlying neural mechanisms persist into adulthood. Research indicates differences in audiovisual speech processing between ASD and healthy controls (HC) in the auditory cortex. The temporal dynamics of these differences still need to be characterized. Thus, in the present study we examined 14 adult subjects with high-functioning ASD and 15 adult HC while they viewed visual (lip movements) and auditory (voice) speech information that was either superimposed by white noise (condition 1) or not (condition 2). Subject's performance was quantified by measuring stimulus comprehension. In addition, event-related brain potentials (ERPs) were recorded. Results demonstrated worse speech comprehension for ASD subjects compared to HC under noisy conditions. Moreover, ERP-analysis revealed significantly higher P2 amplitudes over parietal electrodes for ASD subjects compared to HC.
Collapse
Affiliation(s)
- Anna Borgolte
- Dept. of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany.
| | - Mandy Roy
- Asklepios, Psychiatric Hospital Ochsenzoll, Hamburg, Germany
| | - Christopher Sinke
- Dept. of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Daniel Wiswede
- Dept. of Neurology, University of Lübeck, Lübeck, Germany
| | - Michael Stephan
- Dept. of Psychosomatic Medicine and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Stefan Bleich
- Dept. of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany; Center of Systems Neuroscience, Hanover, Germany
| | - Thomas F Münte
- Dept. of Neurology, University of Lübeck, Lübeck, Germany
| | - Gregor R Szycik
- Dept. of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| |
Collapse
|
2
|
Borgolte A, Bransi A, Seifert J, Toto S, Szycik GR, Sinke C. Audiovisual Simultaneity Judgements in Synaesthesia. Multisens Res 2021; 34:1-12. [PMID: 33984831 DOI: 10.1163/22134808-bja10050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Accepted: 04/07/2021] [Indexed: 11/19/2022]
Abstract
Synaesthesia is a multimodal phenomenon in which the activation of one sensory modality leads to an involuntary additional experience in another sensory modality. To date, normal multisensory processing has hardly been investigated in synaesthetes. In the present study we examine processes of audiovisual separation in synaesthesia by using a simultaneity judgement task. Subjects were asked to indicate whether an acoustic and a visual stimulus occurred simultaneously or not. Stimulus onset asynchronies (SOA) as well as the temporal order of the stimuli were systematically varied. Our results demonstrate that synaesthetes are better in separating auditory and visual events than control subjects, but only when vision leads.
Collapse
Affiliation(s)
- Anna Borgolte
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Carl-Neuberg-Strasse 1, 30625 Hannover, Germany
| | - Ahmad Bransi
- Oberberg Fachklinik Weserbergland, Brede 29, 32699 Extertal-Laßbruch, Germany
| | - Johanna Seifert
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Carl-Neuberg-Strasse 1, 30625 Hannover, Germany
| | - Sermin Toto
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Carl-Neuberg-Strasse 1, 30625 Hannover, Germany
| | - Gregor R Szycik
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Carl-Neuberg-Strasse 1, 30625 Hannover, Germany
| | - Christopher Sinke
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Carl-Neuberg-Strasse 1, 30625 Hannover, Germany
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Division of Clinical Psychology & Sexual Medicine, Hannover Medical School, Carl-Neuberg-Strasse 1, 30625 Hannover, Germany
| |
Collapse
|
3
|
Zerr M, Freihorst C, Schütz H, Sinke C, Müller A, Bleich S, Münte TF, Szycik GR. Brief Sensory Training Narrows the Temporal Binding Window and Enhances Long-Term Multimodal Speech Perception. Front Psychol 2019; 10:2489. [PMID: 31749748 PMCID: PMC6848860 DOI: 10.3389/fpsyg.2019.02489] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2019] [Accepted: 10/22/2019] [Indexed: 11/13/2022] Open
Abstract
Our ability to integrate multiple sensory-based representations of our surrounding supplies us with a more holistic view of our world. There are many complex algorithms our nervous system uses to construct a coherent perception. An indicator to solve this 'binding problem' are the temporal characteristics with the specificity that environmental information has different propagation speeds (e.g., sound and electromagnetic waves) and sensory processing time and thus the temporal relationship of a stimulus pair derived from the same event must be flexibly adjusted by our brain. This tolerance can be conceptualized in the form of the cross-modal temporal binding window (TBW). Several studies showed the plasticity of the TBW and its importance concerning audio-visual illusions, synesthesia, as well as psychiatric disturbances. Using three audio-visual paradigms, we investigated the importance of length (short vs. long) as well as modality (uni- vs. multimodal) of a perceptual training aiming at reducing the TBW in a healthy population. We also investigated the influence of the TBW on speech intelligibility, where participants had to integrate auditory and visual speech information from a videotaped speaker. We showed that simple sensory trainings can change the TBW and are capable of optimizing speech perception at a very naturalistic level. While the training-length had no different effect on the malleability of the TBW, the multisensory trainings induced a significantly stronger narrowing of the TBW than their unisensory counterparts. Furthermore, a narrowing of the TBW was associated with a better performance in speech perception, meaning that participants showed a greater capacity for integrating informations from different sensory modalities in situations with one modality impaired. All effects persisted at least seven days. Our findings show the significance of multisensory temporal processing regarding ecologically valid measures and have important clinical implications for interventions that may be used to alleviate debilitating conditions (e.g., autism, schizophrenia), in which multisensory temporal function is shown to be impaired.
Collapse
Affiliation(s)
- Michael Zerr
- Department of Psychosomatic Medicine and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Christina Freihorst
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Helene Schütz
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Christopher Sinke
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Astrid Müller
- Department of Psychosomatic Medicine and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Stefan Bleich
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Thomas F Münte
- Department of Neurology, University of Lübeck, Lübeck, Germany.,Institute of Psychology II, University of Lübeck, Lübeck, Germany
| | - Gregor R Szycik
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| |
Collapse
|
4
|
Tietze FA, Hundertmark L, Roy M, Zerr M, Sinke C, Wiswede D, Walter M, Münte TF, Szycik GR. Auditory Deficits in Audiovisual Speech Perception in Adult Asperger's Syndrome: fMRI Study. Front Psychol 2019; 10:2286. [PMID: 31649597 PMCID: PMC6795762 DOI: 10.3389/fpsyg.2019.02286] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2019] [Accepted: 09/24/2019] [Indexed: 01/23/2023] Open
Abstract
Audiovisual (AV) integration deficits have been proposed to underlie difficulties in speech perception in Asperger’s syndrome (AS). It is not known, if the AV deficits are related to alterations in sensory processing at the level of unisensory processing or at levels of conjoint multisensory processing. Functional Magnetic-resonance images (MRI) was performed in 16 adult subjects with AS and 16 healthy controls (HC) matched for age, gender, and verbal IQ as they were exposed to disyllabic AV congruent and AV incongruent nouns. A simple semantic categorization task was used to ensure subjects’ attention to the stimuli. The left auditory cortex (BA41) showed stronger activation in HC than in subjects with AS with no interaction regarding AV congruency. This suggests that alterations in auditory processing in unimodal low-level areas underlie AV speech perception deficits in AS. Whether this is signaling a difficulty in the deployment of attention remains to be demonstrated.
Collapse
Affiliation(s)
- Fabian-Alexander Tietze
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Laura Hundertmark
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Mandy Roy
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany.,Asklepios Clinic North - Ochsenzoll, Hamburg, Germany
| | - Michael Zerr
- Department of Psychosomatic Medicine and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Christopher Sinke
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| | - Daniel Wiswede
- Institute of Psychology II, University of Lübeck, Lübeck, Germany.,Department of Neurology, University of Lübeck, Lübeck, Germany
| | - Martin Walter
- Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
| | - Thomas F Münte
- Institute of Psychology II, University of Lübeck, Lübeck, Germany.,Department of Neurology, University of Lübeck, Lübeck, Germany
| | - Gregor R Szycik
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School, Hanover, Germany
| |
Collapse
|
5
|
Császár N, Kapócs G, Bókkon I. A possible key role of vision in the development of schizophrenia. Rev Neurosci 2019; 30:359-379. [PMID: 30244235 DOI: 10.1515/revneuro-2018-0022] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2018] [Accepted: 08/01/2018] [Indexed: 12/12/2022]
Abstract
Based on a brief overview of the various aspects of schizophrenia reported by numerous studies, here we hypothesize that schizophrenia may originate (and in part be performed) from visual areas. In other words, it seems that a normal visual system or at least an evanescent visual perception may be an essential prerequisite for the development of schizophrenia as well as of various types of hallucinations. Our study focuses on auditory and visual hallucinations, as they are the most prominent features of schizophrenic hallucinations (and also the most studied types of hallucinations). Here, we evaluate the possible key role of the visual system in the development of schizophrenia.
Collapse
Affiliation(s)
- Noemi Császár
- Gaspar Karoly University Psychological Institute, H-1091 Budapest, Hungary.,Psychoszomatic Outpatient Department, H-1037 Budapest, Hungary
| | - Gabor Kapócs
- Buda Family Centred Mental Health Centre, Department of Psychiatry and Psychiatric Rehabilitation, St. John Hospital, Budapest, Hungary
| | - István Bókkon
- Psychoszomatic Outpatient Department, H-1037 Budapest, Hungary.,Vision Research Institute, Neuroscience and Consciousness Research Department, 25 Rita Street, Lowell, MA 01854, USA
| |
Collapse
|
6
|
Nair A, Brang D. Inducing synesthesia in non-synesthetes: Short-term visual deprivation facilitates auditory-evoked visual percepts. Conscious Cogn 2019; 70:70-79. [PMID: 30852449 PMCID: PMC6436976 DOI: 10.1016/j.concog.2019.02.006] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2018] [Revised: 02/18/2019] [Accepted: 02/23/2019] [Indexed: 12/19/2022]
Abstract
Sounds can modulate activity in visual cortex, facilitating the detection of visual targets. However, these sound-driven modulations are not thought to evoke conscious visual percepts in the general population. In individuals with synesthesia, however, multisensory interactions do lead to qualitatively different experiences such as sounds evoking flashes of light. Why, if multisensory interactions are present in all individuals, do only synesthetes experience abnormal qualia? Competing models differ in the time required for synesthetic experiences to emerge. The cross-activation model suggests synesthesia arises over months or years from the development of abnormal neural connections. Here we demonstrate that after ∼5 min of visual deprivation, sounds can evoke synesthesia-like percepts (vivid colors and Klüver form-constants) in ∼50% of non-synesthetes. These results challenge aspects of the cross-activation model and suggest that synesthesia exists as a latent feature in all individuals, manifesting when the balance of activity across the senses has been altered.
Collapse
Affiliation(s)
- Anupama Nair
- Department of Psychology, University of Michigan, United States
| | - David Brang
- Department of Psychology, University of Michigan, United States.
| |
Collapse
|
7
|
Ward J. Individual differences in sensory sensitivity: A synthesizing framework and evidence from normal variation and developmental conditions. Cogn Neurosci 2018; 10:139-157. [PMID: 30526338 DOI: 10.1080/17588928.2018.1557131] [Citation(s) in RCA: 47] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
For some people, simple sensory stimuli (e.g., noises, patterns) may reliably evoke intense and aversive reactions. This is common in certain clinical groups (e.g., autism) and varies greatly in the neurotypical population. This paper critically evaluates the concept of individual differences in sensory sensitivity, explores its possible underlying neurobiological basis, and presents a roadmap for future research in this area. A distinction is made between subjective sensory sensitivity (self-reported symptoms); neural sensory sensitivity (the degree of neural activity induced by sensory stimuli); and behavioral sensory sensitivity (detection and discrimination of sensory stimuli). Whereas increased subjective and neural sensory sensitivity are assumed to increase together, the status of behavioral sensory sensitivity depends on the extent to which the increased neural activity is linked to signal or noise. A signal detection framework is presented that offers a unifying framework for exploring sensory sensitivity across different conditions. The framework is discussed, in more concrete terms, by linking it to four existing theoretical accounts of atypical sensory sensitivity (not necessarily mutually exclusive): increased excitation-to-inhibition ratio; predictive coding; increased neural noise; and atypical brain connectivity.
Collapse
Affiliation(s)
- Jamie Ward
- a School of Psychology , University of Sussex , Brighton , UK
| |
Collapse
|
8
|
Dell'Erba S, Brown DJ, Proulx MJ. Synesthetic hallucinations induced by psychedelic drugs in a congenitally blind man. Conscious Cogn 2018; 60:127-132. [PMID: 29549713 DOI: 10.1016/j.concog.2018.02.008] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2017] [Revised: 02/22/2018] [Accepted: 02/23/2018] [Indexed: 10/17/2022]
Abstract
This case report offers rare insights into crossmodal responses to psychedelic drug use in a congenitally blind (CB) individual as a form of synthetic synesthesia. BP's personal experience provides us with a unique report on the psychological and sensory alterations induced by hallucinogenic drugs, including an account of the absence of visual hallucinations, and a compelling look at the relationship between LSD induced synesthesia and crossmodal correspondences. The hallucinatory experiences reported by BP are of particular interest in light of the observation that rates of psychosis within the CB population are extremely low. The phenomenology of the induced hallucinations suggests that experiences acquired through other means, might not give rise to "visual" experiences in the phenomenological sense, but instead gives rise to novel experiences in the other functioning senses.
Collapse
Affiliation(s)
- Sara Dell'Erba
- Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath BA2 7AY, UK
| | - David J Brown
- Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath BA2 7AY, UK
| | - Michael J Proulx
- Crossmodal Cognition Lab, Department of Psychology, University of Bath, Bath BA2 7AY, UK.
| |
Collapse
|
9
|
Bouvet L, Barbier JE, Cason N, Bakchine S, Ehrlé N. When synesthesia and savant abilities are mistaken for hallucinations and delusions: contribution of a cognitive approach for their differential diagnosis. Clin Neuropsychol 2017; 31:1459-1473. [PMID: 28276863 DOI: 10.1080/13854046.2017.1288269] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
OBJECTIVE Schizophrenia is characterized by hallucinations, delusions, disorganized speech and behavior, and other symptoms that cause social or occupational dysfunction. However, some of these symptoms, such as hallucinations and delusions, can be indicative of other phenomena such as synesthesia and savant abilities. The aim of this paper is to highlight how neurological and psychiatric conditions can be confused and how formal neuropsychological evaluations can be necessary to distinguish them. METHOD We report the case of a young woman, VA, who perceived sounds as colors and claimed to have elaborated complex astrophysical reasoning, despite having experienced difficulties at school, especially in mathematics. VA also had difficulties to orient herself, to develop social relationships, and often became confused by daily life situations. These elements were considered as symptoms of schizophrenia. RESULTS Evaluations revealed that VA exhibited savant abilities in astrophysics and colored-hearing synesthesia. We also found evidence of higher-than-average cognitive functioning. CONCLUSIONS In complex cases, neuropsychological and formal evaluations are necessary to establish a differential diagnosis. Moreover, the case highlights the link between synesthesia and savant abilities.
Collapse
Affiliation(s)
- Lucie Bouvet
- a Laboratoire CERPPS (EA 7411) , Université Toulouse Jean Jaurés , Toulouse , France
| | | | - Nia Cason
- c Laboratoire PSITEC (EA 4072) , Université de Lille 3 , Lille , France
| | - Serge Bakchine
- d Service de neurologie, Hôpital Maison-Blanche , Hôpital Universitaire de Reims , Reims , France
| | - Nathalie Ehrlé
- c Laboratoire PSITEC (EA 4072) , Université de Lille 3 , Lille , France.,d Service de neurologie, Hôpital Maison-Blanche , Hôpital Universitaire de Reims , Reims , France
| |
Collapse
|
10
|
Fassnidge C, Cecconi Marcotti C, Freeman E. A deafening flash! Visual interference of auditory signal detection. Conscious Cogn 2017; 49:15-24. [PMID: 28092861 DOI: 10.1016/j.concog.2016.12.009] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2016] [Accepted: 12/09/2016] [Indexed: 10/20/2022]
Abstract
In some people, visual stimulation evokes auditory sensations. How prevalent and how perceptually real is this? 22% of our neurotypical adult participants responded 'Yes' when asked whether they heard faint sounds accompanying flash stimuli, and showed significantly better ability to discriminate visual 'Morse-code' sequences. This benefit might arise from an ability to recode visual signals as sounds, thus taking advantage of superior temporal acuity of audition. In support of this, those who showed better visual relative to auditory sequence discrimination also had poorer auditory detection in the presence of uninformative visual flashes, though this was independent of awareness of visually-evoked sounds. Thus a visually-evoked auditory representation may occur subliminally and disrupt detection of real auditory signals. The frequent natural correlation between visual and auditory stimuli might explain the surprising prevalence of this phenomenon. Overall, our results suggest that learned correspondences between strongly correlated modalities may provide a precursor for some synaesthetic abilities.
Collapse
Affiliation(s)
- Christopher Fassnidge
- Cognitive Neuroscience Research Unit, Department of Psychology, City, University of London, London, UK
| | | | - Elliot Freeman
- Cognitive Neuroscience Research Unit, Department of Psychology, City, University of London, London, UK.
| |
Collapse
|
11
|
Mas-Casadesús A, Gherri E. Ignoring Irrelevant Information: Enhanced Intermodal Attention in Synaesthetes. Multisens Res 2017; 30:253-277. [PMID: 31287079 DOI: 10.1163/22134808-00002566] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Accepted: 03/22/2017] [Indexed: 11/19/2022]
Abstract
Despite the fact that synaesthetes experience additional percepts during their inducer-concurrent associations that are often unrelated or irrelevant to their daily activities, they appear to be relatively unaffected by this potentially distracting information. This might suggest that synaesthetes are particularly good at ignoring irrelevant perceptual information coming from different sensory modalities. To investigate this hypothesis, the performance of a group of synaesthetes was compared to that of a matched non-synaesthete group in two different conflict tasks aimed at assessing participants' abilities to ignore irrelevant information. In order to match the sensory modality of the task-irrelevant distractors (vision) with participants' synaesthetic attentional filtering experience, we tested only synaesthetes experiencing at least one synaesthesia subtype triggering visual concurrents (e.g., grapheme-colour synaesthesia or sequence-space synaesthesia). Synaesthetes and controls performed a classic flanker task (FT) and a visuo-tactile cross-modal congruency task (CCT) in which they had to attend to tactile targets while ignoring visual distractors. While no differences were observed between synaesthetes and controls in the FT, synaesthetes showed reduced interference by the irrelevant distractors of the CCT. These findings provide the first direct evidence that synaesthetes might be more efficient than non-synaesthetes at dissociating conflicting information from different sensory modalities when the irrelevant modality correlates with their synaesthetic concurrent modality (here vision).
Collapse
Affiliation(s)
- Anna Mas-Casadesús
- School of Philosophy, Psychology, and Language Sciences, Department of Psychology, The University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK
| | - Elena Gherri
- School of Philosophy, Psychology, and Language Sciences, Department of Psychology, The University of Edinburgh, 7 George Square, Edinburgh EH8 9JZ, UK
| |
Collapse
|
12
|
Bankieris KR, Bejjanki VR, Aslin RN. Cue Integration for Continuous and Categorical Dimensions by Synesthetes. Multisens Res 2017; 30:207-234. [PMID: 31287069 DOI: 10.1163/22134808-00002559] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2016] [Accepted: 02/16/2017] [Indexed: 11/19/2022]
Abstract
For synesthetes, sensory or cognitive stimuli induce the perception of an additional sensory or cognitive stimulus. Grapheme-color synesthetes, for instance, consciously and consistently experience particular colors (e.g., fluorescent pink) when perceiving letters (e.g., u). As a phenomenon involving multiple stimuli within or across modalities, researchers have posited that synesthetes may integrate sensory cues differently than non-synesthetes. However, findings to date present mixed results concerning this hypothesis, with researchers reporting enhanced, depressed, or normal sensory integration for synesthetes. In this study we quantitatively evaluated the multisensory integration process of synesthetes and non-synesthetes using Bayesian principles, rather than employing multisensory illusions, to make inferences about the sensory integration process. In two studies we investigated synesthetes' sensory integration by comparing human behavior to that of an ideal observer. We found that synesthetes integrated cues for both continuous and categorical dimensions in a statistically optimal manner, matching the sensory integration behavior of controls. These findings suggest that synesthetes and controls utilize similar cue integration mechanisms, despite differences in how they perceive unimodal stimuli.
Collapse
Affiliation(s)
- Kaitlyn R Bankieris
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
| | | | - Richard N Aslin
- Department of Brain and Cognitive Sciences, University of Rochester, Rochester, NY, USA
| |
Collapse
|
13
|
|
14
|
Abstract
Purpose of review Synesthesia is an extraordinary perceptual phenomenon, in which individuals experience unusual percepts elicited by the activation of an unrelated sensory modality or by a cognitive process. Emotional reactions are commonly associated. The condition prompted philosophical debates on the nature of perception and impacted the course of art history. It recently generated a considerable interest among neuroscientists, but its clinical significance apparently remains underevaluated. This review focuses on the recent studies regarding variants of color synesthesia, the commonest form of the condition. Recent findings Synesthesia is commonly classified as developmental and acquired. Developmental forms predispose to changes in primary sensory processing and cognitive functions, usually with better performances in certain aspects and worse in others, and to heightened creativity. Acquired forms of synesthesia commonly arise from drug ingestion or neurological disorders, including thalamic lesions and sensory deprivation (e.g., blindness). Cerebral exploration using structural and functional imaging has demonstrated distinct patterns in cortical activation and brain connectivity for controls and synesthetes. Artworks of affected painters are most illustrative of the nature of synesthetic experiences. Summary Results of the recent investigations on synesthesia offered a remarkable insight into the mechanisms of perception, emotion and consciousness, and deserve attention both from neuroscientists and from clinicians.
Collapse
|
15
|
Sinke C, Neufeld J, Wiswede D, Emrich HM, Bleich S, Münte TF, Szycik GR. N1 enhancement in synesthesia during visual and audio-visual perception in semantic cross-modal conflict situations: an ERP study. Front Hum Neurosci 2014; 8:21. [PMID: 24523689 PMCID: PMC3906591 DOI: 10.3389/fnhum.2014.00021] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2013] [Accepted: 01/10/2014] [Indexed: 11/13/2022] Open
Abstract
Synesthesia entails a special kind of sensory perception, where stimulation in one sensory modality leads to an internally generated perceptual experience of another, not stimulated sensory modality. This phenomenon can be viewed as an abnormal multisensory integration process as here the synesthetic percept is aberrantly fused with the stimulated modality. Indeed, recent synesthesia research has focused on multimodal processing even outside of the specific synesthesia-inducing context and has revealed changed multimodal integration, thus suggesting perceptual alterations at a global level. Here, we focused on audio–visual processing in synesthesia using a semantic classification task in combination with visually or auditory–visually presented animated and in animated objects in an audio–visual congruent and incongruent manner. Fourteen subjects with auditory-visual and/or grapheme-color synesthesia and 14 control subjects participated in the experiment. During presentation of the stimuli, event-related potentials were recorded from 32 electrodes. The analysis of reaction times and error rates revealed no group differences with best performance for audio-visually congruent stimulation indicating the well-known multimodal facilitation effect. We found enhanced amplitude of the N1 component over occipital electrode sites for synesthetes compared to controls. The differences occurred irrespective of the experimental condition and therefore suggest a global influence on early sensory processing in synesthetes.
Collapse
Affiliation(s)
- Christopher Sinke
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School Hanover, Germany ; Department of Neurology, University Medical Center Hamburg-Eppendorf Hamburg, Germany
| | - Janina Neufeld
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School Hanover, Germany ; School of Psychology and Clinical Language Sciences, University of Reading Reading, UK
| | - Daniel Wiswede
- Department of Neurology, University of Lübeck , Lübeck, Germany
| | - Hinderk M Emrich
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School Hanover, Germany
| | - Stefan Bleich
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School Hanover, Germany
| | - Thomas F Münte
- Department of Neurology, University of Lübeck , Lübeck, Germany
| | - Gregor R Szycik
- Department of Psychiatry, Social Psychiatry and Psychotherapy, Hannover Medical School Hanover, Germany
| |
Collapse
|