Brain networks underlying mental imagery of auditory and visual information

Innovative strategies for managing hallucinations by exploring effects of tDCS on source monitoring abilities

This randomised, crossover, sham-controlled study explored the neural basis of source-monitoring, a crucial cognitive process implicated in schizophrenia. Left superior temporal gyrus (STG) and dorsolateral prefrontal cortex (DLPFC) were the key focus areas. Thirty participants without neurological or psychological disorders underwent offline sham and active tDCS sessions with specific electrode montage targeting the left STG and DLPFC. Source-monitoring tasks, reality monitoring (Hear-Imagine), internal source-monitoring (Say-Imagine), and external source monitoring (Virtual-Real) were administered. Paired t-test and estimation statistics was performed with Graphpad version 10.1.0. The Benjamini-Hochberg procedure was employed to control the false discovery rate in multiple hypothesis testing. A significant improvement in internal source monitoring tasks (p = 0.001, Cohen's d = 0.97) was observed, but reality monitoring tasks demonstrated moderate improvement (p = 0.02, Cohen's d = 0.44). The study provides insights into the neural mechanisms of source monitoring in healthy individuals and proposes tDCS as a therapeutic intervention, laying the foundation for future studies to refine tDCS protocols and develop individualized approaches to address source monitoring deficits in schizophrenia.

Neural Signature of Rhyming Ability During Story Listening in Preschool-Age Children

Purpose: Rhyming is a phonological skill that typically emerges in the preschool-age range. Prosody/rhythm processing involves right-lateralized temporal cortex, yet the neural basis of rhyming ability in young children is unclear. The study objective was to use functional magnetic resonance imaging (fMRI) to quantify neural correlates of rhyming abilities in preschool-age children. Method: Healthy pre-kindergarten child-parent dyads were recruited for a study visit including MRI and the Preschool and Primary Inventory of Phonological Awareness (PIPA) rhyme subtest. MRI included an fMRI task where the child listened to a rhymed and unrhymed story without visual stimuli. fMRI data were processed using the CONN functional connectivity (FC) toolbox, with FC computed between 132 regions of interest (ROI) across the brain. Associations between PIPA score and FC during the rhymed versus unrhymed story were compared accounting for age, sex, and maternal education. Results: In total, 45 children completed MRI (age 54 ± 8 months, 37-63; 19M 26F). Median maternal education was college graduate. FC between ROIs in posterior default mode (imagery) and right fronto-parietal (executive function) networks was more strongly positively associated with PIPA score during the rhymed compared with the unrhymed story [F(2,39) = 10.95, p-FDR = 0.043], as was FC between ROIs in right-sided language (prosody) and dorsal attention networks [F(2,39) = 9.85, p-FDR = 0.044]. Conclusions: Preschool-age children with better rhyming abilities had stronger FC between ROIs supporting attention and prosody and also between ROIs supporting executive function and imagery, suggesting rhyme as a catalyst for attention, visualization, and comprehension. These represent novel neural biomarkers of nascent phonological skills.

A whole-brain neuromark resting-state fMRI analysis of first-episode and early psychosis: Evidence of aberrant cortical-subcortical-cerebellar functional circuitry

Psychosis (including symptoms of delusions, hallucinations, and disorganized conduct/speech) is a main feature of schizophrenia and is frequently present in other major psychiatric illnesses. Studies in individuals with first-episode (FEP) and early psychosis (EP) have the potential to interpret aberrant connectivity associated with psychosis during a period with minimal influence from medication and other confounds. The current study uses a data-driven whole-brain approach to examine patterns of aberrant functional network connectivity (FNC) in a multi-site dataset comprising resting-state functional magnetic resonance images (rs-fMRI) from 117 individuals with FEP or EP and 130 individuals without a psychiatric disorder, as controls. Accounting for age, sex, race, head motion, and multiple imaging sites, differences in FNC were identified between psychosis and control participants in cortical (namely the inferior frontal gyrus, superior medial frontal gyrus, postcentral gyrus, supplementary motor area, posterior cingulate cortex, and superior and middle temporal gyri), subcortical (the caudate, thalamus, subthalamus, and hippocampus), and cerebellar regions. The prominent pattern of reduced cerebellar connectivity in psychosis is especially noteworthy, as most studies focus on cortical and subcortical regions, neglecting the cerebellum. The dysconnectivity reported here may indicate disruptions in cortical-subcortical-cerebellar circuitry involved in rudimentary cognitive functions which may serve as reliable correlates of psychosis.

fNIRS a novel neuroimaging tool to investigate olfaction, olfactory imagery, and crossmodal interactions: a systematic review

Olfaction is understudied in neuroimaging research compared to other senses, but there is growing evidence of its therapeutic benefits on mood and well-being. Olfactory imagery can provide similar health benefits as olfactory interventions. Harnessing crossmodal visual-olfactory interactions can facilitate olfactory imagery. Understanding and employing these cross-modal interactions between visual and olfactory stimuli could aid in the research and applications of olfaction and olfactory imagery interventions for health and wellbeing. This review examines current knowledge, debates, and research on olfaction, olfactive imagery, and crossmodal visual-olfactory integration. A total of 56 papers, identified using the PRISMA method, were evaluated to identify key brain regions, research themes and methods used to determine the suitability of fNIRS as a tool for studying these topics. The review identified fNIRS-compatible protocols and brain regions within the fNIRS recording depth of approximately 1.5 cm associated with olfactory imagery and crossmodal visual-olfactory integration. Commonly cited regions include the orbitofrontal cortex, inferior frontal gyrus and dorsolateral prefrontal cortex. The findings of this review indicate that fNIRS would be a suitable tool for research into these processes. Additionally, fNIRS suitability for use in naturalistic settings may lead to the development of new research approaches with greater ecological validity compared to existing neuroimaging techniques.

Brain Functional Correlates of Resting Hypnosis and Hypnotizability: A Review

This comprehensive review delves into the cognitive neuroscience of hypnosis and variations in hypnotizability by examining research employing functional magnetic resonance imaging (fMRI), positron emission tomography (PET), and electroencephalography (EEG) methods. Key focus areas include functional brain imaging correlations in hypnosis, EEG band oscillations as indicators of hypnotic states, alterations in EEG functional connectivity during hypnosis and wakefulness, drawing critical conclusions, and suggesting future research directions. The reviewed functional connectivity findings support the notion that disruptions in the available integration between different components of the executive control network during hypnosis may correspond to altered subjective appraisals of the agency during the hypnotic response, as per dissociated and cold control theories of hypnosis. A promising exploration avenue involves investigating how frontal lobes' neurochemical and aperiodic components of the EEG activity at waking-rest are linked to individual differences in hypnotizability. Future studies investigating the effects of hypnosis on brain function should prioritize examining distinctive activation patterns across various neural networks.

Visualizing risky situations induces a stronger neural response in brain areas associated with mental imagery and emotions than visualizing non-risky situations

In an fMRI study, we tested the prediction that visualizing risky situations induces a stronger neural response in brain areas associated with mental imagery and emotions than visualizing non-risky and more positive situations. We assumed that processing mental images that allow for "trying-out" the future has greater adaptive importance for risky than non-risky situations, because the former can generate severe negative outcomes. We identified several brain regions that were activated when participants produced images of risky situations and these regions overlap with brain areas engaged in visual, speech, and movement imagery. We also found that producing images of risky situations, in contrast to non-risky situations, was associated with increased neural activation in the insular cortex and cerebellum-the regions involved, among other functions, in emotional processing. Finally, we observed an increased BOLD signal in the cingulate gyrus associated with reward-based decision making and monitoring of decision outcomes. In summary, risky situations increased neural activation in brain areas involved in mental imagery, emotional processing, and decision making. These findings imply that the evaluation of everyday risky situations may be driven by emotional responses that result from mental imagery.

Decoding reveals the neural representation of held and manipulated musical thoughts

Imagine a song you know by heart. With little effort you could sing it or play it vividly in your mind. However, we are only beginning to understand how the brain represents, holds, and manipulates these musical "thoughts". Here, we decoded listened and imagined melodies from MEG brain data (N = 71) to show that auditory regions represent the sensory properties of individual sounds, whereas cognitive control (prefrontal cortex, basal nuclei, thalamus) and episodic memory areas (inferior and medial temporal lobe, posterior cingulate, precuneus) hold and manipulate the melody as an abstract unit. Furthermore, the mental manipulation of a melody systematically changes its neural representation, reflecting the volitional control of auditory images. Our work sheds light on the nature and dynamics of auditory representations and paves the way for future work on neural decoding of auditory imagination.

Neurofeedback-dependent influence of the ventral striatum using a working memory paradigm targeting the dorsolateral prefrontal cortex

Executive functions and motivation have been established as key aspects for neurofeedback success. However, task-specific influence of cognitive strategies is scarcely explored. In this study, we test the ability to modulate the dorsolateral prefrontal cortex, a strong candidate for clinical application of neurofeedback in several disorders with dysexecutive syndrome, and investigate how feedback contributes to better performance in a single session. Participants of both neurofeedback (n = 17) and sham-control (n = 10) groups were able to modulate DLPFC in most runs (with or without feedback) while performing a working memory imagery task. However, activity in the target area was higher and more sustained in the active group when receiving feedback. Furthermore, we found increased activity in the nucleus accumbens in the active group, compared with a predominantly negative response along the block in participants receiving sham feedback. Moreover, they acknowledged the non-contingency between imagery and feedback, reflecting the impact on motivation. This study reinforces DLPFC as a robust target for neurofeedback clinical implementations and enhances the critical influence of the ventral striatum, both poised to achieve success in the self-regulation of brain activity.

Odor imagery but not perception drives risk for food cue reactivity and increased adiposity

Mental imagery has been proposed to play a critical role in the amplification of cravings. Here we tested whether olfactory imagery drives food cue reactivity strength to promote adiposity in 45 healthy individuals. We measured odor perception, odor imagery ability, and food cue reactivity using self-report, perceptual testing, and neuroimaging. Adiposity was assessed at baseline and one year later. Brain responses to real and imagined odors were analyzed with univariate and multivariate decoding methods to identify pattern-based olfactory codes. We found that the accuracy of decoding imagined, but not real, odor quality correlated with a perceptual measure of odor imagery ability and with greater adiposity changes. This latter relationship was mediated by cue-potentiated craving and intake. Collectively, these findings establish odor imagery ability as a risk factor for weight gain and more specifically as a mechanism by which exposure to food cues promotes craving and overeating.

Meta-analytic evidence for a novel hierarchical model of conceptual processing

Conceptual knowledge plays a pivotal role in human cognition. Grounded cognition theories propose that concepts consist of perceptual-motor features represented in modality-specific perceptual-motor cortices. However, it is unclear whether conceptual processing consistently engages modality-specific areas. Here, we performed an activation likelihood estimation (ALE) meta-analysis across 212 neuroimaging experiments on conceptual processing related to 7 perceptual-motor modalities (action, sound, visual shape, motion, color, olfaction-gustation, and emotion). We found that conceptual processing consistently engages brain regions also activated during real perceptual-motor experience of the same modalities. In addition, we identified multimodal convergence zones that are recruited for multiple modalities. In particular, the left inferior parietal lobe (IPL) and posterior middle temporal gyrus (pMTG) are engaged for three modalities: action, motion, and sound. These "trimodal" regions are surrounded by "bimodal" regions engaged for two modalities. Our findings support a novel model of the conceptual system, according to which conceptual processing relies on a hierarchical neural architecture from modality-specific to multimodal areas up to an amodal hub.

Individual-Specific Characterization of Event-Related Hemodynamic Responses during an Auditory Task: An Exploratory Study

Functional near-infrared spectroscopy (fNIRS) has been established as an informative modality for understanding the hemodynamic-metabolic correlates of cortical auditory processing. To date, such knowledge has shown broad clinical applications in the diagnosis, treatment, and intervention procedures in disorders affecting auditory processing; however, exploration of the hemodynamic response to auditory tasks is yet incomplete. This holds particularly true in the context of auditory event-related fNIRS experiments, where preliminary work has shown the presence of valid responses while leaving the need for more comprehensive explorations of the hemodynamic correlates of event-related auditory processing. In this study, we apply an individual-specific approach to characterize fNIRS-based hemodynamic changes during an auditory task in healthy adults. Oxygenated hemoglobin (HbO₂) concentration change time courses were acquired from eight participants. Independent component analysis (ICA) was then applied to isolate individual-specific class discriminative spatial filters, which were then applied to HbO₂ time courses to extract auditory-related hemodynamic features. While six of eight participants produced significant class discriminative features before ICA-based spatial filtering, the proposed method identified significant auditory hemodynamic features in all participants. Furthermore, ICA-based filtering improved correlation between trial labels and extracted features in every participant. For the first time, this study demonstrates hemodynamic features important in experiments exploring auditory processing as well as the utility of individual-specific ICA-based spatial filtering in fNIRS-based feature extraction techniques in auditory experiments. These outcomes provide insights for future studies exploring auditory hemodynamic characteristics and may eventually provide a baseline framework for better understanding auditory response dysfunctions in clinical populations.

Cerebellar Transcranial Direct Current Stimulation Reconfigures Brain Networks Involved in Motor Execution and Mental Imagery

Transcranial direct current stimulation (tDCS) is growingly applied to the cerebellum to modulate the activity of cerebellar circuitry, affecting both motor and cognitive performances in a polarity-specific manner. The remote effects of tDCS are mediated in particular via the dentato-thalamo-cortical pathway. We showed recently that tDCS of the cerebellum exerts dynamic effects on resting state networks. We tested the neural hypothesis that tDCS reconfigurates brain networks involved in motor execution (ME) and motor mental imagery (MMI). We combined tDCS applied over the right cerebellum and fMRI to investigate tDCS-induced reconfiguration of ME- and MMI-related networks using a randomized, sham-controlled design in 21 right-handed healthy volunteers. Subjects were instructed to draw circles at comfortable speed and to imagine drawing circles with their right hand. fMRI data were recorded after real anodal stimulation (1.5 mA, 20 min) or sham tDCS. Real tDCS compared with SHAM specifically reconfigurated the functional links between the main intrinsic connected networks, especially the central executive network, in relation with lobule VII, and the salience network. The right cerebellum mainly influenced prefrontal and anterior cingulate areas in both tasks, and improved the overt motor performance. During MMI, the cerebellum also modulated the default-mode network and associative visual areas. These results demonstrate that tDCS of the cerebellum represents a novel tool to modulate cognitive brain networks controlling motor execution and mental imagery, tuning the activity of remote cortical regions. This approach opens novel doors for the non-invasive neuromodulation of disorders involving cerebello-thalamo-cortical paths.

Erfassung der Lebendigkeit mentaler Vorstellungsbilder

Zusammenfassung. Mentale Vorstellungsfähigkeit bezeichnet ein Konstrukt von enormer Bedeutung für diverse psychische Funktionen (z. B. Motivation, Emotion und Handlungssteuerung). Die Lebendigkeit gilt hierbei als ein zentrales und interindividuell variierendes Merkmal mentaler Vorstellungen. Bislang mangelt es allerdings an validierten deutschsprachigen Fragebögen zur Erfassung der Lebendigkeit. Daher wurden an einer Stichprobe von N = 300 Personen aus der Allgemeinbevölkerung (81 % Studierende) deutschsprachige Versionen des Vividness of Visual Imagery Questionnaire (VVIQ; visuelle Vorstellungen) und des Plymouth Sensory Imagery Questionnaire (PSI-Q; multisensorische Erfassung) adaptiert und validiert. Für den VVIQ und PSI-Q konnten die faktorielle (mittels Exploratory Structural Equation Modeling), konvergente und diskriminante Validität belegt werden. Es ergaben sich akzeptable bis hohe interne Konsistenzen, die Retest-Korrelationen (8 Monate) variierten je nach Subskala. Die Lebendigkeit mentaler Vorstellungen zeigte erwartungskonform negative Zusammenhänge mit Defiziten in der emotionalen Verarbeitung (Alexithymie). Insgesamt stellen die beiden Fragebögen ökonomische, reliable und valide Verfahren dar, um die Lebendigkeit mentaler Vorstellungen zu erfassen.

The role of the primary motor cortex in motor imagery: A theta burst stimulation study

While mentally simulated actions activate similar neural structures to overt movement, the role of the primary motor cortex (PMC) in motor imagery remains disputed. The aim of the study was to use continuous theta burst stimulation (cTBS) to modulate corticospinal activity to investigate the putative role of the PMC in implicit motor imagery in young adults with typical and atypical motor ability. A randomized, double blind, sham‐controlled, crossover, offline cTBS protocol was applied to 35 young adults. During three separate sessions, adults with typical and low motor ability (developmental coordination disorder [DCD]), received active cTBS to the PMC and supplementary motor area (SMA), and sham stimulation to either the PMC or SMA. Following stimulation, participants completed measures of motor imagery (i.e., hand rotation task) and visual imagery (i.e., letter number rotation task). Although active cTBS significantly reduced corticospinal excitability in adults with typical motor ability, neither task performance was altered following active cTBS to the PMC or SMA, compared to performance after sham cTBS. These results did not differ across motor status (i.e., typical motor ability and DCD). These findings are not consistent with our hypothesis that the PMC (and SMA) is directly involved in motor imagery. Instead, previous motor cortical activation observed during motor imagery may be an epiphenomenon of other neurophysiological processes and/or activity within brain regions involved in motor imagery. This study highlights the need to consider multi‐session theta burst stimulation application and its neural effects when probing the putative role of motor cortices in motor imagery.

A controlled continuous theta burst stimulation protocol was adopted to examine the role of the primary motor cortex in motor imagery. While corticospinal excitability was suppressed in individuals with typical motor ability, no changes in imagery performance were detected after applying active stimulation to the motor regions. This suggests that motor regions may not be causally implicated in motor imagery and/or that multiple stimulation sessions may be required when inducing cognitive‐behavioral changes.

Brain networks are decoupled from external stimuli during internal cognition

Our cognition can be directed to external stimuli or to internal information. While there are many different forms of internal cognition (mind-wandering, recall, imagery etc.), their essential feature is independence from the immediate sensory input, conceptually referred to as perceptual decoupling. Perceptual decoupling is thought to be reflected in brain activity transitioning from a stimulus-processing to internally-processing mode, but a direct investigation of this remains outstanding. Here we present a conceptual and analysis framework that quantifies the extent to which brain networks reflect stimulus processing. We tested this framework by presenting subjects with an audiovisual stimulus and instructing them to either attend to the stimulus (external task) or engage in mental imagery, recall or arithmetic (internal tasks) while measuring the evoked brain activity using functional MRI. We found that stimulus responses were generally attenuated for the internal tasks, though they increased in a subset of tasks and brain networks. However, using our new framework, we showed that brain networks became less reflective of stimulus processing, even in the subset of tasks and brain networks in which stimulus responses increased. These results quantitatively demonstrate that during internal cognition brain networks become decoupled from the external stimuli, opening the door for a fundamental and quantitative understanding of internal cognition.

Generating odour imagery enhances brain activity in individuals with low subjective olfactory imagery ability

Olfactory imagery (OI) is defined as the generation of odour images in the mind. There are large inter-individual differences regarding OI abilities. However, the neural representations of OI among individuals with high or low OI abilities are less understood. Participants with high or low OI abilities evaluated using the Vividness of Olfactory Imagery Questionnaire were recruited in this study. Brain activations were measured during a word cueing OI and visual imagery (VI) tasks using functional magnetic resonance imaging (fMRI). In addition, the OI task was divided into two parts. In one part, OI was performed for 8 s (long imagery generation time) and in the other part for 2 s (short imagery generation time). Ratings of the overall imagery vividness were collected at the end of each task. The vividness of OI during short OI was lower among participants with low OI abilities compared to participants with high OI abilities. Brain imaging results showed that participants with low OI ability had stronger brain activation of the supplementary motor area and the superior frontal cortex, compared to participants with higher OI abilities during the short versus long imagery generation time conditions. These results suggest that when generating odour images in a relatively short period of time (e.g., 2 s), people with either high or low OI abilities may have adopted different approaches, resulting in diverse brain activation.

Visual mental imagery: Inside the mind's eyes

What are mental images needed for? A variety of everyday situations calls for us to plan ahead; one of the clever ways our mind prepares and strategizes our next move is through mental simulation. A powerful tool in running these simulations is visual mental imagery, which can be conceived as a way to activate and maintain an internal representation of the to-be-imagined object, giving rise to predictions. Therefore, under normal conditions imagination is primarily an endogenous process, and only more rarely can mental images be activated exogenously, for example, by means of intracerebral stimulation. A large debate is still ongoing regarding the neural substrates supporting mental imagery, with the neuropsychological and neuroimaging literature agreeing in some cases, but not others. This chapter reviews the neuroscientific literature on mental imagery, and attempts to reappraise the neuropsychological and neuroimaging evidence by drawing a model of mental imagery informed by both structural and functional brain data. Overall, the role of regions in the ventral temporal cortex, especially of the left hemisphere, stands out unequivocally as a key substrate in mental imagery.

Transcranial direct current stimulation (tDCS) enhances internal source monitoring abilities in healthy participants

Source monitoring refers to the ability to identify the origin of a memory, for example, whether you remember saying something or thinking about it, and confusions of these sources have been associated with the experience of auditory verbal hallucinations (AVHs). Both AVHs and source confusions are reported to originate from dysfunctional brain activations in the prefrontal cortex (PFC) and the superior temporal gyrus (STG); specifically, it is assumed that a hypoactive PFC and a hyperactive STG gives rise to AVHs and source confusions. We set out to test this assumption by trying to mimic this hypertemporal/hypofrontal model in healthy individuals with transcranial direct current stimulation (tDCS): the inhibitory cathode was placed over the left PFC and the excitatory anode over the left dorsolateral STG. Participants completed a reality monitoring task (distinguishing between external and internal memory sources) and an internal source monitoring task (distinguishing between two or more internal memory sources) in two separate experiments (offline vs. online tDCS). In the offline experiment (n = 34), both source monitoring tasks were completed after tDCS stimulation, and in the online experiment (n = 27) source monitoring tasks were completed while simultaneously being stimulated with tDCS. We found that internal source monitoring abilities were significantly enhanced during active online tDCS, while reality monitoring abilities were unaffected by stimulation in both experiments. We speculate, based on combining the present findings with previous studies, that there might be different brain areas involved in reality and internal source monitoring. While internal source monitoring seems to involve speech production areas, specifically Broca’s area, as suggested in the present study, reality monitoring seems to rely more on the STG and DLPFC, as shown in other studies of the field.

What is the Link Between Mental Imagery and Sensory Sensitivity? Insights from Aphantasia

People with aphantasia have impoverished visual imagery so struggle to form mental pictures in the mind's eye. By testing people with and without aphantasia, we investigate the relationship between sensory imagery and sensory sensitivity (i.e., hyper- or hypo-reactivity to incoming signals through the sense organs). In Experiment 1 we first show that people with aphantasia report impaired imagery across multiple domains (e.g., olfactory, gustatory etc.) rather than simply vision. Importantly, we also show that imagery is related to sensory sensitivity: aphantasics reported not only lower imagery, but also lower sensory sensitivity. In Experiment 2, we showed a similar relationship between imagery and sensitivity in the general population. Finally, in Experiment 3 we found behavioural corroboration in a Pattern Glare Task, in which aphantasics experienced less visual discomfort and fewer visual distortions typically associated with sensory sensitivity. Our results suggest for the very first time that sensory imagery and sensory sensitivity are related, and that aphantasics are characterised by both lower imagery, and lower sensitivity. Our results also suggest that aphantasia (absence of visual imagery) may be more accurately defined as a subtype of a broader imagery deficit we name dysikonesia, in which weak or absent imagery occurs across multiple senses.

Comparing perceptual category learning across modalities in the same individuals

Category learning is a fundamental process in human cognition that spans the senses. However, much still remains unknown about the mechanisms supporting learning in different modalities. In the current study, we directly compared auditory and visual category learning in the same individuals. Thirty participants (22 F; 18-32 years old) completed two unidimensional rule-based category learning tasks in a single day - one with auditory stimuli and another with visual stimuli. We replicated the results in a second experiment with a larger online sample (N = 99, 45 F, 18-35 years old). The categories were identically structured in the two modalities to facilitate comparison. We compared categorization accuracy, decision processes as assessed through drift-diffusion models, and the generalizability of resulting category representation through a generalization test. We found that individuals learned auditory and visual categories to similar extents and that accuracies were highly correlated across the two tasks. Participants had similar evidence accumulation rates in later learning, but early on had slower rates for visual than auditory learning. Participants also demonstrated differences in the decision thresholds across modalities. Participants had more categorical generalizable representations for visual than auditory categories. These results suggest that some modality-general cognitive processes support category learning but also suggest that the modality of the stimuli may also affect category learning behavior and outcomes.

Hemispheric asymmetries in visual mental imagery

Visual mental imagery is the faculty whereby we can "visualize" objects that are not in our line of sight. Longstanding evidence dating back over thirty years has shown that unilateral brain lesions, especially in the left temporal lobe, can impair aspects of this ability. Yet, there is currently no attempt to identify analogies between these neuropsychological findings of hemispheric asymmetry and those from other neuroscientific approaches. Here, we present a critical review of the available literature on the hemispheric laterality of visual mental imagery, by looking at cross-method patterns of evidence in the domains of lesion neuropsychology, neuroimaging, and direct cortical stimulation. Results can be summarized under three main axes. First, frontoparietal networks in both hemispheres appear to be associated with visual mental imagery. Second, lateralization patterns emerge in the temporal lobes, with the left inferior temporal lobe being the most common finding in the literature for endogenously generated images, especially, but not exclusively, when orthographic material is used to ignite imagery. Third, an opposite pattern of hemispheric laterality emerges when visual mental images are induced by exogenous stimulation; direct cortical electrical stimulation tends to produce visual imagery experiences predominantly when applied to the right temporal lobe. These patterns of hemispheric asymmetry are difficult to reconcile with the dominant model of visual mental imagery, which emphasizes the implication of early sensory cortices. They suggest instead that visual mental imagery relies on large-scale brain networks, with a crucial participation of high-level visual regions in the temporal lobes.

Reinforcement of Self-Regulated Brain Activity in Schizophrenia Patients Undergoing Rehabilitation

The experiment was aimed to compare the effects of different forms of rehabilitation applied in patients with schizophrenia. Verification of the obtained results was based on the analysis of the level of cognitive and social functioning of the subjects. For this purpose, the following clinical tools were used: Positive and Negative Syndrome Scale (PANSS), Beck Cognitive Insight Scale (BCIS), Color Trial Test (CTT-1, CTT-2), d2 psychological tests, Acceptance of Illness Scale (AIS), Self-efficacy Scale (GSES), Quantitative Electroencephalogram Biofeedback (QEEG-BF), auditory event-related potentials (ERPs), and serum levels of brain-derived neurotrophic factor (BDNF). The subjects were mentally stable male schizophrenia patients who had been in remission. They were divided into two groups which received different types of rehabilitation for three months. Group 1 patients followed a standard rehabilitation and Group 2 patients received GSR Biofeedback (galvanic skin response Biofeedback, GSR-BF) training. Pretherapy and posttherapy measurements were made for each group. Experimental rehabilitation based on GSR-BF training resulted in regulatory control of neurophysiological mechanisms, and the parameters obtained demonstrated improvement in the subjects' cognitive and social function. The following therapy outcomes were observed: (1) reduce psychopathological symptoms (2) improving cognitive (concentration, attention) and social functions (3) increase in the neurotrophic factor BDNF. GSR-BF can be used as an alternative to conventional rehabilitation in schizophrenia patients.

Visual mental imagery engages the left fusiform gyrus, but not the early visual cortex: A meta-analysis of neuroimaging evidence

The dominant neural model of visual mental imagery (VMI) stipulates that memories from the medial temporal lobe acquire sensory features in early visual areas. However, neurological patients with damage restricted to the occipital cortex typically show perfectly vivid VMI, while more anterior damages extending into the temporal lobe, especially in the left hemisphere, often cause VMI impairments. Here we present two major results reconciling neuroimaging findings in neurotypical subjects with the performance of brain-damaged patients: (1) A large-scale meta-analysis of 46 fMRI studies, of which 27 investigated specifically visual mental imagery, revealed that VMI engages fronto-parietal networks and a well-delimited region in the left fusiform gyrus. (2) A Bayesian analysis showed no evidence for imagery-related activity in early visual cortices. We propose a revised neural model of VMI that draws inspiration from recent cytoarchitectonic and lesion studies, whereby fronto-parietal networks initiate, modulate, and maintain activity in a core temporal network centered on the fusiform imagery node, a high-level visual region in the left fusiform gyrus.

Aphantasia: The science of visual imagery extremes

Visual imagery allows us to revisit the appearance of things in their absence and to test out virtual combinations of sensory experience. Visual imagery has been linked to many cognitive processes, such as autobiographical and visual working memory. Imagery also plays symptomatic and mechanistic roles in neurologic and mental disorders and is utilized in treatment. A large network of brain activity spanning frontal, parietal, temporal, and visual cortex is involved in generating and maintain images in mind. The ability to visualize has extreme variations, ranging from completely absent (aphantasia) to photo-like (hyperphantasia). The anatomy and functionality of visual cortex, including primary visual cortex, have been associated with individual differences in visual imagery ability, pointing to a potential correlate for both aphantasia and hyperphantasia. Preliminary evidence suggests that lifelong aphantasia is associated with prosopagnosia and reduction in autobiographical memory; hyperphantasia is associated with synesthesia. Aphantasic individuals can also be highly imaginative and are able to complete many tasks that were previously thought to rely on visual imagery, demonstrating that visualization is only one of many ways of representing things in their absence. The study of extreme imagination reminds us how easily invisible differences can escape detection.

Breaking down the cocktail party: Attentional modulation of cerebral audiovisual speech processing

Recent studies utilizing electrophysiological speech envelope reconstruction have sparked renewed interest in the cocktail party effect by showing that auditory neurons entrain to selectively attended speech. Yet, the neural networks of attention to speech in naturalistic audiovisual settings with multiple sound sources remain poorly understood. We collected functional brain imaging data while participants viewed audiovisual video clips of lifelike dialogues with concurrent distracting speech in the background. Dialogues were presented in a full-factorial design, comprising task (listen to the dialogues vs. ignore them), audiovisual quality and semantic predictability. We used univariate analyses in combination with multivariate pattern analysis (MVPA) to study modulations of brain activity related to attentive processing of audiovisual speech. We found attentive speech processing to cause distinct spatiotemporal modulation profiles in distributed cortical areas including sensory and frontal-control networks. Semantic coherence modulated attention-related activation patterns in the earliest stages of auditory cortical processing, suggesting that the auditory cortex is involved in high-level speech processing. Our results corroborate views that emphasize the dynamic nature of attention, with task-specificity and context as cornerstones of the underlying neuro-cognitive mechanisms.

Cognitive and Social Rehabilitation in Schizophrenia-From Neurophysiology to Neuromodulation. Pilot Study

The aim of this pilot study was to analyse the influence of Galvanic Skin Response (GSR) Biofeedback training in a group of 18 men with schizophrenia at the remission stage. The results were verified according to: Positive and Negative Syndrome Scale (PANSS), Acceptance of Illness Scale (AIS), Self-efficacy Scale (GSES), Beck Cognitive Insight Scale (BCIS) scales, Colour Trial Test (CTT-1, CTT-2), d2 psychological tests, Quantitative Electroencephalogram (QEEG) Biofeedback, auditory event-related potentials (ERPs), and serum levels of brain-derived neurotrophic factor (BDNF). The results were compared in the same patients after 3 months. Statistically significant changes were noted in results for the variables on the PANSS scale. For the BDNF variable, a statistically significant increase occurred, indicating that GSR Biofeedback training may influence serum levels of the neurotrophic factor. Statistically significant changes were noted in results for the variables on the BCIS, AIS, and GSES indicating an improvement in the cognitive and social functioning. Changes were noted for results for theta/beta and theta/Sensory Motor Rhythm (SMR) ratios, which indicate an improvement in concentration and attention. Changes were noted for the N1 wave amplitude in the frontal brain region (F-z), and for the P2 wave latency in the central brain region (C-z), which indicates an improvement in the initial perceptual analysis. The use of GSR Biofeedback in a group of patients with schizophrenia gives interesting results, but requires further in-depth research.

Neural Decoding of Multi-Modal Imagery Behavior Focusing on Temporal Complexity

Mental imagery behaviors of various modalities include visual, auditory, and motor behaviors. Their alterations are pathologically involved in various psychiatric disorders. Results of earlier studies suggest that imagery behaviors are correlated with the modulated activities of the respective modality-specific regions and the additional activities of supramodal imagery-related regions. Additionally, despite the availability of complexity analysis in the neuroimaging field, it has not been used for neural decoding approaches. Therefore, we sought to characterize neural oscillation related to multimodal imagery through complexity-based neural decoding. For this study, we modified existing complexity measures to characterize the time evolution of temporal complexity. We took magnetoencephalography (MEG) data of eight healthy subjects as they performed multimodal imagery and non-imagery tasks. The MEG data were decomposed into amplitude and phase of sub-band frequencies by Hilbert-Huang transform. Subsequently, we calculated the complexity values of each reconstructed time series, along with raw data and band power for comparison, and applied these results as inputs to decode visual perception (VP), visual imagery (VI), motor execution (ME), and motor imagery (MI) functions. Consequently, intra-subject decoding with the complexity yielded a characteristic sensitivity map for each task with high decoding accuracy. The map is inverted in the occipital regions between VP and VI and in the central regions between ME and MI. Additionally, replacement of the labels into two classes as imagery and non-imagery also yielded better classification performance and characteristic sensitivity with the complexity. It is particularly interesting that some subjects showed characteristic sensitivities not only in modality-specific regions, but also in supramodal regions. These analyses indicate that two-class and four-class classifications each provided better performance when using complexity than when using raw data or band power as input. When inter-subject decoding was used with the same model, characteristic sensitivity maps were also obtained, although their decoding performance was lower. Results of this study underscore the availability of complexity measures in neural decoding approaches and suggest the possibility of a modality-independent imagery-related mechanism. The use of time evolution of temporal complexity in neural decoding might extend our knowledge of the neural bases of hierarchical functions in the human brain.

Musical imagery depends upon coordination of auditory and sensorimotor brain activity

Recent magnetoencephalography (MEG) studies have established that sensorimotor brain rhythms are strongly modulated during mental imagery of musical beat and rhythm, suggesting that motor regions of the brain are important for temporal aspects of musical imagery. The present study examined whether these rhythms also play a role in non-temporal aspects of musical imagery including musical pitch. Brain function was measured with MEG from 19 healthy adults while they performed a validated musical pitch imagery task and two non-imagery control tasks with identical temporal characteristics. A 4-dipole source model probed activity in bilateral auditory and sensorimotor cortices. Significantly greater β-band modulation was found during imagery compared to control tasks of auditory perception and mental arithmetic. Imagery-induced β-modulation showed no significant differences between auditory and sensorimotor regions, which may reflect a tightly coordinated mode of communication between these areas. Directed connectivity analysis in the θ-band revealed that the left sensorimotor region drove left auditory region during imagery onset. These results add to the growing evidence that motor regions of the brain are involved in the top-down generation of musical imagery, and that imagery-like processes may be involved in musical perception.

Imagining Sounds and Images: Decoding the Contribution of Unimodal and Transmodal Brain Regions to Semantic Retrieval in the Absence of Meaningful Input

In the absence of sensory information, we can generate meaningful images and sounds from representations in memory. However, it remains unclear which neural systems underpin this process and whether tasks requiring the top–down generation of different kinds of features recruit similar or different neural networks. We asked people to internally generate the visual and auditory features of objects, either in isolation (car, dog) or in specific and complex meaning-based contexts (car/dog race). Using an fMRI decoding approach, in conjunction with functional connectivity analysis, we examined the role of auditory/visual cortex and transmodal brain regions. Conceptual retrieval in the absence of external input recruited sensory and transmodal cortex. The response in transmodal regions—including anterior middle temporal gyrus—was of equal magnitude for visual and auditory features yet nevertheless captured modality information in the pattern of response across voxels. In contrast, sensory regions showed greater activation for modality-relevant features in imagination (even when external inputs did not differ). These data are consistent with the view that transmodal regions support internally generated experiences and that they play a role in integrating perceptual features encoded in memory.

Neural tracking of speech mental imagery during rhythmic inner counting

The subjective inner experience of mental imagery is among the most ubiquitous human experiences in daily life. Elucidating the neural implementation underpinning the dynamic construction of mental imagery is critical to understanding high-order cognitive function in the human brain. Here, we applied a frequency-tagging method to isolate the top-down process of speech mental imagery from bottom-up sensory-driven activities and concurrently tracked the neural processing time scales corresponding to the two processes in human subjects. Notably, by estimating the source of the magnetoencephalography (MEG) signals, we identified isolated brain networks activated at the imagery-rate frequency. In contrast, more extensive brain regions in the auditory temporal cortex were activated at the stimulus-rate frequency. Furthermore, intracranial stereotactic electroencephalogram (sEEG) evidence confirmed the participation of the inferior frontal gyrus in generating speech mental imagery. Our results indicate that a disassociated neural network underlies the dynamic construction of speech mental imagery independent of auditory perception.

Externalization Errors of Olfactory Source Monitoring in Healthy Controls-An fMRI Study

Using a combined approach of functional magnetic resonance imaging (fMRI) and noninvasive brain stimulation (transcranial direct current stimulation [tDCS]), the present study investigated source memory and its link to mental imagery in the olfactory domain, as well as in the auditory domain. Source memory refers to the knowledge of the origin of mental experiences, differentiating events that have occurred and memories of imagined events. Because of a confusion between internally generated and externally perceived information, patients that are prone to hallucinations show decreased source memory accuracy; also, vivid mental imagery can lead to similar results in healthy controls. We tested source memory following cathodal tDCS stimulation using a mental imagery task, which required participants to perceive or imagine a set of the same olfactory and auditory stimuli during fMRI. The supplementary motor area (SMA) is involved in mental imagery across different modalities and potentially linked to source memory. Therefore, we attempted to modulate participants' SMA activation before entering the scanner using tDCS to influence source memory accuracy in healthy participants. Our results showed the same source memory accuracy between the olfactory and auditory modalities with no effects of stimulation. Finally, we found SMA's subregions differentially involved in olfactory and auditory imagery, with activation of dorsal SMA correlated with auditory source memory.

Neural basis of romantic partners' decisions about participation in leisure activity

Leisure activity is one of key ingredients for individual happiness and life satisfaction. Enjoying leisure activity with one’s partner can increase marital satisfaction. This study aimed to identify the neural basis of making decisions on participation in a leisure activity with one’s romantic partner as well as the relationship between leisure activity and satisfaction with life. Thirty-seven soon-to-be married heterosexual couples were participated in functional MRI while deciding participation in specific leisure activities in the individual, partner, with-friend, and with-partner conditions. We constructed analysis of variance models and investigated couple characteristics such as personality similarity, leisure activity matching rate, and spatial similarity in the bilateral frontoparietal network. The results showed decreased activity in the bilateral hippocampus during the task in the with-partner condition. Individual leisure activity was correlated with quality of life in males, whereas participation in leisure activity might require more cognitive loading on the dorsolateral prefrontal cortex in females. The leisure activity matching rate was correlated with courtship period, personality similarity, and spatial similarity of the right frontoparietal network during the task. These findings suggest that although there are different activation pattern in making decisions on leisure activity between romantic couples, spatial similarity of the partner’s social brain networks may be a marker that predicts how well the couple enjoys leisure activity together. In addition, our couples’ data analysis provides a scientific basis for the saying that romantic couples become more similar the longer they are together.

Stimulation of the Angular Gyrus Improves the Level of Consciousness

Background: Navigated repetitive transcranial magnetic stimulation (rTMS) is a promising tool for neuromodulation. In previous studies it has been shown that the activity of the default mode network (DMN) areas, particularly of its key region—the angular gyrus—is positively correlated with the level of consciousness. Our study aimed to explore the effect of rTMS of the angular gyrus as a new approach for disorders of consciousness (DOC) treatment; Methods: A 10-session 2-week high-frequency rTMS protocol was delivered over the left angular gyrus in 38 DOC patients with repeated neurobehavioral assessments obtained at baseline and in 2 days after the stimulation course was complete; Results: 20 Hz-rTMS over left angular gyrus improved the coma recovery scale revised (CRS-R) total score in minimally conscious state (MCS) patients. We observed no effects in vegetative state (VS) patients; and Conclusions: The left angular gyrus is likely to be effective target for rTMS in patients with present signs of consciousness.

Common cortical areas involved in both auditory and visual imageries for novel stimuli

We examine cross-modality commonalities in visual and auditory imageries during fMRI scanning in a sample of healthy young adults. In a visual task combining viewed and imagined stimuli, 28 participants were asked to imagine novel scenes related to the other images, and in a similar auditory task combining heard and imagined stimuli, to imagine novel sentences spoken by individuals they had heard speaking previously. We identified a common set of regions in medial and lateral Brodmann area 6, as well as inferior frontal gyrus (BA 44/45), partially supporting previous meta-analytic results. Comparing individuals with high or low reported imagery ability, we replicated a previous result showing individuals with lower visual imagery ability showed greater activation in the cerebellum, frontal and dorsolateral prefrontal cortex, while there was no relationship with auditory imagery ability in this sample. The emphasis on imagining novel stimuli, rather than familiar or previously experienced stimuli, confirms the role of the supramodal imagery network underlying creative imagery.

Interaction of the effects associated with auditory-motor integration and attention-engaging listening tasks

A number of previous studies have implicated regions in posterior auditory cortex (AC) in auditory-motor integration during speech production. Other studies, in turn, have shown that activation in AC and adjacent regions in the inferior parietal lobule (IPL) is strongly modulated during active listening and depends on task requirements. The present fMRI study investigated whether auditory-motor effects interact with those related to active listening tasks in AC and IPL. In separate task blocks, our subjects performed either auditory discrimination or 2-back memory tasks on phonemic or nonphonemic vowels. They responded to targets by either overtly repeating the last vowel of a target pair, overtly producing a given response vowel, or by pressing a response button. We hypothesized that the requirements for auditory-motor integration, and the associated activation, would be stronger during repetition than production responses and during repetition of nonphonemic than phonemic vowels. We also hypothesized that if auditory-motor effects are independent of task-dependent modulations, then the auditory-motor effects should not differ during discrimination and 2-back tasks. We found that activation in AC and IPL was significantly modulated by task (discrimination vs. 2-back), vocal-response type (repetition vs. production), and motor-response type (vocal vs. button). Motor-response and task effects interacted in IPL but not in AC. Overall, the results support the view that regions in posterior AC are important in auditory-motor integration. However, the present study shows that activation in wide AC and IPL regions is modulated by the motor requirements of active listening tasks in a more general manner. Further, the results suggest that activation modulations in AC associated with attention-engaging listening tasks and those associated with auditory-motor performance are mediated by independent mechanisms.

The vividness of imagining emotional feelings in positive situations is attenuated in non-clinical dysphoria and predicts the experience of positive emotional feelings

OBJECTIVE

The vividness of imagining emotional feelings in positive situations (EFP) in non-clinically dysphoric and non-dysphoric individuals and its relation to dysphoric and positive feelings was examined.

METHOD

Participants were university students in Study 1 (N = 106, 84 women; 18-45 years), in Study 2 (N = 43, 39 women; 20-47 years), in Study 3 (N = 109, 92 women; 18-50 years) who filled out a set of questionnaires assessing depressive symptoms, cognition measures, and then completed an affective imagery task, using a cross-sectional design.

RESULTS

Non-clinically dysphoric participants imagined less vividly EFP than non-dysphoric participants. The vividness of imagining EFP accounted for group differences in positive feelings beyond positive and negative cognition and negative mood.

CONCLUSIONS

In addition to deficits in the general imagery of positive events, the attenuation of vividness of EFP in non-clinical dysphoric individuals warrants attention as a separate pathway by which non-clinically dysphoric individuals develop deficiencies of conscious positive feelings.

The role of hippocampus in the retrieval of autobiographical memories in patients with amnestic Mild Cognitive Impairment due to Alzheimer's disease

The role of the hippocampus and neocortical areas in the retrieval of past memories in pre-dementia Alzheimer's disease (AD) patients was investigated. The aim was to assess whether the hippocampus has a temporary role in memory trace formation, according to the Cortical Reallocation Theory (CRT), or whether it continuously updates and enriches memories, according to the Multiple Trace Theory. According to the former theory, hippocampal damage should affect more recent memories, whereas the association cortex is expected to affect memories of the entire lifespan. In the second case, damage to either the hippocampus or the association cortices should affect memories of the entire lifespan. Seventeen patients with amnestic Mild Cognitive Impairment due to AD were submitted to autobiographical (i.e., episodic and semantic personal) memory assessment. Patients underwent MRI for the acquisition of T1-weighted brain volumes. Voxel-based morphometry was used to assess correlations between grey matter (GM) volumes and autobiographical memory. Correlation analyses revealed a strict association between GM volumes in the hippocampus and patients' ability to retrieve the most recent but not the oldest autobiographical memories in both aspects, episodic and semantic. Moreover, patients' GM volumes in the pre-frontal and temporal polar areas were associated with recollection of episodic and semantic events, respectively. Finally, GM volumes in the precuneus and occipital cortex were associated with retrieval of the most recent episodic events. These findings indicate that the hippocampus has a specific time-dependent role; thus, they support the CRT.

My Action, My Self: Recognition of Self-Created but Visually Unfamiliar Dance-Like Actions From Point-Light Displays

Previous research has shown that motor experience of an action can facilitate the visual recognition of that action, even in the absence of visual experience. We conducted an experiment in which participants were presented point-light displays of dance-like actions that had been recorded with the same group of participants during a previous session. The stimuli had been produced with the participant in such a way that each participant experienced a subset of phrases only as observer, learnt two phrases from observation, and created one phrase while blindfolded. The clips presented in the recognition task showed movements that were either unfamiliar, only visually familiar, familiar from observational learning and execution, or self-created while blind-folded (and hence not visually familiar). Participants assigned all types of movements correctly to the respective categories, showing that all three ways of experiencing the movement (observed, learnt through observation and practice, and created blindfolded) resulted in an encoding that was adequate for recognition. Observed movements showed the lowest level of recognition accuracy, whereas the accuracy of assigning blindfolded self-created movements was on the same level as for unfamiliar and learnt movements. Self-recognition was modulated by action recognition, as participants were more likely to identify themselves as the actor in clips they had assigned to the category "created" than in clips they had assigned to the category "learnt," supporting the idea of an influence of agency on self-recognition.

Investigating the roles of medial prefrontal and superior temporal cortex in source monitoring

Source monitoring, or the ability to recall the origin of information, is a crucial aspect of remembering past experience. One facet of this, reality monitoring, refers to the ability to distinguish between internally generated and externally generated information, biases in which have previously been associated with auditory verbal hallucinations in schizophrenia. Neuroimaging evidence suggests that medial prefrontal and superior temporal (STG) regions may play a role in reality monitoring for auditory verbal information, with evidence from a previous neurostimulation experiment also suggesting that modulation of excitability in STG may affect reality monitoring task performance. Here, two experiments are reported that used transcranial direct current stimulation (tDCS) to modulate excitability in medial prefrontal and superior temporal cortex, to further investigate the role of these brain regions in reality monitoring. In the first experiment (N = 36), tDCS was applied during the encoding stage of the task, while in the second experiment, in a separate sample (N = 36), it was applied during the test stage. There was no effect of tDCS compared to a sham condition in either experiment, with Bayesian analysis providing evidence for the null hypothesis in both cases. This suggests that tDCS applied to superior temporal or medial prefrontal regions may not affect reality monitoring performance, and has implications for theoretical models that link reality monitoring to the therapeutic effect of tDCS on auditory verbal hallucinations.

Prominent Changes in Cerebro-Cerebellar Functional Connectivity During Continuous Cognitive Processing

While task-dependent responses of specific brain areas during cognitive tasks are well established, much less is known about the changes occurring in resting state networks (RSNs) in relation to continuous cognitive processing. In particular, the functional involvement of cerebro-cerebellar loops connecting the posterior cerebellum to associative cortices, remains unclear. In this study, 22 healthy volunteers underwent a multi-session functional magnetic resonance imaging (fMRI) protocol composed of four consecutive 8-min resting state fMRI (rs-fMRI) scans. After a first control scan, participants listened to a narrated story for the entire duration of the second rs-fMRI scan; two further rs-fMRI scans followed the end of story listening. The story plot was purposely designed to stimulate specific cognitive processes that are known to involve the cerebro-cerebellar loops. Almost all of the identified 15 RSNs showed changes in functional connectivity (FC) during and for several minutes after the story. The FC changes mainly occurred in the frontal and prefrontal cortices and in the posterior cerebellum, especially in Crus I-II and lobule VI. The FC changes occurred in cerebellar clusters belonging to different RSNs, including the cerebellar network (CBLN), sensory networks (lateral visual network, LVN; medial visual network, MVN) and cognitive networks (default mode network, DMN; executive control network, ECN; right and left ventral attention networks, RVAN and LVAN; salience network, SN; language network, LN; and working memory network, WMN). Interestingly, a k-means analysis of FC changes revealed clustering of FCN, ECN, and WMN, which are all involved in working memory functions, CBLN, DMN, and SN, which play a key-role in attention switching, and RSNs involved in visual imagery. These results show that the cerebellum is deeply entrained in well-structured network clusters, which reflect multiple aspects of cognitive processing, during and beyond the conclusion of auditory stimulation.

Mental Imagery Follows Similar Cortical Reorganization as Perception: Intra-Modal and Cross-Modal Plasticity in Congenitally Blind

Cortical plasticity in congenitally blind individuals leads to cross-modal activation of the visual cortex and may lead to superior perceptual processing in the intact sensory domains. Although mental imagery is often defined as a quasi-perceptual experience, it is unknown whether it follows similar cortical reorganization as perception in blind individuals. In this study, we show that auditory versus tactile perception evokes similar intra-modal discriminative patterns in congenitally blind compared with sighted participants. These results indicate that cortical plasticity following visual deprivation does not influence broad intra-modal organization of auditory and tactile perception as measured by our task. Furthermore, not only the blind, but also the sighted participants showed cross-modal discriminative patterns for perception modality in the visual cortex. During mental imagery, both groups showed similar decoding accuracies for imagery modality in the intra-modal primary sensory cortices. However, no cross-modal discriminative information for imagery modality was found in early visual cortex of blind participants, in contrast to the sighted participants. We did find evidence of cross-modal activation of higher visual areas in blind participants, including the representation of specific-imagined auditory features in visual area V4.

fMRI-based Multivariate Pattern Analyses Reveal Imagery Modality and Imagery Content Specific Representations in Primary Somatosensory, Motor and Auditory Cortices

Previous studies have shown that the early visual cortex contains content-specific representations of stimuli during visual imagery, and that these representational patterns of imagery content have a perceptual basis. To date, there is little evidence for the presence of a similar organization in the auditory and tactile domains. Using fMRI-based multivariate pattern analyses we showed that primary somatosensory, auditory, motor, and visual cortices are discriminative for imagery of touch versus sound. In the somatosensory, motor and visual cortices the imagery modality discriminative patterns were similar to perception modality discriminative patterns, suggesting that top-down modulations in these regions rely on similar neural representations as bottom-up perceptual processes. Moreover, we found evidence for content-specific representations of the stimuli during auditory imagery in the primary somatosensory and primary motor cortices. Both the imagined emotions and the imagined identities of the auditory stimuli could be successfully classified in these regions.

Spectral-Spatial Differentiation of Brain Activity During Mental Imagery of Improvisational Music Performance Using MEG

Group musical improvisation is thought to be akin to conversation, and therapeutically has been shown to be effective at improving communicativeness, sociability, creative expression, and overall psychological health. To understand these therapeutic effects, clarifying the nature of brain activity during improvisational cognition is important. Some insight regarding brain activity during improvisational music cognition has been gained via functional magnetic resonance imaging (fMRI) and electroencephalography (EEG). However, we have found no reports based on magnetoencephalography (MEG). With the present study, we aimed to demonstrate the feasibility of improvisational music performance experimentation in MEG. We designed a novel MEG-compatible keyboard, and used it with experienced musicians (N = 13) in a music performance paradigm to spectral-spatially differentiate spontaneous brain activity during mental imagery of improvisational music performance. Analyses of source activity revealed that mental imagery of improvisational music performance induced greater theta (5–7 Hz) activity in left temporal areas associated with rhythm production and communication, greater alpha (8–12 Hz) activity in left premotor and parietal areas associated with sensorimotor integration, and less beta (15–29 Hz) activity in right frontal areas associated with inhibition control. These findings support the notion that musical improvisation is conversational, and suggest that creation of novel auditory content is facilitated by a more internally-directed, disinhibited cognitive state.

Prosody production networks are modulated by sensory cues and social context

The neurobiology of emotional prosody production is not well investigated. In particular, the effects of cues and social context are not known. The present study sought to differentiate cued from free emotion generation and the effect of social feedback from a human listener. Online speech filtering enabled functional magnetic resonance imaging during prosodic communication in 30 participants. Emotional vocalizations were (i) free, (ii) auditorily cued, (iii) visually cued or (iv) with interactive feedback. In addition to distributed language networks, cued emotions increased activity in auditory and—in case of visual stimuli—visual cortex. Responses were larger in posterior superior temporal gyrus at the right hemisphere and the ventral striatum when participants were listened to and received feedback from the experimenter. Sensory, language and reward networks contributed to prosody production and were modulated by cues and social context. The right posterior superior temporal gyrus is a central hub for communication in social interactions—in particular for interpersonal evaluation of vocal emotions.

Electrophysiological correlates and psychoacoustic characteristics of hearing-motion synaesthesia

People with hearing-motion synaesthesia experience sounds from moving or changing (e.g. flickering) visual stimuli. This phenomenon may be one of the most common forms of synaesthesia but it has rarely been studied and there are no studies of its neural basis. We screened for this in a sample of 200+ individuals, and estimated a prevalence of 4.2%. We also document its characteristics: it tends to be induced by physically moving stimuli (more so than static stimuli which imply motion or trigger illusory motion); and the psychoacoustic features are simple (e.g. "whooshing") with some systematic correspondences to vision (e.g. faster movement is higher pitch). We demonstrate using event-related potentials that it emerges from early perceptual processing of vision. The synaesthetes have a higher amplitude motion-evoked N2 (165-185ms), with some evidence of group differences as early as 55-75ms. We discuss similarities between hearing-motion synaesthesia and previous observations that visual motion triggers auditory activity in the congenitally deaf. It is possible that both conditions reflect the maintenance of multisensory pathways found in early development that most people lose but can be retained in certain people in response to sensory deprivation (in the deaf) or, in people with normal hearing, as a result of other differences (e.g. genes predisposing to synaesthesia).