Integration of “what” and “where” in frontal cortex during visual imagery of scenes

The neuro-oscillatory profiles of static and dynamic music-induced visual imagery

Visual imagery, i.e., seeing in the absence of the corresponding retinal input, has been linked to visual and motor processing areas of the brain. Music listening provides an ideal vehicle for exploring the neural correlates of visual imagery because it has been shown to reliably induce a broad variety of content, ranging from abstract shapes to dynamic scenes. Forty-two participants listened with closed eyes to twenty-four excerpts of music, while a 15-channel EEG was recorded, and, after each excerpt, rated the extent to which they experienced static and dynamic visual imagery. Our results show both static and dynamic imagery to be associated with posterior alpha suppression (especially in lower alpha) early in the onset of music listening, while static imagery was associated with an additional alpha enhancement later in the listening experience. With regard to the beta band, our results demonstrate beta enhancement to static imagery, but first beta suppression before enhancement in response to dynamic imagery. We also observed a positive association, early in the listening experience, between gamma power and dynamic imagery ratings that was not present for static imagery ratings. Finally, we offer evidence that musical training may selectively drive effects found with respect to static and dynamic imagery and alpha, beta, and gamma band oscillations. Taken together, our results show the promise of using music listening as an effective stimulus for examining the neural correlates of visual imagery and its contents. Our study also highlights the relevance of future work seeking to study the temporal dynamics of music-induced visual imagery.

Mnemonic-trained brain tuning to a regular odd-even pattern subserves digit memory in children

It is said that our species use mnemonics - that "magic of memorization" - to engrave an enormous amount of information in the brain. Yet, it is unclear how mnemonics affect memory and what the neural underpinnings are. In this electroencephalography study, we examined the hypotheses whether mnemonic training improved processing-efficiency and/or altered encoding-pattern to support memory enhancement. By 22-day training of a digit-image mnemonic (a custom memory technique used by world-class mnemonists), a group of children showed increased short-term memory after training, but with limited gain generalization. This training resulted in regular odd-even neural patterns (i.e., enhanced P200 and theta power during the encoding of digits at even- versus odd- positions in a sequence). Critically, the P200 and theta power effects predicted the training-induced memory improvement. These findings provide evidence of how mnemonics alter encoding pattern, as reflected in functional brain organization, to support memory enhancement.

Functional connectivity fingerprints of the frontal eye field and inferior frontal junction suggest spatial versus nonspatial processing in the prefrontal cortex

Neuroimaging evidence suggests that the frontal eye field (FEF) and inferior frontal junction (IFJ) govern the encoding of spatial and nonspatial (such as feature- or object-based) representations, respectively, both during visual attention and working memory tasks. However, it is still unclear whether such contrasting functional segregation is also reflected in their underlying functional connectivity patterns. Here, we hypothesized that FEF has predominant functional coupling with spatiotopically organized regions in the dorsal ('where') visual stream whereas IFJ has predominant functional connectivity with the ventral ('what') visual stream. We applied seed-based functional connectivity analyses to temporally high-resolving resting-state magnetoencephalography (MEG) recordings. We parcellated the brain according to the multimodal Glasser atlas and tested, for various frequency bands, whether the spontaneous activity of each parcel in the ventral and dorsal visual pathway has predominant functional connectivity with FEF or IFJ. The results show that FEF has a robust power correlation with the dorsal visual pathway in beta and gamma bands. In contrast, anterior IFJ (IFJa) has a strong power coupling with the ventral visual stream in delta, beta and gamma oscillations. Moreover, while FEF is phase-coupled with the superior parietal lobe in the beta band, IFJa is phase-coupled with the middle and inferior temporal cortex in delta and gamma oscillations. We argue that these intrinsic connectivity fingerprints are congruent with each brain region's function. Therefore, we conclude that FEF and IFJ have dissociable connectivity patterns that fit their respective functional roles in spatial versus nonspatial top-down attention and working memory control.

Lower affective empathy in oral contraceptive users: a cross-sectional fMRI study

Evidence accumulates that oral contraceptive (OC) use modulates various socio-affective behaviors, including empathic abilities. Endogenous and synthetic sex hormones, such as estrogens and progestogens, bind to receptor sites in brain regions (i.e. frontal, limbic, and cerebellar) involved in socio-affective processing. Therefore, the aim of this study was to investigate the role of OC use in empathy. In a cross-sectional functional magnetic resonance imaging study, women in different hormonal states, including OC use (n = 46) or being naturally cycling in the early follicular (fNC: n = 37) or peri-ovulatory phase (oNC: n = 28), performed a visual, sentence-based empathy task. Behaviorally, OC users had lower empathy ratings than oNC women. Congruently, whole-brain analysis revealed significantly larger task-related activation of several brain regions, including the left dorsomedial prefrontal gyrus (dmPFG), left precentral gyrus, and left temporoparietal junction in oNC compared to OC women. In OC users, the activity of the left dmPFG and precentral gyrus was negatively associated with behavioral and self-reported affective empathy. Furthermore, empathy-related region-of-interest analysis indicated negative associations of brain activation with synthetic hormone levels in OC women. Overall, this multimodal, cross-sectional investigation of empathy suggests a role of OC intake in especially affective empathy and highlights the importance of including synthetic hormone levels in OC-related analyses.

Memories with a blind mind: Remembering the past and imagining the future with aphantasia

Our capacity to re-experience the past and simulate the future is thought to depend heavily on visual imagery, which allows us to construct complex sensory representations in the absence of sensory stimulation. There are large individual differences in visual imagery ability, but their impact on autobiographical memory and future prospection remains poorly understood. Research in this field assumes the normative use of visual imagery as a cognitive tool to simulate the past and future, however some individuals lack the ability to visualise altogether (a condition termed "aphantasia"). Aphantasia represents a rare and naturally occurring knock-out model for examining the role of visual imagery in episodic memory recall. Here, we assessed individuals with aphantasia on an adapted form of the Autobiographical Interview, a behavioural measure of the specificity and richness of episodic details underpinning the memory of events. Aphantasic participants generated significantly fewer episodic details than controls for both past and future events. This effect was most pronounced for novel future events, driven by selective reductions in visual detail retrieval, accompanied by comparatively reduced ratings of the phenomenological richness of simulated events, and paralleled by quantitative linguistic markers of reduced perceptual language use in aphantasic participants compared to those with visual imagery. Our findings represent the first systematic evidence (using combined objective and subjective data streams) that aphantasia is associated with a diminished ability to re-experience the past and simulate the future, indicating that visual imagery is an important cognitive tool for the dynamic retrieval and recombination of episodic details during mental simulation.

Combining Statistical Analysis and Machine Learning for EEG Scalp Topograms Classification

Incorporating brain-computer interfaces (BCIs) into daily life requires reducing the reliance of decoding algorithms on the calibration or enabling calibration with the minimal burden on the user. A potential solution could be a pre-trained decoder demonstrating a reasonable accuracy on the naive operators. Addressing this issue, we considered ambiguous stimuli classification tasks and trained an artificial neural network to classify brain responses to the stimuli of low and high ambiguity. We built a pre-trained classifier utilizing time-frequency features corresponding to the fundamental neurophysiological processes shared between subjects. To extract these features, we statistically contrasted electroencephalographic (EEG) spectral power between the classes in the representative group of subjects. As a result, the pre-trained classifier achieved 74% accuracy on the data of newly recruited subjects. Analysis of the literature suggested that a pre-trained classifier could help naive users to start using BCI bypassing training and further increased accuracy during the feedback session. Thus, our results contribute to using BCI during paralysis or limb amputation when there is no explicit user-generated kinematic output to properly train a decoder. In machine learning, our approach may facilitate the development of transfer learning (TL) methods for addressing the cross-subject problem. It allows extracting the interpretable feature subspace from the source data (the representative group of subjects) related to the target data (a naive user), preventing the negative transfer in the cross-subject tasks.

In your phase: neural phase synchronisation underlies visual imagery of faces

Mental imagery is the process through which we retrieve and recombine information from our memory to elicit the subjective impression of “seeing with the mind’s eye”. In the social domain, we imagine other individuals while recalling our encounters with them or modelling alternative social interactions in future. Many studies using imaging and neurophysiological techniques have shown several similarities in brain activity between visual imagery and visual perception, and have identified frontoparietal, occipital and temporal neural components of visual imagery. However, the neural connectivity between these regions during visual imagery of socially relevant stimuli has not been studied. Here we used electroencephalography to investigate neural connectivity and its dynamics between frontal, parietal, occipital and temporal electrodes during visual imagery of faces. We found that voluntary visual imagery of faces is associated with long-range phase synchronisation in the gamma frequency range between frontoparietal electrode pairs and between occipitoparietal electrode pairs. In contrast, no effect of imagery was observed in the connectivity between occipitotemporal electrode pairs. Gamma range synchronisation between occipitoparietal electrode pairs predicted subjective ratings of the contour definition of imagined faces. Furthermore, we found that visual imagery of faces is associated with an increase of short-range frontal synchronisation in the theta frequency range, which temporally preceded the long-range increase in the gamma synchronisation. We speculate that the local frontal synchrony in the theta frequency range might be associated with an effortful top-down mnemonic reactivation of faces. In contrast, the long-range connectivity in the gamma frequency range along the fronto-parieto-occipital axis might be related to the endogenous binding and subjective clarity of facial visual features.

Mental rotation ability and spontaneous brain activity: a magnetoencephalography study

We performed experiments using magnetoencephalography to clarify the relationship between three-dimensional visuospatial abilities and spontaneous visual thinking characteristics. Subjects were divided into two groups based on the rate of correct answers to mental rotation tasks: those with good performances (Group G) and those with bad performances (Group B). We found the followings: (1) in the mental rotation tasks, the 25-35 Hz lower γ band activities in the superior parietal lobule/intraparietal sulcus regions and in the occipitotemporal region were significantly larger in Group G than in Group B and (2) in the spontaneous mental imagery tasks, the 20-Hz band activity in the left premotor cortex and the 35-Hz band activity in the supplementary motor area were significantly larger in Group G.

Dissociating Cognitive Processes During Ambiguous Information Processing in Perceptual Decision-Making

Decision-making requires the accumulation of sensory evidence. However, in everyday life, sensory information is often ambiguous and contains decision-irrelevant features. This means that the brain must disambiguate sensory input and extract decision-relevant features. Sensory information processing and decision-making represent two subsequent stages of the perceptual decision-making process. While sensory processing relies on occipito-parietal neuronal activity during the earlier time window, decision-making lasts for a prolonged time, involving parietal and frontal areas. Although perceptual decision-making is being actively studied, its neuronal mechanisms under ambiguous sensory evidence lack detailed consideration. Here, we analyzed the brain activity of subjects accomplishing a perceptual decision-making task involving the classification of ambiguous stimuli. We demonstrated that ambiguity induced high frontal θ-band power for 0.15 s post-stimulus onset, indicating increased reliance on top-down processes, such as expectations and memory. Ambiguous processing also caused high occipito-parietal β-band power for 0.2 s and high fronto-parietal β-power for 0.35–0.42 s post-stimulus onset. We supposed that the former component reflected the disambiguation process while the latter reflected the decision-making phase. Our findings complemented existing knowledge about ambiguous perception by providing additional information regarding the temporal discrepancy between the different cognitive processes during perceptual decision-making.

First-Person Virtual Embodiment Modulates the Cortical Network that Encodes the Bodily Self and Its Surrounding Space during the Experience of Domestic Violence

Social aggression, such as domestic violence, has been associated with a reduced ability to take on others’ perspectives. In this naturalistic imaging study, we investigated whether training human participants to take on a first-person embodied perspective during the experience of domestic violence enhances the identification with the victim and elicits brain activity associated with the monitoring of the body and surrounding space and the experience of threat. We combined fMRI measurements with preceding virtual reality exposure from either first-person perspective (1PP) or third-person perspective (3PP) to manipulate whether the domestic abuse stimulus was perceived as directed to oneself or another. We found that 1PP exposure increased body ownership and identification with the virtual victim. Furthermore, when the stimulus was perceived as directed toward oneself, the brain network that encodes the bodily self and its surrounding space was more strongly synchronized across participants and connectivity increased from premotor cortex (PM) and intraparietal sulcus towards superior parietal lobe. Additionally, when the stimulus came near the body, brain activity in the amygdala (AMG) strongly synchronized across participants. Exposure to 3PP reduced synchronization of brain activity in the personal space network, increased modulation of visual areas and strengthened functional connectivity between PM, supramarginal gyrus and primary visual cortex. In conclusion, our results suggest that 1PP embodiment training enhances experience from the viewpoint of the virtual victim, which is accompanied by synchronization in the fronto-parietal network to predict actions toward the body and in the AMG to signal the proximity of the stimulus.

Amygdala responds to direct gaze in real but not in computer-generated faces

Computer-generated (CG) faces are an important visual interface for human-computer interaction in social contexts. Here we investigated whether the human brain processes emotion and gaze similarly in real and carefully matched CG faces. Real faces evoked greater responses in the fusiform face area than CG faces, particularly for fearful expressions. Emotional (angry and fearful) facial expressions evoked similar activations in the amygdala in real and CG faces. Direct as compared with averted gaze elicited greater fMRI responses in the amygdala regardless of facial expression but only for real and not for CG faces. We observed an interaction effect between gaze and emotion (i.e., the shared signal effect) in the right posterior temporal sulcus and other regions, but not in the amygdala, and we found no evidence for different shared signal effects in real and CG faces. Taken together, the present findings highlight similarities (emotional processing in the amygdala) and differences (overall processing in the fusiform face area, gaze processing in the amygdala) in the neural processing of real and CG faces.

Visual stimulus-driven functional organization of macaque prefrontal cortex

The extent to which the major subdivisions of prefrontal cortex (PFC) can be functionally partitioned is unclear. In approaching the question, it is often assumed that the organization is task dependent. Here we use fMRI to show that PFC can respond in a task-independent way, and we leverage these responses to uncover a stimulus-driven functional organization. The results were generated by mapping the relative location of responses to faces, bodies, scenes, disparity, color, and eccentricity in four passively fixating macaques. The results control for individual differences in functional architecture and provide the first account of a systematic visual stimulus-driven functional organization across PFC. Responses were focused in dorsolateral PFC (DLPFC), in the ventral prearcuate region; and in ventrolateral PFC (VLPFC), extending into orbital PFC. Face patches were in the VLPFC focus and were characterized by a striking lack of response to non-face stimuli rather than an especially strong response to faces. Color-biased regions were near but distinct from face patches. One scene-biased region was consistently localized with different contrasts and overlapped the disparity-biased region to define the DLPFC focus. All visually responsive regions showed a peripheral visual-field bias. These results uncover an organizational scheme that presumably constrains the flow of information about different visual modalities into PFC.

Windows into the Visual Brain: New Discoveries about the Visual System, Its Functions, and Implications for Practitioners

Introduction

In recent years, major progress has been made in understanding the human visual system because of new investigative techniques. These developments often contradict older concepts about visual function.

Methods

A detailed literature search and interprofessional discussions.

Results

Recent innovative neurological tests are described that are able to show much more accurately the visual pathways, the process of vision, and the close relationships among sensory modalities. These tests also reveal the remarkable neuroplasticity of the human brain and disorders of connectivity that frequently involve visual function.

Discussion

How these recent neurological advances may benefit service providers is discussed.

Implications for practitioners

It is important that from time to time new neurological and ophthalmic developments are summarized for professionals who are involved in the clinical management of individuals with visual disorders and how the newly acquired knowledge affects the diagnosis and intervention strategies. Visual rehabilitation must be based on up-to-date science, which continually changes and grows with research.

Targeting the affective brain-a randomized controlled trial of real-time fMRI neurofeedback in patients with depression

Functional magnetic resonance imaging neurofeedback (fMRI-NF) training of areas involved in emotion processing can reduce depressive symptoms by over 40% on the Hamilton Depression Rating Scale (HDRS). However, it remains unclear if this efficacy is specific to feedback from emotion-regulating regions. We tested in a single-blind, randomized, controlled trial if upregulation of emotion areas (NFE) yields superior efficacy compared to upregulation of a control region activated by visual scenes (NFS). Forty-three moderately to severely depressed medicated patients were randomly assigned to five sessions augmentation treatment of either NFE or NFS training. At primary outcome (week 12) no significant group mean HDRS difference was found (B = -0.415 [95% CI -4.847 to 4.016], p = 0.848) for the 32 completers (16 per group). However, across groups depressive symptoms decreased by 43%, and 38% of patients remitted. These improvements lasted until follow-up (week 18). Both groups upregulated target regions to a similar extent. Further, clinical improvement was correlated with an increase in self-efficacy scores. However, the interpretation of clinical improvements remains limited due to lack of a sham-control group. We thus surveyed effects reported for accepted augmentation therapies in depression. Data indicated that our findings exceed expected regression to the mean and placebo effects that have been reported for drug trials and other sham-controlled high-technology interventions. Taken together, we suggest that the experience of successful self-regulation during fMRI-NF training may be therapeutic. We conclude that if fMRI-NF is effective for depression, self-regulation training of higher visual areas may provide an effective alternative.

Novelty N2-P3a Complex and Theta Oscillations Reflect Improving Neural Coordination Within Frontal Brain Networks During Adolescence

Adolescents are easily distracted by novel items than adults. Maturation of the frontal cortex and its integration into widely distributed brain networks may result in diminishing distractibility with the transition into young adulthood. The aim of this study was to investigate maturational changes of brain activity during novelty processing. We hypothesized that during adolescence, timing and task-relevant modulation of frontal cortex network activity elicited by novelty processing improves, concurrently with increasing cognitive control abilities. A visual novelty oddball task was utilized in combination with EEG measurements to investigate brain maturation between 8–28 years of age (n = 84). Developmental changes of the frontal N2-P3a complex and concurrent theta oscillations (4–7 Hz) elicited by rare and unexpected novel stimuli were analyzed using regression models. N2 amplitude decreased, P3a amplitude increased, and latency of both components decreased with age. Pre-stimulus amplitude of theta oscillations decreased, while inter-trial consistency, task-related amplitude modulation and inter-site connectivity of frontal theta oscillations increased with age. Targets, intertwined in a stimulus train with regular non-targets and novels, were detected faster with increasing age. These results indicate that neural processing of novel stimuli became faster and the neural activation pattern more precise in timing and amplitude modulation. Better inter-site connectivity further implicates that frontal brain maturation leads to global neural reorganization and better integration of frontal brain activity within widely distributed brain networks. Faster target detection indicated that these maturational changes in neural activation during novelty processing may result in diminished distractibility and increased cognitive control to pursue the task.

Mental Imagery Follows Similar Cortical Reorganization as Perception: Intra-Modal and Cross-Modal Plasticity in Congenitally Blind

Cortical plasticity in congenitally blind individuals leads to cross-modal activation of the visual cortex and may lead to superior perceptual processing in the intact sensory domains. Although mental imagery is often defined as a quasi-perceptual experience, it is unknown whether it follows similar cortical reorganization as perception in blind individuals. In this study, we show that auditory versus tactile perception evokes similar intra-modal discriminative patterns in congenitally blind compared with sighted participants. These results indicate that cortical plasticity following visual deprivation does not influence broad intra-modal organization of auditory and tactile perception as measured by our task. Furthermore, not only the blind, but also the sighted participants showed cross-modal discriminative patterns for perception modality in the visual cortex. During mental imagery, both groups showed similar decoding accuracies for imagery modality in the intra-modal primary sensory cortices. However, no cross-modal discriminative information for imagery modality was found in early visual cortex of blind participants, in contrast to the sighted participants. We did find evidence of cross-modal activation of higher visual areas in blind participants, including the representation of specific-imagined auditory features in visual area V4.

fMRI-based Multivariate Pattern Analyses Reveal Imagery Modality and Imagery Content Specific Representations in Primary Somatosensory, Motor and Auditory Cortices

Previous studies have shown that the early visual cortex contains content-specific representations of stimuli during visual imagery, and that these representational patterns of imagery content have a perceptual basis. To date, there is little evidence for the presence of a similar organization in the auditory and tactile domains. Using fMRI-based multivariate pattern analyses we showed that primary somatosensory, auditory, motor, and visual cortices are discriminative for imagery of touch versus sound. In the somatosensory, motor and visual cortices the imagery modality discriminative patterns were similar to perception modality discriminative patterns, suggesting that top-down modulations in these regions rely on similar neural representations as bottom-up perceptual processes. Moreover, we found evidence for content-specific representations of the stimuli during auditory imagery in the primary somatosensory and primary motor cortices. Both the imagined emotions and the imagined identities of the auditory stimuli could be successfully classified in these regions.

Vividness of Visual Imagery Depends on the Neural Overlap with Perception in Visual Areas

Research into the neural correlates of individual differences in imagery vividness point to an important role of the early visual cortex. However, there is also great fluctuation of vividness within individuals, such that only looking at differences between people necessarily obscures the picture. In this study, we show that variation in moment-to-moment experienced vividness of visual imagery, within human subjects, depends on the activity of a large network of brain areas, including frontal, parietal, and visual areas. Furthermore, using a novel multivariate analysis technique, we show that the neural overlap between imagery and perception in the entire visual system correlates with experienced imagery vividness. This shows that the neural basis of imagery vividness is much more complicated than studies of individual differences seemed to suggest.

SIGNIFICANCE STATEMENT

Visual imagery is the ability to visualize objects that are not in our direct line of sight: something that is important for memory, spatial reasoning, and many other tasks. It is known that the better people are at visual imagery, the better they can perform these tasks. However, the neural correlates of moment-to-moment variation in visual imagery remain unclear. In this study, we show that the more the neural response during imagery is similar to the neural response during perception, the more vivid or perception-like the imagery experience is.

How does intentionality of encoding affect memory for episodic information?

Episodic memory enables the detailed and vivid recall of past events, including target and wider contextual information. In this paper, we investigated whether/how encoding intentionality affects the retention of target and contextual episodic information from a novel experience. Healthy adults performed (1) a What-Where-When (WWW) episodic memory task involving the hiding and delayed recall of a number of items (what) in different locations (where) in temporally distinct sessions (when) and (2) unexpected tests probing memory for wider contextual information from the WWW task. Critically, some participants were informed that memory for WWW information would be subsequently probed (intentional group), while this came as a surprise for others (incidental group). The probing of contextual information came as a surprise for all participants. Participants also performed several measures of episodic and nonepisodic cognition from which common episodic and nonepisodic factors were extracted. Memory for target (WWW) and contextual information was superior in the intentional group compared with the incidental group. Memory for target and contextual information was unrelated to factors of nonepisodic cognition, irrespective of encoding intentionality. In addition, memory for target information was unrelated to factors of episodic cognition. However, memory for wider contextual information was related to some factors of episodic cognition, and these relationships differed between the intentional and incidental groups. Our results lead us to propose the hypothesis that intentional encoding of episodic information increases the coherence of the representation of the context in which the episode took place. This hypothesis remains to be tested.

Feel the Noise: Relating Individual Differences in Auditory Imagery to the Structure and Function of Sensorimotor Systems

Humans can generate mental auditory images of voices or songs, sometimes perceiving them almost as vividly as perceptual experiences. The functional networks supporting auditory imagery have been described, but less is known about the systems associated with interindividual differences in auditory imagery. Combining voxel-based morphometry and fMRI, we examined the structural basis of interindividual differences in how auditory images are subjectively perceived, and explored associations between auditory imagery, sensory-based processing, and visual imagery. Vividness of auditory imagery correlated with gray matter volume in the supplementary motor area (SMA), parietal cortex, medial superior frontal gyrus, and middle frontal gyrus. An analysis of functional responses to different types of human vocalizations revealed that the SMA and parietal sites that predict imagery are also modulated by sound type. Using representational similarity analysis, we found that higher representational specificity of heard sounds in SMA predicts vividness of imagery, indicating a mechanistic link between sensory- and imagery-based processing in sensorimotor cortex. Vividness of imagery in the visual domain also correlated with SMA structure, and with auditory imagery scores. Altogether, these findings provide evidence for a signature of imagery in brain structure, and highlight a common role of perceptual–motor interactions for processing heard and internally generated auditory information.

Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective

Recent developments in neuroimaging research support the increased use of naturalistic stimulus material such as film, avatars, or androids. These stimuli allow for a better understanding of how the brain processes information in complex situations while maintaining experimental control. While avatars and androids are well suited to study human cognition, they should not be equated to human stimuli. For example, the uncanny valley hypothesis theorizes that artificial agents with high human-likeness may evoke feelings of eeriness in the human observer. Here we review if, when, and how the perception of human-like avatars and androids differs from the perception of humans and consider how this influences their utilization as stimulus material in social and affective neuroimaging studies. First, we discuss how the appearance of virtual characters affects perception. When stimuli are morphed across categories from non-human to human, the most ambiguous stimuli, rather than the most human-like stimuli, show prolonged classification times and increased eeriness. Human-like to human stimuli show a positive linear relationship with familiarity. Secondly, we show that expressions of emotions in human-like avatars can be perceived similarly to human emotions, with corresponding behavioral, physiological and neuronal activations, with exception of physical dissimilarities. Subsequently, we consider if and when one perceives differences in action representation by artificial agents versus humans. Motor resonance and predictive coding models may account for empirical findings, such as an interference effect on action for observed human-like, natural moving characters. However, the expansion of these models to explain more complex behavior, such as empathy, still needs to be investigated in more detail. Finally, we broaden our outlook to social interaction, where virtual reality stimuli can be utilized to imitate complex social situations.

Brain activities of visual thinkers and verbal thinkers: A MEG study

In this study we measured activation patterns in the primary visual cortex and the frontal language areas and compared them in individuals with strong and weak capacities to mentally visualize information during spontaneous thinking. Subjects were first administered a 5-item questionnaire to assess their ability to create mental pictures, and were divided into two groups (strong and weak visualizers) on this basis. They then performed tasks requiring visual imagery and verbal recollection, and their local neural activities were measured, using magnetoencephalography (MEG). Notably in the high beta-band (25Hz), the visual area (BA 17) was more strongly activated in strong visualizers, whereas, the frontal language areas were more strongly activated in weak visualizers. Strong visualizers are considered to be visual thinkers, and weak visualizers are verbal thinkers.

Linking brain electrical signals elicited by current outcomes with future risk decision-making

The experience of current outcomes influences future decisions in various ways. The neural mechanism of this phenomenon may help to clarify the determinants of decision-making. In this study, thirty-nine young adults finished a risky gambling task by choosing between a high- and a low-risk option in each trial during electroencephalographic data collection. We found that risk-taking strategies significantly modulated mean amplitudes of the event-related potential (ERP) component P3, particularly at the central scalp. The event-related spectral perturbation and the inter-trial coherence measurements of the independent component analysis (ICA) data indicated that the “stay” vs. “switch” electrophysiological difference associated with subsequent decision-making was mainly due to fronto-central theta and left/right mu independent components. Event-related cross-coherence results suggested that the neural information of action monitoring and updating emerged in the fronto-central cortex and propagated to sensorimotor area for further behavior adjustment. Based on these findings of ERP and event-related oscillation (ERO) measures, we propose a neural model of the influence of current outcomes on future decisions.

[Mental Imagery: Neurophysiology and Implications in Psychiatry]

OBJECTIVE

To provide an explanation about what mental imagery is and some implications in psychiatry.

METHODS

This article is a narrative literature review.

RESULTS

There are many terms in which imagery representations are described in different fields of research. They are defined as perceptions in the absence of an external stimulus, and can be created in any sensory modality. Their neurophysiological substrate is almost the same as the one activated during sensory perception. There is no unified theory about its function, but it is possibly the way that our brain uses and manipulates the information to respond to the environment.

CONCLUSIONS

Mental imagery is an everyday phenomenon, and when it occurs in specific patterns it can be a sign of mental disorders.

Visual imagery while reading concrete and abstract Japanese kanji words: an fMRI study

Neuroimaging studies have investigated differences in neural correlates between abstract and concrete concepts but this has not been done with Japanese participants. Concrete words have higher imageability than abstract words, such that they elicit more visual imagery. The present study used functional MRI to investigate brain activity of Japanese participants (N=16) during generation of visual images for written concrete or abstract Japanese kanji words. Concrete words elicited significantly more activation than abstract words in the left middle frontal gyrus (LMFG), bilateral superior frontal gyrus, and left fusiform gyrus (LFG). Psychophysiological interaction (PPI) analyses were performed to assess LMFG and LFG functional connections. LMFG activity was accompanied by increased functional interaction with the left superior parietal lobule (LSPL), and LFG activity was accompanied by increased functional interaction with the LMFG. This finding suggests that the LMFG plays an important role in visual imagery, with interactions between this region and both the LSPL and LFG.

Neural network configuration and efficiency underlies individual differences in spatial orientation ability

Spatial orientation is a complex cognitive process requiring the integration of information processed in a distributed system of brain regions. Current models on the neural basis of spatial orientation are based primarily on the functional role of single brain regions, with limited understanding of how interaction among these brain regions relates to behavior. In this study, we investigated two sources of variability in the neural networks that support spatial orientation--network configuration and efficiency--and assessed whether variability in these topological properties relates to individual differences in orientation accuracy. Participants with higher accuracy were shown to express greater activity in the right supramarginal gyrus, the right precentral cortex, and the left hippocampus, over and above a core network engaged by the whole group. Additionally, high-performing individuals had increased levels of global efficiency within a resting-state network composed of brain regions engaged during orientation and increased levels of node centrality in the right supramarginal gyrus, the right primary motor cortex, and the left hippocampus. These results indicate that individual differences in the configuration of task-related networks and their efficiency measured at rest relate to the ability to spatially orient. Our findings advance systems neuroscience models of orientation and navigation by providing insight into the role of functional integration in shaping orientation behavior.

The functional neuroanatomy of multitasking: combining dual tasking with a short term memory task

Insight into the neural architecture of multitasking is crucial when investigating the pathophysiology of multitasking deficits in clinical populations. Presently, little is known about how the brain combines dual-tasking with a concurrent short-term memory task, despite the relevance of this mental operation in daily life and the frequency of complaints related to this process, in disease. In this study we aimed to examine how the brain responds when a memory task is added to dual-tasking. Thirty-three right-handed healthy volunteers (20 females, mean age 39.9 ± 5.8) were examined with functional brain imaging (fMRI). The paradigm consisted of two cross-modal single tasks (a visual and auditory temporal same-different task with short delay), a dual-task combining both single tasks simultaneously and a multi-task condition, combining the dual-task with an additional short-term memory task (temporal same-different visual task with long delay). Dual-tasking compared to both individual visual and auditory single tasks activated a predominantly right-sided fronto-parietal network and the cerebellum. When adding the additional short-term memory task, a larger and more bilateral frontoparietal network was recruited. We found enhanced activity during multitasking in components of the network that were already involved in dual-tasking, suggesting increased working memory demands, as well as recruitment of multitask-specific components including areas that are likely to be involved in online holding of visual stimuli in short-term memory such as occipito-temporal cortex. These results confirm concurrent neural processing of a visual short-term memory task during dual-tasking and provide evidence for an effective fMRI multitasking paradigm.

Mental imagery, emotion and psychopathology across child and adolescent development

Mental imagery-based interventions are receiving increasing interest for the treatment of psychological disorders in adults. This is based on evidence that mental imagery potently influences the experience of emotion in non-clinical samples, and that a number of psychological disorders are marked by syndrome-specific, distressing abnormalities in mental imagery. During childhood and adolescence, neurocognitive development impacting mental imagery processes may moderate its relationship with clinically-relevant emotional symptoms at a number of potential loci. Crucially, these changes could impact vulnerability to distressing mental imagery and the efficacy of mental imagery-based clinical interventions. This review synthesises evidence pertaining to developmental changes in the role and content of mental imagery, and in the cognitive sub-processes required to generate and sustain mental images. Subsequently, we discuss implications for understanding the developmental relationship between mental imagery, emotion and psychopathology. Translational cognitive neuroscience research investigating the content, emotional impact and neurocognitive substrates of mental imagery across development may reveal insights into trajectories of vulnerability to symptoms of a number of psychological disorders. If proper consideration is given to developmental factors, techniques based on mental imagery may be valuable as part of a treatment armoury for child and adolescent clinical populations and those at risk of emotional disorders.

Oscillatory neuronal dynamics associated with manual acupuncture: a magnetoencephalography study using beamforming analysis

Magnetoencephalography (MEG) enables non-invasive recording of neuronal activity, with reconstruction methods providing estimates of underlying brain source locations and oscillatory dynamics from externally recorded neuromagnetic fields. The aim of our study was to use MEG to determine the effect of manual acupuncture on neuronal oscillatory dynamics. A major problem in MEG investigations of manual acupuncture is the absence of onset times for each needle manipulation. Given that beamforming (spatial filtering) analysis is not dependent upon stimulus-driven responses being phase-locked to stimulus onset, we postulated that beamforming could reveal source locations and induced changes in neuronal activity during manual acupuncture. In a beamformer analysis, a two-minute period of manual acupuncture needle manipulation delivered to the ipsilateral right LI-4 (Hegu) acupoint was contrasted with a two-minute baseline period. We considered oscillatory power changes in the theta (4-8 Hz), alpha (8-13 Hz), beta (13-30 Hz), and gamma (30-100 Hz) frequency bands. We found significant decreases in beta band power in the contralateral primary somatosensory cortex and superior frontal gyrus (SFG). In the ipsilateral cerebral hemisphere, we found significant power decreases in beta and gamma frequency bands in only the SFG. No significant power modulations were found in theta and alpha bands. Our results indicate that beamforming is a useful analytical tool to reconstruct underlying neuronal activity associated with manual acupuncture. Our main finding was of beta power decreases in primary somatosensory cortex and SFG, which opens up a line of future investigation regarding whether this contributes toward an underlying mechanism of acupuncture.

Hemispheric Differences within the Fronto-Parietal Network Dynamics Underlying Spatial Imagery

Spatial imagery refers to the inspection and evaluation of spatial features (e.g., distance, relative position, configuration) and/or the spatial manipulation (e.g., rotation, shifting, reorienting) of mentally generated visual images. In the past few decades, psychophysical as well as functional brain imaging studies have indicated that any such processing of spatially coded information and/or manipulation based on mental images (i) is subject to similar behavioral demands and limitations as in the case of spatial processing based on real visual images, and (ii) consistently activates several nodes of widely distributed cortical networks in the brain. These nodes include areas within both, the dorsal fronto-parietal as well as ventral occipito-temporal visual processing pathway, representing the “what” versus “where” aspects of spatial imagery. We here describe evidence from functional brain imaging and brain interference studies indicating systematic hemispheric differences within the dorsal fronto-parietal networks during the execution of spatial imagery. Importantly, such hemispheric differences and functional lateralization principles are also found in the effective brain network connectivity within and across these networks, with a direction of information flow from anterior frontal/premotor regions to posterior parietal cortices. In an attempt to integrate these findings of hemispheric lateralization and fronto-to-parietal interactions, we argue that spatial imagery constitutes a multifaceted cognitive construct that can be segregated in several distinct mental sub processes, each associated with activity within specific lateralized fronto-parietal (sub) networks, forming the basis of the here proposed dynamic network model of spatial imagery.