Dynamic premotor-to-parietal interactions during spatial imagery

Measuring neuronal avalanches to inform brain-computer interfaces

Large-scale interactions among multiple brain regions manifest as bursts of activations called neuronal avalanches, which reconfigure according to the task at hand and, hence, might constitute natural candidates to design brain-computer interfaces (BCIs). To test this hypothesis, we used source-reconstructed magneto/electroencephalography during resting state and a motor imagery task performed within a BCI protocol. To track the probability that an avalanche would spread across any two regions, we built an avalanche transition matrix (ATM) and demonstrated that the edges whose transition probabilities significantly differed between conditions hinged selectively on premotor regions in all subjects. Furthermore, we showed that the topology of the ATMs allows task-decoding above the current gold standard. Hence, our results suggest that neuronal avalanches might capture interpretable differences between tasks that can be used to inform brain-computer interfaces.

Review of spatial disability in individuals with attention deficit-hyperactivity disorder: Toward spatial cognition theory

Spatial cognition is the ability to detect, process, integrate, and formulate the spatial aspects of the environment. Spatial abilities, as perceptual doorway of information processing, influence on higher cognitive functions. This systematic review aimed to explore impaired spatial ability in individuals with Attention Deficit-Hyperactivity Disorders (ADHD). The data from 18 empirical experiments that explored at least one factor of spatial ability in individuals with ADHD was collected in accordance with the PRISMA approach. This study discussed several determinants of impaired spatial ability, including factors, domains, tasks, and measures of spatial ability. Furthermore, the impact of age, gender, and comorbidities are discussed. Finally, a model was proposed to explain the impaired cognitive functions in children with ADHD based on spatial abilities.

Regional activity and effective connectivity within the frontoparietal network during precision walking with visual cueing: an fNIRS study

Precision walking (PW) incorporates precise step adjustments into regular walking patterns to navigate challenging surroundings. However, the brain processes involved in PW control, which encompass cortical regions and interregional interactions, are not fully understood. This study aimed to investigate the changes in regional activity and effective connectivity within the frontoparietal network associated with PW. Functional near-infrared spectroscopy data were recorded from adult subjects during treadmill walking tasks, including normal walking (NOR) and PW with visual cues, wherein the intercue distance was either fixed (FIX) or randomly varied (VAR) across steps. The superior parietal lobule (SPL), dorsal premotor area (PMd), supplementary motor area (SMA), and dorsolateral prefrontal cortex (dlPFC) were specifically targeted. The results revealed higher activities in SMA and left PMd, as well as left-to-right SPL connectivity, in VAR than in FIX. Activities in SMA and right dlPFC, along with dlPFC-to-SPL connectivity, were higher in VAR than in NOR. Overall, these findings provide insights into the roles of different brain regions and connectivity patterns within the frontoparietal network in facilitating gait control during PW, providing a useful baseline for further investigations into brain networks involved in locomotion.

How embodied is cognition? fMRI and behavioral evidence for common neural resources underlying motor planning and mental rotation of bodily stimuli

Functional neuroimaging shows that dorsal frontoparietal regions exhibit conjoint activity during various motor and cognitive tasks. However, it is unclear whether these regions serve several, computationally independent functions, or underlie a motor "core process" that is reused to serve higher-order functions. We hypothesized that mental rotation capacity relies on a phylogenetically older motor process that is rooted within these areas. This hypothesis entails that neural and cognitive resources recruited during motor planning predict performance in seemingly unrelated mental rotation tasks. To test this hypothesis, we first identified brain regions associated with motor planning by measuring functional activations to internally-triggered vs externally-triggered finger presses in 30 healthy participants. Internally-triggered finger presses yielded significant activations in parietal, premotor, and occipitotemporal regions. We then asked participants to perform two mental rotation tasks outside the scanner, consisting of hands or letters as stimuli. Parietal and premotor activations were significant predictors of individual reaction times when mental rotation involved hands. We found no association between motor planning and performance in mental rotation of letters. Our results indicate that neural resources in parietal and premotor cortex recruited during motor planning also contribute to mental rotation of bodily stimuli, suggesting a common core component underlying both capacities.

Enhanced intrinsic functional connectivity in the visual system of visual artist: Implications for creativity

Introduction

This study sought to elucidate the cognitive traits of visual artists (VAs) from the perspective of visual creativity and the visual system (i.e., the most fundamental neural correlate).

Methods

We examined the local and long-distance intrinsic functional connectivity (FC) of the visual system to unravel changes in brain traits among VAs. Twenty-seven university students majoring in visual arts and 27 non-artist controls were enrolled.

Results

VAs presented enhanced local FC in the right superior parietal lobule, right precuneus, left inferior temporal gyrus (ITG), left superior parietal lobule, left angular gyrus, and left middle occipital gyrus. VAs also presented enhanced FC with the ITG that targeted the visual area (occipital gyrus and cuneus), which appears to be associated with visual creativity.

Discussion

The visual creativity of VAs was correlated with strength of intrinsic functional connectivity in the visual system. Learning-induced neuroplasticity as a trait change observed in VAs can be attributed to the macroscopic consolidation of consociated neural circuits that are engaged over long-term training in the visual arts and aesthetic experience. The consolidated network can be regarded as virtuoso-specific neural fingerprint.

Sound-modulations of visual motion perception implicate the cortico-vestibular brain

A widely used example of the intricate (yet poorly understood) intertwining of multisensory signals in the brain is the audiovisual bounce inducing effect (ABE). This effect presents two identical objects moving along the azimuth with uniform motion and towards opposite directions. The perceptual interpretation of the motion is ambiguous and is modulated if a transient (sound) is presented in coincidence with the point of overlap of the two objects' motion trajectories. This phenomenon has long been written-off to simple attentional or decision-making mechanisms, although the neurological underpinnings for the effect are not well understood. Using behavioural metrics concurrently with event-related fMRI, we show that sound-induced modulations of motion perception can be further modulated by changing motion dynamics of the visual targets. The phenomenon engages the posterior parietal cortex and the parieto-insular-vestibular cortical complex, with a close correspondence of activity in these regions with behaviour. These findings suggest that the insular cortex is engaged in deriving a probabilistic perceptual solution through the integration of multisensory data.

The Relationships between Cognitive Styles and Creativity: The Role of Field Dependence-Independence on Visual Creative Production

Previous studies explored the relationships between field dependent-independent cognitive style (FDI) and creativity, providing misleading and unclear results. The present research explored this problematic interplay through the lens of the Geneplore model, employing a product-oriented task: the Visual Creative Synthesis Task (VCST). The latter requires creating objects belonging to pre-established categories, starting from triads of visual components and consists of two steps: the preinventive phase and the inventive phase. Following the Amabile’s consensual assessment technique, three independent judges evaluated preinventive structures in terms of originality and synthesis whereas inventions were evaluated in terms of originality and appropriateness. The Embedded Figure Test (EFT) was employed in order to measure the individual’s predisposition toward the field dependence or the field independence. Sixty undergraduate college students (31 females) took part in the experiment. Results revealed that field independent individuals outperformed field dependent ones in each of the four VCST scores, showing higher levels of creativity. Results were discussed in light of the better predisposition of field independent individuals in mental imagery, mental manipulation of abstract objects, as well as in using their knowledge during complex tasks that require creativity. Future research directions were also discussed.

Crossmodal Visuospatial Effects on Auditory Perception of Musical Contour

The crossmodal correspondence between auditory pitch and visuospatial elevation (in which high- and low-pitched tones are associated with high and low spatial elevation respectively) has been proposed as the basis for Western musical notation. One implication of this is that music perception engages visuospatial processes and may not be exclusively auditory. Here, we investigated how music perception is influenced by concurrent visual stimuli. Participants listened to unfamiliar five-note musical phrases with four kinds of pitch contour (rising, falling, rising-falling, or falling-rising), accompanied by incidental visual contours that were either congruent (e.g., auditory rising/visual rising) or incongruent (e.g., auditory rising/visual falling) and judged whether the final note of the musical phrase was higher or lower in pitch than the first. Response times for the auditory judgment were significantly slower for incongruent compared to congruent trials, i.e., there was a congruency effect, even though the visual contours were incidental to the auditory task. These results suggest that music perception, although generally regarded as an auditory experience, may actually be multisensory in nature.

Responses to Visual Speech in Human Posterior Superior Temporal Gyrus Examined with iEEG Deconvolution

Experimentalists studying multisensory integration compare neural responses to multisensory stimuli with responses to the component modalities presented in isolation. This procedure is problematic for multisensory speech perception since audiovisual speech and auditory-only speech are easily intelligible but visual-only speech is not. To overcome this confound, we developed intracranial encephalography (iEEG) deconvolution. Individual stimuli always contained both auditory and visual speech, but jittering the onset asynchrony between modalities allowed for the time course of the unisensory responses and the interaction between them to be independently estimated. We applied this procedure to electrodes implanted in human epilepsy patients (both male and female) over the posterior superior temporal gyrus (pSTG), a brain area known to be important for speech perception. iEEG deconvolution revealed sustained positive responses to visual-only speech and larger, phasic responses to auditory-only speech. Confirming results from scalp EEG, responses to audiovisual speech were weaker than responses to auditory-only speech, demonstrating a subadditive multisensory neural computation. Leveraging the spatial resolution of iEEG, we extended these results to show that subadditivity is most pronounced in more posterior aspects of the pSTG. Across electrodes, subadditivity correlated with visual responsiveness, supporting a model in which visual speech enhances the efficiency of auditory speech processing in pSTG. The ability to separate neural processes may make iEEG deconvolution useful for studying a variety of complex cognitive and perceptual tasks.SIGNIFICANCE STATEMENT Understanding speech is one of the most important human abilities. Speech perception uses information from both the auditory and visual modalities. It has been difficult to study neural responses to visual speech because visual-only speech is difficult or impossible to comprehend, unlike auditory-only and audiovisual speech. We used intracranial encephalography deconvolution to overcome this obstacle. We found that visual speech evokes a positive response in the human posterior superior temporal gyrus, enhancing the efficiency of auditory speech processing.

Is Visual Creativity Embodied? Thinking Aloud While Performing the Creative Mental Synthesis Task

Over time, the view that creativity is embodied has emerged. In order to explore if visual creativity is supported by embodied mechanisms, the simulation approach was used as a framework of reference. The idea that visual creativity relies on mental representations that implement motor processes was faced. Participants were instructed to think aloud while carrying out the Creative Mental Synthesis Task, which allows to form pre-inventive structures and interpret them according to a specific category. Two independent judges scored verbal protocols in terms of the number of motor, spatial, and visual thoughts reported during the pre-inventive and inventive phases, and also evaluated the final objects according to originality and appropriateness. Originality was predicted positively by inventive motor thoughts and by pre-inventive spatial thoughts, but negatively by inventive spatial thoughts; appropriateness was only predicted by inventive visual thoughts. These results suggest that actions for future object utilization were simulated while interpreting pre-inventive structures, increasing originality of objects. In addition, spatial transformations are useful to construct the pre-inventive structures, but not to interpret them. Yet, thinking of the pictorial details of the object is also essential to classify it in a given category. Limitations and future research directions are discussed.

Directed Interaction Between Monkey Premotor and Posterior Parietal Cortex During Motor-Goal Retrieval from Working Memory

Goal-directed behavior requires cognitive control of action, putatively by means of frontal-lobe impact on posterior brain areas. We investigated frontoparietal directed interaction (DI) in monkeys during memory-guided rule-based reaches, to test if DI supports motor-goal selection or working memory (WM) processes. We computed DI between the parietal reach region (PRR) and dorsal premotor cortex (PMd) with a Granger-causality measure of intracortical local field potentials (LFP). LFP mostly in the beta (12–32 Hz) and low-frequency (f≤10Hz) ranges contributed to DI. During movement withholding, beta-band activity in PRR had a Granger-causal effect on PMd independent of WM content. Complementary, low-frequency PMd activity had a transient Granger-causing effect on PRR specifically during WM retrieval of spatial motor goals, while no DI was associated with preliminary motor-goal selection. Our results support the idea that premotor and posterior parietal cortices interact functionally to achieve cognitive control during goal-directed behavior, in particular, that frontal-to-parietal interaction occurs during retrieval of motor-goal information from spatial WM.

Where is the "where" in the brain? A meta-analysis of neuroimaging studies on spatial cognition

Spatial representations are processed in the service of several different cognitive functions. The present study capitalizes on the Activation Likelihood Estimation (ALE) method of meta-analysis to identify: (a) the shared neural activations among spatial functions to reveal the "core" network of spatial processing; (b) the specific neural activations associated with each of these functions. Following PRISMA guidelines, a total of 133 fMRI and PET studies were included in the meta-analysis. The overall analysis showed that the core network of spatial processing comprises regions that are symmetrically distributed on both hemispheres and that include dorsal frontoparietal regions, presupplementary motor area, anterior insula, and frontal operculum. The specific analyses revealed the brain regions that are selectively recruited for each spatial function, such as the right temporoparietal junction for shift of spatial attention, the right parahippocampal gyrus, and the retrosplenial cortex for navigation and spatial long-term memory. The findings are integrated within a systematic review of the neuroimaging literature and a new neurocognitive model of spatial cognition is proposed.

The format of mental imagery: from a critical review to an integrated embodied representation approach

The issue of the format of mental imagery is still an open debate. The classical analogue (depictive)-propositional (descriptive) debate has not provided definitive conclusions. Over the years, the debate has shifted within the frame of the embodied cognition approach, which focuses on the interdependence of perception, cognition and action. Although the simulation approach still retains the concept of representation, the more radical line of the embodied cognition approach emphasizes the importance of action and clearly disregards the concept of representation. In particular, the enactive approach focuses on motor procedures that allow the body to interact with the environment, whereas the sensorimotor approach focuses on the possession and exercise of sensorimotor knowledge about how the sensory input changes as a function of movement. In this review, the embodied approaches are presented and critically discussed. Then, in an attempt to show that the format of mental imagery varies according to the ability and the strategy used to represent information, the role of individual differences in imagery ability (e.g., vividness and expertise) and imagery strategy (e.g., object vs. spatial imagers) is reviewed. Since vividness is mainly associated with perceptual information, reflecting the activation level of specific imagery systems, whereas the preferred strategy used is mainly associated with perceptual (e.g., object imagery) or amodal and motor information (e.g., spatial imagery), the format of mental imagery appears to be based on dynamic embodied representations, depending on imagery abilities and imagery strategies.

The role of dorsal premotor cortex in mental rotation: A transcranial magnetic stimulation study

Although activation of dorsal premotor cortex (PMd) has been consistently observed in the neuroimaging studies of mental rotation, the functional meaning of PMd activation is still unclear and multiple alternative explanations have been suggested. The present study used repetitive transcranial magnetic stimulation (rTMS) to investigate the role of PMd in mental rotation. Two tasks were used, involving mental rotation of hands and abstract objects, with either matching (same stimuli) or mirror stimuli. Compared to sham stimulation, TMS over right and left PMd regions significantly affected accuracy in the object task, specifically for the same stimuli. Furthermore, response times were longer following right PMd stimulation in both the object and the hand tasks, but again, selectively for the same stimuli. The effect of rotational angle on response times and accuracies was greater for the same stimuli. Moreover TMS over PMd impaired the performance accuracy selectively in these stimuli, mainly in a task that included abstract objects. For these reasons, the present findings indicate a contribution of PMd to mental rotation.

Vividness of Visual Imagery Depends on the Neural Overlap with Perception in Visual Areas

Research into the neural correlates of individual differences in imagery vividness point to an important role of the early visual cortex. However, there is also great fluctuation of vividness within individuals, such that only looking at differences between people necessarily obscures the picture. In this study, we show that variation in moment-to-moment experienced vividness of visual imagery, within human subjects, depends on the activity of a large network of brain areas, including frontal, parietal, and visual areas. Furthermore, using a novel multivariate analysis technique, we show that the neural overlap between imagery and perception in the entire visual system correlates with experienced imagery vividness. This shows that the neural basis of imagery vividness is much more complicated than studies of individual differences seemed to suggest.

SIGNIFICANCE STATEMENT

Visual imagery is the ability to visualize objects that are not in our direct line of sight: something that is important for memory, spatial reasoning, and many other tasks. It is known that the better people are at visual imagery, the better they can perform these tasks. However, the neural correlates of moment-to-moment variation in visual imagery remain unclear. In this study, we show that the more the neural response during imagery is similar to the neural response during perception, the more vivid or perception-like the imagery experience is.

Dynamic interactions of the cortical networks during thought suppression

OBJECTIVES

Thought suppression has spurred extensive research in clinical and preclinical fields, particularly with regard to the paradoxical aspects of this behavior. However, the involvement of the brain's inhibitory system in the dynamics underlying the continuous effort to suppress thoughts has yet to be clarified. This study aims to provide a unified perspective for the volitional suppression of internal events incorporating the current understanding of the brain's inhibitory system.

MATERIALS AND METHODS

Twenty healthy volunteers underwent functional magnetic resonance imaging while they performed thought suppression blocks alternating with visual imagery blocks. The whole dataset was decomposed by group-independent component analysis into 30 components. After discarding noise components, the 20 valid components were subjected to further analysis of their temporal properties including task-relatedness and between-component residual correlation.

RESULTS

Combining a long task period and a data-driven approach, we observed a right-side-dominant, lateral frontoparietal network to be strongly suppression related. This network exhibited increased fluctuation during suppression, which is compatible with the well-known difficulty of suppression maintenance.

CONCLUSIONS

Between-network correlation provided further insight into the coordinated engagement of the executive control and dorsal attention networks, as well as the reciprocal activation of imagery-related components, thus revealing neural substrates associated with the rivalry between intrusive thoughts and the suppression process.

Cerebral Hemodynamic Responses During Dynamic Posturography: Analysis with a Multichannel Near-Infrared Spectroscopy System

To investigate cortical roles in standing balance, cortical hemodynamic activity was recorded from the right hemisphere using near-infrared spectroscopy (NIRS) while subjects underwent the sensory organization test (SOT) protocol that systematically disrupts sensory integration processes (i.e., somatosensory or visual inputs or both). Eleven healthy men underwent the SOT during NIRS recording. Group statistical analyses were performed based on changes in oxygenated hemoglobin concentration in 10 different cortical regions of interest and on a general linear analysis with NIRS statistical parametric mapping. The statistical analyses indicated significant activation in the right frontal operculum (f-Op), right parietal operculum (p-Op), and right superior temporal gyrus (STG), right posterior parietal cortex (PPC), right dorsal and ventral premotor cortex (PMC), and the supplementary motor area (SMA) under various conditions. The activation patterns in response to specific combinations of SOT conditions suggested that (1) f-Op, p-Op, and STG are essential for sensory integration when standing balance is perturbed; (2) the SMA is involved in the execution of volitional action and establishment of new motor programs to maintain postural balance; and (3) the PPC and PMC are involved in the updating and computation of spatial reference frames during instances of sensory conflict between vestibular and visual information.

Neural evidence for the use of digit-image mnemonic in a superior memorist: an fMRI study

Some superior memorists demonstrated exceptional memory for reciting a large body of information. The underlying neural correlates, however, are seldom addressed. C.L., the current holder of Guinness World Record for reciting 67,890 digits in π, participated in this functional magnetic resonance imaging (fMRI) study. Thirteen participants without any mnemonics training were included as controls. Our previous studies suggested that C.L. used a digit-image mnemonic in studying and recalling lists of digits, namely associating 2-digit groups of “00” to “99” with images and generating vivid stories out of them (Hu et al., 2009). Thus, 2-digit condition was included, with 1-digit numbers and letters as control conditions. We hypothesized that 2-digit condition in C.L. should elicit the strongest activity in the brain regions which are associated with his mnemonic. Functional MRI results revealed that bilateral frontal poles (FPs, BA10), left superior parietal lobule (SPL), left premotor cortex (PMC), and left dorsolateral prefrontal cortex (DLPFC), were more engaged in both the study and recall phase of 2-digit condition for C.L. relative to controls. Moreover, the left middle/inferior frontal gyri (M/IFG) and intraparietal sulci (IPS) were less engaged in the study phase of 2-digit condition for C.L. (vs. controls). These results suggested that C.L. relied more on brain regions that are associated with episodic memory other than verbal rehearsal while he used his mnemonic strategies. This study supported theoretical accounts of restructured cognitive mechanisms for the acquisition of superior memory performance.

Spatial imagery in haptic shape perception

We have proposed that haptic activation of the shape-selective lateral occipital complex (LOC) reflects a model of multisensory object representation in which the role of visual imagery is modulated by object familiarity. Supporting this, a previous functional magnetic resonance imaging (fMRI) study from our laboratory used inter-task correlations of blood oxygenation level-dependent (BOLD) signal magnitude and effective connectivity (EC) patterns based on the BOLD signals to show that the neural processes underlying visual object imagery (objIMG) are more similar to those mediating haptic perception of familiar (fHS) than unfamiliar (uHS) shapes. Here we employed fMRI to test a further hypothesis derived from our model, that spatial imagery (spIMG) would evoke activation and effective connectivity patterns more related to uHS than fHS. We found that few of the regions conjointly activated by spIMG and either fHS or uHS showed inter-task correlations of BOLD signal magnitudes, with parietal foci featuring in both sets of correlations. This may indicate some involvement of spIMG in HS regardless of object familiarity, contrary to our hypothesis, although we cannot rule out alternative explanations for the commonalities between the networks, such as generic imagery or spatial processes. EC analyses, based on inferred neuronal time series obtained by deconvolution of the hemodynamic response function from the measured BOLD time series, showed that spIMG shared more common paths with uHS than fHS. Re-analysis of our previous data, using the same EC methods as those used here, showed that, by contrast, objIMG shared more common paths with fHS than uHS. Thus, although our model requires some refinement, its basic architecture is supported: a stronger relationship between spIMG and uHS compared to fHS, and a stronger relationship between objIMG and fHS compared to uHS.

Decoding sound and imagery content in early visual cortex

Human early visual cortex was traditionally thought to process simple visual features such as orientation, contrast, and spatial frequency via feedforward input from the lateral geniculate nucleus (e.g., [1]). However, the role of nonretinal influence on early visual cortex is so far insufficiently investigated despite much evidence that feedback connections greatly outnumber feedforward connections [2–5]. Here, we explored in five fMRI experiments how information originating from audition and imagery affects the brain activity patterns in early visual cortex in the absence of any feedforward visual stimulation. We show that category-specific information from both complex natural sounds and imagery can be read out from early visual cortex activity in blindfolded participants. The coding of nonretinal information in the activity patterns of early visual cortex is common across actual auditory perception and imagery and may be mediated by higher-level multisensory areas. Furthermore, this coding is robust to mild manipulations of attention and working memory but affected by orthogonal, cognitively demanding visuospatial processing. Crucially, the information fed down to early visual cortex is category specific and generalizes to sound exemplars of the same category, providing evidence for abstract information feedback rather than precise pictorial feedback. Our results suggest that early visual cortex receives nonretinal input from other brain areas when it is generated by auditory perception and/or imagery, and this input carries common abstract information. Our findings are compatible with feedback of predictive information to the earliest visual input level (e.g., [6]), in line with predictive coding models [7–10].

•

Early visual cortex receives nonretinal input carrying abstract information

•

Both auditory perception and imagery generate consistent top-down input

•

Information feedback may be mediated by multisensory areas

•

Feedback is robust to attentional, but not visuospatial, manipulation

The neural pathway underlying a numerical working memory task in abacus-trained children and associated functional connectivity in the resting brain

Training can induce significant changes in brain functioning and behavioral performance. One consequence of training is changing the pattern of brain activation. Abacus training is of interest because abacus experts gain the ability to handle digits with unusual speed and accuracy. However, the neural correlates of numerical memory in abacus-trained children remain unknown. In the current study, we aimed to detect a training effect of abacus-based mental calculations on numerical working memory in children. We measured brain functional magnetic resonance imaging (fMRI) activation patterns in 17 abacus-trained children and 17 control children as they performed two numerical working memory tasks (digits and beads). Functional MRI results revealed higher activation in abacus-trained children than in the controls in the right posterior superior parietal lobule/superior occipital gyrus (PSPL/SOG) and the right supplementary motor area (SMA) in both tasks. When these regions were used as seeds in a functional connectivity analysis of the resting brain, the abacus-trained children showed significantly enhanced integration between the right SMA and the right inferior frontal gyrus (IFG). The IFG is considered to be the key region for the control of attention. These findings demonstrate that extensive engagement of the fronto-parietal network occurs during numerical memory tasks in the abacus-trained group. Furthermore, abacus training may increase the functional integration of visuospatial-attention circuitry, which and thus enhances high-level cognitive process.

Massive modulation of brain areas after mechanical pain stimulation: a time-resolved FMRI study

To date, relatively little is known about the spatiotemporal aspects of whole-brain blood oxygenation level-dependent (BOLD) responses to brief nociceptive stimuli. It is known that the majority of brain areas show a stimulus-locked response, whereas only some are characterized by a canonical hemodynamic response function. Here, we investigated the time course of brain activations in response to mechanical pain stimulation applied to participants' hands while they were undergoing functional magnetic resonance imaging (fMRI) scanning. To avoid any assumption about the shape of BOLD response, we used an unsupervised data-driven method to group voxels sharing a time course similar to the BOLD response to the stimulus and found that whole-brain BOLD responses to painful mechanical stimuli elicit massive activation of stimulus-locked brain areas. This pattern of activations can be segregated into 5 clusters, each with a typical temporal profile. In conclusion, we show that an extensive activity of multiple networks is engaged at different time latencies after presentation of a noxious stimulus. These findings aim to motivate research on a controversial topic, such as the temporal profile of BOLD responses, the variability of these response profiles, and the interaction between the stimulus-related BOLD response and ongoing fluctuations in large-scale brain networks.

Brain networks underlying mental imagery of auditory and visual information

Mental imagery is a complex cognitive process that resembles the experience of perceiving an object when this object is not physically present to the senses. It has been shown that, depending on the sensory nature of the object, mental imagery also involves correspondent sensory neural mechanisms. However, it remains unclear which areas of the brain subserve supramodal imagery processes that are independent of the object modality, and which brain areas are involved in modality-specific imagery processes. Here, we conducted a functional magnetic resonance imaging study to reveal supramodal and modality-specific networks of mental imagery for auditory and visual information. A common supramodal brain network independent of imagery modality, two separate modality-specific networks for imagery of auditory and visual information, and a common deactivation network were identified. The supramodal network included brain areas related to attention, memory retrieval, motor preparation and semantic processing, as well as areas considered to be part of the default-mode network and multisensory integration areas. The modality-specific networks comprised brain areas involved in processing of respective modality-specific sensory information. Interestingly, we found that imagery of auditory information led to a relative deactivation within the modality-specific areas for visual imagery, and vice versa. In addition, mental imagery of both auditory and visual information widely suppressed the activity of primary sensory and motor areas, for example deactivation network. These findings have important implications for understanding the mechanisms that are involved in generation of mental imagery.

Auditory Imagery Modulates Frequency-specific Areas in the Human Auditory Cortex

Neural responses in early sensory areas are influenced by top–down processing. In the visual system, early visual areas have been shown to actively participate in top–down processing based on their topographical properties. Although it has been suggested that the auditory cortex is involved in top–down control, functional evidence of topographic modulation is still lacking. Here, we show that mental auditory imagery for familiar melodies induces significant activation in the frequency-responsive areas of the primary auditory cortex (PAC). This activation is related to the characteristics of the imagery: when subjects were asked to imagine high-frequency melodies, we observed increased activation in the high- versus low-frequency response area; when the subjects were asked to imagine low-frequency melodies, the opposite was observed. Furthermore, we found that A1 is more closely related to the observed frequency-related modulation than R in tonotopic subfields of the PAC. Our findings suggest that top–down processing in the auditory cortex relies on a mechanism similar to that used in the perception of external auditory stimuli, which is comparable to early visual systems.

Hemispheric Differences within the Fronto-Parietal Network Dynamics Underlying Spatial Imagery

Spatial imagery refers to the inspection and evaluation of spatial features (e.g., distance, relative position, configuration) and/or the spatial manipulation (e.g., rotation, shifting, reorienting) of mentally generated visual images. In the past few decades, psychophysical as well as functional brain imaging studies have indicated that any such processing of spatially coded information and/or manipulation based on mental images (i) is subject to similar behavioral demands and limitations as in the case of spatial processing based on real visual images, and (ii) consistently activates several nodes of widely distributed cortical networks in the brain. These nodes include areas within both, the dorsal fronto-parietal as well as ventral occipito-temporal visual processing pathway, representing the “what” versus “where” aspects of spatial imagery. We here describe evidence from functional brain imaging and brain interference studies indicating systematic hemispheric differences within the dorsal fronto-parietal networks during the execution of spatial imagery. Importantly, such hemispheric differences and functional lateralization principles are also found in the effective brain network connectivity within and across these networks, with a direction of information flow from anterior frontal/premotor regions to posterior parietal cortices. In an attempt to integrate these findings of hemispheric lateralization and fronto-to-parietal interactions, we argue that spatial imagery constitutes a multifaceted cognitive construct that can be segregated in several distinct mental sub processes, each associated with activity within specific lateralized fronto-parietal (sub) networks, forming the basis of the here proposed dynamic network model of spatial imagery.

The role of visual experience for the neural basis of spatial cognition

Blindness often results in the adaptive neural reorganization of the remaining modalities, producing sharper auditory and haptic behavioral performance. Yet, non-visual modalities might not be able to fully compensate for the lack of visual experience as in the case of congenital blindness. For example, developmental visual experience seems to be necessary for the maturation of multisensory neurons for spatial tasks. Additionally, the ability of vision to convey information in parallel might be taken into account as the main attribute that cannot be fully compensated by the spared modalities. Therefore, the lack of visual experience might impair all spatial tasks that require the integration of inputs from different modalities, such as having to represent a set of objects on the basis of the spatial relationships among the objects, rather than the spatial relationship that each object has with oneself. Here we integrate behavioral and neural evidence to conclude that visual experience is necessary for the neural development of normal spatial cognition.

Trial-to-trial variability differentiates motor imagery during observation between low versus high responders: a functional near-infrared spectroscopy study

Trial-to-trial variability is a well-known issue in brain signals measured using functional near-infrared spectroscopy (fNIRS). We aimed to investigate whether trial-to-trial variability does provide information about individual performance. Seventeen subjects observed a virtual reality grasping task in first-person view while either imagining (motor imagery during observation, MIO) or imitating (motor execution, ME) the movements. Each condition was performed with the display in one of two positions, a conventional vertical position and a mirrored horizontal position which placed the virtual arm in the correct position relative to the viewpoint. Averaged oxy-hemoglobin concentration Δ[O(2)Hb] showed that the responses could be differentiated into two distinct groups: low responders (LR) and high responders (HR). Within groups, two main sources of trial-to-trial variability were identified: (a) the Δ[O(2)Hb] amplitude, with largest amplitudes in ME conditions (group HR) and smallest amplitudes in MIO conditions (group LR), and (b) the sign of Δ[O(2)Hb], with positive responses occurring most frequently during ME (group HR) and negative responses most frequently during MIO (group LR). Furthermore, the trial-to-trial dynamics differed between groups and could be described in group LR as inverted polynomial U-shaped curve in the mirror conditions (ME-mirror, MIO-mirror). Last, trial-to-trial variability was significantly dependent on task modality, i.e. ME (group HR) versus MIO (group LR), and/or the mirrored display positions (group LR). Our results show a relationship of trial-to-trial variability to individual MI performance, which may be of significance for neurorehabilitation applications. Although the sources of trial-to-trial variability remain unknown, we suggest that they may contribute to future neurofeedback applications.

Reorganization of functional and effective connectivity during real-time fMRI-BCI modulation of prosody processing

Mechanisms of cortical reorganization underlying the enhancement of speech processing have been poorly investigated. In the present study, we addressed changes in functional and effective connectivity induced in subjects who learned to deliberately increase activation in the right inferior frontal gyrus (rIFG), and improved their ability to identify emotional intonations by using a real-time fMRI Brain-Computer Interface. At the beginning of their training process, we observed a massive connectivity of the rIFG to a widespread network of frontal and temporal areas, which decreased and lateralized to the right hemisphere with practice. Volitional control of activation strengthened connectivity of this brain region to the right prefrontal cortex, whereas training increased its connectivity to bilateral precentral gyri. These findings suggest that changes of connectivity in a functionally specific manner play an important role in the enhancement of speech processing. Also, these findings support previous accounts suggesting that motor circuits play a role in the comprehension of speech.

When response inhibition is followed by response reengagement: an event-related fMRI study

In the course of daily living, changing environmental demands often make our actions, once initiated, unnecessary or even inappropriate. Under such circumstances, the ability to inhibit the obsolete action and to update behavior can be of vital importance. Previous lesion and neuroimaging studies have shown that the right prefrontal cortex and the basal ganglia seem to play an important role in the inhibition of already initiated motor responses. The present study was designed to investigate whether the neural activity of inhibitory motor control was altered if the inhibition process was succeeded by an additional process, namely the reengagement into an alternative action. Therefore, cerebral blood oxygenation during performance of a stop-change paradigm was registered in 15 male participants using event-related functional magnetic resonance imaging. Data analysis showed, that during successful and failed stopping and changing (response inhibition and subsequent response reengagement) of initiated motor responses a very similar network was activated including primarily the right inferior frontal cortex (IFC). Besides, stopping-related activation in right IFC was significantly greater for fast inhibitors than for slow ones. Results of the present study thus further underline the important role of right IFC in response inhibition and suggest that the inhibition process functions similarly regardless whether changing task demands require the complete suppression of an already initiated motor response or its suppression and a subsequent response reengagement into an alternative action.

Modulation of visual cortical excitability by working memory: effect of luminance contrast of mental imagery

Although much is known about the impact of stimulus properties such as luminance contrast, spatial frequency, and orientation on visually evoked neural activity, much less is known about how they modulate neural activity when they are properties of a mental image held in working memory (WM). Here we addressed this question by investigating how a parametric manipulation of an imagined stimulus attribute affects neuronal excitability in the early visual cortex. We manipulated luminance contrast, a stimulus property known to strongly affect the magnitude of neuronal responses in early visual areas. Luminance contrast modulated neuronal excitability, as assessed by the frequency of phosphenes induced by transcranial magnetic stimulation (TMS) with the exact nature of this modulation depending on TMS intensity. These results point to a strong overlap in the neuronal processes underlying visual perception and mental imagery: not only does WM maintenance selectively engage neurons which are tuned to the maintained attribute (as has previously been shown), but the extent to which those neurons are activated depends on the image contrast (as is the case with visually evoked responses). From a methodological viewpoint, these results suggest that assessment of visual cortical excitability using TMS is affected by the TMS intensity used to probe the neuronal population.

Pivotal role of anterior cingulate cortex in working memory after traumatic brain injury in youth

In this fMRI study, the functions of the anterior cingulate cortex (ACC) were studied in a group of adolescents who had sustained a moderate to severe traumatic brain injury (TBI). A spatial working memory task with varying working memory loads, representing experimental conditions of increasing difficulty, was administered. In a cross-sectional comparison between the patients and a matched control group, patients performed worse than Controls, showing longer reaction times and lower response accuracy on the spatial working memory task. Brain imaging findings suggest a possible double-dissociation: activity of the ACC in the TBI group, but not in the Control group, was associated with task difficulty; conversely, activity of the left sensorimotor cortex (lSMC) in the Control group, but not in the TBI group, was correlated with task difficulty. In addition to the main cross-sectional study, a longitudinal study of a group of adolescent patients with moderate to severe TBI was done using fMRI and the same spatial working memory task. The patient group was studied at two time-points: one time-point during the post-acute phase and one time-point 12 months later, during the chronic phase. Results indicated that patients' behavioral performance improved over time, suggesting cognitive recovery. Brain imaging findings suggest that, over this 12-month period, patients recruited less of the ACC and more of the lSMC in response to increasing task difficulty. The role of ACC in executive functions following a moderate to severe brain injury in adolescence is discussed within the context of conflicting models of the ACC functions in the existing literature.

Mental imagery of speech and movement implicates the dynamics of internal forward models

The classical concept of efference copies in the context of internal forward models has stimulated productive research in cognitive science and neuroscience. There are compelling reasons to argue for such a mechanism, but finding direct evidence in the human brain remains difficult. Here we investigate the dynamics of internal forward models from an unconventional angle: mental imagery, assessed while recording high temporal resolution neuronal activity using magnetoencephalography. We compare two overt and covert tasks; our covert, mental imagery tasks are unconfounded by overt input/output demands – but in turn necessitate the development of appropriate multi-dimensional topographic analyses. Finger tapping (studies 1 and 2) and speech experiments (studies 3–5) provide temporally constrained results that implicate the estimation of an efference copy. We suggest that one internal forward model over parietal cortex subserves the kinesthetic feeling in motor imagery. Secondly, observed auditory neural activity ~170 ms after motor estimation in speech experiments (studies 3–5) demonstrates the anticipated auditory consequences of planned motor commands in a second internal forward model in imagery of speech production. Our results provide neurophysiological evidence from the human brain in favor of internal forward models deploying efference copies in somatosensory and auditory cortex, in finger tapping and speech production tasks, respectively, and also suggest the dynamics and sequential updating structure of internal forward models.

Brain Network Dynamics Underlying Visuospatial Judgment: An fMRI Connectivity Study

Previous functional imaging research has consistently indicated involvement of bilateral fronto-parietal networks during the execution of visuospatial tasks. Studies with TMS have suggested that the right hemispheric network, but not the left, is functionally relevant for visuospatial judgments. However, very little is still known about the interactions within these fronto-parietal networks underlying visuospatial processing. In the current study, we investigated task modulation of functional connectivity (instantaneous correlations of regional time courses), and task-specific effective connectivity (direction of influences), within the right fronto-parietal network activated during visuospatial judgments. Ten healthy volunteers performed a behaviorally controlled visuospatial judgment task (ANGLE) or a control task (COLOR) in an fMRI experiment. Visuospatial task-specific activations were found in posterior parietal cortex (PPC) and middle/inferior frontal gyrus (MFG). Functional connectivity within this network was task-modulated, with significantly higher connectivity between PPC and MFG during ANGLE than during COLOR. Effective connectivity analysis for directed influence revealed that visuospatial task-specific projections within this network were predominantly in a frontal-to-parietal direction. Moreover, ANGLE-specific influences from thalamic nuclei to PPC were identified. Exploratory effective connectivity analysis revealed that closely neighboring clusters, within visuospatial regions, were differentially involved in the network. These neighboring clusters had opposite effective connectivity patterns to other nodes of the fronto-parietal network. Our data thus reveal that visuospatial judgments are supported by massive fronto-parietal backprojections, thalamo-parietal influence, and multiple stages, or loops, of information flow within the visuospatial network. We speculate on possible functional contributions of the various network nodes and informational loops in a neurocognitive model.

Foreseeing the future: occurrence probability of imagined future events modulates hippocampal activation

Episodic memory and episodic future thinking are known to share a set of brain regions. Potential differences in activation patterns associated with the two conditions are as yet inconclusive, in particular with respect to hippocampal involvement. Hippocampal activation is modulated by a range of phenomenal qualities during the imagination of both past and future events (Addis et al. (2004) Hippocampus 14:752-762; Addis and Schacter (2008) Hippocampus 18:227-237). A relevant variable in this regard is the occurrence probability of an episode, which varies for future but not past events and thus cannot be equated across conditions. Using parametric modulation analysis, we investigated the effect of occurrence probability of imagined future events on brain activation patterns, while effects of temporal distance, amount of details, and emotionality were controlled for. Activation of right anterior hippocampus increased with decreasing occurrence probability, presumably reflecting higher processing demands during binding of more disparate details for unlikely events. This finding may contribute to the understanding of previously reported inconsistent results concerning hippocampal involvement during the imagination of past and future events.

Seeing with the mind's eye: top-down, bottom-up, and conscious awareness

With the advent of functional brain imaging techniques and recent developments in the analysis of cortical connectivity, the focus of mental imagery studies has shifted from a semi-modular approach to an integrated cortical network perspective. Functional magnetic resonance imaging studies of visual imagery of faces and objects show that activation of content-specific representations stored in the ventral visual stream is top-down-modulated by parietal and frontal regions. Recent findings in patients with conscious awareness disorders reveal that mental imagery can be used to map patterns of residual cognitive function in their brain and to provide diagnostic and prognostic indicators.

A comparison of Granger causality and coherency in fMRI-based analysis of the motor system

The ability of functional MRI to acquire data from multiple brain areas has spurred developments not only in voxel-by-voxel analyses, but also in multivariate techniques critical to quantifying the interactions between brain areas. As the number of multivariate techniques multiplies, however, few studies in any modality have directly compared different connectivity measures, and fewer still have done so in the context of well-characterized neural systems. To focus specifically on the temporal dimension of interactions between brain regions, we compared Granger causality and coherency (Sun et al., 2004, 2005: Neuroimage 21:647-658, Neuroimage 28:227-237) in a well-studied motor system (1) to gain further insight into the convergent and divergent results expected from each technique, and (2) to investigate the leading and lagging influences between motor areas as subjects performed a motor task in which they produced different learned series of eight button presses. We found that these analyses gave convergent but not identical results: both techniques, for example, suggested an anterior-to-posterior temporal gradient of activity from supplemental motor area through premotor and motor cortices to the posterior parietal cortex, but the techniques were differentially sensitive to the coupling strength between areas. We also found practical reasons that might argue for the use of one technique over another in different experimental situations. Ultimately, the ideal approach to fMRI data analysis is likely to involve a complementary combination of methods, possibly including both Granger causality and coherency.

FMRI effective connectivity and TMS chronometry: complementary accounts of causality in the visuospatial judgment network

BACKGROUND

While traditionally quite distinct, functional neuroimaging (e.g. functional magnetic resonance imaging: fMRI) and functional interference techniques (e.g. transcranial magnetic stimulation: TMS) increasingly address similar questions of functional brain organization, including connectivity, interactions, and causality in the brain. Time-resolved TMS over multiple brain network nodes can elucidate the relative timings of functional relevance for behavior ("TMS chronometry"), while fMRI functional or effective connectivity (fMRI EC) can map task-specific interactions between brain regions based on the interrelation of measured signals. The current study empirically assessed the relation between these different methods.

METHODOLOGY/PRINCIPAL FINDINGS

One group of 15 participants took part in two experiments: one fMRI EC study, and one TMS chronometry study, both of which used an established cognitive paradigm involving one visuospatial judgment task and one color judgment control task. Granger causality mapping (GCM), a data-driven variant of fMRI EC analysis, revealed a frontal-to-parietal flow of information, from inferior/middle frontal gyrus (MFG) to posterior parietal cortex (PPC). FMRI EC-guided Neuronavigated TMS had behavioral effects when applied to both PPC and to MFG, but the temporal pattern of these effects was similar for both stimulation sites. At first glance, this would seem in contradiction to the fMRI EC results. However, we discuss how TMS chronometry and fMRI EC are conceptually different and show how they can be complementary and mutually constraining, rather than contradictory, on the basis of our data.

CONCLUSIONS/SIGNIFICANCE

The findings that fMRI EC could successfully localize functionally relevant TMS target regions on the single subject level, and conversely, that TMS confirmed an fMRI EC identified functional network to be behaviorally relevant, have important methodological and theoretical implications. Our results, in combination with data from earlier studies by our group (Sack et al., 2007, Cerebral Cortex), lead to informed speculations on complex brain mechanisms, and TMS disruption thereof, underlying visuospatial judgment. This first in-depth empirical and conceptual comparison of fMRI EC and TMS chronometry thereby shows the complementary insights offered by the two methods.

Imagining predictions: mental imagery as mental emulation

We argue that the primary function of mental imagery is to allow us to generate specific predictions based upon past experience. All imagery allows us to answer 'what if' questions by making explicit and accessible the likely consequences of being in a specific situation or performing a specific action. Imagery is also characterized by its reliance on perceptual representations and activation of perceptual brain systems. We use this conception of imagery to argue that all imagery is simulation-more specifically, it is a specific type of simulation in which the mental processes that 'run' the simulation emulate those that would actually operate in the simulated scenario. This type of simulation, which we label emulation, has benefits over other types of simulations that merely mimic the content of the simulated scenario.

Brain activation during anticipation of sound sequences

Music consists of sound sequences that require integration over time. As we become familiar with music, associations between notes, melodies, and entire symphonic movements become stronger and more complex. These associations can become so tight that, for example, hearing the end of one album track can elicit a robust image of the upcoming track while anticipating it in total silence. Here, we study this predictive "anticipatory imagery" at various stages throughout learning and investigate activity changes in corresponding neural structures using functional magnetic resonance imaging. Anticipatory imagery (in silence) for highly familiar naturalistic music was accompanied by pronounced activity in rostral prefrontal cortex (PFC) and premotor areas. Examining changes in the neural bases of anticipatory imagery during two stages of learning conditional associations between simple melodies, however, demonstrates the importance of fronto-striatal connections, consistent with a role of the basal ganglia in "training" frontal cortex (Pasupathy and Miller, 2005). Another striking change in neural resources during learning was a shift between caudal PFC earlier to rostral PFC later in learning. Our findings regarding musical anticipation and sound sequence learning are highly compatible with studies of motor sequence learning, suggesting common predictive mechanisms in both domains.