Look Hear! The Prefrontal Cortex is Stratified by Modality of Sensory Input During Multisensory Cognitive Control

The auditory stimulus facilitates memory guidance in distractor suppression in males with substance use disorder

Introduction

Representations in working memory can affect distractor suppression in human visual search, and this process is modulated by a separate top-down cognitive control. An increasing body of research has demonstrated that patients with substance use disorder (SUD) have deficits in cognitive control over filtering interference by perceptual distractors. However, their ability to resist proactive interference from working memory has received comparatively less attention.

Methods

Here, we investigate this issue by employing a working memory/visual search dual-task paradigm. An intervening gap-location search task was instructed to be performed while participants memorized a written color word, with congruent auditory information present during the memory encoding phase on half of the trials.

Results

Results showed that there was a reliable response time (RT) advantage when the meaning of the memory sample agreed with the color of one of the distractors under the visual alone condition. However, such a result was only found in the control group. More importantly, both groups exhibited comparable facilitation under the audiovisual condition, with the facilitation effect appearing later in the SUD group. Furthermore, the facilitation effect was superior in magnitude and time course under the audiovisual condition to the visual alone condition.

Discussion

These findings highlight how patients with SUD resist distractor interference at the memory level and extend our understanding of how working memory, selective attention, and audiovisual enhancement interact to optimize perceptual decisions in patients with SUD.

Domain general frontoparietal regions show modality-dependent coding of auditory and visual rules

A defining feature of human cognition is our ability to respond flexibly to what we see and hear, changing how we respond depending on our current goals. In fact, we can rapidly associate almost any input stimulus with any arbitrary behavioural response. This remarkable ability is thought to depend on a frontoparietal "multiple demand" circuit which is engaged by many types of cognitive demand and widely referred to as domain general. However, it is not clear how responses to multiple input modalities are structured within this system. Domain generality could be achieved by holding information in an abstract form that generalises over input modality, or in a modality-tagged form, which uses similar resources but produces unique codes to represent the information in each modality. We used a stimulus-response task, with conceptually identical rules in two sensory modalities (visual and auditory), to distinguish between these possibilities. Multivariate decoding of functional magnetic resonance imaging data showed that representations of visual and auditory rules recruited overlapping neural resources but were expressed in modality-tagged non-generalisable neural codes. Our data suggest that this frontoparietal system may draw on the same or similar resources to solve multiple tasks, but does not create modality-general representations of task rules, even when those rules are conceptually identical between domains.

Multi-modal Representation of the Size of Space in the Human Brain

To estimate the size of an indoor space, we must analyze the visual boundaries that limit the spatial extent and acoustic cues from reflected interior surfaces. We used fMRI to examine how the brain processes the geometric size of indoor scenes when various types of sensory cues are presented individually or together. Specifically, we asked whether the size of space is represented in a modality-specific way or in an integrative way that combines multimodal cues. In a block-design study, images or sounds that depict small- and large-sized indoor spaces were presented. Visual stimuli were real-world pictures of empty spaces that were small or large. Auditory stimuli were sounds convolved with different reverberations. By using a multivoxel pattern classifier, we asked whether the two sizes of space can be classified in visual, auditory, and visual-auditory combined conditions. We identified both sensory-specific and multimodal representations of the size of space. To further investigate the nature of the multimodal region, we specifically examined whether it contained multimodal information in a coexistent or integrated form. We found that angular gyrus and the right medial frontal gyrus had modality-integrated representation, displaying sensitivity to the match in the spatial size information conveyed through image and sound. Background functional connectivity analysis further demonstrated that the connection between sensory-specific regions and modality-integrated regions increases in the multimodal condition compared with single modality conditions. Our results suggest that spatial size perception relies on both sensory-specific and multimodal representations, as well as their interplay during multimodal perception.

Extended Frontal Networks for Visual and Auditory Working Memory

Working memory (WM) supports the persistent representation of transient sensory information. Visual and auditory stimuli place different demands on WM and recruit different brain networks. Separate auditory- and visual-biased WM networks extend into the frontal lobes, but several challenges confront attempts to parcellate human frontal cortex, including fine-grained organization and between-subject variability. Here, we use differential intrinsic functional connectivity from 2 visual-biased and 2 auditory-biased frontal structures to identify additional candidate sensory-biased regions in frontal cortex. We then examine direct contrasts of task functional magnetic resonance imaging during visual versus auditory 2-back WM to validate those candidate regions. Three visual-biased and 5 auditory-biased regions are robustly activated bilaterally in the frontal lobes of individual subjects (N = 14, 7 women). These regions exhibit a sensory preference during passive exposure to task stimuli, and that preference is stronger during WM. Hierarchical clustering analysis of intrinsic connectivity among novel and previously identified bilateral sensory-biased regions confirms that they functionally segregate into visual and auditory networks, even though the networks are anatomically interdigitated. We also observe that the frontotemporal auditory WM network is highly selective and exhibits strong functional connectivity to structures serving non-WM functions, while the frontoparietal visual WM network hierarchically merges into the multiple-demand cognitive system.

Stroop-related cerebellar and temporal activation is correlated with negative affect and alcohol use disorder severity

Impairment in cognitive control in alcohol use disorder (AUD) contributes to difficulty controlling alcohol use and, in many populations, difficulties with emotion regulation. However, the most reliable and robust marker of clinically-relevant deficits in cognitive control in AUD is unclear. Our aims were to measure relationships between BOLD signal during a Stroop task and AUD severity and change in BOLD signal and change in drinking over three weeks. We also aimed to explore the relationships between BOLD signal and subjective negative affect. Thirty-three individuals with AUD underwent a multisensory Stroop task during functional magnetic resonance imaging (fMRI), as well as a battery of neuropsychological tests and self-report assessments of negative affect and AUD severity. Greater activation in temporal gyrus and cerebellum during incongruent trials compared to congruent trials was observed, and percent signal change (incongruent minus congruent) in both clusters was positively correlated with AUD severity and self-reported negative affect. Neuropsychological task performance and self-reported impulsivity were not highly correlated with AUD severity. Hierarchical regression analyses indicated that percent signal change (incongruent minus congruent) in cerebellum was independently associated with negative affect after controlling for recent and chronic drinking. In a subset of individuals (n = 23) reduction in cerebellar percent signal change (incongruent minus congruent) was correlated with increases in percent days abstinent over 3 weeks. BOLD activation during this Stroop task may therefore be an important objective marker of AUD severity and negative affect. The potential importance of the cerebellum in emotion regulation and AUD severity is highlighted.

Supramodal Mechanisms of the Cognitive Control Network in Uncertainty Processing

Information processing under conditions of uncertainty requires the involvement of cognitive control. Despite behavioral evidence of the supramodal function (i.e., independent of sensory modality) of cognitive control, the underlying neural mechanism needs to be directly tested. This study used functional magnetic imaging together with visual and auditory perceptual decision-making tasks to examine brain activation as a function of uncertainty in the two stimulus modalities. The results revealed a monotonic increase in activation in the cortical regions of the cognitive control network (CCN) as a function of uncertainty in the visual and auditory modalities. The intrinsic connectivity between the CCN and sensory regions was similar for the visual and auditory modalities. Furthermore, multivariate patterns of activation in the CCN predicted the level of uncertainty within and across stimulus modalities. These findings suggest that the CCN implements cognitive control by processing uncertainty as abstract information independent of stimulus modality.

A comparison of denoising pipelines in high temporal resolution task-based functional magnetic resonance imaging data

It has been known for decades that head motion/other artifacts affect the blood oxygen level-dependent signal. Recent recommendations predominantly focus on denoising resting state data, which may not apply to task data due to the different statistical relationships that exist between signal and noise sources. Several blind-source denoising strategies (FIX and AROMA) and more standard motion parameter (MP) regression (0, 12, or 24 parameters) analyses were therefore compared across four sets of event-related functional magnetic resonance imaging (erfMRI) and block-design (bdfMRI) datasets collected with multiband 32- (repetition time [TR] = 460 ms) or older 12-channel (TR = 2,000 ms) head coils. The amount of motion varied across coil designs and task types. Quality control plots indicated small to moderate relationships between head motion estimates and percent signal change in both signal and noise regions. Blind-source denoising strategies eliminated signal as well as noise relative to MP24 regression; however, the undesired effects on signal depended both on algorithm (FIX > AROMA) and design (bdfMRI > erfMRI). Moreover, in contrast to previous results, there were minimal differences between MP12/24 and MP0 pipelines in both erfMRI and bdfMRI designs. MP12/24 pipelines were detrimental for a task with both longer block length (30 ± 5 s) and higher correlations between head MPs and design matrix. In summary, current results suggest that there does not appear to be a single denoising approach that is appropriate for all fMRI designs. However, even nonaggressive blind-source denoising approaches appear to remove signal as well as noise from task-related data at individual subject and group levels.

Prediction of individualized task activation in sensory modality-selective frontal cortex with 'connectome fingerprinting'

The human cerebral cortex is estimated to comprise 200-300 distinct functional regions per hemisphere. Identification of the precise anatomical location of an individual's unique set of functional regions is a challenge for neuroscience that has broad scientific and clinical utility. Recent studies have demonstrated the existence of four interleaved regions in lateral frontal cortex (LFC) that are part of broader visual attention and auditory attention networks (Michalka et al., 2015; Noyce et al., 2017; Tobyne et al., 2017). Due to a large degree of inter-subject anatomical variability, identification of these regions depends critically on within-subject analyses. Here, we demonstrate that, for both sexes, an individual's unique pattern of resting-state functional connectivity can accurately identify their specific pattern of visual- and auditory-selective working memory and attention task activation in lateral frontal cortex (LFC) using "connectome fingerprinting." Building on prior techniques (Saygin et al., 2011; Osher et al., 2016; Tavor et al., 2016; Smittenaar et al., 2017; Wang et al., 2017; Parker Jones et al., 2017), we demonstrate here that connectome fingerprint predictions are far more accurate than group-average predictions and match the accuracy of within-subject task-based functional localization, while requiring less data. These findings are robust across brain parcellations and are improved with penalized regression methods. Because resting-state data can be easily and rapidly collected, these results have broad implications for both clinical and research investigations of frontal lobe function. Our findings also provide a set of recommendations for future research.

Sensory-biased attention networks in human lateral frontal cortex revealed by intrinsic functional connectivity

Human frontal cortex is commonly described as being insensitive to sensory modality, however several recent studies cast doubt on this view. Our laboratory previously reported two visual-biased attention regions interleaved with two auditory-biased attention regions, bilaterally, within lateral frontal cortex. These regions selectively formed functional networks with posterior visual-biased and auditory-biased attention regions. Here, we conducted a series of functional connectivity analyses to validate and expand this analysis to 469 subjects from the Human Connectome Project (HCP). Functional connectivity analyses replicated the original findings and revealed a novel hemispheric connectivity bias. We also subdivided lateral frontal cortex into 21 thin-slice ROIs and observed bilateral patterns of spatially alternating visual-biased and auditory-biased attention network connectivity. Finally, we performed a correlation difference analysis that revealed five additional bilateral lateral frontal regions differentially connected to either the visual-biased or auditory-biased attention networks. These findings leverage the HCP dataset to demonstrate that sensory-biased attention networks may have widespread influence in lateral frontal cortical organization.

Sensory-Biased and Multiple-Demand Processing in Human Lateral Frontal Cortex

The functionality of much of human lateral frontal cortex (LFC) has been characterized as "multiple demand" (MD) as these regions appear to support a broad range of cognitive tasks. In contrast to this domain-general account, recent evidence indicates that portions of LFC are consistently selective for sensory modality. Michalka et al. (2015) reported two bilateral regions that are biased for visual attention, superior precentral sulcus (sPCS) and inferior precentral sulcus (iPCS), interleaved with two bilateral regions that are biased for auditory attention, transverse gyrus intersecting precentral sulcus (tgPCS) and caudal inferior frontal sulcus (cIFS). In the present study, we use fMRI to examine both the multiple-demand and sensory-bias hypotheses within caudal portions of human LFC (both men and women participated). Using visual and auditory 2-back tasks, we replicate the finding of two bilateral visual-biased and two bilateral auditory-biased LFC regions, corresponding to sPCS and iPCS and to tgPCS and cIFS, and demonstrate high within-subject reliability of these regions over time and across tasks. In addition, we assess MD responsiveness using BOLD signal recruitment and multi-task activation indices. In both, we find that the two visual-biased regions, sPCS and iPCS, exhibit stronger MD responsiveness than do the auditory-biased LFC regions, tgPCS and cIFS; however, neither reaches the degree of MD responsiveness exhibited by dorsal anterior cingulate/presupplemental motor area or by anterior insula. These results reconcile two competing views of LFC by demonstrating the coexistence of sensory specialization and MD functionality, especially in visual-biased LFC structures.SIGNIFICANCE STATEMENT Lateral frontal cortex (LFC) is known to play a number of critical roles in supporting human cognition; however, the functional organization of LFC remains controversial. The "multiple demand" (MD) hypothesis suggests that LFC regions provide domain-general support for cognition. Recent evidence challenges the MD view by demonstrating that a preference for sensory modality, vision or audition, defines four discrete LFC regions. Here, the sensory-biased LFC results are reproduced using a new task, and MD responsiveness of these regions is tested. The two visual-biased regions exhibit MD behavior, whereas the auditory-biased regions have no more than weak MD responses. These findings help to reconcile two competing views of LFC functional organization.

Auditory and visual connectivity gradients in frontoparietal cortex

A frontoparietal network of brain regions is often implicated in both auditory and visual information processing. Although it is possible that the same set of multimodal regions subserves both modalities, there is increasing evidence that there is a differentiation of sensory function within frontoparietal cortex. Magnetic resonance imaging (MRI) in humans was used to investigate whether different frontoparietal regions showed intrinsic biases in connectivity with visual or auditory modalities. Structural connectivity was assessed with diffusion tractography and functional connectivity was tested using functional MRI. A dorsal-ventral gradient of function was observed, where connectivity with visual cortex dominates dorsal frontal and parietal connections, while connectivity with auditory cortex dominates ventral frontal and parietal regions. A gradient was also observed along the posterior-anterior axis, although in opposite directions in prefrontal and parietal cortices. The results suggest that the location of neural activity within frontoparietal cortex may be influenced by these intrinsic biases toward visual and auditory processing. Thus, the location of activity in frontoparietal cortex may be influenced as much by stimulus modality as the cognitive demands of a task. It was concluded that stimulus modality was spatially encoded throughout frontal and parietal cortices, and was speculated that such an arrangement allows for top-down modulation of modality-specific information to occur within higher-order cortex. This could provide a potentially faster and more efficient pathway by which top-down selection between sensory modalities could occur, by constraining modulations to within frontal and parietal regions, rather than long-range connections to sensory cortices. Hum Brain Mapp 38:255-270, 2017. © 2016 Wiley Periodicals, Inc.