Short-Term Memory for Space and Time Flexibly Recruit Complementary Sensory-Biased Frontal Lobe Attention Networks

Perceptual coupling in human dyads: Kinematics does not affect interpersonal synchronization

The minimal, essential condition for individuals to interact is that they exchange information via at least one sensory channel. Once informational coupling is established, it enables basic forms of coordinated behavior to spontaneously emerge from the interaction. Our previous study revealed different coordination dynamics in dyads engaged in a joint finger-tapping task based on visual versus auditory coupling. This observation led us to propose the 'modality-dependent hypothesis', which posits that coordination dynamics are influenced by the sensory modality mediating informational coupling. However, recognizing that different modalities have inherent differences in accessing spatiotemporal features of perceived movement, we formulated the alternative 'kinematic hypothesis'. This hypothesis posits that differences in dynamics would vanish given equivalent kinematic information across modalities. The study involved forty (N = 40) participants, grouped into twenty (N = 20) dyads, who engaged in a joint finger-tapping task. This task was conducted under varying conditions of visual and auditory coupling, with manipulations in the access to kinematic information, categorized as discrete and continuous. Contrary to our initial predictions, the results strongly supported the 'modality-dependent hypothesis'. We observed that visual and auditory coupling consistently yielded distinct attractor dynamics, regardless of the access to kinematic information. Furthermore, all conditions of auditory coupling resulted in higher levels of synchronization than their visual counterparts. These findings suggest that the differences in interpersonal synchronization are predominantly influenced by the sensory modality, rather than the continuity of kinematic information. Our study highlights the significance of sensorimotor interactions in interpersonal synchronization and addresses the potential of sonification strategies in supporting motor training and rehabilitation.

Utilizing connectome fingerprinting functional MRI models for motor activity prediction in presurgical planning: A feasibility study

Presurgical planning prior to brain tumor resection is critical for the preservation of neurologic function post-operatively. Neurosurgeons increasingly use advanced brain mapping techniques pre- and intra-operatively to delineate brain regions which are "eloquent" and should be spared during resection. Functional MRI (fMRI) has emerged as a commonly used non-invasive modality for individual patient mapping of critical cortical regions such as motor, language, and visual cortices. To map motor function, patients are scanned using fMRI while they perform various motor tasks to identify brain networks critical for motor performance, but it may be difficult for some patients to perform tasks in the scanner due to pre-existing deficits. Connectome fingerprinting (CF) is a machine-learning approach that learns associations between resting-state functional networks of a brain region and the activations in the region for specific tasks; once a CF model is constructed, individualized predictions of task activation can be generated from resting-state data. Here we utilized CF to train models on high-quality data from 208 subjects in the Human Connectome Project (HCP) and used this to predict task activations in our cohort of healthy control subjects (n = 15) and presurgical patients (n = 16) using resting-state fMRI (rs-fMRI) data. The prediction quality was validated with task fMRI data in the healthy controls and patients. We found that the task predictions for motor areas are on par with actual task activations in most healthy subjects (model accuracy around 90%-100% of task stability) and some patients suggesting the CF models can be reliably substituted where task data is either not possible to collect or hard for subjects to perform. We were also able to make robust predictions in cases in which there were no task-related activations elicited. The findings demonstrate the utility of the CF approach for predicting activations in out-of-sample subjects, across sites and scanners, and in patient populations. This work supports the feasibility of the application of CF models to presurgical planning, while also revealing challenges to be addressed in future developments. PRACTITIONER POINTS: Precision motor network prediction using connectome fingerprinting. Carefully trained models' performance limited by stability of task-fMRI data. Successful cross-scanner predictions and motor network mapping in patients with tumor.

Task and stimulus coding in the multiple-demand network

In the human brain, a multiple-demand (MD) network plays a key role in cognitive control, with core components in lateral frontal, dorsomedial frontal and lateral parietal cortex, and multivariate activity patterns that discriminate the contents of many cognitive activities. In prefrontal cortex of the behaving monkey, different cognitive operations are associated with very different patterns of neural activity, while details of a particular stimulus are encoded as small variations on these basic patterns (Sigala et al, 2008). Here, using the advanced fMRI methods of the Human Connectome Project and their 360-region cortical parcellation, we searched for a similar result in MD activation patterns. In each parcel, we compared multivertex patterns for every combination of three tasks (working memory, task-switching, and stop-signal) and two stimulus classes (faces and buildings). Though both task and stimulus category were discriminated in every cortical parcel, the strength of discrimination varied strongly across parcels. The different cognitive operations of the three tasks were strongly discriminated in MD regions. Stimulus categories, in contrast, were most strongly discriminated in a large region of primary and higher visual cortex, and intriguingly, in both parietal and frontal lobe regions adjacent to core MD regions. In the monkey, frontal neurons show a strong pattern of nonlinear mixed selectivity, with activity reflecting specific conjunctions of task events. In our data, however, there was limited evidence for mixed selectivity; throughout the brain, discriminations of task and stimulus combined largely linearly, with a small nonlinear component. In MD regions, human fMRI data recapitulate some but not all aspects of electrophysiological data from nonhuman primates.

Organization of the human cerebral cortex estimated within individuals: networks, global topography, and function

The cerebral cortex is populated by specialized regions that are organized into networks. Here we estimated networks from functional MRI (fMRI) data in intensively sampled participants. The procedure was developed in two participants (scanned 31 times) and then prospectively applied to 15 participants (scanned 8-11 times). Analysis of the networks revealed a global organization. Locally organized first-order sensory and motor networks were surrounded by spatially adjacent second-order networks that linked to distant regions. Third-order networks possessed regions distributed widely throughout association cortex. Regions of distinct third-order networks displayed side-by-side juxtapositions with a pattern that repeated across multiple cortical zones. We refer to these as supra-areal association megaclusters (SAAMs). Within each SAAM, two candidate control regions were adjacent to three separate domain-specialized regions. Response properties were explored with task data. The somatomotor and visual networks responded to body movements and visual stimulation, respectively. Second-order networks responded to transients in an oddball detection task, consistent with a role in orienting to salient events. The third-order networks, including distinct regions within each SAAM, showed two levels of functional specialization. Regions linked to candidate control networks responded to working memory load across multiple stimulus domains. The remaining regions dissociated across language, social, and spatial/episodic processing domains. These results suggest that progressively higher-order networks nest outward from primary sensory and motor cortices. Within the apex zones of association cortex, there is specialization that repeatedly divides domain-flexible from domain-specialized regions. We discuss implications of these findings, including how repeating organizational motifs may emerge during development.NEW & NOTEWORTHY The organization of cerebral networks was estimated within individuals with intensive, repeat sampling of fMRI data. A hierarchical organization emerged in each individual that delineated first-, second-, and third-order cortical networks. Regions of distinct third-order association networks consistently exhibited side-by-side juxtapositions that repeated across multiple cortical zones, with clear and robust functional specialization among the embedded regions.

Principles of cortical areas and their implications for neuroimaging

Cortical organization should constrain the study of how the brain performs behavior and cognition. A fundamental concept in cortical organization is that of arealization: that the cortex is parceled into discrete areas. In part one of this report, we review how non-human animal studies have illuminated principles of cortical arealization by revealing: (1) what defines a cortical area, (2) how cortical areas are formed, (3) how cortical areas interact with one another, and (4) what "computations" or "functions" areas perform. In part two, we discuss how these principles apply to neuroimaging research. In doing so, we highlight several examples where the commonly accepted interpretation of neuroimaging observations requires assumptions that violate the principles of arealization, including nonstationary areas that move on short time scales, large-scale gradients as organizing features, and cortical areas with singular functionality that perfectly map psychological constructs. Our belief is that principles of neurobiology should strongly guide the nature of computational explanations.

Domain general frontoparietal regions show modality-dependent coding of auditory and visual rules

A defining feature of human cognition is our ability to respond flexibly to what we see and hear, changing how we respond depending on our current goals. In fact, we can rapidly associate almost any input stimulus with any arbitrary behavioural response. This remarkable ability is thought to depend on a frontoparietal "multiple demand" circuit which is engaged by many types of cognitive demand and widely referred to as domain general. However, it is not clear how responses to multiple input modalities are structured within this system. Domain generality could be achieved by holding information in an abstract form that generalises over input modality, or in a modality-tagged form, which uses similar resources but produces unique codes to represent the information in each modality. We used a stimulus-response task, with conceptually identical rules in two sensory modalities (visual and auditory), to distinguish between these possibilities. Multivariate decoding of functional magnetic resonance imaging data showed that representations of visual and auditory rules recruited overlapping neural resources but were expressed in modality-tagged non-generalisable neural codes. Our data suggest that this frontoparietal system may draw on the same or similar resources to solve multiple tasks, but does not create modality-general representations of task rules, even when those rules are conceptually identical between domains.

Enhancing cognitive control with transcranial magnetic stimulation in subject-specific frontoparietal networks

BACKGROUND

Cognitive control processes, including those involving frontoparietal networks, are highly variable between individuals, posing challenges to basic and clinical sciences. While distinct frontoparietal networks have been associated with specific cognitive control functions such as switching, inhibition, and working memory updating functions, there have been few basic tests of the role of these networks at the individual level.

METHODS

To examine the role of cognitive control at the individual level, we conducted a within-subject excitatory transcranial magnetic stimulation (TMS) study in 19 healthy individuals that targeted intrinsic ("resting") frontoparietal networks. Person-specific intrinsic networks were identified with resting state functional magnetic resonance imaging scans to determine TMS targets. The participants performed three cognitive control tasks: an adapted Navon figure-ground task (requiring set switching), n-back (working memory), and Stroop color-word (inhibition).

OBJECTIVE

Hypothesis: We predicted that stimulating a network associated with externally oriented control [the "FPCN-B" (fronto-parietal control network)] would improve performance on the set switching and working memory task relative to a network associated with attention (the Dorsal Attention Network, DAN) and cranial vertex in a full within-subjects crossover design.

RESULTS

We found that set switching performance was enhanced by FPCN-B stimulation along with some evidence of enhancement in the higher-demand n-back conditions.

CONCLUSION

Higher task demands or proactive control might be a distinguishing role of the FPCN-B, and personalized intrinsic network targeting is feasible in TMS designs.

Superior Attentional Efficiency of Auditory Cue via the Ventral Auditory-thalamic Pathway

Auditory commands are often executed more efficiently than visual commands. However, empirical evidence on the underlying behavioral and neural mechanisms remains scarce. In two experiments, we manipulated the delivery modality of informative cues and the prediction violation effect and found consistently enhanced RT benefits for the matched auditory cues compared with the matched visual cues. At the neural level, when the bottom-up perceptual input matched the prior prediction induced by the auditory cue, the auditory-thalamic pathway was significantly activated. Moreover, the stronger the auditory-thalamic connectivity, the higher the behavioral benefits of the matched auditory cue. When the bottom-up input violated the prior prediction induced by the auditory cue, the ventral auditory pathway was specifically involved. Moreover, the stronger the ventral auditory-prefrontal connectivity, the larger the behavioral costs caused by the violation of the auditory cue. In addition, the dorsal frontoparietal network showed a supramodal function in reacting to the violation of informative cues irrespective of the delivery modality of the cue. Taken together, the results reveal novel behavioral and neural evidence that the superior efficiency of the auditory cue is twofold: The auditory-thalamic pathway is associated with improvements in task performance when the bottom-up input matches the auditory cue, whereas the ventral auditory-prefrontal pathway is involved when the auditory cue is violated.

Multi-modal Representation of the Size of Space in the Human Brain

To estimate the size of an indoor space, we must analyze the visual boundaries that limit the spatial extent and acoustic cues from reflected interior surfaces. We used fMRI to examine how the brain processes the geometric size of indoor scenes when various types of sensory cues are presented individually or together. Specifically, we asked whether the size of space is represented in a modality-specific way or in an integrative way that combines multimodal cues. In a block-design study, images or sounds that depict small- and large-sized indoor spaces were presented. Visual stimuli were real-world pictures of empty spaces that were small or large. Auditory stimuli were sounds convolved with different reverberations. By using a multivoxel pattern classifier, we asked whether the two sizes of space can be classified in visual, auditory, and visual-auditory combined conditions. We identified both sensory-specific and multimodal representations of the size of space. To further investigate the nature of the multimodal region, we specifically examined whether it contained multimodal information in a coexistent or integrated form. We found that angular gyrus and the right medial frontal gyrus had modality-integrated representation, displaying sensitivity to the match in the spatial size information conveyed through image and sound. Background functional connectivity analysis further demonstrated that the connection between sensory-specific regions and modality-integrated regions increases in the multimodal condition compared with single modality conditions. Our results suggest that spatial size perception relies on both sensory-specific and multimodal representations, as well as their interplay during multimodal perception.

Basis of executive functions in fine-grained architecture of cortical and subcortical human brain networks

Theoretical models suggest that executive functions rely on both domain-general and domain-specific processes. Supporting this view, prior brain imaging studies have revealed that executive activations converge and diverge within broadly characterized brain networks. However, the lack of precise anatomical mappings has impeded our understanding of the interplay between domain-general and domain-specific processes. To address this challenge, we used the high-resolution multimodal magnetic resonance imaging approach of the Human Connectome Project to scan participants performing 3 canonical executive tasks: n-back, rule switching, and stop signal. The results reveal that, at the individual level, different executive activations converge within 9 domain-general territories distributed in frontal, parietal, and temporal cortices. Each task exhibits a unique topography characterized by finely detailed activation gradients within domain-general territory shifted toward adjacent resting-state networks; n-back activations shift toward the default mode, rule switching toward dorsal attention, and stop signal toward cingulo-opercular networks. Importantly, the strongest activations arise at multimodal neurobiological definitions of network borders. Matching results are seen in circumscribed regions of the caudate nucleus, thalamus, and cerebellum. The shifting peaks of local gradients at the intersection of task-specific networks provide a novel mechanistic insight into how partially-specialized networks interact with neighboring domain-general territories to generate distinct executive functions.

fNIRS Dataset During Complex Scene Analysis

When analyzing complex scenes, humans often focus their attention on an object at a particular spatial location. The ability to decode the attended spatial location would facilitate brain computer interfaces for complex scene analysis (CSA). Here, we investigated capability of functional near-infrared spectroscopy (fNIRS) to decode audio-visual spatial attention in the presence of competing stimuli from multiple locations. We targeted dorsal frontoparietal network including frontal eye field (FEF) and intra-parietal sulcus (IPS) as well as superior temporal gyrus/planum temporal (STG/PT). They all were shown in previous functional magnetic resonance imaging (fMRI) studies to be activated by auditory, visual, or audio-visual spatial tasks. To date, fNIRS has not been applied to decode auditory and visual-spatial attention during CSA, and thus, no such dataset exists yet. This report provides an open-access fNIRS dataset that can be used to develop, test, and compare machine learning algorithms for classifying attended locations based on the fNIRS signals on a single trial basis.

Prediction during language comprehension: what is next?

Prediction is often regarded as an integral aspect of incremental language comprehension, but little is known about the cognitive architectures and mechanisms that support it. We review studies showing that listeners and readers use all manner of contextual information to generate multifaceted predictions about upcoming input. The nature of these predictions may vary between individuals owing to differences in language experience, among other factors. We then turn to unresolved questions which may guide the search for the underlying mechanisms. (i) Is prediction essential to language processing or an optional strategy? (ii) Are predictions generated from within the language system or by domain-general processes? (iii) What is the relationship between prediction and memory? (iv) Does prediction in comprehension require simulation via the production system? We discuss promising directions for making progress in answering these questions and for developing a mechanistic understanding of prediction in language.

Within-Individual Organization of the Human Cerebral Cortex: Networks, Global Topography, and Function

The human cerebral cortex is populated by specialized regions that are organized into networks. Here we estimated networks using a Multi-Session Hierarchical Bayesian Model (MS-HBM) applied to intensively sampled within-individual functional MRI (fMRI) data. The network estimation procedure was initially developed and tested in two participants (each scanned 31 times) and then prospectively applied to 15 new participants (each scanned 8 to 11 times). Detailed analysis of the networks revealed a global organization. Locally organized first-order sensory and motor networks were surrounded by spatially adjacent second-order networks that also linked to distant regions. Third-order networks each possessed regions distributed widely throughout association cortex. Moreover, regions of distinct third-order networks displayed side-by-side juxtapositions with a pattern that repeated similarly across multiple cortical zones. We refer to these as Supra-Areal Association Megaclusters (SAAMs). Within each SAAM, two candidate control regions were typically adjacent to three separate domain-specialized regions. Independent task data were analyzed to explore functional response properties. The somatomotor and visual first-order networks responded to body movements and visual stimulation, respectively. A subset of the second-order networks responded to transients in an oddball detection task, consistent with a role in orienting to salient or novel events. The third-order networks, including distinct regions within each SAAM, showed two levels of functional specialization. Regions linked to candidate control networks responded to working memory load across multiple stimulus domains. The remaining regions within each SAAM did not track working memory load but rather dissociated across language, social, and spatial / episodic processing domains. These results support a model of the cerebral cortex in which progressively higher-order networks nest outwards from primary sensory and motor cortices. Within the apex zones of association cortex there is specialization of large-scale networks that divides domain-flexible from domain-specialized regions repeatedly across parietal, temporal, and prefrontal cortices. We discuss implications of these findings including how repeating organizational motifs may emerge during development.

Multi-modal representation of the size of space in the human brain

To estimate the size of an indoor space, we must analyze the visual boundaries that limit the spatial extent and acoustic cues from reflected interior surfaces. We used fMRI to examine how the brain processes geometric size of indoor scenes when various types of sensory cues are presented individually or together. Specifically, we asked whether the size of space is represented in a modality-specific way or in an integrative way that combines multimodal cues. In a block-design study, images or sounds that depict small and large sized indoor spaces were presented. Visual stimuli were real-world pictures of empty spaces that were small or large. Auditory stimuli were sounds convolved with different reverberation. By using a multi-voxel pattern classifier, we asked whether the two sizes of space can be classified in visual, auditory, and visual-auditory combined conditions. We identified both sensory specific and multimodal representations of the size of space. To further investigate the nature of the multimodal region, we specifically examined whether it contained multimodal information in a coexistent or integrated form. We found that AG and the right IFG pars opercularis had modality-integrated representation, displaying sensitivity to the match in the spatial size information conveyed through image and sound. Background functional connectivity analysis further demonstrated that the connection between sensory specific regions and modality-integrated regions increase in the multimodal condition compared to single modality conditions. Our results suggest that the spatial size perception relies on both sensory specific and multimodal representations, as well as their interplay during multimodal perception.

Induced alpha and beta electroencephalographic rhythms covary with single-trial speech intelligibility in competition

Neurophysiological studies suggest that intrinsic brain oscillations influence sensory processing, especially of rhythmic stimuli like speech. Prior work suggests that brain rhythms may mediate perceptual grouping and selective attention to speech amidst competing sound, as well as more linguistic aspects of speech processing like predictive coding. However, we know of no prior studies that have directly tested, at the single-trial level, whether brain oscillations relate to speech-in-noise outcomes. Here, we combined electroencephalography while simultaneously measuring intelligibility of spoken sentences amidst two different interfering sounds: multi-talker babble or speech-shaped noise. We find that induced parieto-occipital alpha (7-15 Hz; thought to modulate attentional focus) and frontal beta (13-30 Hz; associated with maintenance of the current sensorimotor state and predictive coding) oscillations covary with trial-wise percent-correct scores; importantly, alpha and beta power provide significant independent contributions to predicting single-trial behavioral outcomes. These results can inform models of speech processing and guide noninvasive measures to index different neural processes that together support complex listening.

Induced Alpha And Beta Electroencephalographic Rhythms Covary With Single-Trial Speech Intelligibility In Competition

Neurophysiological studies suggest that intrinsic brain oscillations influence sensory processing, especially of rhythmic stimuli like speech. Prior work suggests that brain rhythms may mediate perceptual grouping and selective attention to speech amidst competing sound, as well as more linguistic aspects of speech processing like predictive coding. However, we know of no prior studies that have directly tested, at the single-trial level, whether brain oscillations relate to speech-in-noise outcomes. Here, we combined electroencephalography while simultaneously measuring intelligibility of spoken sentences amidst two different interfering sounds: multi-talker babble or speech-shaped noise. We find that induced parieto-occipital alpha (7-15 Hz; thought to modulate attentional focus) and frontal beta (13-30 Hz; associated with maintenance of the current sensorimotor state and predictive coding) oscillations covary with trial-wise percent-correct scores; importantly, alpha and beta power provide significant independent contributions to predicting single-trial behavioral outcomes. These results can inform models of speech processing and guide noninvasive measures to index different neural processes that together support complex listening.

Responsiveness variability during anaesthesia relates to inherent differences in brain structure and function of the frontoparietal networks

Anaesthesia combined with functional neuroimaging provides a powerful approach for understanding the brain mechanisms of consciousness. Although propofol is used ubiquitously in clinical interventions that reversibly suppress consciousness, it shows large inter-individual variability, and the brain bases of this variability remain poorly understood. We asked whether three networks key to conscious cognition-the dorsal attention (DAN), executive control (ECN), and default mode (DMN)-underlie responsiveness variability under anaesthesia. Healthy participants (N = 17) were moderately anaesthetized during narrative understanding and resting-state conditions inside the Magnetic Resonance Imaging scanner. A target detection task measured behavioural responsiveness. An independent behavioural study (N = 25) qualified the attention demands of narrative understanding. Then, 30% of participants were unaffected in their response times, thus thwarting a key aim of anaesthesia-the suppression of behavioural responsiveness. Individuals with stronger functional connectivity within the DAN and ECN, between them, and to the DMN, and with larger grey matter volume in frontal regions were more resilient to anaesthesia. For the first time, we show that responsiveness variability during propofol anaesthesia relates to inherent differences in brain structure and function of the frontoparietal networks, which can be predicted prior to sedation. Results highlight novel markers for improving awareness monitoring during clinical anaesthesia.

Functional connectivity and gray matter deficits within the auditory attention circuit in first-episode psychosis

Background

Selective attention deficits in first episode of psychosis (FEP) can be indexed by impaired attentional modulation of auditory M100. It is unknown if the pathophysiology underlying this deficit is restricted to auditory cortex or involves a distributed attention network. We examined the auditory attention network in FEP.

Methods

MEG was recorded from 27 FEP and 31 matched healthy controls (HC) while alternately ignoring or attending tones. A whole-brain analysis of MEG source activity during auditory M100 identified non-auditory areas with increased activity. Time-frequency activity and phase-amplitude coupling were examined in auditory cortex to identify the attentional executive carrier frequency. Attention networks were defined by phase-locking at the carrier frequency. Spectral and gray matter deficits in the identified circuits were examined in FEP.

Results

Attention-related activity was identified in prefrontal and parietal regions, markedly in precuneus. Theta power and phase coupling to gamma amplitude increased with attention in left primary auditory cortex. Two unilateral attention networks were identified with precuneus seeds in HC. Network synchrony was impaired in FEP. Gray matter thickness was reduced within the left hemisphere network in FEP but did not correlate with synchrony.

Conclusion

Several extra-auditory attention areas with attention-related activity were identified. Theta was the carrier frequency for attentional modulation in auditory cortex. Left and right hemisphere attention networks were identified, with bilateral functional deficits and left hemisphere structural deficits, though FEP showed intact auditory cortex theta phase-gamma amplitude coupling. These novel findings indicate attention-related circuitopathy early in psychosis potentially amenable to future non-invasive interventions.

Auditory P3a response to native and foreign speech in children with or without attentional deficit

The aim of this study was to investigate the attentional mechanism in speech processing of native and foreign language in children with and without attentional deficit. For this purpose, the P3a component, cognitive neuromarker of the attentional processes, was investigated in a two-sequence two-deviant oddball paradigm using Finnish and English speech items via event-related potentials (ERP) technique. The difference waves reflected the temporal brain dynamics of the P3a response in native and foreign language contexts. Cluster-based permutation tests evaluated the group differences over the P3a time window. A correlation analysis was conducted between the P3a response and the attention score (ATTEX) to evaluate whether the behavioral assessment reflected the neural activity. The source reconstruction method (CLARA) was used to investigate the neural origins of the attentional differences between groups and conditions. The ERP results showed a larger P3a response in the group of children with attentional problems (AP) compared to controls (CTR). The P3a response differed statistically between the two groups in the native language processing, but not in the foreign language. The ATTEX score correlated with the P3a amplitude in the native language contrasts. The correlation analyses hint at some hemispheric brain activity difference in the frontal area. The group-level CLARA reconstruction showed activation in the speech perception and attention networks over the frontal, parietal, and temporal areas. Differences in activations of these networks were found between the groups and conditions, with the AP group showing higher activity in the source level, being the origin of the ERP enhancement observed on the scalp level.

Defining attention from an auditory perspective

Attention prioritizes certain information at the expense of other information in ways that are similar across vision, audition, and other sensory modalities. It influences how-and even what-information is represented and processed, affecting brain activity at every level. Much of the core research into cognitive and neural mechanisms of attention has used visual tasks. However, the same top-down, object-based, and bottom-up attentional processes shape auditory perception, largely through the same underlying, cognitive networks. This article is categorized under: Psychology > Attention.

A Distributed Network for Multimodal Experiential Representation of Concepts

Neuroimaging, neuropsychological, and psychophysical evidence indicate that concept retrieval selectively engages specific sensory and motor brain systems involved in the acquisition of the retrieved concept. However, it remains unclear which supramodal cortical regions contribute to this process and what kind of information they represent. Here, we used representational similarity analysis of two large fMRI datasets with a searchlight approach to generate a detailed map of human brain regions where the semantic similarity structure across individual lexical concepts can be reliably detected. We hypothesized that heteromodal cortical areas typically associated with the default mode network encode multimodal experiential information about concepts, consistent with their proposed role as cortical integration hubs. In two studies involving different sets of concepts and different participants (both sexes), we found a distributed, bihemispheric network engaged in concept representation, composed of high-level association areas in the anterior, lateral, and ventral temporal lobe; inferior parietal lobule; posterior cingulate gyrus and precuneus; and medial, dorsal, ventrolateral, and orbital prefrontal cortex. In both studies, a multimodal model combining sensory, motor, affective, and other types of experiential information explained significant variance in the neural similarity structure observed in these regions that was not explained by unimodal experiential models or by distributional semantics (i.e., word2vec similarity). These results indicate that during concept retrieval, lexical concepts are represented across a vast expanse of high-level cortical regions, especially in the areas that make up the default mode network, and that these regions encode multimodal experiential information.SIGNIFICANCE STATEMENT Conceptual knowledge includes information acquired through various modalities of experience, such as visual, auditory, tactile, and emotional information. We investigated which brain regions encode mental representations that combine information from multiple modalities when participants think about the meaning of a word. We found that such representations are encoded across a widely distributed network of cortical areas in both hemispheres, including temporal, parietal, limbic, and prefrontal association areas. Several areas not traditionally associated with semantic cognition were also implicated. Our results indicate that the retrieval of conceptual knowledge during word comprehension relies on a much larger portion of the cerebral cortex than previously thought and that multimodal experiential information is represented throughout the entire network.

Interaction of bottom-up and top-down neural mechanisms in spatial multi-talker speech perception

How the human auditory cortex represents spatially separated simultaneous talkers and how talkers' locations and voices modulate the neural representations of attended and unattended speech are unclear. Here, we measured the neural responses from electrodes implanted in neurosurgical patients as they performed single-talker and multi-talker speech perception tasks. We found that spatial separation between talkers caused a preferential encoding of the contralateral speech in Heschl's gyrus (HG), planum temporale (PT), and superior temporal gyrus (STG). Location and spectrotemporal features were encoded in different aspects of the neural response. Specifically, the talker's location changed the mean response level, whereas the talker's spectrotemporal features altered the variation of response around response's baseline. These components were differentially modulated by the attended talker's voice or location, which improved the population decoding of attended speech features. Attentional modulation due to the talker's voice only appeared in the auditory areas with longer latencies, but attentional modulation due to location was present throughout. Our results show that spatial multi-talker speech perception relies upon a separable pre-attentive neural representation, which could be further tuned by top-down attention to the location and voice of the talker.

Imbalanced Gamma-band Functional Brain Networks of Autism Spectrum Disorders

Resting gamma-band brain networks are known as an inhibitory component in functional brain networks. Although autism spectrum disorder (ASD) is considered as with imbalanced brain networks, the inhibitory component remains not fully explored. The study reported 10 children with ASD and 10 typically-developing (TD) controls. The power spectral density analysis of the gamma-band signal in the cerebral cortex was performed at the source level. The normalized phase transfer entropy values (nPTEs) were calculated to construct brain connectivity. Gamma-band activity of the ASD group was lower than the TD children. The significantly inhibited brain regions were mainly distributed in the bilateral frontal and temporal lobes. Connectivity analysis showed alterations in the connections from key nodes of the social brain network. The behavior assessments in the ASD group revealed a significantly positive correlation between the total score of Childhood Autism Rating Scale and the regional nPTEs of the right transverse temporal gyrus. Our results provide strong evidence that the gamma-band brain networks of ASD children have a lower level of brain activities and different distribution of information flows. Clinical meanings of such imbalances of both activity and connectivity were also worthy of further explorations.

Precision Estimates of Macroscale Network Organization in the Human and Their Relation to Anatomical Connectivity in the Marmoset Monkey

Precision estimates of network organization from functional connectivity MRI in the human and tract-tracing data in the marmoset monkey converge to reveal an orderly macroscale gradient of sequential networks across the cerebral cortex. Parallel networks begin with a sequence of multiple nested sensory-motor networks in both species progressing to more distributed association networks in rostral prefrontal and temporal association zones, which are expanded and differentiated in the human. From this perspective, the spatially-distributed motif encountered in association networks appears to be on a continuum with primary sensory-motor networks. Network motifs supporting sophisticated forms of human cognition may arise from specializations of distributed anatomical networks formed in an ancestor at least 45 million years ago.

Cerebral representation of sequence patterns across multiple presentation formats

The ability to detect the abstract pattern underlying a temporal sequence of events is crucial to many human activities, including language and mathematics, but its cortical correlates remain poorly understood. It is also unclear whether repeated exposure to the same sequence of sensory stimuli is sufficient to induce the encoding of an abstract amodal representation of the pattern. Using functional MRI, we probed the existence of such abstract codes for sequential patterns, their localization in the human brain, and their relation to existing language and math-responsive networks. We used a passive sequence violation paradigm, in which a given sequence is repeatedly presented before rare deviant sequences are introduced. We presented two binary patterns, AABB and ABAB, in four presentation formats, either visual or auditory, and either cued by the identity of the stimuli or by their spatial location. Regardless of the presentation format, a habituation to the repeated pattern and a response to pattern violations were seen in a set of inferior frontal, intraparietal and temporal areas. Within language areas, such pattern-violation responses were only found in the inferior frontal gyrus (IFG), whereas all math-responsive regions responded to pattern changes. Most of these regions also responded whenever the modality or the cue changed, suggesting a general sensitivity to violation detection. Thus, the representation of sequence patterns appears to be distributed, yet to include a core set of abstract amodal regions, particularly the IFG.

Precise Topology of Adjacent Domain-General and Sensory-Biased Regions in the Human Brain

Recent functional MRI studies identified sensory-biased regions across much of the association cortices and cerebellum. However, their anatomical relationship to multiple-demand (MD) regions, characterized as domain-general due to their coactivation during multiple cognitive demands, remains unclear. For a better anatomical delineation, we used multimodal MRI techniques of the Human Connectome Project to scan subjects performing visual and auditory versions of a working memory (WM) task. The contrast between hard and easy WM showed strong domain generality, with essentially identical patterns of cortical, subcortical, and cerebellar MD activity for visual and auditory materials. In contrast, modality preferences were shown by contrasting easy WM with baseline; most MD regions showed visual preference while immediately adjacent to cortical MD regions, there were interleaved regions of both visual and auditory preference. The results may exemplify a general motif whereby domain-specific regions feed information into and out of an adjacent, integrative MD core.

Is the prefrontal cortex organized by supramodal or modality-specific sensory demands during adolescence?

Attention is inherently biased towards the visual modality during most multisensory scenarios in adults, but the developmental trajectory towards visual dominance has not been fully elucidated. More recent evidence in primates and adult humans suggests a modality-specific stratification of the prefrontal cortex. The current study therefore used functional magnetic resonance imaging (fMRI) to investigate the neuronal correlates of proactive (following cues) and reactive (following probes) cognitive control for simultaneous audio-visual stimulation in 67 healthy adolescents (13-18 years old). Behavioral results were only partially supportive of visual dominance in adolescents, with both reduced response times and accuracy during attend-visual relative to attend-auditory trials. Differential activation of medial and lateral prefrontal cortex for processing incongruent relative to congruent stimuli (reactive control) was also only observed during attend-visual trials. There was no evidence of modality-specific prefrontal cortex stratification during the active processing of multisensory stimuli or during separate functional connectivity analyses. Attention-related modulations were also greater within visual relative to auditory cortex, but were less robust than observed in previous adult studies. Collectively, current results suggest a continued transition towards visual dominance in adolescence, as well as limited modality-specific specialization of prefrontal cortex and attentional modulations of unisensory cortex.

Extended Frontal Networks for Visual and Auditory Working Memory

Working memory (WM) supports the persistent representation of transient sensory information. Visual and auditory stimuli place different demands on WM and recruit different brain networks. Separate auditory- and visual-biased WM networks extend into the frontal lobes, but several challenges confront attempts to parcellate human frontal cortex, including fine-grained organization and between-subject variability. Here, we use differential intrinsic functional connectivity from 2 visual-biased and 2 auditory-biased frontal structures to identify additional candidate sensory-biased regions in frontal cortex. We then examine direct contrasts of task functional magnetic resonance imaging during visual versus auditory 2-back WM to validate those candidate regions. Three visual-biased and 5 auditory-biased regions are robustly activated bilaterally in the frontal lobes of individual subjects (N = 14, 7 women). These regions exhibit a sensory preference during passive exposure to task stimuli, and that preference is stronger during WM. Hierarchical clustering analysis of intrinsic connectivity among novel and previously identified bilateral sensory-biased regions confirms that they functionally segregate into visual and auditory networks, even though the networks are anatomically interdigitated. We also observe that the frontotemporal auditory WM network is highly selective and exhibits strong functional connectivity to structures serving non-WM functions, while the frontoparietal visual WM network hierarchically merges into the multiple-demand cognitive system.

Individual Subject Approaches to Mapping Sensory-Biased and Multiple-Demand Regions in Human Frontal Cortex

Sensory modality, widely accepted as a key factor in the functional organization of posterior cortical areas, also shapes the organization of human frontal lobes. 'Deep imaging,' or the practice of collecting a sizable amount of data on individual subjects, offers significant advantages in revealing fine-scale aspects of functional organization of the human brain. Here, we review deep imaging approaches to mapping multiple sensory-biased and multiple-demand regions within human lateral frontal cortex. In addition, we discuss how deep imaging methods can be transferred to large public data sets to further extend functional mapping at the group level. We also review how 'connectome fingerprinting' approaches, combined with deep imaging, can be used to localize fine-grained functional organization in individual subjects using resting-state data. Finally, we summarize current 'best practices' for deep imaging.

Light Through the Fog: Using Precision fMRI Data to Disentangle the Neural Substrates of Cognitive Control

Cognitive control, the ability to engage in goal-related behavior, is linked to frontal, parietal, and cingulate brain regions. However, the underlying function(s) of these regions is still in question, with ongoing discussions about their specificity and/or multifunctionality. These brain regions are also among the most variable across individuals, which may confound multi-functionality with inter-individual heterogeneity. Precision fMRI-extended data acquisition from single individuals-allows for reliable individualized mapping of brain organization. We review examples of recent studies that use precision fMRI to surmount inter-individual variability in functional neuroanatomy. These studies provide evidence of interleaved specialized and multifunctional regions in the frontal cortex. We discuss the potential for these techniques to address outstanding controversies on the neural underpinnings of cognitive control.

Nonspatial Features Reduce the Reliance on Sustained Spatial Auditory Attention

OBJECTIVE

Top-down spatial attention is effective at selecting a target sound from a mixture. However, nonspatial features often distinguish sources in addition to location. This study explores whether redundant nonspatial features are used to maintain selective auditory attention for a spatially defined target.

DESIGN

We recorded electroencephalography while subjects focused attention on one of three simultaneous melodies. In one experiment, subjects (n = 17) were given an auditory cue indicating both the location and pitch of the target melody. In a second experiment (n = 17 subjects), the cue only indicated target location, and we compared two conditions: one in which the pitch separation of competing melodies was large, and one in which this separation was small.

RESULTS

In both experiments, responses evoked by onsets of events in sound streams were modulated by attention, and we found no significant difference in this modulation between small and large pitch separation conditions. Therefore, the evoked response reflected that target stimuli were the focus of attention, and distractors were suppressed successfully for all experimental conditions. In all cases, parietal alpha was lateralized following the cue, but before melody onset, indicating that subjects initially focused attention in space. During the stimulus presentation, this lateralization disappeared when pitch cues were strong but remained significant when pitch cues were weak, suggesting that strong pitch cues reduced reliance on sustained spatial attention.

CONCLUSIONS

These results demonstrate that once a well-defined target stream at a known location is selected, top-down spatial attention plays a weak role in filtering out a segregated competing stream.

Hemodynamic Responses Link Individual Differences in Informational Masking to the Vicinity of Superior Temporal Gyrus

Suppressing unwanted background sound is crucial for aural communication. A particularly disruptive type of background sound, informational masking (IM), often interferes in social settings. However, IM mechanisms are incompletely understood. At present, IM is identified operationally: when a target should be audible, based on suprathreshold target/masker energy ratios, yet cannot be heard because target-like background sound interferes. We here confirm that speech identification thresholds differ dramatically between low- vs. high-IM background sound. However, speech detection thresholds are comparable across the two conditions. Moreover, functional near infrared spectroscopy recordings show that task-evoked blood oxygenation changes near the superior temporal gyrus (STG) covary with behavioral speech detection performance for high-IM but not low-IM background sound, suggesting that the STG is part of an IM-dependent network. Moreover, listeners who are more vulnerable to IM show increased hemodynamic recruitment near STG, an effect that cannot be explained based on differences in task difficulty across low- vs. high-IM. In contrast, task-evoked responses near another auditory region of cortex, the caudal inferior frontal sulcus (cIFS), do not predict behavioral sensitivity, suggesting that the cIFS belongs to an IM-independent network. Results are consistent with the idea that cortical gating shapes individual vulnerability to IM.

Structure, function and connectivity fingerprints of the frontal eye field versus the inferior frontal junction: A comprehensive comparison

The human prefrontal cortex contains two prominent areas, the frontal eye field and the inferior frontal junction, that are crucially involved in the orchestrating functions of attention, working memory and cognitive control. Motivated by comparative evidence in non-human primates, we review the human neuroimaging literature, suggesting that the functions of these regions can be clearly dissociated. We found remarkable differences in how these regions relate to sensory domains and visual topography, top-down and bottom-up spatial attention, spatial versus non-spatial (i.e., feature- and object-based) attention and working memory and, finally, the multiple-demand system. Functional magnetic resonance imaging (fMRI) studies using multivariate pattern analysis reveal the selectivity of the frontal eye field and inferior frontal junction to spatial and non-spatial information, respectively. The analysis of functional and effective connectivity provides evidence of the modulation of the activity in downstream visual areas from the frontal eye field and inferior frontal junction and sheds light on their reciprocal influences. We therefore suggest that future studies should aim at disentangling more explicitly the role of these regions in the control of spatial and non-spatial selection. We propose that the analysis of the structural and functional connectivity (i.e., the connectivity fingerprints) of the frontal eye field and inferior frontal junction may be used to further characterize their involvement in a spatial ('where') and a non-spatial ('what') network, respectively, highlighting segregated brain networks that allow biasing visual selection and working memory performance to support goal-driven behaviour.

Impairments in brain perfusion, executive control network, topological characteristics, and neurocognition in adult patients with asymptomatic Moyamoya disease

Background

Asymptomatic Moyamoya disease (MMD) impairs hemodynamic and cognitive function. The relationship between these changes, cerebral blood flow (CBF), and network connectivity remains largely unknown. The aim of this study was to increase understanding of the relationship between CBF, functional networks, and neurocognition in adults with asymptomatic MMD. We compared CBF and functional status in 26 patients with MMD and 20 healthy controls using arterial spin labeling and resting state functional magnetic resonance imaging sequences. At the same time, a detailed cognitive test was performed in 15 patients with no cerebral or lumen infarction who were selected by magnetic resonance imaging-T2 FLAIR screening.

Results

Compared to the controls, the patients showed varying degrees of decline in their computational ability (simple subtraction, p = 0.009; complex subtraction, p = 0.006) and short-term memory (p = 0.042). The asymptomatic MMD group also showed decreased CBF in the left anterior central and left inferior frontal gyri of the island flap with multiple node abnormalities in the brain network and reduced network connectivity. There was a significant association of these changes with cognitive decline in the MMD group.

Conclusions

In patients with asymptomatic MMD, disturbance of CBF and impaired brain network connections may be important causes of cognitive decline and appear before clinical symptoms.

Clinical trial registration-URL: http://www.chictr.org.cn

Unique identifier: ChiCTR1900023610

Supplementary Information

The online version contains supplementary material available at 10.1186/s12868-021-00638-z.

Altered Functional Connectivity in Children with ADHD Revealed by Scalp EEG: An ERP Study

Attention deficit hyperactivity disorder (ADHD) is one of the most common neurodevelopmental brain disorders in childhood. Despite extensive researches, the neurobiological mechanism underlying ADHD is still left unveiled. Since the deficit functions, such as attention, have been demonstrated in ADHD, in our present study, based on the oddball P3 task, the corresponding electroencephalogram (EEG) of both healthy controls (HCs) and ADHD children was first collected. And we then not only focused on the event-related potential (ERP) evoked during tasks but also investigated related brain networks. Although an insignificant difference in behavior was found between the HCs and ADHD children, significant electrophysiological differences were found in both ERPs and brain networks. In detail, the dysfunctional attention occurred during the early stage of the designed task; as compared to HCs, the reduced P2 and N2 amplitudes in ADHD children were found, and the atypical information interaction might further underpin such a deficit. On the one hand, when investigating the cortical activity, HCs recruited much stronger brain activity mainly in the temporal and frontal regions, compared to ADHD children; on the other hand, the brain network showed atypical enhanced long-range connectivity between the frontal and occipital lobes but attenuated connectivity among frontal, parietal, and temporal lobes in ADHD children. We hope that the findings in this study may be instructive for the understanding of cognitive processing in children with ADHD.

Precision Estimates of Parallel Distributed Association Networks: Evidence for Domain Specialization and Implications for Evolution and Development

Humans can reason about other minds, comprehend language and imagine. These abilities depend on association regions that exhibit evolutionary expansion and prolonged postnatal development. Precision maps within individuals reveal these expanded zones are populated by multiple specialized networks that each possess a spatially distributed motif but remain anatomically separated throughout the cortex for language, social and mnemonic / spatial functions. Rather than converge on multi-domain regions or hubs, these networks include distinct regions within rostral prefrontal and temporal association zones. To account for these observations, we propose the expansion-fractionation-specialization (EFS) hypothesis: evolutionary expansion of human association cortex may have allowed for an archetype distributed network to fractionate into multiple specialized networks. Human development may recapitulate fractionation and specialization when these abilities emerge.

Attention and Default Mode Network Assessments of Meditation Experience during Active Cognition and Rest

Meditation experience has previously been shown to improve performance on behavioral assessments of attention, but the neural bases of this improvement are unknown. Two prominent, strongly competing networks exist in the human cortex: a dorsal attention network, that is activated during focused attention, and a default mode network, that is suppressed during attentionally demanding tasks. Prior studies suggest that strong anti-correlations between these networks indicate good brain health. In addition, a third network, a ventral attention network, serves as a "circuit-breaker" that transiently disrupts and redirects focused attention to permit salient stimuli to capture attention. Here, we used functional magnetic resonance imaging to contrast cortical network activation between experienced focused attention Vipassana meditators and matched controls. Participants performed two attention tasks during scanning: a sustained attention task and an attention-capture task. Meditators demonstrated increased magnitude of differential activation in the dorsal attention vs. default mode network in a sustained attention task, relative to controls. In contrast, there were no evident attention network differences between meditators and controls in an attentional reorienting paradigm. A resting state functional connectivity analysis revealed a greater magnitude of anticorrelation between dorsal attention and default mode networks in the meditators as compared to both our local control group and a n = 168 Human Connectome Project dataset. These results demonstrate, with both task- and rest-based fMRI data, increased stability in sustained attention processes without an associated attentional capture cost in meditators. Task and resting-state results, which revealed stronger anticorrelations between dorsal attention and default mode networks in experienced mediators than in controls, are consistent with a brain health benefit of long-term meditation practice.

Repetitive transcranial magnetic stimulation changes cognitive/motor tasks performance: An absolute alpha and beta power study

The voluntary movement demands integration between cognitive and motor functions. During the initial stages of motor learning until mastery of a new motor task, and during a demanding task that is not automatic, cognitive and motor functions can be perceived as independent from each other. Areas used for actually performing motor tasks are essentially the same used by Motor Imagery (MI). The main objective of this study was to investigate inhibition effects on cognitive functions of motor skills induced by low-frequency (1 Hz) Repetitive Transcranial Magnetic Stimulation (rTMS) at the sensory-motor integration site (Cz). In particular, the goal was to examine absolute alpha and beta power changes on frontal regions during Execution, Action observation, and Motor Imagery of finger movement tasks. Eleven healthy, right-handed volunteers of both sexes (5 males, 6 females; mean age 28 ± 5 years), with no history of psychiatric or neurological disorders, participated in the experiment. The execution task consisted of the subject flexing and extending the index finger. The action observation task involved watching a video of the same movement. The motor imagery task was imagining the flexion and extension of the index finger movement. After performing the tasks randomly, subjects were submitted to 15 min of low-frequency rTMS and performed the tasks again. All tasks were executed simultaneously with EEG signals recording. Our results demonstrated a significant interaction between rTMS and the three tasks in almost all analyzed regions showing that rTMS can affect the frontal region regarding Execution, Action observation, and Motor Imagery tasks.

Comparative anatomy of the macaque and the human frontal oculomotor domain

In non-human primates, at the junction of the prefrontal with the premotor cortex, there is a sector designated as frontal eye field (FEF), involved in controlling oculomotor behavior and spatial attention. Evidence for at least two FEFs in humans is at the basis of the still open issue of the possible homologies between the macaque and the human frontal oculomotor system. In this review article we address this issue suggesting a new view solidly grounded on evidence from the last decade showing that, in macaques, the FEF is at the core of an oculomotor domain in which several distinct areas, including areas 45A and 45B, provide the substrate for parallel processing of different aspects of oculomotor behavior. Based on comparative considerations, we will propose a correspondence between some of the macaque and the human oculomotor fields, thus suggesting sharing of neural substrate for oculomotor control, gaze processing, and orienting attention in space. Accordingly, this article could contribute to settle some aspects of the so-called "enigma" of the human FEF anatomy.

Comprehension of computer code relies primarily on domain-general executive brain regions

Computer programming is a novel cognitive tool that has transformed modern society. What cognitive and neural mechanisms support this skill? Here, we used functional magnetic resonance imaging to investigate two candidate brain systems: the multiple demand (MD) system, typically recruited during math, logic, problem solving, and executive tasks, and the language system, typically recruited during linguistic processing. We examined MD and language system responses to code written in Python, a text-based programming language (Experiment 1) and in ScratchJr, a graphical programming language (Experiment 2); for both, we contrasted responses to code problems with responses to content-matched sentence problems. We found that the MD system exhibited strong bilateral responses to code in both experiments, whereas the language system responded strongly to sentence problems, but weakly or not at all to code problems. Thus, the MD system supports the use of novel cognitive tools even when the input is structurally similar to natural language.

Cerebellar correlates of visual hallucinations in Parkinson's disease and Charles Bonnet Syndrome

Hallucinations, percepts in the absence of external stimuli, are a shared feature of eye-disease (Charles Bonnet Syndrome, CBS) and Parkinson's disease (PD) thought to arise through pathophysiologically distinct mechanisms: deafferentation and attentional network dysfunction respectively. Recent studies have found an association between visual hallucinations and structural changes in the cerebellum without obvious link to either mechanism. Here, we employed Voxel Based Morphometry (VBM), optimised for the cerebellum using the Spatially Unbiased Infratentorial Template (SUIT), to characterise similarities and differences in cerebellar structure associated with visual hallucinations in PD and CBS. Grey and white matter volume (GMV & WMV) from patients with eye-disease (n = 12 hallucinators; n = 9 non-hallucinators) and PD (n = 7 hallucinators; n = 9 non-hallucinators) was examined in a 2-way ANOVA controlling for age, sex, and intracranial volume. Comparing hallucinators to controls across both groups, lower GMV was found bilaterally within cerebellar lobule VIII extending to IX/VII. GMV reductions were also found in Crus 1, greater in PD than eye-disease. Predominantly within PD, hallucination-related lower WMV was found in the medulla. No regions of increased GMV or WMV were found. A correlation was observed between brainstem WMV and lobule VIIIb GMV suggesting a functional association. Lobule VIII comprises a functional node within the Dorsal Attention Network (DAN), linking these findings to current attentional theories of hallucinations, while Crus 1 is linked to cortical visual processing. These findings provide preliminary evidence of a cerebellar contribution to hallucinations that transcends clinical conditions.

Orienting Attention to Short-Term Memory Representations via Sensory Modality and Semantic Category Retro-Cues

There is growing interest in characterizing the neural mechanisms underlying the interactions between attention and memory. Current theories posit that reflective attention to memory representations generally involves a fronto-parietal attentional control network. The present study aimed to test this idea by manipulating how a particular short-term memory (STM) representation is accessed, that is, based on its input sensory modality or semantic category, during functional magnetic resonance imaging (fMRI). Human participants performed a novel variant of the retro-cue paradigm, in which they were presented with both auditory and visual non-verbal stimuli followed by Modality, Semantic, or Uninformative retro-cues. Modality and, to a lesser extent, Semantic retro-cues facilitated response time relative to Uninformative retro-cues. The univariate and multivariate pattern analyses (MVPAs) of fMRI time-series revealed three key findings. First, the posterior parietal cortex (PPC), including portions of the intraparietal sulcus (IPS) and ventral angular gyrus (AG), had activation patterns that spatially overlapped for both modality-based and semantic-based reflective attention. Second, considering both the univariate and multivariate analyses, Semantic retro-cues were associated with a left-lateralized fronto-parietal network. Finally, the experimental design enabled us to examine how dividing attention cross-modally within STM modulates the brain regions involved in reflective attention. This analysis revealed that univariate activation within bilateral portions of the PPC increased when participants simultaneously attended both auditory and visual memory representations. Therefore, prefrontal and parietal regions are flexibly recruited during reflective attention, depending on the representational feature used to selectively access STM representations.

Distractor probabilities modulate flanker task performance

Expectations about upcoming events help humans to effectively filter out potential distractors and respond more efficiently to task-relevant inputs. While previous work has emphasized the role of expectations about task-relevant inputs, less is known about the role that expectations play in suppressing specific distractors. To address this question, we manipulated the probabilities of different flanker configurations in the Eriksen flanker task. Across four studies, we found robust evidence for sensitivity to the probability of flankers, with an approximately logarithmic relationship between the likelihood of a particular flanker configuration and the accuracy of subjects' responses. Subjects were also sensitive to length of runs of repeated targets, but minimally sensitive to length of runs of repeated flankers. Two studies used chevron stimuli, and two used letters (confirming that results generalize with greater dissimilarity between stimuli). Expanding the set of stimuli (thus reducing the dominance of any one exemplar) eliminated the effect. Our findings suggest that expectations about distractors form in response to statistical regularities at multiple timescales, and that their effects are strongest when stimuli are geometrically similar and subjects are able to respond to trials quickly. Unexpected distractors could disrupt performance, most likely via a form of attentional capture. This work demonstrates how expectations can influence attention in complex cognitive settings, and illuminates the multiple, nested factors that contribute.

Feeling the Beat (and Seeing It, Too): Vibrotactile, Visual, and Bimodal Rate Discrimination

Beats are among the basic units of perceptual experience. Produced by regular, intermittent stimulation, beats are most commonly associated with audition, but the experience of a beat can result from stimulation in other modalities as well. We studied the robustness of visual, vibrotactile, and bimodal signals as sources of beat perception. Subjects attempted to discriminate between pulse trains delivered at 3 Hz or at 6 Hz. To investigate signal robustness, we intentionally degraded signals on two-thirds of the trials using temporal-domain noise. On these trials, inter-pulse intervals (IPIs) were stochastic, perturbed independently from the nominal IPI by random samples from zero-mean Gaussian distributions with different variances. These perturbations produced directional changes in the IPIs, which either increased or decreased the likelihood of confusing the two pulse rates. In addition to affording an assay of signal robustness, this paradigm made it possible to gauge how subjects' judgments were influenced by successive IPIs. Logistic regression revealed a strong primacy effect: subjects' decisions were disproportionately influenced by a trial's initial IPIs. Response times and parameter estimates from drift-diffusion modeling showed that information accumulates more rapidly with bimodal stimulation than with either unimodal stimulus alone. Analysis of error rates within each condition suggested consistently optimal decision making, even with increased IPI variability. Finally, beat information delivered by vibrotactile signals proved just as robust as information conveyed by visual signals, confirming vibrotactile stimulation's potential as a communication channel.

Gradients of functional organization in posterior parietal cortex revealed by visual attention, visual short-term memory, and intrinsic functional connectivity

Visual attention and visual working memory tasks recruit a common network of lateral frontal cortical (LFC) and posterior parietal cortical (PPC) regions. Here, we examine finer-scale organization of this frontoparietal network. Three LFC regions recruited by visual cognition tasks, superior precentral sulcus (sPCS), inferior precentral sulcus (iPCS), and mid inferior frontal sulcus (midIFS) exhibit differential patterns of resting-state functional connectivity to PPC. A broad dorsomedial to ventrolateral gradient is observed, with sPCS connectivity dominating in the dorsomedial PPC band, iPCS dominating in the middle band, and midIFS dominating in the ventrolateral band. These connectivity-defined subregions of PPC capture differential task activation between a pair of visual attention and working memory tasks. The relative functional connectivity of sPCS and iPCS also varies along the rostral-caudal axis of the retinotopic regions of PPC. iPCS connectivity is relatively stronger near the IPS0/IPS1 and IPS2/IPS3 borders, especially on the lateral portions of these borders, which each preferentially encode central visual field representations. In contrast, sPCS connectivity is relatively stronger elsewhere in retinotopic IPS regions which preferentially encode peripheral visual field representations. These findings reveal fine-scale gradients in functional connectivity within the frontoparietal visual network that capture a high-degree of specificity in PPC functional organization.

Spatial Attention and Temporal Expectation Exert Differential Effects on Visual and Auditory Discrimination

Anticipation of an impending stimulus shapes the state of the sensory systems, optimizing neural and behavioral responses. Here, we studied the role of brain oscillations in mediating spatial and temporal anticipations. Because spatial attention and temporal expectation are often associated with visual and auditory processing, respectively, we directly contrasted the visual and auditory modalities and asked whether these anticipatory mechanisms are similar in both domains. We recorded the magnetoencephalogram in healthy human participants performing an auditory and visual target discrimination task, in which cross-modal cues provided both temporal and spatial information with regard to upcoming stimulus presentation. Motivated by prior findings, we were specifically interested in delta (1-3 Hz) and alpha (8-13 Hz) band oscillatory state in anticipation of target presentation and their impact on task performance. Our findings support the view that spatial attention has a stronger effect in the visual domain, whereas temporal expectation effects are more prominent in the auditory domain. For the spatial attention manipulation, we found a typical pattern of alpha lateralization in the visual system, which correlated with response speed. Providing a rhythmic temporal cue led to increased postcue synchronization of low-frequency rhythms, although this effect was more broadband in nature, suggesting a general phase reset rather than frequency-specific neural entrainment. In addition, we observed delta-band synchronization with a frontal topography, which correlated with performance, especially in the auditory task. Combined, these findings suggest that spatial and temporal anticipations operate via a top-down modulation of the power and phase of low-frequency oscillations, respectively.

A Domain-General Cognitive Core Defined in Multimodally Parcellated Human Cortex

Numerous brain imaging studies identified a domain-general or "multiple-demand" (MD) activation pattern accompanying many tasks and may play a core role in cognitive control. Though this finding is well established, the limited spatial localization provided by traditional imaging methods precluded a consensus regarding the precise anatomy, functional differentiation, and connectivity of the MD system. To address these limitations, we used data from 449 subjects from the Human Connectome Project, with the cortex of each individual parcellated using neurobiologically grounded multimodal MRI features. The conjunction of three cognitive contrasts reveals a core of 10 widely distributed MD parcels per hemisphere that are most strongly activated and functionally interconnected, surrounded by a penumbra of 17 additional areas. Outside cerebral cortex, MD activation is most prominent in the caudate and cerebellum. Comparison with canonical resting-state networks shows MD regions concentrated in the fronto-parietal network but also engaging three other networks. MD activations show modest relative task preferences accompanying strong co-recruitment. With distributed anatomical organization, mosaic functional preferences, and strong interconnectivity, we suggest MD regions are well positioned to integrate and assemble the diverse components of cognitive operations. Our precise delineation of MD regions provides a basis for refined analyses of their functions.

Parallel distributed networks dissociate episodic and social functions within the individual

Association cortex is organized into large-scale distributed networks. One such network, the default network (DN), is linked to diverse forms of internal mentation, opening debate about whether shared or distinct anatomy supports multiple forms of cognition. Using within-individual analysis procedures that preserve idiosyncratic anatomical details, we probed whether multiple tasks from two domains, episodic projection and theory of mind (ToM), rely on the same or distinct networks. In an initial experiment (6 subjects, each scanned 4 times), we found evidence that episodic projection and ToM tasks activate separate regions distributed throughout the cortex, with adjacent regions in parietal, temporal, prefrontal, and midline zones. These distinctions were predicted by the hypothesis that the DN comprises two parallel, interdigitated networks. One network, linked to parahippocampal cortex (PHC), is preferentially recruited during episodic projection, including both remembering and imagining the future. A second juxtaposed network, which includes the temporoparietal junction (TPJ), is differentially engaged during multiple forms of ToM. In two prospectively acquired independent experiments, we replicated and triplicated the dissociation (each with 6 subjects scanned 4 times). Furthermore, the dissociation was found in all zones when analyzed independently, including robustly in midline regions previously described as hubs. The TPJ-linked network is interwoven with the PHC-linked network across the cortex, making clear why it is difficult to fully resolve the two networks in group-averaged or lower-resolution data. These results refine our understanding of the functional-anatomical organization of association cortex and raise fundamental questions about how specialization might arise in parallel, juxtaposed association networks.NEW & NOTEWORTHY Two distributed, interdigitated networks exist within the bounds of the canonical default network. Here we used repeated scanning of individuals, across three independent samples, to provide evidence that tasks requiring episodic projection or theory of mind differentially recruit the two networks across multiple cortical zones. The two distributed networks thus appear to preferentially subserve distinct functions.

Bottom-up and top-down neural signatures of disordered multi-talker speech perception in adults with normal hearing

In social settings, speech waveforms from nearby speakers mix together in our ear canals. Normally, the brain unmixes the attended speech stream from the chorus of background speakers using a combination of fast temporal processing and cognitive active listening mechanisms. Of >100,000 patient records,~10% of adults visited our clinic because of reduced hearing, only to learn that their hearing was clinically normal and should not cause communication difficulties. We found that multi-talker speech intelligibility thresholds varied widely in normal hearing adults, but could be predicted from neural phase-locking to frequency modulation (FM) cues measured with ear canal EEG recordings. Combining neural temporal fine structure processing, pupil-indexed listening effort, and behavioral FM thresholds accounted for 78% of the variability in multi-talker speech intelligibility. The disordered bottom-up and top-down markers of poor multi-talker speech perception identified here could inform the design of next-generation clinical tests for hidden hearing disorders.