Fractionating the anterior temporal lobe: MVPA reveals differential responses to input and conceptual modality

How does the "default mode" network contribute to semantic cognition?

This review examines whether and how the "default mode" network (DMN) contributes to semantic processing. We review evidence implicating the DMN in the processing of individual word meanings and in sentence- and discourse-level semantics. Next, we argue that the areas comprising the DMN contribute to semantic processing by coordinating and integrating the simultaneous activity of local neuronal ensembles across multiple unimodal and multimodal cortical regions, creating a transient, global neuronal ensemble. The resulting ensemble implements an integrated simulation of phenomenological experience - that is, an embodied situation model - constructed from various modalities of experiential memory traces. These situation models, we argue, are necessary not only for semantic processing but also for aspects of cognition that are not traditionally considered semantic. Although many aspects of this proposal remain provisional, we believe it provides new insights into the relationships between semantic and non-semantic cognition and into the functions of the DMN.

Graded and sharp transitions in semantic function in left temporal lobe

Recent work has focussed on how patterns of functional change within the temporal lobe relate to whole-brain dimensions of intrinsic connectivity variation (Margulies et al., 2016). We examined two such 'connectivity gradients' reflecting the separation of (i) unimodal versus heteromodal and (ii) visual versus auditory-motor cortex, examining visually presented verbal associative and feature judgments, plus picture-based context and emotion generation. Functional responses along the first dimension sometimes showed graded change between modality-tuned and heteromodal cortex (in the verbal matching task), and other times showed sharp functional transitions, with deactivation at the extremes and activation in the middle of this gradient (internal generation). The second gradient revealed more visual than auditory-motor activation, regardless of content (associative, feature, context, emotion) or task process (matching/generation). We also uncovered subtle differences across each gradient for content type, which predominantly manifested as differences in relative magnitude of activation or deactivation.

Temporopolar regions of the human brain

Following prolonged neglect during the formative decades of behavioural neurology, the temporopolar region has become a site of vibrant research on the neurobiology of cognition and conduct. This turnaround can be attributed to increasing recognition of neurodegenerative diseases that target temporopolar regions for peak destruction. The resultant syndromes include behavioural dementia, associative agnosia, semantic forms of primary progressive aphasia and semantic dementia. Clinicopathological correlations show that object naming and word comprehension are critically dependent on the language-dominant (usually left) temporopolar region, whereas behavioural control and non-verbal object recognition display a more bilateral representation with a rightward bias. Neuroanatomical experiments in macaques and neuroimaging in humans show that the temporoparietal region sits at the confluence of auditory, visual and limbic streams of processing at the downstream (deep) pole of the 'what' pathway. The functional neuroanatomy of this region revolves around three axes, an anterograde horizontal axis from unimodal to heteromodal and paralimbic cortex; a radial axis where visual (ventral), auditory (dorsal) and paralimbic (medial) territories encircle temporopolar cortex and display hemispheric asymmetry; and a vertical depth-of-processing axis for the associative elaboration of words, objects and interoceptive states. One function of this neural matrix is to support the transformation of object and word representations from unimodal percepts to multimodal concepts. The underlying process is likely to start at canonical gateways that successively lead to generic (superordinate), specific (basic) and unique levels of recognition. A first sign of left temporopolar dysfunction takes the form of taxonomic blurring where boundaries among categories are preserved but not boundaries among exemplars of a category. Semantic paraphasias and coordinate errors in word-picture verification tests are consequences of this phenomenon. Eventually, boundaries among categories are also blurred and comprehension impairments become more profound. The medial temporopolar region belongs to the amygdalocentric component of the limbic system and stands to integrate exteroceptive information with interoceptive states underlying social interactions. Review of the pertinent literature shows that word comprehension and conduct impairments caused by temporopolar strokes and temporal lobectomy are far less severe than those seen in temporopolar atrophies. One explanation for this unexpected discrepancy invokes the miswiring of residual temporopolar neurons during the many years of indolently progressive neurodegeneration. According to this hypothesis, the temporopolar regions become not only dysfunctional but also sources of aberrant outputs that interfere with the function of areas elsewhere in the language and paralimbic networks, a juxtaposition not seen in lobectomy or stroke.

Context free and context-dependent conceptual representation in the brain

How concepts are coded in the brain is a core issue in cognitive neuroscience. Studies have focused on how individual concepts are processed, but the way in which conceptual representation changes to suit the context is unclear. We parametrically manipulated the association strength between words, presented in pairs one word at a time using a slow event-related fMRI design. We combined representational similarity analysis and computational linguistics to probe the neurocomputational content of these trials. Individual word meaning was maintained in supramarginal gyrus (associated with verbal short-term memory) when items were judged to be unrelated, but not when a linking context was retrieved. Context-dependent meaning was instead represented in left lateral prefrontal gyrus (associated with controlled retrieval), angular gyrus, and ventral temporal lobe (regions associated with integrative aspects of memory). Analyses of informational connectivity, examining the similarity of activation patterns across trials between sites, showed that control network regions had more similar multivariate responses across trials when association strength was weak, reflecting a common controlled retrieval state when the task required more unusual associations. These findings indicate that semantic control and representational sites amplify contextually relevant meanings in trials judged to be related.

Flexing the principal gradient of the cerebral cortex to suit changing semantic task demands

Understanding how thought emerges from the topographical structure of the cerebral cortex is a primary goal of cognitive neuroscience. Recent work has revealed a principal gradient of intrinsic connectivity capturing the separation of sensory-motor cortex from transmodal regions of the default mode network (DMN); this is thought to facilitate memory-guided cognition. However, studies have not explored how this dimension of connectivity changes when conceptual retrieval is controlled to suit the context. We used gradient decomposition of informational connectivity in a semantic association task to establish how the similarity in connectivity across brain regions changes during familiar and more original patterns of retrieval. Multivoxel activation patterns at opposite ends of the principal gradient were more divergent when participants retrieved stronger associations; therefore, when long-term semantic information is sufficient for ongoing cognition, regions supporting heteromodal memory are functionally separated from sensory-motor experience. In contrast, when less related concepts were linked, this dimension of connectivity was reduced in strength as semantic control regions separated from the DMN to generate more flexible and original responses. We also observed fewer dimensions within the neural response towards the apex of the principal gradient when strong associations were retrieved, reflecting less complex or varied neural coding across trials and participants. In this way, the principal gradient explains how semantic cognition is organised in the human cerebral cortex: the separation of DMN from sensory-motor systems is a hallmark of the retrieval of strong conceptual links that are culturally shared.

Diffusion magnetic resonance imaging connectome features are predictive of functional lateralization of semantic processing in the anterior temporal lobes

Assessment of regional language lateralization is crucial in many scenarios, but not all populations are suited for its evaluation via task-functional magnetic resonance imaging (fMRI). In this study, the utility of structural connectome features for the classification of language lateralization in the anterior temporal lobes (ATLs) was investigated. Laterality indices for semantic processing in the ATL were computed from task-fMRI in 1038 subjects from the Human Connectome Project who were labeled as stronger rightward lateralized (RL) or stronger leftward to bilaterally lateralized (LL) in a data-driven approach. Data of unrelated subjects (n = 432) were used for further analyses. Structural connectomes were generated from diffusion-MRI tractography, and graph theoretical metrics (node degree, betweenness centrality) were computed. A neural network (NN) and a random forest (RF) classifier were trained on these metrics to classify subjects as RL or LL. After classification, comparisons of network measures were conducted via permutation testing. Degree-based classifiers produced significant above-chance predictions both during cross-validation (NN: AUC-ROC[CI] = 0.68[0.64-0.73], accuracy[CI] = 68.34%[63-73.2%]; RF: AUC-ROC[CI] = 0.7[0.66-0.73], accuracy[CI] = 64.81%[60.9-68.5]) and testing (NN: AUC-ROC[CI] = 0.69[0.53-0.84], accuracy[CI] = 68.09[53.2-80.9]; RF: AUC-ROC[CI] = 0.68[0.53-0.84], accuracy[CI] = 68.09[55.3-80.9]). Comparison of network metrics revealed small effects of increased node degree within the right posterior middle temporal gyrus (pMTG) in subjects with RL, while degree was decreased in the right posterior cingulate cortex (PCC). Above-chance predictions of functional language lateralization in the ATL are possible based on diffusion-MRI connectomes alone. Increased degree within the right pMTG as a right-sided homologue of a known semantic hub, and decreased hubness of the right PCC may form a structural basis for rightward-lateralized semantic processing.

Temporal pole volume is associated with episodic autobiographical memory in healthy older adults

Recollection of personal past events differs across the lifespan. Older individuals recall fewer episodic details and convey more semantic information than young. Here we examine how gray matter volumes in temporal lobe regions integral to episodic and semantic memory (hippocampus and temporal poles, respectively) are related to age differences in autobiographical recollection. Gray matter volumes were obtained in healthy young (n = 158) and old (n = 105) adults. The temporal pole was demarcated and hippocampus segmented into anterior and posterior regions to test for volume differences between age groups. The Autobiographical Interview was administered to measure episodic and semantic autobiographical memory. Volume associations with episodic and semantic autobiographical memory were then assessed. Brain volumes were smaller for older adults in the posterior hippocampus. Autobiographical memory was less episodic and more semanticized for older versus younger adults. Older adults also showed positive associations between temporal pole volumes and episodic autobiographical recall; in the young, temporal pole volume was positively associated with performance on standard laboratory measures of semantic memory. Exploratory analyses revealed that age-related episodic autobiographical memory associations with anterior hippocampal volumes depended on sex. These findings suggest that age differences in brain structures implicated in episodic and semantic memory may portend reorganization of neural circuits to support autobiographical memory in later life.

Electrocorticographic evidence of a common neurocognitive sequence for mentalizing about the self and others

Neuroimaging studies of mentalizing (i.e., theory of mind) consistently implicate the default mode network (DMN). Nevertheless, the social cognitive functions of individual DMN regions remain unclear, perhaps due to limited spatiotemporal resolution in neuroimaging. Here we use electrocorticography (ECoG) to directly record neuronal population activity while 16 human participants judge the psychological traits of themselves and others. Self- and other-mentalizing recruit near-identical cortical sites in a common spatiotemporal sequence. Activations begin in the visual cortex, followed by temporoparietal DMN regions, then finally in medial prefrontal regions. Moreover, regions with later activations exhibit stronger functional specificity for mentalizing, stronger associations with behavioral responses, and stronger self/other differentiation. Specifically, other-mentalizing evokes slower and longer activations than self-mentalizing across successive DMN regions, implying lengthier processing at higher levels of representation. Our results suggest a common neurocognitive pathway for self- and other-mentalizing that follows a complex spatiotemporal gradient of functional specialization across DMN and beyond.

Enhancing vs. inhibiting semantic performance with transcranial magnetic stimulation over the anterior temporal lobe: Frequency- and task-specific effects

Accumulating, converging evidence indicates that the anterior temporal lobe (ATL) appears to be the transmodal hub for semantic representation. A series of repetitive transcranial magnetic stimulation (rTMS) investigations utilizing the ‘virtual lesion’ approach have established the brain-behavioural relationship between the ATL and semantic processing by demonstrating that inhibitory rTMS over the ATL induced impairments in semantic performance in healthy individuals. However, a growing body of rTMS studies suggest that rTMS might also be a tool for cognitive enhancement and rehabilitation, though there has been no previous exploration in semantic cognition. Here, we explored a potential role of rTMS in enhancing and inhibiting semantic performance with contrastive rTMS protocols (1 Hz vs. 20 Hz) by controlling practice effects. Twenty-one healthy participants were recruited and performed an object category judgement task and a pattern matching task serving as a control task before and after the stimulation over the ATL (1 Hz, 20 Hz, and sham). A task familiarization procedure was performed prior to the experiment in order to establish a ‘stable baseline’ prior to stimulation and thus minimize practice effect. Our results demonstrated that it is possible to modulate semantic performance positively or negatively depending on the ATL stimulation frequency: 20 Hz rTMS was optimal for facilitating cortical processing (faster RT in a semantic task) contrasting with diminished semantic performance after 1 Hz rTMS. In addition to cementing the importance of the ATL to semantic representation, our findings suggest that 20 Hz rTMS leads to semantic enhancement in healthy individuals and potentially could be used for patients with semantic impairments as a therapeutic tool.

Knowing what you need to know in advance: The neural processes underpinning flexible semantic retrieval of thematic and taxonomic relations

Semantic retrieval is flexible, allowing us to focus on subsets of features and associations that are relevant to the current task or context: for example, we use taxonomic relations to locate items in the supermarket (carrots are a vegetable), but thematic associations to decide which tools we need when cooking (carrot goes with peeler). We used fMRI to investigate the neural basis of this form of semantic flexibility; in particular, we asked how retrieval unfolds differently when participants have advanced knowledge of the type of link to retrieve between concepts (taxonomic or thematic). Participants performed a semantic relatedness judgement task: on half the trials, they were cued to search for a taxonomic or thematic link, while on the remaining trials, they judged relatedness without knowing which type of semantic relationship would be relevant. Left inferior frontal gyrus showed greater activation when participants knew the trial type in advance. An overlapping region showed a stronger response when the semantic relationship between the items was weaker, suggesting this structure supports both top-down and bottom-up forms of semantic control. Multivariate pattern analysis further revealed that the neural response in left inferior frontal gyrus reflects goal information related to different conceptual relationships. Top-down control specifically modulated the response in visual cortex: when the goal was unknown, there was greater deactivation to the first word, and greater activation to the second word. We conclude that top-down control of semantic retrieval is primarily achieved through the gating of task-relevant 'spoke' regions.

Intrinsic connectivity of anterior temporal lobe relates to individual differences in semantic retrieval for landmarks

Contemporary neuroscientific accounts suggest that ventral anterior temporal lobe (ATL) acts as a bilateral heteromodal semantic hub, which is particularly critical for the specific-level knowledge needed to recognise unique entities, such as familiar landmarks and faces. There may also be graded functional differences between left and right ATL, relating to effects of modality (linguistic versus non-linguistic) and category (e.g., knowledge of people and places). Individual differences in intrinsic connectivity from left and right ATL might be associated with variation in semantic categorisation performance across these categories and modalities. We recorded resting-state fMRI in 74 individuals and, in a separate session, examined semantic categorisation. People with greater connectivity between left and right ATL were more efficient at categorising landmarks (e.g., Eiffel Tower), especially when these were presented visually. In addition, participants who showed stronger connectivity from right than left ATL to medial occipital cortex showed more efficient semantic categorisation of landmarks regardless of modality of presentation. These results can be interpreted in terms of graded differences in the patterns of connectivity across left and right ATL, which give rise to a bilateral yet partially segregated semantic 'hub'. More specifically, right ATL connectivity supports the efficient semantic categorisation of landmarks.

Dynamic activity patterns in the anterior temporal lobe represents object semantics

The anterior temporal lobe (ATL) is considered a crucial area for the representation of transmodal concepts. Recent evidence suggests that specific regions within the ATL support the representation of individual object concepts, as shown by studies combining multivariate analysis methods and explicit measures of semantic knowledge. This research looks to further our understanding by probing conceptual representations at a spatially and temporally resolved neural scale. Representational similarity analysis was applied to human intracranial recordings from anatomically defined lateral to medial ATL sub-regions. Neural similarity patterns were tested against semantic similarity measures, where semantic similarity was defined by a hybrid corpus-based and feature-based approach. Analyses show that the perirhinal cortex, in the medial ATL, significantly related to semantic effects around 200 to 400 ms, and were greater than more lateral ATL regions. Further, semantic effects were present in low frequency (theta and alpha) oscillatory phase signals. These results provide converging support that more medial regions of the ATL support the representation of basic-level visual object concepts within the first 400 ms, and provide a bridge between prior fMRI and MEG work by offering detailed evidence for the presence of conceptual representations within the ATL.

The Neural Mechanism of the Social Framing Effect: Evidence from fMRI and tDCS Studies

As an important cognitive bias, the framing effect shows that our decision preferences are sensitive to the verbal description (i.e., frame) of options. This study focuses on the neural underpinnings of the social framing effect, which is based on decision-making regarding other people. A novel paradigm was used in which participants made a trade-off between economic benefits and the feelings of others. This decision was described as either a "harm" to, or "not helping," other persons in two conditions (Harm frame vs Help frame). Both human males and females were recruited. Participants behaved more prosocially for Harm frame compared with Help frame, resulting in a significant social framing effect. Using functional magnetic resonance imaging, Experiment 1 showed that the social framing effect was associated with stronger activation in the temporoparietal junction (TPJ), especially its right part. The functional connectivity between the right TPJ (rTPJ) and medial prefrontal cortex predicted the social framing effect on the group level. In Experiment 2, we used transcranial direct current stimulation to modulate the activity of the rTPJ and found that the social framing effect became more prominent under anodal (excitatory) stimulation, while the nonsocial framing effect elicited by the economic gain/loss gambling frame remained unaffected. The rTPJ results might be associated with moral conflicts modulated by the social consequences of an action or different levels of mentalizing with others under different frame conditions, but alternative interpretations are also worth noting. These findings could help elucidate the psychological mechanisms of the social framing effect.SIGNIFICANCE STATEMENT Previous studies have suggested that the framing effect is generated from an interaction between the amygdala and anterior cingulate cortex. This opinion, however, is based on findings from nonsocial framing tasks. Recent research has highlighted the importance of distinguishing between the social and nonsocial framing effects. The current study focuses on the social framing effect and finds out that the temporoparietal junction and its functional connectivity with the medial prefrontal cortex play a significant role. Additionally, modulating the activity of this region leads to changes in social (but not nonsocial) framing effect. Broadly speaking, these findings help understand the difference in neural mechanisms between social and nonsocial decision-making. Meanwhile, they might be illuminating to promote helping behavior in society.

Linking individual differences in semantic cognition to white matter microstructure

Semantic cognition is thought to involve the interaction of heteromodal conceptual representations with control processes that (i) focus retrieval on currently-relevant information, and (ii) suppress dominant yet irrelevant features and associations. Research suggests that semantic control demands are higher when retrieving a link between weakly-associated word pairs, since there is a mismatch between the pattern of semantic retrieval required by the task and the dominant associations of individual words. In addition, given that heteromodal concepts are thought to reflect the integration of vision, audition, valence and other features, the control demands of semantic tasks should be higher when there is less consistency between these features. In the present study, 62 volunteers completed a semantic decision task, where association strength and semantic-affective congruence were manipulated. We used diffusion tensor magnetic resonance imaging to obtain fractional anisotropy (FA) measures of white matter tracts hypothesized to be part of the semantic network. The behavioural data revealed an interaction between semantic-affective congruence and strength of association, suggesting these manipulations both contribute to semantic control demands. Next we considered how individual differences in these markers of semantic control relate to the microstructure of canonical white matter tracts, complementing previous studies that have largely focused on measures of intrinsic functional connectivity. Repeated-measures analysis of covariance showed opposing interactions between semantic control markers and FA of two tracts: left inferior longitudinal fasciculus (ILF) and right inferior fronto-occipital fasciculus (IFOF). Participants with higher FA in left ILF showed more efficient retrieval of weak associations, and more accurate performance for weak associations when meaning and valence were incongruent, consistent with the hypothesis that this left hemisphere tract supports semantic control. In contrast, participants with higher FA in right IFOF were more accurate for trials in which meaning and valence were congruent, and consequently when semantic control demands were minimised. These findings are consistent with recent studies showing that semantic control processes are strongly left-lateralised. In contrast, long-range connections from vision to semantic regions in the right hemisphere might support relatively automatic patterns of semantic retrieval.

Distinct individual differences in default mode network connectivity relate to off-task thought and text memory during reading

Often, as we read, we find ourselves thinking about something other than the text; this tendency to mind-wander is linked to poor comprehension and reduced subsequent memory for texts. Contemporary accounts argue that periods of off-task thought are related to the tendency for attention to be decoupled from external input. We used fMRI to understand the neural processes that underpin this phenomenon. First, we found that individuals with poorer text-based memory tend to show reduced recruitment of left middle temporal gyrus in response to orthographic input, within a region located at the intersection of default mode, dorsal attention and frontoparietal networks. Voxels within these networks were taken as seeds in a subsequent resting-state study. The default mode network region (i) had greater connectivity with medial prefrontal cortex, falling within the same network, for individuals with better text-based memory, and (ii) was more decoupled from medial visual regions in participants who mind-wandered more frequently. These findings suggest that stronger intrinsic connectivity within the default mode network is linked to better text processing, while reductions in default mode network coupling to the visual system may underpin individual variation in the tendency for our attention to become disengaged from what we are reading.

Imagining Sounds and Images: Decoding the Contribution of Unimodal and Transmodal Brain Regions to Semantic Retrieval in the Absence of Meaningful Input

In the absence of sensory information, we can generate meaningful images and sounds from representations in memory. However, it remains unclear which neural systems underpin this process and whether tasks requiring the top–down generation of different kinds of features recruit similar or different neural networks. We asked people to internally generate the visual and auditory features of objects, either in isolation (car, dog) or in specific and complex meaning-based contexts (car/dog race). Using an fMRI decoding approach, in conjunction with functional connectivity analysis, we examined the role of auditory/visual cortex and transmodal brain regions. Conceptual retrieval in the absence of external input recruited sensory and transmodal cortex. The response in transmodal regions—including anterior middle temporal gyrus—was of equal magnitude for visual and auditory features yet nevertheless captured modality information in the pattern of response across voxels. In contrast, sensory regions showed greater activation for modality-relevant features in imagination (even when external inputs did not differ). These data are consistent with the view that transmodal regions support internally generated experiences and that they play a role in integrating perceptual features encoded in memory.

Dissociations in semantic cognition: Oscillatory evidence for opposing effects of semantic control and type of semantic relation in anterior and posterior temporal cortex

How does the brain represent and process different types of knowledge? The Dual Hub account postulates that anterior temporal lobes (ATL) support taxonomic relationships based on shared physical features (mole – cat), while temporoparietal regions, including posterior middle temporal gyrus (pMTG), support thematic associations (mole – earth). Conversely, the Controlled Semantic Cognition account proposes that ATL supports both aspects of knowledge, while left pMTG contributes to controlled retrieval. This study used magnetoencephalography to test these contrasting predictions of functional dissociations within the temporal lobe. ATL and pMTG responded more strongly to taxonomic and thematic trials respectively, matched for behavioural performance, in line with predictions of the Dual Hub account. In addition, ATL showed a greater response to strong than weak thematic associations, while pMTG showed the opposite pattern, supporting a key prediction of the Controlled Semantic Cognition account. ATL showed a stronger response for word pairs that were more semantically coherent, either because they shared physical features (in taxonomic trials) or a strong thematic association. These effects largely coincided in time and frequency (although an early oscillatory response in ATL was specific to taxonomic trials). In contrast, pMTG showed non-overlapping effects of semantic control demands and thematic judgements: this site showed a larger oscillatory response to weak associations, when ongoing retrieval needed to be shaped to suit the task demands, and also a larger response to thematic judgements contrasted with taxonomic trials (which was reduced but not eliminated when the thematic trials were easier). Consequently, time-sensitive neuroimaging supports a complex pattern of functional dissociations within the left temporal lobe, which reflects both coherence versus control and distinctive oscillatory responses for taxonomic overlap (in ATL) and thematic relations (in pMTG).

Reduced semantic control in older adults is linked to intrinsic DMN connectivity

Ageing provides an interesting window into semantic cognition: while younger adults generally outperform older adults on many cognitive tasks, knowledge continues to accumulate over the lifespan and consequently, the semantic store (i.e., vocabulary size) remains stable (or even improves) during healthy ageing. Semantic cognition involves the interaction of at least two components - a semantic store and control processes that interact to ensure efficient and context-relevant use of representations. Given older adults perform less well on tasks measuring executive control, their ability to access the semantic store in a goal driven manner may be compromised. Older adults also consistently show reductions in intrinsic brain connectivity, and we examined how these brain changes relate to age-related changes in semantic performance. We found that while older participants outperformed their younger counterparts on tests of vocabulary size (i.e., NART), younger participants were faster and more accurate in tasks requiring semantic control, and these age differences correlated with measures of intrinsic connectivity between the anterior temporal lobe (ATL) and medial prefrontal cortex (mPFC), within the default mode network. Higher intrinsic connectivity from right ATL to mPFC at rest related to better performance on verbal (but not picture) semantic tasks, and older adults showed an exaggerated version of this pattern, suggesting that this within-DMN connectivity may become more important for conceptual access from words as we age. However, this appeared to be at the expense of control over semantic retrieval - there was little relationship between connectivity and performance for strong associations in either group, but older adults with stronger connectivity showed particularly inefficient retrieval of weak associations. Older adults may struggle to harness the default mode network to support demanding patterns of semantic retrieval, resulting in a performance cost.

The effects of psychiatric history and age on self-regulation of the default mode network

Real-time neurofeedback enables human subjects to learn to regulate their brain activity, effecting behavioral changes and improvements of psychiatric symptomatology. Neurofeedback up-regulation and down-regulation have been assumed to share common neural correlates. Neuropsychiatric pathology and aging incur suboptimal functioning of the default mode network. Despite the exponential increase in real-time neuroimaging studies, the effects of aging, pathology and the direction of regulation on neurofeedback performance remain largely unknown. Using real-time fMRI data shared through the Rockland Sample Real-Time Neurofeedback project (N = 136) and open-access analyses, we first modeled neurofeedback performance and learning in a group of subjects with psychiatric history (n_a = 74) and a healthy control group (n_b = 62). Subsequently, we examined the relationship between up-regulation and down-regulation learning, the relationship between age and neurofeedback performance in each group and differences in neurofeedback performance between the two groups. For interpretative purposes, we also investigated functional connectomics prior to neurofeedback. Results show that in an initial session of default mode network neurofeedback with real-time fMRI, up-regulation and down-regulation learning scores are negatively correlated. This finding is related to resting state differences in the eigenvector centrality of the posterior cingulate cortex. Moreover, age correlates negatively with default mode network neurofeedback performance, only in absence of psychiatric history. Finally, adults with psychiatric history outperform healthy controls in default mode network up-regulation. Interestingly, the performance difference is related to no up-regulation learning in controls. This finding is supported by marginally higher default mode network centrality during resting state, in the presence of psychiatric history.

The devil is in the detail: exploring the intrinsic neural mechanisms that link attention-deficit/hyperactivity disorder symptomatology to ongoing cognition

BACKGROUND

Attention-deficit/hyperactivity disorder (ADHD) is a developmental condition that profoundly affects quality of life. Although mounting evidence now suggests uncontrolled mind-wandering as a core aspect of the attentional problems associated with ADHD, the neural mechanisms underpinning this deficit remains unclear. To that extent, competing views argue for (i) excessive generation of task-unrelated mental content, or (ii) deficiency in the control of task-relevant cognition.

METHODS

In a cross-sectional investigation of a large neurotypical cohort (n = 184), we examined alterations in the intrinsic brain functional connectivity architecture of the default mode (DMN) and frontoparietal (FPN) networks during resting state functional magnetic resonance imaging in relation to ADHD symptomatology, which could potentially underlie changes in ongoing thought within variable environmental contexts.

RESULTS

The results illustrated that ADHD symptoms were linked to lower levels of detail in ongoing thought while the participants made more difficult, memory based decisions. Moreover, greater ADHD scores were associated with lower levels of connectivity between the DMN and right sensorimotor cortex, and between the FPN and right ventral visual cortex. Finally, a combination of high levels of ADHD symptomology with reduced FPN connectivity to the visual cortex was associated with reduced levels of detail in thought.

CONCLUSIONS

The results of our study suggest that the frequent mind-wandering observed in ADHD may be an indirect consequence of the deficient control of ongoing cognition in response to increasing environmental demands, and that this may partly arise from dysfunctions in the intrinsic organisation of the FPN at rest.

Music enhances activity in the hypothalamus, brainstem, and anterior cerebellum during script-driven imagery of affective scenes

Music is frequently used to establish atmosphere and to enhance/alter emotion in dramas and films. During music listening, visual imagery is a common mechanism underlying emotion induction. The present functional magnetic resonance imaging (fMRI) study examined the neural substrates of the emotional processing of music and imagined scene. A factorial design was used with factors emotion valence (positive; negative) and music (withoutMUSIC: script-driven imagery of emotional scenes; withMUSIC: script-driven imagery of emotional scenes and simultaneously listening to affectively congruent music). The baseline condition was imagery of neutral scenes in the absence of music. Eleven females and five males participated in this fMRI study. Behavioural data revealed that during scene imagery, participants' subjective emotions were significantly intensified by music. The contrasts of positive and negative withoutMUSIC conditions minus the baseline (imagery of neutral scenes) showed no significant activation. When comparing the withMUSIC to withoutMUSIC conditions, activity in a number of emotion-related regions was observed, including the temporal pole (TP), amygdala, hippocampus, hypothalamus, anterior ventral tegmental area (VTA), locus coeruleus, and anterior cerebellum. We hypothesized that the TP may integrate music and the imagined scene to extract socioemotional significance, initiating the subcortical structures to generate subjective feelings and bodily responses. For the withMUSIC conditions, negative emotions were associated with enhanced activation in the posterior VTA compared to positive emotions. Our findings replicated and extended previous research which suggests that different subregions of the VTA are sensitive to rewarding and aversive stimuli. Taken together, this study suggests that emotional music embedded in an imagined scenario is a salient social signal that prompts preparation of approach/avoidance behaviours and emotional responses in listeners.

Default mode network can support the level of detail in experience during active task states

Accounts of the default mode network (DMN) as task negative are partly based on evidence for a role of this system in off-task thought. We revisited the evidence for this assumption in a study combining experience sampling with functional neuroimaging. Whether thoughts were related or unrelated to an ongoing task was associated with patterns of neural activity in regions adjacent to unimodal sensorimotor cortex. In contrast, during periods of working-memory maintenance, activity patterns in the DMN were associated with whether thoughts were detailed. These results demonstrate that activity within the DMN encodes information associated with ongoing cognition that goes beyond whether attention is directed to the task, including detailed experiences during active task states.

Regions of transmodal cortex, in particular the default mode network (DMN), have historically been argued to serve functions unrelated to task performance, in part because of associations with naturally occurring periods of off-task thought. In contrast, contemporary views of the DMN suggest it plays an integrative role in cognition that emerges from its location at the top of a cortical hierarchy and its relative isolation from systems directly involved in perception and action. The combination of these topographical features may allow the DMN to support abstract representations derived from lower levels in the hierarchy and so reflect the broader cognitive landscape. To investigate these contrasting views of DMN function, we sampled experience as participants performed tasks varying in their working-memory load while inside an fMRI scanner. We used self-report data to establish dimensions of thought that describe levels of detail, the relationship to a task, the modality of thought, and its emotional qualities. We used representational similarity analysis to examine correspondences between patterns of neural activity and each dimension of thought. Our results were inconsistent with a task-negative view of DMN function. Distinctions between on- and off-task thought were associated with patterns of consistent neural activity in regions adjacent to unimodal cortex, including motor and premotor cortex. Detail in ongoing thought was associated with patterns of activity within the DMN during periods of working-memory maintenance. These results demonstrate a contribution of the DMN to ongoing cognition extending beyond task-unrelated processing that can include detailed experiences occurring under active task conditions.

Integrated deep visual and semantic attractor neural networks predict fMRI pattern-information along the ventral object processing pathway

Recognising an object involves rapid visual processing and activation of semantic knowledge about the object, but how visual processing activates and interacts with semantic representations remains unclear. Cognitive neuroscience research has shown that while visual processing involves posterior regions along the ventral stream, object meaning involves more anterior regions, especially perirhinal cortex. Here we investigate visuo-semantic processing by combining a deep neural network model of vision with an attractor network model of semantics, such that visual information maps onto object meanings represented as activation patterns across features. In the combined model, concept activation is driven by visual input and co-occurrence of semantic features, consistent with neurocognitive accounts. We tested the model’s ability to explain fMRI data where participants named objects. Visual layers explained activation patterns in early visual cortex, whereas pattern-information in perirhinal cortex was best explained by later stages of the attractor network, when detailed semantic representations are activated. Posterior ventral temporal cortex was best explained by intermediate stages corresponding to initial semantic processing, when visual information has the greatest influence on the emerging semantic representation. These results provide proof of principle of how a mechanistic model of combined visuo-semantic processing can account for pattern-information in the ventral stream.

Distant from input: Evidence of regions within the default mode network supporting perceptually-decoupled and conceptually-guided cognition

The default mode network supports a variety of mental operations such as semantic processing, episodic memory retrieval, mental time travel and mind-wandering, yet the commonalities between these functions remains unclear. One possibility is that this system supports cognition that is independent of the immediate environment; alternatively or additionally, it might support higher-order conceptual representations that draw together multiple features. We tested these accounts using a novel paradigm that separately manipulated the availability of perceptual information to guide decision-making and the representational complexity of this information. Using task based imaging we established regions that respond when cognition combines both stimulus independence with multi-modal information. These included left and right angular gyri and the left middle temporal gyrus. Although these sites were within the default mode network, they showed a stronger response to demanding memory judgements than to an easier perceptual task, contrary to the view that they support automatic aspects of cognition. In a subsequent analysis, we showed that these regions were located at the extreme end of a macroscale gradient, which describes gradual transitions from sensorimotor to transmodal cortex. This shift in the focus of neural activity towards transmodal, default mode, regions might reflect a process of where the functional distance from specific sensory enables conceptually rich and detailed cognitive states to be generated in the absence of input.

Dynamic semantic cognition: Characterising coherent and controlled conceptual retrieval through time using magnetoencephalography and chronometric transcranial magnetic stimulation

Distinct neural processes are thought to support the retrieval of semantic information that is (i) coherent with strongly-encoded aspects of knowledge, and (ii) non-dominant yet relevant for the current task or context. While the brain regions that support readily coherent and more controlled patterns of semantic retrieval are relatively well-characterised, the temporal dynamics of these processes are not well-understood. This study used magnetoencephalography (MEG) and dual-pulse chronometric transcranial magnetic stimulation (cTMS) in two separate experiments to examine temporal dynamics during the retrieval of strong and weak associations. MEG results revealed a dissociation within left temporal cortex: anterior temporal lobe (ATL) showed greater oscillatory response for strong than weak associations, while posterior middle temporal gyrus (pMTG) showed the reverse pattern. Left inferior frontal gyrus (IFG), a site associated with semantic control and retrieval, showed both patterns at different time points. In the cTMS experiment, stimulation of ATL at ∼150 msec disrupted the efficient retrieval of strong associations, indicating a necessary role for ATL in coherent conceptual activations. Stimulation of pMTG at the onset of the second word disrupted the retrieval of weak associations, suggesting this site may maintain information about semantic context from the first word, allowing efficient engagement of semantic control. Together these studies provide converging evidence for a functional dissociation within the temporal lobe, across both tasks and time.

From percept to concept in the ventral temporal lobes: Graded hemispheric specialisation based on stimulus and task

The left and right ventral anterior temporal lobes (vATL) have been implicated as key regions for the representation of conceptual knowledge. However, the nature and degree of hemispheric specialisation in their function is unclear. To address this issue, we investigated hemispheric specialisation in the ventral temporal lobes using a distortion-corrected spin-echo fMRI protocol that enhanced signal in vATL. We employed an orthogonal manipulation of stimulus (written words vs pictured objects) and task (naming vs recognition). Words elicited left-lateralised vATL activation while objects elicited bilateral activation with no hemispheric bias. In contrast, posterior ventral temporal cortex exhibited a rightward bias for objects as well as a leftward bias for words. Naming tasks produced left-lateralised activation in vATL while activity for recognition was equal in left and right vATLs. These findings are incompatible with proposals that left and right ATLs are strongly modular in function, since these predict rightward as well as leftward biases. Instead, they support an alternative model in which (a) left and right ATL together form a bilateral, integrated system for the representation of concepts and (b) within this system, graded hemispheric specialisation emerges as a consequence of differential connectivity with other neural systems. On this view, greater left vATL activation for written word processing develops as a consequence of the inputs this region receives from left-lateralised visual word processing system in posterior temporal cortex. Greater left vATL activation during naming tasks is most likely due to connectivity with left-lateralised speech output systems in prefrontal and motor cortices.

Integrative and distinctive coding of visual and conceptual object features in the ventral visual stream

A significant body of research in cognitive neuroscience is aimed at understanding how object concepts are represented in the human brain. However, it remains unknown whether and where the visual and abstract conceptual features that define an object concept are integrated. We addressed this issue by comparing the neural pattern similarities among object-evoked fMRI responses with behavior-based models that independently captured the visual and conceptual similarities among these stimuli. Our results revealed evidence for distinctive coding of visual features in lateral occipital cortex, and conceptual features in the temporal pole and parahippocampal cortex. By contrast, we found evidence for integrative coding of visual and conceptual object features in perirhinal cortex. The neuroanatomical specificity of this effect was highlighted by results from a searchlight analysis. Taken together, our findings suggest that perirhinal cortex uniquely supports the representation of fully specified object concepts through the integration of their visual and conceptual features.

Context-dependent lexical ambiguity resolution: MEG evidence for the time-course of activity in left inferior frontal gyrus and posterior middle temporal gyrus

An MEG study investigated the role of context in semantic interpretation by examining the comprehension of ambiguous words in contexts leading to different interpretations. We compared high-ambiguity words in minimally different contexts (to bowl, the bowl) to low-ambiguity counterparts (the tray, to flog). Whole brain beamforming revealed the engagement of left inferior frontal gyrus (LIFG) and posterior middle temporal gyrus (LPMTG). Points of interest analyses showed that both these sites showed a stronger response to verb-contexts by 200 ms post-stimulus and displayed overlapping ambiguity effects that were sustained from 300 ms onwards. The effect of context was stronger for high-ambiguity words than for low-ambiguity words at several different time points, including within the first 100 ms post-stimulus. Unlike LIFG, LPMTG also showed stronger responses to verb than noun contexts in low-ambiguity trials. We argue that different functional roles previously attributed to LIFG and LPMTG are in fact played out at different periods during processing.