1
|
Reward Value Enhances Sequence Monitoring Ramping Dynamics as Ending Rewards Approach in the Rostrolateral Prefrontal Cortex. eNeuro 2022; 9:ENEURO.0003-22.2022. [PMID: 35168953 PMCID: PMC8906790 DOI: 10.1523/eneuro.0003-22.2022] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2022] [Accepted: 01/25/2022] [Indexed: 11/21/2022] Open
Abstract
Many fundamental human behaviors contain multiple sequences performed to reach a desired outcome, such as cooking. Reward is inherently associated with sequence completion and has been shown to generally enhance cognitive control. However, the impact of reward on cognitive sequence processing remains unexplored. To address this key question, we focused on the rostrolateral prefrontal cortex (RLPFC). This area is necessary and exhibits increasing (“ramping”) activation during sequences, a dynamic that may be related to reward processing in other brain regions. To separate these dynamics, we designed a task where reward was only provided after multiple four-item sequences (“iterations”), rather than each individual sequence. Using fMRI in humans, we investigated three possible interactions of reward and sequential control signals in RLPFC: (1) with the visibility of sequential cues, i.e., memory; (2) equally across individual sequence iterations; and (3) differently across individual sequence iterations (e.g., increasing as reward approaches). Evidence from previous, nonsequential cognitive control experiments suggested that reward would uniformly change RLPFC activity across iterations and may depend on the visibility of cues. However, we found the influence of reward on RLPFC ramping increased across sequence iterations and did not interact with memory. These results suggest an active, predictive, and distinctive role for RLPFC in sequence monitoring and integration of reward information, consistent with extant literature demonstrating similar accelerating reward-related dopamine dynamics in regions connected to RLPFC. These results have implications for understanding sequential behavior in daily life, and when they go awry in disorders such as addiction.
Collapse
|
2
|
Goodroe SC, Starnes J, Brown TI. The Complex Nature of Hippocampal-Striatal Interactions in Spatial Navigation. Front Hum Neurosci 2018; 12:250. [PMID: 29977198 PMCID: PMC6021746 DOI: 10.3389/fnhum.2018.00250] [Citation(s) in RCA: 65] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2018] [Accepted: 05/30/2018] [Indexed: 12/15/2022] Open
Abstract
Decades of research have established the importance of the hippocampus for episodic and spatial memory. In spatial navigation tasks, the role of the hippocampus has been classically juxtaposed with the role of the dorsal striatum, the latter of which has been characterized as a system important for implementing stimulus-response and action-outcome associations. In many neuroimaging paradigms, this has been explored through contrasting way finding and route-following behavior. The distinction between the contributions of the hippocampus and striatum to spatial navigation has been supported by extensive literature. Convergent research has also underscored the fact that these different memory systems can interact in dynamic ways and contribute to a broad range of navigational scenarios. For example, although familiar routes may often be navigable based on stimulus-response associations, hippocampal episodic memory mechanisms can also contribute to egocentric route-oriented memory, enabling recall of context-dependent sequences of landmarks or the actions to be made at decision points. Additionally, the literature has stressed the importance of subdividing the striatum into functional gradients—with more ventral and medial components being important for the behavioral expression of hippocampal-dependent spatial memories. More research is needed to reveal how networks involving these regions process and respond to dynamic changes in memory and control demands over the course of navigational events. In this Perspective article, we suggest that a critical direction for navigation research is to further characterize how hippocampal and striatal subdivisions interact in different navigational contexts.
Collapse
Affiliation(s)
- Sarah C Goodroe
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, United States
| | - Jon Starnes
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, United States
| | - Thackery I Brown
- School of Psychology, Georgia Institute of Technology, Atlanta, GA, United States
| |
Collapse
|
3
|
Variants of the CNTNAP2 5' promoter as risk factors for autism spectrum disorders: a genetic and functional approach. Mol Psychiatry 2015; 20:839-49. [PMID: 25224256 DOI: 10.1038/mp.2014.103] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/18/2013] [Revised: 06/04/2014] [Accepted: 07/14/2014] [Indexed: 12/11/2022]
Abstract
Contactin-associated protein-like 2 gene (CNTNAP2), a member of the Neurexin gene superfamily, is one of the best-replicated risk genes for autism spectrum disorders (ASD). ASD are predominately genetically determined neurodevelopmental disorders characterized by impairments of language development, social interaction and communication, as well as stereotyped behavior and interests. Although CNTNAP2 expression levels were proposed to alter ASD risk, no study to date has focused on its 5' promoter. Here, we directly sequenced the CNTNAP2 5' promoter region of 236 German families with one child with ASD and detected four novel variants. Furthermore, we genotyped the three most frequent variants (rs150447075, rs34712024, rs71781329) in an additional sample of 356 families and found nominal association of rs34712024G with ASD and rs71781329GCG[7] with language development. The four novel and the three known minor alleles of the identified variants were predicted to alter transcription factor binding sites (TFBS). At the functional level, the respective sequences spanning these seven variants were bound by nuclear factors. In a luciferase promoter assay, the respective minor alleles showed cell line-specific and differentiation stage-dependent effects at the level of promoter activation. The novel potential rare risk-variant M2, a G>A mutation -215 base pairs 5' of the transcriptional start site, significantly reduced promoter efficiency in HEK293T and in undifferentiated and differentiated neuroblastoid SH-SY5Y cells. This variant was transmitted to a patient with autistic disorder. The under-transmitted, protective minor G allele of the common variant rs34712024, in contrast, increased transcriptional activity. These results lead to the conclusion that the pathomechanism of CNTNAP2 promoter variants on ASD risk is mediated by their effect on TFBSs, and thus confirm the hypothesis that a reduced CNTNAP2 level during neuronal development increases liability for ASD.
Collapse
|
4
|
Jeon HA, Friederici AD. Degree of automaticity and the prefrontal cortex. Trends Cogn Sci 2015; 19:244-50. [PMID: 25843542 DOI: 10.1016/j.tics.2015.03.003] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2015] [Revised: 02/27/2015] [Accepted: 03/06/2015] [Indexed: 10/23/2022]
Abstract
The dorsolateral prefrontal cortex (PFC), with more anterior areas [Brodmann area (BA) 45, 47, and 10], has been known to be activated as cognitive hierarchy increases. However, this does not hold for highly automatic processes such as first language (L1), where the posterior region (BA 44) is known as the key area for the processing of complex linguistic hierarchy. Discussing this disparity, we propose that the degree of automaticity (DoA) is a crucial factor for the framework of functional mapping in the PFC: the posterior-to-anterior gradient system for more controlled processes and the posterior-confined system for automatic processes. We support this view with previous findings and provide a new perspective on the functional organization of the PFC.
Collapse
Affiliation(s)
- Hyeon-Ae Jeon
- Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, Leipzig, Germany.
| | - Angela D Friederici
- Max Planck Institute for Human Cognitive and Brain Sciences, Department of Neuropsychology, Leipzig, Germany
| |
Collapse
|
5
|
The role of prediction and outcomes in adaptive cognitive control. ACTA ACUST UNITED AC 2015; 109:38-52. [PMID: 25698177 DOI: 10.1016/j.jphysparis.2015.02.001] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2014] [Revised: 01/18/2015] [Accepted: 02/07/2015] [Indexed: 02/04/2023]
Abstract
Humans adaptively perform actions to achieve their goals. This flexible behaviour requires two core abilities: the ability to anticipate the outcomes of candidate actions and the ability to select and implement actions in a goal-directed manner. The ability to predict outcomes has been extensively researched in reinforcement learning paradigms, but this work has often focused on simple actions that are not embedded in hierarchical and sequential structures that are characteristic of goal-directed human behaviour. On the other hand, the ability to select actions in accordance with high-level task goals, particularly in the presence of alternative responses and salient distractors, has been widely researched in cognitive control paradigms. Cognitive control research, however, has often paid less attention to the role of action outcomes. The present review attempts to bridge these accounts by proposing an outcome-guided mechanism for selection of extended actions. Our proposal builds on constructs from the hierarchical reinforcement learning literature, which emphasises the concept of reaching and evaluating informative states, i.e., states that constitute subgoals in complex actions. We develop an account of the neural mechanisms that allow outcome-guided action selection to be achieved in a network that relies on projections from cortical areas to the basal ganglia and back-projections from the basal ganglia to the cortex. These cortico-basal ganglia-thalamo-cortical 'loops' allow convergence - and thus integration - of information from non-adjacent cortical areas (for example between sensory and motor representations). This integration is essential in action sequences, for which achieving an anticipated sensory state signals the successful completion of an action. We further describe how projection pathways within the basal ganglia allow selection between representations, which may pertain to movements, actions, or extended action plans. The model lastly envisages a role for hierarchical projections from the striatum to dopaminergic midbrain areas that enable more rostral frontal areas to bias the selection of inputs from more posterior frontal areas via their respective representations in the basal ganglia.
Collapse
|
6
|
Functional network mirrored in the prefrontal cortex, caudate nucleus, and thalamus: high-resolution functional imaging and structural connectivity. J Neurosci 2014; 34:9202-12. [PMID: 25009254 DOI: 10.1523/jneurosci.0228-14.2014] [Citation(s) in RCA: 43] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Despite myriads of studies on a parallel organization of cortico-striatal-thalamo-cortical loops, direct evidence of this has been lacking for the healthy human brain. Here, we scrutinize the functional specificity of the cortico-subcortical loops depending on varying levels of cognitive hierarchy as well as their structural connectivity with high-resolution fMRI and diffusion-weighted MRI (dMRI) at 7 tesla. Three levels of cognitive hierarchy were implemented in two domains: second language and nonlanguage. In fMRI, for the higher level, activations were found in the ventroanterior portion of the prefrontal cortex (PFC), the head of the caudate nucleus (CN), and the ventral anterior nucleus (VA) in the thalamus. Conversely, for the lower level, activations were located in the posterior region of the PFC, the body of the CN, and the medial dorsal nucleus (MD) in the thalamus. This gradient pattern of activations was furthermore shown to be tenable by the parallel connectivity in dMRI tractography connecting the anterior regions of the PFC with the head of the CN and the VA in the thalamus, whereas the posterior activations of the PFC were linked to the body of the CN and the MD in the thalamus. This is the first human in vivo study combining fMRI and dMRI showing that the functional specificity is mirrored within the cortico-subcortical loop substantiated by parallel networks.
Collapse
|
7
|
Berns GS, Brooks AM, Spivak M. Scent of the familiar: an fMRI study of canine brain responses to familiar and unfamiliar human and dog odors. Behav Processes 2014; 110:37-46. [PMID: 24607363 DOI: 10.1016/j.beproc.2014.02.011] [Citation(s) in RCA: 64] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2013] [Revised: 01/13/2014] [Accepted: 02/14/2014] [Indexed: 11/25/2022]
Abstract
Understanding dogs' perceptual experience of both conspecifics and humans is important to understand how dogs evolved and the nature of their relationships with humans and other dogs. Olfaction is believed to be dogs' most powerful and perhaps important sense and an obvious place to begin for the study of social cognition of conspecifics and humans. We used fMRI in a cohort of dogs (N=12) that had been trained to remain motionless while unsedated and unrestrained in the MRI. By presenting scents from humans and conspecifics, we aimed to identify the dimensions of dogs' responses to salient biological odors - whether they are based on species (dog or human), familiarity, or a specific combination of factors. We focused our analysis on the dog's caudate nucleus because of its well-known association with positive expectations and because of its clearly defined anatomical location. We hypothesized that if dogs' primary association to reward, whether it is based on food or social bonds, is to humans, then the human scents would activate the caudate more than the conspecific scents. Conversely, if the smell of conspecifics activated the caudate more than the smell of humans, dogs' association to reward would be stronger to their fellow canines. Five scents were presented (self, familiar human, strange human, familiar dog, strange dog). While the olfactory bulb/peduncle was activated to a similar degree by all the scents, the caudate was activated maximally to the familiar human. Importantly, the scent of the familiar human was not the handler, meaning that the caudate response differentiated the scent in the absence of the person being present. The caudate activation suggested that not only did the dogs discriminate that scent from the others, they had a positive association with it. This speaks to the power of the dog's sense of smell, and it provides important clues about the importance of humans in dogs' lives. This article is part of a Special Issue entitled: Canine Behavior.
Collapse
Affiliation(s)
- Gregory S Berns
- Center for Neuropolicy, Emory University, Atlanta, GA 30322, United States.
| | - Andrew M Brooks
- Center for Neuropolicy, Emory University, Atlanta, GA 30322, United States
| | - Mark Spivak
- Comprehensive Pet Therapy, 6600 Roswell Road, Suite K-2, Sandy Springs, GA 30328, United States
| |
Collapse
|
8
|
Strenziok M, Greenwood PM, Santa Cruz SA, Thompson JC, Parasuraman R. Differential contributions of dorso-ventral and rostro-caudal prefrontal white matter tracts to cognitive control in healthy older adults. PLoS One 2013; 8:e81410. [PMID: 24312550 PMCID: PMC3846728 DOI: 10.1371/journal.pone.0081410] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2013] [Accepted: 10/13/2013] [Indexed: 12/27/2022] Open
Abstract
Prefrontal cortex mediates cognitive control by means of circuitry organized along dorso-ventral and rostro-caudal axes. Along the dorso-ventral axis, ventrolateral PFC controls semantic information, whereas dorsolateral PFC encodes task rules. Along the rostro-caudal axis, anterior prefrontal cortex encodes complex rules and relationships between stimuli, whereas posterior prefrontal cortex encodes simple relationships between stimuli and behavior. Evidence of these gradients of prefrontal cortex organization has been well documented in fMRI studies, but their functional correlates have not been examined with regard to integrity of underlying white matter tracts. We hypothesized that (a) the integrity of specific white matter tracts is related to cognitive functioning in a manner consistent with the dorso-ventral and rostro-caudal organization of the prefrontal cortex, and (b) this would be particularly evident in healthy older adults. We assessed three cognitive processes that recruit the prefrontal cortex and can distinguish white matter tracts along the dorso-ventral and rostro-caudal dimensions -episodic memory, working memory, and reasoning. Correlations between cognition and fractional anisotropy as well as fiber tractography revealed: (a) Episodic memory was related to ventral prefrontal cortex-thalamo-hippocampal fiber integrity; (b) Working memory was related to integrity of corpus callosum body fibers subserving dorsolateral prefrontal cortex; and (c) Reasoning was related to integrity of corpus callosum body fibers subserving rostral and caudal dorsolateral prefrontal cortex. These findings confirm the ventrolateral prefrontal cortex's role in semantic control and the dorsolateral prefrontal cortex's role in rule-based processing, in accordance with the dorso-ventral prefrontal cortex gradient. Reasoning-related rostral and caudal superior frontal white matter may facilitate different levels of task rule complexity. This study is the first to demonstrate dorso-ventral and rostro-caudal prefrontal cortex processing gradients in white matter integrity.
Collapse
Affiliation(s)
- Maren Strenziok
- Department of Psychology, George Mason University, Fairfax, Virginia, United States of America
| | - Pamela M. Greenwood
- Department of Psychology, George Mason University, Fairfax, Virginia, United States of America
| | - Sophia A. Santa Cruz
- Department of Psychology, George Mason University, Fairfax, Virginia, United States of America
| | - James C. Thompson
- Department of Psychology, George Mason University, Fairfax, Virginia, United States of America
| | - Raja Parasuraman
- Department of Psychology, George Mason University, Fairfax, Virginia, United States of America
| |
Collapse
|
9
|
Abstract
As a higher cognitive function in humans, mathematics is supported by parietal and prefrontal brain regions. Here, we give an integrative account of the role of the different brain systems in processing the semantics of mathematical logic from the perspective of macroscopic polysynaptic networks. By comparing algebraic and arithmetic expressions of identical underlying structure, we show how the different subparts of a fronto-parietal network are modulated by the semantic domain, over which the mathematical formulae are interpreted. Within this network, the prefrontal cortex represents a system that hosts three major components, namely, control, arithmetic-logic, and short-term memory. This prefrontal system operates on data fed to it by two other systems: a premotor-parietal top-down system that updates and transforms (external) data into an internal format, and a hippocampal bottom-up system that either detects novel information or serves as an access device to memory for previously acquired knowledge.
Collapse
|