1
|
The immunomodulatory effect of oral NaHCO 3 is mediated by the splenic nerve: multivariate impact revealed by artificial neural networks. J Neuroinflammation 2024; 21:79. [PMID: 38549144 PMCID: PMC10976719 DOI: 10.1186/s12974-024-03067-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Accepted: 03/18/2024] [Indexed: 04/02/2024] Open
Abstract
Stimulation of the inflammatory reflex (IR) is a promising strategy for treating systemic inflammatory disorders. Recent studies suggest oral sodium bicarbonate (NaHCO3) as a potential activator of the IR, offering a safe and cost-effective treatment approach. However, the mechanisms underlying NaHCO3-induced anti-inflammatory effects remain unclear. We investigated whether oral NaHCO3's immunomodulatory effects are mediated by the splenic nerve. Female rats received NaHCO3 or water (H2O) for four days, and splenic immune markers were assessed using flow cytometry. NaHCO3 led to a significant increase (p < 0.05, and/or partial eta squared > 0.06) in anti-inflammatory markers, including CD11bc + CD206 + (M2-like) macrophages, CD3 + CD4 + FoxP3 + cells (Tregs), and Tregs/M1-like ratio. Conversely, proinflammatory markers, such as CD11bc + CD38 + TNFα + (M1-like) macrophages, M1-like/M2-like ratio, and SSChigh/SSClow ratio of FSChighCD11bc + cells, decreased in the spleen following NaHCO3 administration. These effects were abolished in spleen-denervated rats, suggesting the necessity of the splenic nerve in mediating NaHCO3-induced immunomodulation. Artificial neural networks accurately classified NaHCO3 and H2O treatment in sham rats but failed in spleen-denervated rats, highlighting the splenic nerve's critical role. Additionally, spleen denervation independently influenced Tregs, M2-like macrophages, Tregs/M1-like ratio, and CD11bc + CD38 + cells, indicating distinct effects from both surgery and treatment. Principal component analysis (PCA) further supported the separate effects. Our findings suggest that the splenic nerve transmits oral NaHCO3-induced immunomodulatory changes to the spleen, emphasizing NaHCO3's potential as an IR activator with therapeutic implications for a wide spectrum of systemic inflammatory conditions.
Collapse
|
2
|
OFC neurons do not represent the negative value of a conditioned inhibitor. Neurobiol Learn Mem 2024; 207:107869. [PMID: 38042330 DOI: 10.1016/j.nlm.2023.107869] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/07/2023] [Revised: 11/16/2023] [Accepted: 11/28/2023] [Indexed: 12/04/2023]
Abstract
The orbitofrontal cortex (OFC) is often proposed to function as a value integrator; however, alternative accounts focus on its role in representing associative structures that specify the probability and sensory identity of future outcomes. These two accounts make different predictions about how this area should respond to conditioned inhibitors of reward, since in the former, neural activity should reflect the negative value of the inhibitor, whereas in the latter, it should track the estimated probability of a future reward based on all cues present. Here, we assessed these predictions by recording from small groups of neurons in the lateral OFC of rats during training in a conditioned inhibition design. Rats showed negative summation when the inhibitor was compounded with a novel excitor, suggesting that they learned to respond to the conditioned inhibitor appropriately. Against this backdrop, we found unit and population responses that scaled with expected reward value on excitor + inhibitor compound trials. However, the responses of these neurons did not differentiate between the conditioned inhibitor and a neutral cue when both were presented in isolation. Further, when the ensemble patterns were analyzed, activity to the conditioned inhibitor did not classify according to putative negative value. Instead, it classified with a same-modality neutral cue when presented alone and as a unique item when presented in compound with a novel excitor. This pattern of results supports the notion that OFC encodes a model of the causal structure of the environment rather than either the modality or the value of cues.
Collapse
|
3
|
Correction to: Persistent disruption of overexpectation learning after inactivation of the lateral orbitofrontal cortex in male rats. Psychopharmacology (Berl) 2023; 240:513. [PMID: 36006415 DOI: 10.1007/s00213-022-06215-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
4
|
Can a basic solution activate the inflammatory reflex? A review of potential mechanisms, opportunities, and challenges. Pharmacol Res 2023; 187:106525. [PMID: 36441036 DOI: 10.1016/j.phrs.2022.106525] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 10/09/2022] [Accepted: 10/25/2022] [Indexed: 11/24/2022]
Abstract
Stimulation of the inflammatory reflex (IR) is a promising strategy to treat systemic inflammatory disorders. However, this strategy is hindered by the cost and side effects of traditional IR activators. Recently, oral intake of sodium bicarbonate (NaHCO3) has been suggested to activate the IR, providing a safe and inexpensive alternative. Critically, the mechanisms whereby NaHCO3 might achieve this effect and more broadly the pathways underlying the IR remain poorly understood. Here, we argue that the recognition of NaHCO3 as a potential IR activator presents exciting clinical and research opportunities. To aid this quest, we provide an integrative review of our current knowledge of the neural and cellular pathways mediating the IR and discuss the status of physiological models of IR activation. From this vantage point, we derive testable hypotheses on potential mechanisms whereby NaHCO3 might stimulate the IR and compare NaHCO3 with classic IR activators. Elucidation of these mechanisms will help determine the therapeutic value of NaHCO3 as an IR activator and provide new insights into the IR circuitry.
Collapse
|
5
|
Surprise-induced enhancements in the associability of Pavlovian cues facilitate learning across behavior systems. Behav Neurosci 2022; 136:285-292. [PMID: 35175064 PMCID: PMC9396881 DOI: 10.1037/bne0000505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Surprising violations of outcome expectancies have long been known to enhance the associability of Pavlovian cues; that is, the rate at which the cue enters into further associations. The adaptive value of such enhancements resides in promoting new learning in the face of uncertainty. However, it is unclear whether associability enhancements reflect increased associative plasticity within a particular behavior system, or whether they can facilitate learning between a cue and any arbitrary outcome, as suggested by attentional models of conditioning. Here, we show evidence consistent with the latter hypothesis. Violating the outcome expectancies generated by a cue in an appetitive setting (feeding behavior system) facilitated subsequent learning about the cue in an aversive setting (defense behavior system). In addition to shedding light on the nature of associability enhancements, our findings offer the neuroscientist a behavioral tool to dissociate their neural substrates from those of other, behavior system- or valence-specific changes. Moreover, our results present an opportunity to utilize associability enhancements to the advantage of counterconditioning procedures in therapeutic contexts. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
|
6
|
Female rats take longer than male rats to update reward expectancies when outcomes are worse than expected. Behav Neurosci 2020; 134:417-423. [PMID: 32757583 DOI: 10.1037/bne0000396] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The ability to update predictive relationships and adjust behavior accordingly is critical for survival. Females take longer to update expectancies under conditions of outcome omission. It remains unknown whether that is also the case under conditions when outcomes are delivered such as in overexpectation. Here we examined whether male and female rats are able to learn from overexpectation using the same learning parameters. Our data show that males but not females learn from overexpectation when given just a single day of compound training, whereas both sexes learn when given extended 2 days of overexpectation training. These data provide important insight into sex differences that link with prior work and thus open an avenue for the study of how conflicting memories interact in the male and female brain. (PsycInfo Database Record (c) 2020 APA, all rights reserved).
Collapse
|
7
|
Different methods of fear reduction are supported by distinct cortical substrates. eLife 2020; 9:e55294. [PMID: 32589138 PMCID: PMC7343386 DOI: 10.7554/elife.55294] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2020] [Accepted: 06/25/2020] [Indexed: 12/13/2022] Open
Abstract
Understanding how learned fear can be reduced is at the heart of treatments for anxiety disorders. Tremendous progress has been made in this regard through extinction training in which the aversive outcome is omitted. However, current progress almost entirely rests on this single paradigm, resulting in a very specialized knowledgebase at the behavioural and neural level of analysis. Here, we used a dual-paradigm approach to show that different methods that lead to reduction in learned fear in rats are dissociated in the cortex. We report that the infralimbic cortex has a very specific role in fear reduction that depends on the omission of aversive events but not on overexpectation. The orbitofrontal cortex, a structure generally overlooked in fear, is critical for downregulating fear when novel predictions about upcoming aversive events are generated, such as when fear is inflated or overexpected, but less so when an expected aversive event is omitted.
Collapse
|
8
|
A self-initiated cue-reward learning procedure for neural recording in rodents. J Neurosci Methods 2020; 338:108671. [PMID: 32135212 DOI: 10.1016/j.jneumeth.2020.108671] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2019] [Revised: 02/18/2020] [Accepted: 03/01/2020] [Indexed: 11/17/2022]
Abstract
BACKGROUND Single-unit recording in Pavlovian conditioning tasks requires the use of within-subject designs as well as sampling a considerable number of trials per trial type and session, which increases the total trial count. Pavlovian conditioning, on the other hand, requires a long average intertrial interval (ITI) relative to cue duration for cue-specific learning to occur. These requirements combined can make the session duration unfeasibly long. NEW METHOD To circumvent this issue, we developed a self-initiated variant of the Pavlovian magazine-approach procedure in rodents. Unlike the standard procedure, where the animals passively receive the trials, the self-initiated procedure grants animals agency to self-administer and self-pace trials from a predetermined, pseudorandomized list. Critically, whereas in the standard procedure the typical ITI is in the order of minutes, our procedure uses a much shorter ITI (10 s). RESULTS Despite such a short ITI, discrimination learning in the self-initiated procedure is comparable to that observed in the standard procedure with a typical ITI, and superior to that observed in the standard procedure with an equally short ITI. COMPARISON WITH EXISTING METHOD(S) The self-initiated procedure permits delivering 100 trials in a ∼1-h session, almost doubling the number of trials safely attainable over that period with the standard procedure. CONCLUSIONS The self-initiated procedure enhances the collection of neural correlates of cue-reward learning while producing good discrimination performance. Other advantages for neural recording studies include ensuring that at the start of each trial the animal is engaged, attentive and in the same location within the conditioning chamber.
Collapse
|
9
|
Dissociation of Appetitive Overexpectation and Extinction in the Infralimbic Cortex. CEREBRAL CORTEX (NEW YORK, N.Y. : 1991) 2019. [PMID: 30371757 DOI: 10.1093/cercor/bhy248.] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
Behavioral change is paramount to adaptive behavior. Two ways to achieve alterations in previously established behavior are extinction and overexpectation. The infralimbic (IL) portion of the medial prefrontal cortex controls the inhibition of previously established aversive behavioral responses in extinction. The role of the IL cortex in behavioral modification in appetitive Pavlovian associations remains poorly understood. Here, we seek to determine if the IL cortex modulates overexpectation and extinction of reward learning. Using overexpectation or extinction to achieve a reduction in behavior, the present findings uncover a dissociable role for the IL cortex in these paradigms. Pharmacologically inactivating the IL cortex left overexpectation intact. In contrast, pre-training manipulations in the IL cortex prior to extinction facilitated the reduction in conditioned responding but led to a disrupted extinction retrieval on test drug-free. Additional studies confirmed that this effect is restricted to the IL and not dependent on the dorsally-located prelimbic cortex. Together, these results show that the IL cortex underlies extinction but not overexpectation-driven reduction in behavior, which may be due to regulating the expression of conditioned responses influenced by stimulus-response associations rather than stimulus-stimulus associations.
Collapse
|
10
|
The serial blocking effect: a testbed for the neural mechanisms of temporal-difference learning. Sci Rep 2019; 9:5962. [PMID: 30979910 PMCID: PMC6461709 DOI: 10.1038/s41598-019-42244-4] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2019] [Accepted: 03/22/2019] [Indexed: 11/08/2022] Open
Abstract
Temporal-difference (TD) learning models afford the neuroscientist a theory-driven roadmap in the quest for the neural mechanisms of reinforcement learning. The application of these models to understanding the role of phasic midbrain dopaminergic responses in reward prediction learning constitutes one of the greatest success stories in behavioural and cognitive neuroscience. Critically, the classic learning paradigms associated with TD are poorly suited to cast light on its neural implementation, thus hampering progress. Here, we present a serial blocking paradigm in rodents that overcomes these limitations and allows for the simultaneous investigation of two cardinal TD tenets; namely, that learning depends on the computation of a prediction error, and that reinforcing value, whether intrinsic or acquired, propagates back to the onset of the earliest reliable predictor. The implications of this paradigm for the neural exploration of TD mechanisms are highlighted.
Collapse
|
11
|
Corrigendum: Dissociation of Appetitive Overexpectation and Extinction in the Infralimbic Cortex. Cereb Cortex 2018; 29:1703. [DOI: 10.1093/cercor/bhy338] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2018] [Indexed: 11/13/2022] Open
|
12
|
Dissociation of Appetitive Overexpectation and Extinction in the Infralimbic Cortex. Cereb Cortex 2018; 29:3687-3701. [PMID: 30371757 DOI: 10.1093/cercor/bhy248] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2018] [Revised: 08/03/2018] [Indexed: 01/05/2023] Open
Abstract
Abstract
Behavioral change is paramount to adaptive behavior. Two ways to achieve alterations in previously established behavior are extinction and overexpectation. The infralimbic (IL) portion of the medial prefrontal cortex controls the inhibition of previously established aversive behavioral responses in extinction. The role of the IL cortex in behavioral modification in appetitive Pavlovian associations remains poorly understood. Here, we seek to determine if the IL cortex modulates overexpectation and extinction of reward learning. Using overexpectation or extinction to achieve a reduction in behavior, the present findings uncover a dissociable role for the IL cortex in these paradigms. Pharmacologically inactivating the IL cortex left overexpectation intact. In contrast, pre-training manipulations in the IL cortex prior to extinction facilitated the reduction in conditioned responding but led to a disrupted extinction retrieval on test drug-free. Additional studies confirmed that this effect is restricted to the IL and not dependent on the dorsally-located prelimbic cortex. Together, these results show that the IL cortex underlies extinction but not overexpectation-driven reduction in behavior, which may be due to regulating the expression of conditioned responses influenced by stimulus–response associations rather than stimulus–stimulus associations.
Collapse
|
13
|
Neural correlates of two different types of extinction learning in the amygdala central nucleus. Nat Commun 2016; 7:12330. [PMID: 27531638 PMCID: PMC4992052 DOI: 10.1038/ncomms12330] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2015] [Accepted: 06/23/2016] [Indexed: 11/09/2022] Open
Abstract
Extinction is a fundamental form of memory updating in which one learns to stop expecting an event that no longer occurs. This learning ensues when one experiences a change in environmental contingencies, that is, when an expected outcome fails to occur (simple extinction), or when a novel inflated expectation of a double outcome (overexpectation) is in conflict with the real outcome, and is a process that has been linked to amygdala function. Here, we show that in rats, the same neuronal population in the amygdala central nucleus updates reward expectancies and behaviour in both types of extinction, and neural changes in one paradigm are reflected in the other. This work may have implications for the management of addiction and anxiety disorders that require treatments based on the outcome omission, and disorders such as obesity that could use overexpectation, but not omission strategies.
Collapse
|
14
|
Amygdalo-striatal interaction in the enhancement of stimulus salience in associative learning. Behav Neurosci 2015; 129:87-95. [PMID: 25730120 DOI: 10.1037/bne0000041] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Function of the central nucleus of the amygdala (CeA) is critical to 2 aspects of attention in associative learning: the conditioning of orienting responses (ORs) to cues paired with food, and the enhancement of cue salience by the surprising omission of expected events. Such salience enhancements have been found to depend on interactions within a circuit that includes CeA, the substantia nigra pars compacta (SNc), the substantia innominata (SI), and the posterior parietal cortex (PPC). The acquisition and expression of conditioned ORs requires interactions among CeA, SNc, and the dorsal lateral striatum (DLS), but not SI or PPC. Here, we considered whether CeA-DLS interactions are also important in surprise-induced salience enhancements in a serial prediction task. Rats received unilateral lesions of CeA and DLS, either contralaterally, which disrupted interactions between those structures, or ipsilaterally, which produced comparable damage to each structure but permitted interactions between them in 1 hemisphere. Rats with ipsilateral lesions of CeA and DLS showed the salience enhancements normally observed in this task, but rats with contralateral lesions of those structures did not. Thus, convergence of information processing by CeA and DLS is essential for surprise-induced salience enhancements, as well as for conditioned ORs.
Collapse
|
15
|
The basolateral amygdala is necessary for negative prediction errors to enhance cue salience, but not to produce conditioned inhibition. Eur J Neurosci 2014; 40:3328-37. [PMID: 25135841 DOI: 10.1111/ejn.12695] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2014] [Revised: 07/11/2014] [Accepted: 07/14/2014] [Indexed: 11/28/2022]
Abstract
Behavioral evidence shows that prediction errors (PEs) not only drive associative learning, but also enhance the salience of predictive cues, making them better able to capture attention when they are next encountered. Research from our laboratory suggests that this latter consequence of PEs depends on a neural circuit that includes the amygdala. Lesions of the basolateral complex of the amygdala (BLA), for instance, selectively disrupt enhancements in cue processing that are normally induced by positive PEs without compromising simple excitatory learning. This result is consistent with electrophysiological evidence showing that BLA neurons track positive PEs. Interestingly, the same neurons also seem to track negative PEs, suggesting the possibility that the BLA might also use these errors to drive enhancements in cue processing. Here, we examined the role of the BLA in the processing (Experiment 1) and utilization (Experiment 2) of negative PEs in increasing cue salience in an unblocking procedure. Using FOS expression as an index of neural activity, Experiment 1 confirmed that BLA neurons track negative PEs with reinforcement downshifts. This tracking was evident both when these errors were generated by decreasing the concentration of a sucrose reinforcer (which encourages the development of conditioned inhibition) and when they were generated by decreasing the number of sucrose reinforcers (which encourages excitatory learning - unblocking - and allows the detection of enhancements in cue processing). Experiment 2 demonstrated that BLA lesions abolished enhancements in cue processing while sparing inhibitory learning. These results suggest a general role of the BLA in utilizing PEs, whatever their sign, for boosting cue processing.
Collapse
|
16
|
Abstract
The orbitofrontal cortex (OFC) has been described as signaling outcome expectancies or value. Evidence for the latter comes from the studies showing that neural signals in the OFC correlate with value across features. Yet features can co-vary with value, and individual units may participate in multiple ensembles coding different features. Here we used unblocking to test whether OFC neurons would respond to a predictive cue signaling a ‘valueless’ change in outcome flavor. Neurons were recorded as the rats learned about cues that signaled either an increase in reward number or a valueless change in flavor. We found that OFC neurons acquired responses to both predictive cues. This activity exceeded that exhibited to a ‘blocked’ cue and was correlated with activity to the actual outcome. These results show that OFC neurons fire to cues with no value independent of what can be inferred through features of the predicted outcome. DOI:http://dx.doi.org/10.7554/eLife.02653.001 Imagine you are at a restaurant and the waiter offers you a choice of cheesecake or fruit salad for dessert. When making your choice it is likely that you will consider the features of these desserts, such as their taste, their sweetness or how healthy they are. However, when you decide which dessert to have, you will pick the one that you judge to have the highest value for you at that moment in time. In this sense, ‘value’ is a subjective concept that varies from person to person, while ‘features’ remain relatively static. It is generally agreed that the orbitofrontal cortex (OFC) is involved in making these sorts of decisions, but its role is still a topic of debate. According to one theory the neurons in the OFC signal the subjective value of an outcome, whereas a rival theory suggests that they signal the features of the expected outcome. However, it has proved challenging to test these theories in experiments because it is difficult to say for certain that a given decision was clearly due to the value or a feature. Now, McDannald et al. have devised an approach that can tell the difference between neurons signaling value and neurons signaling features. They trained thirsty rats to associate different odours with either an increase in the amount of milk they were given (a change in both value and a feature), or a change in the flavor of the milk (a change in a feature without a change in value). Extensive testing showed that the rats did not value one flavor over the other. McDannald et al. then examined how the neurons in the OFC responded. If these neurons signal only value, they should only fire when the value of the outcome changes. On the other hand, if they signal features, they should fire when a feature changes, even if the value does not. It turned out that the neurons in the OFC responded whenever the features changed, irrespective of whether or not the value changed. These findings present a challenge to popular conceptions of the role of the neurons in the OFC. DOI:http://dx.doi.org/10.7554/eLife.02653.002
Collapse
|
17
|
Abstract
Decision making is impacted by uncertainty and risk (i.e., variance). Activity in the orbitofrontal cortex, an area implicated in decision making, covaries with these quantities. However, this activity could reflect the heightened salience of situations in which multiple outcomes-reward and reward omission-are expected. To resolve these accounts, rats were trained to respond to cues predicting 100%, 67%, 33%, or 0% reward. Consistent with prior reports, some orbitofrontal neurons fired differently in anticipation of uncertain (33% and 67%) versus certain (100% and 0%) reward. However, over 90% of these neurons also fired differently prior to 100% versus 0% reward (or baseline) or prior to 33% versus 67% reward. These responses are inconsistent with risk but fit well with the representation of acquired salience linked to the sum of cue-outcome and cue-no-outcome associative strengths. These results expand our understanding of how the orbitofrontal cortex might regulate learning and behavior.
Collapse
|
18
|
Attention-related Pearce-Kaye-Hall signals in basolateral amygdala require the midbrain dopaminergic system. Biol Psychiatry 2012; 72:1012-9. [PMID: 22763185 PMCID: PMC3465645 DOI: 10.1016/j.biopsych.2012.05.023] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2012] [Revised: 05/17/2012] [Accepted: 05/18/2012] [Indexed: 11/15/2022]
Abstract
BACKGROUND Neural activity in basolateral amygdala has recently been shown to reflect surprise or attention as predicted by the Pearce-Kaye-Hall model (PKH)--an influential model of associative learning. Theoretically, a PKH attentional signal originates in prediction errors of the kind associated with phasic firing of dopamine neurons. This requirement for prediction errors, coupled with projections from the midbrain dopamine system into basolateral amygdala, suggests that the PKH signal in amygdala may depend on dopaminergic input. METHODS To test this, we recorded single unit activity in basolateral amygdala in rats with 6-hydroxydopamine or sham lesions of the ipsilateral midbrain region. Neurons were recorded as the rats performed a task previously used to demonstrate both dopaminergic reward prediction errors and attentional signals in basolateral amygdala neurons. RESULTS We found that neurons recorded in sham lesioned rats exhibited the same attention-related PKH signal observed in previous studies. By contrast, neurons recorded in rats with ipsilateral 6-hydroxydopamine lesions failed to show attentional signaling. CONCLUSIONS These results indicate a linkage between the neural instantiations of the basolateral complex of the amygdala attentional signal and dopaminergic prediction errors. Such a linkage would have important implications for understanding both normal and aberrant learning and behavior, particularly in diseases thought to have a primary effect on dopamine systems, such as addiction and schizophrenia.
Collapse
|
19
|
Abstract
Computational and learning theory models propose that behavioral control reflects value that is both cached (computed and stored during previous experience) and inferred (estimated on the fly on the basis of knowledge of the causal structure of the environment). The latter is thought to depend on the orbitofrontal cortex. Yet some accounts propose that the orbitofrontal cortex contributes to behavior by signaling "economic" value, regardless of the associative basis of the information. We found that the orbitofrontal cortex is critical for both value-based behavior and learning when value must be inferred but not when a cached value is sufficient. The orbitofrontal cortex is thus fundamental for accessing model-based representations of the environment to compute value rather than for signaling value per se.
Collapse
|
20
|
Abstract
Learning theory and computational accounts suggest that learning depends on errors in outcome prediction as well as changes in processing of or attention to events. These divergent ideas are captured by models, such as Rescorla-Wagner (RW) and temporal difference (TD) learning on the one hand, which emphasize errors as directly driving changes in associative strength, vs. models such as Pearce-Hall (PH) and more recent variants on the other hand, which propose that errors promote changes in associative strength by modulating attention and processing of events. Numerous studies have shown that phasic firing of midbrain dopamine (DA) neurons carries a signed error signal consistent with RW or TD learning theories, and recently we have shown that this signal can be dissociated from attentional correlates in the basolateral amygdala and anterior cingulate. Here we will review these data along with new evidence: (i) implicating habenula and striatal regions in supporting error signaling in midbrain DA neurons; and (ii) suggesting that the central nucleus of the amygdala and prefrontal regions process the amygdalar attentional signal. However, while the neural instantiations of the RW and PH signals are dissociable and complementary, they may be linked. Any linkage would have implications for understanding why one signal dominates learning in some situations and not others, and also for appreciating the potential impact on learning of neuropathological conditions involving altered DA or amygdalar function, such as schizophrenia, addiction or anxiety disorders.
Collapse
|
21
|
The fate of redundant cues during blocking and a simple discrimination. ACTA ACUST UNITED AC 2012; 38:167-79. [DOI: 10.1037/a0027662] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
22
|
Reconciling the influence of predictiveness and uncertainty on stimulus salience: a model of attention in associative learning. Proc Biol Sci 2011; 278:2553-61. [PMID: 21653585 PMCID: PMC3136838 DOI: 10.1098/rspb.2011.0836] [Citation(s) in RCA: 104] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2011] [Accepted: 05/16/2011] [Indexed: 11/12/2022] Open
Abstract
Theories of selective attention in associative learning posit that the salience of a cue will be high if the cue is the best available predictor of reinforcement (high predictiveness). In contrast, a different class of attentional theory stipulates that the salience of a cue will be high if the cue is an inaccurate predictor of reinforcement (high uncertainty). Evidence in support of these seemingly contradictory propositions has led to: (i) the development of hybrid attentional models that assume the coexistence of separate, predictiveness-driven and uncertainty-driven mechanisms of changes in cue salience; and (ii) a surge of interest in identifying the neural circuits underpinning these mechanisms. Here, we put forward a formal attentional model of learning that reconciles the roles of predictiveness and uncertainty in salience modification. The issues discussed are relevant to psychologists, behavioural neuroscientists and neuroeconomists investigating the roles of predictiveness and uncertainty in behaviour.
Collapse
|
23
|
Two kinds of attention in Pavlovian conditioning: evidence for a hybrid model of learning. ACTA ACUST UNITED AC 2011; 36:456-70. [PMID: 20718552 DOI: 10.1037/a0018528] [Citation(s) in RCA: 33] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Four appetitive Pavlovian conditioning experiments with rats examined the rate at which the discrimination between compounds AY and AX was solved relative to the discrimination between compounds AY and BY. In Experiments 1 and 2, these discriminations were preceded by training in which A and B were continuously reinforced and X and Y were partially reinforced. Consistent with the Pearce and Hall (1980) model, the results showed that the AY/AX discrimination was solved more readily than the AY/BY discrimination. In Experiments 3 and 4, the discriminations were preceded by feature-positive training in which trials with AX and BY signaled food but trials with X and Y did not. Consistent with the Mackintosh (1975) model, the results showed that the AY/BY discrimination was solved more readily than the AY/AX discrimination. These results are discussed with respect to a hybrid model of conditioning and attention.
Collapse
|
24
|
All that glitters ... dissociating attention and outcome expectancy from prediction errors signals. J Neurophysiol 2010; 104:587-95. [PMID: 20554849 DOI: 10.1152/jn.00173.2010] [Citation(s) in RCA: 56] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Initially reported in dopamine neurons, neural correlates of prediction errors have now been shown in a variety of areas, including orbitofrontal cortex, ventral striatum, and amygdala. Yet changes in neural activity to an outcome or cues that precede it can reflect other processes. We review the recent literature and show that although activity in dopamine neurons appears to signal prediction errors, similar activity in orbitofrontal cortex, basolateral amygdala, and ventral striatum does not. Instead, increased firing in basolateral amygdala to unexpected outcomes likely reflects attention, whereas activity in orbitofrontal cortex and ventral striatum is unaffected by prior expectations and may provide information on outcome expectancy. These results have important implications for how these areas interact to facilitate learning and guide behavior.
Collapse
|
25
|
How do you (estimate you will) like them apples? Integration as a defining trait of orbitofrontal function. Curr Opin Neurobiol 2010; 20:205-11. [PMID: 20206497 PMCID: PMC2862846 DOI: 10.1016/j.conb.2010.01.009] [Citation(s) in RCA: 104] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2010] [Accepted: 01/26/2010] [Indexed: 11/18/2022]
Abstract
The past 15 years have seen a rapid increase in our understanding of orbitofrontal function. Today this region is the focus of an enormous amount of research, including work on such complex phenomena as regret, ambiguity, and willingness to pay. The orbitofrontal cortex is also credited as a major player in a host of neuropsychiatric diseases. This transformation arguably began with the application of concepts derived from animal learning theory. We will review data from studies emphasizing these approaches to argue that the orbitofrontal cortex forms a crucial part of a network of structures that signals information about expected outcomes. Further we will suggest that, within this network, the orbitofrontal cortex provides the critical ability to integrate information in real-time to make what amounts to actionable predictions or estimates about future outcomes. As we will show, the influence of these estimates can be demonstrated experimentally in appropriate behavioral settings, and their operation can also readily explain the role of orbitofrontal cortex in much more complex phenomena such as those cited above.
Collapse
|
26
|
Enhancement of responding to A after A+/AX+ training: challenges for a comparator theory of learning. JOURNAL OF EXPERIMENTAL PSYCHOLOGY. ANIMAL BEHAVIOR PROCESSES 2009; 35:485-97. [PMID: 19839701 DOI: 10.1037/a0014908] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Two appetitive Pavlovian conditioning experiments with rats investigated the associative changes that A undergoes in an A+/AX+ blocking procedure. Conditioned responding to A was enhanced relative to stimulus B, which had been conditioned in isolation (B+). This result was interpreted in terms of the formation of a within-compound association between A and X. The results of Experiment 2 supported this conclusion by demonstrating that X had associative strength of its own and, furthermore, that extinguishing X resulted in a similar level of responding to A and B. These results are considered in terms of retrospective revaluation theories of learning.
Collapse
|
27
|
Absence of overshadowing between a landmark and geometric cues in a distinctively shaped environment: a test of Miller and Shettleworth (2007). ACTA ACUST UNITED AC 2009; 35:357-70. [PMID: 19594281 DOI: 10.1037/a0014536] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Rats in the first 2 experiments, which were designed to test predictions from a model of spatial learning by N. Y. Miller and S. J. Shettleworth (2007), had to escape from a triangular pool by swimming to a submerged platform in a geometrically unique corner. A spherical landmark was suspended above the platform for an overshadowing group. A control group was trained with the same arrangement and with a second, identical landmark suspended in another corner. The platform could thus be found by reference to the landmark or the geometric cues in the overshadowing group, whereas the control group had to rely on geometric cues. There was no indication of overshadowing between the geometric cues and the landmark in the overshadowing group. The final 2 experiments revealed that the absence of overshadowing was not a consequence of the landmark being an ineffective cue for overshadowing. The results indicate either that the landmark and geometric cues were not in competition for the control they acquired over behavior or that an additional process compensated for any such competition that might have occurred in the overshadowing group. This additional process could involve between-cues associations or the provision of a stable spatial framework.
Collapse
|