Differential encoding of action selection by orbitofrontal and striatal population dynamics

Constraints on the subsecond modulation of striatal dynamics by physiological dopamine signaling

Dopaminergic neurons play a crucial role in associative learning, but their capacity to regulate behavior on subsecond timescales remains debated. It is thought that dopaminergic neurons drive certain behaviors by rapidly modulating striatal spiking activity; however, a view has emerged that only artificially high (that is, supra-physiological) dopamine signals alter behavior on fast timescales. This raises the possibility that moment-to-moment striatal spiking activity is not strongly shaped by dopamine signals in the physiological range. To test this, we transiently altered dopamine levels while monitoring spiking responses in the ventral striatum of behaving mice. These manipulations led to only weak changes in striatal activity, except when dopamine release exceeded reward-matched levels. These findings suggest that dopaminergic neurons normally play a minor role in the subsecond modulation of striatal dynamics in relation to other inputs and demonstrate the importance of discerning dopaminergic neuron contributions to brain function under physiological and potentially nonphysiological conditions.

Cracking and Packing Information about the Features of Expected Rewards in the Orbitofrontal Cortex

The orbitofrontal cortex (OFC) is crucial for tracking various aspects of expected outcomes, thereby helping to guide choices and support learning. Our previous study showed that the effects of reward timing and size on the activity of single units in OFC were dissociable when these attributes were manipulated independently ( Roesch et al., 2006). However, in real-life decision-making scenarios, outcome features often change simultaneously, so here we investigated how OFC neurons in male rats integrate information about the timing and identity (flavor) of reward and respond to changes in these features, according to whether they were changed simultaneously or separately. We found that a substantial number of OFC neurons fired differentially to immediate versus delayed reward and to the different reward flavors. However, contrary to the previous study, selectivity for timing was strongly correlated with selectivity for identity. Taken together with the previous research, these results suggest that when reward features are correlated, OFC tends to "pack" them into unitary constructs, whereas when they are independent, OFC tends to "crack" them into separate constructs. Furthermore, we found that when both reward timing and flavor were changed, reward-responsive OFC neurons showed unique activity patterns preceding and during the omission of an expected reward. Interestingly, this OFC activity is similar and slightly preceded the ventral tegmental area dopamine (VTA DA) activity observed in a previous study ( Takahashi et al., 2023), consistent with the role of OFC in providing predictive information to VTA DA neurons.

The Secondary Motor Cortex-striatum Circuit Contributes to Suppressing Inappropriate Responses in Perceptual Decision Behavior

The secondary motor cortex (M2) encodes choice-related information and plays an important role in cue-guided actions. M2 neurons innervate the dorsal striatum (DS), which also contributes to decision-making behavior, yet how M2 modulates signals in the DS to influence perceptual decision-making is unclear. Using mice performing a visual Go/No-Go task, we showed that inactivating M2 projections to the DS impaired performance by increasing the false alarm (FA) rate to the reward-irrelevant No-Go stimulus. The choice signal of M2 neurons correlated with behavioral performance, and the inactivation of M2 neurons projecting to the DS reduced the choice signal in the DS. By measuring and manipulating the responses of direct or indirect pathway striatal neurons defined by M2 inputs, we found that the indirect pathway neurons exhibited a shorter response latency to the No-Go stimulus, and inactivating their early responses increased the FA rate. These results demonstrate that the M2-to-DS pathway is crucial for suppressing inappropriate responses in perceptual decision behavior.

Multimodal Neural Evidence on the Corticostriatal Underpinning of Suicidality in Late-Life Depression

BACKGROUND

Suicidality involves thoughts (ideations and plans) and actions related to self-inflicted death. To improve management and prevention of suicidality, it is essential to understand the key neural mechanisms underlying suicidal thoughts and actions. Following empirically informed neural framework, we hypothesized that suicidal thoughts would be primarily characterized by alterations in the default mode network indicating disrupted self-related processing, whereas suicidal actions would be characterized by changes in the lateral prefrontal corticostriatal circuitries implicating compromised action control.

METHODS

We analyzed the gray matter volume and resting-state functional connectivity of 113 individuals with late-life depression, including 45 nonsuicidal patients, 33 with suicidal thoughts but no action, and 35 with past suicidal action. Between-group analyses revealed key neural features associated with suicidality. The functional directionality of the identified resting-state functional connectivity was examined using dynamic causal modeling to further elucidate its mechanistic nature. Post hoc classification analysis examined the contribution of the neural measures to suicide classification.

RESULTS

As expected, reduced gray matter volumes in the default mode network and lateral prefrontal regions characterized patients with suicidal thoughts and those with past suicidal actions compared with nonsuicidal patients. Furthermore, region-of-interest analyses revealed that the directionality and strength of the ventrolateral prefrontal cortex-caudate resting-state functional connectivity were related to suicidal thoughts and actions. The neural features significantly improved classification of suicidal thoughts and actions over that based on clinical and suicide questionnaire variables.

CONCLUSIONS

Gray matter reductions in the default mode network and lateral prefrontal regions and the ventrolateral prefrontal cortex-caudate connectivity alterations characterized suicidal thoughts and actions in patients with late-life depression.

Multiplexed action-outcome representation by striatal striosome-matrix compartments detected with a mouse cost-benefit foraging task

Learning about positive and negative outcomes of actions is crucial for survival and underpinned by conserved circuits including the striatum. How associations between actions and outcomes are formed is not fully understood, particularly when the outcomes have mixed positive and negative features. We developed a novel foraging (‘bandit’) task requiring mice to maximize rewards while minimizing punishments. By 2-photon Ca⁺⁺ imaging, we monitored activity of visually identified anterodorsal striatal striosomal and matrix neurons. We found that action-outcome associations for reward and punishment were encoded in parallel in partially overlapping populations. Single neurons could, for one action, encode outcomes of opposing valence. Striosome compartments consistently exhibited stronger representations of reinforcement outcomes than matrix, especially for high reward or punishment prediction errors. These findings demonstrate multiplexing of action-outcome contingencies by single identified striatal neurons and suggest that striosomal neurons are particularly important in action-outcome learning.

The role that the striatum plays in tracking the association between actions and combinations of rewarding and aversive outcomes remains unclear. Here, by using both calcium imaging in mice and reinforcement learning models, the authors find that individual striatal neurons can encode associations between actions and multiple, sometimes conflicting, outcomes.

To deconvolve, or not to deconvolve: Inferences of neuronal activities using calcium imaging data

BACKGROUND

With the increasing popularity of calcium imaging in neuroscience research, choosing the right methods to analyze calcium imaging data is critical to address various scientific questions. Unlike spike trains measured using electrodes, fluorescence intensity traces provide an indirect and noisy measurement of the underlying neuronal activities. The observed calcium traces are either analyzed directly or deconvolved to spike trains to infer neuronal activities. When both approaches are applicable, it is unclear whether deconvolving calcium traces is a necessary step.

METHODS

In this article, we compare the performance of using calcium traces or their deconvolved spike trains for three common analyses: clustering, principal component analysis (PCA), and population decoding.

RESULTS

We found that (1) the two approaches lead to diverging results; (2) estimated spike trains, when smoothed or binned appropriately, usually lead to satisfactory performances, such as more accurate estimation of cluster membership; (3) although estimate spike train produce results more similar to true spike data than trace data, we found that the PCA results from trace data might better reflect the underlying neuronal ensembles (clusters); and (4) for both approaches, decobability can be improved by using denoising or smoothing methods.

COMPARISON WITH EXISTING METHODS

Our simulations and applications to real data suggest that estimated spike data outperform trace data in cluster analysis and give comparable results for population decoding. In addition, the decobability of estimated spike data can be slightly better than that of calcium trace data with appropriate filtering / smoothing methods.

CONCLUSION

We conclude that spike detection might be a useful pre-processing step for certain problems such as clustering; however, the continuous nature of calcium imaging data provides a natural smoothness that might be helpful for problems such as dimensional reduction.

Is the core function of orbitofrontal cortex to signal values or make predictions?

One dominant hypothesis about the function of the orbitofrontal cortex (OFC) is that the OFC signals the subjective values of possible outcomes to other brain areas for learning and decision making. This popular view generally neglects the fact that OFC is not necessary for simple value-based behavior (i.e., when values have been directly experienced). An alternative, emerging view suggests that OFC plays a more general role in representing structural information about the task or environment, derived from prior experience, and relevant to predicting behavioral outcomes, such as value. From this perspective, value signaling is simply one derivative of the core underlying function of OFC. New data in favor of both views have been accumulating rapidly. Here we review these new data in discussing the relative merits of these two ideas.

Spatial Representations in Rat Orbitofrontal Cortex

The orbitofrontal cortex (OFC) and hippocampus share striking cognitive and functional similarities. As a result, both structures have been proposed to encode "cognitive maps" that provide useful scaffolds for planning complex behaviors. However, while this function has been exemplified by spatial coding in neurons of hippocampal regions-particularly place and grid cells-spatial representations in the OFC have been investigated far less. Here we sought to address this by recording OFC neurons from male rats engaged in an open-field foraging task like that originally developed to characterize place fields in rodent hippocampal neurons. Single-unit activity was recorded as rats searched for food pellets scattered randomly throughout a large enclosure. In some sessions, particular flavors of food occurred more frequently in particular parts of the enclosure; in others, only a single flavor was used. OFC neurons showed spatially localized firing fields in both conditions, and representations changed between flavored and unflavored foraging periods in a manner reminiscent of remapping in the hippocampus. Compared with hippocampal recordings taken under similar behavioral conditions, OFC spatial representations were less temporally reliable, and there was no significant evidence of grid tuning in OFC neurons. These data confirm that OFC neurons show spatial firing fields in a large, two-dimensional environment in a manner similar to hippocampus. Consistent with the focus of the OFC on biological meaning and goals, spatial coding was weaker than in hippocampus and influenced by outcome identity.SIGNIFICANCE STATEMENT The orbitofrontal cortex (OFC) and hippocampus have both been proposed to encode "cognitive maps" that provide useful scaffolds for planning complex behaviors. This function is exemplified by place and grid cells identified in hippocampus, the activity of which maps spatial environments. The current study directly demonstrates very similar, though not identical, spatial representatives in OFC neurons, confirming that OFC-like hippocampus-can represent a spatial map under the appropriate experimental conditions.