Beyond the Average View of Dopamine

Reappraising the role of dopamine in adolescent risk-taking behavior

Adolescence is characterized by increased risk-taking, which is often ascribed to developmental changes in dopaminergic signaling. Popular models propose that these behaviors are caused by dopamine-induced hypersensitivity to rewards, which overrides adolescents' immature self-control mechanisms. However, these models are often based on oversimplified notions about the workings and functions of dopamine. Here we discuss the relationship between changes in the dopaminergic system and adolescent behavior in light of current theories/models about the functions of dopamine. We show that dopamine is linked to learning, adaptive decision-making under uncertainty, and increased motivation to work for rewards. Thus, changes in the dopaminergic system contribute to the maturation of cognitive control through various mechanisms, contrary to the false dichotomy between reward processing and self-control. Finally, we note that dopamine interacts with a number of other neuromodulator systems, which also change during adolescence, but that have been largely ignored in the field of adolescent development. A full understanding of adolescent behavior will require these neurochemicals and their interactions with dopamine to be taken into account.

The potential therapeutic roles of Rho GTPases in substance dependence

Rho GTPases family are considered to be molecular switches that regulate various cellular processes, including cytoskeleton remodeling, cell polarity, synaptic development and maintenance. Accumulating evidence shows that Rho GTPases are involved in neuronal development and brain diseases, including substance dependence. However, the functions of Rho GTPases in substance dependence are divergent and cerebral nuclei-dependent. Thereby, comprehensive integration of their roles and correlated mechanisms are urgently needed. In this review, the molecular functions and regulatory mechanisms of Rho GTPases and their regulators such as GTPase-activating proteins (GAPs) and guanine nucleotide exchange factors (GEFs) in substance dependence have been reviewed, and this is of great significance for understanding their spatiotemporal roles in addictions induced by different addictive substances and in different stages of substance dependence.

Performance-gated deliberation: A context-adapted strategy in which urgency is opportunity cost

Finding the right amount of deliberation, between insufficient and excessive, is a hard decision making problem that depends on the value we place on our time. Average-reward, putatively encoded by tonic dopamine, serves in existing reinforcement learning theory as the opportunity cost of time, including deliberation time. Importantly, this cost can itself vary with the environmental context and is not trivial to estimate. Here, we propose how the opportunity cost of deliberation can be estimated adaptively on multiple timescales to account for non-stationary contextual factors. We use it in a simple decision-making heuristic based on average-reward reinforcement learning (AR-RL) that we call Performance-Gated Deliberation (PGD). We propose PGD as a strategy used by animals wherein deliberation cost is implemented directly as urgency, a previously characterized neural signal effectively controlling the speed of the decision-making process. We show PGD outperforms AR-RL solutions in explaining behaviour and urgency of non-human primates in a context-varying random walk prediction task and is consistent with relative performance and urgency in a context-varying random dot motion task. We make readily testable predictions for both neural activity and behaviour.

Modeling the activity of the dopamine signaling pathway by combination of analog electrical circuit and mathematical approaches

This paper demonstrates the application of the system biology principles on the example of the dopamine signaling pathway in neurons. Presented model is based on two approaches - cytomorphic electronic circuits and mathematical modeling. Transcription and phosphorylation of DARPP-32 was modeled by analog circuit, based on well-known approaches presented in [1]. It was shown that application of circuit helps to receive signal oscillations that close to described ones in real biological systems. This combination on the one hand gives possibility to simplify calculations, on another to show this signaling pathway dynamics. The expected effect of changes in the functioning of calcium channels is considered, and the mathematical model of the interaction of system components is proposed. The average frequency of calcium current oscillations due to the presence of dopamine was 30 Hz in presented model, that is consistent with the literature, where the frequency of such oscillations is up to several tens of Hz. All presented results shows good correlation with known data, which already published today.