Dynamic control of decision and movement speed in the human basal ganglia

Concurrent inflammation-related brain reorganization in multiple sclerosis and depression

BACKGROUND

Neuroinflammation affects brain tissue integrity in multiple sclerosis (MS) and may have a role in major depressive disorder (MDD). Whether advanced magnetic resonance imaging characteristics of the gray-to-white matter border serve as proxy of neuroinflammatory activity in MDD and MS remain unknown.

METHODS

We included 684 participants (132 MDD patients with recurrent depressive episodes (RDE), 70 MDD patients with a single depressive episode (SDE), 222 MS patients without depressive symptoms (nMS), 58 MS patients with depressive symptoms (dMS), and 202 healthy controls (HC)). 3 T-T1w MRI-derived gray-to-white matter contrast (GWc) was used to reconstruct and characterize connectivity alterations of GWc-covariance networks by means of modularity, clustering coefficient, and degree. A cross-validated support vector machine was used to test the ability of GWc to stratify groups according to their depression symptoms, measured with BDI, at the single-subject level in MS and MDD independently.

FINDINGS

MS and MDD patients showed increased modularity (ANOVA partial-η2 = 0.3) and clustering (partial-η2 = 0.1) compared to HC. In the subgroups, a linear trend analysis attested a gradient of modularity increases in the form: HC, dMS, nMS, SDE, and RDE (ANOVA partial-η2 = 0.28, p < 0.001) while this trend was less evident for clustering coefficient. Reduced morphological integrity (GWc) was seen in patients with increased depressive symptoms (partial-η2 = 0.42, P < 0.001) and was associated with depression scores across patient groups (r = -0.2, P < 0.001). Depressive symptoms in MS were robustly classified (88 %).

CONCLUSIONS

Similar structural network alterations in MDD and MS exist, suggesting possible common inflammatory events like demyelination, neuroinflammation that are caught by GWc analyses. These alterations may vary depending on the severity of symptoms and in the case of MS may elucidate the occurrence of comorbid depression.

How cortico-basal ganglia-thalamic subnetworks can shift decision policies to maximize reward rate

All mammals exhibit flexible decision policies that depend, at least in part, on the cortico-basal ganglia-thalamic (CBGT) pathways. Yet understanding how the complex connectivity, dynamics, and plasticity of CBGT circuits translates into experience-dependent shifts of decision policies represents a longstanding challenge in neuroscience. Here we used a computational approach to address this problem. Specifically, we simulated decisions driven by CBGT circuits under baseline, unrewarded conditions using a spiking neural network, and fit the resulting behavior to an evidence accumulation model. Using canonical correlation analysis, we then replicated the existence of three recently identified control ensembles (responsiveness, pliancy and choice) within CBGT circuits, with each ensemble mapping to a specific configuration of the evidence accumulation process. We subsequently simulated learning in a simple two-choice task with one optimal (i.e., rewarded) target. We find that value-based learning, via dopaminergic signals acting on cortico-striatal synapses, effectively manages the speed-accuracy tradeoff so as to increase reward rate over time. Within this process, learning-related changes in decision policy can be decomposed in terms of the contributions of each control ensemble, and these changes are driven by sequential reward prediction errors on individual trials. Our results provide a clear and simple mechanism for how dopaminergic plasticity shifts specific subnetworks within CBGT circuits so as to strategically modulate decision policies in order to maximize effective reward rate.

Subthalamic stimulation modulates context-dependent effects of beta bursts during fine motor control

Increasing evidence suggests a considerable role of pre-movement beta bursts for motor control and its impairment in Parkinson's disease. However, whether beta bursts occur during precise and prolonged movements and if they affect fine motor control remains unclear. To investigate the role of within-movement beta bursts for fine motor control, we here combine invasive electrophysiological recordings and clinical deep brain stimulation in the subthalamic nucleus in 19 patients with Parkinson's disease performing a context-varying task that comprised template-guided and free spiral drawing. We determined beta bursts in narrow frequency bands around patient-specific peaks and assessed burst amplitude, duration, and their immediate impact on drawing speed. We reveal that beta bursts occur during the execution of drawing movements with reduced duration and amplitude in comparison to rest. Exclusively when drawing freely, they parallel reductions in acceleration. Deep brain stimulation increases the acceleration around beta bursts in addition to a general increase in drawing velocity and improvements of clinical function. These results provide evidence for a diverse and task-specific role of subthalamic beta bursts for fine motor control in Parkinson's disease; suggesting that pathological beta bursts act in a context dependent manner, which can be targeted by clinical deep brain stimulation.

Neuroscience: Therapy modulates decision-making in Parkinson's disease

There is mounting evidence that decision-making can be affected by treatment in Parkinson's disease. A new study shows that dopamine and deep brain stimulation, two mainstay treatments of Parkinson's, differently affect how patients make decisions weighing rewards against effort costs.

The onset of motor learning impairments in Parkinson's disease: a computational investigation

The basal ganglia (BG) is part of a basic feedback circuit regulating cortical function, such as voluntary movements control, via their influence on thalamocortical projections. BG disorders, namely Parkinson's disease (PD), characterized by the loss of neurons in the substantia nigra, involve the progressive loss of motor functions. At the present, PD is incurable. Converging evidences suggest the onset of PD-specific pathology prior to the appearance of classical motor signs. This latent phase of neurodegeneration in PD is of particular relevance in developing more effective therapies by intervening at the earliest stages of the disease. Therefore, a key challenge in PD research is to identify and validate markers for the preclinical and prodromal stages of the illness. We propose a mechanistic neurocomputational model of the BG at a mesoscopic scale to investigate the behavior of the simulated neural system after several degrees of lesion of the substantia nigra, with the aim of possibly evaluating which is the smallest lesion compromising motor learning. In other words, we developed a working framework for the analysis of theoretical early-stage PD. While simulations in healthy conditions confirm the key role of dopamine in learning, in pathological conditions the network predicts that there may exist abnormalities of the motor learning process, for physiological alterations in the BG, that do not yet involve the presence of symptoms typical of the clinical diagnosis.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.

Effort cost of harvest affects decisions and movement vigor of marmosets during foraging

Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.

Significance statement

Our results suggest that as the brainstem neuromodulatory circuits that control pupil size respond to effort costs, they alter computations in the brain regions that control decisions, encouraging work and delaying gratification, and the brain regions that control movements, reducing vigor and suppressing energy expenditure. This coordinated response suggests that decisions and actions are part of a single control policy that aims to maximize a variable relevant to fitness: the capture rate.

Integrated control of non-motor and motor efforts during perceptual decision-making and action execution: a pilot study

Humans daily life is characterized by a succession of voluntary actions. Since energy resources are limited, the ability to invest the appropriate amount of effort for selecting and executing these actions is a hallmark of adapted behavior. Recent studies indicate that decisions and actions share important principles, including the optimization of their duration when the context requires it. In the present pilot study, we test the hypothesis that the management of effort-related energy resources is shared between decision and action too. Healthy human subjects performed a perceptual decision task where they had to choose between two levels of effort to invest in making the decision (i.e. two levels of perceptual difficulty), and report it with a reaching movement. Crucially, the movement accuracy requirement gradually increased from trial to trial depending on participants' decision performance. Results indicate an overall moderate and non-significant impact of the increasing motor difficulty on the choice of the non-motor (decision) effort to invest in each trial and on decision performance. By contrast, motor performance strongly decreased depending on both the motor and decisional difficulties. Together, the results support the hypothesis of an integrated management of the effort-related energy resources between decision and action. They also suggest that in the present task, the mutualized resources are primarily allocated to the decision-making process to the detriment of movements.

Dynamic modulation of subthalamic nucleus activity facilitates adaptive behavior

Adapting actions to changing goals and environments is central to intelligent behavior. There is evidence that the basal ganglia play a crucial role in reinforcing or adapting actions depending on their outcome. However, the corresponding electrophysiological correlates in the basal ganglia and the extent to which these causally contribute to action adaptation in humans is unclear. Here, we recorded electrophysiological activity and applied bursts of electrical stimulation to the subthalamic nucleus, a core area of the basal ganglia, in 16 patients with Parkinson's disease (PD) on medication using temporarily externalized deep brain stimulation (DBS) electrodes. Patients as well as 16 age- and gender-matched healthy participants attempted to produce forces as close as possible to a target force to collect a maximum number of points. The target force changed over trials without being explicitly shown on the screen so that participants had to infer target force based on the feedback they received after each movement. Patients and healthy participants were able to adapt their force according to the feedback they received (P < 0.001). At the neural level, decreases in subthalamic beta (13 to 30 Hz) activity reflected poorer outcomes and stronger action adaptation in 2 distinct time windows (Pcluster-corrected < 0.05). Stimulation of the subthalamic nucleus reduced beta activity and led to stronger action adaptation if applied within the time windows when subthalamic activity reflected action outcomes and adaptation (Pcluster-corrected < 0.05). The more the stimulation volume was connected to motor cortex, the stronger was this behavioral effect (Pcorrected = 0.037). These results suggest that dynamic modulation of the subthalamic nucleus and interconnected cortical areas facilitates adaptive behavior.