EEG correlates of physical effort and reward processing during reinforcement learning

Dissociable neural after-effects of cognitive and physical effort expenditure during reward evaluation

The reward after-effect of effort expenditure refers to the phenomenon that previous effort investment changes the subjective value of rewards when obtained. However, the neural mechanisms underlying the after-effects of effort exertion are still not fully understood. We investigated the modulation of reward after-effects by effort type (cognitive vs. physical) through the lens of neural dynamics. Thirty-two participants performed a physically or cognitively demanding task during an effort phase and then played a simple gambling game during a subsequent reward phase to earn monetary rewards while their electroencephalogram (EEG) was recorded. We found that previous effort expenditure decreased electrocortical activity during feedback evaluation. Importantly, this effort effect occurred in a domain-general manner during the early stage (as indexed by the reward positivity) but in a domain-specific manner during the later and more elaborative stage (as indexed by the P3 and delta oscillation) of reward evaluation. Additionally, effort expenditure enhanced P3 sensitivity to feedback valence regardless of effort type. Our findings suggest that cognitive and physical effort, although bearing some surface resemblance to each other, may have dissociable neural influences on the reward after-effects.

Relationship between reward-related brain activity and opportunities to sit

The present study tested whether energy-minimizing behaviors evoke reward-related brain activity that promotes the repetition of these behaviors via reinforcement learning processes. Fifty-eight healthy young adults in a standing position performed a task where they could earn a reward either by sitting down or squatting while undergoing electroencephalographic (EEG) recording. Reward-prediction errors were quantified as the amplitude of the EEG-derived reward positivity. Results showed that reward positivity was larger on reward versus no reward trials, confirming the validity of our paradigm to measure evoked reward-related brain activity. However, results showed no evidence that sitting (versus standing and squatting) trials led to larger reward positivity. Moreover, we found no evidence suggesting that this effect was moderated by typical physical activity, physical activity on the day of the study, or energy expenditure during the experiment. However, at the behavioral level, results showed that the probability of choosing the stimulus more likely to lead to sitting than standing increased as the number of trials increased. In addition, results revealed that the probability of changing the selected stimulus was higher when the previous trial was a stand trial relative to a sit trial. In sum, neural results showed no evidence supporting the theory that opportunities to minimize energy expenditure are rewarding. However, behavioral findings suggested participants tend to choose the less effortful behavioral alternative and were therefore consistent with the theory of effort minimization (TEMPA).

Using EEG to study sensorimotor adaptation

Sensorimotor adaptation, or the capacity to flexibly adapt movements to changes in the body or the environment, is crucial to our ability to move efficiently in a dynamic world. The field of sensorimotor adaptation is replete with rigorous behavioural and computational methods, which support strong conceptual frameworks. An increasing number of studies have combined these methods with electroencephalography (EEG) to unveil insights into the neural mechanisms of adaptation. We review these studies: discussing EEG markers of adaptation in the frequency and the temporal domain, EEG predictors for successful adaptation and how EEG can be used to unmask latent processes resulting from adaptation, such as the modulation of spatial attention. With its high temporal resolution, EEG can be further exploited to deepen our understanding of sensorimotor adaptation.