1
|
Lopez-Gamundi P, Mas-Herrero E, Marco-Pallares J. Disentangling effort from probability of success: Temporal dynamics of frontal midline theta in effort-based reward processing. Cortex 2024; 176:94-112. [PMID: 38763111 DOI: 10.1016/j.cortex.2024.03.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 12/30/2023] [Accepted: 03/31/2024] [Indexed: 05/21/2024]
Abstract
The ability to weigh a reward against the effort required to acquire it is critical for decision-making. However, extant experimental paradigms oftentimes confound increased effort demand with decreased reward probability, thereby obscuring neural correlates underlying these cognitive processes. To resolve this issue, we designed novel tasks that disentangled probability of success - and therefore reward probability - from effort demand. In Experiment 1, reward magnitude and effort demand were varied while reward probability was kept constant. In Experiment 2, effort demand and reward probability were varied while reward magnitude remained fixed. Electroencephalogram (EEG) data was recorded to explore how frontal midline theta (FMT; an electrophysiological index of mPFC function) and component P3 (an index of incentive salience) respond to effort demand, and reward magnitude and probability. We found no evidence that FMT tracked effort demands or net value during cue evaluation. At feedback, however, FMT power was enhanced for high compared to low effort trials, but not modulated by reward magnitude or probability. Conversely, P3 was sensitive to reward magnitude and probability at both cue and feedback phases and only integrated expended effort costs at feedback, such that P3 amplitudes continued to scale with reward magnitude and probability but were also increased for high compared to low effort reward feedback. These findings suggest that, when likelihood of success is equal, FMT power does not track net value of prospective effort-based rewards. Instead, expended cognitive effort potentiates FMT power and enhances the saliency of rewards at feedback. SIGNIFICANCE STATEMENT: The way the brain weighs rewards against the effort required to achieve them is critical for understanding motivational disorders. Current paradigms confound increased effort demand with decreased reward probability, making it difficult to disentangle neural activity associated with effort costs from those associated with reward likelihood. Here, we explored the temporal dynamics of effort-based reward (via frontal midline theta (FMT) and component P3) while participants underwent a novel paradigm that kept probability of reward constant between mental effort demand conditions. Our findings suggest that the FMT does not track net value and that expended effort enhances, instead of attenuates, the saliency of rewards.
Collapse
Affiliation(s)
- Paula Lopez-Gamundi
- Department of Cognition, Development and Educational Psychology, Institute of Neurosciences, University of Barcelona, Barcelona, Spain; Cognition and Brain Plasticity Unit, Bellvitge Biomedical Research Institute, Hospital Duran i Reynals, Hospitalet de Llobregat, Spain.
| | - Ernest Mas-Herrero
- Department of Cognition, Development and Educational Psychology, Institute of Neurosciences, University of Barcelona, Barcelona, Spain; Cognition and Brain Plasticity Unit, Bellvitge Biomedical Research Institute, Hospital Duran i Reynals, Hospitalet de Llobregat, Spain
| | - Josep Marco-Pallares
- Department of Cognition, Development and Educational Psychology, Institute of Neurosciences, University of Barcelona, Barcelona, Spain; Cognition and Brain Plasticity Unit, Bellvitge Biomedical Research Institute, Hospital Duran i Reynals, Hospitalet de Llobregat, Spain.
| |
Collapse
|
2
|
Brassard SL, Liu H, Dosanjh J, MacKillop J, Balodis I. Neurobiological foundations and clinical relevance of effort-based decision-making. Brain Imaging Behav 2024:10.1007/s11682-024-00890-x. [PMID: 38819540 DOI: 10.1007/s11682-024-00890-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 04/28/2024] [Indexed: 06/01/2024]
Abstract
Applying effort-based decision-making tasks provides insights into specific variables influencing choice behaviors. The current review summarizes the structural and functional neuroanatomy of effort-based decision-making. Across 39 examined studies, the review highlights the ventromedial prefrontal cortex in forming reward-based predictions, the ventral striatum encoding expected subjective values driven by reward size, the dorsal anterior cingulate cortex for monitoring choices to maximize rewards, and specific motor areas preparing for effort expenditure. Neuromodulation techniques, along with shifting environmental and internal states, are promising novel treatment interventions for altering neural alterations underlying decision-making. Our review further articulates the translational promise of this construct into the development, maintenance and treatment of psychiatric conditions, particularly those characterized by reward-, effort- and valuation-related deficits.
Collapse
Affiliation(s)
- Sarah L Brassard
- Neuroscience Graduate Program, McMaster University, Hamilton, ON, Canada
- Peter Boris Center for Addictions Research, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada
- Department of Psychiatry and Behavioural Neuroscience, McMaster University, Hamilton, ON, Canada
| | - Hanson Liu
- Peter Boris Center for Addictions Research, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada
| | - Jadyn Dosanjh
- Peter Boris Center for Addictions Research, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada
| | - James MacKillop
- Peter Boris Center for Addictions Research, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada
- Department of Psychiatry and Behavioural Neuroscience, McMaster University, Hamilton, ON, Canada
- Michael G. DeGroote Centre for Medicinal Cannabis Research, Hamilton, ON, Canada
- Department of Psychology, Neuroscience and Behaviour, McMaster University, Hamilton, ON, Canada
| | - Iris Balodis
- Peter Boris Center for Addictions Research, St. Joseph's Healthcare Hamilton, Hamilton, ON, Canada.
- Department of Psychiatry and Behavioural Neuroscience, McMaster University, Hamilton, ON, Canada.
- Michael G. DeGroote Centre for Medicinal Cannabis Research, Hamilton, ON, Canada.
| |
Collapse
|
3
|
Wang LL, Wang J, Liu BH, Tuo D, Lui SSY, Wan WQ, Huang J, Chan RCK. Neural substrates of the interaction between effort-expenditure reward decision-making and outcome anticipation. Behav Brain Res 2024; 466:114979. [PMID: 38582409 DOI: 10.1016/j.bbr.2024.114979] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 03/20/2024] [Accepted: 04/02/2024] [Indexed: 04/08/2024]
Abstract
OBJECTIVE Reward anticipation is important for future decision-making, possibly due to re-evaluation of prior decisions. However, the exact relationship between reward anticipation and prior effort-expenditure decision-making, and its neural substrates are unknown. METHOD Thirty-three healthy participants underwent fMRI scanning while performing the Effort-based Pleasure Experience Task (E-pet). Participants were required to make effort-expenditure decisions and anticipate the reward. RESULTS We found that stronger anticipatory activation at the posterior cingulate cortex was correlated with slower reaction time while making decisions with a high-probability of reward. Moreover, the substantia nigra was significantly activated in the prior decision-making phase, and involved in reward-anticipation in view of its strengthened functional connectivity with the mammillary body and the putamen in trial conditions with a high probability of reward. CONCLUSIONS These findings support the role of reward anticipation in re-evaluating decisions based on the brain-behaviour correlation. Moreover, the study revealed the neural interaction between reward anticipation and decision-making.
Collapse
Affiliation(s)
- Ling-Ling Wang
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Jiao Wang
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Bing-Hui Liu
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Donghao Tuo
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Simon S Y Lui
- Department of Psychiatry, School of Clinical Medicine, The University of Hong Kong, Hong Kong Special Administration Region, Hong Kong, SAR China
| | - Wei-Qing Wan
- Department of Neurosurgery, Tiantan Hospital, Beijing, China
| | - Jia Huang
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China.
| | - Raymond C K Chan
- Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
4
|
Wen H, Wu M, Wang Z, Gao B, Zheng Y. Aberrant effort-based reward dynamics in anhedonia. Cereb Cortex 2024; 34:bhae193. [PMID: 38741268 DOI: 10.1093/cercor/bhae193] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 04/06/2024] [Accepted: 04/09/2024] [Indexed: 05/16/2024] Open
Abstract
Anhedonia is a transdiagnostic symptom and associated with a spectrum of reward deficits among which the motivational dysfunction is poorly understood. Previous studies have established the abnormal cost-benefit trade-off as a contributor to motivational deficits in anhedonia and its relevant psychiatric diseases. However, it remains elusive how the anhedonic neural dynamics underlying reward processing are modulated by effort expenditure. Using an effort-based monetary incentive delay task, the current event-related potential study examined the neural dynamics underlying the effort-reward interplay in anhedonia using a nonclinical sample who scored high or low on an anhedonia questionnaire. We found that effort prospectively decreased reward effect on the contingent variation negativity and the target-P3 but retrospectively enhanced outcome effect on the feedback-P3 following effort expenditure. Compared to the low-anhedonia group, the high-anhedonia group displayed a diminished effort effect on the target-P3 during effort expenditure and an increased effort-enhancement effect for neutral trials during the feedback-P3 period following effort expenditure. Our findings suggest that anhedonia is associated with an inefficient control and motivation allocation along the efforted-based reward dynamics from effort preparation to effort production.
Collapse
Affiliation(s)
- Hailing Wen
- Department of Psychology, Dalian Medical University, 9 West Section, Lvshun South Road, Dalian 116044, China
| | - Menglin Wu
- Department of Psychology, Dalian Medical University, 9 West Section, Lvshun South Road, Dalian 116044, China
| | - Zhao Wang
- Department of Psychology, Dalian Medical University, 9 West Section, Lvshun South Road, Dalian 116044, China
| | - Bo Gao
- Department of Psychology, Dalian Medical University, 9 West Section, Lvshun South Road, Dalian 116044, China
| | - Ya Zheng
- Department of Psychology, Guangzhou University, 230 Wai Huan Xi Road, Guangzhou Higher Education Mega Center, Guangzhou 510006, China
| |
Collapse
|
5
|
Iso-Ahola SE. Non-consciously processed physical activity for survival versus consciously deliberated exercise for health. Front Psychol 2023; 14:1181671. [PMID: 37384173 PMCID: PMC10293637 DOI: 10.3389/fpsyg.2023.1181671] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Accepted: 05/23/2023] [Indexed: 06/30/2023] Open
Abstract
Humans evolved to become dependent on physical activity for their survival, but they have not evolved to exercise today. Because survival in modern society is heavily reliant on conscious thinking, most people (54%) have evolved away from physical activity and become occasional exercisers. This transition from non-conscious to conscious processing prevents people from capitalizing on evolution's wisdom for survival and wellbeing as they consciously deliberate on the utility of health practices to achieve certain outcomes (e.g., weight loss). Unlike in early times, people today have a choice of not engaging in physical activity and yet surviving. As a result, they struggle with the question whether the gains from exercising are greater than losses from not doing it, weighing positive gains and losses against negative gains and losses. Such conscious deliberations, however, can easily be overridden by solving cognitive dissonance (e.g., "exercise is good for my health" vs. "I don't exercise") through conscious rationalizations and non-conscious dismissal. Today's exercise problem can only be solved by individually acquiring the mindset of early times of evolution when the initiation of physical activity was largely a matter of non-conscious thoughts and feelings.
Collapse
|
6
|
Kellermann B, MacPherson A, Collins D, Bertollo M. Reading the MAP: A Pracademic Perspective on the Current State of Play of the Multi-Action Plan Model with Regard to Transitions between Mental States. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2022; 19:15520. [PMID: 36497593 PMCID: PMC9738600 DOI: 10.3390/ijerph192315520] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/23/2022] [Revised: 11/14/2022] [Accepted: 11/14/2022] [Indexed: 06/17/2023]
Abstract
The Multi-Action Plan (MAP) presents as an action-focused, sport-specific, mixed methods intervention model. MAP research characterized four Performance Types (PTs). Each PT operates on an affective, cognitive, behavioral, and psychophysiological level-across performance contexts. In this narrative review, we present a synthesis of our current understanding of MAP research, coupled with offering applied implications and directions for future research. We make the case for investigating the timing of transitions between PTs as our primary area of interest in expanding the MAP framework on a conceptual and applied level. Regarding pre-transition cues, we offer ideas on examining socio-environmental precursors to performance, with the aim of expanding MAP from a psycho-bio (affective, cognitive, behavioral, and psychophysiological dimensions) to a biopsychosocial concept (affective, cognitive, behavioral, psychophysiological, and socio-environmental dimensions). Regarding post-transition, we propose that investigating short- and long-term effort and reward perception will yield valuable insights into athletes' rationales behind the selection, operationalization, and experience of specific PTs. Finally, and from a pracademic perspective, we reflect critically on the achievements of MAP research thus far and provide specific directions for future research.
Collapse
Affiliation(s)
- Bernadette Kellermann
- Institute for Sport, Physical Education and Health Sciences, University of Edinburgh, St. Leonard’s Land, Holyrood Road, Edinburgh EH8 8AQ, UK
| | - Alan MacPherson
- Institute for Sport, Physical Education and Health Sciences, University of Edinburgh, St. Leonard’s Land, Holyrood Road, Edinburgh EH8 8AQ, UK
| | - Dave Collins
- Institute for Sport, Physical Education and Health Sciences, University of Edinburgh, St. Leonard’s Land, Holyrood Road, Edinburgh EH8 8AQ, UK
- Grey Matters Performance Ltd., Stratford upon Avon CV37 9TQ, UK
| | - Maurizio Bertollo
- Department of Medicine and Aging Sciences, University “G. d’Annunzio” of Chieti-Pescara, 66100 Chieti, Italy
| |
Collapse
|
7
|
Watanabe H, Naruse Y. P300 as a neural indicator for setting levels of goal scores in educational gamification applications from the perspective of intrinsic motivation: An ERP study. FRONTIERS IN NEUROERGONOMICS 2022; 3:948080. [PMID: 38235471 PMCID: PMC10790842 DOI: 10.3389/fnrgo.2022.948080] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/19/2022] [Accepted: 09/30/2022] [Indexed: 01/19/2024]
Abstract
The challenge level of goal achievement affects intrinsic motivation. Thus, the goal score learners are required to achieve is an important element in gamified educational applications to foster users' intrinsic motivation. However, determining optimal goal scores that enhance the intrinsic motivation of each learner is not easy because individual competence and preferences for the challenge level (e.g., preference for difficult-to-achieve challenges) vary. One approach is to determine the goal score using physiological measurements to estimate when an individual's intrinsic motivation is reinforced. Measurement of event-related potentials (ERPs) is considered useful for this purpose. ERPs time-locked to feedback onset, such as feedback-related negativity and P300, reflect intrinsic motivation. However, it remains unclear whether these ERPs can serve as indicators of optimal goal scores for gamified educational applications in terms of intrinsic motivation. The present study aimed to examine whether ERP measures vary with the challenge levels of the goal score determined by participants' competence (too-easy, moderate and too-hard levels) and/or with their preference for these levels when using a gamified mental arithmetic application. Thirty-three participants solved 64 addition problems in one session in this application and received auditory feedback immediately after each answer entry. Scores were then calculated based on their task performance. Before each session, participants were informed of the goal score and instructed to exceed it as much as possible. Sessions were repeated six times at easy, moderate, and hard levels of goal scores, with two sessions per level. Goal score preferences were quantified based on subjective ratings of the motivation to achieve each level of goal score using a 7-point Likert scale. The mean amplitudes of ERPs were obtained for each participant. Results showed that P300 was significantly related to subjective ratings but not to levels of goal scores, indicating that P300 could be an indicator of participant preference for goal score levels. This study suggests that measurement of P300 may serve as a neural indicator providing an optimal goal score for individual learners that maximizes their intrinsic motivation in gamified learning applications.
Collapse
Affiliation(s)
| | - Yasushi Naruse
- Center for Information and Neural Networks, Advanced ICT Research Institute, National Institute of Information and Communications Technology, Osaka University, Kobe, Japan
| |
Collapse
|
8
|
Zheng J, Wang L, Meng L. When the Counterpart Chooses the Opposite: The First Mover’s Anticipation and Evaluation of the Final Feedback in Gambles. Front Neurosci 2022; 16:948579. [PMID: 36033619 PMCID: PMC9400596 DOI: 10.3389/fnins.2022.948579] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2022] [Accepted: 06/20/2022] [Indexed: 11/13/2022] Open
Abstract
This research examines the effect of response (in) consistency on the first mover’s anticipation and evaluation of the performance feedback in gambles. In a two-player gambling task, the participant played as the first mover while the confederate served as the second mover, who made their gambles in sequence. A more pronounced feedback-related negativity (FRN) was observed when the first mover noticed that the second mover chose a different option from him/her. An enlarged stimulus-preceding negativity (SPN) was observed when the first mover was anticipating the final feedback in this condition. Interestingly, consistent responses gave rise to a more pronounced FRN difference wave (d-FRN) during the feedback stage. Taken together, these results suggest that response discrepancy would modulate the first mover’s anticipation and evaluation of the final feedback in gambles.
Collapse
Affiliation(s)
- Jiehui Zheng
- Alibaba Business School, Hangzhou Normal University, Hangzhou, China
- Neuromanagement Lab, Zhejiang University, Hangzhou, China
| | - Lei Wang
- Neuromanagement Lab, Zhejiang University, Hangzhou, China
- School of Management, Zhejiang University, Hangzhou, China
| | - Liang Meng
- School of Business and Management, Shanghai International Studies University, Shanghai, China
- Institute of Organizational Behavior and Organizational Neuroscience, Shanghai International Studies University, Shanghai, China
- *Correspondence: Liang Meng,
| |
Collapse
|
9
|
Białaszek W, Marcowski P, Mizak S. Everything Comes at a Price: Considerations in Modeling Effort-Based Choice. Behav Processes 2022; 200:104692. [PMID: 35753582 DOI: 10.1016/j.beproc.2022.104692] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2021] [Revised: 04/22/2022] [Accepted: 06/21/2022] [Indexed: 11/18/2022]
Abstract
When observing human behavior, one of the key factors determining choice is effort. It is often assumed that people prefer an easier course of action when the alternative yields the same benefits. However, recent research demonstrates that this is not always the case: effort is not always costly and can also add value. A promising avenue to study effort-based choice is to utilize formal decision models that enable quantitative modeling. In this paper, we aim to present an overview of the current approaches to modeling effort-based choice and discuss some considerations that stem from theoretical and practical issues (present and previous) in studies on the role of effort, focusing on the connections and discrepancies between formal models and the findings from the body of empirical research. Considering that effort can, in some circumstances, act as a cost and as a benefit, reconciling these discrepancies is a practical and theoretical challenge that can ultimately lead to better predictions and increased model validity. Our review identifies and discusses these discrepancies providing direction for future empirical research.
Collapse
Affiliation(s)
- Wojciech Białaszek
- SWPS University of Social Sciences and Humanities, DecisionLab: Center for Behavioral Research in Decision Making, Institute of Psychology, Warsaw, Poland.
| | - Przemysław Marcowski
- SWPS University of Social Sciences and Humanities, DecisionLab: Center for Behavioral Research in Decision Making, Institute of Psychology, Warsaw, Poland
| | - Szymon Mizak
- SWPS University of Social Sciences and Humanities, DecisionLab: Center for Behavioral Research in Decision Making, Institute of Psychology, Warsaw, Poland
| |
Collapse
|
10
|
Zhang M, Zheng Y. Neural dynamics of effort-modulated reward processing. Psychophysiology 2022; 59:e14070. [PMID: 35415931 DOI: 10.1111/psyp.14070] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2021] [Revised: 01/30/2022] [Accepted: 03/17/2022] [Indexed: 11/26/2022]
Abstract
Previous studies have established that effort can either decrease reward value as a cost or increase reward value as an augmenter, which is referred to as the effort paradox. The present event-related potential study investigated the neural dynamics underlying the modulation of reward processing by effort expenditure. Thirty-two participants completed a modified monetary incentive delay task in a high-effort context and a low-effort context to earn monetary rewards while their EEG was recorded during effort anticipation, effort execution, and effort completion, respectively. Results revealed the multiphase nature of the effort-reward relationship, which unfolds over time. During effort anticipation, effort discounts reward value as reflected by a reduced contingent negative variation for high- versus low-effort trials. During effort exertion, the target-P3 reward effect was accrued by effort expenditure. Finally, effort also provides its own value following effort completion, as revealed by an enhanced stimulus-preceding negativity for high-effort relative to low-effort trials. These findings provide new insights into the relationship between effort expenditure and reward processing and are helpful to mitigate the effort paradox.
Collapse
Affiliation(s)
- Mang Zhang
- Department of Psychology, Dalian Medical University, Dalian, China
| | - Ya Zheng
- Department of Psychology, Dalian Medical University, Dalian, China
| |
Collapse
|
11
|
Carsten T, Kostandyan M, Boehler CN, Krebs RM. Comparing the motivational value of rewards and losses in an EEG-pupillometry study. Eur J Neurosci 2020; 53:1822-1838. [PMID: 33244798 DOI: 10.1111/ejn.15064] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2020] [Revised: 11/14/2020] [Accepted: 11/15/2020] [Indexed: 01/10/2023]
Abstract
We found earlier that performance-contingent rewards lead to faster performance than equivalent losses [Carsten, Hoofs, Boehler, & Krebs, 2019. Motivation Science, 5(3). http://dx.doi.org/10.1037/mot0000117]. Here, we further tested the hypothesis that motivation to gain rewards is higher than to avoid losses, even when incentive values are matched. As implicit markers of motivation, we assessed electroencephalography (EEG) focusing on the P3 after target and feedback onset, and the Feedback-Related Negativity (FRN), as well as simultaneously recorded pupil size. Comparing only reward and loss prospect trials in Experiment 1, we found no consistent differences in behavior and electrophysiological markers of motivation, although pupil data suggested higher arousal after feedback in potential-loss trials. Including additional no-incentive trials in Experiment 2, we found consistent evidence that motivation to gain rewards was higher than to avoid losses: In line with behavior, the target-P3 was most pronounced for reward-related stimuli, followed by loss and no-incentive ones. This same ranking was found in the P3 and the FRN after positive outcomes (i.e., reward, avoided loss, and correct feedback in no-incentive trials). Negative outcomes featured a different pattern in line with the pupil response, which suggests that losses are emotionally salient events, without invigorating behavior proportionally. In sum, these findings suggest that the motivation to gain rewards is more pronounced than motivation to avoid equivalent losses, at least in tasks promoting transient increases in attention triggered by incentive prospect. These motivational differences may arise as avoided losses are not profitable in the long term, in contrast to gained rewards.
Collapse
Affiliation(s)
- Thomas Carsten
- Department of Experimental Psychology, Ghent University, Gent, Belgium.,Institute of Neuroscience, Université catholique de Louvain, Brussels, Belgium
| | - Mariam Kostandyan
- Department of Experimental Psychology, Ghent University, Gent, Belgium
| | - C Nico Boehler
- Department of Experimental Psychology, Ghent University, Gent, Belgium
| | - Ruth M Krebs
- Department of Experimental Psychology, Ghent University, Gent, Belgium
| |
Collapse
|
12
|
Teubner-Rhodes S. Cognitive Persistence and Executive Function in the Multilingual Brain During Aging. Front Psychol 2020; 11:568702. [PMID: 33013606 PMCID: PMC7494780 DOI: 10.3389/fpsyg.2020.568702] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2020] [Accepted: 08/13/2020] [Indexed: 11/14/2022] Open
Abstract
Researchers have debated the extent to which the experience of speaking more than two languages induces long-term neuroplasticity that protects multilinguals from the adverse cognitive effects of aging. In this review, I propose a novel theory that multilingualism affects cognitive persistence, the application of effort to improve performance on challenging tasks. I review recent evidence demonstrating that the cingulo-opercular network, consisting of the bilateral inferior frontal gyrus (IFG) and dorsal anterior cingulate cortex (dACC), supports cognitive persistence. I then show that this same network is involved in multilingual language control and changes with multilingual language experience. While both early and late multilinguals exhibit differences in the cingulo-opercular network compared to monolinguals, I find that early multilinguals have a pattern of decreased dACC activity and increased left IFG activity that may enable more efficient cognitive control, whereas late multilinguals show larger dACC responses to conflict that may be associated with higher cognitive persistence. I further demonstrate that multilingual effects on the cingulo-opercular network are present in older adults and have been implicated in the mitigation of cognitive symptoms in age-related neurodegenerative disorders. Finally, I argue that mixed results in the literature are due, in part, to the confound between cognitive persistence and ability in most executive function tasks, and I provide guidance for separating these processes in future research.
Collapse
Affiliation(s)
- Susan Teubner-Rhodes
- Department of Psychological Sciences, Auburn University, Auburn, AL, United States
| |
Collapse
|
13
|
Palidis DJ, Gribble PL. EEG correlates of physical effort and reward processing during reinforcement learning. J Neurophysiol 2020; 124:610-622. [PMID: 32727262 DOI: 10.1152/jn.00370.2020] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Effort-based decision making is often modeled using subjective value, a function of reward discounted by effort. We asked whether EEG event-related potential (ERP) correlates of reward processing are also modulated by physical effort. Human participants performed a task in which they were required to accurately produce target levels of muscle activation to receive rewards. Quadriceps muscle activation was recorded with electromyography (EMG) during isometric knee extension. On a given trial, the target muscle activation required either low or high effort. The effort was determined probabilistically according to a binary choice, such that the responses were associated with 20% and 80% probability of high effort. This contingency could only be learned through experience, and it reversed periodically. Binary reinforcement feedback depended on accurately producing the target muscle activity. Participants adaptively avoided effort by switching responses more frequently after choices that resulted in hard effort. Feedback after participants' choices that revealed the resulting effort requirement did not elicit modulation of the feedback-related negativity/reward positivity (FRN/RP). However, the neural response to reinforcement outcome after effort production was increased by preceding physical effort. Source decomposition revealed separable early and late positive deflections contributing to the ERP. The main effect of reward outcome, characteristic of the FRN/RP, loaded onto the earlier component, whereas the reward × effort interaction was observed only in the later positivity, which resembled the P300. Thus, retrospective effort modulates reward processing. This may explain paradoxical behavioral findings whereby rewards requiring more effort to obtain can become more powerful reinforcers.NEW & NOTEWORTHY Choices probabilistically determined the physical effort requirements for a subsequent task, and reward depended on task performance. Feedback revealing whether choices resulted in easy or hard effort did not elicit reinforcement learning signals. However, the neural responses to reinforcement were modulated by preceding effort. Thus, effort itself was not treated as loss or punishment, but it affected the responses to subsequent reinforcement outcomes. This may explain how effort can enhance the motivational effect of reward.
Collapse
Affiliation(s)
- Dimitrios J Palidis
- The Brain and Mind Institute, Western University, London, Ontario, Canada.,Department of Psychology, Western University, London, Ontario, Canada.,Graduate Program in Neuroscience, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada
| | - Paul L Gribble
- The Brain and Mind Institute, Western University, London, Ontario, Canada.,Department of Psychology, Western University, London, Ontario, Canada.,Department of Physiology and Pharmacology, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada.,Haskins Laboratories, New Haven, Connecticut
| |
Collapse
|
14
|
Towards a Pragmatic Approach to a Psychophysiological Unit of Analysis for Mental and Brain Disorders: An EEG-Copeia for Neurofeedback. Appl Psychophysiol Biofeedback 2020; 44:151-172. [PMID: 31098793 DOI: 10.1007/s10484-019-09440-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
This article proposes what we call an "EEG-Copeia" for neurofeedback, like the "Pharmacopeia" for psychopharmacology. This paper proposes to define an "EEG-Copeia" as an organized list of scientifically validated EEG markers, characterized by a specific association with an identified cognitive process, that define a psychophysiological unit of analysis useful for mental or brain disorder evaluation and treatment. A characteristic of EEG neurofeedback for mental and brain disorders is that it targets a EEG markers related to a supposed cognitive process, whereas conventional treatments target clinical manifestations. This could explain why EEG neurofeedback studies encounter difficulty in achieving reproducibility and validation. The present paper suggests that a first step to optimize EEG neurofeedback protocols and future research is to target a valid EEG marker. The specificity of the cognitive skills trained and learned during real time feedback of the EEG marker could be enhanced and both the reliability of neurofeedback training and the therapeutic impact optimized. However, several of the most well-known EEG markers have seldom been applied for neurofeedback. Moreover, we lack a reliable and valid EEG targets library for further RCT to evaluate the efficacy of neurofeedback in mental and brain disorders. With the present manuscript, our aim is to foster dialogues between cognitive neuroscience and EEG neurofeedback according to a psychophysiological perspective. The primary objective of this review was to identify the most robust EEG target. EEG markers linked with one or several clearly identified cognitive-related processes will be identified. The secondary objective was to organize these EEG markers and related cognitive process in a psychophysiological unit of analysis matrix inspired by the Research Domain Criteria (RDoC) project.
Collapse
|
15
|
Decomposing the effort paradox in reward processing: Time matters. Neuropsychologia 2020; 137:107311. [PMID: 31862207 DOI: 10.1016/j.neuropsychologia.2019.107311] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2019] [Revised: 12/16/2019] [Accepted: 12/16/2019] [Indexed: 11/22/2022]
Abstract
Effort expenditure not only discounts reward value prospectively but also accrues reward value retrospectively. To decompose the effort paradox in reward processing, the current event-related potential study investigated the neural dynamics underlying effects of effort expenditure on subsequent reward processing. Participants exerted one of two levels of effort to obtain an opportunity of winning a high or low amount of monetary reward, and we focused on electrophysiological activity during the anticipatory and consummatory phases of reward processing. During the anticipatory phase, the stimulus-preceding negativity was enhanced when potential high rewards were anticipated, but this reward effect disappeared following high-effort expenditure. During the consummatory phase, feedback-related ERPs were increased for high relative to low rewards, and this reward effect was enlarged following effort expenditure during the early stage (200-300 ms) as indexed by the reward positivity but not the late stage (400-600 ms) as indexed by the P3. Our findings provide a strong support for the psychological contrast theory and indicate that time matters in decomposing the effort paradox for reward processing such that effort expenditure reduces reward sensitivity during the anticipatory phase but enhances reward sensitivity during the consummatory phase.
Collapse
|
16
|
Cooperation moderates the impact of effort on reward valuation. Neuropsychologia 2019; 135:107214. [PMID: 31689426 DOI: 10.1016/j.neuropsychologia.2019.107214] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2019] [Revised: 09/26/2019] [Accepted: 09/26/2019] [Indexed: 11/21/2022]
Abstract
Effort is valuable, but researchers have different opinions on whether effort can reduce or increase the valuation of rewards. The effect of cooperation on reward valuation also remains unclear. In this study, we conducted two experiments to examine the effect of effort on reward valuation (Experiment 1) and whether this effect can be influenced by cooperation (Experiment 2), using electroencephalogram (EEG) technology. We found that when participants worked alone, they generated a larger feedback-related negativity (FRN) amplitude for losing rewards than for gaining rewards, with more effort resulting in larger FRN amplitudes for losing rewards. However, when participants worked together with a partner, there was no significant difference between the amplitude for gaining rewards and that for losing rewards during low-effort tasks. Nevertheless, for high-effort tasks, the FRN amplitude for losing rewards was significantly larger than that for gaining rewards. Moreover, in both experiments, we found larger N1 amplitudes for gaining rewards than for losing rewards. Our ERP results suggest that in the early stage of processing, people pay extra attention to rewards, after that the effort level influences their reward valuation. In addition, cooperation regulates the reduced valuation of losing rewards only when people invest low effort.
Collapse
|
17
|
Wilhelm RA, Miller MW, Gable PA. Neural and Attentional Correlates of Intrinsic Motivation Resulting from Social Performance Expectancy. Neuroscience 2019; 416:137-146. [PMID: 31369789 DOI: 10.1016/j.neuroscience.2019.07.039] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2019] [Revised: 07/12/2019] [Accepted: 07/22/2019] [Indexed: 11/28/2022]
Abstract
Some models of motivation distinguish between intrinsic and extrinsic motivation. While past work has examined the neural and cognitive correlates of extrinsic motivation, research on intrinsic motivation has relied primarily on behavioral measures of performance and learning. In particular, no past work has examined the neural and cognitive correlates of social performance expectancy, which is linked to intrinsic motivation. The current study manipulated expectancy of difficult (vs. easy) trials on a cued flanker task and assessed attentional scope and performance. EEG was used to examine motor-action preparation as measured by suppression of beta band activity over the motor cortex and feedback processing as measured by the Reward Positivity (RewP). Results revealed expectancy of difficult (vs. easy) trials narrowed attentional scope, reduced beta activity over the motor cortex, and enhanced RewP amplitudes to win feedback. These findings suggest that enhancing intrinsic motivation through expectancies of positive social comparison engages similar neural and cognitive correlates as extrinsic motivators high in motivational intensity.
Collapse
Affiliation(s)
- Ricardo A Wilhelm
- Department of Psychology, The University of Alabama, Box 870348, Tuscaloosa, AL 35487-0348, United States.
| | | | - Philip A Gable
- Department of Psychology, The University of Alabama, Box 870348, Tuscaloosa, AL 35487-0348, United States.
| |
Collapse
|
18
|
Wang L, Zhang X, Li L, Meng L. Taking Others as a Mirror: Contingent Social Comparison Promotes Task Engagement. Front Hum Neurosci 2018; 12:476. [PMID: 30555312 PMCID: PMC6282022 DOI: 10.3389/fnhum.2018.00476] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2018] [Accepted: 11/14/2018] [Indexed: 11/17/2022] Open
Abstract
Social comparison implemented in an informational while not controlling manner can be motivating. In order to directly examine the effect of contingent social comparison on one’s task engagement, we manipulated social comparison in an experimental study and adopted an electrophysiological approach to measure one’ task engagement. In this experiment, we engaged the participants in a modified stop-watch (SW) task which requires a button press to stop the watch within a given time interval and instructed the participants to either play alone or simultaneously play with a same-sex counterpart. In the latter case, they could freely solicit feedback on their counterparts’ performance besides their own. Enlarged stimulus-preceding negativity (SPN) and error-related negativity (ERN) were observed in the two-player condition, indicating strengthened anticipatory attention toward the task-onset stimulus at the pre-task stage and enhanced performance surveillance during task execution. As a complement, self-report data suggested that the participants were more intrinsically motivated to engage in the SW task when contingent social comparison was present. Thus, converging electrophysiological and behavioral evidences suggested the pivotal role of contingent social comparison in promoting self-directed task engagement.
Collapse
Affiliation(s)
- Lei Wang
- School of Management, Zhejiang University, Hangzhou, China.,Neuromanagement Lab, Zhejiang University, Hangzhou, China
| | - Xiaoshuang Zhang
- School of Management, Zhejiang University, Hangzhou, China.,Neuromanagement Lab, Zhejiang University, Hangzhou, China
| | - Lu Li
- School of Management, Zhejiang University, Hangzhou, China.,Neuromanagement Lab, Zhejiang University, Hangzhou, China
| | - Liang Meng
- School of Business and Management, Shanghai International Studies University, Shanghai, China.,Laboratory of Applied Brain and Cognitive Sciences, Shanghai International Studies University, Shanghai, China
| |
Collapse
|
19
|
Glazer JE, Kelley NJ, Pornpattananangkul N, Mittal VA, Nusslock R. Beyond the FRN: Broadening the time-course of EEG and ERP components implicated in reward processing. Int J Psychophysiol 2018; 132:184-202. [DOI: 10.1016/j.ijpsycho.2018.02.002] [Citation(s) in RCA: 94] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2017] [Revised: 01/31/2018] [Accepted: 02/01/2018] [Indexed: 12/18/2022]
|
20
|
Inzlicht M, Shenhav A, Olivola CY. The Effort Paradox: Effort Is Both Costly and Valued. Trends Cogn Sci 2018; 22:337-349. [PMID: 29477776 PMCID: PMC6172040 DOI: 10.1016/j.tics.2018.01.007] [Citation(s) in RCA: 255] [Impact Index Per Article: 42.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2017] [Revised: 01/13/2018] [Accepted: 01/23/2018] [Indexed: 12/30/2022]
Abstract
According to prominent models in cognitive psychology, neuroscience, and economics, effort (be it physical or mental) is costly: when given a choice, humans and non-human animals alike tend to avoid effort. Here, we suggest that the opposite is also true and review extensive evidence that effort can also add value. Not only can the same outcomes be more rewarding if we apply more (not less) effort, sometimes we select options precisely because they require effort. Given the increasing recognition of effort's role in motivation, cognitive control, and value-based decision-making, considering this neglected side of effort will not only improve formal computational models, but also provide clues about how to promote sustained mental effort across time.
Collapse
Affiliation(s)
- Michael Inzlicht
- Department of Psychology, University of Toronto, 1265 Military Trail, Toronto, Ontario M1C 1A4, Canada; Rotman School of Management, University of Toronto, 105 St. George Street, Ontario M56 3E6, Canada.
| | - Amitai Shenhav
- Department of Cognitive, Linguistic, and Psychological Sciences, Brown Institute for Brain Science, Brown University, Providence, RI, USA
| | - Christopher Y Olivola
- Tepper School of Business, Carnegie Mellon University, Pittsburgh, PA, USA; Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA, USA
| |
Collapse
|
21
|
Feedback is the breakfast of champions: the significance of self-controlled formal feedback for autonomous task engagement. Neuroreport 2018; 29:13-18. [PMID: 29112673 DOI: 10.1097/wnr.0000000000000921] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
With the aim of examining the positive effect of the formal feedback mechanism itself beyond its informational aspect, we engaged participants in the stopwatch task and recorded their electroencephalogram throughout the experiment. This task requires a button press to stop the watch within a given time interval, the completion of which is simultaneously accompanied by adequate information on task performance. In the self-controlled feedback mode, participants could freely choose whether to request formal feedback after completing the task. In another mode, additional feedback was not provided. The 'non-choice' cue was found to elicit a more negative cue-elicited feedback negativity compared with 'choice', suggesting that the opportunity to solicit formal feedback was perceived as more desirable. In addition, a more enhanced stimulus-preceding negativity was observed prior to the task initiation cue in the self-controlled feedback condition, indicating that participants paid more sustained anticipatory attention during task preparation. Taken together, these electrophysiological results suggested an inherent reward within the formal feedback mechanism itself and the significance of self-controlled formal feedback for autonomous task engagement.
Collapse
|
22
|
Dunn TL, Inzlicht M, Risko EF. Anticipating cognitive effort: roles of perceived error-likelihood and time demands. PSYCHOLOGICAL RESEARCH 2017; 83:1033-1056. [PMID: 29134281 DOI: 10.1007/s00426-017-0943-x] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2017] [Accepted: 10/31/2017] [Indexed: 01/12/2023]
Abstract
Why are some actions evaluated as effortful? In the present set of experiments we address this question by examining individuals' perception of effort when faced with a trade-off between two putative cognitive costs: how much time a task takes vs. how error-prone it is. Specifically, we were interested in whether individuals anticipate engaging in a small amount of hard work (i.e., low time requirement, but high error-likelihood) vs. a large amount of easy work (i.e., high time requirement, but low error-likelihood) as being more effortful. In between-subject designs, Experiments 1 through 3 demonstrated that individuals anticipate options that are high in perceived error-likelihood (yet less time consuming) as more effortful than options that are perceived to be more time consuming (yet low in error-likelihood). Further, when asked to evaluate which of the two tasks was (a) more effortful, (b) more error-prone, and (c) more time consuming, effort-based and error-based choices closely tracked one another, but this was not the case for time-based choices. Utilizing a within-subject design, Experiment 4 demonstrated overall similar pattern of judgments as Experiments 1 through 3. However, both judgments of error-likelihood and time demand similarly predicted effort judgments. Results are discussed within the context of extant accounts of cognitive control, with considerations of how error-likelihood and time demands may independently and conjunctively factor into judgments of cognitive effort.
Collapse
Affiliation(s)
- Timothy L Dunn
- Leeds School of Business, University of Colorado Boulder, 995 Regent Dr. Koelbel Building 419 UCB, Boulder, CO, 80309, USA.
| | - Michael Inzlicht
- Department of Psychology, University of Toronto, Toronto, Canada.,Rotman School of Management, Toronto, Canada
| | - Evan F Risko
- Department of Psychology, Universiy of Waterloo, Waterloo, Canada
| |
Collapse
|
23
|
Ma Q, Pei G, Meng L. Inverted U-Shaped Curvilinear Relationship between Challenge and One's Intrinsic Motivation: Evidence from Event-Related Potentials. Front Neurosci 2017; 11:131. [PMID: 28400712 PMCID: PMC5368271 DOI: 10.3389/fnins.2017.00131] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/20/2016] [Accepted: 03/06/2017] [Indexed: 11/24/2022] Open
Abstract
The balance between task demand and one's competence is critical for the maintenance of intrinsic motivation. According to Flow theory and Self-determination theory, optimal challenge gives rise to the maximum intrinsic motivation, and an inverted U-shaped curvilinear relationship between perceived challenge and one's intrinsic motivation is suggested. In order to provide direct experimental evidences for predictions of these theories, in this study, we employed the two-player StopWatch game that we previously designed, which made references to the game format of a badminton tournament. According to our manipulation, a male participant was defeated by the same-sex player paired with him (played by a well-trained confederate of the experimenter) in two matches, one with a wide margin (the complete defeat condition) and another with a narrow one (the near miss condition). Participants performed better and reported to enjoy the near miss match to a greater extent. Besides, an enlarged Stimulus-preceding negativity was elicited when participants were actively anticipating outcomes in the near miss condition, suggesting greater anticipatory attention toward the outcome and an enhanced intrinsic motivation to win. Thus, converging electrophysiological evidences from this study and our former study confirmed the inverted U-shaped curvilinear relationship between perceived challenge and one's intrinsic motivation.
Collapse
Affiliation(s)
- Qingguo Ma
- Institute of Neural Management Sciences, Zhejiang University of Technology Hangzhou, China
| | - Guanxiong Pei
- School of Management, Zhejiang University Hangzhou, China
| | - Liang Meng
- School of Business and Management, Shanghai International Studies UniversityShanghai, China; Laboratory of Applied Brain and Cognitive Sciences, Shanghai International Studies UniversityShanghai, China
| |
Collapse
|