Diurnal rhythms in psychological reward functioning in healthy young men: 'Wanting', liking, and learning

Hilaire MA, Arrona-Palacios A, Czeisler CA, Duffy JF. Time of Day and Sleep Deprivation Effects on Risky Decision Making

Previous research has revealed that daily variations in human neurobehavioral functions are driven in part by the endogenous circadian system. The objective of this study was to explore whether there exists a circadian influence on performance regarding a risky decision-making task and to determine whether the performance changes with sleep deprivation (SD). Thirteen participants underwent a 39 h constant routine (CR) protocol, during which they remained awake in constant conditions and performed the BART (balloon analogue risk task) every two hours. The mean pumps (gains) (p < 0.001) and balloons popped (losses) (p = 0.003) exhibited variation during the CR. The reaction time (RT) also showed significant variation across the CR (p < 0.001), with slower mean RTs in the morning hours following SD. A greater risk propensity was observed around midday before SD and a lower risk propensity after 29.5 h of being awake. The sensitivity to punishment varied during the CR, but did not follow a predictable trend. Further research using real monetary incentives and neurophysiological measures is warranted to elucidate these findings.

The rhythm of mental health: the relationship of chronotype with psychiatric trait dimensions and diurnal variation in psychiatric symptoms

To advance the emergence of circadian-based therapies, this study characterized how psychiatric symptoms fluctuate across the day and vary between individuals. Using a dimensional approach, we determined how chronotype relates to 13 psychiatric traits, and modeled the temporal development of symptoms throughout the day using generalized additive mixed effects models. In this preregistered study, a subclinical sample completed 13 psychiatric trait scales and a chronotype scale at baseline (N = 515, n = 404 women, 109 men, n = 2 non-binary, M age = 32.4 years, range 18-77), followed by 22 psychiatric symptoms and behaviors rated repeatedly between ~08:00-00:00 (n = 410). Key findings are that 11 out of 13 psychiatric traits were associated with being an evening-type, ranging from depression to obsessive comulsive disorder, social anxiety, and delusional ideation, while only mania was associated with being a morning-type. Four distinct psychiatric trait factors were identified, each predicting worse symptom levels throughout the day. Fatigue-related symptoms exhibited strong time-of-day changes with evening-types experiencing worse fatigue in the morning and morning-types in the evening. Evening-types had considerably lower drive and motivation than morning-types from morning to early evening. Evening-types also had more pronounced negative emotional symptoms and ADHD-type symptoms in the evening, particularly among those high in psychiatric trait factors. These findings identified important research targets that hold promise for improving mental health outcomes, such as strategies to boost morning motivation. Furthermore, the results emphasize the relevance of incorporating circadian factors, including chronotype, into translational psychiatric research and interventions.

Effect of circadian rhythm on NAD and other metabolites in human brain

Nicotinamide Adenine Dinucleotide (NAD) plays a central role in the master circadian clock of the brain (the suprachiasmatic nuclei, SCN) as demonstrated in many model organisms. NAD acts as an enzyme co-factor and substrate and its modulation was found to be tightly regulated to the periodicity of the cycles. However, in human brain, the effect of the circadian rhythm (CR) on the metabolism of the SCN and other brain regions is poorly understood. We conducted a magnetic resonance spectroscopy (MRS) study at a high magnetic field, measuring the occipital brain NAD levels and other metabolites in two different morning and afternoon diurnal states in 25 healthy participants. Salivary cortisol levels were determined to confirm that the experiment was done in two chronologically different physiological conditions, and a behavioral test of risk-taking propensity was administered. Overall, we found that the CR did not significantly affect NAD levels in the occipital brain region. The other brain metabolites measured, including lactate, were not significantly affected by the CR either, except for taurine. The CR did impact risk-taking behavior and salivary cortisol level, confirming that the participants were in two circadian different behavioral and physiological states in the morning and in the afternoon. Measurement of the CR effect on NAD and taurine levels in other brain regions might provide stronger effects.

The circadian neurobiology of reward

Circadian clocks are important regulators of physiology and behavior. In the brain, circadian clocks have been described in many centers of the central reward system. They affect neurotransmitter signaling, neuroendocrine circuits, and the sensitivity to external stimulation. Circadian disruption affects reward signaling, promoting the development of behavioral and substance use disorders. In this review, we summarize our current knowledge of circadian clock-reward crosstalk. We show how chronodisruption affects reward signaling in different animal models. We then translate these findings to circadian aspects of human reward (dys-) function and its clinical implications. Finally, we devise approaches to and challenges in implementing the concepts of circadian medicine in the therapy of substance use disorders.

When should I eat: A circadian view on food intake and metabolic regulation

The circadian clock is a hierarchical timing system regulating most physiological and behavioral functions with a period of approximately 24 h in humans and other mammalian species. The circadian clock drives daily eating rhythms that, in turn, reinforce the circadian clock network itself to anticipate and orchestrate metabolic responses to food intake. Eating is tightly interconnected with the circadian clock and recent evidence shows that the timing of meals is crucial for the control of appetite and metabolic regulation. Obesity results from combined long-term dysregulation in food intake (homeostatic and hedonic circuits), energy expenditure, and energy storage. Increasing evidence supports that the loss of synchrony of daily rhythms significantly impairs metabolic homeostasis and is associated with obesity. This review presents an overview of mechanisms regulating food intake (homeostatic/hedonic) and focuses on the crucial role of the circadian clock on the metabolic response to eating, thus providing a fundamental research axis to maintain a healthy eating behavior.

The 24-hour rhythm in alcohol craving and individual differences in sleep characteristics and alcohol use frequency

BACKGROUND

Evidence implicates sleep/circadian factors in alcohol use, suggesting the existence of a 24-h rhythm in alcohol craving, which may vary by individual differences in sleep factors and alcohol use frequency. This study sought to (1) replicate prior findings of a 24-h rhythm in alcohol craving, and (2) examine whether individual differences in sleep timing, sleep duration, or alcohol use frequency are related to differences in the timing of the peak of the craving rhythm (i.e., the acrophase) or magnitude of fluctuation of the rhythm (i.e., amplitude). Finally, whether such associations varied by sex or racial identity was explored.

METHODS

Two-hundred fifteen adult drinkers (21 to 35 years of age, 72% male, 66% self-identified as White) completed a baseline assessment of alcohol use frequency and then smartphone reports of alcohol craving intensity six times a day across 10 days. Sleep timing was also recorded each morning of the 10-day period. Multilevel cosinor analysis was used to test the presence of a 24-h rhythm and to estimate acrophase and amplitude.

RESULTS

Multilevel cosinor analysis revealed a 24-h rhythm in alcohol craving. Individual differences in sleep timing or sleep duration did not predict rhythm acrophase or amplitude. However, alcohol use frequency moderated this rhythm wherein individuals who used alcohol more frequently in the 30 days prior to beginning the study had higher mean levels of craving and greater rhythm amplitudes (i.e., greater rhythmic fluctuations). Associations did not vary by sex or racial identity.

CONCLUSIONS

Results show that alcohol craving exhibits a systematic rhythm over the course of the 24 h and that the frequency of alcohol use may be relevant to the shape of this rhythm. Consideration of daily rhythms in alcohol craving may further our understanding of the mechanisms that drive alcohol use.

Preliminary Evidence That Circadian Alignment Predicts Neural Response to Monetary Reward in Late Adolescent Drinkers

BACKGROUND

Robust evidence links sleep and circadian rhythm disturbances to alcohol use and alcohol-related problems, with a growing literature implicating reward-related mechanisms. However, the extant literature has been limited by cross-sectional designs, self-report or behavioral proxies for circadian timing, and samples without substantive alcohol use. Here, we employed objective measures of sleep and circadian rhythms, and an intensive prospective design, to assess whether circadian alignment predicts the neural response to reward in a sample of late adolescents reporting regular alcohol use.

METHODS

Participants included 31 late adolescents (18-22 y/o; 19 female participants) reporting weekly alcohol use. Participants completed a 14-day protocol including pre- and post-weekend (Thursday and Sunday) circadian phase assessments via the dim light melatonin onset (DLMO), in counterbalanced order. Sleep-wake timing was assessed via actigraphy. Circadian alignment was operationalized as the DLMO-midsleep interval; secondary analyses considered social jet lag based on weekday-weekend differences in midsleep or DLMO. Neural response to reward (anticipation and outcome) was assessed via a monetary reward fMRI task (Friday and Monday scans). Alcohol use was assessed at baseline and via ecological momentary assessment. Mean BOLD signal was extracted from two regions-of-interest (striatum and medial prefrontal cortex, mPFC) for analyses in regression models, accounting for age, sex, racial identity, and scan order.

RESULTS

In primary analyses, shorter DLMO-midsleep intervals (i.e., greater misalignment) on Thursday predicted lower striatal and mPFC responses to anticipated reward, but not reward outcome, on Friday. Lower neural (striatum and mPFC) responses to anticipated reward on Friday correlated with more binge-drinking episodes at baseline, but were not associated with alcohol use in the post-scan weekend. In secondary analyses, greater social jet lag (particularly larger weekend delays in midsleep or DLMO) was associated with lower neural responses to reward anticipation on Monday.

CONCLUSION

Findings provide preliminary evidence of proximal associations between objectively determined circadian alignment and the neural response to anticipated monetary reward, which is linked in turn to patterns of problematic drinking. Replication in a larger sample and experimental designs will be important next steps to determining the extent to which circadian misalignment influences risk for alcohol involvement via alterations in reward function.

Daytime and season do not affect reinforcement learning capacity in a response time adjustment task

Seasonal and circadian rhythms have a broad impact on physiological aspects, such as dopamine neurotransmission, and may be involved in the etiology of mood disorders. Considering this, studies on the influence of season and daytime on cognitive function are rare. The present study aimed to assess the impact of seasonal and diurnal effects on the ability to maximize reward outcomes by optimizing response times adaptively. For this purpose, a reward-based learning task that required an adaptation of response time to either a fast or a slow response was used. Eighty German participants (mean age ± SD = 21.86 ± 1.89 years, 41 women) were examined twice, in the morning and in the evening. Half of the participants were tested during the summer, while the other half performed the test in the winter. No impact of daytime, season or of the external factors photoperiodicity and temperature on reinforcement learning could be found. However, a generally slower response speed in the morning compared to the evening appeared. Previously conducted tasks could not display behavioral differences in both times of season and daytime, although neurophysiological findings suggest it.

Dopamine D1 and D2 receptors are distinctly associated with rest-activity rhythms and drug reward

BACKGROUND

Certain components of rest-activity rhythms such as greater eveningness (delayed phase), physical inactivity (blunted amplitude) and shift work (irregularity) are associated with increased risk for drug use. Dopaminergic (DA) signaling has been hypothesized to mediate the associations, though clinical evidence is lacking.

METHODS

We examined associations between rhythm components and striatal D1 (D1R) and D2/3 receptor (D2/3R) availability in 32 healthy adults (12 female, age: 42.40±12.22) and its relationship to drug reward. Rest-activity rhythms were assessed by one-week actigraphy combined with self-reports. [11C]NNC112 and [11C]raclopride Positron Emission Tomography (PET) scans were conducted to measure D1R and D2/3R availability, respectively. Additionally, self-reported drug-rewarding effects of 60 mg oral methylphenidate were assessed.

RESULTS

We found that delayed rhythm was associated with higher D1R availability in caudate, which was not attributable to sleep loss or 'social jet lag', whereas physical inactivity was associated with higher D2/3R availability in nucleus accumbens (NAc). Delayed rest-activity rhythm, higher caudate D1R and NAc D2/3R availability were associated with greater sensitivity to the rewarding effects of methylphenidate.

CONCLUSION

These findings reveal specific components of rest-activity rhythms associated with striatal D1R, D2/3R availability and drug-rewarding effects. Personalized interventions that target rest-activity rhythms may help prevent and treat substance use disorders.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT03190954FUNDING. This work was accomplished with support from the National Institute on Alcohol Abuse and Alcoholism (ZIAAA000550).

Conscious and unconscious brain responses to food and cocaine cues

Visual presentation of appetitive and negative cues triggers fast responses in the human brain. Here we assessed functional MRI (fMRI) responses to food, cocaine, and neutral cues presented at a subliminal ("unconscious", 33 ms) and supraliminal ("conscious", 750 and 3000 ms) level in healthy, cocaine naïve volunteers. Because there is evidence of circadian variability in reward sensitivity, our second aim was to assess diurnal variability in the brain's reactivity to cues. Sixteen participants completed two randomly ordered fMRI sessions (once 9-11 AM and another 5-7 PM). in which food, cocaine, and neutral cues were presented for 33, 750 and 3000 ms. Participants rated food cues as positive and "wanted" (more so in evenings than mornings), and cocaine cues as negative (no diurnal differences). fMRI showed occipital cortex activation for food>neutral, cocaine>neutral and cocaine>food; dorsolateral prefrontal cortex for cocaine>neutral and cocaine>food, and midbrain for cocaine>food (all p_FWE < 0.05). When comparing unconscious (33 ms) > conscious (750 and 3000 ms) presentations, we observed significant differences for cocaine>neutral and cocaine>food in occipital cortex, for cocaine>neutral in the insula/temporal lobe, and for food>neutral in the middle temporal gyrus (p_FWE < 0.05). No diurnal differences for brain activations were observed. We interpret these findings to suggest that negative items (e.g., cocaine) might be perceived at a faster speed than positive ones (e.g., food), although we cannot rule out that the higher saliency of cocaine cues, which would be novel to non-drug using individuals, contributed to the faster speed of detection.

Experimentally imposed circadian misalignment alters the neural response to monetary rewards and response inhibition in healthy adolescents

BACKGROUND

Sleep and circadian timing shifts later during adolescence, conflicting with early school start times, and resulting in circadian misalignment. Although circadian misalignment has been linked to depression, substance use, and altered reward function, a paucity of experimental studies precludes the determination of causality. Here we tested, for the first time, whether experimentally-imposed circadian misalignment alters the neural response to monetary reward and/or response inhibition.

METHODS

Healthy adolescents (n = 25, ages 13-17) completed two in-lab sleep schedules in counterbalanced order: An 'aligned' condition based on typical summer sleep-wake times (0000-0930) and a 'misaligned' condition mimicking earlier school year sleep-wake times (2000-0530). Participants completed morning and afternoon functional magnetic resonance imaging scans during each condition, including monetary reward (morning only) and response inhibition (morning and afternoon) tasks. Total sleep time and circadian phase were assessed via actigraphy and salivary melatonin, respectively.

RESULTS

Bilateral ventral striatal (VS) activation during reward outcome was lower during the Misaligned condition after accounting for the prior night's total sleep time. Bilateral VS activation during reward anticipation was lower during the Misaligned condition, including after accounting for covariates, but did not survive correction for multiple comparisons. Right inferior frontal gyrus activation during response inhibition was lower during the Misaligned condition, before and after accounting for total sleep time and vigilant attention, but only during the morning scan.

CONCLUSIONS

Our findings provide novel experimental evidence that circadian misalignment analogous to that resulting from school schedules may have measurable impacts on healthy adolescents' reward processing and inhibition of prepotent responses.

Is there a 24-hour rhythm in alcohol craving and does it vary by sleep/circadian timing?

Increasing evidence implicates sleep/circadian factors in alcohol use; however, the role of such factors in alcohol craving has received scant attention. Prior research suggests a 24-hour rhythm in related processes (e.g., reward motivation), but more research directly investigating a rhythm in craving is needed. Moreover, prior evidence is ambiguous whether such a rhythm in alcohol craving may vary by sleep/circadian timing. To examine these possibilities, 36 late adolescents (18-22 years of age; 61% female) with regular alcohol use but without a current alcohol use disorder were recruited to complete smartphone reports of alcohol craving intensity six times a day for two weeks. During these two weeks, participants wore wrist actigraphs and completed two in-lab assessments (on Thursday and Sunday) of dim light melatonin onset (DLMO). Average actigraphically derived midpoint of sleep on weekends and average DLMO were used as indicators of sleep and circadian timing, respectively. Multilevel cosinor analysis revealed a 24-hour rhythm in alcohol craving. Findings across the sleep and circadian timing variables converged to suggest that sleep/circadian timing moderated the 24-hour rhythm in alcohol craving. Specifically, people with later sleep/circadian timing had later timing of peak alcohol craving. These findings add to the growing evidence of potential circadian influences on reward-related phenomena and suggest that greater consideration of sleep and circadian influences on alcohol craving may be useful for understanding alcohol use patterns and advancing related interventions.

Measuring circadian function in bipolar disorders: Empirical and conceptual review of physiological, actigraphic, and self-report approaches

BACKGROUND

Interest in biological clock pathways in bipolar disorders (BD) continues to grow, but there has yet to be an audit of circadian measurement tools for use in BD research and practice.

PROCEDURE

The International Society for Bipolar Disorders Chronobiology Task Force conducted a critical integrative review of circadian methods that have real-world applicability. Consensus discussion led to the selection of three domains to review-melatonin assessment, actigraphy, and self-report.

RESULTS

Measurement approaches used to quantify circadian function in BD are described in sufficient detail for researchers and clinicians to make pragmatic decisions about their use. A novel integration of the measurement literature is offered in the form of a provisional taxonomy distinguishing between circadian measures (the instruments and methods used to quantify circadian function, such as dim light melatonin onset) and circadian constructs (the biobehavioral processes to be measured, such as circadian phase).

CONCLUSIONS

Circadian variables are an important target of measurement in clinical practice and biomarker research. To improve reproducibility and clinical application of circadian constructs, an informed systematic approach to measurement is required. We trust that this review will decrease ambiguity in the literature and support theory-based consideration of measurement options.

Impact of Meal Timing and Chronotype on Food Reward and Appetite Control in Young Adults

Early meal timing and chronotype are associated with lower BMI, but their impact on appetite is poorly understood. We examined the impact of meal timing and chronotype on appetite and food reward. Forty-four adults were divided into early (EC; Morningness–Eveningness Questionnaire (MEQ) score = 55 ± 5) or late chronotype (LC; MEQ score = 40 ± 6) and assessed for body mass index, habitual energy intake (EI; three-day online dietary record) and eating behavior traits from the Three-Factor Eating Questionnaire (TFEQ). Participants attended the laboratory after ≥3 h fast on two occasions for early (AM; 8–10 a.m.) and late (PM; 4–6 p.m.) counterbalanced testing sessions in a 2 × 2 design. Appetite ratings and food reward (validated diurnal Leeds Food Preference Questionnaire) were measured in response to a standardized test meal. LC was associated with higher BMI (p = 0.01), but not with EI or TFEQ. The composite appetite score was lower in AM than PM (M_Δ= −5 (95% CI −10, −0.2) mm, p = 0.040). Perceived test meal fillingness was higher in AM than PM and EC compared to LC (p ≤ 0.038). Liking and wanting high-fat food were lower in AM than PM (p ≤ 0.004). The late chronotype was associated with greater desire for high-fat food (p = 0.006). To conclude, early meal timing and early chronotype are independently associated with smaller appetite and lower desire for high-fat food.

Ideal Time of Day for Risky Decision Making: Evidence from the Balloon Analogue Risk Task

BACKGROUND

Previous studies have demonstrated that individuals showed higher risk preference in the afternoon than in the morning. However, few studies aimed to explore the alteration of feedback learning effect during risky decision making, which is one of the important psychological processes of real risk behaviors. Moreover, cognitive function altered at the off-peak time due to impaired inhibitory control. The present study is to investigate the time-of-day effect on risky decision making and inhibitory control and whether the alteration of inhibitory control causes the differences in risky decision making across one day.

PARTICIPANTS AND METHODS

We adopted a within-participants design without extremely chronotype individuals to measure the time-of-day (9 am vs 3 pm) effect on risky decision making by using the Balloon Analogue Risk Task. At the same time, we measured the inhibitory control by using the Go/no-go task.

RESULTS

Our results confirmed that individuals showed higher risk preference in the afternoon than in the morning. In addition, we found that individuals were insensitive to loss and the previous negative feedback in the afternoon. Critically, the results did not reveal any significant correlation between risky decision making and inhibitory control under the regulation of the time-of-day effects, although individuals performed worse on inhibitory control in the afternoon.

CONCLUSION

The current findings revealed that the time-of-day effect regulated risky decision making and inhibitory control. Individuals act with higher risk preference, less sensitivity to loss as negative feedback, and lower inhibitory control in the afternoon than in the morning. This may reflect the effects of time-of-day on risk propensity and inhibitory control is relatively independent.

Sleepiness and Behavioral Risk-Taking: Do Sleepy People Take More or Less Risk?

BACKGROUND

Although sleep loss has been implicated in risk-taking behavior, it is unclear how individuals' current propensity to fall asleep, known as sleepiness, influences risk-taking. Because sleepiness is not only driven by recent sleep but also by factors such as circadian rhythm and current stimulation, it may be an important contributor to risk-taking as it reflects the more immediate sleep-wake state.

PARTICIPANTS

One hundred thirty participants were recruited from a large Midwestern U.S. university.

METHODS

Participants completed a short personality survey, reported their current sleepiness on the Stanford Sleepiness Scale, and then completed the Balloon Analog Risk Task, a computerized risk-taking measure in which participants earned real money for their performance.

RESULTS

There was little support for a linear relation between sleepiness and risk-taking, but the evidence indicated a robust curvilinear relation. Even after controlling for important individual differences in sleep and risk-taking, participants who were moderately sleepy took longer to complete the risk-taking task, pumped balloons more, and exploded more balloons than those who were either low or high on sleepiness.

CONCLUSIONS

The curvilinear relation between sleepiness and risk-taking sheds light on inconsistencies in prior findings linking sleepiness and sleep loss to risk-taking behavior. Moreover, current sleepiness appears to have unique implications for risk-taking.

Circadian modulation of human reward function: Is there an evidentiary signal in existing neuroimaging studies?

Reward functioning in animals is modulated by the circadian system, but such effects are poorly understood in the human case. The aim of this study was to address this deficit via a systematic review of human fMRI studies measuring one or more proxies for circadian function and a neural reward outcome. A narrative synthesis of 15 studies meeting inclusion criteria identified 13 studies that show a circadian impact on the human reward system, with four types of proxy (circadian system biology, downstream circadian rhythms, circadian challenge, and time of day) associated with neural reward activation. Specific reward-related regions/networks subserving this effect included the medial prefrontal cortex, ventral striatum, putamen and default mode network. The circadian effect was observed in measures of both reward anticipation and reward receipt, with more consistent evidence for the latter. Findings are limited by marked heterogeneity across study designs. We encourage a systematic program of research investigating circadian-reward interactions as an adapted biobehavioural feature and as an aetiological mechanism in reward-related pathologies.

A psychometric investigation of the sleep, circadian rhythms, and mood (SCRAM) questionnaire

The sleep, circadian rhythms, and mood (SCRAM) questionnaire (Byrne, Bullock et al., 2017) was designed to concurrently measure individual differences in three clinically important functions: diurnal preference, sleep quality, and mood. The 15-item questionnaire consists of three 5-item scales named Morningness, Good Sleep, and Depressed Mood. The overarching aim of the current project was to investigate the validity and reliability of the questionnaire. Here, we report on associations investigated in three data sets. Study 1 (N = 70, 80% females) was used to examine the test-retest reliability of the questionnaire, finding strong test-retest reliability of the three scales over a 2-week period (r's ranging from 0.73 to 0.86). Study 2 (N = 183, 80% females) enabled us to examine the construct validity of the SCRAM scales against well-validated self-report measures of diurnal preference, sleep quality, and depression. Strong correlations were found between each SCRAM scale and their respective measure in bivariate analyses, and associations were robust after the inclusion of the remaining two SCRAM scales as predictors in regression analyses. Data from Study 3 (N = 42, 100% males) were used to measure the extent to which SCRAM scores correlated with objective measures of sleep-wake behavior using actigraphy. Morningness was found to be related to earlier sleep onset and offset times, and Good Sleep was related to higher sleep efficiency but to no other measures of sleep quality; Depressed Mood was not related to actigraphy measures. The findings provide provisional support for construct validity and reliability of the SCRAM questionnaire as a measure of diurnal preference, sleep quality, and depressed mood. Future research into the psychometrics of SCRAM should test the questionnaire's discriminant and predictive validity in clinical samples.

Evidence of a diurnal rhythm in implicit reward learning

Many aspects of hedonic behavior, including self-administration of natural and drug rewards, as well as human positive affect, follow a diurnal cycle that peaks during the species-specific active period. This variation has been linked to circadian modulation of the mesolimbic dopamine system, and is hypothesized to serve an adaptive function by driving an organism to engage with the environment during times where the opportunity for obtaining rewards is high. However, relatively little is known about whether more complex facets of hedonic behavior - in particular, reward learning - follow the same diurnal cycle. The current study aimed to address this gap by examining evidence for diurnal variation in reward learning on a well-validated probabilistic reward learning task (PRT). PRT data from a large normative sample (N = 516) of non-clinical individuals, recruited across eight studies, were examined for the current study. The PRT uses an asymmetrical reinforcement ratio to induce a behavioral response bias, and reward learning was operationalized as the strength of this response bias across blocks of the task. Results revealed significant diurnal variation in reward learning, however in contrast to patterns previously observed in other aspects of hedonic behavior, reward learning was lowest in the middle of the day. Although a diurnal pattern was also observed on a measure of more general task performance (discriminability), this did not account for the variation observed in reward learning. Taken together, these findings point to a distinct diurnal pattern in reward learning that differs from that observed in other aspects of hedonic behavior. The results of this study have important implications for our understanding of clinical disorders characterized by both circadian and reward learning disturbances, and future research is needed to confirm whether this diurnal variation has a truly circadian origin.

Time of Day Differences in Neural Reward Functioning in Healthy Young Men

Reward function appears to be modulated by the circadian system, but little is known about the neural basis of this interaction. Previous research suggests that the neural reward response may be different in the afternoon; however, the direction of this effect is contentious. Reward response may follow the diurnal rhythm in self-reported positive affect, peaking in the early afternoon. An alternative is that daily reward response represents a type of prediction error, with neural reward activation relatively high at times of day when rewards are unexpected (i.e., early and late in the day). The present study measured neural reward activation in the context of a validated reward task at 10.00 h, 14.00 h, and 19.00 h in healthy human males. A region of interest BOLD fMRI protocol was used to investigate the diurnal waveform of activation in reward-related brain regions. Multilevel modeling found, as expected, a highly significant quadratic time-of-day effect focusing on the left putamen (p < 0.001). Consistent with the "prediction error" hypothesis, activation was significantly higher at 10.00 h and 19.00 h compared with 14.00 h. It is provisionally concluded that the putamen may be particularly important in endogenous priming of reward motivation at different times of day, with the pattern of activation consistent with circadian-modulated reward expectancies in neural pathways (i.e., greater activation to reward stimuli at unexpected times of day). This study encourages further research into circadian modulation of reward and underscores the methodological importance of accounting for time of day in fMRI protocols.SIGNIFICANCE STATEMENT This is one of the first studies to use a repeated-measures imaging procedure to explore the diurnal rhythm of reward activation. Although self-reported reward (most often operationalized as positive affect) peaks in the afternoon, the present findings indicate that neural activation is lowest at this time. We conclude that the diurnal neural activation pattern may reflect a prediction error of the brain, where rewards at unexpected times (10.00 h and 19.00 h) elicit higher activation in reward brain regions than at expected (14.00 h) times. These data also have methodological significance, suggesting that there may be a time of day influence, which should be accounted for in neural reward studies.