Recurrent, robust and scalable patterns underlie human approach and avoidance

A novel approach to anxiety level prediction using small sets of judgment and survey variables

Anxiety, a condition characterized by intense fear and persistent worry, affects millions each year and, when severe, is distressing and functionally impairing. Numerous machine learning frameworks have been developed and tested to predict features of anxiety and anxiety traits. This study extended these approaches by using a small set of interpretable judgment variables (n = 15) and contextual variables (demographics, perceived loneliness, COVID-19 history) to (1) understand the relationships between these variables and (2) develop a framework to predict anxiety levels [derived from the State Trait Anxiety Inventory (STAI)]. This set of 15 judgment variables, including loss aversion and risk aversion, models biases in reward/aversion judgments extracted from an unsupervised, short (2-3 min) picture rating task (using the International Affective Picture System) that can be completed on a smartphone. The study cohort consisted of 3476 de-identified adult participants from across the United States who were recruited using an email survey database. Using a balanced Random Forest approach with these judgment and contextual variables, STAI-derived anxiety levels were predicted with up to 81% accuracy and 0.71 AUC ROC. Normalized Gini scores showed that the most important predictors (age, loneliness, household income, employment status) contributed a total of 29-31% of the cumulative relative importance and up to 61% was contributed by judgment variables. Mediation/moderation statistics revealed that the interactions between judgment and contextual variables appears to be important for accurately predicting anxiety levels. Median shifts in judgment variables described a behavioral profile for individuals with higher anxiety levels that was characterized by less resilience, more avoidance, and more indifference behavior. This study supports the hypothesis that distinct constellations of 15 interpretable judgment variables, along with contextual variables, could yield an efficient and highly scalable system for mental health assessment. These results contribute to our understanding of underlying psychological processes that are necessary to characterize what causes variance in anxiety conditions and its behaviors, which can impact treatment development and efficacy.

Predicting COVID-19 Vaccination Uptake Using a Small and Interpretable Set of Judgment and Demographic Variables: Cross-Sectional Cognitive Science Study

BACKGROUND

Despite COVID-19 vaccine mandates, many chose to forgo vaccination, raising questions about the psychology underlying how judgment affects these choices. Research shows that reward and aversion judgments are important for vaccination choice; however, no studies have integrated such cognitive science with machine learning to predict COVID-19 vaccine uptake.

OBJECTIVE

This study aims to determine the predictive power of a small but interpretable set of judgment variables using 3 machine learning algorithms to predict COVID-19 vaccine uptake and interpret what profile of judgment variables was important for prediction.

METHODS

We surveyed 3476 adults across the United States in December 2021. Participants answered demographic, COVID-19 vaccine uptake (ie, whether participants were fully vaccinated), and COVID-19 precaution questions. Participants also completed a picture-rating task using images from the International Affective Picture System. Images were rated on a Likert-type scale to calibrate the degree of liking and disliking. Ratings were computationally modeled using relative preference theory to produce a set of graphs for each participant (minimum R2>0.8). In total, 15 judgment features were extracted from these graphs, 2 being analogous to risk and loss aversion from behavioral economics. These judgment variables, along with demographics, were compared between those who were fully vaccinated and those who were not. In total, 3 machine learning approaches (random forest, balanced random forest [BRF], and logistic regression) were used to test how well judgment, demographic, and COVID-19 precaution variables predicted vaccine uptake. Mediation and moderation were implemented to assess statistical mechanisms underlying successful prediction.

RESULTS

Age, income, marital status, employment status, ethnicity, educational level, and sex differed by vaccine uptake (Wilcoxon rank sum and chi-square P<.001). Most judgment variables also differed by vaccine uptake (Wilcoxon rank sum P<.05). A similar area under the receiver operating characteristic curve (AUROC) was achieved by the 3 machine learning frameworks, although random forest and logistic regression produced specificities between 30% and 38% (vs 74.2% for BRF), indicating a lower performance in predicting unvaccinated participants. BRF achieved high precision (87.8%) and AUROC (79%) with moderate to high accuracy (70.8%) and balanced recall (69.6%) and specificity (74.2%). It should be noted that, for BRF, the negative predictive value was <50% despite good specificity. For BRF and random forest, 63% to 75% of the feature importance came from the 15 judgment variables. Furthermore, age, income, and educational level mediated relationships between judgment variables and vaccine uptake.

CONCLUSIONS

The findings demonstrate the underlying importance of judgment variables for vaccine choice and uptake, suggesting that vaccine education and messaging might target varying judgment profiles to improve uptake. These methods could also be used to aid vaccine rollouts and health care preparedness by providing location-specific details (eg, identifying areas that may experience low vaccination and high hospitalization).

Characterizing major depressive disorder and substance use disorder using heatmaps and variable interactions: The utility of operant behavior and brain structure relationships

BACKGROUND

Rates of depression and addiction have risen drastically over the past decade, but the lack of integrative techniques remains a barrier to accurate diagnoses of these mental illnesses. Changes in reward/aversion behavior and corresponding brain structures have been identified in those with major depressive disorder (MDD) and cocaine-dependence polysubstance abuse disorder (CD). Assessment of statistical interactions between computational behavior and brain structure may quantitatively segregate MDD and CD.

METHODS

Here, 111 participants [40 controls (CTRL), 25 MDD, 46 CD] underwent structural brain MRI and completed an operant keypress task to produce computational judgment metrics. Three analyses were performed: (1) linear regression to evaluate groupwise (CTRL v. MDD v. CD) differences in structure-behavior associations, (2) qualitative and quantitative heatmap assessment of structure-behavior association patterns, and (3) the k-nearest neighbor machine learning approach using brain structure and keypress variable inputs to discriminate groups.

RESULTS

This study yielded three primary findings. First, CTRL, MDD, and CD participants had distinct structure-behavior linear relationships, with only 7.8% of associations overlapping between any two groups. Second, the three groups had statistically distinct slopes and qualitatively distinct association patterns. Third, a machine learning approach could discriminate between CTRL and CD, but not MDD participants.

CONCLUSIONS

These findings demonstrate that variable interactions between computational behavior and brain structure, and the patterns of these interactions, segregate MDD and CD. This work raises the hypothesis that analysis of interactions between operant tasks and structural neuroimaging might aide in the objective classification of MDD, CD and other mental health conditions.

Putting Effort into Emotion Regulation: Manipulating Desirability and Motivational Strength

Although people often want to regulate their emotions, they are sometimes reluctant to invest the necessary effort in doing so. We propose that people could be motivated to invest effort in emotion regulation, by rendering the target emotional state more desirable. Rendering an emotion goal more desirable can motivate people to invest effort in emotion regulation, ultimately facilitating successful emotion regulation. In three studies (N = 452), we show that both inside and outside the lab, rendering calmness more desirable, boosted the motivational strength to increase calmness, increasing the effort people invested to increase calmness, and ultimately made people calmer. This investigation points to the importance of motivational strength as a potential means to promote effort and success in emotion regulation.

Supplementary Information

The online version contains supplementary material available at 10.1007/s42761-022-00155-0.

The Prevalence of Psychotic Symptoms, Violent Ideation, and Disruptive Behavior in a Population With SARS-CoV-2 Infection: Preliminary Study

Background

The COVID-19 disease results from infection by the SARS-CoV-2 virus to produce a range of mild to severe physical, neurological, and mental health symptoms. The COVID-19 pandemic has indirectly caused significant emotional distress, triggering the emergence of mental health symptoms in individuals who were not previously affected or exacerbating symptoms in those with existing mental health conditions. Emotional distress and certain mental health conditions can lead to violent ideation and disruptive behavior, including aggression, threatening acts, deliberate harm toward other people or animals, and inattention to or noncompliance with education or workplace rules. Of the many mental health conditions that can be associated with violent ideation and disruptive behavior, psychosis can evidence greater vulnerability to unpredictable changes and being at a greater risk for them. Individuals with psychosis can also be more susceptible to contracting COVID-19 disease.

Objective

This study aimed to investigate whether violent ideation, disruptive behavior, or psychotic symptoms were more prevalent in a population with COVID-19 and did not precede the pandemic.

Methods

In this preliminary study, we analyzed questionnaire responses from a population sample (N=366), received between the end of February 2021 and the start of March 2021 (1 year into the COVID-19 pandemic), regarding COVID-19 illness, violent ideation, disruptive behavior, and psychotic symptoms. Using the Wilcoxon rank sum test followed by multiple comparisons correction, we compared the self-reported frequency of these variables for 3 time windows related to the past 1 month, past 1 month to 1 year, and >1 year ago among the distributions of people who answered whether they tested positive or were diagnosed with COVID-19 by a clinician. We also used multivariable logistic regression with iterative resampling to investigate the relationship between these variables occurring >1 year ago (ie, before the pandemic) and the likelihood of contracting COVID-19.

Results

We observed a significantly higher frequency of self-reported violent ideation, disruptive behavior, and psychotic symptoms, for all 3 time windows of people who tested positive or were diagnosed with COVID-19 by a clinician. Using multivariable logistic regression, we observed 72% to 94% model accuracy for an increased incidence of COVID-19 in participants who reported violent ideation, disruptive behavior, or psychotic symptoms >1 year ago.

Conclusions

This preliminary study found that people who reported a test or clinician diagnosis of COVID-19 also reported higher frequencies of violent ideation, disruptive behavior, or psychotic symptoms across multiple time windows, indicating that they were not likely to be the result of COVID-19. In parallel, participants who reported these behaviors >1 year ago (ie, before the pandemic) were more likely to be diagnosed with COVID-19, suggesting that violent ideation, disruptive behavior, in addition to psychotic symptoms, were associated with COVID-19 with an approximately 70% to 90% likelihood.

An MRI method for parcellating the human striatum into matrix and striosome compartments in vivo

The mammalian striatum is comprised of intermingled tissue compartments, matrix and striosome. Though indistinguishable by routine histological techniques, matrix and striosome have distinct embryologic origins, afferent/efferent connections, surface protein expression, intra-striatal location, susceptibilities to injury, and functional roles in a range of animal behaviors. Distinguishing the compartments previously required post-mortem tissue and/or genetic manipulation; we aimed to identify matrix/striosome non-invasively in living humans. We used diffusion MRI (probabilistic tractography) to identify human striatal voxels with connectivity biased towards matrix-favoring or striosome-favoring regions (determined by prior animal tract-tracing studies). Segmented striatal compartments replicated the topological segregation and somatotopic organization identified in animal matrix/striosome studies. Of brain regions mapped in prior studies, our human brain data confirmed 93% of the compartment-selective structural connectivity demonstrated in animals. Test-retest assessment on repeat scans found a voxel classification error rate of 0.14%. Fractional anisotropy was significantly higher in matrix-like voxels, while mean diffusivity did not differ between the compartments. As mapped by the Talairach human brain atlas, 460 regions were significantly biased towards either matrix or striosome. Our method allows the study of striatal compartments in human health and disease, in vivo, for the first time.

Effects of extended-release naltrexone on the brain response to drug-related stimuli in patients with opioid use disorder

BACKGROUND

Heightened response to drug-related cues is a hallmark of addiction. Extended-release naltrexone (XR-NTX) is a US Food and Drug Administration-approved pharmacotherapy for relapse prevention in patients with opioid use disorder (OUD). In these patients, XR-NTX has been shown to reduce brain responses to opioid-related visual stimuli. To assess the biomarker potential of this phenomenon, it is necessary to determine whether this effect is limited to opioid-related stimuli and whether it is associated with key OUD symptoms.

METHODS

Using functional MRI (fMRI), we measured the brain responses to opioid-related and control (i.e., sexual and aversive) images in detoxified patients with OUD before, during and after XR-NTX treatment. Craving and withdrawal severity were evaluated using clinician- and self-administered instruments during each session.

RESULTS

We included 24 patients with OUD in our analysis. During XR-NTX treatment, we found reduced responses to opioid-related stimuli in the nucleus accumbens (NAcc) and medial orbitofrontal cortex (mOFC). The reduction in mOFC response was specific to the opioid-related stimuli. The reduced NAcc and mOFC opioid cue reactivity was correlated with reduction in clinician-assessed and self-reported withdrawal symptoms, respectively.

LIMITATIONS

The study was not placebo-controlled owing to ethical, safety and feasibility concerns.

CONCLUSION

Extended-release naltrexone reduces the NAcc and mOFC cue reactivity in patients with OUD. This effect is specific to opioid-related stimuli in the mOFC only. The reduction in neural response to opioid-related stimuli is more robust in patients with greater decline in withdrawal severity. Our results support the clinical utility of mesocorticolimbic cue reactivity in monitoring the XR-NTX treatment outcomes and highlight the link between opioid withdrawal symptomatology and neural opioid cue reactivity.

Keypress-Based Musical Preference Is Both Individual and Lawful

Musical preference is highly individualized and is an area of active study to develop methods for its quantification. Recently, preference-based behavior, associated with activity in brain reward circuitry, has been shown to follow lawful, quantifiable patterns, despite broad variation across individuals. These patterns, observed using a keypress paradigm with visual stimuli, form the basis for relative preference theory (RPT). Here, we sought to determine if such patterns extend to non-visual domains (i.e., audition) and dynamic stimuli, potentially providing a method to supplement psychometric, physiological, and neuroimaging approaches to preference quantification. For this study, we adapted our keypress paradigm to two sets of stimuli consisting of seventeenth to twenty-first century western art music (Classical) and twentieth to twenty-first century jazz and popular music (Popular). We studied a pilot sample and then a separate primary experimental sample with this paradigm, and used iterative mathematical modeling to determine if RPT relationships were observed with high R² fits. We further assessed the extent of heterogeneity in the rank ordering of keypress-based responses across subjects. As expected, individual rank orderings of preferences were quite heterogeneous, yet we observed mathematical patterns fitting these data similar to those observed previously with visual stimuli. These patterns in music preference were recurrent across two cohorts and two stimulus sets, and scaled between individual and group data, adhering to the requirements for lawfulness. Our findings suggest a general neuroscience framework that predicts human approach/avoidance behavior, while also allowing for individual differences and the broad diversity of human choices; the resulting framework may offer novel approaches to advancing music neuroscience, or its applications to medicine and recommendation systems.

A Quantitative Relationship between Signal Detection in Attention and Approach/Avoidance Behavior

This study examines how the domains of reward and attention, which are often studied as independent processes, in fact interact at a systems level. We operationalize divided attention with a continuous performance task and variables from signal detection theory (SDT), and reward/aversion with a keypress task measuring approach/avoidance in the framework of relative preference theory (RPT). Independent experiments with the same subjects showed a significant association between one SDT and two RPT variables, visualized as a three-dimensional structure. Holding one of these three variables constant, further showed a significant relationship between a loss aversion-like metric from the approach/avoidance task, and the response bias observed during the divided attention task. These results indicate that a more liberal response bias under signal detection (i.e., a higher tolerance for noise, resulting in a greater proportion of false alarms) is associated with higher "loss aversion." Furthermore, our functional model suggests a mechanism for processing constraints with divided attention and reward/aversion. Together, our results argue for a systematic relationship between divided attention and reward/aversion processing in humans.

The Commonality of Loss Aversion across Procedures and Stimuli

Individuals tend to give losses approximately 2-fold the weight that they give gains. Such approximations of loss aversion (LA) are almost always measured in the stimulus domain of money, rather than objects or pictures. Recent work on preference-based decision-making with a schedule-less keypress task (relative preference theory, RPT) has provided a mathematical formulation for LA similar to that in prospect theory (PT), but makes no parametric assumptions in the computation of LA, uses a variable tied to communication theory (i.e., the Shannon entropy or information), and works readily with non-monetary stimuli. We evaluated if these distinct frameworks described similar LA in healthy subjects, and found that LA during the anticipation phase of the PT-based task correlated significantly with LA related to the RPT-based task. Given the ease with which non-monetary stimuli can be used on the Internet, or in animal studies, these findings open an extensive range of applications for the study of loss aversion. Furthermore, the emergence of methodology that can be used to measure preference for both social stimuli and money brings a common framework to the evaluation of preference in both social psychology and behavioral economics.

From Affective Experience to Motivated Action: Tracking Reward-Seeking and Punishment-Avoidant Behaviour in Real-Life

Many of the decisions and actions in everyday life result from implicit learning processes. Important to psychopathology are, for example, implicit reward-seeking and punishment-avoidant learning processes. It is known that when specific actions get associated with a rewarding experience, such as positive emotions, that this will increase the likelihood that an organism will engage in similar actions in the future. Similarly, when actions get associated with punishing experiences, such as negative emotions, this may reduce the likelihood that the organism will engage in similar actions in the future. This study examines whether we can observe these implicit processes prospectively in the flow of daily life. If such processes take place then we expect that current behaviour can be predicted by how similar behaviour was experienced (in terms of positive and negative affect) at previous measurement moments. This was examined in a sample of 621 female individuals that had participated in an Experience Sampling data collection. Measures of affect and behaviour were collected at 10 semi-random moments of the day for 5 consecutive days. It was examined whether affective experience that was paired with certain behaviours (physical activity and social context) at previous measurements modified the likelihood to show similar behaviours at next measurement moments. Analyses were performed both at the level of observations (a time scale with units of ± 90 min) and at day level (a time scale with units of 24 h). As expected, we found that affect indeed moderated the extent to which previous behaviour predicted similar behaviour later in time, at both beep- and day-level. This study showed that it is feasible to track reward-seeking and punishment-avoidant behaviour prospectively in humans in the flow of daily life. This opens up a new toolbox to examine processes determining goal-oriented behaviour in relation to psychopathology in humans.

Age-related striatal BOLD changes without changes in behavioral loss aversion

Loss aversion (LA), the idea that negative valuations have a higher psychological impact than positive ones, is considered an important variable in consumer research. The literature on aging and behavior suggests older individuals may show more LA, although it is not clear if this is an effect of aging in general (as in the continuum from age 20 and 50 years), or of the state of older age (e.g., past age 65 years). We also have not yet identified the potential biological effects of aging on the neural processing of LA. In the current study we used a cohort of subjects with a 30 year range of ages, and performed whole brain functional MRI (fMRI) to examine the ventral striatum/nucleus accumbens (VS/NAc) response during a passive viewing of affective faces with model-based fMRI analysis incorporating behavioral data from a validated approach/avoidance task with the same stimuli. Our a priori focus on the VS/NAc was based on (1) the VS/NAc being a central region for reward/aversion processing; (2) its activation to both positive and negative stimuli; (3) its reported involvement with tracking LA. LA from approach/avoidance to affective faces showed excellent fidelity to published measures of LA. Imaging results were then compared to the behavioral measure of LA using the same affective faces. Although there was no relationship between age and LA, we observed increasing neural differential sensitivity (NDS) of the VS/NAc to avoidance responses (negative valuations) relative to approach responses (positive valuations) with increasing age. These findings suggest that a central region for reward/aversion processing changes with age, and may require more activation to produce the same LA behavior as in younger individuals, consistent with the idea of neural efficiency observed with high IQ individuals showing less brain activation to complete the same task.

Redefining neuromarketing as an integrated science of influence

Multiple transformative forces target marketing, many of which derive from new technologies that allow us to sample thinking in real time (i.e., brain imaging), or to look at large aggregations of decisions (i.e., big data). There has been an inclination to refer to the intersection of these technologies with the general topic of marketing as "neuromarketing". There has not been a serious effort to frame neuromarketing, which is the goal of this paper. Neuromarketing can be compared to neuroeconomics, wherein neuroeconomics is generally focused on how individuals make "choices", and represent distributions of choices. Neuromarketing, in contrast, focuses on how a distribution of choices can be shifted or "influenced", which can occur at multiple "scales" of behavior (e.g., individual, group, or market/society). Given influence can affect choice through many cognitive modalities, and not just that of valuation of choice options, a science of influence also implies a need to develop a model of cognitive function integrating attention, memory, and reward/aversion function. The paper concludes with a brief description of three domains of neuromarketing application for studying influence, and their caveats.

Behavioral characteristics of pair bonding in the black tufted-ear marmoset (Callithrix penicillata)

The present study describes how the development of a pair bond modifies social, sexual and aggressive behavior. Five heterosexual pairs of marmosets, previously unknown to each other, were formed at the beginning of the study. At the onset of pairing, social, sexual, exploratory and aggressive behaviors were recorded for 40 min. The animals were then observed for 20 min, both in the morning and afternoon for 21 days. The frequency and/or duration of behaviors recorded on Day 1 were compared to those recorded at later observations. The behavior displayed shortly after pairing should be completely unaffected by the pair bond, while such a bond should be present at later observations. Thus, it was possible to determine how the behavior between the pair was modified by the development of a pair bond. Social behaviors increased from Day 1 to Days 2-6 and all subsequent days observed. Conversely, other behaviors, such as open mouth displays (usually considered to be an invitation to sexual activity), had a high frequency during the early part of cohabitation but declined towards the end. Consequently, pair bonding manifests itself in an increased intensity of social behaviors. It is suggested that the intrinsically rewarding properties of grooming and perhaps other social behaviors turn the pair mate into a positive incentive, activating approach and further interactions when possible. Thus, the pair bond may be a motivational state activated by the conditioned incentive properties of the partner. This notion can explain all forms of pair bonds, including those occurring between individuals of the same sex and in promiscuous species.

Microstructural abnormalities in subcortical reward circuitry of subjects with major depressive disorder

BACKGROUND

Previous studies of major depressive disorder (MDD) have focused on abnormalities in the prefrontal cortex and medial temporal regions. There has been little investigation in MDD of midbrain and subcortical regions central to reward/aversion function, such as the ventral tegmental area/substantia nigra (VTA/SN), and medial forebrain bundle (MFB).

METHODOLOGY/PRINCIPAL FINDINGS

We investigated the microstructural integrity of this circuitry using diffusion tensor imaging (DTI) in 22 MDD subjects and compared them with 22 matched healthy control subjects. Fractional anisotropy (FA) values were increased in the right VT and reduced in dorsolateral prefrontal white matter in MDD subjects. Follow-up analysis suggested two distinct subgroups of MDD patients, which exhibited non-overlapping abnormalities in reward/aversion circuitry. The MDD subgroup with abnormal FA values in VT exhibited significantly greater trait anxiety than the subgroup with normal FA values in VT, but the subgroups did not differ in levels of anhedonia, sadness, or overall depression severity.

CONCLUSIONS/SIGNIFICANCE

These findings suggest that MDD may be associated with abnormal microstructure in brain reward/aversion regions, and that there may be at least two subtypes of microstructural abnormalities which each impact core symptoms of depression.