Learning and selective attention

Computational processes of simultaneous learning of stochasticity and volatility in humans

Making adaptive decisions requires predicting outcomes, and this in turn requires adapting to uncertain environments. This study explores computational challenges in distinguishing two types of noise influencing predictions: volatility and stochasticity. Volatility refers to diffusion noise in latent causes, requiring a higher learning rate, while stochasticity introduces moment-to-moment observation noise and reduces learning rate. Dissociating these effects is challenging as both increase the variance of observations. Previous research examined these factors mostly separately, but it remains unclear whether and how humans dissociate them when they are played off against one another. In two large-scale experiments, through a behavioral prediction task and computational modeling, we report evidence of humans dissociating volatility and stochasticity solely based on their observations. We observed contrasting effects of volatility and stochasticity on learning rates, consistent with statistical principles. These results are consistent with a computational model that estimates volatility and stochasticity by balancing their dueling effects.

Human hippocampus and dorsomedial prefrontal cortex infer and update latent causes during social interaction

Latent-cause inference is the process of identifying features of the environment that have caused an outcome. This problem is especially important in social settings where individuals may not make equal contributions to the outcomes they achieve together. Here, we designed a novel task in which participants inferred which of two characters was more likely to have been responsible for outcomes achieved by working together. Using computational modeling, univariate and multivariate analysis of human fMRI, and continuous theta-burst stimulation, we identified two brain regions that solved the task. Notably, as each outcome occurred, it was possible to decode the inference of its cause (the responsible character) from hippocampal activity. Activity in dorsomedial prefrontal cortex (dmPFC) updated estimates of association between cause-responsible character-and the outcome. Disruption of dmPFC activity impaired participants' ability to update their estimate as a function of inferred responsibility but spared their ability to infer responsibility.

Distinct computational mechanisms of uncertainty processing explain opposing exploratory behaviors in anxiety and apathy

Decision-making in uncertain environments often leads to varied outcomes. Understanding how individuals interpret the causes of unexpected feedback is crucial for adaptive behavior and mental well-being. Uncertainty can be broadly categorized into two components: volatility and stochasticity. Volatility is about how quickly conditions change, impacting results. Stochasticity, on the other hand, refers to outcomes affected by random chance or "luck". Understanding these factors enables individuals to have more effective environmental analysis and strategy implementation (explore or exploit) for future decisions. This study investigates how anxiety and apathy, two prevalent affective states, influence the perceptions of uncertainty and exploratory behavior. Participants (N = 1001) completed a restless three-armed bandit task that was analyzed using latent state models. Anxious individuals perceived uncertainty as more volatile, leading to increased exploration and learning rates, especially after reward omission. Conversely, apathetic individuals viewed uncertainty as more stochastic, resulting in decreased exploration and learning rates. The perceived volatility-to-stochasticity ratio mediated the anxiety-exploration relationship post-adverse outcomes. Dimensionality reduction showed exploration and uncertainty estimation to be distinct but related latent factors shaping a manifold of adaptive behavior that is modulated by anxiety and apathy. These findings reveal distinct computational mechanisms for how anxiety and apathy influence decision-making, providing a framework for understanding cognitive and affective processes in neuropsychiatric disorders.

Artificial Multimodal Neuron with Associative Learning Capabilities: Acquisition, Extinction, and Spontaneous Recovery

Associative multimodal artificial intelligence (AMAI) has gained significant attention across various fields, yet its implementation poses challenges due to the burden on computing and memory resources. To address these challenges, researchers have paid increasing attention to neuromorphic devices based on novel materials and structures, which can implement classical conditioning behaviors with simplified circuitry. Herein, we introduce an artificial multimodal neuron device that shows not only the acquisition behavior but also the extinction and the spontaneous recovery behaviors for the first time. Being composed of an ovonic threshold switch (OTS)-based neuron device, a conductive bridge memristor (CBM)-based synapse device, and a few passive electrical elements, such observed behaviors of this neuron device are explained in terms of the electroforming and the diffusion of metallic ions in the CBM. We believe that the proposed associative learning neuron device will shed light on the way of developing large-scale AMAI systems by providing inspiration to devise an associative learning network with improved energy efficiency.

Optogenetic Inhibition of Rat Anterior Cingulate Cortex Impairs the Ability to Initiate and Stay on Task

Our prior research has identified neural correlates of cognitive control in the anterior cingulate cortex (ACC), leading us to hypothesize that the ACC is necessary for increasing attention as rats flexibly learn new contingencies during a complex reward-guided decision-making task. Here, we tested this hypothesis by using optogenetics to transiently inhibit the ACC, while rats of either sex performed the same two-choice task. ACC inhibition had a profound impact on behavior that extended beyond deficits in attention during learning when expected outcomes were uncertain. We found that ACC inactivation slowed and reduced the number of trials rats initiated and impaired both their accuracy and their ability to complete sessions. Furthermore, drift-diffusion model analysis suggested that free-choice performance and evidence accumulation (i.e., reduced drift rates) were degraded during initial learning-leading to weaker associations that were more easily overridden in later trial blocks (i.e., stronger bias). Together, these results suggest that in addition to attention-related functions, the ACC contributes to the ability to initiate trials and generally stay on task.

Bayesian reinforcement learning: A basic overview

We and other animals learn because there is some aspect of the world about which we are uncertain. This uncertainty arises from initial ignorance, and from changes in the world that we do not perfectly know; the uncertainty often becomes evident when our predictions about the world are found to be erroneous. The Rescorla-Wagner learning rule, which specifies one way that prediction errors can occasion learning, has been hugely influential as a characterization of Pavlovian conditioning and, through its equivalence to the delta rule in engineering, in a much wider class of learning problems. Here, we review the embedding of the Rescorla-Wagner rule in a Bayesian context that is precise about the link between uncertainty and learning, and thereby discuss extensions to such suggestions as the Kalman filter, structure learning, and beyond, that collectively encompass a wider range of uncertainties and accommodate a wider assortment of phenomena in conditioning.

Hybrid U-Net and Swin-transformer network for limited-angle cardiac computed tomography

Objective.Cardiac computed tomography (CT) is widely used for diagnosis of cardiovascular disease, the leading cause of morbidity and mortality in the world. Diagnostic performance depends strongly on the temporal resolution of the CT images. To image the beating heart, one can reduce the scanning time by acquiring limited-angle projections. However, this leads to increased image noise and limited-angle-related artifacts. The goal of this paper is to reconstruct high quality cardiac CT images from limited-angle projections.Approach. The ability to reconstruct high quality images from limited-angle projections is highly desirable and remains a major challenge. With the development of deep learning networks, such as U-Net and transformer networks, progresses have been reached on image reconstruction and processing. Here we propose a hybrid model based on the U-Net and Swin-transformer (U-Swin) networks. The U-Net has the potential to restore structural information due to missing projection data and related artifacts, then the Swin-transformer can gather a detailed global feature distribution.Main results. Using synthetic XCAT and clinical cardiac COCA datasets, we demonstrate that our proposed method outperforms the state-of-the-art deep learning-based methods.Significance. It has a great potential to freeze the beating heart with a higher temporal resolution.

Investigation of directional discrimination in the nociceptive system using temperature-controlled laser stimuli

BACKGROUND

Cutaneous laser stimulation has commonly been employed to investigate the thermal properties of the nociceptive system. The aim of this study was to investigate how a temperature-controlled laser system improves the assessment of directional discrimination in the nociceptive system.

METHODS

In total, twenty healthy volunteers participated in this study. To determine the directional discrimination threshold (stimulation length 50% correct, expressed in mm), thermal stimuli were delivered using a diode laser and the laser beam was perpendicularly displaced across the skin to give a linear stimulation in four different directions (distal, proximal, lateral and medial) and displacement lengths (3 for lateral-medial and 5 for distal-proximal). Two temperature control modes were used in the stimulation system, open-loop and closed-loop control. The subjects had to report the perceived stimulus direction, the degree of certainty regarding the perceived direction and the intensity of the perceived stimulus (0-10 numerical rating scale, 3: pain threshold).

RESULTS

During closed-loop control, the orientation of stimuli was discriminated significantly more accurately than during open-loop control. During closed-loop control, the directional discrimination threshold was 31.9 and 26.1 mm for distal-proximal and lateral-medial directed stimuli, respectively. A numerical rating scale was significantly higher for the lateral/medial directions. Moreover, the variability of the discrimination threshold is reduced in the closed-loop control system.

CONCLUSIONS

The findings show that discrimination ability is better in the lateral-medial directions compared to the distal-proximal directions. This study indicates that using a system enabling closed-loop temperature control, allows more robust probing of the temporo-spatial mechanisms in the nociceptive system.

SIGNIFICANCE

This study shows that a newly developed temperature-controlled laser stimulation system enhances the possibilities to investigate the nociceptive temporo-spatial integration, as shown by a less variable directional discrimination threshold. The results also show that different orthogonal directions are discriminated differently. This new method allows a better investigation of the combined temporal and spatial mechanisms in the nociceptive system.

Learning environment-specific learning rates

People often have to switch back and forth between different environments that come with different problems and volatilities. While volatile environments require fast learning (i.e., high learning rates), stable environments call for lower learning rates. Previous studies have shown that people adapt their learning rates, but it remains unclear whether they can also learn about environment-specific learning rates, and instantaneously retrieve them when revisiting environments. Here, using optimality simulations and hierarchical Bayesian analyses across three experiments, we show that people can learn to use different learning rates when switching back and forth between two different environments. We even observe a signature of these environment-specific learning rates when the volatility of both environments is suddenly the same. We conclude that humans can flexibly adapt and learn to associate different learning rates to different environments, offering important insights for developing theories of meta-learning and context-specific control.

Neural and behavioral evidence for oxytocin's facilitatory effects on learning in volatile and stable environments

Outcomes of past decisions profoundly shape our behavior. However, choice-outcome associations can become volatile and adaption to such changes is of importance. The present study combines pharmaco-electroencephalography with computational modeling to examine whether intranasal oxytocin can modulate reinforcement learning under a volatile vs. a stable association. Results show that oxytocin increases choice accuracy independent of learning context, which is paralleled by a larger N2pc and a smaller P300. Model-based analyses reveal that while oxytocin promotes learning by accelerating value update of outcomes in the volatile context, in the stable context it does so by improving choice consistency. These findings suggest that oxytocin's facilitatory effects on learning may be exerted via improving early attentional selection and late neural processing efficiency, although at the computational level oxytocin's actions are highly adaptive between learning contexts. Our findings provide proof of concept for oxytocin's therapeutic potential in mental disorders with adaptive learning dysfunction.

Flexible learning in complex worlds

Cognitive flexibility can enhance the ability to adjust to changing environments. Here, we use learning simulations to investigate the possible advantages of flexible learning in volatile (changing) environments. We compare two established learning mechanisms, one with constant learning rates and one with rates that adjust to volatility. We study an ecologically relevant case of volatility, based on observations of developing cleaner fish Labroides dimidiatus that experience a transition from a simpler to a more complex foraging environment. There are other similar transitions in nature, such as migrating to a new and different habitat. We also examine two traditional approaches to volatile environments in experimental psychology and behavioral ecology: reversal learning, and learning set formation (consisting of a sequence of different discrimination tasks). These provide experimental measures of cognitive flexibility. Concerning transitions to a complex world, we show that both constant and flexible learning rates perform well, losing only a small proportion of available rewards in the period after a transition, but flexible rates perform better than constant rates. For reversal learning, flexible rates improve the performance with each successive reversal because of increasing learning rates, but this does not happen for constant rates. For learning set formation, we find no improvement in performance with successive shifts to new stimuli to discriminate for either flexible or constant learning rates. Flexible learning rates might thus explain increasing performance in reversal learning but not in learning set formation, and this can shed light on the nature of cognitive flexibility in a given system.

Exponential history integration with diverse temporal scales in retrosplenial cortex supports hyperbolic behavior

Animals use past experience to guide future choices. The integration of experiences typically follows a hyperbolic, rather than exponential, decay pattern with a heavy tail for distant history. Hyperbolic integration affords sensitivity to both recent environmental dynamics and long-term trends. However, it is unknown how the brain implements hyperbolic integration. We found that mouse behavior in a foraging task showed hyperbolic decay of past experience, but the activity of cortical neurons showed exponential decay. We resolved this apparent mismatch by observing that cortical neurons encode history information with heterogeneous exponential time constants that vary across neurons. A model combining these diverse timescales recreated the heavy-tailed, hyperbolic history integration observed in behavior. In particular, the time constants of retrosplenial cortex (RSC) neurons best matched the behavior, and optogenetic inactivation of RSC uniquely reduced behavioral history dependence. These results indicate that behavior-relevant history information is maintained across multiple timescales in parallel and that RSC is a critical reservoir of information guiding decision-making.

Human attention during goal-directed reading comprehension relies on task optimization

The computational principles underlying attention allocation in complex goal-directed tasks remain elusive. Goal-directed reading, that is, reading a passage to answer a question in mind, is a common real-world task that strongly engages attention. Here, we investigate what computational models can explain attention distribution in this complex task. We show that the reading time on each word is predicted by the attention weights in transformer-based deep neural networks (DNNs) optimized to perform the same reading task. Eye tracking further reveals that readers separately attend to basic text features and question-relevant information during first-pass reading and rereading, respectively. Similarly, text features and question relevance separately modulate attention weights in shallow and deep DNN layers. Furthermore, when readers scan a passage without a question in mind, their reading time is predicted by DNNs optimized for a word prediction task. Therefore, we offer a computational account of how task optimization modulates attention distribution during real-world reading.

Developmental changes in exploration resemble stochastic optimization

Human development is often described as a 'cooling off' process, analogous to stochastic optimization algorithms that implement a gradual reduction in randomness over time. Yet there is ambiguity in how to interpret this analogy, due to a lack of concrete empirical comparisons. Using data from n = 281 participants ages 5 to 55, we show that cooling off does not only apply to the single dimension of randomness. Rather, human development resembles an optimization process of multiple learning parameters, for example, reward generalization, uncertainty-directed exploration and random temperature. Rapid changes in parameters occur during childhood, but these changes plateau and converge to efficient values in adulthood. We show that while the developmental trajectory of human parameters is strikingly similar to several stochastic optimization algorithms, there are important differences in convergence. None of the optimization algorithms tested were able to discover reliably better regions of the strategy space than adult participants on this task.

How can we apply decision-making theories to wild animal behavior? Predictions arising from dual process theory and Bayesian decision theory

Our understanding of decision-making processes and cognitive biases is ever increasing, thanks to an accumulation of testable models and a large body of research over the last several decades. The vast majority of this work has been done in humans and laboratory animals because these study subjects and situations allow for tightly controlled experiments. However, it raises questions about how this knowledge can be applied to wild animals in their complex environments. Here, we review two prominent decision-making theories, dual process theory and Bayesian decision theory, to assess the similarities in these approaches and consider how they may apply to wild animals living in heterogenous environments within complicated social groupings. In particular, we wanted to assess when wild animals are likely to respond to a situation with a quick heuristic decision and when they are likely to spend more time and energy on the decision-making process. Based on the literature and evidence from our multi-destination routing experiments on primates, we find that individuals are likely to make quick, heuristic decisions when they encounter routine situations, or signals/cues that accurately predict a certain outcome, or easy problems that experience or evolutionary history has prepared them for. Conversely, effortful decision-making is likely in novel or surprising situations, when signals and cues have unpredictable or uncertain relationships to an outcome, and when problems are computationally complex. Though if problems are overly complex, satisficing via heuristics is likely, to avoid costly mental effort. We present hypotheses for how animals with different socio-ecologies may have to distribute their cognitive effort. Finally, we examine the conservation implications and potential cognitive overload for animals experiencing increasingly novel situations caused by current human-induced rapid environmental change.

Visuospatial attention revamps cortical processing of sound amid audiovisual uncertainty

Selective attentional biases arising from one sensory modality manifest in others. The effects of visuospatial attention, important in visual object perception, are unclear in the auditory domain during audiovisual (AV) scene processing. We investigate temporal and spatial factors that underlie such transfer neurally. Auditory encoding of random tone pips in AV scenes was addressed via a temporal response function model (TRF) of participants' electroencephalogram (N = 30). The spatially uninformative pips were associated with spatially distributed visual contrast reversals ("flips"), through asynchronous probabilistic AV temporal onset distributions. Participants deployed visuospatial selection on these AV stimuli to perform a task. A late (~300 ms) cross-modal influence over the neural representation of pips was found in the original and a replication study (N = 21). Transfer depended on selected visual input being (i) presented during or shortly after a related sound, in relatively limited temporal distributions (<165 ms); (ii) positioned across limited (1:4) visual foreground to background ratios. Neural encoding of auditory input, as a function of visual input, was largest at visual foreground quadrant sectors and lowest at locations opposite to the target. The results indicate that ongoing neural representations of sounds incorporate visuospatial attributes for auditory stream segregation, as cross-modal transfer conveys information that specifies the identity of multisensory signals. A potential mechanism is by enhancing or recalibrating the tuning properties of the auditory populations that represent them as objects. The results account for the dynamic evolution under visual attention of multisensory integration, specifying critical latencies at which relevant cortical networks operate.

Information-Theoretic Neural Decoding Reproduces Several Laws of Human Behavior

Human response times conform to several regularities including the Hick-Hyman law, the power law of practice, speed-accuracy trade-offs, and the Stroop effect. Each of these has been thoroughly modeled in isolation, but no account describes these phenomena as predictions of a unified framework. We provide such a framework and show that the phenomena arise as decoding times in a simple neural rate code with an entropy stopping threshold. Whereas traditional information-theoretic encoding systems exploit task statistics to optimize encoding strategies, we move this optimization to the decoder, treating it as a Bayesian ideal observer that can track transmission statistics as prior information during decoding. Our approach allays prominent concerns that applying information-theoretic perspectives to modeling brain and behavior requires complex encoding schemes that are incommensurate with neural encoding.

Flexible structure learning under uncertainty

Experience is known to facilitate our ability to interpret sequences of events and make predictions about the future by extracting temporal regularities in our environments. Here, we ask whether uncertainty in dynamic environments affects our ability to learn predictive structures. We exposed participants to sequences of symbols determined by first-order Markov models and asked them to indicate which symbol they expected to follow each sequence. We introduced uncertainty in this prediction task by manipulating the: (a) probability of symbol co-occurrence, (b) stimulus presentation rate. Further, we manipulated feedback, as it is known to play a key role in resolving uncertainty. Our results demonstrate that increasing the similarity in the probabilities of symbol co-occurrence impaired performance on the prediction task. In contrast, increasing uncertainty in stimulus presentation rate by introducing temporal jitter resulted in participants adopting a strategy closer to probability maximization than matching and improving in the prediction tasks. Next, we show that feedback plays a key role in learning predictive statistics. Trial-by-trial feedback yielded stronger improvement than block feedback or no feedback; that is, participants adopted a strategy closer to probability maximization and showed stronger improvement when trained with trial-by-trial feedback. Further, correlating individual strategy with learning performance showed better performance in structure learning for observers who adopted a strategy closer to maximization. Our results indicate that executive cognitive functions (i.e., selective attention) may account for this individual variability in strategy and structure learning ability. Taken together, our results provide evidence for flexible structure learning; individuals adapt their decision strategy closer to probability maximization, reducing uncertainty in temporal sequences and improving their ability to learn predictive statistics in variable environments.

Humans display interindividual differences in the latent mechanisms underlying fear generalization behaviour

Human generalization research aims to understand the processes underlying the transfer of prior experiences to new contexts. Generalization research predominantly relies on descriptive statistics, assumes a single generalization mechanism, interprets generalization from mono-source data, and disregards individual differences. Unfortunately, such an approach fails to disentangle various mechanisms underlying generalization behaviour and can readily result in biased conclusions regarding generalization tendencies. Therefore, we combined a computational model with multi-source data to mechanistically investigate human generalization behaviour. By simultaneously modelling learning, perceptual and generalization data at the individual level, we revealed meaningful variations in how different mechanisms contribute to generalization behaviour. The current research suggests the need for revising the theoretical and analytic foundations in the field to shift the attention away from forecasting group-level generalization behaviour and toward understanding how such phenomena emerge at the individual level. This raises the question for future research whether a mechanism-specific differential diagnosis may be beneficial for generalization-related psychiatric disorders.

Exploring global trends and future directions in advertising research: A focus on consumer behavior

This study aims to select the physiological and neurophysiological studies utilized in advertising and to address the fragmented comprehension of consumers' mental responses to advertising held by marketers and advertisers. To fill the gap, the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework was employed to select relevant articles, and bibliometric analysis was conducted to determine global trends and advancements in advertising and neuromarketing. The study selected and analyzed forty-one papers from the Web of Science (WoS) database from 2009-2020. The results indicated that Spain, particularly the Complutense University of Madrid, was the most productive country and institution, respectively, with 11 and 3 articles. The journal Frontiers in Psychology was the most prolific, with eight articles. The article "Neuromarketing: The New Science of Consumer Behavior" had the most citations (152 T.Cs). Additionally, the researchers discovered that the inferior frontal and middle temporal gyri were associated with pleasant and unpleasant emotions, respectively, while the right superior temporal and right middle frontal gyrus was connected to high and low arousal. Furthermore, the right prefrontal cortex (PFC) and left PFC were linked to withdrawal and approach behaviors. In terms of the reward system, the ventral striatum played a critical role, while the orbitofrontal cortex and ventromedial PFC were connected to perception. As far as we know, this is the first paper that focused on the global academic trends and developments of neurophysiological and physiological instruments used in advertising in the new millennium, emphasizing the significance of intrinsic and extrinsic emotional processes, endogenous and exogenous attentional processes, memory, reward, motivational attitude, and perception in advertising campaigns.

A characterization of the neural representation of confidence during probabilistic learning

Learning in a stochastic and changing environment is a difficult task. Models of learning typically postulate that observations that deviate from the learned predictions are surprising and used to update those predictions. Bayesian accounts further posit the existence of a confidence-weighting mechanism: learning should be modulated by the confidence level that accompanies those predictions. However, the neural bases of this confidence are much less known than the ones of surprise. Here, we used a dynamic probability learning task and high-field MRI to identify putative cortical regions involved in the representation of confidence about predictions during human learning. We devised a stringent test based on the conjunction of four criteria. We localized several regions in parietal and frontal cortices whose activity is sensitive to the confidence of an ideal observer, specifically so with respect to potential confounds (surprise and predictability), and in a way that is invariant to which item is predicted. We also tested for functionality in two ways. First, we localized regions whose activity patterns at the subject level showed an effect of both confidence and surprise in qualitative agreement with the confidence-weighting principle. Second, we found neural representations of ideal confidence that also accounted for subjective confidence. Taken together, those results identify a set of cortical regions potentially implicated in the confidence-weighting of learning.

Neurocomputational mechanism of real-time distributed learning on social networks

Social networks shape our decisions by constraining what information we learn and from whom. Yet, the mechanisms by which network structures affect individual learning and decision-making remain unclear. Here, by combining a real-time distributed learning task with functional magnetic resonance imaging, computational modeling and social network analysis, we studied how humans learn from observing others' decisions on seven-node networks with varying topological structures. We show that learning on social networks can be approximated by a well-established error-driven process for observational learning, supported by an action prediction error encoded in the lateral prefrontal cortex. Importantly, learning is flexibly weighted toward well-connected neighbors, according to activity in the dorsal anterior cingulate cortex, but only insofar as social observations contain secondhand, potentially intertwining, information. These data suggest a neurocomputational mechanism of network-based filtering on the sources of information, which may give rise to biased learning and the spread of misinformation in an interconnected society.

Aversion, interpretation and determinability: Three factors of uncertainty that may play a role in psychopathology

This opinion piece considers the construct of tolerance of uncertainty and suggests that it should be viewed in the context of three psychological factors: uncertainty aversion, uncertainty interpretation, and uncertainty determinability. Uncertainty aversion refers to a dislike of situations in which the outcomes are not deterministic and is similar to conventional conceptions of (in)tolerance of uncertainty. Uncertainty interpretation refers to the extent to which variability in an observed outcome is interpreted as random fluctuation around a relatively stable base-rate versus frequent and rapid changes in the base-rate. Uncertainty determinability refers to the (actual or perceived) capacity of the individual to generate any meaningful expectancy of the uncertain outcome, which may be undeterminable if predictions are updated too quickly. We argue that uncertainty interpretation and determinability are psychological responses to the experience of probabilistic events that vary among individuals and can moderate negative affect experienced in response to uncertainty. We describe how individual differences in basic parameters of associative learning (modelled by a simple learning window) could lead to this variation. To explain these hypotheses, we utilise the distinction between aleatory uncertainty (the inherent unpredictability of individual stochastic events) and epistemic uncertainty (obtainable knowledge that the individual lacks or perceives to be lacking). We argue that when expectancies are updated quickly, epistemic uncertainty will dominate the individual's representation of the events around them, leading to a subjective experience of the world as one that is volatile and unpredictable.

Contextual inference in learning and memory

Context is widely regarded as a major determinant of learning and memory across numerous domains, including classical and instrumental conditioning, episodic memory, economic decision-making, and motor learning. However, studies across these domains remain disconnected due to the lack of a unifying framework formalizing the concept of context and its role in learning. Here, we develop a unified vernacular allowing direct comparisons between different domains of contextual learning. This leads to a Bayesian model positing that context is unobserved and needs to be inferred. Contextual inference then controls the creation, expression, and updating of memories. This theoretical approach reveals two distinct components that underlie adaptation, proper and apparent learning, respectively referring to the creation and updating of memories versus time-varying adjustments in their expression. We review a number of extensions of the basic Bayesian model that allow it to account for increasingly complex forms of contextual learning.

Consumer Behaviour to Be Considered in Advertising: A Systematic Analysis and Future Agenda

In the past decade, neurophysiological and physiological tools have been used to explore consumer behaviour toward advertising. The studies into brain processes (e.g., emotions, motivation, reward, attention, perception, and memory) toward advertising are scant, and remain unclear in the academic literature. To fill the gap in the literature, this study followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) protocol to extract relevant articles. It extracted and analysed 76 empirical articles from the Web of Science (WoS) database from 2009-2020. The findings revealed that the inferior frontal gyrus was associated with pleasure, while the middle temporal gyrus correlated with displeasure of advertising. Meanwhile, the right superior-temporal is related to high arousal and the right middle-frontal-gyrus is linked to low arousal toward advertisement campaigns. The right prefrontal-cortex (PFC) is correlated with withdrawal behaviour, and the left PFC is linked to approach behaviour. For the reward system, the ventral striatum has a main role in the reward system. It has also been found that perception is connected to the orbitofrontal cortex (OFC) and ventromedial (Vm) PFC. The study's findings provide a profound overview of the importance of brain processes such as emotional processes, reward, motivation, cognitive processes, and perception in advertising campaigns such as commercial, social initiative, and public health.

Psychedelics and schizophrenia: Distinct alterations to Bayesian inference

Schizophrenia and states induced by certain psychotomimetic drugs may share some physiological and phenomenological properties, but they differ in fundamental ways: one is a crippling chronic mental disease, while the others are temporary, pharmacologically-induced states presently being explored as treatments for mental illnesses. Building towards a deeper understanding of these different alterations of normal consciousness, here we compare the changes in neural dynamics induced by LSD and ketamine (in healthy volunteers) against those associated with schizophrenia, as observed in resting-state M/EEG recordings. While both conditions exhibit increased neural signal diversity, our findings reveal that this is accompanied by an increased transfer entropy from the front to the back of the brain in schizophrenia, versus an overall reduction under the two drugs. Furthermore, we show that these effects can be reproduced via different alterations of standard Bayesian inference applied on a computational model based on the predictive processing framework. In particular, the effects observed under the drugs are modelled as a reduction of the precision of the priors, while the effects of schizophrenia correspond to an increased precision of sensory information. These findings shed new light on the similarities and differences between schizophrenia and two psychotomimetic drug states, and have potential implications for the study of consciousness and future mental health treatments.

Chasing Unknown Bandits: Uncertainty Guidance in Learning and Decision Making

In repeated decision problems for which it is possible to learn from experience, people should actively seek out uncertain options, rather than avoid ambiguity or uncertainty, in order to learn and improve future decisions. Research on human behavior in a variety of multiarmed-bandit tasks supports this prediction. Multiarmed-bandit tasks involve repeated decisions between options with initially unknown reward distributions and require a careful balance between learning about relatively unknown options (exploration) and obtaining high immediate rewards (exploitation). Resolving this exploration-exploitation dilemma optimally requires considering not only the estimated value of each option, but also the uncertainty in these estimations. Bayesian learning naturally quantifies uncertainty and hence provides a principled framework to study how humans resolve this dilemma. On the basis of computational modeling and behavioral results in bandit tasks, I argue that human learning, attention, and exploration are guided by uncertainty. These results support Bayesian theories of cognition and underpin the fundamental role of subjective uncertainty in both learning and decision making.

Neural signals implicated in the processing of appetitive and aversive events in social and non-social contexts

In 2014, we participated in a special issue of Frontiers examining the neural processing of appetitive and aversive events. Specifically, we reviewed brain areas that contribute to the encoding of prediction errors and value versus salience, attention and motivation. Further, we described how we disambiguated these cognitive processes and their neural substrates by using paradigms that incorporate both appetitive and aversive stimuli. We described a circuit in which the orbitofrontal cortex (OFC) signals expected value and the basolateral amygdala (BLA) encodes the salience and valence of both appetitive and aversive events. This information is integrated by the nucleus accumbens (NAc) and dopaminergic (DA) signaling in order to generate prediction and prediction error signals, which guide decision-making and learning via the dorsal striatum (DS). Lastly, the anterior cingulate cortex (ACC) is monitoring actions and outcomes, and signals the need to engage attentional control in order to optimize behavioral output. Here, we expand upon this framework, and review our recent work in which within-task manipulations of both appetitive and aversive stimuli allow us to uncover the neural processes that contribute to the detection of outcomes delivered to a conspecific and behaviors in social contexts. Specifically, we discuss the involvement of single-unit firing in the ACC and DA signals in the NAc during the processing of appetitive and aversive events in both social and non-social contexts.

Freezing revisited: coordinated autonomic and central optimization of threat coping

Animals have sophisticated mechanisms for coping with danger. Freezing is a unique state that, upon threat detection, allows evidence to be gathered, response possibilities to be previsioned and preparations to be made for worst-case fight or flight. We propose that - rather than reflecting a passive fear state - the particular somatic and cognitive characteristics of freezing help to conceal overt responses, while optimizing sensory processing and action preparation. Critical for these functions are the neurotransmitters noradrenaline and acetylcholine, which modulate neural information processing and also control the sympathetic and parasympathetic branches of the autonomic nervous system. However, the interactions between autonomic systems and the brain during freezing, and the way in which they jointly coordinate responses, remain incompletely explored. We review the joint actions of these systems and offer a novel computational framework to describe their temporally harmonized integration. This reconceptualization of freezing has implications for its role in decision-making under threat and for psychopathology.

A Single Session of SMR-Neurofeedback Training Improves Selective Attention Emerging from a Dynamic Structuring of Brain-Heart Interplay

Research on sensorimotor rhythms (SMR) based on neurofeedback (NFb) emphasizes improvements in selective attention associated with SMR amplification. However, the long-term training proposed in most studies posed the question of acceptability, which led to the evaluation of the potential of a single NFb session. Based on cognitive and autonomic controls interfering with attention processes, we hypothesized changes in selective attention after a single SMR-NFb session, along with changes in brain-heart interplay, which are reflected in the multifractality of heartbeat dynamics. Here, young healthy participants (n = 35, 20 females, 21 ± 3 years) were randomly assigned either to a control group (Ctrl) watching a movie or to a neurofeedback (NFb) group performing a single session of SMR-NFb. A headset with EEG electrodes (positioned on C3 and C4) connected to a smartphone app served to guide and to evaluate NFb training efficacy. A Stroop task was performed for 8 min by each group before and after the intervention (movie vs. SMR-NFb) while collecting heart rate variability and C4-EEG for 20 min. When compared to Ctrl, the NFb group exhibited better Stroop performance, especially when facing incongruent trials. The multifractality and NFb training efficacy were identified as strong predictors of the gain in global Stroop performance, while multifractality was the only predictor regarding incongruent trials. We conclude that a single session of SMR-NFb improves selective attention in healthy individuals through the specific reorganization of brain-heart interplay, which is reflected in multifractal heartbeat dynamics.

Altered predictive control during memory suppression in PTSD

Aberrant predictions of future threat lead to maladaptive avoidance in individuals with post-traumatic stress disorder (PTSD). How this disruption in prediction influences the control of memory states orchestrated by the dorsolateral prefrontal cortex is unknown. We combined computational modeling and brain connectivity analyses to reveal how individuals exposed and nonexposed to the 2015 Paris terrorist attacks formed and controlled beliefs about future intrusive re-experiencing implemented in the laboratory during a memory suppression task. Exposed individuals with PTSD used beliefs excessively to control hippocampal activity during the task. When this predictive control failed, the prediction-error associated with unwanted intrusions was poorly downregulated by reactive mechanisms. This imbalance was linked to higher severity of avoidance symptoms, but not to general disturbances such as anxiety or negative affect. Conversely, trauma-exposed participants without PTSD and nonexposed individuals were able to optimally balance predictive and reactive control during the memory suppression task. These findings highlight a potential pathological mechanism occurring in individuals with PTSD rooted in the relationship between the brain’s predictive and control mechanisms.

It remains unclear how predictions of future threat affect memory recall, specifically in the case of post-traumatic stress disorder (PTSD). Here, the authors combined computational modeling and brain connectivity analyses to show that individuals with PTSD have exaggerated predictive control and reduced reactive control in a memory suppression task.

The Neural Bases of Action-Outcome Learning in Humans

From an associative perspective the acquisition of new goal-directed actions requires the encoding of specific action-outcome (AO) associations and, therefore, sensitivity to the validity of an action as a predictor of a specific outcome relative to other events. Although competitive architectures have been proposed within associative learning theory to achieve this kind of identity-based selection, whether and how these architectures are implemented by the brain is still a matter of conjecture. To investigate this issue, we trained human participants to encode various AO associations while undergoing functional neuroimaging (fMRI). We then degraded one AO contingency by increasing the probability of the outcome in the absence of its associated action while keeping other AO contingencies intact. We found that this treatment selectively reduced performance of the degraded action. Furthermore, when a signal predicted the unpaired outcome, performance of the action was restored, suggesting that the degradation effect reflects competition between the action and the context for prediction of the specific outcome. We used a Kalman filter to model the contribution of different causal variables to AO learning and found that activity in the medial prefrontal cortex (mPFC) and the dorsal anterior cingulate cortex (dACC) tracked changes in the association of the action and context, respectively, with regard to the specific outcome. Furthermore, we found the mPFC participated in a network with the striatum and posterior parietal cortex to segregate the influence of the various competing predictors to establish specific AO associations.SIGNIFICANCE STATEMENT Humans and other animals learn the consequences of their actions, allowing them to control their environment in a goal-directed manner. Nevertheless, it is unknown how we parse environmental causes from the effects of our own actions to establish these specific action-outcome (AO) relationships. Here, we show that the brain learns the causal structure of the environment by segregating the unique influence of actions from other causes in the medial prefrontal and anterior cingulate cortices and, through a network of structures, including the caudate nucleus and posterior parietal cortex, establishes the distinct causal relationships from which specific AO associations are formed.

Temporal dynamics of fMRI signal changes during conditioned interoceptive pain-related fear and safety acquisition and extinction

Associative learning and memory mechanisms drive interoceptive signaling along the gut-brain axis, thus shaping affective-emotional reactions and behavior. Specifically, learning to predict potentially harmful, visceral pain is assumed to succeed within very few trials. However, the temporal dynamics of cerebellar and cerebral fMRI signal changes underlying early acquisition and extinction of learned fear signals and the concomitant evolvement of safety learning remain incompletely understood. 3T fMRI data of healthy individuals from three studies were uniformly processed across the whole brain and the cerebellum including an advanced normalizing method of the cerebellum. All studies employed differential delay conditioning (N=94) with one visual cue (CS⁺) being repeatedly paired with visceral pain as unconditioned stimulus (US) while a second cue remained unpaired (CS^-). During subsequent extinction (N=51), all CS were presented without US. Behavioral results revealed increased CS⁺-aversiveness and CS^--pleasantness after conditioning and diminished valence ratings for both CS following extinction. During early acquisition, the CS^- induced linearly increasing neural activation in the insula, midcingulate cortex, hippocampus, precuneus as well as cerebral and cerebellar somatomotor regions. The comparison between acquisition and extinction phases yielded a CS^--induced linear increase in the posterior cingulate cortex and precuneus during early acquisition, while there was no evidence for linear fMRI signal changes for the CS⁺ during acquisition and for both CS during extinction. Based on theoretical accounts of discrimination and temporal difference learning, these results suggest a gradual evolvement of learned safety cues that engage emotional arousal, memory, and cortical modulatory networks. As safety signals are presumably more difficult to learn and to discriminate from learned threat cues, the underlying temporal dynamics may reflect enhanced salience and prediction processing as well as increasing demands for attentional resources and the integration of multisensory information. Maladaptive responses to learned safety signals are a clinically relevant phenotype in multiple conditions, including chronic visceral pain, and can be exceptionally resistant to modification or extinction. Through sustained hypervigilance, safety seeking constitutes one key component in pain and stress-related avoidance behavior, calling for future studies targeting the mechanisms of safety learning and extinction to advance current cognitive-behavioral treatment approaches.

Time pressure changes how people explore and respond to uncertainty

How does time pressure influence exploration and decision-making? We investigated this question with several four-armed bandit tasks manipulating (within subjects) expected reward, uncertainty, and time pressure (limited vs. unlimited). With limited time, people have less opportunity to perform costly computations, thus shifting the cost-benefit balance of different exploration strategies. Through behavioral, reinforcement learning (RL), reaction time (RT), and evidence accumulation analyses, we show that time pressure changes how people explore and respond to uncertainty. Specifically, participants reduced their uncertainty-directed exploration under time pressure, were less value-directed, and repeated choices more often. Since our analyses relate uncertainty to slower responses and dampened evidence accumulation (i.e., drift rates), this demonstrates a resource-rational shift towards simpler, lower-cost strategies under time pressure. These results shed light on how people adapt their exploration and decision-making strategies to externally imposed cognitive constraints.

Serotonin neurons modulate learning rate through uncertainty

Regulating how fast to learn is critical for flexible behavior. Learning about the consequences of actions should be slow in stable environments, but accelerate when that environment changes. Recognizing stability and detecting change are difficult in environments with noisy relationships between actions and outcomes. Under these conditions, theories propose that uncertainty can be used to modulate learning rates ("meta-learning"). We show that mice behaving in a dynamic foraging task exhibit choice behavior that varied as a function of two forms of uncertainty estimated from a meta-learning model. The activity of dorsal raphe serotonin neurons tracked both types of uncertainty in the foraging task as well as in a dynamic Pavlovian task. Reversible inhibition of serotonin neurons in the foraging task reproduced changes in learning predicted by a simulated lesion of meta-learning in the model. We thus provide a quantitative link between serotonin neuron activity, learning, and decision making.

Valence biases in reinforcement learning shift across adolescence and modulate subsequent memory

As individuals learn through trial and error, some are more influenced by good outcomes, while others weight bad outcomes more heavily. Such valence biases may also influence memory for past experiences. Here, we examined whether valence asymmetries in reinforcement learning change across adolescence, and whether individual learning asymmetries bias the content of subsequent memory. Participants ages 8-27 learned the values of 'point machines,' after which their memory for trial-unique images presented with choice outcomes was assessed. Relative to children and adults, adolescents overweighted worse-than-expected outcomes during learning. Individuals' valence biases modulated incidental memory, such that those who prioritized worse- (or better-) than-expected outcomes during learning were also more likely to remember images paired with these outcomes, an effect reproduced in an independent dataset. Collectively, these results highlight age-related changes in the computation of subjective value and demonstrate that a valence-asymmetric valuation process influences how information is prioritized in episodic memory.

Leveraging Spiking Deep Neural Networks to Understand the Neural Mechanisms Underlying Selective Attention

Spatial attention enhances sensory processing of goal-relevant information and improves perceptual sensitivity. Yet, the specific neural mechanisms underlying the effects of spatial attention on performance are still contested. Here, we examine different attention mechanisms in spiking deep convolutional neural networks. We directly contrast effects of precision (internal noise suppression) and two different gain modulation mechanisms on performance on a visual search task with complex real-world images. Unlike standard artificial neurons, biological neurons have saturating activation functions, permitting implementation of attentional gain as gain on a neuron's input or on its outgoing connection. We show that modulating the connection is most effective in selectively enhancing information processing by redistributing spiking activity and by introducing additional task-relevant information, as shown by representational similarity analyses. Precision only produced minor attentional effects in performance. Our results, which mirror empirical findings, show that it is possible to adjudicate between attention mechanisms using more biologically realistic models and natural stimuli.

Computational models of adaptive behavior and prefrontal cortex

The real world is uncertain, and while ever changing, it constantly presents itself in terms of new sets of behavioral options. To attain the flexibility required to tackle these challenges successfully, most mammalian brains are equipped with certain computational abilities that rely on the prefrontal cortex (PFC). By examining learning in terms of internal models associating stimuli, actions, and outcomes, we argue here that adaptive behavior relies on specific interactions between multiple systems including: (1) selective models learning stimulus-action associations through rewards; (2) predictive models learning stimulus- and/or action-outcome associations through statistical inferences anticipating behavioral outcomes; and (3) contextual models learning external cues associated with latent states of the environment. Critically, the PFC combines these internal models by forming task sets to drive behavior and, moreover, constantly evaluates the reliability of actor task sets in predicting external contingencies to switch between task sets or create new ones. We review different models of adaptive behavior to demonstrate how their components map onto this unifying framework and specific PFC regions. Finally, we discuss how our framework may help to better understand the neural computations and the cognitive architecture of PFC regions guiding adaptive behavior.

Short breaks at school: effects of a physical activity and a mindfulness intervention on children's attention, reading comprehension, and self-esteem

BACKGROUND

Although breaks are essential to restoring cognitive and psychological conditions for learning, short breaks within school lessons are not established and the specificity of effects has not often been investigated. Therefore, the effects of a physical activity (Study 1) and a mindfulness intervention (Study 2) were investigated.

PROCEDURE

By an intervention-control group design, the effects of daily 10-min physical activity (Study 1: N = 162, 4th grade) and mindfulness breaks (Study 2: N = 79, 5th grade) were implemented within regular school lessons over a 2-week time period to research the impact on attention, reading comprehension, and self-esteem.

RESULTS

In the physical activity intervention children's attention improved (attention-processing speed: p < .004, η_p² = .05, attention-performance: p < .025, η_p² = .03), and in the mindfulness intervention reading comprehension improved (p < .012, η_p² = .08) compared to the controls. Results further indicated that self-esteem moderated the relationship between groups and attention improvement in study 1.

CONCLUSION

Classroom-based short physical and mindfulness breaks could support attention and reading comprehension, which are known to support overall academic success.

A model for learning based on the joint estimation of stochasticity and volatility

Previous research has stressed the importance of uncertainty for controlling the speed of learning, and how such control depends on the learner inferring the noise properties of the environment, especially volatility: the speed of change. However, learning rates are jointly determined by the comparison between volatility and a second factor, moment-to-moment stochasticity. Yet much previous research has focused on simplified cases corresponding to estimation of either factor alone. Here, we introduce a learning model, in which both factors are learned simultaneously from experience, and use the model to simulate human and animal data across many seemingly disparate neuroscientific and behavioral phenomena. By considering the full problem of joint estimation, we highlight a set of previously unappreciated issues, arising from the mutual interdependence of inference about volatility and stochasticity. This interdependence complicates and enriches the interpretation of previous results, such as pathological learning in individuals with anxiety and following amygdala damage.

Mixing memory and desire: How memory reactivation supports deliberative decision-making

Memories affect nearly every aspect of our mental life. They allow us to both resolve uncertainty in the present and to construct plans for the future. Recently, renewed interest in the role memory plays in adaptive behavior has led to new theoretical advances and empirical observations. We review key findings, with particular emphasis on how the retrieval of many kinds of memories affects deliberative action selection. These results are interpreted in a sequential inference framework, in which reinstatements from memory serve as "samples" of potential action outcomes. The resulting model suggests a central role for the dynamics of memory reactivation in determining the influence of different kinds of memory in decisions. We propose that representation-specific dynamics can implement a bottom-up "product of experts" rule that integrates multiple sets of action-outcome predictions weighted based on their uncertainty. We close by reviewing related findings and identifying areas for further research. This article is categorized under: Psychology > Reasoning and Decision Making Neuroscience > Cognition Neuroscience > Computation.

Selective Attention and Concentration Are Related to Lifestyle in Chilean Schoolchildren

The objective of this investigation was to determine the association between selective attention and concentration with physical fitness (i.e., cardiorespiratory fitness (CRF), V˙O_2max, the standing long jump test (SLJ) and handgrip muscle strength (HGS)), lifestyle parameters (i.e., physical activity (PA) level, screen time (ST), sleep duration and food habits) and anthropometric measures (i.e., body mass index (BMI) and waist circumference (WC)) among Chilean schoolchildren. Two hundred and forty-eight schoolchildren (137 boys, 111 girls, 11.80 ± 1.17 and 11.58 ± 1.09 years, respectively) participated. Selective attention, concentration and lifestyle (PA, ST, sleep duration and Mediterranean diet (MD) adherence) were determined using a standard questionnaire. CRF, SLJ, HGS and anthropometric indicators (BMI and WC) were also measured. Selective attention showed a positive association with MD adherence score (β; 5.012, p = p < 0.05). Concentration was linked inversely to ST (β; −5.498, p = p < 0.05). Likewise, concentration presented a positive association with MD adherence (β; 2.904, p = p < 0.05). In conclusion, children’s lifestyles are related to the selective attention and concentration of children; therefore, promoting healthy habits could be a cost-effective strategy in the promotion of cognitive development, as it relates to selective attention and concentration.

Visual Attention and Lexical Involvement in L1 and L2 Word Processing: Emotional Stroop Effect

Given the fact that the process of engaging and interacting with the text is not only the function of a reader but also the text itself, the current study attempts to examine the role of the type of the word in the attentional engagement. More specifically, the present investigation aims to verify the interplay of sensorimotor information, emotions, and the linguistic information in the word processing. In so doing, for the scale validation, a sample of 220 Iranian English as a Foreign Language (EFL) learners from different language institutes were requested to complete the newly designed Persian and English lexical involvement scales. The results of Structural Equation Modeling (SEM) supported the factor structure and the reliability of the measures. Moreover, using Emotional Stroop task in the experimental set up, the results revealed that there is a strong positive relationship between lexical involvement and visual attentional engagement in L1(Persian). The association was conversely negative in L2 (English). Finally, the statistical analysis indicates that the lexical stimuli differ regarding their magnitude of lexical involvement in L1 and L2.

Neural oscillations underlying selective attention follow sexually divergent developmental trajectories during adolescence

•

A cohort of 9- to 16-year-olds completed a classic flanker task during MEG.

•

There were developmentally-sensitive interference effects in key attention regions.

•

Youth showed sexually-divergent patterns of age-related interference activity.

•

Maturational differences among males supported improved task behavior.

Selective attention processes are critical to everyday functioning and are known to develop through at least young adulthood. Although numerous investigations have studied the maturation of attention systems in the brain, these studies have largely focused on the spatial configuration of these systems; there is a paucity of research on the neural oscillatory dynamics serving selective attention, particularly among youth. Herein, we examined the developmental trajectory of neural oscillatory activity serving selective attention in 53 typically developing youth age 9-to-16 years-old. Participants completed the classic arrow-based flanker task during magnetoencephalography, and the resulting data were imaged in the time-frequency domain. Flanker interference significantly modulated theta and alpha/beta oscillations within prefrontal, mid-cingulate, cuneus, and occipital regions. Interference-related neural activity also increased with age in the temporoparietal junction and the rostral anterior cingulate. Sex-specific effects indicated that females had greater theta interference activity in the anterior insula, whereas males showed differential effects in theta and alpha/beta oscillations across frontoparietal regions. Finally, males showed age-related changes in alpha/beta interference in the cuneus and middle frontal gyrus, which predicted improved behavioral performance. Taken together, these data suggest sexually-divergent developmental trajectories underlying selective attention in youth.

Sequence learning recodes cortical representations instead of strengthening initial ones

We contrast two computational models of sequence learning. The associative learner posits that learning proceeds by strengthening existing association weights. Alternatively, recoding posits that learning creates new and more efficient representations of the learned sequences. Importantly, both models propose that humans act as optimal learners but capture different statistics of the stimuli in their internal model. Furthermore, these models make dissociable predictions as to how learning changes the neural representation of sequences. We tested these predictions by using fMRI to extract neural activity patterns from the dorsal visual processing stream during a sequence recall task. We observed that only the recoding account can explain the similarity of neural activity patterns, suggesting that participants recode the learned sequences using chunks. We show that associative learning can theoretically store only very limited number of overlapping sequences, such as common in ecological working memory tasks, and hence an efficient learner should recode initial sequence representations.

Perceptual Inference, Learning, and Attention in a Multisensory World

Adaptive behavior in a complex, dynamic, and multisensory world poses some of the most fundamental computational challenges for the brain, notably inference, decision-making, learning, binding, and attention. We first discuss how the brain integrates sensory signals from the same source to support perceptual inference and decision-making by weighting them according to their momentary sensory uncertainties. We then show how observers solve the binding or causal inference problem-deciding whether signals come from common causes and should hence be integrated or else be treated independently. Next, we describe the multifarious interplay between multisensory processing and attention. We argue that attentional mechanisms are crucial to compute approximate solutions to the binding problem in naturalistic environments when complex time-varying signals arise from myriad causes. Finally, we review how the brain dynamically adapts multisensory processing to a changing world across multiple timescales.

Human Representation Learning

The central theme of this review is the dynamic interaction between information selection and learning. We pose a fundamental question about this interaction: How do we learn what features of our experiences are worth learning about? In humans, this process depends on attention and memory, two cognitive functions that together constrain representations of the world to features that are relevant for goal attainment. Recent evidence suggests that the representations shaped by attention and memory are themselves inferred from experience with each task. We review this evidence and place it in the context of work that has explicitly characterized representation learning as statistical inference. We discuss how inference can be scaled to real-world decisions by approximating beliefs based on a small number of experiences. Finally, we highlight some implications of this inference process for human decision-making in social environments.

BCI learning induces core-periphery reorganization in M/EEG multiplex brain networks

Brain-computer interfaces (BCIs) constitute a promising tool for communication and control. However, mastering non-invasive closed-loop systems remains a learned skill that is difficult to develop for a non-negligible proportion of users. The involved learning process induces neural changes associated with a brain network reorganization that remains poorly understood. To address this inter-subject variability, we adopted a multilayer approach to integrate brain network properties from electroencephalographic (EEG) and magnetoencephalographic (MEG) data resulting from a four-session BCI training program followed by a group of healthy subjects. Our method gives access to the contribution of each layer to multilayer network that tends to be equal with time. We show that regardless the chosen modality, a progressive increase in the integration of somatosensory areas in the α band was paralleled by a decrease of the integration of visual processing and working memory areas in the β band. Notably, only brain network properties in multilayer network correlated with future BCI scores in the α2 band: positively in somatosensory and decision-making related areas and negatively in associative areas. Our findings cast new light on neural processes underlying BCI training. Integrating multimodal brain network properties provides new information that correlates with behavioral performance and could be considered as a potential marker of BCI learning.

Modulation of Dopamine for Adaptive Learning: A Neurocomputational Model

There have been many proposals that learning rates in the brain are adaptive, in the sense that they increase or decrease depending on environmental conditions. The majority of these models are abstract and make no attempt to describe the neural circuitry that implements the proposed computations. This article describes a biologically detailed computational model that overcomes this shortcoming. Specifically, we propose a neural circuit that implements adaptive learning rates by modulating the gain on the dopamine response to reward prediction errors, and we model activity within this circuit at the level of spiking neurons. The model generates a dopamine signal that depends on the size of the tonically active dopamine neuron population and the phasic spike rate. The model was tested successfully against results from two single-neuron recording studies and a fast-scan cyclic voltammetry study. We conclude by discussing the general applicability of the model to dopamine mediated tasks that transcend the experimental phenomena it was initially designed to address.