The Bayesian brain: the role of uncertainty in neural coding and computation

Computation noise promotes zero-shot adaptation to uncertainty during decision-making in artificial neural networks

Random noise in information processing systems is widely seen as detrimental to function. But despite the large trial-to-trial variability of neural activity, humans show a remarkable adaptability to conditions with uncertainty during goal-directed behavior. The origin of this cognitive ability, constitutive of general intelligence, remains elusive. Here, we show that moderate levels of computation noise in artificial neural networks promote zero-shot generalization for decision-making under uncertainty. Unlike networks featuring noise-free computations, but like human participants tested on similar decision problems (ranging from probabilistic reasoning to reversal learning), noisy networks exhibit behavioral hallmarks of optimal inference in uncertain conditions entirely unseen during training. Computation noise enables this cognitive ability jointly through "structural" regularization of network weights during training and "functional" regularization by shaping the stochastic dynamics of network activity after training. Together, these findings indicate that human cognition may ride on neural variability to support adaptive decisions under uncertainty without extensive experience or engineered sophistication.

Interoceptive inference and prediction in food-related disorders

The brain's capacity to predict and anticipate changes in internal and external environments is fundamental to initiating efficient adaptive responses, behaviors, and reflexes that minimize disruptions to physiology. In the context of feeding control, the brain predicts and anticipates responses to the consumption of dietary substances, thus driving adaptive behaviors in the form of food choices, physiological preparation for meals, and engagement of defensive mechanisms. Here, we provide an integrative perspective on the multisensory computation between exteroceptive and interoceptive cues that guides feeding strategy and may result in food-related disorders.

Distinct neural pathway and its information flow for blind individual's Braille reading

Natural Braille reading presents significant challenges to the brain networks of late blind individuals, yet its underlying neural mechanisms remain largely unexplored. Using natural Braille texts in behavioral assessments and functional MRI, we sought to pinpoint the neural pathway and information flow crucial for Braille reading performance in late blind individuals. In the resting state, we discovered a unique neural connection between the higher-order 'visual' cortex, the lateral occipital cortex (LOC), and the inferior frontal cortex (IFC) in late blind individuals, but not in sighted controls. The left-lateralized LOC-IFC connectivity was correlated with individual Braille reading proficiency. Prolonged Braille reading practice led to increased strength of this connectivity. During a natural Braille reading task, bidirectional information flow between the LOC and the IFC was positively modulated, with a predominantly stronger top-down modulation from the IFC to the LOC. This stronger top-down modulation contributed to higher Braille reading proficiency. We thus proposed a two-predictor multiple regression model to predict individual Braille reading proficiency, incorporating both static connectivity and dynamic top-down communication between the LOC-IFC link. This work highlights the dual contributions of the occipito-frontal neural pathway and top-down cognitive strategy to superior natural Braille reading performance, offering guidance for training late blind individuals.

Expectation generation and its effect on subsequent pain and visual perception

Bayesian accounts of perception, such as predictive processing, suggest that perceptions integrate expectations and sensory experience, and thus assimilate to expected values. Furthermore, more precise expectations should have stronger influences on perception. We tested these hypotheses in a paradigm that manipulates both the mean value and the precision of cues within-person. Forty-five participants observed cues-presented as ratings from 10 previous participants-with varying cue means, variances (precision), and skewness across trials. Participants reported expectations regarding the painfulness of thermal stimuli or the visual contrast of flickering checkerboards. Subsequently, similar cues were each followed by a visual or noxious thermal stimulus. While perceptions assimilated to expected values in both modalities, cues' precision mainly affected visual ratings. Furthermore, behavioral and computational models revealed that expectations were biased towards extreme values in both modalities, and towards low-pain cues specifically. fMRI analysis revealed that the cues affected systems related to higher-level affective and cognitive processes-including assimilation to the cue mean in a neuromarker of endogenous contributions to pain and in the nucleus accumbens, and activity consistent with aversive prediction-error-like encoding in the periaqueductal gray during pain perception-but not systems related to early perceptual processing. Our findings suggest that predictive processing theories should be combined with mechanisms such as selective attention to better fit empirical findings, and that expectation generation and its perceptual effects are mostly modality-specific and operate on higher-level processes rather than early perception.

No evidence for a difference in Bayesian reasoning for egocentric versus allocentric spatial cognition

Bayesian reasoning (i.e. prior integration, cue combination, and loss minimization) has emerged as a prominent model for some kinds of human perception and cognition. The major theoretical issue is that we do not yet have a robust way to predict when we will or will not observe Bayesian effects in human performance. Here we tested a proposed divide in terms of Bayesian reasoning for egocentric spatial cognition versus allocentric spatial cognition (self-centered versus world-centred). The proposal states that people will show stronger Bayesian reasoning effects when it is possible to perform the Bayesian calculations within the egocentric frame, as opposed to requiring an allocentric frame. Three experiments were conducted with one egocentric-allowing condition and one allocentric-requiring condition but otherwise matched as closely as possible. No difference was found in terms of prior integration (Experiment 1), cue combination (Experiment 2), or loss minimization (Experiment 3). The contrast in previous reports, where Bayesian effects are present in many egocentric-allowing tasks while they are absent in many allocentric-requiring tasks, is likely due to other differences between the tasks-for example, the way allocentric-requiring tasks are often more complex and memory intensive.

Bayesian inference by visuomotor neurons in prefrontal cortex

Perceptual judgements of the environment emerge from the concerted activity of neural populations in decision-making areas downstream of sensory cortex [1, 2, 3]. When the sensory input is ambiguous, perceptual judgements can be biased by prior expectations shaped by environmental regularities [4, 5, 6, 7, 8, 9,10,11]. These effects are examples of Bayesian inference, a reasoning method in which prior knowledge is leveraged to optimize uncertain decisions [12, 13]. However, it is not known how decision-making circuits combine sensory signals and prior expectations to form a perceptual decision. Here, we study neural population activity in the prefrontal cortex of macaque monkeys trained to report perceptual judgments of ambiguous visual stimuli under two different stimulus distributions. We analyze the component of the neural population response that represents the formation of the perceptual decision (the decision variable, DV), and find that its dynamical evolution reflects the integration of sensory signals and prior expectations. Prior expectations impact the DV's trajectory both before and during stimulus presentation such that DV trajectories with a smaller dynamic range result in more biased and less sensitive perceptual decisions. These results reveal a mechanism by which prefrontal circuits can execute Bayesian inference.

Transformers and cortical waves: encoders for pulling in context across time

The capabilities of transformer networks such as ChatGPT and other large language models (LLMs) have captured the world's attention. The crucial computational mechanism underlying their performance relies on transforming a complete input sequence - for example, all the words in a sentence - into a long 'encoding vector' that allows transformers to learn long-range temporal dependencies in naturalistic sequences. Specifically, 'self-attention' applied to this encoding vector enhances temporal context in transformers by computing associations between pairs of words in the input sequence. We suggest that waves of neural activity traveling across single cortical areas, or multiple regions on the whole-brain scale, could implement a similar encoding principle. By encapsulating recent input history into a single spatial pattern at each moment in time, cortical waves may enable a temporal context to be extracted from sequences of sensory inputs, the same computational principle as that used in transformers.

Learning probability distributions of sensory inputs with Monte Carlo predictive coding

It has been suggested that the brain employs probabilistic generative models to optimally interpret sensory information. This hypothesis has been formalised in distinct frameworks, focusing on explaining separate phenomena. On one hand, classic predictive coding theory proposed how the probabilistic models can be learned by networks of neurons employing local synaptic plasticity. On the other hand, neural sampling theories have demonstrated how stochastic dynamics enable neural circuits to represent the posterior distributions of latent states of the environment. These frameworks were brought together by variational filtering that introduced neural sampling to predictive coding. Here, we consider a variant of variational filtering for static inputs, to which we refer as Monte Carlo predictive coding (MCPC). We demonstrate that the integration of predictive coding with neural sampling results in a neural network that learns precise generative models using local computation and plasticity. The neural dynamics of MCPC infer the posterior distributions of the latent states in the presence of sensory inputs, and can generate likely inputs in their absence. Furthermore, MCPC captures the experimental observations on the variability of neural activity during perceptual tasks. By combining predictive coding and neural sampling, MCPC can account for both sets of neural data that previously had been explained by these individual frameworks.

Effective Connectivity Network of Aberrant Prediction Error Processing in Auditory Phantom Perception

Introduction: Prediction error (PE) is key to perception in the predictive coding framework. However, previous studies indicated the varied neural activities evoked by PE in tinnitus patients. Here, we aimed to reconcile the conflict by (1) a more nuanced view of PE, which could be driven by changing stimulus (stimulus-driven PE [sPE]) and violation of current context (context-driven PE [cPE]) and (2) investigating the aberrant connectivity networks that are engaged in the processing of the two types of PEs in tinnitus patients. Methods: Ten tinnitus patients with normal hearing and healthy controls were recruited, and a local-global auditory oddball paradigm was applied to measure the electroencephalographic difference between the two groups during sPE and cPE conditions. Results: Overall, the sPE condition engaged bottom-up and top-down connections, whereas the cPE condition engaged mostly top-down connections. The tinnitus group showed decreased sensitivity to the sPE and increased sensitivity to the cPE condition. Particularly, the auditory cortex and posterior cingulate cortex were the hubs for processing cPE in the control and tinnitus groups, respectively, showing the orientation to an internal state in tinnitus. Furthermore, tinnitus patients showed stronger connectivity to the parahippocampus and pregenual anterior cingulate cortex for the establishment of the prediction during the cPE condition. Conclusion: These results begin to dissect the role of changes in stimulus characteristics versus changes in the context of processing the same stimulus in mechanisms of tinnitus generation. Impact Statement This study delves into the number dynamics of prediction error (PE) in tinnitus, proposing a dual framework distinguishing between stimulus-driven PE (sPE) and context-driven PE (cPE). Electroencephalographic data from tinnitus patients and controls revealed distinct connectivity patterns during sPE and cPE conditions. Tinnitus patients exhibited reduced sensitivity to sPE and increased sensitivity to cPE. The auditory cortex and posterior cingulate cortex emerged as pivotal regions for cPE processing in controls and tinnitus patients, indicative of an internal state orientation in tinnitus. Enhanced connectivity to the parahippocampus and pregenual anterior cingulate cortex underscores the role of context in tinnitus pathophysiology.

Demystifying unsupervised learning: how it helps and hurts

Humans and machines rarely have access to explicit external feedback or supervision, yet manage to learn. Most modern machine learning systems succeed because they benefit from unsupervised data. Humans are also expected to benefit and yet, mysteriously, empirical results are mixed. Does unsupervised learning help humans or not? Here, we argue that the mixed results are not conflicting answers to this question, but reflect that humans self-reinforce their predictions in the absence of supervision, which can help or hurt depending on whether predictions and task align. We use this framework to synthesize empirical results across various domains to clarify when unsupervised learning will help or hurt. This provides new insights into the fundamentals of learning with implications for instruction and lifelong learning.

Dynamical predictive coding with reservoir computing performs noise-robust multi-sensory speech recognition

Multi-sensory integration is a perceptual process through which the brain synthesizes a unified perception by integrating inputs from multiple sensory modalities. A key issue is understanding how the brain performs multi-sensory integrations using a common neural basis in the cortex. A cortical model based on reservoir computing has been proposed to elucidate the role of recurrent connectivity among cortical neurons in this process. Reservoir computing is well-suited for time series processing, such as speech recognition. This inquiry focuses on extending a reservoir computing-based cortical model to encompass multi-sensory integration within the cortex. This research introduces a dynamical model of multi-sensory speech recognition, leveraging predictive coding combined with reservoir computing. Predictive coding offers a framework for the hierarchical structure of the cortex. The model integrates reliability weighting, derived from the computational theory of multi-sensory integration, to adapt to multi-sensory time series processing. The model addresses a multi-sensory speech recognition task, necessitating the management of complex time series. We observed that the reservoir effectively recognizes speech by extracting time-contextual information and weighting sensory inputs according to sensory noise. These findings indicate that the dynamic properties of recurrent networks are applicable to multi-sensory time series processing, positioning reservoir computing as a suitable model for multi-sensory integration.

Rats rely on airflow cues for self-motion perception

Self-motion perception is a vital skill for all species. It is an inherently multisensory process that combines inertial (body-based) and relative (with respect to the environment) motion cues. Although extensively studied in human and non-human primates, there is currently no paradigm to test self-motion perception in rodents using both inertial and relative self-motion cues. We developed a novel rodent motion simulator using two synchronized robotic arms to generate inertial, relative, or combined (inertial and relative) cues of self-motion. Eight rats were trained to perform a task of heading discrimination, similar to the popular primate paradigm. Strikingly, the rats relied heavily on airflow for relative self-motion perception, with little contribution from the (limited) optic flow cues provided-performance in the dark was almost as good. Relative self-motion (airflow) was perceived with greater reliability vs. inertial. Disrupting airflow, using a fan or windshield, damaged relative, but not inertial, self-motion perception. However, whiskers were not needed for this function. Lastly, the rats integrated relative and inertial self-motion cues in a reliability-based (Bayesian-like) manner. These results implicate airflow as an important cue for self-motion perception in rats and provide a new domain to investigate the neural bases of self-motion perception and multisensory processing in awake behaving rodents.

Microenvironmental entropy dynamics analysis reveals novel insights into Notch-Delta-Jagged decision-making mechanism

Notch-Delta-Jagged (NDJ) signaling among neighboring cells contributes crucially to spatiotemporal pattern formation and developmental decision-making. Despite numerous detailed mathematical models, their high-dimensionality parametric space limits analytical treatment, especially regarding local microenvironmental fluctuations. Using the low-dimensional dynamics of the recently postulated least microenvironmental uncertainty principle (LEUP) framework, we showcase how the LEUP formalism recapitulates a noisy NDJ spatial patterning. Our LEUP simulations show that local phenotypic entropy increases for lateral inhibition but decreases for lateral induction. This distinction allows us to identify a critical parameter that captures the transition from a Notch-Delta-driven lateral inhibition to a Notch-Jagged-driven lateral induction phenomenon and suggests random phenotypic patterning in the case of lack of dominance of either Notch-Delta or Notch-Jagged signaling. Our results enable an analytical treatment to map the high-dimensional dynamics of NDJ signaling on tissue-level patterning and can possibly be generalized to decode operating principles of collective cellular decision-making.

Electrical Signaling Beyond Neurons

Neural action potentials (APs) are difficult to interpret as signal encoders and/or computational primitives. Their relationships with stimuli and behaviors are obscured by the staggering complexity of nervous systems themselves. We can reduce this complexity by observing that "simpler" neuron-less organisms also transduce stimuli into transient electrical pulses that affect their behaviors. Without a complicated nervous system, APs are often easier to understand as signal/response mechanisms. We review examples of nonneural stimulus transductions in domains of life largely neglected by theoretical neuroscience: bacteria, protozoans, plants, fungi, and neuron-less animals. We report properties of those electrical signals-for example, amplitudes, durations, ionic bases, refractory periods, and particularly their ecological purposes. We compare those properties with those of neurons to infer the tasks and selection pressures that neurons satisfy. Throughout the tree of life, nonneural stimulus transductions time behavioral responses to environmental changes. Nonneural organisms represent the presence or absence of a stimulus with the presence or absence of an electrical signal. Their transductions usually exhibit high sensitivity and specificity to a stimulus, but are often slow compared to neurons. Neurons appear to be sacrificing the specificity of their stimulus transductions for sensitivity and speed. We interpret cellular stimulus transductions as a cell's assertion that it detected something important at that moment in time. In particular, we consider neural APs as fast but noisy detection assertions. We infer that a principal goal of nervous systems is to detect extremely weak signals from noisy sensory spikes under enormous time pressure. We discuss neural computation proposals that address this goal by casting neurons as devices that implement online, analog, probabilistic computations with their membrane potentials. Those proposals imply a measurable relationship between afferent neural spiking statistics and efferent neural membrane electrophysiology.

Lower confidence and increased error sensitivity in OCD patients while learning under volatility

A decoupling between confidence and action could relate to compulsive behaviour as seen in obsessive-compulsive disorder (OCD). The link between confidence and action in OCD has been investigated in clinical case-control studies and in the general population with discrepant findings. The generalizability of findings from highly-compulsive general population samples to clinical OCD samples has been questioned. Here, we investigate action-confidence coupling for 38 OCD patients compared to 37 healthy controls (HC), using a predictive inference task. We compared those results to a comparison between matched high and low compulsive individuals from the general population. Action-updating, confidence and their coupling were compared between the groups. Moreover, computational modeling was performed to compare groups on error sensitivity and environmental parameters. OCD patients showed lower confidence and higher learning rates in reaction to (small) prediction errors than HC, signaling hyperactive error signaling and lower confidence estimation. No evidence was found for differences in action-confidence coupling between groups. In contrast high the compulsive group showed higher confidence and stronger decoupling than the low compulsive group, both of which were related to symptoms. The underlying mechanisms of obsessive-compulsive behaviour might differ between clinical and highly-compulsive general population samples, resulting in different (meta)cognitive profiles.

A computational account of the development and evolution of psychotic symptoms

The mechanisms of psychotic symptoms like hallucinations and delusions are often investigated in fully-formed illness, well after symptoms emerge. These investigations have yielded key insights, but are not well-positioned to reveal the dynamic forces underlying symptom formation itself. Understanding symptom development over time would allow us to identify steps in the pathophysiological process leading to psychosis, shifting the focus of psychiatric intervention from symptom alleviation to prevention. We propose a model for understanding the emergence of psychotic symptoms within the context of an adaptive, developing neural system. We will make the case for a pathophysiological process that begins with cortical hyperexcitability and bottom-up noise transmission, which engenders inappropriate belief formation via aberrant prediction error signaling. We will argue that this bottom-up noise drives learning about the (im)precision of new incoming sensory information because of diminished signal-to-noise ratio, causing a compensatory relative over-reliance on prior beliefs. This over-reliance on priors predisposes to hallucinations and covaries with hallucination severity. An over-reliance on priors may also lead to increased conviction in the beliefs generated by bottom-up noise and drive movement toward conversion to psychosis. We will identify predictions of our model at each stage, examine evidence to support or refute those predictions, and propose experiments that could falsify or help select between alternative elements of the overall model. Nesting computational abnormalities within longitudinal development allows us to account for hidden dynamics among the mechanisms driving symptom formation and to view established symptomatology as a point of equilibrium among competing biological forces.

A Bayesian inference model can predict the effects of attention on the serial dependence in heading estimation from optic flow

It has been demonstrated that observers can accurately estimate their self-motion direction (i.e., heading) from optic flow, which can be affected by attention. However, it remains unclear how attention affects the serial dependence in the estimation. In the current study, participants conducted two experiments. The results showed that the estimation accuracy decreased when attentional resources allocated to the heading estimation task were reduced. Additionally, the estimates of currently presented headings were biased toward the headings of previously seen headings, showing serial dependence. Especially, this effect decreased (increased) when the attentional resources allocated to the previously (currently) seen headings were reduced. Furthermore, importantly, we developed a Bayesian inference model, which incorporated attention-modulated likelihoods and qualitatively predicted changes in the estimation accuracy and serial dependence. In summary, the current study shows that attention affects the serial dependence in heading estimation from optic flow and reveals the Bayesian computational mechanism behind the heading estimation.

Temporal stability of Bayesian belief updating in perceptual decision-making

Bayesian inference suggests that perception is inferred from a weighted integration of prior contextual beliefs with current sensory evidence (likelihood) about the world around us. The perceived precision or uncertainty associated with prior and likelihood information is used to guide perceptual decision-making, such that more weight is placed on the source of information with greater precision. This provides a framework for understanding a spectrum of clinical transdiagnostic symptoms associated with aberrant perception, as well as individual differences in the general population. While behavioral paradigms are commonly used to characterize individual differences in perception as a stable characteristic, measurement reliability in these behavioral tasks is rarely assessed. To remedy this gap, we empirically evaluate the reliability of a perceptual decision-making task that quantifies individual differences in Bayesian belief updating in terms of the relative precision weighting afforded to prior and likelihood information (i.e., sensory weight). We analyzed data from participants (n = 37) who performed this task twice. We found that the precision afforded to prior and likelihood information showed high internal consistency and good test-retest reliability (ICC = 0.73, 95% CI [0.53, 0.85]) when averaged across participants, as well as at the individual level using hierarchical modeling. Our results provide support for the assumption that Bayesian belief updating operates as a stable characteristic in perceptual decision-making. We discuss the utility and applicability of reliable perceptual decision-making paradigms as a measure of individual differences in the general population, as well as a diagnostic tool in psychiatric research.

Is Anticipation Skill Learning Bayesian?

Purpose: The aims of this study were to examine the learning of anticipation skill in the presence of kinematic and outcome probabilities information, and to see if this learning exhibited characteristics of Bayesian integration. Method: Participants with no competitive tennis playing experience watched tennis player stimuli playing forehand tennis shots and were tasked with predicted shot outcomes. Accuracy, response times and perceived task effort were recorded, pre, post and during four acquisition blocks where outcome feedback was provided. In both Experiment 1 and 2, kinematic information about shot direction was either present in the training group stimuli or absent. In Experiment 1, left/right shot probability information remained equi-probable for both groups. In Experiment 2, both groups also trained with a bias in the shot outcome probability toward one shot direction on 80% of the trials across acquisition blocks (and were not told about this manipulation). Results: Pre-to-post anticipation performance improved in the presence of kinematic (EXP 1) or both information sources (EXP 2). Pre-to-post improvements in the presence of shot outcome probability information were congruent with the bias in the shot direction trained (EXP 2). Superior anticipation performance was found when both information sources were present. The presence of kinematic information resulted in increased perceived effort during early training (EXP 1 & 2). Bayesian odds ratios indicated that shot direction probabilities and kinematic information were integrated during anticipation skill learning. Conclusion: Learning with shot direction probabilities and kinematic information shows characteristics of Bayesian integration.

Multisensory perceptual and causal inference is largely preserved in medicated post-acute individuals with schizophrenia

Hallucinations and perceptual abnormalities in psychosis are thought to arise from imbalanced integration of prior information and sensory inputs. We combined psychophysics, Bayesian modeling, and electroencephalography (EEG) to investigate potential changes in perceptual and causal inference in response to audiovisual flash-beep sequences in medicated individuals with schizophrenia who exhibited limited psychotic symptoms. Seventeen participants with schizophrenia and 23 healthy controls reported either the number of flashes or the number of beeps of audiovisual sequences that varied in their audiovisual numeric disparity across trials. Both groups balanced sensory integration and segregation in line with Bayesian causal inference rather than resorting to simpler heuristics. Both also showed comparable weighting of prior information regarding the signals' causal structure, although the schizophrenia group slightly overweighted prior information about the number of flashes or beeps. At the neural level, both groups computed Bayesian causal inference through dynamic encoding of independent estimates of the flash and beep counts, followed by estimates that flexibly combine audiovisual inputs. Our results demonstrate that the core neurocomputational mechanisms for audiovisual perceptual and causal inference in number estimation tasks are largely preserved in our limited sample of medicated post-acute individuals with schizophrenia. Future research should explore whether these findings generalize to unmedicated patients with acute psychotic symptoms.

A Broken Duet: Multistable Dynamics in Dyadic Interactions

Misunderstandings in dyadic interactions often persist despite our best efforts, particularly between native and non-native speakers, resembling a broken duet that refuses to harmonise. This paper delves into the computational mechanisms underpinning these misunderstandings through the lens of the broken Lorenz system-a continuous dynamical model. By manipulating a specific parameter regime, we induce bistability within the Lorenz equations, thereby confining trajectories to distinct attractors based on initial conditions. This mirrors the persistence of divergent interpretations that often result in misunderstandings. Our simulations reveal that differing prior beliefs between interlocutors result in misaligned generative models, leading to stable yet divergent states of understanding when exposed to the same percept. Specifically, native speakers equipped with precise (i.e., overconfident) priors expect inputs to align closely with their internal models, thus struggling with unexpected variations. Conversely, non-native speakers with imprecise (i.e., less confident) priors exhibit a greater capacity to adjust and accommodate unforeseen inputs. Our results underscore the important role of generative models in facilitating mutual understanding (i.e., establishing a shared narrative) and highlight the necessity of accounting for multistable dynamics in dyadic interactions.

Chronic pain - A maladaptive compensation to unbalanced hierarchical predictive processing

The ability to perceive pain presents an interesting evolutionary advantage to adapt to an ever-changing environment. However, in the case of chronic pain (CP), pain perception hinders the capacity of the system to adapt to changing sensory environments. Similar to other chronic perceptual disorders, CP is also proposed to be a maladaptive compensation to aberrant sensory predictive processing. The local-global oddball paradigm relies on learning hierarchical rules and processing environmental irregularities at a local and global level. Prediction errors (PE) between actual and predicted input typically trigger an update of the forward model to limit the probability of encountering future PEs. It has been hypothesised that CP hinders forward model updating, reflected in increased local deviance and decreased global deviance. In the present study, we used the local-global paradigm to examine how CP influences hierarchical learning relative to healthy controls. As hypothesised, we observed that deviance in the stimulus characteristics evoked heightened local deviance and decreased global deviance of the stimulus-driven PE. This is also accompanied by respective changes in theta phase locking that is correlated with the subjective pain perception. Changes in the global deviant in the stimulus-driven-PE could also be explained by dampened attention-related responses. Changing the context of the auditory stimulus did not however show a difference in the context-driven PE. These findings suggest that CP is accompanied by maladaptive forward model updating where the constant presence of pain perception disrupts local deviance in non-nociceptive domains. Furthermore, we hypothesise that the auditory-processing based biomarker identified here could be a marker of domain-general dysfunction that could be confirmed by future research.

Comprehensive investigation of predictive processing: A cross- and within-cognitive domains fMRI meta-analytic approach

Predictive processing (PP) stands as a predominant theoretical framework in neuroscience. While some efforts have been made to frame PP within a cognitive domain-general network perspective, suggesting the existence of a "prediction network," these studies have primarily focused on specific cognitive domains or functions. The question of whether a domain-general predictive network that encompasses all well-established cognitive domains exists remains unanswered. The present meta-analysis aims to address this gap by testing the hypothesis that PP relies on a large-scale network spanning across cognitive domains, supporting PP as a unified account toward a more integrated approach to neuroscience. The Activation Likelihood Estimation meta-analytic approach was employed, along with Meta-Analytic Connectivity Mapping, conjunction analysis, and behavioral decoding techniques. The analyses focused on prediction incongruency and prediction congruency, two conditions likely reflective of core phenomena of PP. Additionally, the analysis focused on a prediction phenomena-independent dimension, regardless of prediction incongruency and congruency. These analyses were first applied to each cognitive domain considered (cognitive control, attention, motor, language, social cognition). Then, all cognitive domains were collapsed into a single, cross-domain dimension, encompassing a total of 252 experiments. Results pertaining to prediction incongruency rely on a defined network across cognitive domains, while prediction congruency results exhibited less overall activation and slightly more variability across cognitive domains. The converging patterns of activation across prediction phenomena and cognitive domains highlight the role of several brain hubs unfolding within an organized large-scale network (Dynamic Prediction Network), mainly encompassing bilateral insula, frontal gyri, claustrum, parietal lobules, and temporal gyri. Additionally, the crucial role played at a cross-domain, multimodal level by the anterior insula, as evidenced by the conjunction and Meta-Analytic Connectivity Mapping analyses, places it as the major hub of the Dynamic Prediction Network. Results support the hypothesis that PP relies on a domain-general, large-scale network within whose regions PP units are likely to operate, depending on the context and environmental demands. The wide array of regions within the Dynamic Prediction Network seamlessly integrate context- and stimulus-dependent predictive computations, thereby contributing to the adaptive updating of the brain's models of the inner and external world.

Crossmodal hierarchical predictive coding for audiovisual sequences in the human brain

Predictive coding theory suggests the brain anticipates sensory information using prior knowledge. While this theory has been extensively researched within individual sensory modalities, evidence for predictive processing across sensory modalities is limited. Here, we examine how crossmodal knowledge is represented and learned in the brain, by identifying the hierarchical networks underlying crossmodal predictions when information of one sensory modality leads to a prediction in another modality. We record electroencephalogram (EEG) during a crossmodal audiovisual local-global oddball paradigm, in which the predictability of transitions between tones and images are manipulated at both the stimulus and sequence levels. To dissect the complex predictive signals in our EEG data, we employed a model-fitting approach to untangle neural interactions across modalities and hierarchies. The model-fitting result demonstrates that audiovisual integration occurs at both the levels of individual stimulus interactions and multi-stimulus sequences. Furthermore, we identify the spatio-spectro-temporal signatures of prediction-error signals across hierarchies and modalities, and reveal that auditory and visual prediction errors are rapidly redirected to the central-parietal electrodes during learning through alpha-band interactions. Our study suggests a crossmodal predictive coding mechanism where unimodal predictions are processed by distributed brain networks to form crossmodal knowledge.

Signatures of Bayesian inference emerge from energy-efficient synapses

Biological synaptic transmission is unreliable, and this unreliability likely degrades neural circuit performance. While there are biophysical mechanisms that can increase reliability, for instance by increasing vesicle release probability, these mechanisms cost energy. We examined four such mechanisms along with the associated scaling of the energetic costs. We then embedded these energetic costs for reliability in artificial neural networks (ANNs) with trainable stochastic synapses, and trained these networks on standard image classification tasks. The resulting networks revealed a tradeoff between circuit performance and the energetic cost of synaptic reliability. Additionally, the optimised networks exhibited two testable predictions consistent with pre-existing experimental data. Specifically, synapses with lower variability tended to have (1) higher input firing rates and (2) lower learning rates. Surprisingly, these predictions also arise when synapse statistics are inferred through Bayesian inference. Indeed, we were able to find a formal, theoretical link between the performance-reliability cost tradeoff and Bayesian inference. This connection suggests two incompatible possibilities: evolution may have chanced upon a scheme for implementing Bayesian inference by optimising energy efficiency, or alternatively, energy-efficient synapses may display signatures of Bayesian inference without actually using Bayes to reason about uncertainty.

Leveraging Tendon Vibration to Enhance Pseudo-Haptic Perceptions in VR

Pseudo-haptic techniques are used to modify haptic perception by appropriately changing visual feedback to body movements. Based on the knowledge that tendon vibration can affect our somatosensory perception, this article proposes a method for leveraging tendon vibration to enhance pseudo-haptics during free arm motion. Three experiments were performed to examine the impact of tendon vibration on the range and resolution of pseudo-haptics. The first experiment investigated the effect of tendon vibration on the detection threshold of the discrepancy between visual and physical motion. The results indicated that vibrations applied to the inner tendons of the wrist and elbow increased the threshold, suggesting that tendon vibration can augment the applicable visual motion gain by approximately 13% without users detecting the visual/physical discrepancy. Furthermore, the results demonstrate that tendon vibration acts as noise on haptic motion cues. The second experiment assessed the impact of tendon vibration on the resolution of pseudo-haptics by determining the just noticeable difference in pseudo-weight perception. The results suggested that the tendon vibration does not largely compromise the resolution of pseudo-haptics. The third experiment evaluated the equivalence between the weight perception triggered by tendon vibration and that by visual motion gain, that is, the point of subjective equality. The results revealed that vibration amplifies the weight perception and its effect was equivalent to that obtained using a gain of 0.64 without vibration, implying that the tendon vibration also functions as an additional haptic cue. Our results provide design guidelines and future work for enhancing pseudo-haptics with tendon vibration.

Understanding music and aging through the lens of Bayesian inference

Bayesian inference has recently gained momentum in explaining music perception and aging. A fundamental mechanism underlying Bayesian inference is the notion of prediction. This framework could explain how predictions pertaining to musical (melodic, rhythmic, harmonic) structures engender action, emotion, and learning, expanding related concepts of music research, such as musical expectancies, groove, pleasure, and tension. Moreover, a Bayesian perspective of music perception may shed new insights on the beneficial effects of music in aging. Aging could be framed as an optimization process of Bayesian inference. As predictive inferences refine over time, the reliance on consolidated priors increases, while the updating of prior models through Bayesian inference attenuates. This may affect the ability of older adults to estimate uncertainties in their environment, limiting their cognitive and behavioral repertoire. With Bayesian inference as an overarching framework, this review synthesizes the literature on predictive inferences in music and aging, and details how music could be a promising tool in preventive and rehabilitative interventions for older adults through the lens of Bayesian inference.

Developing a tablet-based brain-computer interface and robotic prototype for upper limb rehabilitation

Background

The current study explores the integration of a motor imagery (MI)-based BCI system with robotic rehabilitation designed for upper limb function recovery in stroke patients.

Methods

We developed a tablet deployable BCI control of the virtual iTbot for ease of use. Twelve right-handed healthy adults participated in this study, which involved a novel BCI training approach incorporating tactile vibration stimulation during MI tasks. The experiment utilized EEG signals captured via a gel-free cap, processed through various stages including signal verification, training, and testing. The training involved MI tasks with concurrent vibrotactile stimulation, utilizing common spatial pattern (CSP) training and linear discriminant analysis (LDA) for signal classification. The testing stage introduced a real-time feedback system and a virtual game environment where participants controlled a virtual iTbot robot.

Results

Results showed varying accuracies in motor intention detection across participants, with an average true positive rate of 63.33% in classifying MI signals.

Discussion

The study highlights the potential of MI-based BCI in robotic rehabilitation, particularly in terms of engagement and personalization. The findings underscore the feasibility of BCI technology in rehabilitation and its potential use for stroke survivors with upper limb dysfunctions.

Erroneous predictive coding across brain hierarchies in a non-human primate model of autism spectrum disorder

In autism spectrum disorder (ASD), atypical sensory experiences are often associated with irregularities in predictive coding, which proposes that the brain creates hierarchical sensory models via a bidirectional process of predictions and prediction errors. However, it remains unclear how these irregularities manifest across different functional hierarchies in the brain. To address this, we study a marmoset model of ASD induced by valproic acid (VPA) treatment. We record high-density electrocorticography (ECoG) during an auditory task with two layers of temporal control, and applied a quantitative model to quantify the integrity of predictive coding across two distinct hierarchies. Our results demonstrate a persistent pattern of sensory hypersensitivity and unstable predictions across two brain hierarchies in VPA-treated animals, and reveal the associated spatio-spectro-temporal neural signatures. Despite the regular occurrence of imprecise predictions in VPA-treated animals, we observe diverse configurations of underestimation or overestimation of sensory regularities within the hierarchies. Our results demonstrate the coexistence of the two primary Bayesian accounts of ASD: overly-precise sensory observations and weak prior beliefs, and offer a potential multi-layered biomarker for ASD, which could enhance our understanding of its diverse symptoms.

The role of perceptual processing in the oddball effect revealed by the Thatcher illusion

When a novel stimulus (oddball) appears after repeated presentation of an identical stimulus, the oddball is perceived to last longer than the repeated stimuli, a phenomenon known as the oddball effect. We investigated whether the perceptual or physical differences between the repeated and oddball stimuli are more important for the oddball effect. To manipulate the perceptual difference while keeping their physical visual features constant, we used the Thatcher illusion, in which an inversion of a face hinders recognition of distortion in its facial features. We found that the Thatcherized face presented after repeated presentation of an intact face induced a stronger oddball effect when the faces were upright than when they were inverted (Experiment 1). However, the difference in the oddball effect between face orientations was not observed when the intact face was presented as the oddball after repeated presentation of a Thatcherized face (Experiment 2). These results were replicated when participants performed both the intact-repeated and Thatcherized-repeated conditions in a single experiment (Experiment 3). Two control experiments confirmed that the repeated presentation of the preceding stimuli is necessary for the difference in duration distortion to occur (Experiments 4 and 5). The results suggest the considerable role of perceptual processing in the oddball effect. We discuss the discrepancy in the results between the intact-repeated and Thatcherized-repeated conditions in terms of predictive coding.

BCI Toolbox: An open-source python package for the Bayesian causal inference model

Psychological and neuroscientific research over the past two decades has shown that the Bayesian causal inference (BCI) is a potential unifying theory that can account for a wide range of perceptual and sensorimotor processes in humans. Therefore, we introduce the BCI Toolbox, a statistical and analytical tool in Python, enabling researchers to conveniently perform quantitative modeling and analysis of behavioral data. Additionally, we describe the algorithm of the BCI model and test its stability and reliability via parameter recovery. The present BCI toolbox offers a robust platform for BCI model implementation as well as a hands-on tool for learning and understanding the model, facilitating its widespread use and enabling researchers to delve into the data to uncover underlying cognitive mechanisms.

Synchrony perception across senses: A systematic review of temporal binding window changes from infancy to adolescence in typical and atypical development

Sensory integration is increasingly acknowledged as being crucial for the development of cognitive and social abilities. However, its developmental trajectory is still little understood. This systematic review delves into the topic by investigating the literature about the developmental changes from infancy through adolescence of the Temporal Binding Window (TBW) - the epoch of time within which sensory inputs are perceived as simultaneous and therefore integrated. Following comprehensive searches across PubMed, Elsevier, and PsycInfo databases, only experimental, behavioral, English-language, peer-reviewed studies on multisensory temporal processing in 0-17-year-olds have been included. Non-behavioral, non-multisensory, and non-human studies have been excluded as those that did not directly focus on the TBW. The selection process was independently performed by two Authors. The 39 selected studies involved 2859 participants in total. Findings indicate a predisposition towards cross-modal asynchrony sensitivity and a composite, still unclear, developmental trajectory, with atypical development associated to increased asynchrony tolerance. These results highlight the need for consistent and thorough research into TBW development to inform potential interventions.

A Bayesian observer model reveals a prior for natural daylights in hue perception

Incorporating statistical characteristics of stimuli in perceptual processing can be highly beneficial for reliable estimation from noisy sensory measurements but may generate perceptual bias. According to Bayesian inference, perceptual biases arise from the integration of internal priors with noisy sensory inputs. In this study, we used a Bayesian observer model to derive biases and priors in hue perception based on discrimination data for hue ensembles with varying levels of chromatic noise. Our results showed that discrimination thresholds for isoluminant stimuli with hue defined by azimuth angle in cone-opponent color space exhibited a bimodal pattern, with lowest thresholds near a non-cardinal blue-yellow axis that aligns closely with the variation of natural daylights. Perceptual biases showed zero crossings around this axis, indicating repulsion away from yellow and attraction towards blue. These biases could be explained by the Bayesian observer model through a non-uniform prior with a preference for blue. Our findings suggest that visual processing takes advantage of knowledge of the distribution of colors in natural environments for hue perception.

A universal preference for animate agents in hominids

When conversing, humans instantaneously predict meaning from fragmentary and ambiguous mspeech, long before utterance completion. They do this by integrating priors (initial assumptions about the world) with contextual evidence to rapidly decide on the most likely meaning. One powerful prior is attentional preference for agents, which biases sentence processing but universally so only if agents are animate. Here, we investigate the evolutionary origins of this preference, by allowing chimpanzees, gorillas, orangutans, human children, and adults to freely choose between agents and patients in still images, following video clips depicting their dyadic interaction. All participants preferred animate (and occasionally inanimate) agents, although the effect was attenuated if patients were also animate. The findings suggest that a preference for animate agents evolved before language and is not reducible to simple perceptual biases. To conclude, both humans and great apes prefer animate agents in decision tasks, echoing a universal prior in human language processing.

A Computational Model of Deep Brain Stimulation for Parkinson's Disease Tremor and Bradykinesia

Parkinson's disease (PD) is a progressive neurological disorder that is typically characterized by a range of motor dysfunctions, and its impact extends beyond physical abnormalities into emotional well-being and cognitive symptoms. The loss of dopaminergic neurons in the substantia nigra pars compacta (SNc) leads to an array of dysfunctions in the functioning of the basal ganglia (BG) circuitry that manifests into PD. While active research is being carried out to find the root cause of SNc cell death, various therapeutic techniques are used to manage the symptoms of PD. The most common approach in managing the symptoms is replenishing the lost dopamine in the form of taking dopaminergic medications such as levodopa, despite its long-term complications. Another commonly used intervention for PD is deep brain stimulation (DBS). DBS is most commonly used when levodopa medication efficacy is reduced, and, in combination with levodopa medication, it helps reduce the required dosage of medication, prolonging the therapeutic effect. DBS is also a first choice option when motor complications such as dyskinesia emerge as a side effect of medication. Several studies have also reported that though DBS is found to be effective in suppressing severe motor symptoms such as tremors and rigidity, it has an adverse effect on cognitive capabilities. Henceforth, it is important to understand the exact mechanism of DBS in alleviating motor symptoms. A computational model of DBS stimulation for motor symptoms will offer great insights into understanding the mechanisms underlying DBS, and, along this line, in our current study, we modeled a cortico-basal ganglia circuitry of arm reaching, where we simulated healthy control (HC) and PD symptoms as well as the DBS effect on PD tremor and bradykinesia. Our modeling results reveal that PD tremors are more correlated with the theta band, while bradykinesia is more correlated with the beta band of the frequency spectrum of the local field potential (LFP) of the subthalamic nucleus (STN) neurons. With a DBS current of 220 pA, 130 Hz, and a 100 microsecond pulse-width, we could found the maximum therapeutic effect for the pathological dynamics simulated using our model using a set of parameter values. However, the exact DBS characteristics vary from patient to patient, and this can be further studied by exploring the model parameter space. This model can be extended to study different DBS targets and accommodate cognitive dynamics in the future to study the impact of DBS on cognitive symptoms and thereby optimize the parameters to produce optimal performance effects across modalities. Combining DBS with rehabilitation is another frontier where DBS can reduce symptoms such as tremors and rigidity, enabling patients to participate in their therapy. With DBS providing instant relief to patients, a combination of DBS and rehabilitation can enhance neural plasticity. One of the key motivations behind combining DBS with rehabilitation is to expect comparable results in motor performance even with milder DBS currents.

Phantom perception as a Bayesian inference problem: a pilot study

Tinnitus is the perception of a continuous sound in the absence of an external source. Although the role of the auditory system is well investigated, there is a gap in how multisensory signals are integrated to produce a single percept in tinnitus. Here, we train participants to learn a new sensory environment by associating a cue with a target signal that varies in perceptual threshold. In the test phase, we present only the cue to see whether the person perceives an illusion of the target signal. We perform two separate experiments to observe the behavioral and electrophysiological responses to the learning and test phases in 1) healthy young adults and 2) people with continuous subjective tinnitus and matched control subjects. We observed that in both parts of the study the percentage of false alarms was negatively correlated with the 75% detection threshold. Additionally, the perception of an illusion goes together with increased evoked response potential in frontal regions of the brain. Furthermore, in patients with tinnitus, we observe no significant difference in behavioral or evoked response in the auditory paradigm, whereas patients with tinnitus were more likely to report false alarms along with increased evoked activity during the learning and test phases in the visual paradigm. This emphasizes the importance of integrity of sensory pathways in multisensory integration and how this process may be disrupted in people with tinnitus. Furthermore, the present study also presents preliminary data supporting evidence that tinnitus patients may be building stronger perceptual models, which needs future studies with a larger population to provide concrete evidence on.NEW & NOTEWORTHY Tinnitus is the continuous phantom perception of a ringing in the ears. Recently, it has been suggested that tinnitus may be a maladaptive inference of the brain to auditory anomalies, whether they are detected or undetected by an audiogram. The present study presents empirical evidence for this hypothesis by inducing an illusion in a sensory domain that is damaged (auditory) and one that is intact (visual). It also presents novel information about how people with tinnitus process multisensory stimuli in the audio-visual domain.

Representation and computation in visual working memory

The ability to sustain internal representations of the sensory environment beyond immediate perception is a fundamental requirement of cognitive processing. In recent years, debates regarding the capacity and fidelity of the working memory (WM) system have advanced our understanding of the nature of these representations. In particular, there is growing recognition that WM representations are not merely imperfect copies of a perceived object or event. New experimental tools have revealed that observers possess richer information about the uncertainty in their memories and take advantage of environmental regularities to use limited memory resources optimally. Meanwhile, computational models of visuospatial WM formulated at different levels of implementation have converged on common principles relating capacity to variability and uncertainty. Here we review recent research on human WM from a computational perspective, including the neural mechanisms that support it.

Conductance-based dendrites perform Bayes-optimal cue integration

A fundamental function of cortical circuits is the integration of information from different sources to form a reliable basis for behavior. While animals behave as if they optimally integrate information according to Bayesian probability theory, the implementation of the required computations in the biological substrate remains unclear. We propose a novel, Bayesian view on the dynamics of conductance-based neurons and synapses which suggests that they are naturally equipped to optimally perform information integration. In our approach apical dendrites represent prior expectations over somatic potentials, while basal dendrites represent likelihoods of somatic potentials. These are parametrized by local quantities, the effective reversal potentials and membrane conductances. We formally demonstrate that under these assumptions the somatic compartment naturally computes the corresponding posterior. We derive a gradient-based plasticity rule, allowing neurons to learn desired target distributions and weight synaptic inputs by their relative reliabilities. Our theory explains various experimental findings on the system and single-cell level related to multi-sensory integration, which we illustrate with simulations. Furthermore, we make experimentally testable predictions on Bayesian dendritic integration and synaptic plasticity.

The Thermodynamics of Mind

To not only survive, but also thrive, the brain must efficiently orchestrate distributed computation across space and time. This requires hierarchical organisation facilitating fast information transfer and processing at the lowest possible metabolic cost. Quantifying brain hierarchy is difficult but can be estimated from the asymmetry of information flow. Thermodynamics has successfully characterised hierarchy in many other complex systems. Here, we propose the 'Thermodynamics of Mind' framework as a natural way to quantify hierarchical brain orchestration and its underlying mechanisms. This has already provided novel insights into the orchestration of hierarchy in brain states including movie watching, where the hierarchy of the brain is flatter than during rest. Overall, this framework holds great promise for revealing the orchestration of cognition.

NeuroDots: From Single-Target to Brain-Network Modulation: Why and What Is Needed?

OBJECTIVES

Current techniques in brain stimulation are still largely based on a phrenologic approach that a single brain target can treat a brain disorder. Nevertheless, meta-analyses of brain implants indicate an overall success rate of 50% improvement in 50% of patients, irrespective of the brain-related disorder. Thus, there is still a large margin for improvement. The goal of this manuscript is to 1) develop a general theoretical framework of brain functioning that is amenable to surgical neuromodulation, and 2) describe the engineering requirements of the next generation of implantable brain stimulators that follow from this theoretic model.

MATERIALS AND METHODS

A neuroscience and engineering literature review was performed to develop a universal theoretical model of brain functioning and dysfunctioning amenable to surgical neuromodulation.

RESULTS

Even though a single target can modulate an entire network, research in network science reveals that many brain disorders are the consequence of maladaptive interactions among multiple networks rather than a single network. Consequently, targeting the main connector hubs of those multiple interacting networks involved in a brain disorder is theoretically more beneficial. We, thus, envision next-generation network implants that will rely on distributed, multisite neuromodulation targeting correlated and anticorrelated interacting brain networks, juxtaposing alternative implant configurations, and finally providing solid recommendations for the realization of such implants. In doing so, this study pinpoints the potential shortcomings of other similar efforts in the field, which somehow fall short of the requirements.

CONCLUSION

The concept of network stimulation holds great promise as a universal approach for treating neurologic and psychiatric disorders.

Systemic neurophysiological signals of auditory predictive coding

Predictive coding framework posits that our brain continuously monitors changes in the environment and updates its predictive models, minimizing prediction errors to efficiently adapt to environmental demands. However, the underlying neurophysiological mechanisms of these predictive phenomena remain unclear. The present study aimed to explore the systemic neurophysiological correlates of predictive coding processes during passive and active auditory processing. Electroencephalography (EEG), functional near-infrared spectroscopy (fNIRS), and autonomic nervous system (ANS) measures were analyzed using an auditory pattern-based novelty oddball paradigm. A sample of 32 healthy subjects was recruited. The results showed shared slow evoked potentials between passive and active conditions that could be interpreted as automatic predictive processes of anticipation and updating, independent of conscious attentional effort. A dissociated topography of the cortical hemodynamic activity and distinctive evoked potentials upon auditory pattern violation were also found between both conditions, whereas only conscious perception leading to imperative responses was accompanied by phasic ANS responses. These results suggest a systemic-level hierarchical reallocation of predictive coding neural resources as a function of contextual demands in the face of sensory stimulation. Principal component analysis permitted to associate the variability of some of the recorded signals.

Pain perception as hierarchical Bayesian inference: A test case for the theory of constructed emotion

An intriguing perspective about human emotion, the theory of constructed emotion considers emotions as generative models according to the Bayesian brain hypothesis. This theory brings fresh insight to existing findings, but its complexity renders it challenging to test experimentally. We argue that laboratory studies of pain could support the theory because although some may not consider pain to be a genuine emotion, the theory must at minimum be able to explain pain perception and its dysfunction in pathology. We review emerging evidence that bear on this question. We cover behavioral and neural laboratory findings, computational models, placebo hyperalgesia, and chronic pain. We conclude that there is substantial evidence for a predictive processing account of painful experience, paving the way for a better understanding of neuronal and computational mechanisms of other emotions.

Flexible Conceptual Representations

A view that has been gaining prevalence over the past decade is that the human conceptual system is malleable, dynamic, context-dependent, and task-dependent, that is, flexible. Within the flexible conceptual representation framework, conceptual representations are constructed ad hoc, forming a different, idiosyncratic instantiation upon each occurrence. In this review, we scrutinize the neurocognitive literature to better understand the nature of this flexibility. First, we identify some key characteristics of these representations. Next, we consider how these flexible representations are constructed by addressing some of the open questions in this framework: We review the age-old question of how to reconcile flexibility with the apparent need for shareable stable definitions to anchor meaning and come to mutual understanding, as well as some newer questions we find critical, namely, the nature of relations among flexible representations, the role of feature saliency in activation, and the viability of all-or-none feature activations. We suggest replacing the debate about the existence of a definitional stable core that is obligatorily activated with a question of the degree and probability of activation of the information constituting a conceptual representation. We rely on published works to suggest that (1) prior featural salience matters, (2) feature activation may be graded, and (3) Bayesian updating of prior information according to current demands offers a viable account of how flexible representations are constructed. This proposal provides a theoretical mechanism for incorporating a changing momentary context into a constructed representation, while still preserving some of the concept's constituent meaning.

Investigating the neural effects of typicality and predictability for face and object stimuli

The brain calibrates itself based on the past stimulus diet, which makes frequently observed stimuli appear as typical (as opposed to uncommon stimuli, which appear as distinctive). Based on predictive processing theory, the brain should be more "prepared" for typical exemplars, because these contain information that has been encountered frequently, allowing it to economically represent items of that category. Thus, one could ask whether predictability and typicality of visual stimuli interact, or rather act in an additive manner. We adapted the design by Egner and colleagues (2010), who used cues to induce expectations about stimulus category (face vs. chair) occurrence during an orthogonal inversion detection task. We measured BOLD responses with fMRI in 35 participants. First, distinctive stimuli always elicited stronger responses than typical ones in all ROIs, and our whole-brain directional contrasts for the effects of typicality and distinctiveness converge with previous findings. Second and importantly, we could not replicate the interaction between category and predictability reported by Egner et al. (2010), which casts doubt on whether cueing designs are ideal to elicit reliable predictability effects. Third, likely as a consequence of the lack of predictability effects, we found no interaction between predictability and typicality in any of the four tested regions (bilateral fusiform face areas, lateral occipital complexes) when considering both categories, nor in the whole brain. We discuss the issue of replicability in neuroscience and sketch an agenda for how future studies might address the same question.

Resonance tuning of rhythmic movements is disrupted at short time scales: A centrifuge study

The human body exploits its neural mechanisms to optimize actions. Rhythmic movements are optimal when their frequency is close to the natural frequency of the system. In a pendulum, gravity modulates this spontaneous frequency. Participants unconsciously adjust their natural pace when cyclically moving the arm in altered gravity. However, the timescale of this adaptation is unexplored. Participants performed cyclic movements before, during, and after fast transitions between hypergravity levels (1g-3g and 3g-1g) induced by a human centrifuge. Movement periods were modulated with the average value of gravity during transitions. However, while participants increased movement pace on a cycle basis when gravity increased (1g-3g), they did not decrease pace when gravity decreased (3g-1g). We highlight asymmetric effects in the spontaneous adjustment of movement dynamics on short timescales, suggesting the involvement of cognitive factors, beyond standard dynamical models.

Dissecting Bayes: Using influence measures to test normative use of probability density information derived from a sample

Bayesian decision theory (BDT) is frequently used to model normative performance in perceptual, motor, and cognitive decision tasks where the possible outcomes of actions are associated with rewards or penalties. The resulting normative models specify how decision makers should encode and combine information about uncertainty and value-step by step-in order to maximize their expected reward. When prior, likelihood, and posterior are probabilities, the Bayesian computation requires only simple arithmetic operations: addition, etc. We focus on visual cognitive tasks where Bayesian computations are carried out not on probabilities but on (1) probability density functions and (2) these probability density functions are derived from samples. We break the BDT model into a series of computations and test human ability to carry out each of these computations in isolation. We test three necessary properties of normative use of pdf information derived from a sample-accuracy, additivity and influence. Influence measures allow us to assess how much weight each point in the sample is assigned in making decisions and allow us to compare normative use (weighting) of samples to actual, point by point. We find that human decision makers violate accuracy and additivity systematically but that the cost of failure in accuracy or additivity would be minor in common decision tasks. However, a comparison of measured influence for each sample point with normative influence measures demonstrates that the individual's use of sample information is markedly different from the predictions of BDT. We will show that the normative BDT model takes into account the geometric symmetries of the pdf while the human decision maker does not. An alternative model basing decisions on a single extreme sample point provided a better account for participants' data than the normative BDT model.

Self as a prior: The malleability of Bayesian multisensory integration to social salience

Our everyday perceptual experiences are grounded in the integration of information within and across our senses. Due to this direct behavioural relevance, cross-modal integration retains a certain degree of contextual flexibility, even to social relevance. However, how social relevance modulates cross-modal integration remains unclear. To investigate possible mechanisms, Experiment 1 tested the principles of audio-visual integration for numerosity estimation by deriving a Bayesian optimal observer model with perceptual prior from empirical data to explain perceptual biases. Such perceptual priors may shift towards locations of high salience in the stimulus space. Our results showed that the tendency to over- or underestimate numerosity, expressed in the frequency and strength of fission and fusion illusions, depended on the actual event numerosity. Experiment 2 replicated the effects of social relevance on multisensory integration from Scheller & Sui, 2022 JEP:HPP, using a lower number of events, thereby favouring the opposite illusion through enhanced influences of the prior. In line with the idea that the self acts like a prior, the more frequently observed illusion (more malleable to prior influences) was modulated by self-relevance. Our findings suggest that the self can influence perception by acting like a prior in cue integration, biasing perceptual estimates towards areas of high self-relevance.

Reviving Bistable Perception in Patients With Depression by Decreasing the Overestimation of Prior Precision

Slower perceptual alternations, a notable perceptual effect observed in psychiatric disorders, can be alleviated by antidepressant therapies that affect serotonin levels in the brain. While these phenomena have been well documented, the underlying neurocognitive mechanisms remain to be elucidated. Our study bridges this gap by employing a computational cognitive approach within a Bayesian predictive coding framework to explore these mechanisms in depression. We fitted a prediction error (PE) model to behavioral data from a binocular rivalry task, uncovering that significantly higher initial prior precision and lower PE led to a slower switch rate in patients with depression. Furthermore, serotonin-targeting antidepressant treatments significantly decreased the prior precision and increased PE, both of which were predictive of improvements in the perceptual alternation rate of depression patients. These findings indicated that the substantially slower perception switch rate in patients with depression was caused by the greater reliance on top-down priors and that serotonin treatment's efficacy was in its recalibration of these priors and enhancement of PE. Our study not only elucidates the cognitive underpinnings of depression, but also suggests computational modeling as a potent tool for integrating cognitive science with clinical psychology, advancing our understanding and treatment of cognitive impairments in depression.

Active Inference With Empathy Mechanism for Socially Behaved Artificial Agents in Diverse Situations

This article proposes a method for an artificial agent to behave in a social manner. Although defining proper social behavior is difficult because it differs from situation to situation, the agent following the proposed method adaptively behaves appropriately in each situation by empathizing with the surrounding others. The proposed method is achieved by incorporating empathy into active inference. We evaluated the proposed method regarding control of autonomous mobile robots in diverse situations. From the evaluation results, an agent controlled by the proposed method could behave more adaptively socially than an agent controlled by the standard active inference in the diverse situations. In the case of two agents, the agent controlled with the proposed method behaved in a social way that reduced the other agent's travel distance by 13.7% and increased the margin between the agents by 25.8%, even though it increased the agent's travel distance by 8.2%. Also, the agent controlled with the proposed method behaved more socially when it was surrounded by altruistic others but less socially when it was surrounded by selfish others.