1
|
Priorelli M, Stoianov IP. Dynamic planning in hierarchical active inference. Neural Netw 2025; 185:107075. [PMID: 39817980 DOI: 10.1016/j.neunet.2024.107075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2024] [Revised: 11/13/2024] [Accepted: 12/18/2024] [Indexed: 01/18/2025]
Abstract
By dynamic planning, we refer to the ability of the human brain to infer and impose motor trajectories related to cognitive decisions. A recent paradigm, active inference, brings fundamental insights into the adaptation of biological organisms, constantly striving to minimize prediction errors to restrict themselves to life-compatible states. Over the past years, many studies have shown how human and animal behaviors could be explained in terms of active inference - either as discrete decision-making or continuous motor control - inspiring innovative solutions in robotics and artificial intelligence. Still, the literature lacks a comprehensive outlook on effectively planning realistic actions in changing environments. Setting ourselves the goal of modeling complex tasks such as tool use, we delve into the topic of dynamic planning in active inference, keeping in mind two crucial aspects of biological behavior: the capacity to understand and exploit affordances for object manipulation, and to learn the hierarchical interactions between the self and the environment, including other agents. We start from a simple unit and gradually describe more advanced structures, comparing recently proposed design choices and providing basic examples. This study distances itself from traditional views centered on neural networks and reinforcement learning, and points toward a yet unexplored direction in active inference: hybrid representations in hierarchical models.
Collapse
Affiliation(s)
- Matteo Priorelli
- Institute of Cognitive Sciences and Technologies, National Research Council, Padova, Italy; Sapienza University of Rome, Rome, Italy
| | - Ivilin Peev Stoianov
- Institute of Cognitive Sciences and Technologies, National Research Council, Padova, Italy.
| |
Collapse
|
2
|
Limanowski J, Adams RA, Kilner J, Parr T. The Many Roles of Precision in Action. ENTROPY (BASEL, SWITZERLAND) 2024; 26:790. [PMID: 39330123 PMCID: PMC11431491 DOI: 10.3390/e26090790] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Revised: 09/05/2024] [Accepted: 09/07/2024] [Indexed: 09/28/2024]
Abstract
Active inference describes (Bayes-optimal) behaviour as being motivated by the minimisation of surprise of one's sensory observations, through the optimisation of a generative model (of the hidden causes of one's sensory data) in the brain. One of active inference's key appeals is its conceptualisation of precision as biasing neuronal communication and, thus, inference within generative models. The importance of precision in perceptual inference is evident-many studies have demonstrated the importance of ensuring precision estimates are correct for normal (healthy) sensation and perception. Here, we highlight the many roles precision plays in action, i.e., the key processes that rely on adequate estimates of precision, from decision making and action planning to the initiation and control of muscle movement itself. Thereby, we focus on the recent development of hierarchical, "mixed" models-generative models spanning multiple levels of discrete and continuous inference. These kinds of models open up new perspectives on the unified description of hierarchical computation, and its implementation, in action. Here, we highlight how these models reflect the many roles of precision in action-from planning to execution-and the associated pathologies if precision estimation goes wrong. We also discuss the potential biological implementation of the associated message passing, focusing on the role of neuromodulatory systems in mediating different kinds of precision.
Collapse
Affiliation(s)
- Jakub Limanowski
- Institute of Psychology, University of Greifswald, 17487 Greifswald, Germany
| | - Rick A. Adams
- Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK; (R.A.A.); (J.K.)
- Centre for Medical Image Computing, University College London, London WC1N 6LJ, UK
| | - James Kilner
- Institute of Cognitive Neuroscience, University College London, London WC1N 3AZ, UK; (R.A.A.); (J.K.)
| | - Thomas Parr
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford OX1 4AL, UK;
| |
Collapse
|
3
|
Parvizi-Wayne D, Sandved-Smith L, Pitliya RJ, Limanowski J, Tufft MRA, Friston KJ. Forgetting ourselves in flow: an active inference account of flow states and how we experience ourselves within them. Front Psychol 2024; 15:1354719. [PMID: 38887627 PMCID: PMC11182004 DOI: 10.3389/fpsyg.2024.1354719] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 04/26/2024] [Indexed: 06/20/2024] Open
Abstract
Flow has been described as a state of optimal performance, experienced universally across a broad range of domains: from art to athletics, gaming to writing. However, its phenomenal characteristics can, at first glance, be puzzling. Firstly, individuals in flow supposedly report a loss of self-awareness, even though they perform in a manner which seems to evince their agency and skill. Secondly, flow states are felt to be effortless, despite the prerequisite complexity of the tasks that engender them. In this paper, we unpick these features of flow, as well as others, through the active inference framework, which posits that action and perception are forms of active Bayesian inference directed at sustained self-organisation; i.e., the minimisation of variational free energy. We propose that the phenomenology of flow is rooted in the deployment of high precision weight over (i) the expected sensory consequences of action and (ii) beliefs about how action will sequentially unfold. This computational mechanism thus draws the embodied cognitive system to minimise the ensuing (i.e., expected) free energy through the exploitation of the pragmatic affordances at hand. Furthermore, given the challenging dynamics the flow-inducing situation presents, attention must be wholly focussed on the unfolding task whilst counterfactual planning is restricted, leading to the attested loss of the sense of self-as-object. This involves the inhibition of both the sense of self as a temporally extended object and higher-order, meta-cognitive forms of self-conceptualisation. Nevertheless, we stress that self-awareness is not entirely lost in flow. Rather, it is pre-reflective and bodily. Our approach to bodily-action-centred phenomenology can be applied to similar facets of seemingly agentive experience beyond canonical flow states, providing insights into the mechanisms of so-called selfless experiences, embodied expertise and wellbeing.
Collapse
Affiliation(s)
- Darius Parvizi-Wayne
- Department of Experimental Psychology, University College London, London, United Kingdom
| | - Lars Sandved-Smith
- Monash Centre for Consciousness and Contemplative Studies, Monash University, Clayton, VIC, Australia
| | - Riddhi J. Pitliya
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom
- VERSES AI Research Lab, Los Angeles, CA, United States
| | - Jakub Limanowski
- Institute of Psychology, University of Greifswald, Greifswald, Germany
| | - Miles R. A. Tufft
- Department of Experimental Psychology, University College London, London, United Kingdom
| | - Karl J. Friston
- VERSES AI Research Lab, Los Angeles, CA, United States
- Queen Square Institute of Neurology, University College London, London, United Kingdom
| |
Collapse
|
4
|
Novicky F, Parr T, Friston K, Mirza MB, Sajid N. Bistable perception, precision and neuromodulation. Cereb Cortex 2024; 34:bhad401. [PMID: 37950879 PMCID: PMC10793076 DOI: 10.1093/cercor/bhad401] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 10/04/2023] [Accepted: 10/05/2023] [Indexed: 11/13/2023] Open
Abstract
Bistable perception follows from observing a static, ambiguous, (visual) stimulus with two possible interpretations. Here, we present an active (Bayesian) inference account of bistable perception and posit that perceptual transitions between different interpretations (i.e. inferences) of the same stimulus ensue from specific eye movements that shift the focus to a different visual feature. Formally, these inferences are a consequence of precision control that determines how confident beliefs are and change the frequency with which one can perceive-and alternate between-two distinct percepts. We hypothesized that there are multiple, but distinct, ways in which precision modulation can interact to give rise to a similar frequency of bistable perception. We validated this using numerical simulations of the Necker cube paradigm and demonstrate the multiple routes that underwrite the frequency of perceptual alternation. Our results provide an (enactive) computational account of the intricate precision balance underwriting bistable perception. Importantly, these precision parameters can be considered the computational homologs of particular neurotransmitters-i.e. acetylcholine, noradrenaline, dopamine-that have been previously implicated in controlling bistable perception, providing a computational link between the neurochemistry and perception.
Collapse
Affiliation(s)
- Filip Novicky
- Department of Neurophysics, Radboud University, Heyendaalseweg 135, 6525 AJ, Nijmegen, Netherlands
- Faculty of Psychology and Neuroscience, Maastricht University, Universiteitssingel 406229 ER, Maastricht, Netherlands
| | - Thomas Parr
- Wellcome Centre for Human Neuroimaging, UCL, 12 Queen Square London WC1N 3AR, United Kingdom
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, UCL, 12 Queen Square London WC1N 3AR, United Kingdom
| | - Muammer Berk Mirza
- Department of Psychology, University of Cambridge, Downing Pl, Cambridge CB2 3EB, United Kingdom
| | - Noor Sajid
- Wellcome Centre for Human Neuroimaging, UCL, 12 Queen Square London WC1N 3AR, United Kingdom
| |
Collapse
|
5
|
Yun S, Jo SH, Jeon HJ, Choo B, Seok JH, Shin H, Kim IY, Choi SW, Koo BH. Neurophysiological insights into impaired mentalization in borderline personality disorder an electroencephalography study. Front Psychiatry 2024; 14:1293347. [PMID: 38268560 PMCID: PMC10806161 DOI: 10.3389/fpsyt.2023.1293347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Accepted: 12/22/2023] [Indexed: 01/26/2024] Open
Abstract
Introduction Borderline personality disorder (BPD) is characterized by interpersonal and emotional instabilities, recurring suicidal tendencies, and feelings of emptiness. Childhood adverse event is reported in 70%-80% of cases involving BPD. Furthermore, the deficiency in mentalization capacity plays a significant role in emotion dysregulation and social interaction problems within individuals with BPD. This study explored the relationship among childhood adverse experiences, mentalization capacity, and neurophysiological activity in patients with BPD. Methods Resting-state electroencephalography was used to identify the neural correlates associated with childhood adversity and mentalization deficits. The participants included 45 patients with BPD and 15 healthy controls. Results The BPD group exhibited reduced alpha activity during eyes-closed rest, indicating heightened arousal even during relaxation. Correlations were found between the power spectral density (PSD) and mentalization capacity in the delta and theta ranges, suggesting an association between PSD and emotional awareness and expression. Gamma activity negatively correlated with psychic equivalence, implying a blurring of the boundaries between internal mental experiences and the external world. Conclusion These findings offer insights into the pathophysiology of BPD, provide potential diagnostic markers, and suggest personalized treatment approaches based on mentalization traits.
Collapse
Affiliation(s)
- Seokho Yun
- Department of Psychiatry, Yeungnam University Hospital, Yeungnam University College of Medicine, Daegu, Republic of Korea
| | - So-Hye Jo
- Department of Psychiatry, Yeungnam University Hospital, Yeungnam University College of Medicine, Daegu, Republic of Korea
| | - Hye-Jin Jeon
- Department of Psychiatry, Yeungnam University Hospital, Yeungnam University College of Medicine, Daegu, Republic of Korea
| | - Bokyung Choo
- Industry-Academic Cooperations, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Jeong-Ho Seok
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Hyunkyung Shin
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - In-Young Kim
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Sun-Woo Choi
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Bon-Hoon Koo
- Department of Psychiatry, Yeungnam University Hospital, Yeungnam University College of Medicine, Daegu, Republic of Korea
| |
Collapse
|
6
|
Schoeller F, Horowitz AH, Jain A, Maes P, Reggente N, Christov-Moore L, Pezzulo G, Barca L, Allen M, Salomon R, Miller M, Di Lernia D, Riva G, Tsakiris M, Chalah MA, Klein A, Zhang B, Garcia T, Pollack U, Trousselard M, Verdonk C, Dumas G, Adrien V, Friston K. Interoceptive technologies for psychiatric interventions: From diagnosis to clinical applications. Neurosci Biobehav Rev 2024; 156:105478. [PMID: 38007168 DOI: 10.1016/j.neubiorev.2023.105478] [Citation(s) in RCA: 13] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2023] [Revised: 11/16/2023] [Accepted: 11/19/2023] [Indexed: 11/27/2023]
Abstract
Interoception-the perception of internal bodily signals-has emerged as an area of interest due to its implications in emotion and the prevalence of dysfunctional interoceptive processes across psychopathological conditions. Despite the importance of interoception in cognitive neuroscience and psychiatry, its experimental manipulation remains technically challenging. This is due to the invasive nature of existing methods, the limitation of self-report and unimodal measures of interoception, and the absence of standardized approaches across disparate fields. This article integrates diverse research efforts from psychology, physiology, psychiatry, and engineering to address this oversight. Following a general introduction to the neurophysiology of interoception as hierarchical predictive processing, we review the existing paradigms for manipulating interoception (e.g., interoceptive modulation), their underlying mechanisms (e.g., interoceptive conditioning), and clinical applications (e.g., interoceptive exposure). We suggest a classification for interoceptive technologies and discuss their potential for diagnosing and treating mental health disorders. Despite promising results, considerable work is still needed to develop standardized, validated measures of interoceptive function across domains and before these technologies can translate safely and effectively to clinical settings.
Collapse
Affiliation(s)
- Felix Schoeller
- Fluid Interfaces Group, Media Lab, Massachusetts Institute of Technology, USA; Institute for Advanced Consciousness Studies, Santa Monica, CA, USA; Department Cognitive Sciences, University of Haifa, Israel.
| | - Adam Haar Horowitz
- Fluid Interfaces Group, Media Lab, Massachusetts Institute of Technology, USA; Center for Sleep and Cognition, Beth Israel Deaconess Medical Center, Harvard Medical School, USA
| | - Abhinandan Jain
- Fluid Interfaces Group, Media Lab, Massachusetts Institute of Technology, USA
| | - Pattie Maes
- Fluid Interfaces Group, Media Lab, Massachusetts Institute of Technology, USA
| | - Nicco Reggente
- Institute for Advanced Consciousness Studies, Santa Monica, CA, USA
| | | | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Laura Barca
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Micah Allen
- Center of Functionally Integrative Neuroscience, Aarhus University, Denmark; Cambridge Psychiatry, University of Cambridge, UK
| | - Roy Salomon
- Department Cognitive Sciences, University of Haifa, Israel
| | - Mark Miller
- Center for Human Nature, Artificial Intelligence and Neuroscience, Hokkaido University, Japan
| | - Daniele Di Lernia
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy; Applied Technology for Neuro- Psychology Laboratory, IRCCS Istituto Auxologico Italiano, Milan, Italy
| | - Giuseppe Riva
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy; Applied Technology for Neuro- Psychology Laboratory, IRCCS Istituto Auxologico Italiano, Milan, Italy
| | - Manos Tsakiris
- The Warburg Institute, School of Advanced Study, University of London, UK; Department of Psychology, Royal Holloway, University of London, UK; Department of Behavioural and Cognitive Sciences, University of Luxembourg, Luxembourg
| | - Moussa A Chalah
- EA 4391, Excitabilité Nerveuse et Thérapeutique, Université Paris-Est Créteil, Créteil, France; Service de Physiologie - Explorations Fonctionnelles, Hôpital Henri Mondor, Créteil, France
| | - Arno Klein
- Child Mind Institute, New York City, USA
| | - Ben Zhang
- Institute for Advanced Consciousness Studies, Santa Monica, CA, USA
| | - Teresa Garcia
- Institute for Advanced Consciousness Studies, Santa Monica, CA, USA
| | - Ursula Pollack
- Institute for Advanced Consciousness Studies, Santa Monica, CA, USA
| | - Marion Trousselard
- Institut de Recherche Biomédicale des Armées, Place Général Valérie André, 91220 Brétigny-sur-Orge, France
| | - Charles Verdonk
- Institut de Recherche Biomédicale des Armées, Place Général Valérie André, 91220 Brétigny-sur-Orge, France
| | | | - Vladimir Adrien
- Infrastructure for Clinical Research in Neurosciences (iCRIN) Psychiatry, Paris Brain Institute, Paris, France; Department of Psychiatry, Hôpital Saint-Antoine, AP-HP, Sorbonne Université, 75012 Paris, France
| | - Karl Friston
- Queen Sq, Institute of Neurology, UCL, London WC1N 3AR, UK
| |
Collapse
|
7
|
Martin A, Lane TJ, Hsu TY. DLPFC-PPC-cTBS effects on metacognitive awareness. Cortex 2023; 167:41-50. [PMID: 37523964 DOI: 10.1016/j.cortex.2023.05.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 02/12/2023] [Accepted: 05/16/2023] [Indexed: 08/02/2023]
Abstract
BACKGROUND Neuroimaging and lesion studies suggested that the dorsolateral prefrontal and posterior parietal cortices mediate visual metacognitive awareness. The causal evidence provided by non-invasive brain stimulation, however, is inconsistent. OBJECTIVE/HYPOTHESIS Here we revisit a major figure discrimination experiment adding a new Kanizsa figure task trying to resolve whether bilateral continuous theta-burst transcranial magnetic stimulation (cTBS) over these regions affects perceptual metacognition. Specifically, we tested whether subjective visibility ratings and/or metacognitive efficiency are lower when cTBS is applied to these two regions in comparison to an active control region. METHODS A within-subjects design including three sessions spaced by one-week intervals was implemented. In each session, every participant was administered bilateral cTBS to either prefrontal, control or parietal cortices. Two concurrent tasks were performed, a real and an illusory figure task, stabilising objective performance with use of an adaptive staircase procedure. RESULTS When performing the replicated task, cTBS was found insufficient to disrupt neither visibility ratings nor metacognitive efficiency. However, with use of Kanizsa style illusory figures, cTBS over the dorsolateral prefrontal, but not over the posterior parietal cortex, was observed to significantly diminish metacognitive efficiency. CONCLUSION(S) Real and illusory figure tasks demonstrated different cTBS effects. A possible explanation is the involvement of the prefrontal cortex in the creation of expectations, which is necessary for efficient metacognition. Failure to replicate previous findings for the real figure task, however, cannot be said to support, conclusively, the notion that these brain regions have a causal role in metacognitive awareness. This inconsistent finding may result from certain limitations of our study, thereby suggesting the need for yet further investigation.
Collapse
Affiliation(s)
- Antonio Martin
- Graduate Institute of Mind, Brain and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan
| | - Timothy J Lane
- Graduate Institute of Mind, Brain and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan; Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City, Taiwan
| | - Tzu-Yu Hsu
- Graduate Institute of Mind, Brain and Consciousness (GIMBC), Taipei Medical University, Taipei, Taiwan; Brain and Consciousness Research Center (BCRC), TMU-Shuang Ho Hospital, New Taipei City, Taiwan.
| |
Collapse
|
8
|
Brouillet D, Friston K. Relative fluency (unfelt vs felt) in active inference. Conscious Cogn 2023; 115:103579. [PMID: 37776599 DOI: 10.1016/j.concog.2023.103579] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 09/07/2023] [Accepted: 09/16/2023] [Indexed: 10/02/2023]
Abstract
For a growing number of researchers, it is now accepted that the brain is a predictive organ that predicts the content of the sensorium and crucially the precision of-or confidence in-its own predictions. In order to predict the precision of its predictions, the brain has to infer the reliability of its own beliefs. This means that our brains have to recognise the precision of their predictions or, at least, their accuracy. In this paper, we argue that fluency is product of this recognition process. In short, to recognise fluency is to infer that we have a precise 'grip' on the unfolding processes that generate our sensations. More specifically, we propose that it is changes in fluency - from unfelt to felt - that are both recognised and realised when updating predictions about precision. Unfelt fluency orients attention to unpredicted sensations, while felt fluency supervenes on-and contextualises-unfelt fluency; thereby rendering certain attentional processes, phenomenologically opaque. As such, fluency underwrites the precision we place in our predictions and therefore acts upon our perceptual inferences. Hence, the causes of conscious subjective inference have unconscious perceptual precursors.
Collapse
Affiliation(s)
- Denis Brouillet
- University Paul Valéry-Montpellier-France, EPSYLON, France; University Paris Nanterre, LICAE, France.
| | - Karl Friston
- Queen Square Institute of Neurology, University College, London, United Kingdom; Wellcome Centre for Human Neuroimaging, London, United Kingdom
| |
Collapse
|
9
|
Olawole-Scott H, Yon D. Expectations about precision bias metacognition and awareness. J Exp Psychol Gen 2023; 152:2177-2189. [PMID: 36972098 PMCID: PMC10399087 DOI: 10.1037/xge0001371] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Revised: 11/24/2022] [Accepted: 12/26/2022] [Indexed: 03/29/2023]
Abstract
Bayesian models of the mind suggest that we estimate the reliability or "precision" of incoming sensory signals to guide perceptual inference and to construct feelings of confidence or uncertainty about what we are perceiving. However, accurately estimating precision is likely to be challenging for bounded systems like the brain. One way observers could overcome this challenge is to form expectations about the precision of their perceptions and use these to guide metacognition and awareness. Here we test this possibility. Participants made perceptual decisions about visual motion stimuli, while providing confidence ratings (Experiments 1 and 2) or ratings of subjective visibility (Experiment 3). In each experiment, participants acquired probabilistic expectations about the likely strength of upcoming signals. We found these expectations about precision altered metacognition and awareness-with participants feeling more confident and stimuli appearing more vivid when stronger sensory signals were expected, without concomitant changes in objective perceptual performance. Computational modeling revealed that this effect could be well explained by a predictive learning model that infers the precision (strength) of current signals as a weighted combination of incoming evidence and top-down expectation. These results support an influential but untested tenet of Bayesian models of cognition, suggesting that agents do not only "read out" the reliability of information arriving at their senses, but also take into account prior knowledge about how reliable or "precise" different sources of information are likely to be. This reveals that expectations about precision influence how the sensory world appears and how much we trust our senses. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
Affiliation(s)
| | - Daniel Yon
- Department of Psychological Sciences, Birkbeck, University of London
| |
Collapse
|
10
|
Parr T, Holmes E, Friston KJ, Pezzulo G. Cognitive effort and active inference. Neuropsychologia 2023; 184:108562. [PMID: 37080424 PMCID: PMC10636588 DOI: 10.1016/j.neuropsychologia.2023.108562] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 04/03/2023] [Accepted: 04/11/2023] [Indexed: 04/22/2023]
Abstract
This paper aims to integrate some key constructs in the cognitive neuroscience of cognitive control and executive function by formalising the notion of cognitive (or mental) effort in terms of active inference. To do so, we call upon a task used in neuropsychology to assess impulse inhibition-a Stroop task. In this task, participants must suppress the impulse to read a colour word and instead report the colour of the text of the word. The Stroop task is characteristically effortful, and we unpack a theory of mental effort in which, to perform this task accurately, participants must overcome prior beliefs about how they would normally act. However, our interest here is not in overt action, but in covert (mental) action. Mental actions change our beliefs but have no (direct) effect on the outside world-much like deploying covert attention. This account of effort as mental action lets us generate multimodal (choice, reaction time, and electrophysiological) data of the sort we might expect from a human participant engaging in this task. We analyse how parameters determining cognitive effort influence simulated responses and demonstrate that-when provided only with performance data-these parameters can be recovered, provided they are within a certain range.
Collapse
Affiliation(s)
- Thomas Parr
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, UK.
| | - Emma Holmes
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, UK
| | - Karl J Friston
- Wellcome Centre for Human Neuroimaging, Queen Square Institute of Neurology, UK
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| |
Collapse
|
11
|
De Ridder D, Friston K, Sedley W, Vanneste S. A parahippocampal-sensory Bayesian vicious circle generates pain or tinnitus: a source-localized EEG study. Brain Commun 2023; 5:fcad132. [PMID: 37223127 PMCID: PMC10202557 DOI: 10.1093/braincomms/fcad132] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Revised: 02/14/2023] [Accepted: 04/19/2023] [Indexed: 05/25/2023] Open
Abstract
Pain and tinnitus share common pathophysiological mechanisms, clinical features, and treatment approaches. A source-localized resting-state EEG study was conducted in 150 participants: 50 healthy controls, 50 pain, and 50 tinnitus patients. Resting-state activity as well as functional and effective connectivity was computed in source space. Pain and tinnitus were characterized by increased theta activity in the pregenual anterior cingulate cortex, extending to the lateral prefrontal cortex and medial anterior temporal lobe. Gamma-band activity was increased in both auditory and somatosensory cortex, irrespective of the pathology, and extended to the dorsal anterior cingulate cortex and parahippocampus. Functional and effective connectivity were largely similar in pain and tinnitus, except for a parahippocampal-sensory loop that distinguished pain from tinnitus. In tinnitus, the effective connectivity between parahippocampus and auditory cortex is bidirectional, whereas the effective connectivity between parahippocampus and somatosensory cortex is unidirectional. In pain, the parahippocampal-somatosensory cortex is bidirectional, but parahippocampal auditory cortex unidirectional. These modality-specific loops exhibited theta-gamma nesting. Applying a Bayesian brain model of brain functioning, these findings suggest that the phenomenological difference between auditory and somatosensory phantom percepts result from a vicious circle of belief updating in the context of missing sensory information. This finding may further our understanding of multisensory integration and speaks to a universal treatment for pain and tinnitus-by selectively disrupting parahippocampal-somatosensory and parahippocampal-auditory theta-gamma activity and connectivity.
Collapse
Affiliation(s)
- Dirk De Ridder
- Unit of Neurosurgery, Department of Surgical Sciences, Dunedin School of Medicine, University of Otago, Dunedin 9016, New Zealand
| | - Karl Friston
- Wellcome Trust Centre for Neuroimaging, University College London, London WC1N 3AR, UK
| | - William Sedley
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne NE1 7RU, UK
| | - Sven Vanneste
- Correspondence to: Sven Vanneste Lab for Clinical & Integrative Neuroscience Global Brain Health Institute and Institute of Neuroscience Trinity College Dublin, College Green 2, Dublin D02 PN40, Ireland E-mail:
| |
Collapse
|
12
|
Carhart-Harris RL, Chandaria S, Erritzoe DE, Gazzaley A, Girn M, Kettner H, Mediano PAM, Nutt DJ, Rosas FE, Roseman L, Timmermann C, Weiss B, Zeifman RJ, Friston KJ. Canalization and plasticity in psychopathology. Neuropharmacology 2023; 226:109398. [PMID: 36584883 DOI: 10.1016/j.neuropharm.2022.109398] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 12/01/2022] [Accepted: 12/20/2022] [Indexed: 12/28/2022]
Abstract
This theoretical article revives a classical bridging construct, canalization, to describe a new model of a general factor of psychopathology. To achieve this, we have distinguished between two types of plasticity, an early one that we call 'TEMP' for 'Temperature or Entropy Mediated Plasticity', and another, we call 'canalization', which is close to Hebbian plasticity. These two forms of plasticity can be most easily distinguished by their relationship to 'precision' or inverse variance; TEMP relates to increased model variance or decreased precision, whereas the opposite is true for canalization. TEMP also subsumes increased learning rate, (Ising) temperature and entropy. Dictionary definitions of 'plasticity' describe it as the property of being easily shaped or molded; TEMP is the better match for this. Importantly, we propose that 'pathological' phenotypes develop via mechanisms of canalization or increased model precision, as a defensive response to adversity and associated distress or dysphoria. Our model states that canalization entrenches in psychopathology, narrowing the phenotypic state-space as the agent develops expertise in their pathology. We suggest that TEMP - combined with gently guiding psychological support - can counter canalization. We address questions of whether and when canalization is adaptive versus maladaptive, furnish our model with references to basic and human neuroscience, and offer concrete experiments and measures to test its main hypotheses and implications. This article is part of the Special Issue on "National Institutes of Health Psilocybin Research Speaker Series".
Collapse
Affiliation(s)
- R L Carhart-Harris
- Psychedelics Division - Neuroscape, Department of Neurology, University of California, San Francisco, USA; Centre for Psychedelic Research, Imperial College London, UK.
| | - S Chandaria
- Centre for Psychedelic Research, Imperial College London, UK; Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, UK; Institute of Philosophy, School of Advanced Study, University of London, UK
| | - D E Erritzoe
- Centre for Psychedelic Research, Imperial College London, UK; CNWL-Imperial Psychopharmacology and Psychedelic Research Clinic (CIPPRS), UK
| | - A Gazzaley
- Psychedelics Division - Neuroscape, Department of Neurology, University of California, San Francisco, USA
| | - M Girn
- Department of Neurology and Neurosurgery, Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - H Kettner
- Psychedelics Division - Neuroscape, Department of Neurology, University of California, San Francisco, USA; Centre for Psychedelic Research, Imperial College London, UK
| | - P A M Mediano
- Department of Computing, Imperial College London, London, UK; Department of Psychology, University of Cambridge, UK
| | - D J Nutt
- Centre for Psychedelic Research, Imperial College London, UK
| | - F E Rosas
- Centre for Psychedelic Research, Imperial College London, UK; Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford, UK; Department of Informatics, University of Sussex, UK; Centre for Complexity Science, Imperial College London, UK
| | - L Roseman
- Centre for Psychedelic Research, Imperial College London, UK; CNWL-Imperial Psychopharmacology and Psychedelic Research Clinic (CIPPRS), UK
| | - C Timmermann
- Centre for Psychedelic Research, Imperial College London, UK; CNWL-Imperial Psychopharmacology and Psychedelic Research Clinic (CIPPRS), UK
| | - B Weiss
- Centre for Psychedelic Research, Imperial College London, UK; CNWL-Imperial Psychopharmacology and Psychedelic Research Clinic (CIPPRS), UK
| | - R J Zeifman
- Centre for Psychedelic Research, Imperial College London, UK; NYU Langone Center for Psychedelic Medicine, NYU Grossman School of Medicine, USA
| | - K J Friston
- Wellcome Centre for Human Neuroimaging, University College London, UK
| |
Collapse
|
13
|
Prevalence and nature of multi-sensory and multi-modal hallucinations in people with first episode psychosis. Psychiatry Res 2023; 319:114988. [PMID: 36463721 DOI: 10.1016/j.psychres.2022.114988] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/13/2022] [Revised: 11/19/2022] [Accepted: 11/27/2022] [Indexed: 11/29/2022]
Abstract
Hallucinations can occur in single or multiple sensory modalities. This study explored how common these experiences were in people with first episode of psychosis (n = 82). Particular attention was paid to the number of modalities reported and whether the experiences were seen to be linked temporally and thematically. It was predicted that those people reporting a greater number of hallucinations would report more delusional ideation, greater levels of distress generally and lower functioning. All participants reported hallucinations in the auditory domain, given the nature of the recruitment. The participants also reported a range of other unusual sensory experiences, with visual and tactile hallucinations being reported by over half. Moreover, single sensory experiences or unimodal hallucinations were less common than two or more hallucination modalities which was reported by 78% of the participants. The number of hallucinations was significantly associated with greater delusional ideation and higher levels of general distress, but not with reduced functioning. It is clear there is a need to refine psychological treatments so that they are better matched to the actual experiences reported by people with psychosis. Theoretical implications are also considered.
Collapse
|
14
|
Stoliker D, Egan GF, Friston KJ, Razi A. Neural Mechanisms and Psychology of Psychedelic Ego Dissolution. Pharmacol Rev 2022; 74:876-917. [PMID: 36786290 DOI: 10.1124/pharmrev.121.000508] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2021] [Revised: 06/26/2022] [Accepted: 06/29/2022] [Indexed: 11/22/2022] Open
Abstract
Neuroimaging studies of psychedelics have advanced our understanding of hierarchical brain organization and the mechanisms underlying their subjective and therapeutic effects. The primary mechanism of action of classic psychedelics is binding to serotonergic 5-HT2A receptors. Agonist activity at these receptors leads to neuromodulatory changes in synaptic efficacy that can have a profound effect on hierarchical message-passing in the brain. Here, we review the cognitive and neuroimaging evidence for the effects of psychedelics: in particular, their influence on selfhood and subject-object boundaries-known as ego dissolution-surmised to underwrite their subjective and therapeutic effects. Agonism of 5-HT2A receptors, located at the apex of the cortical hierarchy, may have a particularly powerful effect on sentience and consciousness. These effects can endure well after the pharmacological half-life, suggesting that psychedelics may have effects on neural plasticity that may play a role in their therapeutic efficacy. Psychologically, this may be accompanied by a disarming of ego resistance that increases the repertoire of perceptual hypotheses and affords alternate pathways for thought and behavior, including those that undergird selfhood. We consider the interaction between serotonergic neuromodulation and sentience through the lens of hierarchical predictive coding, which speaks to the value of psychedelics in understanding how we make sense of the world and specific predictions about effective connectivity in cortical hierarchies that can be tested using functional neuroimaging. SIGNIFICANCE STATEMENT: Classic psychedelics bind to serotonergic 5-HT2A receptors. Their agonist activity at these receptors leads to neuromodulatory changes in synaptic efficacy, resulting in a profound effect on information processing in the brain. Here, we synthesize an abundance of brain imaging research with pharmacological and psychological interpretations informed by the framework of predictive coding. Moreover, predictive coding is suggested to offer more sophisticated interpretations of neuroimaging findings by bridging the role between the 5-HT2A receptors and large-scale brain networks.
Collapse
Affiliation(s)
- Devon Stoliker
- Turner Institute for Brain and Mental Health (D.S., G.F.E., A.R.) and Monash Biomedical Imaging (G.F.E., A.R.), Monash University, Clayton, Victoria, Australia; Wellcome Centre for Human Neuroimaging, UCL, London, United Kingdom (K.J.F., A.R.); and CIFAR Azrieli Global Scholar, CIFAR, Toronto, Canada (A.R.)
| | - Gary F Egan
- Turner Institute for Brain and Mental Health (D.S., G.F.E., A.R.) and Monash Biomedical Imaging (G.F.E., A.R.), Monash University, Clayton, Victoria, Australia; Wellcome Centre for Human Neuroimaging, UCL, London, United Kingdom (K.J.F., A.R.); and CIFAR Azrieli Global Scholar, CIFAR, Toronto, Canada (A.R.)
| | - Karl J Friston
- Turner Institute for Brain and Mental Health (D.S., G.F.E., A.R.) and Monash Biomedical Imaging (G.F.E., A.R.), Monash University, Clayton, Victoria, Australia; Wellcome Centre for Human Neuroimaging, UCL, London, United Kingdom (K.J.F., A.R.); and CIFAR Azrieli Global Scholar, CIFAR, Toronto, Canada (A.R.)
| | - Adeel Razi
- Turner Institute for Brain and Mental Health (D.S., G.F.E., A.R.) and Monash Biomedical Imaging (G.F.E., A.R.), Monash University, Clayton, Victoria, Australia; Wellcome Centre for Human Neuroimaging, UCL, London, United Kingdom (K.J.F., A.R.); and CIFAR Azrieli Global Scholar, CIFAR, Toronto, Canada (A.R.)
| |
Collapse
|
15
|
Anil Meera A, Novicky F, Parr T, Friston K, Lanillos P, Sajid N. Reclaiming saliency: Rhythmic precision-modulated action and perception. Front Neurorobot 2022; 16:896229. [PMID: 35966370 PMCID: PMC9368584 DOI: 10.3389/fnbot.2022.896229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Accepted: 06/28/2022] [Indexed: 11/13/2022] Open
Abstract
Computational models of visual attention in artificial intelligence and robotics have been inspired by the concept of a saliency map. These models account for the mutual information between the (current) visual information and its estimated causes. However, they fail to consider the circular causality between perception and action. In other words, they do not consider where to sample next, given current beliefs. Here, we reclaim salience as an active inference process that relies on two basic principles: uncertainty minimization and rhythmic scheduling. For this, we make a distinction between attention and salience. Briefly, we associate attention with precision control, i.e., the confidence with which beliefs can be updated given sampled sensory data, and salience with uncertainty minimization that underwrites the selection of future sensory data. Using this, we propose a new account of attention based on rhythmic precision-modulation and discuss its potential in robotics, providing numerical experiments that showcase its advantages for state and noise estimation, system identification and action selection for informative path planning.
Collapse
Affiliation(s)
- Ajith Anil Meera
- Department of Cognitive Robotics, Faculty of Mechanical, Maritime and Materials Engineering, Delft University of Technology, Delft, Netherlands
- *Correspondence: Ajith Anil Meera
| | - Filip Novicky
- Department of Neurophysiology, Donders Institute for Brain Cognition and Behavior, Radboud University, Nijmegen, Netherlands
- Filip Novicky
| | - Thomas Parr
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| | - Pablo Lanillos
- Department of Artificial Intelligence, Donders Institute for Brain Cognition and Behavior, Radboud University, Nijmegen, Netherlands
| | - Noor Sajid
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| |
Collapse
|
16
|
Sheldon AD, Kafadar E, Fisher V, Greenwald MS, Aitken F, Negreira AM, Woods SW, Powers AR. Perceptual pathways to hallucinogenesis. Schizophr Res 2022; 245:77-89. [PMID: 35216865 PMCID: PMC9232894 DOI: 10.1016/j.schres.2022.02.002] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Revised: 01/31/2022] [Accepted: 02/02/2022] [Indexed: 12/22/2022]
Abstract
Recent advances in computational psychiatry have provided unique insights into the neural and cognitive underpinnings of psychotic symptoms. In particular, a host of new data has demonstrated the utility of computational frameworks for understanding how hallucinations might arise from alterations in typical perceptual processing. Of particular promise are models based in Bayesian inference that link hallucinatory perceptual experiences to latent states that may drive them. In this piece, we move beyond these findings to ask: how and why do these latent states arise, and how might we take advantage of heterogeneity in that process to develop precision approaches to the treatment of hallucinations? We leverage specific models of Bayesian inference to discuss components that might lead to the development of hallucinations. Using the unifying power of our model, we attempt to place disparate findings in the study of psychotic symptoms within a common framework. Finally, we suggest directions for future elaboration of these models in the service of a more refined psychiatric nosology based on predictable, testable, and ultimately treatable information processing derangements.
Collapse
Affiliation(s)
- Andrew D Sheldon
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, United States of America
| | - Eren Kafadar
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, United States of America
| | - Victoria Fisher
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, United States of America
| | - Maximillian S Greenwald
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, United States of America
| | - Fraser Aitken
- School of Biomedical and Imaging Sciences, Kings College, London, UK
| | | | - Scott W Woods
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, United States of America
| | - Albert R Powers
- Yale University School of Medicine and the Connecticut Mental Health Center, New Haven, CT, United States of America.
| |
Collapse
|
17
|
McParlin Z, Cerritelli F, Rossettini G, Friston KJ, Esteves JE. Therapeutic Alliance as Active Inference: The Role of Therapeutic Touch and Biobehavioural Synchrony in Musculoskeletal Care. Front Behav Neurosci 2022; 16:897247. [PMID: 35846789 PMCID: PMC9280207 DOI: 10.3389/fnbeh.2022.897247] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Accepted: 05/24/2022] [Indexed: 12/05/2022] Open
Abstract
Touch is recognised as crucial for survival, fostering cooperative communication, accelerating recovery, reducing hospital stays, and promoting overall wellness and the therapeutic alliance. In this hypothesis and theory paper, we present an entwined model that combines touch for alignment and active inference to explain how the brain develops "priors" necessary for the health care provider to engage with the patient effectively. We appeal to active inference to explain the empirically integrative neurophysiological and behavioural mechanisms that underwrite synchronous relationships through touch. Specifically, we offer a formal framework for understanding - and explaining - the role of therapeutic touch and hands-on care in developing a therapeutic alliance and synchrony between health care providers and their patients in musculoskeletal care. We first review the crucial importance of therapeutic touch and its clinical role in facilitating the formation of a solid therapeutic alliance and in regulating allostasis. We then consider how touch is used clinically - to promote cooperative communication, demonstrate empathy, overcome uncertainty, and infer the mental states of others - through the lens of active inference. We conclude that touch plays a crucial role in achieving successful clinical outcomes and adapting previous priors to create intertwined beliefs. The ensuing framework may help healthcare providers in the field of musculoskeletal care to use hands-on care to strengthen the therapeutic alliance, minimise prediction errors (a.k.a., free energy), and thereby promote recovery from physical and psychological impairments.
Collapse
Affiliation(s)
- Zoe McParlin
- Clinical-Based Human Research Department, Foundation COME Collaboration, Pescara, Italy
| | - Francesco Cerritelli
- Clinical-Based Human Research Department, Foundation COME Collaboration, Pescara, Italy
| | | | - Karl J. Friston
- Institute of Neurology, Wellcome Centre for Human Neuroimaging, London, United Kingdom
| | - Jorge E. Esteves
- Clinical-Based Human Research Department, Foundation COME Collaboration, Pescara, Italy
- Malta ICOM Educational, Gzira, Malta
- University College of Osteopathy, London, United Kingdom
| |
Collapse
|
18
|
Constant A, Badcock P, Friston K, Kirmayer LJ. Integrating Evolutionary, Cultural, and Computational Psychiatry: A Multilevel Systemic Approach. Front Psychiatry 2022; 13:763380. [PMID: 35444580 PMCID: PMC9013887 DOI: 10.3389/fpsyt.2022.763380] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Accepted: 02/14/2022] [Indexed: 12/21/2022] Open
Abstract
This paper proposes an integrative perspective on evolutionary, cultural and computational approaches to psychiatry. These three approaches attempt to frame mental disorders as multiscale entities and offer modes of explanations and modeling strategies that can inform clinical practice. Although each of these perspectives involves systemic thinking, each is limited in its ability to address the complex developmental trajectories and larger social systemic interactions that lead to mental disorders. Inspired by computational modeling in theoretical biology, this paper aims to integrate the modes of explanation offered by evolutionary, cultural and computational psychiatry in a multilevel systemic perspective. We apply the resulting Evolutionary, Cultural and Computational (ECC) model to Major Depressive Disorder (MDD) to illustrate how this integrative approach can guide research and practice in psychiatry.
Collapse
Affiliation(s)
- Axel Constant
- Department of Philosophy, The University of Sydney, Darlington, NSW, Australia
| | - Paul Badcock
- Centre for Youth Mental Health, The University of Melbourne, Parkville, VIC, Australia
- Orygen, Parkville, VIC, Australia
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| | | |
Collapse
|
19
|
Mazzaglia P, Verbelen T, Çatal O, Dhoedt B. The Free Energy Principle for Perception and Action: A Deep Learning Perspective. ENTROPY (BASEL, SWITZERLAND) 2022; 24:301. [PMID: 35205595 PMCID: PMC8871280 DOI: 10.3390/e24020301] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Revised: 02/14/2022] [Accepted: 02/15/2022] [Indexed: 02/05/2023]
Abstract
The free energy principle, and its corollary active inference, constitute a bio-inspired theory that assumes biological agents act to remain in a restricted set of preferred states of the world, i.e., they minimize their free energy. Under this principle, biological agents learn a generative model of the world and plan actions in the future that will maintain the agent in an homeostatic state that satisfies its preferences. This framework lends itself to being realized in silico, as it comprehends important aspects that make it computationally affordable, such as variational inference and amortized planning. In this work, we investigate the tool of deep learning to design and realize artificial agents based on active inference, presenting a deep-learning oriented presentation of the free energy principle, surveying works that are relevant in both machine learning and active inference areas, and discussing the design choices that are involved in the implementation process. This manuscript probes newer perspectives for the active inference framework, grounding its theoretical aspects into more pragmatic affairs, offering a practical guide to active inference newcomers and a starting point for deep learning practitioners that would like to investigate implementations of the free energy principle.
Collapse
Affiliation(s)
- Pietro Mazzaglia
- IDLab, Ghent University, 9052 Gent, Belgium; (T.V.); (O.Ç.); (B.D.)
| | | | | | | |
Collapse
|
20
|
Connolly P. Instability and Uncertainty Are Critical for Psychotherapy: How the Therapeutic Alliance Opens Us Up. Front Psychol 2022; 12:784295. [PMID: 35069367 PMCID: PMC8777103 DOI: 10.3389/fpsyg.2021.784295] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Accepted: 12/06/2021] [Indexed: 01/04/2023] Open
Abstract
Tschacher and Haken have recently applied a systems-based approach to modeling psychotherapy process in terms of potentially beneficial tendencies toward deterministic as well as chaotic forms of change in the client's behavioral, cognitive and affective experience during the course of therapy. A chaotic change process refers to a greater exploration of the states that a client can be in, and it may have a potential positive role to play in their development. A distinction is made between on the one hand, specific instances of instability which are due to techniques employed by the therapist, and on the other, a more general instability which is due to the therapeutic relationship, and a key, necessary result of a successful therapeutic alliance. Drawing on Friston's systems-based model of free energy minimization and predictive coding, it is proposed here that the increase in the instability of a client's functioning due to therapy can be conceptualized as a reduction in the precisions (certainty) with which the client's prior beliefs about themselves and their world, are held. It is shown how a good therapeutic alliance (characterized by successful interpersonal synchrony of the sort described by Friston and Frith) results in the emergence of a new hierarchical level in the client's generative model of themselves and their relationship with the world. The emergence of this new level of functioning permits the reduction of the precisions of the client's priors, which allows the client to 'open up': to experience thoughts, emotions and experiences they did not have before. It is proposed that this process is a necessary precursor to change due to psychotherapy. A good consilience can be found between this approach to understanding the role of the therapeutic alliance, and the role of epistemic trust in psychotherapy as described by Fonagy and Allison. It is suggested that beneficial forms of instability in clients are an underappreciated influence on psychotherapy process, and thoughts about the implications, as well as situations in which instability may not be beneficial (or potentially harmful) for therapy, are considered.
Collapse
Affiliation(s)
- Patrick Connolly
- Counselling and Psychology Department, Hong Kong Shue Yan University, North Point, Hong Kong SAR, China
| |
Collapse
|
21
|
Affiliation(s)
- Lena Palaniyappan
- From the Department of Psychiatry, Schulich School of Medicine & Dentistry, Western University, London, Ont., Canada (Palaniyappan); the Robart Research Institute & Lawson Health Research Institute, London, Ont., Canada (Palaniyappan); and the InSTAR Program, Schizophrenia Clinic, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences, Bangalore, India (Venkatasubramanian)
| | - Ganesan Venkatasubramanian
- From the Department of Psychiatry, Schulich School of Medicine & Dentistry, Western University, London, Ont., Canada (Palaniyappan); the Robart Research Institute & Lawson Health Research Institute, London, Ont., Canada (Palaniyappan); and the InSTAR Program, Schizophrenia Clinic, Department of Psychiatry, National Institute of Mental Health and Neuro Sciences, Bangalore, India (Venkatasubramanian)
| |
Collapse
|
22
|
Hong CCH, Fallon JH, Friston KJ. fMRI Evidence for Default Mode Network Deactivation Associated with Rapid Eye Movements in Sleep. Brain Sci 2021; 11:brainsci11111528. [PMID: 34827529 PMCID: PMC8615877 DOI: 10.3390/brainsci11111528] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2021] [Revised: 11/12/2021] [Accepted: 11/16/2021] [Indexed: 11/25/2022] Open
Abstract
System-specific brain responses—time-locked to rapid eye movements (REMs) in sleep—are characteristically widespread, with robust and clear activation in the primary visual cortex and other structures involved in multisensory integration. This pattern suggests that REMs underwrite hierarchical processing of visual information in a time-locked manner, where REMs index the generation and scanning of virtual-world models, through multisensory integration in dreaming—as in awake states. Default mode network (DMN) activity increases during rest and reduces during various tasks including visual perception. The implicit anticorrelation between the DMN and task-positive network (TPN)—that persists in REM sleep—prompted us to focus on DMN responses to temporally-precise REM events. We timed REMs during sleep from the video recordings and quantified the neural correlates of REMs—using functional MRI (fMRI)—in 24 independent studies of 11 healthy participants. A reanalysis of these data revealed that the cortical areas exempt from widespread REM-locked brain activation were restricted to the DMN. Furthermore, our analysis revealed a modest temporally-precise REM-locked decrease—phasic deactivation—in key DMN nodes, in a subset of independent studies. These results are consistent with hierarchical predictive coding; namely, permissive deactivation of DMN at the top of the hierarchy (leading to the widespread cortical activation at lower levels; especially the primary visual cortex). Additional findings indicate REM-locked cerebral vasodilation and suggest putative mechanisms for dream forgetting.
Collapse
Affiliation(s)
- Charles Chong-Hwa Hong
- Patuxent Institution, Correctional Mental Health Center—Jessup, Jessup, MD 20794, USA
- Department of Psychiatry and Behavioral Sciences, The Johns Hopkins University, Baltimore, MD 21205, USA
- Correspondence: ; Tel.: +1-410-596-1956
| | - James H. Fallon
- Department of Anatomy and Neurobiology, University of California, Irvine, CA 92697, USA;
- Department of Psychiatry and Human Behavior, University of California, Irvine, CA 92697, USA
| | - Karl J. Friston
- The Well Come Centre for Human Neuroimaging, Institute of Neurology, University College London, London WC1N 3AR, UK;
| |
Collapse
|
23
|
Park HJ, Eo J, Pae C, Son J, Park SM, Kang J. State-Dependent Effective Connectivity in Resting-State fMRI. Front Neural Circuits 2021; 15:719364. [PMID: 34776875 PMCID: PMC8579116 DOI: 10.3389/fncir.2021.719364] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 09/22/2021] [Indexed: 01/02/2023] Open
Abstract
The human brain at rest exhibits intrinsic dynamics transitioning among the multiple metastable states of the inter-regional functional connectivity. Accordingly, the demand for exploring the state-specific functional connectivity increases for a deeper understanding of mental diseases. Functional connectivity, however, lacks information about the directed causal influences among the brain regions, called effective connectivity. This study presents the dynamic causal modeling (DCM) framework to explore the state-dependent effective connectivity using spectral DCM for the resting-state functional MRI (rsfMRI). We established the sequence of brain states using the hidden Markov model with the multivariate autoregressive coefficients of rsfMRI, summarizing the functional connectivity. We decomposed the state-dependent effective connectivity using a parametric empirical Bayes scheme that models the effective connectivity of consecutive windows with the time course of the discrete states as regressors. We showed the plausibility of the state-dependent effective connectivity analysis in a simulation setting. To test the clinical applicability, we applied the proposed method to characterize the state- and subtype-dependent effective connectivity of the default mode network in children with combined-type attention deficit hyperactivity disorder (ADHD-C) compared with age-matched, typically developed children (TDC). All 88 children were subtyped according to the occupation times (i.e., dwell times) of the three dominant functional connectivity states, independently of clinical diagnosis. The state-dependent effective connectivity differences between ADHD-C and TDC according to the subtypes and those between the subtypes of ADHD-C were expressed mainly in self-inhibition, magnifying the importance of excitation inhibition balance in the subtyping. These findings provide a clear motivation for decomposing the state-dependent dynamic effective connectivity and state-dependent analysis of the directed coupling in exploring mental diseases.
Collapse
Affiliation(s)
- Hae-Jeong Park
- Department of Nuclear Medicine, Yonsei University College of Medicine, Seoul, South Korea.,Department of Psychiatry, Yonsei University College of Medicine, Seoul, South Korea.,Brain Korea 21 Project, Graduate School of Medical Science, Yonsei University College of Medicine, Seoul, South Korea.,Center for Systems and Translational Brain Science, Institute of Human Complexity and Systems Science, Yonsei University, Seoul, South Korea.,Department of Cognitive Science, Yonsei University, Seoul, South Korea
| | - Jinseok Eo
- Brain Korea 21 Project, Graduate School of Medical Science, Yonsei University College of Medicine, Seoul, South Korea.,Center for Systems and Translational Brain Science, Institute of Human Complexity and Systems Science, Yonsei University, Seoul, South Korea
| | - Chongwon Pae
- Department of Nuclear Medicine, Yonsei University College of Medicine, Seoul, South Korea.,Department of Psychiatry, Yonsei University College of Medicine, Seoul, South Korea.,Brain Korea 21 Project, Graduate School of Medical Science, Yonsei University College of Medicine, Seoul, South Korea.,Center for Systems and Translational Brain Science, Institute of Human Complexity and Systems Science, Yonsei University, Seoul, South Korea
| | - Junho Son
- Brain Korea 21 Project, Graduate School of Medical Science, Yonsei University College of Medicine, Seoul, South Korea.,Center for Systems and Translational Brain Science, Institute of Human Complexity and Systems Science, Yonsei University, Seoul, South Korea
| | - Sung Min Park
- Department of Nuclear Medicine, Yonsei University College of Medicine, Seoul, South Korea.,Department of Psychiatry, Yonsei University College of Medicine, Seoul, South Korea
| | - Jiyoung Kang
- Department of Nuclear Medicine, Yonsei University College of Medicine, Seoul, South Korea.,Department of Psychiatry, Yonsei University College of Medicine, Seoul, South Korea.,Brain Korea 21 Project, Graduate School of Medical Science, Yonsei University College of Medicine, Seoul, South Korea.,Center for Systems and Translational Brain Science, Institute of Human Complexity and Systems Science, Yonsei University, Seoul, South Korea
| |
Collapse
|
24
|
Rudrauf D, Sergeant-Perthuis G, Belli O, Tisserand Y, Di Marzo Serugendo G. Modeling the subjective perspective of consciousness and its role in the control of behaviours. J Theor Biol 2021; 534:110957. [PMID: 34742776 DOI: 10.1016/j.jtbi.2021.110957] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2021] [Revised: 10/20/2021] [Accepted: 10/28/2021] [Indexed: 10/19/2022]
Abstract
Consciousness has been hypothesized to operate as a global workspace, which accesses and integrates multimodal information in a uni_ed manner, supports expectation violation monitoring and reduction, and the motivation, programming and control of action. One important yet open issue concerns how the subjective perspective at the core of consciousness, and subjective properties of manifestation of the environment in such perspective as an embodied experience, play a role in such process. We operationalised the concept of subjective perspective using the principles of the Projective Consciousness Model (PCM), based on the projective geometrical concept of Field of Consciousness. We show how these principles can account for documented relationships between appraisal and distance as an inverse distance law, yield a generative model of a_ective and epistemic drives based on purely subjective parameters, such as the apparent size of objects, and can be generalised to implement Theory of Mind, in a manner that is consistent with simulation theory. We used simulations of arti_cial agents, based on psychological rationale, to demonstrate how different model parameters could generate a variety of emergent adaptive and maladaptive behaviours that are relevant to developmental and clinical psychology: the ability to be resilient in the face of obstacles through imaginary projections, the emergence of social approach and joint attention behaviours, the ability to take advantage of false beliefs attributed to others, the emergence of avoidance behaviours as observed in social anxiety disorders, the presence of restricted interests as observed in autism spectrum disorders. The simulation of agents was applied to a speci_c robotic context, and agents' behaviours were demonstrated by controlling the corresponding robots. Our results contribute to advance the scienti_c understanding of the causal relationships between core aspects of the phenomenology of consciousness and its functions in human cybernetics.
Collapse
Affiliation(s)
- D Rudrauf
- FPSE, Section of Psychology, University of Geneva, Geneva, Switzerland; Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland; Computer Science University Center, University of Geneva, Geneva, Switzerland.
| | - G Sergeant-Perthuis
- Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland
| | - O Belli
- Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland; Evolutio, Geneva, Switzerland
| | - Y Tisserand
- FPSE, Section of Psychology, University of Geneva, Geneva, Switzerland; Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland
| | - G Di Marzo Serugendo
- Computer Science University Center, University of Geneva, Geneva, Switzerland; SDS, University of Geneva, Geneva, Switzerland
| |
Collapse
|
25
|
Fox S. Future-Proofing Startups: Stress Management Principles Based on Adaptive Calibration Model and Active Inference Theory. ENTROPY 2021; 23:e23091155. [PMID: 34573780 PMCID: PMC8468633 DOI: 10.3390/e23091155] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Revised: 08/30/2021] [Accepted: 08/31/2021] [Indexed: 12/12/2022]
Abstract
In this paper, the Adaptive Calibration Model (ACM) and Active Inference Theory (AIT) are related to future-proofing startups. ACM encompasses the allocation of energy by the stress response system to alternative options for action, depending upon individuals’ life histories and changing external contexts. More broadly, within AIT, it is posited that humans survive by taking action to align their internal generative models with sensory inputs from external states. The first contribution of the paper is to address the need for future-proofing methods for startups by providing eight stress management principles based on ACM and AIT. Future-proofing methods are needed because, typically, nine out of ten startups do not survive. A second contribution is to relate ACM and AIT to startup life cycle stages. The third contribution is to provide practical examples that show the broader relevance ACM and AIT to organizational practice. These contributions go beyond previous literature concerned with entrepreneurial stress and organizational stress. In particular, rather than focusing on particular stressors, this paper is focused on the recalibrating/updating of startups’ stress responsivity patterns in relation to changes in the internal state of the startup and/or changes in the external state. Overall, the paper makes a contribution to relating physics of life constructs concerned with energy, action and ecological fitness to human organizations.
Collapse
Affiliation(s)
- Stephen Fox
- VTT Technical Research Centre of Finland, FI-02150 Espoo, Finland
| |
Collapse
|
26
|
Sandved-Smith L, Hesp C, Mattout J, Friston K, Lutz A, Ramstead MJD. Towards a computational phenomenology of mental action: modelling meta-awareness and attentional control with deep parametric active inference. Neurosci Conscious 2021; 2021:niab018. [PMID: 34457352 PMCID: PMC8396119 DOI: 10.1093/nc/niab018] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 06/23/2021] [Accepted: 07/14/2021] [Indexed: 11/29/2022] Open
Abstract
Meta-awareness refers to the capacity to explicitly notice the current content of consciousness and has been identified as a key component for the successful control of cognitive states, such as the deliberate direction of attention. This paper proposes a formal model of meta-awareness and attentional control using hierarchical active inference. To do so, we cast mental action as policy selection over higher-level cognitive states and add a further hierarchical level to model meta-awareness states that modulate the expected confidence (precision) in the mapping between observations and hidden cognitive states. We simulate the example of mind-wandering and its regulation during a task involving sustained selective attention on a perceptual object. This provides a computational case study for an inferential architecture that is apt to enable the emergence of these central components of human phenomenology, namely, the ability to access and control cognitive states. We propose that this approach can be generalized to other cognitive states, and hence, this paper provides the first steps towards the development of a computational phenomenology of mental action and more broadly of our ability to monitor and control our own cognitive states. Future steps of this work will focus on fitting the model with qualitative, behavioural, and neural data.
Collapse
Affiliation(s)
- Lars Sandved-Smith
- Lyon Neuroscience Research Centre, INSERM U1028, CNRS UMR5292, Lyon 1 University, 95 Bd Pinel, Lyon 69500, France
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
| | - Casper Hesp
- Department of Developmental Psychology, University of Amsterdam, Science Park 904, Amsterdam 1098 XH, Netherlands
- Amsterdam Brain and Cognition Centre, University of Amsterdam, Science Park 904, Amsterdam 1098 XH, Netherlands
- Institute for Advanced Study, University of Amsterdam, Oude Turfmarkt 147, Amsterdam 1012 GC, Netherlands
| | - Jérémie Mattout
- Lyon Neuroscience Research Centre, INSERM U1028, CNRS UMR5292, Lyon 1 University, 95 Bd Pinel, Lyon 69500, France
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
| | - Antoine Lutz
- Lyon Neuroscience Research Centre, INSERM U1028, CNRS UMR5292, Lyon 1 University, 95 Bd Pinel, Lyon 69500, France
| | - Maxwell J D Ramstead
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
- Division of Social and Transcultural Psychiatry, Department of Psychiatry, McGill University, Montreal, 1033 Pine Ave W, QC H3A 1A1, Canada
- Culture, Mind, and Brain Program, McGill University, Montreal, 1033 Pine Ave W, QC H3A 1A1, Canada
| |
Collapse
|
27
|
Parr T, Rikhye RV, Halassa MM, Friston KJ. Prefrontal Computation as Active Inference. Cereb Cortex 2021; 30:682-695. [PMID: 31298270 PMCID: PMC7444741 DOI: 10.1093/cercor/bhz118] [Citation(s) in RCA: 30] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2019] [Revised: 05/01/2019] [Accepted: 05/11/2019] [Indexed: 12/22/2022] Open
Abstract
The prefrontal cortex is vital for a range of cognitive processes, including working memory, attention, and decision-making. Notably, its absence impairs the performance of tasks requiring the maintenance of information through a delay period. In this paper, we formulate a rodent task—which requires maintenance of delay-period activity—as a Markov decision process and treat optimal task performance as an (active) inference problem. We simulate the behavior of a Bayes optimal mouse presented with 1 of 2 cues that instructs the selection of concurrent visual and auditory targets on a trial-by-trial basis. Formulating inference as message passing, we reproduce features of neuronal coupling within and between prefrontal regions engaged by this task. We focus on the micro-circuitry that underwrites delay-period activity and relate it to functional specialization within the prefrontal cortex in primates. Finally, we simulate the electrophysiological correlates of inference and demonstrate the consequences of lesions to each part of our in silico prefrontal cortex. In brief, this formulation suggests that recurrent excitatory connections—which support persistent neuronal activity—encode beliefs about transition probabilities over time. We argue that attentional modulation can be understood as the contextualization of sensory input by these persistent beliefs.
Collapse
Affiliation(s)
- Thomas Parr
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, WC1N 3BG, UK
| | - Rajeev Vijay Rikhye
- Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.,McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA
| | - Michael M Halassa
- Department of Brain and Cognitive Science, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.,McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139, USA.,Stanley Center for Psychiatric Genetics, Broad Institute, Cambridge, MA 02139, USA
| | - Karl J Friston
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, WC1N 3BG, UK
| |
Collapse
|
28
|
Constant A, Clark A, Friston KJ. Representation Wars: Enacting an Armistice Through Active Inference. Front Psychol 2021; 11:598733. [PMID: 33488462 PMCID: PMC7817850 DOI: 10.3389/fpsyg.2020.598733] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2020] [Accepted: 12/08/2020] [Indexed: 12/18/2022] Open
Abstract
Over the last 30 years, representationalist and dynamicist positions in the philosophy of cognitive science have argued over whether neurocognitive processes should be viewed as representational or not. Major scientific and technological developments over the years have furnished both parties with ever more sophisticated conceptual weaponry. In recent years, an enactive generalization of predictive processing – known as active inference – has been proposed as a unifying theory of brain functions. Since then, active inference has fueled both representationalist and dynamicist campaigns. However, we believe that when diving into the formal details of active inference, one should be able to find a solution to the war; if not a peace treaty, surely an armistice of a sort. Based on an analysis of these formal details, this paper shows how both representationalist and dynamicist sensibilities can peacefully coexist within the new territory of active inference.
Collapse
Affiliation(s)
- Axel Constant
- Charles Perkins Centre, The University of Sydney, Sydney, NSW, Australia
| | - Andy Clark
- Department of Philosophy, The University of Sussex, Brighton, United Kingdom.,Department of Informatics, The University of Sussex, Brighton, United Kingdom.,Department of Philosophy, Macquarie University, Sydney, NSW, Australia
| | - Karl J Friston
- Wellcome Trust Centre for Human Neuroimaging, University College London, London, United Kingdom
| |
Collapse
|
29
|
Abstract
The concept of free energy has its origins in 19th century thermodynamics, but has recently found its way into the behavioral and neural sciences, where it has been promoted for its wide applicability and has even been suggested as a fundamental principle of understanding intelligent behavior and brain function. We argue that there are essentially two different notions of free energy in current models of intelligent agency, that can both be considered as applications of Bayesian inference to the problem of action selection: one that appears when trading off accuracy and uncertainty based on a general maximum entropy principle, and one that formulates action selection in terms of minimizing an error measure that quantifies deviations of beliefs and policies from given reference models. The first approach provides a normative rule for action selection in the face of model uncertainty or when information processing capabilities are limited. The second approach directly aims to formulate the action selection problem as an inference problem in the context of Bayesian brain theories, also known as Active Inference in the literature. We elucidate the main ideas and discuss critical technical and conceptual issues revolving around these two notions of free energy that both claim to apply at all levels of decision-making, from the high-level deliberation of reasoning down to the low-level information processing of perception.
Collapse
Affiliation(s)
- Sebastian Gottwald
- Institute of Neural Information Processing, Ulm University, Ulm, Germany
| | - Daniel A. Braun
- Institute of Neural Information Processing, Ulm University, Ulm, Germany
| |
Collapse
|
30
|
Da Costa L, Parr T, Sajid N, Veselic S, Neacsu V, Friston K. Active inference on discrete state-spaces: A synthesis. JOURNAL OF MATHEMATICAL PSYCHOLOGY 2020; 99:102447. [PMID: 33343039 PMCID: PMC7732703 DOI: 10.1016/j.jmp.2020.102447] [Citation(s) in RCA: 73] [Impact Index Per Article: 14.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/17/2020] [Revised: 07/23/2020] [Accepted: 09/03/2020] [Indexed: 05/05/2023]
Abstract
Active inference is a normative principle underwriting perception, action, planning, decision-making and learning in biological or artificial agents. From its inception, its associated process theory has grown to incorporate complex generative models, enabling simulation of a wide range of complex behaviours. Due to successive developments in active inference, it is often difficult to see how its underlying principle relates to process theories and practical implementation. In this paper, we try to bridge this gap by providing a complete mathematical synthesis of active inference on discrete state-space models. This technical summary provides an overview of the theory, derives neuronal dynamics from first principles and relates this dynamics to biological processes. Furthermore, this paper provides a fundamental building block needed to understand active inference for mixed generative models; allowing continuous sensations to inform discrete representations. This paper may be used as follows: to guide research towards outstanding challenges, a practical guide on how to implement active inference to simulate experimental behaviour, or a pointer towards various in-silico neurophysiological responses that may be used to make empirical predictions.
Collapse
Affiliation(s)
- Lancelot Da Costa
- Department of Mathematics, Imperial College London, London, SW7 2RH, United Kingdom
- Wellcome Centre for Human Neuroimaging, University College London, London, WC1N 3AR, United Kingdom
| | - Thomas Parr
- Wellcome Centre for Human Neuroimaging, University College London, London, WC1N 3AR, United Kingdom
| | - Noor Sajid
- Wellcome Centre for Human Neuroimaging, University College London, London, WC1N 3AR, United Kingdom
| | - Sebastijan Veselic
- Wellcome Centre for Human Neuroimaging, University College London, London, WC1N 3AR, United Kingdom
| | - Victorita Neacsu
- Wellcome Centre for Human Neuroimaging, University College London, London, WC1N 3AR, United Kingdom
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, University College London, London, WC1N 3AR, United Kingdom
| |
Collapse
|
31
|
Heins RC, Mirza MB, Parr T, Friston K, Kagan I, Pooresmaeili A. Deep Active Inference and Scene Construction. Front Artif Intell 2020; 3:509354. [PMID: 33733195 PMCID: PMC7861336 DOI: 10.3389/frai.2020.509354] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2019] [Accepted: 09/10/2020] [Indexed: 11/17/2022] Open
Abstract
Adaptive agents must act in intrinsically uncertain environments with complex latent structure. Here, we elaborate a model of visual foraging-in a hierarchical context-wherein agents infer a higher-order visual pattern (a "scene") by sequentially sampling ambiguous cues. Inspired by previous models of scene construction-that cast perception and action as consequences of approximate Bayesian inference-we use active inference to simulate decisions of agents categorizing a scene in a hierarchically-structured setting. Under active inference, agents develop probabilistic beliefs about their environment, while actively sampling it to maximize the evidence for their internal generative model. This approximate evidence maximization (i.e., self-evidencing) comprises drives to both maximize rewards and resolve uncertainty about hidden states. This is realized via minimization of a free energy functional of posterior beliefs about both the world as well as the actions used to sample or perturb it, corresponding to perception and action, respectively. We show that active inference, in the context of hierarchical scene construction, gives rise to many empirical evidence accumulation phenomena, such as noise-sensitive reaction times and epistemic saccades. We explain these behaviors in terms of the principled drives that constitute the expected free energy, the key quantity for evaluating policies under active inference. In addition, we report novel behaviors exhibited by these active inference agents that furnish new predictions for research on evidence accumulation and perceptual decision-making. We discuss the implications of this hierarchical active inference scheme for tasks that require planned sequences of information-gathering actions to infer compositional latent structure (such as visual scene construction and sentence comprehension). This work sets the stage for future experiments to investigate active inference in relation to other formulations of evidence accumulation (e.g., drift-diffusion models) in tasks that require planning in uncertain environments with higher-order structure.
Collapse
Affiliation(s)
- R. Conor Heins
- Department of Collective Behaviour, Max Planck Institute for Animal Behavior, Konstanz, Germany
- Perception and Cognition Group, European Neuroscience Institute, A Joint Initiative of the University Medical Centre Göttingen and the Max-Planck-Society, Göttingen, Germany
- Leibniz Science Campus “Primate Cognition”, Göttingen, Germany
| | - M. Berk Mirza
- Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
- The National Institute for Health Research (NIHR) Maudsley Biomedical Research Centre (BRC) at South London and Maudsley National Health Service (NHS) Foundation Trust and The Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| | - Thomas Parr
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, University College London, London, United Kingdom
| | - Igor Kagan
- Leibniz Science Campus “Primate Cognition”, Göttingen, Germany
- Decision and Awareness Group, Cognitive Neuroscience Laboratory, German Primate Centre (DPZ), Göttingen, Germany
| | - Arezoo Pooresmaeili
- Perception and Cognition Group, European Neuroscience Institute, A Joint Initiative of the University Medical Centre Göttingen and the Max-Planck-Society, Göttingen, Germany
- Leibniz Science Campus “Primate Cognition”, Göttingen, Germany
| |
Collapse
|
32
|
Sajid N, Parr T, Hope TM, Price CJ, Friston KJ. Degeneracy and Redundancy in Active Inference. Cereb Cortex 2020; 30:5750-5766. [PMID: 32488244 PMCID: PMC7899066 DOI: 10.1093/cercor/bhaa148] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2020] [Revised: 05/11/2020] [Accepted: 05/11/2020] [Indexed: 12/16/2022] Open
Abstract
The notions of degeneracy and redundancy are important constructs in many areas, ranging from genomics through to network science. Degeneracy finds a powerful role in neuroscience, explaining key aspects of distributed processing and structure-function relationships in the brain. For example, degeneracy accounts for the superadditive effect of lesions on functional deficits in terms of a "many-to-one" structure-function mapping. In this paper, we offer a principled account of degeneracy and redundancy, when function is operationalized in terms of active inference, namely, a formulation of perception and action as belief updating under generative models of the world. In brief, "degeneracy" is quantified by the "entropy" of posterior beliefs about the causes of sensations, while "redundancy" is the "complexity" cost incurred by forming those beliefs. From this perspective, degeneracy and redundancy are complementary: Active inference tries to minimize redundancy while maintaining degeneracy. This formulation is substantiated using statistical and mathematical notions of degenerate mappings and statistical efficiency. We then illustrate changes in degeneracy and redundancy during the learning of a word repetition task. Finally, we characterize the effects of lesions-to intrinsic and extrinsic connections-using in silico disconnections. These numerical analyses highlight the fundamental difference between degeneracy and redundancy-and how they score distinct imperatives for perceptual inference and structure learning that are relevant to synthetic and biological intelligence.
Collapse
Affiliation(s)
- Noor Sajid
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK
| | - Thomas Parr
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK
| | - Thomas M Hope
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK
| | - Cathy J Price
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK
| | - Karl J Friston
- Wellcome Centre for Human Neuroimaging, UCL Queen Square Institute of Neurology, London, WC1N 3AR, UK
| |
Collapse
|
33
|
Rollwage M, Loosen A, Hauser TU, Moran R, Dolan RJ, Fleming SM. Confidence drives a neural confirmation bias. Nat Commun 2020; 11:2634. [PMID: 32457308 PMCID: PMC7250867 DOI: 10.1038/s41467-020-16278-6] [Citation(s) in RCA: 62] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2019] [Accepted: 04/23/2020] [Indexed: 11/09/2022] Open
Abstract
A prominent source of polarised and entrenched beliefs is confirmation bias, where evidence against one's position is selectively disregarded. This effect is most starkly evident when opposing parties are highly confident in their decisions. Here we combine human magnetoencephalography (MEG) with behavioural and neural modelling to identify alterations in post-decisional processing that contribute to the phenomenon of confirmation bias. We show that holding high confidence in a decision leads to a striking modulation of post-decision neural processing, such that integration of confirmatory evidence is amplified while disconfirmatory evidence processing is abolished. We conclude that confidence shapes a selective neural gating for choice-consistent information, reducing the likelihood of changes of mind on the basis of new information. A central role for confidence in shaping the fidelity of evidence accumulation indicates that metacognitive interventions may help ameliorate this pervasive cognitive bias.
Collapse
Affiliation(s)
- Max Rollwage
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK.
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK.
| | - Alisa Loosen
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK
| | - Tobias U Hauser
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK
| | - Rani Moran
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK
| | - Raymond J Dolan
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK
| | - Stephen M Fleming
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3BG, UK
- Max Planck University College London Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK
- Department of Experimental Psychology, University College London, London WC1H 0AP, UK
| |
Collapse
|
34
|
Demekas D, Parr T, Friston KJ. An Investigation of the Free Energy Principle for Emotion Recognition. Front Comput Neurosci 2020; 14:30. [PMID: 32390817 PMCID: PMC7189749 DOI: 10.3389/fncom.2020.00030] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2019] [Accepted: 03/23/2020] [Indexed: 01/23/2023] Open
Abstract
This paper offers a prospectus of what might be achievable in the development of emotional recognition devices. It provides a conceptual overview of the free energy principle; including Markov blankets, active inference, and-in particular-a discussion of selfhood and theory of mind, followed by a brief explanation of how these concepts can explain both neural and cultural models of emotional inference. The underlying hypothesis is that emotion recognition and inference devices will evolve from state-of-the-art deep learning models into active inference schemes that go beyond marketing applications and become adjunct to psychiatric practice. Specifically, this paper proposes that a second wave of emotion recognition devices will be equipped with an emotional lexicon (or the ability to epistemically search for one), allowing the device to resolve uncertainty about emotional states by actively eliciting responses from the user and learning from these responses. Following this, a third wave of emotional devices will converge upon the user's generative model, resulting in the machine and human engaging in a reciprocal, prosocial emotional interaction, i.e., sharing a generative model of emotional states.
Collapse
Affiliation(s)
- Daphne Demekas
- Department of Mathematics, University College London, London, United Kingdom
| | - Thomas Parr
- Department of Mathematics, University College London, London, United Kingdom
| | - Karl J. Friston
- Wellcome Trust Centre for Neuroimaging, University College London, London, United Kingdom
| |
Collapse
|
35
|
Mazor M, Friston KJ, Fleming SM. Distinct neural contributions to metacognition for detecting, but not discriminating visual stimuli. eLife 2020; 9:e53900. [PMID: 32310086 PMCID: PMC7170652 DOI: 10.7554/elife.53900] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2019] [Accepted: 03/24/2020] [Indexed: 01/07/2023] Open
Abstract
Being confident in whether a stimulus is present or absent (a detection judgment) is qualitatively distinct from being confident in the identity of that stimulus (a discrimination judgment). In particular, in detection, evidence can only be available for the presence, not the absence, of a target object. This asymmetry suggests that higher-order cognitive and neural processes may be required for confidence in detection, and more specifically, in judgments about absence. In a within-subject, pre-registered and performance-matched fMRI design, we observed quadratic confidence effects in frontopolar cortex for detection but not discrimination. Furthermore, in the right temporoparietal junction, confidence effects were enhanced for judgments of target absence compared to judgments of target presence. We interpret these findings as reflecting qualitative differences between a neural basis for metacognitive evaluation of detection and discrimination, potentially in line with counterfactual or higher-order models of confidence formation in detection.
Collapse
Affiliation(s)
- Matan Mazor
- Wellcome Centre for Human Neuroimaging, University College LondonLondonUnited Kingdom
| | - Karl J Friston
- Wellcome Centre for Human Neuroimaging, University College LondonLondonUnited Kingdom
| | - Stephen M Fleming
- Wellcome Centre for Human Neuroimaging, University College LondonLondonUnited Kingdom
- Max Planck UCL Centre for Computational Psychiatry and Aging Research, University College LondonLondonUnited Kingdom
- Department of Experimental Psychology, University College LondonLondonUnited Kingdom
| |
Collapse
|
36
|
Todo M. Towards the interpretation of complex visual hallucinations in terms of self-reorganization of neural networks. Neurosci Res 2020; 156:147-158. [PMID: 32112785 DOI: 10.1016/j.neures.2020.02.009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2019] [Revised: 10/25/2019] [Accepted: 12/28/2019] [Indexed: 10/24/2022]
Abstract
Patients suffering from dementia with Lewy body (DLB) often see complex visual hallucinations (CVH). Despite many pathological, clinical, and neuroimaging studies, the mechanism of CVH remains unknown. One possible scenario is that top-down information is being used to compensate for the lack of bottom-up information. To investigate this possibility and understand the underlying mathematical structure of the CVH mechanism, we propose a simple computational model of synaptic plasticity with particular focus on the effect of selective damage to the bottom-up network on self-reorganization. We show neurons that undergo a change in activity from a bottom-up to a top-down network framework during the reorganization process, which can be understood in terms of state transitions. Assuming that the pre-reorganization representation of this neuron remains after reorganization, it is possible to interpret neural response induced by top-down information as the sensation of bottom-up information. This situation might correspond to a hallucinatory situation in DLB patients. Our results agree with existing experimental evidence and provide new insights into data that have hitherto not been experimentally validated on patients with DLB.
Collapse
Affiliation(s)
- Masato Todo
- Department of Mathematics, School of Science, Hokkaido University, Sapporo, Hokkaido, Japan.
| |
Collapse
|
37
|
Miller M, Kiverstein J, Rietveld E. Embodying addiction: A predictive processing account. Brain Cogn 2020; 138:105495. [PMID: 31877434 PMCID: PMC6983939 DOI: 10.1016/j.bandc.2019.105495] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2019] [Revised: 11/08/2019] [Accepted: 11/13/2019] [Indexed: 12/31/2022]
Abstract
In this paper we show how addiction can be thought of as the outcome of learning. We look to the increasingly influential predictive processing theory for an account of how learning can go wrong in addiction. Perhaps counter intuitively, it is a consequence of this predictive processing perspective on addiction that while the brain plays a deep and important role in leading a person into addiction, it cannot be the whole story. We'll argue that predictive processing implies a view of addiction not as a brain disease, but rather as a breakdown in the dynamics of the wider agent-environment system. The environment becomes meaningfully organised around the agent's drug-seeking and using behaviours. Our account of addiction offers a new perspective on what is harmful about addiction. Philosophers often characterise addiction as a mental illness because addicts irrationally shift in their judgement of how they should act based on cues that predict drug use. We argue that predictive processing leads to a different view of what can go wrong in addiction. We suggest that addiction can prove harmful to the person because as their addiction progressively takes hold, the addict comes to embody a predictive model of the environment that fails to adequately attune them to a volatile, dynamic environment. The use of an addictive substance produces illusory feedback of being well-attuned to the environment when the reality is the opposite. This can be comforting for a person inhabiting a hostile niche, but it can also prove to be harmful to the person as they become skilled at living the life of an addict, to the neglect of all other alternatives. The harm in addiction we'll argue is not to be found in the brains of addicts, but in their way of life.
Collapse
Affiliation(s)
- Mark Miller
- Department of Informatics, University of Sussex, Sussex House, Falmer, Brighton BN1 9RH, United Kingdom.
| | - Julian Kiverstein
- Amsterdam University Medical Center, Department of Psychiatry, University of Amsterdam, Amsterdam, the Netherlands; Amsterdam Brain and Cognition Centre, University of Amsterdam, Amsterdam, the Netherlands.
| | - Erik Rietveld
- Amsterdam University Medical Center, Department of Psychiatry, University of Amsterdam, Amsterdam, the Netherlands; Department of Philosophy, Institute for Logic, Language and Computation, University of Amsterdam, the Netherlands; Department of Philosophy, University of Twente, Enschede, the Netherlands; Amsterdam Brain and Cognition Centre, University of Amsterdam, Amsterdam, the Netherlands.
| |
Collapse
|
38
|
Trujillo LT. Mental Effort and Information-Processing Costs Are Inversely Related to Global Brain Free Energy During Visual Categorization. Front Neurosci 2019; 13:1292. [PMID: 31866809 PMCID: PMC6906157 DOI: 10.3389/fnins.2019.01292] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2019] [Accepted: 11/14/2019] [Indexed: 12/19/2022] Open
Abstract
Mental effort is a neurocognitive process that reflects the controlled expenditure of psychological information-processing resources during perception, cognition, and action. There is a practical need to operationalize and measure mental effort in order to minimize detrimental effects of mental fatigue on real-world human performance. Previous research has identified several neurocognitive indices of mental effort, but these indices are indirect measures that are also sensitive to experimental demands or general factors such as sympathetic arousal. The present study investigated a potential direct neurocognitive index of mental effort based in theories where bounded rational decision makers (realized as embodied brains) are modeled as generalized thermodynamic systems. This index is called free energy, an information-theoretic system property of the brain that reflects the difference between the brain's current and predicted states. Theory predicts that task-related differences in a decision makers' free energy are inversely related to information-processing costs related to task decisions. The present study tested this prediction by quantifying global brain free energy from electroencephalographic (EEG) measures of human brain function. EEG signals were recorded while participants engaged in two visual categorization tasks in which categorization decisions resulted from the allocation of different levels of mental information processing resources. A novel method was developed to quantify brain free energy from machine learning classification of EEG trials. Participant information-processing resource costs were estimated via computational analysis of behavior, whereas the subjective expression of mental effort was estimated via participant ratings of mental workload. Following theoretical predictions, task-related differences in brain free energy negatively correlated with increased allocation of information-processing resource costs. These brain free energy differences were smaller for the visual categorization task that required a greater versus lesser allocation of information-processing resources. Ratings of mental workload were positively correlated with information-processing resource costs, and negatively correlated with global brain free energy differences, only for the categorization task requiring the larger amount of information-processing resource costs. These findings support theoretical thermodynamic approaches to decision making and provide the first empirical evidence of a relationship between mental effort, brain free energy, and neurocognitive information-processing.
Collapse
Affiliation(s)
- Logan T Trujillo
- Department of Psychology, Texas State University, San Marcos, TX, United States
| |
Collapse
|
39
|
Parr T, Friston KJ. Generalised free energy and active inference. BIOLOGICAL CYBERNETICS 2019; 113:495-513. [PMID: 31562544 PMCID: PMC6848054 DOI: 10.1007/s00422-019-00805-w] [Citation(s) in RCA: 75] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/04/2017] [Accepted: 09/13/2019] [Indexed: 05/30/2023]
Abstract
Active inference is an approach to understanding behaviour that rests upon the idea that the brain uses an internal generative model to predict incoming sensory data. The fit between this model and data may be improved in two ways. The brain could optimise probabilistic beliefs about the variables in the generative model (i.e. perceptual inference). Alternatively, by acting on the world, it could change the sensory data, such that they are more consistent with the model. This implies a common objective function (variational free energy) for action and perception that scores the fit between an internal model and the world. We compare two free energy functionals for active inference in the framework of Markov decision processes. One of these is a functional of beliefs (i.e. probability distributions) about states and policies, but a function of observations, while the second is a functional of beliefs about all three. In the former (expected free energy), prior beliefs about outcomes are not part of the generative model (because they are absorbed into the prior over policies). Conversely, in the second (generalised free energy), priors over outcomes become an explicit component of the generative model. When using the free energy function, which is blind to future observations, we equip the generative model with a prior over policies that ensure preferred (i.e. priors over) outcomes are realised. In other words, if we expect to encounter a particular kind of outcome, this lends plausibility to those policies for which this outcome is a consequence. In addition, this formulation ensures that selected policies minimise uncertainty about future outcomes by minimising the free energy expected in the future. When using the free energy functional-that effectively treats future observations as hidden states-we show that policies are inferred or selected that realise prior preferences by minimising the free energy of future expectations. Interestingly, the form of posterior beliefs about policies (and associated belief updating) turns out to be identical under both formulations, but the quantities used to compute them are not.
Collapse
Affiliation(s)
- Thomas Parr
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London, WC1N 3BG UK
| | - Karl J. Friston
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London, WC1N 3BG UK
| |
Collapse
|
40
|
Parr T, Corcoran AW, Friston KJ, Hohwy J. Perceptual awareness and active inference. Neurosci Conscious 2019; 2019:niz012. [PMID: 31528360 PMCID: PMC6734140 DOI: 10.1093/nc/niz012] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2019] [Revised: 05/24/2019] [Accepted: 07/28/2019] [Indexed: 12/16/2022] Open
Abstract
Perceptual awareness depends upon the way in which we engage with our sensorium. This notion is central to active inference, a theoretical framework that treats perception and action as inferential processes. This variational perspective on cognition formalizes the notion of perception as hypothesis testing and treats actions as experiments that are designed (in part) to gather evidence for or against alternative hypotheses. The common treatment of perception and action affords a useful interpretation of certain perceptual phenomena whose active component is often not acknowledged. In this article, we start by considering Troxler fading - the dissipation of a peripheral percept during maintenance of fixation, and its recovery during free (saccadic) exploration. This offers an important example of the failure to maintain a percept without actively interrogating a visual scene. We argue that this may be understood in terms of the accumulation of uncertainty about a hypothesized stimulus when free exploration is disrupted by experimental instructions or pathology. Once we take this view, we can generalize the idea of using bodily (oculomotor) action to resolve uncertainty to include the use of mental (attentional) actions for the same purpose. This affords a useful way to think about binocular rivalry paradigms, in which perceptual changes need not be associated with an overt movement.
Collapse
Affiliation(s)
- Thomas Parr
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, Institute of Neurology, 12 Queen Square, London, UK
| | - Andrew W Corcoran
- Cognition & Philosophy Laboratory, Department of Philosophy, Monash University, Melbourne, Australia
| | - Karl J Friston
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, Institute of Neurology, 12 Queen Square, London, UK
| | - Jakob Hohwy
- Cognition & Philosophy Laboratory, Department of Philosophy, Monash University, Melbourne, Australia
| |
Collapse
|
41
|
Benrimoh D, Parr T, Adams RA, Friston K. Hallucinations both in and out of context: An active inference account. PLoS One 2019; 14:e0212379. [PMID: 31430277 PMCID: PMC6701798 DOI: 10.1371/journal.pone.0212379] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2019] [Accepted: 08/03/2019] [Indexed: 12/19/2022] Open
Abstract
Hallucinations, including auditory verbal hallucinations (AVH), occur in both the healthy population and in psychotic conditions such as schizophrenia (often developing after a prodromal period). In addition, hallucinations can be in-context (they can be consistent with the environment, such as when one hallucinates the end of a sentence that has been repeated many times), or out-of-context (such as the bizarre hallucinations associated with schizophrenia). In previous work, we introduced a model of hallucinations as false (positive) inferences based on a (Markov decision process) formulation of active inference. In this work, we extend this model to include content–to disclose the computational mechanisms behind in- and out-of-context hallucinations. In active inference, sensory information is used to disambiguate alternative hypotheses about the causes of sensations. Sensory information is balanced against prior beliefs, and when this balance is tipped in the favor of prior beliefs, hallucinations can occur. We show that in-context hallucinations arise when (simulated) subjects cannot use sensory information to correct prior beliefs about hearing a voice, but beliefs about content (i.e. the sequential order of a sentence) remain accurate. When hallucinating subjects also have inaccurate beliefs about state transitions, out-of-context hallucinations occur; i.e. their hallucinated speech content is disordered. Note that out-of-context hallucinations in this setting does not refer to inference about context, but rather to false perceptual inference that emerges when the confidence in–or precision of–sensory evidence is reduced. Furthermore, subjects with inaccurate beliefs about state transitions but an intact ability to use sensory information do not hallucinate and are reminiscent of prodromal patients. This work demonstrates the different computational mechanisms that may underlie the spectrum of hallucinatory experience–from the healthy population to psychotic states.
Collapse
Affiliation(s)
- David Benrimoh
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, England, United Kingdom
- McGill University, Department of Psychiatry, Montreal, Canada
- * E-mail:
| | - Thomas Parr
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, England, United Kingdom
| | - Rick A. Adams
- Division of Psychiatry, University College London, London, England, United Kingdom
- Institute of Cognitive Neuroscience, University College London, London, England, United Kingdom
| | - Karl Friston
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, England, United Kingdom
| |
Collapse
|
42
|
Abstract
Many physiological and pathological changes in brain function manifest in eye-movement control. As such, assessment of oculomotion is an invaluable part of a clinical examination and affords a non-invasive window on several key aspects of neuronal computation. While oculomotion is often used to detect deficits of the sort associated with vascular or neoplastic events; subtler (e.g. pharmacological) effects on neuronal processing also induce oculomotor changes. We have previously framed oculomotor control as part of active vision, namely, a process of inference comprising two distinct but related challenges. The first is inferring where to look, and the second is inferring how to implement the selected action. In this paper, we draw from recent theoretical work on the neuromodulatory control of active inference. This allows us to simulate the sort of changes we would expect in oculomotor behaviour, following pharmacological enhancement or suppression of key neuromodulators-in terms of deciding where to look and the ensuing trajectory of the eye movement itself. We focus upon the influence of cholinergic and GABAergic agents on the speed of saccades, and consider dopaminergic and noradrenergic effects on more complex, memory-guided, behaviour. In principle, a computational approach to understanding the relationship between pharmacology and oculomotor behaviour affords the opportunity to estimate the influence of a given pharmaceutical upon neuronal function, and to use this to optimise therapeutic interventions on an individual basis.
Collapse
Affiliation(s)
- Thomas Parr
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London, WC1N 3BG UK
| | - Karl J Friston
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, 12 Queen Square, London, WC1N 3BG UK
| |
Collapse
|
43
|
Harrison LA, Kats A, Williams ME, Aziz-Zadeh L. The Importance of Sensory Processing in Mental Health: A Proposed Addition to the Research Domain Criteria (RDoC) and Suggestions for RDoC 2.0. Front Psychol 2019; 10:103. [PMID: 30804830 PMCID: PMC6370662 DOI: 10.3389/fpsyg.2019.00103] [Citation(s) in RCA: 58] [Impact Index Per Article: 9.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2018] [Accepted: 01/14/2019] [Indexed: 12/21/2022] Open
Abstract
The time is ripe to integrate burgeoning evidence of the important role of sensory and motor functioning in mental health within the National Institute of Mental Health's [NIMH] Research Domain Criteria [RDoC] framework (National Institute of Mental Health, n.d.a), a multi-dimensional method of characterizing mental functioning in health and disease across all neurobiological levels of analysis ranging from genetic to behavioral. As the importance of motor processing in psychopathology has been recognized (Bernard and Mittal, 2015; Garvey and Cuthbert, 2017; National Institute of Mental Health, 2019), here we focus on sensory processing. First, we review the current design of the RDoC matrix, noting sensory features missing despite their prevalence in multiple mental illnesses. We identify two missing classes of sensory symptoms that we widely define as (1) sensory processing, including sensory sensitivity and active sensing, and (2) domains of perceptual signaling, including interoception and proprioception, which are currently absent or underdeveloped in the perception construct of the cognitive systems domain. Then, we describe the neurobiological basis of these psychological constructs and examine why these sensory features are important for understanding psychopathology. Where appropriate, we examine links between sensory processing and the domains currently included in the RDoC matrix. Throughout, we emphasize how the addition of these sensory features to the RDoC matrix is important for understanding a range of mental health disorders. We conclude with the suggestion that a separate sensation and perception domain can enhance the current RDoC framework, while discussing what we see as important principles and promising directions for the future development and use of the RDoC.
Collapse
Affiliation(s)
- Laura A. Harrison
- USC Chan Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA, United States
- Brain and Creativity Institute, University of Southern California, Los Angeles, CA, United States
| | - Anastasiya Kats
- Brain and Creativity Institute, University of Southern California, Los Angeles, CA, United States
| | - Marian E. Williams
- Children’s Hospital Los Angeles, University of Southern California, Los Angeles, CA, United States
| | - Lisa Aziz-Zadeh
- USC Chan Division of Occupational Science and Occupational Therapy, University of Southern California, Los Angeles, CA, United States
- Brain and Creativity Institute, University of Southern California, Los Angeles, CA, United States
| |
Collapse
|
44
|
Parr T, Friston KJ. The Anatomy of Inference: Generative Models and Brain Structure. Front Comput Neurosci 2018; 12:90. [PMID: 30483088 PMCID: PMC6243103 DOI: 10.3389/fncom.2018.00090] [Citation(s) in RCA: 85] [Impact Index Per Article: 12.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2018] [Accepted: 10/25/2018] [Indexed: 01/02/2023] Open
Abstract
To infer the causes of its sensations, the brain must call on a generative (predictive) model. This necessitates passing local messages between populations of neurons to update beliefs about hidden variables in the world beyond its sensory samples. It also entails inferences about how we will act. Active inference is a principled framework that frames perception and action as approximate Bayesian inference. This has been successful in accounting for a wide range of physiological and behavioral phenomena. Recently, a process theory has emerged that attempts to relate inferences to their neurobiological substrates. In this paper, we review and develop the anatomical aspects of this process theory. We argue that the form of the generative models required for inference constrains the way in which brain regions connect to one another. Specifically, neuronal populations representing beliefs about a variable must receive input from populations representing the Markov blanket of that variable. We illustrate this idea in four different domains: perception, planning, attention, and movement. In doing so, we attempt to show how appealing to generative models enables us to account for anatomical brain architectures. Ultimately, committing to an anatomical theory of inference ensures we can form empirical hypotheses that can be tested using neuroimaging, neuropsychological, and electrophysiological experiments.
Collapse
Affiliation(s)
- Thomas Parr
- Wellcome Centre for Human Neuroimaging, Institute of Neurology, University College London, London, United Kingdom
| | | |
Collapse
|