A tale of two densities: active inference is enactive inference

Predictive Processing in Cognitive Robotics: A Review

Predictive processing has become an influential framework in cognitive sciences. This framework turns the traditional view of perception upside down, claiming that the main flow of information processing is realized in a top-down, hierarchical manner. Furthermore, it aims at unifying perception, cognition, and action as a single inferential process. However, in the related literature, the predictive processing framework and its associated schemes, such as predictive coding, active inference, perceptual inference, and free-energy principle, tend to be used interchangeably. In the field of cognitive robotics, there is no clear-cut distinction on which schemes have been implemented and under which assumptions. In this letter, working definitions are set with the main aim of analyzing the state of the art in cognitive robotics research working under the predictive processing framework as well as some related nonrobotic models. The analysis suggests that, first, research in both cognitive robotics implementations and nonrobotic models needs to be extended to the study of how multiple exteroceptive modalities can be integrated into prediction error minimization schemes. Second, a relevant distinction found here is that cognitive robotics implementations tend to emphasize the learning of a generative model, while in nonrobotics models, it is almost absent. Third, despite the relevance for active inference, few cognitive robotics implementations examine the issues around control and whether it should result from the substitution of inverse models with proprioceptive predictions. Finally, limited attention has been placed on precision weighting and the tracking of prediction error dynamics. These mechanisms should help to explore more complex behaviors and tasks in cognitive robotics research under the predictive processing framework.

Information Theory for Agents in Artificial Intelligence, Psychology, and Economics

This review looks at some of the central relationships between artificial intelligence, psychology, and economics through the lens of information theory, specifically focusing on formal models of decision-theory. In doing so we look at a particular approach that each field has adopted and how information theory has informed the development of the ideas of each field. A key theme is expected utility theory, its connection to information theory, the Bayesian approach to decision-making and forms of (bounded) rationality. What emerges from this review is a broadly unified formal perspective derived from three very different starting points that reflect the unique principles of each field. Each of the three approaches reviewed can, in principle at least, be implemented in a computational model in such a way that, with sufficient computational power, they could be compared with human abilities in complex tasks. However, a central critique that can be applied to all three approaches was first put forward by Savage in The Foundations of Statistics and recently brought to the fore by the economist Binmore: Bayesian approaches to decision-making work in what Savage called ‘small worlds’ but cannot work in ‘large worlds’. This point, in various different guises, is central to some of the current debates about the power of artificial intelligence and its relationship to human-like learning and decision-making. Recent work on artificial intelligence has gone some way to bridging this gap but significant questions remain to be answered in all three fields in order to make progress in producing realistic models of human decision-making in the real world in which we live in.

The Natural Philosophy of Economic Information: Autonomous Agents and Physiosemiosis

Information is a core concept in modern economics, yet its definition and empirical specification is elusive. One reason is the intellectual grip of the Shannon paradigm which marginalizes semantic information. However, a precise concept of economic information must be based on a theory of semantics, since what counts economically is the meaning, function and use of information. This paper introduces a new principled approach to information that adopts the paradigm of biosemiotics, rooted in the philosophy of Charles S. Peirce and builds on recent developments of the thermodynamics of information. Information processing by autonomous agents, defined as autopoietic heat engines, is conceived as physiosemiosis operating according to fundamental thermodynamic principles of information processing, as elucidated in recent work by Kolchinsky and Wolpert (KW). I plug the KW approach into a basic conceptual model of physiosemiosis and present an evolutionary interpretation. This approach has far-reaching implications for economics, such as suggesting an evolutionary view of the economic agent, choice and behavior, which is informed by applications of statistical thermodynamics on the brain.

Examining the Continuity between Life and Mind: Is There a Continuity between Autopoietic Intentionality and Representationality?

A weak version of the life-mind continuity thesis entails that every living system also has a basic mind (with a non-representational form of intentionality). The strong version entails that the same concepts that are sufficient to explain basic minds (with non-representational states) are also central to understanding non-basic minds (with representational states). We argue that recent work on the free energy principle supports the following claims with respect to the life-mind continuity thesis: (i) there is a strong continuity between life and mind; (ii) all living systems can be described as if they had representational states; (iii) the ’as-if representationality’ entailed by the free energy principle is central to understanding both basic forms of intentionality and intentionality in non-basic minds. In addition to this, we argue that the free energy principle also renders realism about computation and representation compatible with a strong life-mind continuity thesis (although the free energy principle does not entail computational and representational realism). In particular, we show how representationality proper can be grounded in ’as-if representationality’.

The Free Energy Principle: Good Science and Questionable Philosophy in a Grand Unifying Theory

The Free Energy Principle (FEP) is currently one of the most promising frameworks with which to address a unified explanation of life-related phenomena. With powerful formalism that embeds a small set of assumptions, it purports to deal with complex adaptive dynamics ranging from barely unicellular organisms to complex cultural manifestations. The FEP has received increased attention in disciplines that study life, including some critique regarding its overall explanatory power and its true potential as a grand unifying theory (GUT). Recently, FEP theorists presented a contribution with the main tenets of their framework, together with possible philosophical interpretations, which lean towards so-called Markovian Monism (MM). The present paper assumes some of the abovementioned critiques, rejects the arguments advanced to invalidate the FEP's potential to be a GUT, and overcomes criticism thereof by reviewing FEP theorists' newly minted metaphysical commitment, namely MM. Specifically, it shows that this philosophical interpretation of the FEP argues circularly and only delivers what it initially assumes, i.e., a dual information geometry that allegedly explains epistemic access to the world based on prior dual assumptions. The origin of this circularity can be traced back to a physical description contingent on relative system-environment separation. However, the FEP itself is not committed to MM, and as a scientific theory it delivers more than what it assumes, serving as a heuristic unification principle that provides epistemic advancement for the life sciences.

Active Inference: Applicability to Different Types of Social Organization Explained through Reference to Industrial Engineering and Quality Management

Active inference is a physics of life process theory of perception, action and learning that is applicable to natural and artificial agents. In this paper, active inference theory is related to different types of practice in social organization. Here, the term social organization is used to clarify that this paper does not encompass organization in biological systems. Rather, the paper addresses active inference in social organization that utilizes industrial engineering, quality management, and artificial intelligence alongside human intelligence. Social organization referred to in this paper can be in private companies, public institutions, other for-profit or not-for-profit organizations, and any combination of them. The relevance of active inference theory is explained in terms of variational free energy, prediction errors, generative models, and Markov blankets. Active inference theory is most relevant to the social organization of work that is highly repetitive. By contrast, there are more challenges involved in applying active inference theory for social organization of less repetitive endeavors such as one-of-a-kind projects. These challenges need to be addressed in order for active inference to provide a unifying framework for different types of social organization employing human and artificial intelligence.

Representation Wars: Enacting an Armistice Through Active Inference

Over the last 30 years, representationalist and dynamicist positions in the philosophy of cognitive science have argued over whether neurocognitive processes should be viewed as representational or not. Major scientific and technological developments over the years have furnished both parties with ever more sophisticated conceptual weaponry. In recent years, an enactive generalization of predictive processing – known as active inference – has been proposed as a unifying theory of brain functions. Since then, active inference has fueled both representationalist and dynamicist campaigns. However, we believe that when diving into the formal details of active inference, one should be able to find a solution to the war; if not a peace treaty, surely an armistice of a sort. Based on an analysis of these formal details, this paper shows how both representationalist and dynamicist sensibilities can peacefully coexist within the new territory of active inference.

Science-Driven Societal Transformation, Part III: Design

Climate change, biodiversity loss, and other major social and environmental problems pose severe risks. Progress has been inadequate and scientists, global policy experts, and the general public increasingly conclude that transformational change is needed across all sectors of society in order to improve and maintain social and ecological wellbeing. At least two paths to transformation are conceivable: (1) reform of and innovation within existing societal systems (e.g., economic, legal, and governance systems); and (2) the de novo development of and migration to new and improved societal systems. This paper is the final in a three-part series of concept papers that together outline a novel science-driven research and development program aimed at the second path. It summarizes literature to build a narrative on the topic of de novo design of societal systems. The purpose is to raise issues, suggest design possibilities, and highlight directions and questions that could be explored in the context of this or any R&D program aimed at new system design. This paper does not present original research, but rather provides a synthesis of selected ideas from the literature. Following other papers in the series, a society is viewed as a superorganism and its societal systems as a cognitive architecture. Accordingly, a central goal of design is to improve the collective cognitive capacity of a society, rendering it more capable of achieving and sustainably maintaining vitality. Topics of attention, communication, self-identity, power, and influence are discussed in relation to societal cognition and system design. A prototypical societal system is described, and some design considerations are highlighted.

Embodied skillful performance: where the action is

When someone masters a skill, their performance looks to us like second nature: it looks as if their actions are smoothly performed without explicit, knowledge-driven, online monitoring of their performance. Contemporary computational models in motor control theory, however, are instructionist: that is, they cast skillful performance as a knowledge-driven process. Optimal motor control theory (OMCT), as representative par excellence of such approaches, casts skillful performance as an instruction, instantiated in the brain, that needs to be executed-a motor command. This paper aims to show the limitations of such instructionist approaches to skillful performance. We specifically address the question of whether the assumption of control-theoretic models is warranted. The first section of this paper examines the instructionist assumption, according to which skillful performance consists of the execution of theoretical instructions harnessed in motor representations. The second and third sections characterize the implementation of motor representations as motor commands, with a special focus on formulations from OMCT. The final sections of this paper examine predictive coding and active inference-behavioral modeling frameworks that descend, but are distinct, from OMCT-and argue that the instructionist, control-theoretic assumptions are ill-motivated in light of new developments in active inference.

Science-Driven Societal Transformation, Part I: Worldview

Humanity faces serious social and environmental problems, including climate change and biodiversity loss. Increasingly, scientists, global policy experts, and the general public conclude that incremental approaches to reduce risk are insufficient and transformative change is needed across all sectors of society. However, the meaning of transformation is still unsettled in the literature, as is the proper role of science in fostering it. This paper is the first in a three-part series that adds to the discussion by proposing a novel science-driven research-and-development program aimed at societal transformation. More than a proposal, it offers a perspective and conceptual framework from which societal transformation might be approached. As part of this, it advances a formal mechanics with which to model and understand self-organizing societies of individuals. While acknowledging the necessity of reform to existing societal systems (e.g., governance, economic, and financial systems), the focus of the series is on transformation understood as systems change or systems migration—the de novo development of and migration to new societal systems. The series provides definitions, aims, reasoning, worldview, and a theory of change, and discusses fitness metrics and design principles for new systems. This first paper proposes a worldview, built using ideas from evolutionary biology, complex systems science, cognitive sciences, and information theory, which is intended to serve as the foundation for the R&D program. Subsequent papers in the series build on the worldview to address fitness metrics, system design, and other topics.

Cognition coming about: Self-organisation and free-energy: Commentary on Wright, J.J. and Bourke, P.D. (2020) "The growth of cognition: Free energy minimization and the embryogenesis of cortical computation"

Wright and Bourke's compelling article rightly points out that existing models of embryogenesis fail to explain the mechanisms and functional significance of the dynamic connections among neurons. We pursue their account of Dynamic Logic by appealing to the Markov blanket formalism that underwrites the Free Energy Principle. We submit that this allows one to model embryogenesis as self-organisation in a dynamical system that minimises free-energy. The ensuing formalism may be extended to also explain the autonomous emergence of cognition, specifically in the brain, as a dynamic self-assembling process.

Is the Free-Energy Principle a Formal Theory of Semantics? From Variational Density Dynamics to Neural and Phenotypic Representations

The aim of this paper is twofold: (1) to assess whether the construct of neural representations plays an explanatory role under the variational free-energy principle and its corollary process theory, active inference; and (2) if so, to assess which philosophical stance-in relation to the ontological and epistemological status of representations-is most appropriate. We focus on non-realist (deflationary and fictionalist-instrumentalist) approaches. We consider a deflationary account of mental representation, according to which the explanatorily relevant contents of neural representations are mathematical, rather than cognitive, and a fictionalist or instrumentalist account, according to which representations are scientifically useful fictions that serve explanatory (and other) aims. After reviewing the free-energy principle and active inference, we argue that the model of adaptive phenotypes under the free-energy principle can be used to furnish a formal semantics, enabling us to assign semantic content to specific phenotypic states (the internal states of a Markovian system that exists far from equilibrium). We propose a modified fictionalist account-an organism-centered fictionalism or instrumentalism. We argue that, under the free-energy principle, pursuing even a deflationary account of the content of neural representations licenses the appeal to the kind of semantic content involved in the 'aboutness' or intentionality of cognitive systems; our position is thus coherent with, but rests on distinct assumptions from, the realist position. We argue that the free-energy principle thereby explains the aboutness or intentionality in living systems and hence their capacity to parse their sensory stream using an ontology or set of semantic factors.

Levels and Norm-Development: A Phenomenological Approach to Enactive-Ecological Norms of Action and Perception

The enactive approach and the skilled intentionality framework are two closely related forms of radical embodied cognition that nonetheless exhibit important differences. In this paper, I focus on a conceptual disparity regarding the normative character of action and perception. Whereas the skilled intentionality framework describes the norms of action and perception as the capacity of embodied agents to become attuned (i.e., skilled intentionality) to preestablished normative frameworks (i.e., situated normativity), the enactive approach describes the same phenomenon as the enactment of norms (i.e., as sense-making) at different levels of organization that go from individual biological agents to linguistic encounters. I will argue that although both accounts accurately recognize important features of the norms of action and perception, they also have significant shortcomings. Norm-attunement accurately sees normative, ecological frameworks as the necessary set of constraints for the existence of norms at play in sociocultural bodily practices, but it fails to acknowledge the temporal and open-ended character of these norms and frameworks. Norm-enactment, by contrast, acknowledges that norms of action and perception are temporally open-ended, but fails to explicitly recognize that environmental normative frameworks are necessary for the enactment and development of all sort of norms in the interactional domain of an agent-environment system. To overcome these problems, I propose an enactive-ecological approach to norms of action and perception. This approach consists in describing norm-enactment as a result of a developmental process I call norm-development. This process describes the enactment of norms from the background of ecological, normative frameworks. These frameworks are norms enacted in the past of the interactional history of the agent-environment system that remain open to new configurations (new norms) in the present. To clarify conceptually norm-development, I appeal to Merleau-Ponty's descriptions of norms of perception, and more particularly to his concept of spatial levels. Like the enactive approach, Merleau-Ponty recognizes that perceptual norms emerge in the interactional history of the agent-environment system, but, like the skilled intentionality framework, he also posits that normative frameworks, that he calls levels, enable and constrain the emergence of perceptual norms and its development. Levels are therefore a phenomenological description of ecological normative frameworks that has been temporally constituted and that stay temporally open-ended as a fundamental requisite for the enactment and development of norms of action and perception.

Thinking through prior bodies: autonomic uncertainty and interoceptive self-inference

The Bayesian brain hypothesis, as formalized by the free-energy principle, is ascendant in cognitive science. But, how does the Bayesian brain obtain prior beliefs? Veissière and colleagues argue that sociocultural interaction is one important source. We offer a complementary model in which “interoceptive self-inference” guides the estimation of expected uncertainty both in ourselves and in our social conspecifics.

Bringing Forth Within: Enhabiting at the Intersection Between Enaction and Ecological Psychology

Baggs and Chemero (2018) propose that certain tensions between enaction and ecological psychology arise due different interpretations about what is meant by the "environment." In the enactive approach the emphasis is on the umwelt, which describes the environment as the "meaningful, lived surroundings of a given individual." The ecological approach, on the other hand, emphasises what they refer to as the habitat "the environment as a set of resources for a typical, or ideal, member of a species." By making this distinction, these authors claim they are able to retain the best of both the ecological and the enactive approaches. Herein I propose an account of the individuation of habits that straddles this distinction, what I call a compatabilist account. This is done in two parts. The first part teases out a host of compatibilities that exist between the enactive account as developed by Di Paolo et al. (2017) and the skilled intentionality framework as developed by Bruineberg and Rietveld (2014) and Rietveld and Kiverstein (2014). In part two these compatibilities are brought together with the that these compatibilities can be brought together with the philosophy of Gilbert Simondon to develop the notion of enhabiting. Enhabiting describes a set of ongoing processes by which an umwelt emerges from and is reproduced within the relationship between an embodied subject and their habitat. Thus, enhabiting points toward a point of intersection between enaction and ecological psychology. To enhabit is bring forth (to enact), within (to inhabit).