1
|
Arumugam D, Ho MK, Goodman ND, Van Roy B. Bayesian Reinforcement Learning With Limited Cognitive Load. Open Mind (Camb) 2024; 8:395-438. [PMID: 38665544 PMCID: PMC11045037 DOI: 10.1162/opmi_a_00132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2023] [Accepted: 02/16/2024] [Indexed: 04/28/2024] Open
Abstract
All biological and artificial agents must act given limits on their ability to acquire and process information. As such, a general theory of adaptive behavior should be able to account for the complex interactions between an agent's learning history, decisions, and capacity constraints. Recent work in computer science has begun to clarify the principles that shape these dynamics by bridging ideas from reinforcement learning, Bayesian decision-making, and rate-distortion theory. This body of work provides an account of capacity-limited Bayesian reinforcement learning, a unifying normative framework for modeling the effect of processing constraints on learning and action selection. Here, we provide an accessible review of recent algorithms and theoretical results in this setting, paying special attention to how these ideas can be applied to studying questions in the cognitive and behavioral sciences.
Collapse
Affiliation(s)
| | - Mark K. Ho
- Center for Data Science, New York University
| | - Noah D. Goodman
- Department of Computer Science, Stanford University
- Department of Psychology, Stanford University
| | - Benjamin Van Roy
- Department of Electrical Engineering, Stanford University
- Department of Management Science & Engineering, Stanford University
| |
Collapse
|
2
|
Thermodynamic fluctuation theorems govern human sensorimotor learning. Sci Rep 2023; 13:869. [PMID: 36650215 PMCID: PMC9845310 DOI: 10.1038/s41598-023-27736-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2022] [Accepted: 01/06/2023] [Indexed: 01/18/2023] Open
Abstract
The application of thermodynamic reasoning in the study of learning systems has a long tradition. Recently, new tools relating perfect thermodynamic adaptation to the adaptation process have been developed. These results, known as fluctuation theorems, have been tested experimentally in several physical scenarios and, moreover, they have been shown to be valid under broad mathematical conditions. Hence, although not experimentally challenged yet, they are presumed to apply to learning systems as well. Here we address this challenge by testing the applicability of fluctuation theorems in learning systems, more specifically, in human sensorimotor learning. In particular, we relate adaptive movement trajectories in a changing visuomotor rotation task to fully adapted steady-state behavior of individual participants. We find that human adaptive behavior in our task is generally consistent with fluctuation theorem predictions and discuss the merits and limitations of the approach.
Collapse
|
3
|
Lancia GL, Eluchans M, D’Alessandro M, Spiers HJ, Pezzulo G. Humans account for cognitive costs when finding shortcuts: An information-theoretic analysis of navigation. PLoS Comput Biol 2023; 19:e1010829. [PMID: 36608145 PMCID: PMC9851521 DOI: 10.1371/journal.pcbi.1010829] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Revised: 01/19/2023] [Accepted: 12/19/2022] [Indexed: 01/09/2023] Open
Abstract
When faced with navigating back somewhere we have been before we might either retrace our steps or seek a shorter path. Both choices have costs. Here, we ask whether it is possible to characterize formally the choice of navigational plans as a bounded rational process that trades off the quality of the plan (e.g., its length) and the cognitive cost required to find and implement it. We analyze the navigation strategies of two groups of people that are firstly trained to follow a "default policy" taking a route in a virtual maze and then asked to navigate to various known goal destinations, either in the way they want ("Go To Goal") or by taking novel shortcuts ("Take Shortcut"). We address these wayfinding problems using InfoRL: an information-theoretic approach that formalizes the cognitive cost of devising a navigational plan, as the informational cost to deviate from a well-learned route (the "default policy"). In InfoRL, optimality refers to finding the best trade-off between route length and the amount of control information required to find it. We report five main findings. First, the navigational strategies automatically identified by InfoRL correspond closely to different routes (optimal or suboptimal) in the virtual reality map, which were annotated by hand in previous research. Second, people deliberate more in places where the value of investing cognitive resources (i.e., relevant goal information) is greater. Third, compared to the group of people who receive the "Go To Goal" instruction, those who receive the "Take Shortcut" instruction find shorter but less optimal solutions, reflecting the intrinsic difficulty of finding optimal shortcuts. Fourth, those who receive the "Go To Goal" instruction modulate flexibly their cognitive resources, depending on the benefits of finding the shortcut. Finally, we found a surprising amount of variability in the choice of navigational strategies and resource investment across participants. Taken together, these results illustrate the benefits of using InfoRL to address navigational planning problems from a bounded rational perspective.
Collapse
Affiliation(s)
- Gian Luca Lancia
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
- University of Rome “La Sapienza”, Rome, Italy
| | - Mattia Eluchans
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
- University of Rome “La Sapienza”, Rome, Italy
| | - Marco D’Alessandro
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Hugo J. Spiers
- Institute of Behavioural Neuroscience, Department of Experimental Psychology, Division of Psychology and Language Sciences, University College London, United Kingdom
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| |
Collapse
|
4
|
Hack P, Gottwald S, Braun DA. Jarzyski's Equality and Crooks' Fluctuation Theorem for General Markov Chains with Application to Decision-Making Systems. ENTROPY (BASEL, SWITZERLAND) 2022; 24:1731. [PMID: 36554136 PMCID: PMC9777588 DOI: 10.3390/e24121731] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 11/19/2022] [Accepted: 11/24/2022] [Indexed: 06/17/2023]
Abstract
We define common thermodynamic concepts purely within the framework of general Markov chains and derive Jarzynski's equality and Crooks' fluctuation theorem in this setup. In particular, we regard the discrete-time case, which leads to an asymmetry in the definition of work that appears in the usual formulation of Crooks' fluctuation theorem. We show how this asymmetry can be avoided with an additional condition regarding the energy protocol. The general formulation in terms of Markov chains allows transferring the results to other application areas outside of physics. Here, we discuss how this framework can be applied in the context of decision-making. This involves the definition of the relevant quantities, the assumptions that need to be made for the different fluctuation theorems to hold, as well as the consideration of discrete trajectories instead of the continuous trajectories, which are relevant in physics.
Collapse
Affiliation(s)
- Pedro Hack
- Institute of Neural Information Processing, Ulm University, 89081 Ulm, Germany
| | | | | |
Collapse
|
5
|
Schach S, Lindner A, Braun DA. Bounded rational decision-making models suggest capacity-limited concurrent motor planning in human posterior parietal and frontal cortex. PLoS Comput Biol 2022; 18:e1010585. [PMID: 36227842 PMCID: PMC9560147 DOI: 10.1371/journal.pcbi.1010585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Accepted: 09/18/2022] [Indexed: 11/05/2022] Open
Abstract
While traditional theories of sensorimotor processing have often assumed a serial decision-making pipeline, more recent approaches have suggested that multiple actions may be planned concurrently and vie for execution. Evidence for the latter almost exclusively stems from electrophysiological studies in posterior parietal and premotor cortex of monkeys. Here we study concurrent prospective motor planning in humans by recording functional magnetic resonance imaging (fMRI) during a delayed response task engaging movement sequences towards multiple potential targets. We find that also in human posterior parietal and premotor cortex delay activity modulates both with sequence complexity and the number of potential targets. We tested the hypothesis that this modulation is best explained by concurrent prospective planning as opposed to the mere maintenance of potential targets in memory. We devise a bounded rationality model with information constraints that optimally assigns information resources for planning and memory for this task and determine predicted information profiles according to the two hypotheses. When regressing delay activity on these model predictions, we find that the concurrent prospective planning strategy provides a significantly better explanation of the fMRI-signal modulations. Moreover, we find that concurrent prospective planning is more costly and thus limited for most subjects, as expressed by the best fitting information capacities. We conclude that bounded rational decision-making models allow relating both behavior and neural representations to utilitarian task descriptions based on bounded optimal information-processing assumptions. When the future is uncertain, it can be beneficial to concurrently plan several action possibilities in advance. Electrophysiological research found evidence in monkeys that brain regions in posterior parietal and promotor cortex are indeed capable of planning several actions in parallel. We now used fMRI to study brain activity in these brain regions in humans. For our analyses we applied bounded rationality models that optimally assign information resources to fMRI activity in a complex motor planning task. We find that theoretical information costs of concurrent prospective planning explained fMRI activity profiles significantly better than assuming alternative memory-based strategies. Moreover, exploiting the model allowed us to quantify the individual capacity limit for concurrent planning and to relate these individual limits to both subjects’ behavior and to their neural representations of planning.
Collapse
Affiliation(s)
- Sonja Schach
- Institute of Neural Information Processing, University of Ulm, Ulm, Germany
- * E-mail:
| | - Axel Lindner
- Tübingen Center for Mental Health, Department of Psychiatry and Psychotherapy, University of Tübingen, Tübingen, Germany
- Centre of Neurology, Division of Neuropsychology, Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | | |
Collapse
|
6
|
Lindig-León C, Kaur N, Braun DA. From Bayes-optimal to heuristic decision-making in a two-alternative forced choice task with an information-theoretic bounded rationality model. Front Neurosci 2022; 16:906198. [PMID: 36248642 PMCID: PMC9557085 DOI: 10.3389/fnins.2022.906198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Accepted: 09/09/2022] [Indexed: 11/30/2022] Open
Abstract
Bayes optimal and heuristic decision-making schemes are often considered fundamentally opposed to each other as a framework for studying human choice behavior, although recently it has been proposed that bounded rationality may provide a natural bridge between the two when varying information-processing resources. Here, we investigate a two-alternative forced choice task with varying time constraints, where subjects have to assign multi-component symbolic patterns to one of two stimulus classes. As expected, we find that subjects' response behavior becomes more imprecise with more time pressure. However, we also see that their response behavior changes qualitatively. By regressing subjects' decision weights, we find that decisions allowing for plenty of decision time rely on weighing multiple stimulus features, whereas decisions under high time pressure are made mostly based on a single feature. While the first response pattern is in line with a Bayes-optimal decision strategy, the latter could be considered as an instantiation of heuristic decision-making with cue discounting. When fitting a bounded rational decision model with multiple feature channels and varying information-processing capacity to subjects' responses, we find that the model is able to capture subjects' behavioral change. The model successfully reflects the simplicity of heuristics as well as the efficiency of optimal decision making, thus acting as a bridge between the two approaches.
Collapse
|
7
|
Hack P, Braun DA, Gottwald S. Representing preorders with injective monotones. THEORY AND DECISION 2022; 93:663-690. [PMID: 36245967 PMCID: PMC9550776 DOI: 10.1007/s11238-021-09861-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Accepted: 12/13/2021] [Indexed: 06/16/2023]
Abstract
We introduce a new class of real-valued monotones in preordered spaces, injective monotones. We show that the class of preorders for which they exist lies in between the class of preorders with strict monotones and preorders with countable multi-utilities, improving upon the known classification of preordered spaces through real-valued monotones. We extend several well-known results for strict monotones (Richter-Peleg functions) to injective monotones, we provide a construction of injective monotones from countable multi-utilities, and relate injective monotones to classic results concerning Debreu denseness and order separability. Along the way, we connect our results to Shannon entropy and the uncertainty preorder, obtaining new insights into how they are related. In particular, we show how injective monotones can be used to generalize some appealing properties of Jaynes' maximum entropy principle, which is considered a basis for statistical inference and serves as a justification for many regularization techniques that appear throughout machine learning and decision theory.
Collapse
Affiliation(s)
- Pedro Hack
- Institute of Neural Information Processing, Ulm University, 89081 Ulm, Germany
| | - Daniel A. Braun
- Institute of Neural Information Processing, Ulm University, 89081 Ulm, Germany
| | - Sebastian Gottwald
- Institute of Neural Information Processing, Ulm University, 89081 Ulm, Germany
| |
Collapse
|
8
|
Abstract
The concept of free energy has its origins in 19th century thermodynamics, but has recently found its way into the behavioral and neural sciences, where it has been promoted for its wide applicability and has even been suggested as a fundamental principle of understanding intelligent behavior and brain function. We argue that there are essentially two different notions of free energy in current models of intelligent agency, that can both be considered as applications of Bayesian inference to the problem of action selection: one that appears when trading off accuracy and uncertainty based on a general maximum entropy principle, and one that formulates action selection in terms of minimizing an error measure that quantifies deviations of beliefs and policies from given reference models. The first approach provides a normative rule for action selection in the face of model uncertainty or when information processing capabilities are limited. The second approach directly aims to formulate the action selection problem as an inference problem in the context of Bayesian brain theories, also known as Active Inference in the literature. We elucidate the main ideas and discuss critical technical and conceptual issues revolving around these two notions of free energy that both claim to apply at all levels of decision-making, from the high-level deliberation of reasoning down to the low-level information processing of perception.
Collapse
Affiliation(s)
- Sebastian Gottwald
- Institute of Neural Information Processing, Ulm University, Ulm, Germany
| | - Daniel A. Braun
- Institute of Neural Information Processing, Ulm University, Ulm, Germany
| |
Collapse
|
9
|
Abstract
AbstractJoining multiple decision-makers together is a powerful way to obtain more sophisticated decision-making systems, but requires to address the questions of division of labor and specialization. We investigate in how far information constraints in hierarchies of experts not only provide a principled method for regularization but also to enforce specialization. In particular, we devise an information-theoretically motivated on-line learning rule that allows partitioning of the problem space into multiple sub-problems that can be solved by the individual experts. We demonstrate two different ways to apply our method: (i) partitioning problems based on individual data samples and (ii) based on sets of data samples representing tasks. Approach (i) equips the system with the ability to solve complex decision-making problems by finding an optimal combination of local expert decision-makers. Approach (ii) leads to decision-makers specialized in solving families of tasks, which equips the system with the ability to solve meta-learning problems. We show the broad applicability of our approach on a range of problems including classification, regression, density estimation, and reinforcement learning problems, both in the standard machine learning setup and in a meta-learning setting.
Collapse
|
10
|
Hodicky J, Özkan G, Özdemir H, Stodola P, Drozd J, Buck W. Analytic Hierarchy Process (AHP)-Based Aggregation Mechanism for Resilience Measurement: NATO Aggregated Resilience Decision Support Model. ENTROPY (BASEL, SWITZERLAND) 2020; 22:E1037. [PMID: 33286806 PMCID: PMC7597095 DOI: 10.3390/e22091037] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2020] [Revised: 09/08/2020] [Accepted: 09/10/2020] [Indexed: 11/16/2022]
Abstract
Resilience is a complex system that represents dynamic behaviours through its complicated structure with various nodes, interrelations, and information flows. Like other international organizations NATO has also been dealing with the measurement of this complex phenomenon in order to have a comprehensive understanding of the civil environment and its impact on military operations. With this ultimate purpose, NATO had developed and executed a prototype model with the system dynamics modelling and simulation paradigm. NATO has created an aggregated resilience model as an upgrade of the prototype one, as discussed within this study. The structure of the model, aggregation mechanism and shock parametrization methodologies used in the development of the model comprise the scope of this study. Analytic Hierarchy Process (AHP), which is a multi-criteria decision-making technique is the methodology that is used for the development of the aggregation mechanism. The main idea of selecting the AHP methodology is its power and usefulness in mitigating bias in the decision-making process, its capability to increase the number of what-if scenarios to be created, and its contribution to the quality of causal explanations with the granularity it provides. The parametrized strategic shock input page, AHP-based weighted resilience and risk parameters input pages, one more country insertion to the model, and the decision support system page enhance the capacity of the prototype model. As part of the model, the decision support system page stands out as the strategic level cockpit where the colour codes give a clear idea at first about the overall situational picture and country-wise resilience and risk status. At the validation workshop, users not only validated the model but also discussed further development opportunities, such as adding more strategic shocks into the model and introduction of new parameters that will be determined by a big data analysis on relevant open source databases. The developed model has the potential to inspire high-level decision-makers dealing with resilience management in other international organizations, such as the United Nations.
Collapse
Affiliation(s)
- Jan Hodicky
- NATO Headquarters Supreme Allied Commander Transformation, Norfolk, VA 23511, USA; (J.H.); (W.B.)
| | - Gökhan Özkan
- STM Savunma Teknolojileri Mühendislik ve Ticaret A.S., Ankara 06530, Turkey; (G.Ö.); (H.Ö.)
| | - Hilmi Özdemir
- STM Savunma Teknolojileri Mühendislik ve Ticaret A.S., Ankara 06530, Turkey; (G.Ö.); (H.Ö.)
| | - Petr Stodola
- Department of Intelligence Support, University of Defence, 66210 Brno, Czech Republic
| | - Jan Drozd
- Department of Tactics, University of Defence, 66210 Brno, Czech Republic;
| | - Wayne Buck
- NATO Headquarters Supreme Allied Commander Transformation, Norfolk, VA 23511, USA; (J.H.); (W.B.)
| |
Collapse
|
11
|
Hodický J, Procházka D, Baxa F, Melichar J, Krejčík M, Křížek P, Stodola P, Drozd J. Computer Assisted Wargame for Military Capability-Based Planning. ENTROPY (BASEL, SWITZERLAND) 2020; 22:E861. [PMID: 33286631 PMCID: PMC7517458 DOI: 10.3390/e22080861] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/23/2020] [Revised: 07/15/2020] [Accepted: 07/31/2020] [Indexed: 11/16/2022]
Abstract
Capability-based planning as an approach to defense planning is an almost infinitely complex engineered system with countless nodes and layers of interdependency, influenced by state and non-state diplomatic activities, information, military and economic actions creating secondary and third order effects. The main output of capability-based planning is the set of capability requirements needed to achieve the expected end-state. One revitalized qualitative technique that allows us to gain insights into unstructured and fuzzy problems in the military is wargaming-in its simplest form this involves manual wargaming. At the same time, there has been a push to bring computer assistance to such wargaming, especially to support umpire adjudication and move more generally towards full automation of human elements in wargames. However, computer assistance in wargaming should not be pushed, regardless of cost, towards quantitative techniques. The objective complexity of a problem often does not allow us to replicate the operational environment with the required fidelity to get credible experimental results. This paper discusses a discovery experiment aiming to verify the concept of applying a qualitative expert system within computer assisted wargaming for developing capability requirements in order to reduce umpire bias and risk associated with their decisions. The innovation here lies in applying system dynamics modelling and simulation paradigms when designing the theoretical model of capability development, which forms the core of the expert system. This new approach enables qualitative comparisons between different sets of proposed capability requirements. Moreover, the expert system allows us to reveal the effects of budget cuts on proposed capability requirement solutions, which the umpire was previously unable to articulate when comparing individual solutions by relying solely on his own knowledge. Players in the wargame validated the proposed concept and suggested how the study might be developed going forward: namely, by enabling users to define their own capabilities and not being limited by a predefined set of capabilities.
Collapse
Affiliation(s)
- Jan Hodický
- NATO Headquarters Supreme Allied Commander Transformation, Norfolk, VA 23551, USA;
| | - Dalibor Procházka
- Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic; (D.P.); (F.B.); (J.M.); (M.K.); (P.K.)
| | - Fabian Baxa
- Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic; (D.P.); (F.B.); (J.M.); (M.K.); (P.K.)
| | - Josef Melichar
- Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic; (D.P.); (F.B.); (J.M.); (M.K.); (P.K.)
| | - Milan Krejčík
- Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic; (D.P.); (F.B.); (J.M.); (M.K.); (P.K.)
| | - Petr Křížek
- Centre for Security and Military Strategic Studies, University of Defence, 66210 Brno, Czech Republic; (D.P.); (F.B.); (J.M.); (M.K.); (P.K.)
| | - Petr Stodola
- Department of Intelligence Support, University of Defence, 66210 Brno, Czech Republic
| | - Jan Drozd
- Department of Tactics, University of Defence, 66210 Brno, Czech Republic;
| |
Collapse
|
12
|
Optimization of the Casualties' Treatment Process: Blended Military Experiment. ENTROPY 2020; 22:e22060706. [PMID: 33286478 PMCID: PMC7517244 DOI: 10.3390/e22060706] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 06/23/2020] [Accepted: 06/24/2020] [Indexed: 11/17/2022]
Abstract
At the battalion level, NATO ROLE1 medical treatment command focuses on the provision of primary health care being the very first physician and higher medical equipment intervention for casualty treatments. ROLE1 has paramount importance in casualty reductions, representing a complex system in current operations. This study deals with an experiment on the optimization of ROLE1 according to the key parameters of the numbers of physicians, the number of ambulances and the distance between ROLE1 and the current battlefield. The very first step in this study is to design and implement a model of current battlefield casualties. The model uses friction data generated from an already executed computer assisted exercise (CAX) while employing a constructive simulation to produce offense and defense scenarios on the flow of casualties. The next step in the study is to design and implement a model representing the transportation to ROLE1, its structure and behavior. The deterministic model of ROLE1, employing a system dynamics simulation paradigm, uses the previously generated casualty flows as the inputs representing human decision-making processes through the recorder CAX events. A factorial experimental design for the ROLE1 model revealed the recommended variants of the ROLE1 structure for both offensive and defensive operations. The overall recommendation is for the internal structure of ROLE1 to have three ambulances and three physicians for any kind of current operation and any distance between ROLE1 and the current battlefield within the limit of 20 min. This study provides novelty in the methodology of casualty estimations involving human decision-making factors as well as the optimization of medical treatment processes through experimentation with the process model.
Collapse
|
13
|
Lindig-León C, Gottwald S, Braun DA. Analyzing Abstraction and Hierarchical Decision-Making in Absolute Identification by Information-Theoretic Bounded Rationality. Front Neurosci 2019; 13:1230. [PMID: 31824241 PMCID: PMC6879553 DOI: 10.3389/fnins.2019.01230] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2019] [Accepted: 10/31/2019] [Indexed: 11/25/2022] Open
Abstract
In the face of limited computational resources, bounded rational decision theory predicts that information-processing should be concentrated on actions that make a significant contribution in terms of the utility achieved. Accordingly, information-processing can be simplified by choosing stereotypic actions that lead to satisfactory performance over a range of different inputs rather than choosing a specific action for each input. Such a set of similar inputs with similar action responses would then correspond to an abstraction that can be harnessed with possibly negligible loss in utility, but with potentially considerable savings in information-processing effort. Here we test this prediction in an identification task, where human subjects were asked to estimate the roundness of ellipses varying from a straight line to a perfect circle. Crucially, when reporting their estimates, subjects could choose between three different levels of precision corresponding to three levels of abstraction in a decision-making hierarchy. To induce changes in level selection, we manipulated the information-processing resources available at the perceptual and action stages by varying the difficulty of identifying the stimulus and by enforcing different response times in the action stage. In line with theoretical predictions, we find that subjects adapt their abstraction level depending on the available resources. We compare subjects' behavior to the maximum efficiency predicated by the bounded rational decision-making model and investigate possible sources of inefficiency.
Collapse
Affiliation(s)
- Cecilia Lindig-León
- Faculty of Engineering, Computer Science and Psychology, Institute of Neural Information Processing, Ulm University, Ulm, Germany
| | | | | |
Collapse
|