1
|
Belhomme N, Pelaccia T, Triby E, Pottier P. The time factor: Unravelling the threads of uncertainty tolerance. J Eval Clin Pract 2024. [PMID: 38943491 DOI: 10.1111/jep.14049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Accepted: 05/30/2024] [Indexed: 07/01/2024]
Affiliation(s)
- Nicolas Belhomme
- Service de Médecine Interne et Immunologie Clinique, CHU Rennes, Rennes, France
- Inserm, EHESP, Irset (Institut de Recherche en Santé, Environnement et Travail)-UMR_S 1085, Rennes, France
- Laboratoire Interuniversitaire des Sciences de l'Education et de la Communication, LISEC_UR2310, Université de Strasbourg, Strasbourg, France
| | - Thierry Pelaccia
- Laboratoire Interuniversitaire des Sciences de l'Education et de la Communication, LISEC_UR2310, Université de Strasbourg, Strasbourg, France
- Service d'Urgences (SAMU 67), CHU Strasbourg, Strasbourg, France
- Centre de Formation et de Recherche en Pédagogie des Sciences de la Santé, Faculté de Médecine, Université de Strasbourg, Strasbourg, France
| | - Emmanuel Triby
- Laboratoire Interuniversitaire des Sciences de l'Education et de la Communication, LISEC_UR2310, Université de Strasbourg, Strasbourg, France
| | - Pierre Pottier
- Service de Médecine Interne et Immunologie Clinique, CHU Nantes, Nantes, France
- Faculté de Médecine-Pôle Santé, Nantes Université, Nantes, France
| |
Collapse
|
2
|
Lai L, Gershman SJ. Human decision making balances reward maximization and policy compression. PLoS Comput Biol 2024; 20:e1012057. [PMID: 38669280 PMCID: PMC11078408 DOI: 10.1371/journal.pcbi.1012057] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Revised: 05/08/2024] [Accepted: 04/08/2024] [Indexed: 04/28/2024] Open
Abstract
Policy compression is a computational framework that describes how capacity-limited agents trade reward for simpler action policies to reduce cognitive cost. In this study, we present behavioral evidence that humans prefer simpler policies, as predicted by a capacity-limited reinforcement learning model. Across a set of tasks, we find that people exploit structure in the relationships between states, actions, and rewards to "compress" their policies. In particular, compressed policies are systematically biased towards actions with high marginal probability, thereby discarding some state information. This bias is greater when there is redundancy in the reward-maximizing action policy across states, and increases with memory load. These results could not be explained qualitatively or quantitatively by models that did not make use of policy compression under a capacity limit. We also confirmed the prediction that time pressure should further reduce policy complexity and increase action bias, based on the hypothesis that actions are selected via time-dependent decoding of a compressed code. These findings contribute to a deeper understanding of how humans adapt their decision-making strategies under cognitive resource constraints.
Collapse
Affiliation(s)
- Lucy Lai
- Program in Neuroscience, Harvard University, Cambridge, Massachusetts, United States of America
- Theoretical Sciences Visiting Program, Okinawa Institute of Science and Technology Graduate University, Onna, Okinawa, Japan
| | - Samuel J. Gershman
- Department of Psychology and Center for Brain Science, Harvard University, Cambridge, Massachusetts, United States of America
| |
Collapse
|
3
|
Nussenbaum K, Martin RE, Maulhardt S, Yang Y(J, Bizzell-Hatcher G, Bhatt NS, Koenig M, Rosenbaum GM, O'Doherty JP, Cockburn J, Hartley CA. Novelty and uncertainty differentially drive exploration across development. eLife 2023; 12:e84260. [PMID: 37585251 PMCID: PMC10431916 DOI: 10.7554/elife.84260] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Accepted: 08/07/2023] [Indexed: 08/17/2023] Open
Abstract
Across the lifespan, individuals frequently choose between exploiting known rewarding options or exploring unknown alternatives. A large body of work has suggested that children may explore more than adults. However, because novelty and reward uncertainty are often correlated, it is unclear how they differentially influence decision-making across development. Here, children, adolescents, and adults (ages 8-27 years, N = 122) completed an adapted version of a recently developed value-guided decision-making task that decouples novelty and uncertainty. In line with prior studies, we found that exploration decreased with increasing age. Critically, participants of all ages demonstrated a similar bias to select choice options with greater novelty, whereas aversion to reward uncertainty increased into adulthood. Computational modeling of participant choices revealed that whereas adolescents and adults demonstrated attenuated uncertainty aversion for more novel choice options, children's choices were not influenced by reward uncertainty.
Collapse
Affiliation(s)
| | | | - Sean Maulhardt
- New York UniversityNew YorkUnited States
- University of MarylandCollege ParkUnited States
| | - Yi (Jen) Yang
- New York UniversityNew YorkUnited States
- Temple UniversityPhiladelphiaUnited States
| | | | | | - Maximilian Koenig
- New York UniversityNew YorkUnited States
- Leiden UniversityLeidenNetherlands
| | - Gail M Rosenbaum
- New York UniversityNew YorkUnited States
- Geisinger Health SystemDanvilleUnited States
| | | | | | | |
Collapse
|
4
|
Heilemann G, Georg D, Dobiasch M, Widder J, Renner A. Increasing Quality and Efficiency of the Radiotherapy Treatment Planning Process by Constructing and Implementing a Workflow-Monitoring Application. JCO Clin Cancer Inform 2023; 7:e2300005. [PMID: 37595165 DOI: 10.1200/cci.23.00005] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Revised: 04/18/2023] [Accepted: 06/07/2023] [Indexed: 08/20/2023] Open
Abstract
PURPOSE To demonstrate how the efficiency of the treatment planning processes of a university radiation oncology department (2,500 new patients/year) could be improved by constructing and implementing a workflow-monitoring application. METHODS A web-based application was developed in house, which enhanced the process management tools of the clinic's oncology information system. The application calculates the days left for the next task in the treatment planning process and visualizes the information on a browser-based whiteboard. Workflow monitoring considers tumor types (breast, prostate, lung, etc) and treatment techniques and is backward planned from the planned start of treatment. The effect of introducing this application was analyzed over four phases: (1) baseline data without the workflow-monitoring application, (2) after introducing workflow visualization via a browser-based whiteboard, (3) after upgrading the whiteboard and introducing backend rules, and (4) after updating these rules on the basis of data from the previous phase. RESULTS Implementing the workflow-monitoring application and the introduced measures significantly reduced delays and, consequently, stress and a negative working atmosphere in the treatment planning process. Most notably, the amount of last-minute physics checks (on the day of the treatment start) could be reduced by 50%. CONCLUSION The study showed what measures can help organize and prioritize the treatment planning workflow. The increased efficiency is believed to improve the quality and reduce the risk of human error.
Collapse
Affiliation(s)
- Gerd Heilemann
- Department of Radiation Oncology, Comprehensive Cancer Center Vienna, Medical University Vienna, Vienna, Austria
| | - Dietmar Georg
- Department of Radiation Oncology, Comprehensive Cancer Center Vienna, Medical University Vienna, Vienna, Austria
| | - Matthias Dobiasch
- Department of Radiation Oncology, Comprehensive Cancer Center Vienna, Medical University Vienna, Vienna, Austria
| | - Joachim Widder
- Department of Radiation Oncology, Comprehensive Cancer Center Vienna, Medical University Vienna, Vienna, Austria
| | - Andreas Renner
- Department of Radiation Oncology, Comprehensive Cancer Center Vienna, Medical University Vienna, Vienna, Austria
| |
Collapse
|
5
|
Wang Z, Yu R. Effects of Time Pressure, Reward, and Information Involvement on User Management of Fake News on a Social Media Platform. Percept Mot Skills 2023:315125231179123. [PMID: 37235710 DOI: 10.1177/00315125231179123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
This study examined the effects of time pressure, reward, and information involvement on individual fact-checking behavior within a social media platform. We used a four-factor mixed-design experiment to examine fact-checking performances of 144 participants for 36 ambiguous social platform statements, all of which were news statements of social events or of common-sense knowledge collected from the internet and selected through pre-test screening. We measured the participants' total number of fact-checked statements and their judgment accuracy of those statements. We also measured participants' decision time for making judgments, and their judgment confidence levels. Participants' social presence, time pressure, and information involvement were significantly related to the number of statements they fact-checked. Their perceived social presence on a social media platform reduced their fact-checking. Time pressure increased the frequency of fact-checking and weakened the impact of social presence. Participants were less likely to fact-check statements when they had high involvement with the information, due to overconfidence. Statements with high information involvement had longer decision-making times. These findings provide a basis for designing ways to display and push information to increase an individual's awareness of a need to fact-check ambiguous information in a new social media environment.
Collapse
Affiliation(s)
- Zhecheng Wang
- Department of Industrial Engineering, Tsinghua University, Beijing, China
| | - Ruifeng Yu
- Department of Industrial Engineering, Tsinghua University, Beijing, China
| |
Collapse
|
6
|
Sleigh J, Ormond K, Schneider M, Stern E, Vayena E. How Interactive Visualizations Compare to Ethical Frameworks as Stand-Alone Ethics Learning Tools for Health Researchers and Professionals. AJOB Empir Bioeth 2023; 14:197-207. [PMID: 37074681 DOI: 10.1080/23294515.2023.2201479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/20/2023]
Abstract
BACKGROUND Despite the bourgeoning of digital tools for bioethics research, education, and engagement, little research has empirically investigated the impact of interactive visualizations as a way to translate ethical frameworks and guidelines. To date, most frameworks take the format of text-only documents that outline and offer ethical guidance on specific contexts. This study's goal was to determine whether an interactive-visual format supports frameworks in transferring ethical knowledge by improving learning, deliberation, and user experience. METHODS An experimental comparative study was conducted with a pre-, mid-, and post-test design using the online survey platform Qualtrics. Participants were university based early-stage health researchers who were randomly assigned to either the control condition (text-only document) or the experimental condition (interactive-visual). The primary outcome variables were learning, (measured using a questionnaire), deliberation (using cases studies) and user experience (measured using the SED/UD Scale). Analysis was conducted using descriptive statistics and mixed-effects linear regression. RESULTS Of the 80 participants, 44 (55%) used the text-only document and 36 (45%) used the interactive-visual. Results of the knowledge-test scores showed a statistically significant difference between participants' post-test scores, indicating that the interactive-visual format better supported understanding, acquisition, and application of the framework's knowledge. Findings from the case studies showed both formats supported ethical deliberation. Results further indicated the interactive-visual provided an overall better episodic and remembered user experience compared with the text-only document. CONCLUSIONS Our findings show that ethical frameworks formatted with interactive and visual qualities provide a more pleasing user experience and are effective formats for ethics learning and deliberation. These findings have implications for practitioners developing and deploying ethical frameworks and guidelines (e.g., in educational or employee-onboarding settings), in that the knowledge generated can lead to more effective dissemination practices of normative guidelines and health data ethics concepts.
Collapse
Affiliation(s)
- Joanna Sleigh
- Health Ethics and Policy Lab, Department of Health Sciences and Technology, Swiss Federal Institute of Technology (ETH Zurich), Zurich, Switzerland
| | - Kelly Ormond
- Health Ethics and Policy Lab, Department of Health Sciences and Technology, Swiss Federal Institute of Technology (ETH Zurich), Zurich, Switzerland
| | - Manuel Schneider
- Health Ethics and Policy Lab, Department of Health Sciences and Technology, Swiss Federal Institute of Technology (ETH Zurich), Zurich, Switzerland
| | - Elsbeth Stern
- Chair for Research and Instruction, Department of Humanities, Social and Political Sciences, Swiss Federal Institute of Technology (ETH Zurich), Zurich, Switzerland
| | - Effy Vayena
- Health Ethics and Policy Lab, Department of Health Sciences and Technology, Swiss Federal Institute of Technology (ETH Zurich), Zurich, Switzerland
| |
Collapse
|
7
|
Brown VM, Hallquist MN, Frank MJ, Dombrovski AY. Humans adaptively resolve the explore-exploit dilemma under cognitive constraints: Evidence from a multi-armed bandit task. Cognition 2022; 229:105233. [PMID: 35917612 PMCID: PMC9530017 DOI: 10.1016/j.cognition.2022.105233] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 06/02/2022] [Accepted: 07/22/2022] [Indexed: 11/27/2022]
Abstract
When navigating uncertain worlds, humans must balance exploring new options versus exploiting known rewards. Longer horizons and spatially structured option values encourage humans to explore, but the impact of real-world cognitive constraints such as environment size and memory demands on explore-exploit decisions is unclear. In the present study, humans chose between options varying in uncertainty during a multi-armed bandit task with varying environment size and memory demands. Regression and cognitive computational models of choice behavior showed that with a lower cognitive load, humans are more exploratory than a simulated value-maximizing learner, but under cognitive constraints, they adaptively scale down exploration to maintain exploitation. Thus, while humans are curious, cognitive constraints force people to decrease their strategic exploration in a resource-rational-like manner to focus on harvesting known rewards.
Collapse
Affiliation(s)
- Vanessa M Brown
- Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA.
| | - Michael N Hallquist
- Department of Psychology, Pennsylvania State University, State College, PA, USA; Department of Psychology and Neuroscience, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Michael J Frank
- Department of Cognitive, Linguistic, and Psychological Sciences and Carney Institute for Brain Science, Brown University, Providence, RI, USA
| | | |
Collapse
|