Intuitive physics learning in a deep-learning model inspired by developmental psychology

The role of action concepts in physical reasoning: insights from late childhood

A fundamental component of human cognition is the ability to intuitively reason about behaviours of objects and systems in the physical world without resorting to explicit scientific knowledge. This skill was traditionally considered a symbolic process. However, in the last decades, there has been a shift towards ideas of embodiment, suggesting that accessing physical knowledge and predicting physical outcomes is grounded in bodily interactions with the environment. Infants and children, who learn mainly through their embodied experiences, serve as a model to probe the link between reasoning and physical concepts. Here, we tested school-aged children (5- to 15-year-olds) in online reasoning games that involve different physical action concepts such as supporting, launching and clearing. We assessed changes in children's performance and strategies over development and their relationships with the different action concepts. Children reasoned more accurately in problems that involved supporting actions compared to launching or clearing actions. Moreover, when children failed, they were more strategic in subsequent attempts when problems involved support rather than launching or clearing. Children improved with age, but improvements differed across action concepts. Our findings suggest that accessing physical knowledge and predicting physical events are affected by action concepts, and those effects change over development. This article is part of the theme issue 'Minds in movement: embodied cognition in the age of artificial intelligence'.

The relational bottleneck as an inductive bias for efficient abstraction

A central challenge for cognitive science is to explain how abstract concepts are acquired from limited experience. This has often been framed in terms of a dichotomy between connectionist and symbolic cognitive models. Here, we highlight a recently emerging line of work that suggests a novel reconciliation of these approaches, by exploiting an inductive bias that we term the relational bottleneck. In that approach, neural networks are constrained via their architecture to focus on relations between perceptual inputs, rather than the attributes of individual inputs. We review a family of models that employ this approach to induce abstractions in a data-efficient manner, emphasizing their potential as candidate models for the acquisition of abstract concepts in the human mind and brain.

Bridging Neuroscience and AI: Environmental Enrichment as a Model for Forward Knowledge Transfer

Continual learning (CL) refers to an agent's capability to learn from a continuous stream of data and transfer knowledge without forgetting old information. One crucial aspect of CL is forward transfer, i.e., improved and faster learning on a new task by leveraging information from prior knowledge. While this ability comes naturally to biological brains, it poses a significant challenge for artificial intelligence (AI). Here, we suggest that environmental enrichment (EE) can be used as a biological model for studying forward transfer, inspiring human-like AI development. EE refers to animal studies that enhance cognitive, social, motor, and sensory stimulation and is a model for what, in humans, is referred to as 'cognitive reserve'. Enriched animals show significant improvement in learning speed and performance on new tasks, typically exhibiting forward transfer. We explore anatomical, molecular, and neuronal changes post-EE and discuss how artificial neural networks (ANNs) can be used to predict neural computation changes after enriched experiences. Finally, we provide a synergistic way of combining neuroscience and AI research that paves the path toward developing AI capable of rapid and efficient new task learning.

Cognitive modelling of concepts in the mental lexicon with multilayer networks: Insights, advancements, and future challenges

The mental lexicon is a complex cognitive system representing information about the words/concepts that one knows. Over decades psychological experiments have shown that conceptual associations across multiple, interactive cognitive levels can greatly influence word acquisition, storage, and processing. How can semantic, phonological, syntactic, and other types of conceptual associations be mapped within a coherent mathematical framework to study how the mental lexicon works? Here we review cognitive multilayer networks as a promising quantitative and interpretative framework for investigating the mental lexicon. Cognitive multilayer networks can map multiple types of information at once, thus capturing how different layers of associations might co-exist within the mental lexicon and influence cognitive processing. This review starts with a gentle introduction to the structure and formalism of multilayer networks. We then discuss quantitative mechanisms of psychological phenomena that could not be observed in single-layer networks and were only unveiled by combining multiple layers of the lexicon: (i) multiplex viability highlights language kernels and facilitative effects of knowledge processing in healthy and clinical populations; (ii) multilayer community detection enables contextual meaning reconstruction depending on psycholinguistic features; (iii) layer analysis can mediate latent interactions of mediation, suppression, and facilitation for lexical access. By outlining novel quantitative perspectives where multilayer networks can shed light on cognitive knowledge representations, including in next-generation brain/mind models, we discuss key limitations and promising directions for cutting-edge future research.

Perception of 3D shape integrates intuitive physics and analysis-by-synthesis

Many surface cues support three-dimensional shape perception, but humans can sometimes still see shape when these features are missing-such as when an object is covered with a draped cloth. Here we propose a framework for three-dimensional shape perception that explains perception in both typical and atypical cases as analysis-by-synthesis, or inference in a generative model of image formation. The model integrates intuitive physics to explain how shape can be inferred from the deformations it causes to other objects, as in cloth draping. Behavioural and computational studies comparing this account with several alternatives show that it best matches human observers (total n = 174) in both accuracy and response times, and is the only model that correlates significantly with human performance on difficult discriminations. We suggest that bottom-up deep neural network models are not fully adequate accounts of human shape perception, and point to how machine vision systems might achieve more human-like robustness.

Object geometry serves humans' intuitive physics of stability

How do humans judge physical stability? A prevalent account emphasizes the mental simulation of physical events implemented by an intuitive physics engine in the mind. Here we test the extent to which the perceptual features of object geometry are sufficient for supporting judgments of falling direction. In all experiments, adults and children judged the falling direction of a tilted object and, across experiments, objects differed in the geometric features (i.e., geometric centroid, object height, base size and/or aspect ratio) relevant to the judgment. Participants' performance was compared to computational models trained on geometric features, as well as a deep convolutional neural network (ResNet-50), none of which incorporated mental simulation. Adult and child participants' performance was well fit by models of object geometry, particularly the geometric centroid. ResNet-50 also provided a good account of human performance. Altogether, our findings suggest that object geometry may be sufficient for judging the falling direction of tilted objects, independent of mental simulation.

Metabolic energetics underlying attractors in neural models

Neural population modeling, including the role of neural attractors, is a promising tool for understanding many aspects of brain function. We propose a modeling framework to connect the abstract variables used in modeling to recent cellular-level estimates of the bioenergetic costs of different aspects of neural activity, measured in ATP consumed per second per neuron. Based on recent work, an empirical reference for brain ATP use for the awake resting brain was estimated as ∼2 × 109 ATP/s-neuron across several mammalian species. The energetics framework was applied to the Wilson-Cowan (WC) model of two interacting populations of neurons, one excitatory (E) and one inhibitory (I). Attractors were considered to exhibit steady-state behavior and limit cycle behavior, both of which end when the excitatory stimulus ends, and sustained activity that persists after the stimulus ends. The energy cost of limit cycles, with oscillations much faster than the average neuronal firing rate of the population, is tracked more closely with the firing rate than the limit cycle frequency. Self-sustained firing driven by recurrent excitation, though, involves higher firing rates and a higher energy cost. As an example of a simple network in which each node is a WC model, a combination of three nodes can serve as a flexible circuit element that turns on with an oscillating output when input passes a threshold and then persists after the input ends (an "on-switch"), with moderate overall ATP use. The proposed framework can serve as a guide for anchoring neural population models to plausible bioenergetics requirements.NEW & NOTEWORTHY This work bridges two approaches for understanding brain function: cellular-level studies of the metabolic energy costs of different aspects of neural activity and neural population modeling, including the role of neural attractors. The proposed modeling framework connects energetic costs, in ATP consumed per second per neuron, to the more abstract variables used in neural population modeling. In particular, this work anchors potential neural attractors to physiologically plausible bioenergetics requirements.

Going after the bigger picture: Using high-capacity models to understand mind and brain

Deep neural networks (DNNs) provide a unique opportunity to move towards a generic modelling framework in psychology. The high representational capacity of these models combined with the possibility for further extensions has already allowed us to investigate the forest, namely the complex landscape of representations and processes that underlie human cognition, without forgetting about the trees, which include individual psychological phenomena.

Grounding Intuitive Physics in Perceptual Experience

This review article explores the foundation of laypeople's understanding of the physical world rooted in perceptual experience. Beginning with a concise historical overview of the study of intuitive physics, the article presents the hypothesis that laypeople possess accurate internalized representations of physical laws. A key aspect of this hypothesis is the contention that correct representations of physical laws emerge in ecological experimental conditions, where the scenario being examined resembles everyday life experiences. The article critically examines empirical evidence both supporting and challenging this claim, revealing that despite everyday-life-like conditions, fundamental misconceptions often persist. Many of these misconceptions can be attributed to a domain-general heuristic that arises from the overgeneralization of perceptual-motor experiences with physical objects. To conclude, the article delves into ongoing controversies and highlights promising future avenues in the field of intuitive physics, including action-judgment dissociations, insights from developmental psychology, and computational models integrating artificial intelligence.

Machine learning for cross-scale microscopy of viruses

Despite advances in virological sciences and antiviral research, viruses continue to emerge, circulate, and threaten public health. We still lack a comprehensive understanding of how cells and individuals remain susceptible to infectious agents. This deficiency is in part due to the complexity of viruses, including the cell states controlling virus-host interactions. Microscopy samples distinct cellular infection stages in a multi-parametric, time-resolved manner at molecular resolution and is increasingly enhanced by machine learning and deep learning. Here we discuss how state-of-the-art artificial intelligence (AI) augments light and electron microscopy and advances virological research of cells. We describe current procedures for image denoising, object segmentation, tracking, classification, and super-resolution and showcase examples of how AI has improved the acquisition and analyses of microscopy data. The power of AI-enhanced microscopy will continue to help unravel virus infection mechanisms, develop antiviral agents, and improve viral vectors.

Are Deep Neural Networks Adequate Behavioral Models of Human Visual Perception?

Deep neural networks (DNNs) are machine learning algorithms that have revolutionized computer vision due to their remarkable successes in tasks like object classification and segmentation. The success of DNNs as computer vision algorithms has led to the suggestion that DNNs may also be good models of human visual perception. In this article, we review evidence regarding current DNNs as adequate behavioral models of human core object recognition. To this end, we argue that it is important to distinguish between statistical tools and computational models and to understand model quality as a multidimensional concept in which clarity about modeling goals is key. Reviewing a large number of psychophysical and computational explorations of core object recognition performance in humans and DNNs, we argue that DNNs are highly valuable scientific tools but that, as of today, DNNs should only be regarded as promising-but not yet adequate-computational models of human core object recognition behavior. On the way, we dispel several myths surrounding DNNs in vision science.

The predictive effect of relative intuition on social entrepreneurship orientation: How do exploratory and exploitative learning and personal identity interact?

This study complements the stream of psychology studies on the effects of an individual's intuition on strategic decisions and how it shapes behavioral tendencies by extending how these effects evolve social entrepreneurship orientation in social entrepreneurship. Theoretically, we establish the nexus between relative intuition and social entrepreneurship orientation as well as the moderating roles of exploratory and exploitative learning and personal identity. Empirical validation of these nexuses was based on a cross-section of 276 certified social enterprises in China. The findings indicate that social entrepreneurs' relative intuition has a positive association with social entrepreneurship orientation. Exploratory and exploitative learning positively mediate the nexus between relative intuition and social entrepreneurship orientation. In addition, personal identity positively moderates the effects of exploratory and exploitative learning on social entrepreneurship orientation. Subsequently, we found that the link between relative intuition and social entrepreneurship orientation strengthens as the social entrepreneurs' personal identity increases. In this light, we identify relative intuition as the foundation of exploratory and exploratory learning for the development of social entrepreneurship orientation. Similarly, we shed light on how personal identity positively facilitates the roles of these factors by arousing dedication to the processes/stages of the pursuit of social entrepreneurship orientation goal attainment.

Large Language Models and the Reverse Turing Test

Large language models (LLMs) have been transformative. They are pretrained foundational models that are self-supervised and can be adapted with fine-tuning to a wide range of natural language tasks, each of which previously would have required a separate network model. This is one step closer to the extraordinary versatility of human language. GPT-3 and, more recently, LaMDA, both of them LLMs, can carry on dialogs with humans on many topics after minimal priming with a few examples. However, there has been a wide range of reactions and debate on whether these LLMs understand what they are saying or exhibit signs of intelligence. This high variance is exhibited in three interviews with LLMs reaching wildly different conclusions. A new possibility was uncovered that could explain this divergence. What appears to be intelligence in LLMs may in fact be a mirror that reflects the intelligence of the interviewer, a remarkable twist that could be considered a reverse Turing test. If so, then by studying interviews, we may be learning more about the intelligence and beliefs of the interviewer than the intelligence of the LLMs. As LLMs become more capable, they may transform the way we interact with machines and how they interact with each other. Increasingly, LLMs are being coupled with sensorimotor devices. LLMs can talk the talk, but can they walk the walk? A road map for achieving artificial general autonomy is outlined with seven major improvements inspired by brain systems and how LLMs could in turn be used to uncover new insights into brain function.

Evidence synthesis, digital scribes, and translational challenges for artificial intelligence in healthcare

Healthcare has well-known challenges with safety, quality, and effectiveness, and many see artificial intelligence (AI) as essential to any solution. Emerging applications include the automated synthesis of best-practice research evidence including systematic reviews, which would ultimately see all clinical trial data published in a computational form for immediate synthesis. Digital scribes embed themselves in the process of care to detect, record, and summarize events and conversations for the electronic record. However, three persistent translational challenges must be addressed before AI is widely deployed. First, little effort is spent replicating AI trials, exposing patients to risks of methodological error and biases. Next, there is little reporting of patient harms from trials. Finally, AI built using machine learning may perform less effectively in different clinical settings.

Physics-AI Symbiosis

The phenomenal success of physics in explaining nature and engineering machines is predicated on low dimensional deterministic models that accurately describe a wide range of natural phenomena. Physics provides computational rules that govern physical systems and the interactions of the constituents therein. Led by Deep Neural Networks (DNNs), Artificial Intelligence (AI) has introduced an alternate data-driven computational framework, with astonishing performance in domains that don’t lend themselves to deterministic models such as image classification and speech recognition. These gains, however, come at the expense of predictions that are inconsistent with the physical world as well as computational complexity, with the latter placing AI on a collision course with the expected end of the semiconductor scaling known as Moore’s Law. This paper argues how an emerging symbiosis of physics and AI can overcome such formidable challenges, thereby not only extending AI’s spectacular rise but also transforming the direction of engineering and physical science.