1
|
Richardson AD, Antal T, Blythe RA, Schumacher LJ. Learning spatio-temporal patterns with Neural Cellular Automata. PLoS Comput Biol 2024; 20:e1011589. [PMID: 38669297 PMCID: PMC11078362 DOI: 10.1371/journal.pcbi.1011589] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 05/08/2024] [Accepted: 04/02/2024] [Indexed: 04/28/2024] Open
Abstract
Neural Cellular Automata (NCA) are a powerful combination of machine learning and mechanistic modelling. We train NCA to learn complex dynamics from time series of images and Partial Differential Equation (PDE) trajectories. Our method is designed to identify underlying local rules that govern large scale dynamic emergent behaviours. Previous work on NCA focuses on learning rules that give stationary emergent structures. We extend NCA to capture both transient and stable structures within the same system, as well as learning rules that capture the dynamics of Turing pattern formation in nonlinear PDEs. We demonstrate that NCA can generalise very well beyond their PDE training data, we show how to constrain NCA to respect given symmetries, and we explore the effects of associated hyperparameters on model performance and stability. Being able to learn arbitrary dynamics gives NCA great potential as a data driven modelling framework, especially for modelling biological pattern formation.
Collapse
Affiliation(s)
- Alex D. Richardson
- School of Physics and Astronomy, University of Edinburgh, Edinburgh, United Kingdom
- School of Mathematics and Maxwell Institute for Mathematical Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Tibor Antal
- School of Mathematics and Maxwell Institute for Mathematical Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Richard A. Blythe
- School of Physics and Astronomy, University of Edinburgh, Edinburgh, United Kingdom
| | - Linus J. Schumacher
- School of Mathematics and Maxwell Institute for Mathematical Sciences, University of Edinburgh, Edinburgh, United Kingdom
- Institute of regeneration and repair, University of Edinburgh, Edinburgh, United Kingdom
| |
Collapse
|
2
|
BIO-LGCA: A cellular automaton modelling class for analysing collective cell migration. PLoS Comput Biol 2021; 17:e1009066. [PMID: 34129639 PMCID: PMC8232544 DOI: 10.1371/journal.pcbi.1009066] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2020] [Revised: 06/25/2021] [Accepted: 05/11/2021] [Indexed: 11/19/2022] Open
Abstract
Collective dynamics in multicellular systems such as biological organs and tissues plays a key role in biological development, regeneration, and pathological conditions. Collective tissue dynamics—understood as population behaviour arising from the interplay of the constituting discrete cells—can be studied with on- and off-lattice agent-based models. However, classical on-lattice agent-based models, also known as cellular automata, fail to replicate key aspects of collective migration, which is a central instance of collective behaviour in multicellular systems. To overcome drawbacks of classical on-lattice models, we introduce an on-lattice, agent-based modelling class for collective cell migration, which we call biological lattice-gas cellular automaton (BIO-LGCA). The BIO-LGCA is characterised by synchronous time updates, and the explicit consideration of individual cell velocities. While rules in classical cellular automata are typically chosen ad hoc, rules for cell-cell and cell-environment interactions in the BIO-LGCA can also be derived from experimental cell migration data or biophysical laws for individual cell migration. We introduce elementary BIO-LGCA models of fundamental cell interactions, which may be combined in a modular fashion to model complex multicellular phenomena. We exemplify the mathematical mean-field analysis of specific BIO-LGCA models, which allows to explain collective behaviour. The first example predicts the formation of clusters in adhesively interacting cells. The second example is based on a novel BIO-LGCA combining adhesive interactions and alignment. For this model, our analysis clarifies the nature of the recently discovered invasion plasticity of breast cancer cells in heterogeneous environments. Pattern formation during embryonic development and pathological tissue dynamics, such as cancer invasion, emerge from individual intercellular interactions. In order to study the impact of single cell dynamics and cell-cell interactions on tissue behaviour, one needs to develop space-time-dependent on- or off-lattice agent-based models (ABMs), which consider the behaviour of individual cells. However, classical on-lattice agent-based models also known as cellular automata fail to replicate key aspects of collective migration, which is a central instance of collective behaviour in multicellular systems. Here, we present the rule- and lattice-based BIO-LGCA modelling class which allows for (i) rigorous derivation of rules from biophysical laws and/or experimental data, (ii) mathematical analysis of collective migration, and (iii) computationally efficient simulations.
Collapse
|
3
|
Lehotzky D, Zupanc GKH. Cellular Automata Modeling of Stem-Cell-Driven Development of Tissue in the Nervous System. Dev Neurobiol 2019; 79:497-517. [PMID: 31102334 DOI: 10.1002/dneu.22686] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2019] [Revised: 04/23/2019] [Accepted: 05/02/2019] [Indexed: 12/12/2022]
Abstract
Mathematical and computational modeling enables biologists to integrate data from observations and experiments into a theoretical framework. In this review, we describe how developmental processes associated with stem-cell-driven growth of tissue in both the embryonic and adult nervous system can be modeled using cellular automata (CA). A cellular automaton is defined by its discrete nature in time, space, and state. The discrete space is represented by a uniform grid or lattice containing agents that interact with other agents within their local neighborhood. This possibility of local interactions of agents makes the cellular automata approach particularly well suited for studying through modeling how complex patterns at the tissue level emerge from fundamental developmental processes (such as proliferation, migration, differentiation, and death) at the single-cell level. As part of this review, we provide a primer for how to define biologically inspired rules governing these processes so that they can be implemented into a CA model. We then demonstrate the power of the CA approach by presenting simulations (in the form of figures and movies) based on building models of three developmental systems: the formation of the enteric nervous system through invasion by neural crest cells; the growth of normal and tumorous neurospheres induced by proliferation of adult neural stem/progenitor cells; and the neural fate specification through lateral inhibition of embryonic stem cells in the neurogenic region of Drosophila.
Collapse
Affiliation(s)
- Dávid Lehotzky
- Laboratory of Neurobiology, Department of Biology, Northeastern University, Boston, Massachusetts
| | - Günther K H Zupanc
- Laboratory of Neurobiology, Department of Biology, Northeastern University, Boston, Massachusetts
| |
Collapse
|
4
|
Mente C, Voss-Böhme A, Deutsch A. Analysis of individual cell trajectories in lattice-gas cellular automaton models for migrating cell populations. Bull Math Biol 2015; 77:660-97. [PMID: 25894920 DOI: 10.1007/s11538-015-0079-3] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2014] [Accepted: 03/27/2015] [Indexed: 12/20/2022]
Abstract
Collective dynamics of migrating cell populations drive key processes in tissue formation and maintenance under normal and diseased conditions. Collective cell behavior at the tissue level is typically characterized by considering cell density patterns such as clusters and moving cell fronts. However, there are also important observables of collective dynamics related to individual cell behavior. In particular, individual cell trajectories are footprints of emergent behavior in populations of migrating cells. Lattice-gas cellular automata (LGCA) have proven successful to model and analyze collective behavior arising from interactions of migrating cells. There are well-established methods to analyze cell density patterns in LGCA models. Although LGCA dynamics are defined by cell-based rules, individual cells are not distinguished. Therefore, individual cell trajectories cannot be analyzed in LGCA so far. Here, we extend the classical LGCA framework to allow labeling and tracking of individual cells. We consider cell number conserving LGCA models of migrating cell populations where cell interactions are regulated by local cell density and derive stochastic differential equations approximating individual cell trajectories in LGCA. This result allows the prediction of complex individual cell trajectories emerging in LGCA models and is a basis for model-experiment comparisons at the individual cell level.
Collapse
Affiliation(s)
- Carsten Mente
- Technische Universität Dresden, Zentrum für Informationsdienste und Hochleistungsrechnen, Nöthnitzer Strasse 46, 01187, Dresden, Germany,
| | | | | |
Collapse
|
5
|
Johnston ST, Simpson MJ, McElwain DLS. How much information can be obtained from tracking the position of the leading edge in a scratch assay? J R Soc Interface 2015; 11:20140325. [PMID: 24850906 PMCID: PMC4208362 DOI: 10.1098/rsif.2014.0325] [Citation(s) in RCA: 51] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
Abstract
Moving cell fronts are an essential feature of wound healing, development and disease. The rate at which a cell front moves is driven, in part, by the cell motility, quantified in terms of the cell diffusivity D, and the cell proliferation rate λ. Scratch assays are a commonly reported procedure used to investigate the motion of cell fronts where an initial cell monolayer is scratched, and the motion of the front is monitored over a short period of time, often less than 24 h. The simplest way of quantifying a scratch assay is to monitor the progression of the leading edge. Use of leading edge data is very convenient because, unlike other methods, it is non-destructive and does not require labelling, tracking or counting individual cells among the population. In this work, we study short-time leading edge data in a scratch assay using a discrete mathematical model and automated image analysis with the aim of investigating whether such data allow us to reliably identify D and λ. Using a naive calibration approach where we simply scan the relevant region of the (D, λ) parameter space, we show that there are many choices of D and λ for which our model produces indistinguishable short-time leading edge data. Therefore, without due care, it is impossible to estimate D and λ from this kind of data. To address this, we present a modified approach accounting for the fact that cell motility occurs over a much shorter time scale than proliferation. Using this information, we divide the duration of the experiment into two periods, and we estimate D using data from the first period, whereas we estimate λ using data from the second period. We confirm the accuracy of our approach using in silico data and a new set of in vitro data, which shows that our method recovers estimates of D and λ that are consistent with previously reported values except that that our approach is fast, inexpensive, non-destructive and avoids the need for cell labelling and cell counting.
Collapse
Affiliation(s)
- Stuart T Johnston
- Mathematical Sciences, Queensland University of Technology, Brisbane, Australia Institute of Health and Biomedical Innovation, Queensland University of Technology, Brisbane, Australia
| | - Matthew J Simpson
- Mathematical Sciences, Queensland University of Technology, Brisbane, Australia Institute of Health and Biomedical Innovation, Queensland University of Technology, Brisbane, Australia
| | - D L Sean McElwain
- Mathematical Sciences, Queensland University of Technology, Brisbane, Australia Institute of Health and Biomedical Innovation, Queensland University of Technology, Brisbane, Australia
| |
Collapse
|
6
|
Davies K, Green J, Bean N, Binder B, Ross J. On the derivation of approximations to cellular automata models and the assumption of independence. Math Biosci 2014; 253:63-71. [DOI: 10.1016/j.mbs.2014.04.004] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2013] [Revised: 04/10/2014] [Accepted: 04/15/2014] [Indexed: 02/02/2023]
|
7
|
Middleton AM, Fleck C, Grima R. A continuum approximation to an off-lattice individual-cell based model of cell migration and adhesion. J Theor Biol 2014; 359:220-32. [PMID: 24972155 DOI: 10.1016/j.jtbi.2014.06.011] [Citation(s) in RCA: 52] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2013] [Revised: 06/05/2014] [Accepted: 06/10/2014] [Indexed: 11/24/2022]
Abstract
Cell-cell adhesion plays a key role in the collective migration of cells and in determining correlations in the relative cell positions and velocities. Recently, it was demonstrated that off-lattice individual cell based models (IBMs) can accurately capture the correlations observed experimentally in a migrating cell population. However, IBMs are often computationally expensive and difficult to analyse mathematically. Traditional continuum-based models, in contrast, are amenable to mathematical analysis and are computationally less demanding, but typically correspond to a mean-field approximation of cell migration and so ignore cell-cell correlations. In this work, we address this problem by using an off-lattice IBM to derive a continuum approximation which does take into account correlations. We furthermore show that a mean-field approximation of the off-lattice IBM leads to a single partial integro-differential equation of the same form as proposed by Sherratt and co-workers to model cell adhesion. The latter is found to be only effective at approximating the ensemble averaged cell number density when mechanical interactions between cells are weak. In contrast, the predictions of our novel continuum model for the time-evolution of the ensemble cell number density distribution and of the density-density correlation function are in close agreement with those obtained from the IBM for a wide range of mechanical interaction strengths. In particular, we observe 'front-like' propagation of cells in simulations using both our IBM and our continuum model, but not in the continuum model simulations obtained using the mean-field approximation.
Collapse
Affiliation(s)
- Alistair M Middleton
- University of Heidelberg, Im Neuenheimer Feld 267, 69120 Heidelberg, Germany; Center for Biological Systems Analysis, University of Freiburg, Habsburgerstr. 49, 79104 Freiburg, Germany
| | - Christian Fleck
- Laboratory for Systems and Synthetic Biology, Dreijenplein 10, 6703HB Wageningen, The Netherlands
| | - Ramon Grima
- SynthSys and School of Biological Sciences, University of Edinburgh, EH9 3JR Edinburgh, UK.
| |
Collapse
|
8
|
Plank MJ, Simpson MJ. Models of collective cell behaviour with crowding effects: comparing lattice-based and lattice-free approaches. J R Soc Interface 2012; 9:2983-96. [PMID: 22696488 DOI: 10.1098/rsif.2012.0319] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023] Open
Abstract
Individual-based models describing the migration and proliferation of a population of cells frequently restrict the cells to a predefined lattice. An implicit assumption of this type of lattice-based model is that a proliferative population will always eventually fill the lattice. Here, we develop a new lattice-free individual-based model that incorporates cell-to-cell crowding effects. We also derive approximate mean-field descriptions for the lattice-free model in two special cases motivated by commonly used experimental set-ups. Lattice-free simulation results are compared with these mean-field descriptions and with a corresponding lattice-based model. Data from a proliferation experiment are used to estimate the parameters for the new model, including the cell proliferation rate, showing that the model fits the data well. An important aspect of the lattice-free model is that the confluent cell density is not predefined, as with lattice-based models, but an emergent model property. As a consequence of the more realistic, irregular configuration of cells in the lattice-free model, the population growth rate is much slower at high cell densities and the population cannot reach the same confluent density as an equivalent lattice-based model.
Collapse
Affiliation(s)
- Michael J Plank
- Department of Mathematics and Statistics, University of Canterbury, Christchurch, New Zealand.
| | | |
Collapse
|
9
|
Hackett-Jones EJ, Landman KA, Fellner K. Aggregation patterns from nonlocal interactions: Discrete stochastic and continuum modeling. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2012; 85:041912. [PMID: 22680503 DOI: 10.1103/physreve.85.041912] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/17/2011] [Indexed: 06/01/2023]
Abstract
Conservation equations governed by a nonlocal interaction potential generate aggregates from an initial uniform distribution of particles. We address the evolution and formation of these aggregating steady states when the interaction potential has both attractive and repulsive singularities. Currently, no existence theory for such potentials is available. We develop and compare two complementary solution methods, a continuous pseudoinverse method and a discrete stochastic lattice approach, and formally show a connection between the two. Interesting aggregation patterns involving multiple peaks for a simple doubly singular attractive-repulsive potential are determined. For a swarming Morse potential, characteristic slow-fast dynamics in the scaled inverse energy is observed in the evolution to steady state in both the continuous and discrete approaches. The discrete approach is found to be remarkably robust to modifications in movement rules, related to the potential function. The comparable evolution dynamics and steady states of the discrete model with the continuum model suggest that the discrete stochastic approach is a promising way of probing aggregation patterns arising from two- and three-dimensional nonlocal interaction conservation equations.
Collapse
Affiliation(s)
- Emily J Hackett-Jones
- Department of Mathematics and Statistics, University of Melbourne, Victoria 3010, Australia
| | | | | |
Collapse
|
10
|
Treloar KK, Simpson MJ, McCue SW. Velocity-jump models with crowding effects. PHYSICAL REVIEW. E, STATISTICAL, NONLINEAR, AND SOFT MATTER PHYSICS 2011; 84:061920. [PMID: 22304129 DOI: 10.1103/physreve.84.061920] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/13/2011] [Indexed: 05/31/2023]
Abstract
Velocity-jump processes are discrete random-walk models that have many applications including the study of biological and ecological collective motion. In particular, velocity-jump models are often used to represent a type of persistent motion, known as a run and tumble, that is exhibited by some isolated bacteria cells. All previous velocity-jump processes are noninteracting, which means that crowding effects and agent-to-agent interactions are neglected. By neglecting these agent-to-agent interactions, traditional velocity-jump models are only applicable to very dilute systems. Our work is motivated by the fact that many applications in cell biology, such as wound healing, cancer invasion, and development, often involve tissues that are densely packed with cells where cell-to-cell contact and crowding effects can be important. To describe these kinds of high-cell-density problems using a velocity-jump process we introduce three different classes of crowding interactions into a one-dimensional model. Simulation data and averaging arguments lead to a suite of continuum descriptions of the interacting velocity-jump processes. We show that the resulting systems of hyperbolic partial differential equations predict the mean behavior of the stochastic simulations very well.
Collapse
Affiliation(s)
- Katrina K Treloar
- School of Mathematical Sciences, Queensland University of Technology, Brisbane, Queensland 4001, Australia
| | | | | |
Collapse
|
11
|
Hackett-Jones EJ, Landman KA, Newgreen DF, Zhang D. On the role of differential adhesion in gangliogenesis in the enteric nervous system. J Theor Biol 2011; 287:148-59. [PMID: 21816161 DOI: 10.1016/j.jtbi.2011.07.013] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/04/2011] [Revised: 07/19/2011] [Accepted: 07/20/2011] [Indexed: 01/12/2023]
Abstract
A defining characteristic of the normal development of the enteric nervous system (ENS) is the existence of mesoscale patterned entities called ganglia. Ganglia are clusters of neurons with associated enteric neural crest (ENC) cells, which form in the simultaneously growing gut wall. At first the precursor ENC cells proliferate and gradually differentiate to produce the enteric neurons; these neurons form clusters with ENC scattered around and later lying on the periphery of neuronal clusters. By immunolabelling neural cell-cell adhesion molecules, we infer that the adhesive capacity of neurons is greater than that of ENC cells. Using a discrete mathematical model, we test the hypothesis that local rules governing differential adhesion of neuronal agents and ENC agents will produce clusters which emulate ganglia. The clusters are relatively stable, relatively uniform and small in size, of fairly uniform spacing, with a balance between the number of neuronal and ENC agents. These features are attained in both fixed and growing domains, reproducing respectively organotypic in vitro and in vivo observations. Various threshold criteria governing ENC agent proliferation and differentiation and neuronal agent inhibition of differentiation are important for sustaining these characteristics. This investigation suggests possible explanations for observations in normal and abnormal ENS development.
Collapse
Affiliation(s)
- Emily J Hackett-Jones
- Department of Mathematics and Statistics, University of Melbourne, Victoria 3010, Australia
| | | | | | | |
Collapse
|