Classification of particle trajectories in living cells: Machine learning versus statistical testing hypothesis for fractional anomalous diffusion

Trajectory Analysis in Single-Particle Tracking: From Mean Squared Displacement to Machine Learning Approaches

Single-particle tracking is a powerful technique to investigate the motion of molecules or particles. Here, we review the methods for analyzing the reconstructed trajectories, a fundamental step for deciphering the underlying mechanisms driving the motion. First, we review the traditional analysis based on the mean squared displacement (MSD), highlighting the sometimes-neglected factors potentially affecting the accuracy of the results. We then report methods that exploit the distribution of parameters other than displacements, e.g., angles, velocities, and times and probabilities of reaching a target, discussing how they are more sensitive in characterizing heterogeneities and transient behaviors masked in the MSD analysis. Hidden Markov Models are also used for this purpose, and these allow for the identification of different states, their populations and the switching kinetics. Finally, we discuss a rapidly expanding field-trajectory analysis based on machine learning. Various approaches, from random forest to deep learning, are used to classify trajectory motions, which can be identified by motion models or by model-free sets of trajectory features, either previously defined or automatically identified by the algorithms. We also review free software available for some of the analysis methods. We emphasize that approaches based on a combination of the different methods, including classical statistics and machine learning, may be the way to obtain the most informative and accurate results.

User authentication system based on human exhaled breath physics

This work, in a pioneering approach, attempts to build a biometric system that works purely based on the fluid mechanics governing exhaled breath. We test the hypothesis that the structure of turbulence in exhaled human breath can be exploited to build biometric algorithms. This work relies on the idea that the extrathoracic airway is unique for every individual, making the exhaled breath a biomarker. Methods including classical multi-dimensional hypothesis testing approach and machine learning models are employed in building user authentication algorithms, namely user confirmation and user identification. A user confirmation algorithm tries to verify whether a user is the person they claim to be. A user identification algorithm tries to identify a user's identity with no prior information available. A dataset of exhaled breath time series samples from 94 human subjects was used to evaluate the performance of these algorithms. The user confirmation algorithms performed exceedingly well for the given dataset with over 97% true confirmation rate. The machine learning based algorithm achieved a good true confirmation rate, reiterating our understanding of why machine learning based algorithms typically outperform classical hypothesis test based algorithms. The user identification algorithm performs reasonably well with the provided dataset with over 50% of the users identified as being within two possible suspects. We show surprisingly unique turbulent signatures in the exhaled breath that have not been discovered before. In addition to discussions on a novel biometric system, we make arguments to utilise this idea as a tool to gain insights into the morphometric variation of extrathoracic airway across individuals. Such tools are expected to have future potential in the area of personalised medicines.

Multifractal spectral features enhance classification of anomalous diffusion

Anomalous diffusion processes, characterized by their nonstandard scaling of the mean-squared displacement, pose a unique challenge in classification and characterization. In a previous study [Mangalam et al., Phys. Rev. Res. 5, 023144 (2023)2643-156410.1103/PhysRevResearch.5.023144], we established a comprehensive framework for understanding anomalous diffusion using multifractal formalism. The present study delves into the potential of multifractal spectral features for effectively distinguishing anomalous diffusion trajectories from five widely used models: fractional Brownian motion, scaled Brownian motion, continuous-time random walk, annealed transient time motion, and Lévy walk. We generate extensive datasets comprising 10^{6} trajectories from these five anomalous diffusion models and extract multiple multifractal spectra from each trajectory to accomplish this. Our investigation entails a thorough analysis of neural network performance, encompassing features derived from varying numbers of spectra. We also explore the integration of multifractal spectra into traditional feature datasets, enabling us to assess their impact comprehensively. To ensure a statistically meaningful comparison, we categorize features into concept groups and train neural networks using features from each designated group. Notably, several feature groups demonstrate similar levels of accuracy, with the highest performance observed in groups utilizing moving-window characteristics and p varation features. Multifractal spectral features, particularly those derived from three spectra involving different timescales and cutoffs, closely follow, highlighting their robust discriminatory potential. Remarkably, a neural network exclusively trained on features from a single multifractal spectrum exhibits commendable performance, surpassing other feature groups. In summary, our findings underscore the diverse and potent efficacy of multifractal spectral features in enhancing the predictive capacity of machine learning to classify anomalous diffusion processes.

Extract latent features of single-particle trajectories with historical experience learning

Single-particle tracking has enabled real-time, in situ quantitative studies of complex systems. However, inferring dynamic state changes from noisy and undersampling trajectories encounters challenges. Here, we introduce a data-driven method for extracting features of subtrajectories with historical experience learning (Deep-SEES), where a single-particle tracking analysis pipeline based on a self-supervised architecture automatically searches for the latent space, allowing effective segmentation of the underlying states from noisy trajectories without prior knowledge on the particle dynamics. We validated our method on a variety of noisy simulated and experimental data. Our results showed that the method can faithfully capture both stable states and their dynamic switch. In highly random systems, our method outperformed commonly used unsupervised methods in inferring motion states, which is important for understanding nanoparticles interacting with living cell membranes, active enzymes, and liquid-liquid phase separation. Self-generating latent features of trajectories could potentially improve the understanding, estimation, and prediction of many complex systems.

Confined modes of single-particle trajectories induced by stochastic resetting

Random trajectories of single particles in living cells contain information about the interaction between particles, as well as with the cellular environment. However, precise consideration of the underlying stochastic properties, beyond normal diffusion, remains a challenge as applied to each particle trajectory separately. In this paper, we show how positions of confined particles in living cells can obey not only the Laplace distribution, but the Linnik one. This feature is detected in experimental data for the motion of G proteins and coupled receptors in cells, and its origin is explained in terms of stochastic resetting. This resetting process generates power-law waiting times, giving rise to the Linnik statistics in confined motion, and also includes exponentially distributed times as a limit case leading to the Laplace one. The stochastic process, which is affected by the resetting, can be Brownian motion commonly found in cells. Other possible models producing similar effects are discussed.

Machine-Learning Solutions for the Analysis of Single-Particle Diffusion Trajectories

Single-particle traces of the diffusive motion of molecules, cells, or animals are by now routinely measured, similar to stochastic records of stock prices or weather data. Deciphering the stochastic mechanism behind the recorded dynamics is vital in understanding the observed systems. Typically, the task is to decipher the exact type of diffusion and/or to determine the system parameters. The tools used in this endeavor are currently being revolutionized by modern machine-learning techniques. In this Perspective we provide an overview of recently introduced methods in machine-learning for diffusive time series, most notably, those successfully competing in the anomalous diffusion challenge. As such methods are often criticized for their lack of interpretability, we focus on means to include uncertainty estimates and feature-based approaches, both improving interpretability and providing concrete insight into the learning process of the machine. We expand the discussion by examining predictions on different out-of-distribution data. We also comment on expected future developments.

Anomalous diffusion, nonergodicity, non-Gaussianity, and aging of fractional Brownian motion with nonlinear clocks

How do nonlinear clocks in time and/or space affect the fundamental properties of a stochastic process? Specifically, how precisely may ergodic processes such as fractional Brownian motion (FBM) acquire predictable nonergodic and aging features being subjected to such conditions? We address these questions in the current study. To describe different types of non-Brownian motion of particles-including power-law anomalous, ultraslow or logarithmic, as well as superfast or exponential diffusion-we here develop and analyze a generalized stochastic process of scaled-fractional Brownian motion (SFBM). The time- and space-SFBM processes are, respectively, constructed based on FBM running with nonlinear time and space clocks. The fundamental statistical characteristics such as non-Gaussianity of particle displacements, nonergodicity, as well as aging are quantified for time- and space-SFBM by selecting different clocks. The latter parametrize power-law anomalous, ultraslow, and superfast diffusion. The results of our computer simulations are fully consistent with the analytical predictions for several functional forms of clocks. We thoroughly examine the behaviors of the probability-density function, the mean-squared displacement, the time-averaged mean-squared displacement, as well as the aging factor. Our results are applicable for rationalizing the impact of nonlinear time and space properties superimposed onto the FBM-type dynamics. SFBM offers a general framework for a universal and more precise model-based description of anomalous, nonergodic, non-Gaussian, and aging diffusion in single-molecule-tracking observations.

Single-molecule tracking to determine the abundances and stoichiometries of freely-diffusing protein complexes in living cells: Past applications and future prospects

Most biological processes in living cells rely on interactions between proteins. Live-cell compatible approaches that can quantify to what extent a given protein participates in homo- and hetero-oligomeric complexes of different size and subunit composition are therefore critical to advance our understanding of how cellular physiology is governed by these molecular interactions. Biomolecular complex formation changes the diffusion coefficient of constituent proteins, and these changes can be measured using fluorescence microscopy-based approaches, such as single-molecule tracking, fluorescence correlation spectroscopy, and fluorescence recovery after photobleaching. In this review, we focus on the use of single-molecule tracking to identify, resolve, and quantify the presence of freely-diffusing proteins and protein complexes in living cells. We compare and contrast different data analysis methods that are currently employed in the field and discuss experimental designs that can aid the interpretation of the obtained results. Comparisons of diffusion rates for different proteins and protein complexes in intracellular aqueous environments reported in the recent literature reveal a clear and systematic deviation from the Stokes-Einstein diffusion theory. While a complete and quantitative theoretical explanation of why such deviations manifest is missing, the available data suggest the possibility of weighing freely-diffusing proteins and protein complexes in living cells by measuring their diffusion coefficients. Mapping individual diffusive states to protein complexes of defined molecular weight, subunit stoichiometry, and structure promises to provide key new insights into how protein-protein interactions regulate protein conformational, translational, and rotational dynamics, and ultimately protein function.

Anomalous diffusion, non-Gaussianity, and nonergodicity for subordinated fractional Brownian motion with a drift

The stochastic motion of a particle with long-range correlated increments (the moving phase) which is intermittently interrupted by immobilizations (the trapping phase) in a disordered medium is considered in the presence of an external drift. In particular, we consider trapping events whose times follow a scale-free distribution with diverging mean trapping time. We construct this process in terms of fractional Brownian motion with constant forcing in which the trapping effect is introduced by the subordination technique, connecting "operational time" with observable "real time." We derive the statistical properties of this process such as non-Gaussianity and nonergodicity, for both ensemble and single-trajectory (time) averages. We demonstrate nice agreement with extensive simulations for the probability density function, skewness, kurtosis, as well as ensemble and time-averaged mean-squared displacements. We place a specific emphasis on the comparisons between the cases with and without drift.

Gramian angular fields for leveraging pretrained computer vision models with anomalous diffusion trajectories

Anomalous diffusion is present at all scales, from atomic to large ones. Some exemplary systems are ultracold atoms, telomeres in the nucleus of cells, moisture transport in cement-based materials, arthropods' free movement, and birds' migration patterns. The characterization of the diffusion gives critical information about the dynamics of these systems and provides an interdisciplinary framework with which to study diffusive transport. Thus, the problem of identifying underlying diffusive regimes and inferring the anomalous diffusion exponent α with high confidence is critical to physics, chemistry, biology, and ecology. Classification and analysis of raw trajectories combining machine learning techniques with statistics extracted from them have widely been studied in the Anomalous Diffusion Challenge [Muñoz-Gil et al., Nat. Commun. 12, 6253 (2021)2041-172310.1038/s41467-021-26320-w]. Here we present a new data-driven method for working with diffusive trajectories. This method utilizes Gramian angular fields (GAF) to encode one-dimensional trajectories as images (Gramian matrices), while preserving their spatiotemporal structure for input to computer-vision models. This allows us to leverage two well-established pretrained computer-vision models, ResNet and MobileNet, to characterize the underlying diffusive regime and infer the anomalous diffusion exponent α. Short raw trajectories of lengths between 10 and 50 are commonly encountered in single-particle tracking experiments and are the most difficult ones to characterize. We show that GAF images can outperform the current state-of-the-art while increasing accessibility to machine learning methods in an applied setting.

Temperature and friction fluctuations inside a harmonic potential

In this article we study the trapped motion of a molecule undergoing diffusivity fluctuations inside a harmonic potential. For the same diffusing-diffusivity process, we investigate two possible interpretations. Depending on whether diffusivity fluctuations are interpreted as temperature or friction fluctuations, we show that they display drastically different statistical properties inside the harmonic potential. We compute the characteristic function of the process under both types of interpretations and analyze their limit behavior. Based on the integral representations of the processes we compute the mean-squared displacement and the normalized excess kurtosis. In the long-time limit, we show for friction fluctuations that the probability density function (PDF) always converges to a Gaussian whereas in the case of temperature fluctuations the stationary PDF can display either Gaussian distribution or generalized Laplace (Bessel) distribution depending on the ratio between diffusivity and positional correlation times.

Bayesian deep learning for error estimation in the analysis of anomalous diffusion

Modern single-particle-tracking techniques produce extensive time-series of diffusive motion in a wide variety of systems, from single-molecule motion in living-cells to movement ecology. The quest is to decipher the physical mechanisms encoded in the data and thus to better understand the probed systems. We here augment recently proposed machine-learning techniques for decoding anomalous-diffusion data to include an uncertainty estimate in addition to the predicted output. To avoid the Black-Box-Problem a Bayesian-Deep-Learning technique named Stochastic-Weight-Averaging-Gaussian is used to train models for both the classification of the diffusion model and the regression of the anomalous diffusion exponent of single-particle-trajectories. Evaluating their performance, we find that these models can achieve a well-calibrated error estimate while maintaining high prediction accuracies. In the analysis of the output uncertainty predictions we relate these to properties of the underlying diffusion models, thus providing insights into the learning process of the machine and the relevance of the output.

Multifractional Brownian motion characterization based on Hurst exponent estimation and statistical learning

This paper proposes an approach for the estimation of a time-varying Hurst exponent to allow accurate identification of multifractional Brownian motion (MFBM). The contribution provides a prescription for how to deal with the MFBM measurement data to solve regression and classification problems. Theoretical studies are supplemented with computer simulations and real-world examples. Those prove that the procedure proposed in this paper outperforms the best-in-class algorithm.

Anomalous diffusion, aging, and nonergodicity of scaled Brownian motion with fractional Gaussian noise: overview of related experimental observations and models

How does a systematic time-dependence of the diffusion coefficient $D (t)$ affect the ergodic and statistical characteristics of fractional Brownian motion (FBM)? Here, we examine how the behavior of the...

Objective comparison of methods to decode anomalous diffusion

Deviations from Brownian motion leading to anomalous diffusion are found in transport dynamics from quantum physics to life sciences. The characterization of anomalous diffusion from the measurement of an individual trajectory is a challenging task, which traditionally relies on calculating the trajectory mean squared displacement. However, this approach breaks down for cases of practical interest, e.g., short or noisy trajectories, heterogeneous behaviour, or non-ergodic processes. Recently, several new approaches have been proposed, mostly building on the ongoing machine-learning revolution. To perform an objective comparison of methods, we gathered the community and organized an open competition, the Anomalous Diffusion challenge (AnDi). Participating teams applied their algorithms to a commonly-defined dataset including diverse conditions. Although no single method performed best across all scenarios, machine-learning-based approaches achieved superior performance for all tasks. The discussion of the challenge results provides practical advice for users and a benchmark for developers.

Time averaging and emerging nonergodicity upon resetting of fractional Brownian motion and heterogeneous diffusion processes

How different are the results of constant-rate resetting of anomalous-diffusion processes in terms of their ensemble-averaged versus time-averaged mean-squared displacements (MSDs versus TAMSDs) and how does stochastic resetting impact nonergodicity? We examine, both analytically and by simulations, the implications of resetting on the MSD- and TAMSD-based spreading dynamics of particles executing fractional Brownian motion (FBM) with a long-time memory, heterogeneous diffusion processes (HDPs) with a power-law space-dependent diffusivity D(x)=D_{0}|x|^{γ} and their "combined" process of HDP-FBM. We find, inter alia, that the resetting dynamics of originally ergodic FBM for superdiffusive Hurst exponents develops disparities in scaling and magnitudes of the MSDs and mean TAMSDs indicating weak ergodicity breaking. For subdiffusive HDPs we also quantify the nonequivalence of the MSD and TAMSD and observe a new trimodal form of the probability density function. For reset FBM, HDPs and HDP-FBM we compute analytically and verify by simulations the short-time MSD and TAMSD asymptotes and long-time plateaus reminiscent of those for processes under confinement. We show that certain characteristics of these reset processes are functionally similar despite a different stochastic nature of their nonreset variants. Importantly, we discover nonmonotonicity of the ergodicity-breaking parameter EB as a function of the resetting rate r. For all reset processes studied we unveil a pronounced resetting-induced nonergodicity with a maximum of EB at intermediate r and EB∼(1/r)-decay at large r. Alongside the emerging MSD-versus-TAMSD disparity, this r-dependence of EB can be an experimentally testable prediction. We conclude by discussing some implications to experimental systems featuring resetting dynamics.

Single-particle diffusional fingerprinting: A machine-learning framework for quantitative analysis of heterogeneous diffusion

Single-particle tracking (SPT) analysis of individual biomolecules is an indispensable tool for extracting quantitative information from dynamic biological processes, but often requires some a priori knowledge of the system. Here we present “single-particle diffusional fingerprinting,” a more general approach for extraction of diffusional patterns in SPT independently of the biological system. This method extracts a set of descriptive features for each SPT trajectory, which are ranked upon classification to yield mechanistic insights for the species under comparison. We demonstrate its capacity to yield a dictionary of diffusional traits across multiple systems (e.g., lipases hydrolyzing fat, transcription factors diffusing in cells, and nanoparticles in mucus), supporting its use on multiple biological phenomena (e.g., drug delivery, receptor dynamics, and virology).

Single-particle tracking (SPT) is a key tool for quantitative analysis of dynamic biological processes and has provided unprecedented insights into a wide range of systems such as receptor localization, enzyme propulsion, bacteria motility, and drug nanocarrier delivery. The inherently complex diffusion in such biological systems can vary drastically both in time and across systems, consequently imposing considerable analytical challenges, and currently requires an a priori knowledge of the system. Here we introduce a method for SPT data analysis, processing, and classification, which we term “diffusional fingerprinting.” This method allows for dissecting the features that underlie diffusional behavior and establishing molecular identity, regardless of the underlying diffusion type. The method operates by isolating 17 descriptive features for each observed motion trajectory and generating a diffusional map of all features for each type of particle. Precise classification of the diffusing particle identity is then obtained by training a simple logistic regression model. A linear discriminant analysis generates a feature ranking that outputs the main differences among diffusional features, providing key mechanistic insights. Fingerprinting operates by both training on and predicting experimental data, without the need for pretraining on simulated data. We found this approach to work across a wide range of simulated and experimentally diverse systems, such as tracked lipases on fat substrates, transcription factors diffusing in cells, and nanoparticles diffusing in mucus. This flexibility ultimately supports diffusional fingerprinting’s utility as a universal paradigm for SPT diffusional analysis and prediction.

Time-averaged mean squared displacement ratio test for Gaussian processes with unknown diffusion coefficient

The time-averaged mean squared displacement (TAMSD) is one of the most common statistics used for the analysis of anomalous diffusion processes. Anomalous diffusion is manifested by non-linear (mostly power-law) characteristics of the process in contrast to normal diffusion where linear characteristics are expected. One can distinguish between sub- and super-diffusive processes. We consider Gaussian anomalous diffusion models and propose a new approach used for their testing. This approach is based on the TAMSD ratio statistic for different time lags. Similar to the TAMSD, this statistic exhibits a specific behavior in the anomalous diffusion regime. Through its structure, it is independent of the diffusion coefficient, which, in general, does not influence anomalous diffusion behavior. Thus, the TAMSD ratio-based approach does not require preliminary knowledge of the diffusion coefficient's value, in contrast to the TAMSD-approach, where this value is crucial in the testing procedure. Based on the quadratic form representation of the TAMSD ratio, we calculate its main characteristics and propose a step-by-step testing procedure that can be applied for any Gaussian process. For the anomalous diffusion model used here, namely, the fractional Brownian motion, we demonstrate the effectiveness of the proposed methodology. We show that the new approach outperforms the TAMSD-based one, especially for small sample sizes. Finally, the methodology is applied to the real data from the financial market.

Detection of Anomalous Diffusion with Deep Residual Networks

Identification of the diffusion type of molecules in living cells is crucial to deduct their driving forces and hence to get insight into the characteristics of the cells. In this paper, deep residual networks have been used to classify the trajectories of molecules. We started from the well known ResNet architecture, developed for image classification, and carried out a series of numerical experiments to adapt it to detection of diffusion modes. We managed to find a model that has a better accuracy than the initial network, but contains only a small fraction of its parameters. The reduced size significantly shortened the training time of the model. Moreover, the resulting network has less tendency to overfitting and generalizes better to unseen data.

An Estimation Algorithm for General Linear Single Particle Tracking Models with Time-Varying Parameters

Single Particle Tracking (SPT) is a powerful class of methods for studying the dynamics of biomolecules inside living cells. The techniques reveal the trajectories of individual particles, with a resolution well below the diffraction limit of light, and from them the parameters defining the motion model, such as diffusion coefficients and confinement lengths. Most existing algorithms assume these parameters are constant throughout an experiment. However, it has been demonstrated that they often vary with time as the tracked particles move through different regions in the cell or as conditions inside the cell change in response to stimuli. In this work, we propose an estimation algorithm to determine time-varying parameters of systems that discretely switch between different linear models of motion with Gaussian noise statistics, covering dynamics such as diffusion, directed motion, and Ornstein-Uhlenbeck dynamics. Our algorithm consists of three stages. In the first stage, we use a sliding window approach, combined with Expectation Maximization (EM) to determine maximum likelihood estimates of the parameters as a function of time. These results are only used to roughly estimate the number of model switches that occur in the data to guide the selection of algorithm parameters in the second stage. In the second stage, we use Change Detection (CD) techniques to identify where the models switch, taking advantage of the off-line nature of the analysis of SPT data to create non-causal algorithms with better precision than a purely causal approach. Finally, we apply EM to each set of data between the change points to determine final parameter estimates. We demonstrate our approach using experimental data generated in the lab under controlled conditions.

Impact of Feature Choice on Machine Learning Classification of Fractional Anomalous Diffusion

The growing interest in machine learning methods has raised the need for a careful study of their application to the experimental single-particle tracking data. In this paper, we present the differences in the classification of the fractional anomalous diffusion trajectories that arise from the selection of the features used in random forest and gradient boosting algorithms. Comparing two recently used sets of human-engineered attributes with a new one, which was tailor-made for the problem, we show the importance of a thoughtful choice of the features and parameters. We also analyse the influence of alterations of synthetic training data set on the classification results. The trained classifiers are tested on real trajectories of G proteins and their receptors on a plasma membrane.

Fractional Dynamics Identification via Intelligent Unpacking of the Sample Autocovariance Function by Neural Networks

Many single-particle tracking data related to the motion in crowded environments exhibit anomalous diffusion behavior. This phenomenon can be described by different theoretical models. In this paper, fractional Brownian motion (FBM) was examined as the exemplary Gaussian process with fractional dynamics. The autocovariance function (ACVF) is a function that determines completely the Gaussian process. In the case of experimental data with anomalous dynamics, the main problem is first to recognize the type of anomaly and then to reconstruct properly the physical rules governing such a phenomenon. The challenge is to identify the process from short trajectory inputs. Various approaches to address this problem can be found in the literature, e.g., theoretical properties of the sample ACVF for a given process. This method is effective; however, it does not utilize all of the information contained in the sample ACVF for a given trajectory, i.e., only values of statistics for selected lags are used for identification. An evolution of this approach is proposed in this paper, where the process is determined based on the knowledge extracted from the ACVF. The designed method is intuitive and it uses information directly available in a new fashion. Moreover, the knowledge retrieval from the sample ACVF vector is enhanced with a learning-based scheme operating on the most informative subset of available lags, which is proven to be an effective encoder of the properties inherited in complex data. Finally, the robustness of the proposed algorithm for FBM is demonstrated with the use of Monte Carlo simulations.