Particle Mobility Analysis Using Deep Learning and the Moment Scaling Spectrum

Distinct mobility patterns of BRCA2 molecules at DNA damage sites

BRCA2 is an essential tumor suppressor protein involved in promoting faithful repair of DNA lesions. The activity of BRCA2 needs to be tuned precisely to be active when and where it is needed. Here, we quantified the spatio-temporal dynamics of BRCA2 in living cells using aberration-corrected multifocal microscopy (acMFM). Using multicolor imaging to identify DNA damage sites, we were able to quantify its dynamic motion patterns in the nucleus and at DNA damage sites. While a large fraction of BRCA2 molecules localized near DNA damage sites appear immobile, an additional fraction of molecules exhibits subdiffusive motion, providing a potential mechanism to retain an increased number of molecules at DNA lesions. Super-resolution microscopy revealed inhomogeneous localization of BRCA2 relative to other DNA repair factors at sites of DNA damage. This suggests the presence of multiple nanoscale compartments in the chromatin surrounding the DNA lesion, which could play an important role in the contribution of BRCA2 to the regulation of the repair process.

Deep learning reduces data requirements and allows real-time measurements in imaging FCS

Imaging fluorescence correlation spectroscopy (FCS) is a powerful tool to extract information on molecular mobilities, actions, and interactions in live cells, tissues, and organisms. Nevertheless, several limitations restrict its applicability. First, FCS is data hungry, requiring 50,000 frames at 1-ms time resolution to obtain accurate parameter estimates. Second, the data size makes evaluation slow. Third, as FCS evaluation is model dependent, data evaluation is significantly slowed unless analytic models are available. Here, we introduce two convolutional neural networks-FCSNet and ImFCSNet-for correlation and intensity trace analysis, respectively. FCSNet robustly predicts parameters in 2D and 3D live samples. ImFCSNet reduces the amount of data required for accurate parameter retrieval by at least one order of magnitude and makes correct estimates even in moderately defocused samples. Both convolutional neural networks are trained on simulated data, are model agnostic, and allow autonomous, real-time evaluation of imaging FCS measurements.

Deep learning assisted single particle tracking for automated correlation between diffusion and function

Sub-cellular diffusion in living systems reflects cellular processes and interactions. Recent advances in optical microscopy allow the tracking of this nanoscale diffusion of individual objects with an unprecedented level of precision. However, the agnostic and automated extraction of functional information from the diffusion of molecules and organelles within the sub-cellular environment, is labor-intensive and poses a significant challenge. Here we introduce DeepSPT, a deep learning framework to interpret the diffusional 2D or 3D temporal behavior of objects in a rapid and efficient manner, agnostically. Demonstrating its versatility, we have applied DeepSPT to automated mapping of the early events of viral infections, identifying distinct types of endosomal organelles, and clathrin-coated pits and vesicles with up to 95% accuracy and within seconds instead of weeks. The fact that DeepSPT effectively extracts biological information from diffusion alone illustrates that besides structure, motion encodes function at the molecular and subcellular level.

Single-molecule analysis of intracellular insulin granule behavior and its application to analyzing cytoskeletal dependence and pathophysiological implications

Introduction: Mobilization of intracellular insulin granules to the plasma membrane plays a crucial role in regulating insulin secretion. However, the regulatory mechanisms of this mobilization process have been poorly understood due to technical limitations. In this study, we propose a convenient approach for assessing intracellular insulin granule behavior based on single-molecule analysis of insulin granule membrane proteins labeled with Quantum dot fluorescent nanocrystals. Methods: This approach allows us to analyze intracellular insulin granule movement with subpixel accuracy at 33 fps. We tracked two insulin granule membrane proteins, phogrin and zinc transporter 8, fused to HaloTag in rat insulinoma INS-1 cells and, by evaluating the tracks with mean-square displacement, demonstrated the characteristic behavior of insulin granules. Results and discussion: Pharmacological perturbations of microtubules and F-actin affected insulin granule behavior on distinct modalities. Specifically, microtubule dynamics and F-actin positively and negatively regulate insulin granule behavior, respectively, presumably by modulating each different behavioral mode. Furthermore, we observed impaired insulin granule behavior and cytoskeletal architecture under chronic treatment of high concentrations of glucose and palmitate. Our approach provides detailed information regarding intracellular insulin granule mobilization and its pathophysiological implications. This study sheds new light on the regulatory mechanisms of intracellular insulin granule mobilization and has important implications for understanding the pathogenesis of diabetes.

Inferring pointwise diffusion properties of single trajectories with deep learning

To characterize the mechanisms governing the diffusion of particles in biological scenarios, it is essential to accurately determine their diffusive properties. To do so, we propose a machine-learning method to characterize diffusion processes with time-dependent properties at the experimental time resolution. Our approach operates at the single-trajectory level predicting the properties of interest, such as the diffusion coefficient or the anomalous diffusion exponent, at every time step of the trajectory. In this way, changes in the diffusive properties occurring along the trajectory emerge naturally in the prediction and thus allow the characterization without any prior knowledge or assumption about the system. We first benchmark the method on synthetic trajectories simulated under several conditions. We show that our approach can successfully characterize both abrupt and continuous changes in the diffusion coefficient or the anomalous diffusion exponent. Finally, we leverage the method to analyze experiments of single-molecule diffusion of two membrane proteins in living cells: the pathogen-recognition receptor DC-SIGN and the integrin α5β1. The analysis allows us to characterize physical parameters and diffusive states with unprecedented accuracy, shedding new light on the underlying mechanisms.

Extract latent features of single-particle trajectories with historical experience learning

Single-particle tracking has enabled real-time, in situ quantitative studies of complex systems. However, inferring dynamic state changes from noisy and undersampling trajectories encounters challenges. Here, we introduce a data-driven method for extracting features of subtrajectories with historical experience learning (Deep-SEES), where a single-particle tracking analysis pipeline based on a self-supervised architecture automatically searches for the latent space, allowing effective segmentation of the underlying states from noisy trajectories without prior knowledge on the particle dynamics. We validated our method on a variety of noisy simulated and experimental data. Our results showed that the method can faithfully capture both stable states and their dynamic switch. In highly random systems, our method outperformed commonly used unsupervised methods in inferring motion states, which is important for understanding nanoparticles interacting with living cell membranes, active enzymes, and liquid-liquid phase separation. Self-generating latent features of trajectories could potentially improve the understanding, estimation, and prediction of many complex systems.

Deep learning assisted single particle tracking for automated correlation between diffusion and function

Sub-cellular diffusion in living systems reflects cellular processes and interactions. Recent advances in optical microscopy allow the tracking of this nanoscale diffusion of individual objects with an unprecedented level of precision. However, the agnostic and automated extraction of functional information from the diffusion of molecules and organelles within the sub-cellular environment, is labor-intensive and poses a significant challenge. Here we introduce DeepSPT, a deep learning framework to interpret the diffusional 2D or 3D temporal behavior of objects in a rapid and efficient manner, agnostically. Demonstrating its versatility, we have applied DeepSPT to automated mapping of the early events of viral infections, identifying distinct types of endosomal organelles, and clathrin-coated pits and vesicles with up to 95% accuracy and within seconds instead of weeks. The fact that DeepSPT effectively extracts biological information from diffusion alone indicates that besides structure, motion encodes function at the molecular and subcellular level.

A generative model to simulate spatiotemporal dynamics of biomolecules in cells

Generators of space-time dynamics in bioimaging have become essential to build ground truth datasets for image processing algorithm evaluation such as biomolecule detectors and trackers, as well as to generate training datasets for deep learning algorithms. In this contribution, we leverage a stochastic model, called birth-death-move (BDM) point process, in order to generate joint dynamics of biomolecules in cells. This particle-based stochastic simulation method is very flexible and can be seen as a generalization of well-established standard particle-based generators. In comparison, our approach allows us: (1) to model a system of particles in motion, possibly in interaction, that can each possibly switch from a motion regime (e.g., Brownian) to another (e.g., a directed motion); (2) to take into account finely the appearance over time of new trajectories and their disappearance, these events possibly depending on the cell regions but also on the current spatial configuration of all existing particles. This flexibility enables to generate more realistic dynamics than standard particle-based simulation procedures, by for example accounting for the colocalization phenomena often observed between intracellular vesicles. We explain how to specify all characteristics of a BDM model, with many practical examples that are relevant for bioimaging applications. As an illustration, based on real fluorescence microscopy datasets, we finally calibrate our model to mimic the joint dynamics of Langerin and Rab11 proteins near the plasma membrane, including the well-known colocalization occurrence between these two types of vesicles. We show that the resulting synthetic sequences exhibit comparable features as those observed in real microscopy image sequences.

Compartmentalization of androgen receptors at endogenous genes in living cells

A wide range of nuclear proteins are involved in the spatio-temporal organization of the genome through diverse biological processes such as gene transcription and DNA replication. Upon stimulation by testosterone and translocation to the nucleus, multiple androgen receptors (ARs) accumulate in microscopically discernable foci which are irregularly distributed in the nucleus. Here, we investigated the formation and physical nature of these foci, by combining novel fluorescent labeling techniques to visualize a defined chromatin locus of AR-regulated genes-PTPRN2 or BANP-simultaneously with either AR foci or individual AR molecules. Quantitative colocalization analysis showed evidence of AR foci formation induced by R1881 at both PTPRN2 and BANP loci. Furthermore, single-particle tracking (SPT) revealed three distinct subdiffusive fractional Brownian motion (fBm) states: immobilized ARs were observed near the labeled genes likely as a consequence of DNA-binding, while the intermediate confined state showed a similar spatial behavior but with larger displacements, suggesting compartmentalization by liquid-liquid phase separation (LLPS), while freely mobile ARs were diffusing in the nuclear environment. All together, we show for the first time in living cells the presence of AR-regulated genes in AR foci.

Heterogeneous anomalous transport in cellular and molecular biology

It is well established that a wide variety of phenomena in cellular and molecular biology involve anomalous transport e.g. the statistics for the motility of cells and molecules are fractional and do not conform to the archetypes of simple diffusion or ballistic transport. Recent research demonstrates that anomalous transport is in many cases heterogeneous in both time and space. Thus single anomalous exponents and single generalised diffusion coefficients are unable to satisfactorily describe many crucial phenomena in cellular and molecular biology. We consider advances in the field ofheterogeneous anomalous transport(HAT) highlighting: experimental techniques (single molecule methods, microscopy, image analysis, fluorescence correlation spectroscopy, inelastic neutron scattering, and nuclear magnetic resonance), theoretical tools for data analysis (robust statistical methods such as first passage probabilities, survival analysis, different varieties of mean square displacements, etc), analytic theory and generative theoretical models based on simulations. Special emphasis is made on high throughput analysis techniques based on machine learning and neural networks. Furthermore, we consider anomalous transport in the context of microrheology and the heterogeneous viscoelasticity of complex fluids. HAT in the wavefronts of reaction-diffusion systems is also considered since it plays an important role in morphogenesis and signalling. In addition, we present specific examples from cellular biology including embryonic cells, leucocytes, cancer cells, bacterial cells, bacterial biofilms, and eukaryotic microorganisms. Case studies from molecular biology include DNA, membranes, endosomal transport, endoplasmic reticula, mucins, globular proteins, and amyloids.

Sorzano CO. TrackAnalyzer: A Fiji/ImageJ toolbox for a holistic analysis of tracks

Current live-cell imaging techniques make possible the observation of live events and the acquisition of large datasets to characterize the different parameters of the visualized events. They provide new insights into the dynamics of biological processes with unprecedented spatial and temporal resolutions. Here we describe the implementation and application of a new tool called TrackAnalyzer, accessible from Fiji and ImageJ. Our tool allows running semi-automated single-particle tracking (SPT) and subsequent motion classification, as well as quantitative analysis of diffusion and intensity for selected tracks relying on the graphical user interface (GUI) for large sets of temporal images (X-Y-T or X-Y-C-T dimensions). TrackAnalyzer also allows 3D visualization of the results as overlays of either spots, cells or end-tracks over time, along with corresponding feature extraction and further classification according to user criteria. Our analysis workflow automates the following steps: (1) spot or cell detection and filtering, (2) construction of tracks, (3) track classification and analysis (diffusion and chemotaxis), and (4) detailed analysis and visualization of all the outputs along the pipeline. All these analyses are automated and can be run in batch mode for a set of similar acquisitions.

Quantitative Single-Molecule Localization Microscopy

Super-resolution fluorescence microscopy allows the investigation of cellular structures at nanoscale resolution using light. Current developments in super-resolution microscopy have focused on reliable quantification of the underlying biological data. In this review, we first describe the basic principles of super-resolution microscopy techniques such as stimulated emission depletion (STED) microscopy and single-molecule localization microscopy (SMLM), and then give a broad overview of methodological developments to quantify super-resolution data, particularly those geared toward SMLM data. We cover commonly used techniques such as spatial point pattern analysis, colocalization, and protein copy number quantification but also describe more advanced techniques such as structural modeling, single-particle tracking, and biosensing. Finally, we provide an outlook on exciting new research directions to which quantitative super-resolution microscopy might be applied.

Segmentation-based tracking of macrophages in 2D＋time microscopy movies inside a living animal

The automated segmentation and tracking of macrophages during their migration are challenging tasks due to their dynamically changing shapes and motions. This paper proposes a new algorithm to achieve automatic cell tracking in time-lapse microscopy macrophage data. First, we design a segmentation method employing space-time filtering, local Otsu's thresholding, and the SUBSURF (subjective surface segmentation) method. Next, the partial trajectories for cells overlapping in the temporal direction are extracted in the segmented images. Finally, the extracted trajectories are linked by considering their direction of movement. The segmented images and the obtained trajectories from the proposed method are compared with those of the semi-automatic segmentation and manual tracking. The proposed tracking achieved 97.4% of accuracy for macrophage data under challenging situations, feeble fluorescent intensity, irregular shapes, and motion of macrophages. We expect that the automatically extracted trajectories of macrophages can provide pieces of evidence of how macrophages migrate depending on their polarization modes in the situation, such as during wound healing.

Transport and accumulation of plastic particles on the varying sediment bed cover: Open-channel flow experiment

Contamination of sea bottom sediments by microplastics is widely confirmed, but the reasons for its patchiness remain poorly understood. Laboratory experiments are reported where combined sets of various plastic particles, different by shape, size, density, and flexibility, were transported by the step-wise increasing open-channel flow over the bottom covered with natural sediment of increasing grain size. For every particular flow velocity, observations revealed the recurrent formation of relatively narrow retention areas, where plastic particles lingered for some time in their motion. These areas follow the line of change of the sediment type from finer to coarser grains. It is shown that contact friction drives the retention of a particle at finer sediments, while particle/sediment-grain interaction becomes of importance when particles and sediment grains are of similar sizes. The presence of this effect can be expected for a relatively wide range of natural conditions.

MPTHub: An Open-Source Software for Characterizing the Transport of Particles in Biorelevant Media

The study of particle transport in different environments plays an essential role in understanding interactions with humans and other living organisms. Importantly, obtained data can be directly used for multiple applications in fields such as fundamental biology, toxicology, or medicine. Particle movement in biorelevant media can be readily monitored using microscopy and converted into time-resolved trajectories using freely available tracking software. However, translation into tangible and meaningful parameters is time consuming and not always intuitive. We developed new software—MPTHub—as an open-access, standalone, user-friendly tool for the rapid and reliable analysis of particle trajectories extracted from video microscopy. The software was programmed using Python and allowed to import and analyze trajectory data, as well as to export relevant data such as individual and ensemble time-averaged mean square displacements and effective diffusivity, and anomalous transport exponent. Data processing was reliable, fast (total processing time of less than 10 s), and required minimal memory resources (up to a maximum of around 150 MB in random access memory). Demonstration of software applicability was conducted by studying the transport of different polystyrene nanoparticles (100–200 nm) in mucus surrogates. Overall, MPTHub represents a freely available software tool that can be used even by inexperienced users for studying the transport of particles in biorelevant media.

Rapid Temperature-Dependent Rheological Measurements of Non-Newtonian Solutions Using a Machine-Learning Aided Microfluidic Rheometer

Biofluids such as synovial fluid, blood plasma, and saliva contain several proteins which impart non-Newtonian properties to the biofluids. The concentration of such protein macromolecules in biofluids is regarded as an important biomarker for the diagnosis of several health conditions, including cardiovascular disorders, joint quality, and Alzheimer's. Existing technologies for the measurements of macromolecules in biofluids are limited; they require a long turnaround time, or require complex protocols, thus calling for alternative, more suitable, methodologies aimed at such measurements. According to the well-established relations for polymer solutions, the concentration of macromolecules in solutions can also be derived via measurement of rheological properties such as shear-viscosity and the longest relaxation time. We here introduce a microfluidic rheometer for rapid simultaneous measurement of shear viscosity and longest relaxation time of non-Newtonian solutions at different temperatures. At variance with previous technologies, our microfluidic rheometer provides a very short turnaround time of around 2 min or less thanks to the implementation of a machine-learning algorithm. We validated our platform on several aqueous solutions of poly(ethylene oxide). We also performed measurements on hyaluronic acid solutions in the clinical range for joint grade assessment. We observed monotonic behavior with the concentration for both rheological properties, thus speculating on their use as potential rheo-markers, i.e., rheological biomarkers, across several disease states.

Moving beyond velocity: Opportunities and challenges to quantify immune cell behavior

The analysis of cellular behavior using intravital multi-photon microscopy has contributed substantially to our understanding of the priming and effector phases of immune responses. Yet, many questions remain unanswered and unexplored. Though advancements in intravital imaging techniques and animal models continue to drive new discoveries, continued improvements in analysis methods are needed to extract detailed information about cellular behavior. Focusing on dendritic cell (DC) and T cell interactions as an exemplar, here we discuss key limitations for intravital imaging studies and review and explore alternative approaches to quantify immune cell behavior. We touch upon current developments in deep learning models, as well as established methods from unrelated fields such as ecology to detect and track objects over time. As developments in open-source software make it possible to process and interactively view larger datasets, the challenge for the field will be to determine how best to combine intravital imaging with multi-parameter imaging of larger tissue regions to discover new facets of leukocyte dynamics and how these contribute to immune responses.

Objective comparison of methods to decode anomalous diffusion

Deviations from Brownian motion leading to anomalous diffusion are found in transport dynamics from quantum physics to life sciences. The characterization of anomalous diffusion from the measurement of an individual trajectory is a challenging task, which traditionally relies on calculating the trajectory mean squared displacement. However, this approach breaks down for cases of practical interest, e.g., short or noisy trajectories, heterogeneous behaviour, or non-ergodic processes. Recently, several new approaches have been proposed, mostly building on the ongoing machine-learning revolution. To perform an objective comparison of methods, we gathered the community and organized an open competition, the Anomalous Diffusion challenge (AnDi). Participating teams applied their algorithms to a commonly-defined dataset including diverse conditions. Although no single method performed best across all scenarios, machine-learning-based approaches achieved superior performance for all tasks. The discussion of the challenge results provides practical advice for users and a benchmark for developers.

Quantitative Approaches to Study Retinal Neurogenesis

The study of the development of the vertebrate retina can be addressed from several perspectives: from a purely qualitative to a more quantitative approach that takes into account its spatio-temporal features, its three-dimensional structure and also the regulation and properties at the systems level. Here, we review the ongoing transition toward a full four-dimensional characterization of the developing vertebrate retina, focusing on the challenges at the experimental, image acquisition, image processing and quantification. Using the developing zebrafish retina, we illustrate how quantitative data extracted from these type of highly dense, three-dimensional tissues depend strongly on the image quality, image processing and algorithms used to segment and quantify. Therefore, we propose that the scientific community that focuses on developmental systems could strongly benefit from a more detailed disclosure of the tools and pipelines used to process and analyze images from biological samples.

TRAIT2D: a Software for Quantitative Analysis of Single Particle Diffusion Data

Single particle tracking (SPT) is one of the most widely used tools in optical microscopy to evaluate particle mobility in a variety of situations, including cellular and model membrane dynamics. Recent technological developments, such as Interferometric Scattering microscopy, have allowed recording of long, uninterrupted single particle trajectories at kilohertz framerates. The resulting data, where particles are continuously detected and do not displace much between observations, thereby do not require complex linking algorithms. Moreover, while these measurements offer more details into the short-term diffusion behaviour of the tracked particles, they are also subject to the influence of localisation uncertainties, which are often underestimated by conventional analysis pipelines. we thus developed a Python library, under the name of TRAIT2D (Tracking Analysis Toolbox - 2D version), in order to track particle diffusion at high sampling rates, and analyse the resulting trajectories with an innovative approach. The data analysis pipeline introduced is more localisation-uncertainty aware, and also selects the most appropriate diffusion model for the data provided on a statistical basis. A trajectory simulation platform also allows the user to handily generate trajectories and even synthetic time-lapses to test alternative tracking algorithms and data analysis approaches. A high degree of customisation for the analysis pipeline, for example with the introduction of different diffusion modes, is possible from the source code. Finally, the presence of graphical user interfaces lowers the access barrier for users with little to no programming experience.

TRAIT2D: a Software for Quantitative Analysis of Single Particle Diffusion Data

Single particle tracking (SPT) is one of the most widely used tools in optical microscopy to evaluate particle mobility in a variety of situations, including cellular and model membrane dynamics. Recent technological developments, such as Interferometric Scattering microscopy, have allowed recording of long, uninterrupted single particle trajectories at kilohertz framerates. The resulting data, where particles are continuously detected and do not displace much between observations, thereby do not require complex linking algorithms. Moreover, while these measurements offer more details into the short-term diffusion behaviour of the tracked particles, they are also subject to the influence of localisation uncertainties, which are often underestimated by conventional analysis pipelines. we thus developed a Python library, under the name of TRAIT2D (Tracking Analysis Toolbox - 2D version), in order to track particle diffusion at high sampling rates, and analyse the resulting trajectories with an innovative approach. The data analysis pipeline introduced is more localisation-uncertainty aware, and also selects the most appropriate diffusion model for the data provided on a statistical basis. A trajectory simulation platform also allows the user to handily generate trajectories and even synthetic time-lapses to test alternative tracking algorithms and data analysis approaches. A high degree of customisation for the analysis pipeline, for example with the introduction of different diffusion modes, is possible from the source code. Finally, the presence of graphical user interfaces lowers the access barrier for users with little to no programming experience.

Single-particle diffusional fingerprinting: A machine-learning framework for quantitative analysis of heterogeneous diffusion

Single-particle tracking (SPT) analysis of individual biomolecules is an indispensable tool for extracting quantitative information from dynamic biological processes, but often requires some a priori knowledge of the system. Here we present “single-particle diffusional fingerprinting,” a more general approach for extraction of diffusional patterns in SPT independently of the biological system. This method extracts a set of descriptive features for each SPT trajectory, which are ranked upon classification to yield mechanistic insights for the species under comparison. We demonstrate its capacity to yield a dictionary of diffusional traits across multiple systems (e.g., lipases hydrolyzing fat, transcription factors diffusing in cells, and nanoparticles in mucus), supporting its use on multiple biological phenomena (e.g., drug delivery, receptor dynamics, and virology).

Single-particle tracking (SPT) is a key tool for quantitative analysis of dynamic biological processes and has provided unprecedented insights into a wide range of systems such as receptor localization, enzyme propulsion, bacteria motility, and drug nanocarrier delivery. The inherently complex diffusion in such biological systems can vary drastically both in time and across systems, consequently imposing considerable analytical challenges, and currently requires an a priori knowledge of the system. Here we introduce a method for SPT data analysis, processing, and classification, which we term “diffusional fingerprinting.” This method allows for dissecting the features that underlie diffusional behavior and establishing molecular identity, regardless of the underlying diffusion type. The method operates by isolating 17 descriptive features for each observed motion trajectory and generating a diffusional map of all features for each type of particle. Precise classification of the diffusing particle identity is then obtained by training a simple logistic regression model. A linear discriminant analysis generates a feature ranking that outputs the main differences among diffusional features, providing key mechanistic insights. Fingerprinting operates by both training on and predicting experimental data, without the need for pretraining on simulated data. We found this approach to work across a wide range of simulated and experimentally diverse systems, such as tracked lipases on fat substrates, transcription factors diffusing in cells, and nanoparticles diffusing in mucus. This flexibility ultimately supports diffusional fingerprinting’s utility as a universal paradigm for SPT diffusional analysis and prediction.

Role of BRCA2 DNA-binding and C-terminal domain in its mobility and conformation in DNA repair

Breast cancer type two susceptibility protein (BRCA2) is an essential protein in genome maintenance, homologous recombination (HR), and replication fork protection. Its function includes multiple interaction partners and requires timely localization to relevant sites in the nucleus. We investigated the importance of the highly conserved DNA-binding domain (DBD) and C-terminal domain (CTD) of BRCA2. We generated BRCA2 variants missing one or both domains in mouse embryonic stem (ES) cells and defined their contribution in HR function and dynamic localization in the nucleus, by single-particle tracking of BRCA2 mobility. Changes in molecular architecture of BRCA2 induced by binding partners of purified BRCA2 were determined by scanning force microscopy. BRCA2 mobility and DNA-damage-induced increase in the immobile fraction were largely unaffected by C-terminal deletions. The purified proteins missing CTD and/or DBD were defective in architectural changes correlating with reduced HR function in cells. These results emphasize BRCA2 activity at sites of damage beyond promoting RAD51 delivery.

Axon terminals control endolysosome diffusion to support synaptic remodelling

Endolysosomes present in the presynaptic terminal move by diffusion constrained by F-actin and increase their mobility during the remodelling of synaptic connectivity to support a local degradative activity.

Endolysosomes are acidic organelles formed by the fusion of endosomes with lysosomes. In the presynaptic compartment they contribute to protein homeostasis, the maintenance of vesicle pools and synaptic stability. Here, we evaluated the mobility of endolysosomes found in axon terminals of olfactory sensory neurons of Xenopus tropicalis tadpoles. F-actin restricts the motion of these presynaptic acidic organelles which is characterized by a diffusion coefficient of 6.7 × 10⁻³ μm²·s⁻¹. Local injection of secreted protein acidic and rich in cysteine (SPARC) in the glomerular layer of the olfactory bulb disrupts the structure of synaptic F-actin patches and increases the presence and mobility of endolysosomal organelles found in axon terminals. The increased motion of endolysosomes is localized to the presynaptic compartment and does not promote their access to axonal regions for retrograde transportation to the cell body. Local activation of synaptic degradation mechanisms mediated by SPARC coincides with a loss of the ability of tadpoles to detect waterborne odorants. Together, these observations show that the diffusion of presynaptic endolysosomes increases during conditions of synaptic remodelling to support their local degradative activity.

A survey on applications of deep learning in microscopy image analysis

Advanced microscopy enables us to acquire quantities of time-lapse images to visualize the dynamic characteristics of tissues, cells or molecules. Microscopy images typically vary in signal-to-noise ratios and include a wealth of information which require multiple parameters and time-consuming iterative algorithms for processing. Precise analysis and statistical quantification are often needed for the understanding of the biological mechanisms underlying these dynamic image sequences, which has become a big challenge in the field. As deep learning technologies develop quickly, they have been applied in bioimage processing more and more frequently. Novel deep learning models based on convolution neural networks have been developed and illustrated to achieve inspiring outcomes. This review article introduces the applications of deep learning algorithms in microscopy image analysis, which include image classification, region segmentation, object tracking and super-resolution reconstruction. We also discuss the drawbacks of existing deep learning-based methods, especially on the challenges of training datasets acquisition and evaluation, and propose the potential solutions. Furthermore, the latest development of augmented intelligent microscopy that based on deep learning technology may lead to revolution in biomedical research.

Image-based cell phenotyping with deep learning

A cell's phenotype is the culmination of several cellular processes through a complex network of molecular interactions that ultimately result in a unique morphological signature. Visual cell phenotyping is the characterization and quantification of these observable cellular traits in images. Recently, cellular phenotyping has undergone a massive overhaul in terms of scale, resolution, and throughput, which is attributable to advances across electronic, optical, and chemical technologies for imaging cells. Coupled with the rapid acceleration of deep learning-based computational tools, these advances have opened up new avenues for innovation across a wide variety of high-throughput cell biology applications. Here, we review applications wherein deep learning is powering the recognition, profiling, and prediction of visual phenotypes to answer important biological questions. As the complexity and scale of imaging assays increase, deep learning offers computational solutions to elucidate the details of previously unexplored cellular phenotypes.

Fractional Dynamics Identification via Intelligent Unpacking of the Sample Autocovariance Function by Neural Networks

Many single-particle tracking data related to the motion in crowded environments exhibit anomalous diffusion behavior. This phenomenon can be described by different theoretical models. In this paper, fractional Brownian motion (FBM) was examined as the exemplary Gaussian process with fractional dynamics. The autocovariance function (ACVF) is a function that determines completely the Gaussian process. In the case of experimental data with anomalous dynamics, the main problem is first to recognize the type of anomaly and then to reconstruct properly the physical rules governing such a phenomenon. The challenge is to identify the process from short trajectory inputs. Various approaches to address this problem can be found in the literature, e.g., theoretical properties of the sample ACVF for a given process. This method is effective; however, it does not utilize all of the information contained in the sample ACVF for a given trajectory, i.e., only values of statistics for selected lags are used for identification. An evolution of this approach is proposed in this paper, where the process is determined based on the knowledge extracted from the ACVF. The designed method is intuitive and it uses information directly available in a new fashion. Moreover, the knowledge retrieval from the sample ACVF vector is enhanced with a learning-based scheme operating on the most informative subset of available lags, which is proven to be an effective encoder of the properties inherited in complex data. Finally, the robustness of the proposed algorithm for FBM is demonstrated with the use of Monte Carlo simulations.

Cellular Control of Viscosity Counters Changes in Temperature and Energy Availability

Cellular functioning requires the orchestration of thousands of molecular interactions in time and space. Yet most molecules in a cell move by diffusion, which is sensitive to external factors like temperature. How cells sustain complex, diffusion-based systems across wide temperature ranges is unknown. Here, we uncover a mechanism by which budding yeast modulate viscosity in response to temperature and energy availability. This "viscoadaptation" uses regulated synthesis of glycogen and trehalose to vary the viscosity of the cytosol. Viscoadaptation functions as a stress response and a homeostatic mechanism, allowing cells to maintain invariant diffusion across a 20°C temperature range. Perturbations to viscoadaptation affect solubility and phase separation, suggesting that viscoadaptation may have implications for multiple biophysical processes in the cell. Conditions that lower ATP trigger viscoadaptation, linking energy availability to rate regulation of diffusion-controlled processes. Viscoadaptation reveals viscosity to be a tunable property for regulating diffusion-controlled processes in a changing environment.

Accelerating the experimental responses on cell behaviors: a long-term prediction of cell trajectories using Social Generative Adversarial Network

The incremented uptake provided by time-lapse microscopy in Organ-on-a-Chip (OoC) devices allowed increased attention to the dynamics of the co-cultured systems. However, the amount of information stored in long-time experiments may constitute a serious bottleneck of the experimental pipeline. Forward long-term prediction of cell trajectories may reduce the spatial–temporal burden of video sequences storage. Cell trajectory prediction becomes crucial especially to increase the trustworthiness in software tools designed to conduct a massive analysis of cell behavior under chemical stimuli. To address this task, we transpose here the exploitation of the presence of “social forces” from the human to the cellular level for motion prediction at microscale by adapting the potential of Social Generative Adversarial Network predictors to cell motility. To demonstrate the effectiveness of the approach, we consider here two case studies: one related to PC-3 prostate cancer cells cultured in 2D Petri dishes under control and treated conditions and one related to an OoC experiment of tumor-immune interaction in fibrosarcoma cells. The goodness of the proposed strategy has been verified by successfully comparing the distributions of common descriptors (kinematic descriptors and mean interaction time for the two scenarios respectively) from the trajectories obtained by video analysis and the predicted counterparts.

Gaining insight into cellular cardiac physiology using single particle tracking

Single particle tracking (SPT) is a robust technique to monitor single-molecule behaviors in living cells directly. By this approach, we can uncover the potential biological significance of particle dynamics by statistically characterizing individual molecular behaviors. SPT provides valuable information at the single-molecule level, that could be obscured by simple averaging that is inherent to conventional ensemble measurements. Here, we give a brief introduction to SPT including the commonly used optical implementations, fluorescence labeling strategies, and data analysis methods. We then focus on how SPT has been harnessed to decipher myocardial function. In this context, SPT has provided novel insight into the lateral diffusion of signal receptors and ion channels, the dynamic organization of cardiac nanodomains, subunit composition and stoichiometry of cardiac ion channels, myosin movement along actin filaments, the kinetic features of transcription factors involved in cardiac remodeling, and the intercellular communication by nanotubes. Finally, we speculate on the prospects and challenges of applying SPT to future questions regarding cellular cardiac physiology using SPT.

A bird's-eye view of deep learning in bioimage analysis

Deep learning of artificial neural networks has become the de facto standard approach to solving data analysis problems in virtually all fields of science and engineering. Also in biology and medicine, deep learning technologies are fundamentally transforming how we acquire, process, analyze, and interpret data, with potentially far-reaching consequences for healthcare. In this mini-review, we take a bird's-eye view at the past, present, and future developments of deep learning, starting from science at large, to biomedical imaging, and bioimage analysis in particular.