A review for Cell and Particle Tracking on Microscopy Images using Algorithms and Deep Learning Technologies

BNP-Track: a framework for superresolved tracking

Superresolution tools, such as PALM and STORM, provide nanoscale localization accuracy by relying on rare photophysical events, limiting these methods to static samples. By contrast, here, we extend superresolution to dynamics without relying on photodynamics by simultaneously determining emitter numbers and their tracks (localization and linking) with the same localization accuracy per frame as widefield superresolution on immobilized emitters under similar imaging conditions (≈50 nm). We demonstrate our Bayesian nonparametric track (BNP-Track) framework on both in cellulo and synthetic data. BNP-Track develops a joint (posterior) distribution that learns and quantifies uncertainty over emitter numbers and their associated tracks propagated from shot noise, camera artifacts, pixelation, background and out-of-focus motion. In doing so, we integrate spatiotemporal information into our distribution, which is otherwise compromised by modularly determining emitter numbers and localizing and linking emitter positions across frames. For this reason, BNP-Track remains accurate in crowding regimens beyond those accessible to other single-particle tracking tools.

BNP-Track: A framework for multi-particle superresolved tracking

When tracking fluorescently labeled molecules (termed "emitters") under widefield microscopes, point spread function overlap of neighboring molecules is inevitable in both dilute and especially crowded environments. In such cases, superresolution methods leveraging rare photophysical events to distinguish static targets nearby in space introduce temporal delays that compromise tracking. As we have shown in a companion manuscript, for dynamic targets, information on neighboring fluorescent molecules is encoded as spatial intensity correlations across pixels and temporal correlations in intensity patterns across time frames. We then demonstrated how we used all spatiotemporal correlations encoded in the data to achieve superresolved tracking. That is, we showed the results of full posterior inference over both the number of emitters and their associated tracks simultaneously and self-consistently through Bayesian nonparametrics. In this companion manuscript we focus on testing the robustness of our tracking tool, BNP-Track, across sets of parameter regimes and compare BNP-Track to competing tracking methods in the spirit of a prior Nature Methods tracking competition. We explore additional features of BNP-Track including how a stochastic treatment of background yields greater accuracy in emitter number determination and how BNP-Track corrects for point spread function blur (or "aliasing") introduced by intraframe motion in addition to propagating error originating from myriad sources (such as criss-crossing tracks, out-of-focus particles, pixelation, shot and camera artefact, stochastic background) in posterior inference over emitter numbers and their associated tracks. While head-to-head comparison with other tracking methods is not possible (as competitors cannot simultaneously learn molecule numbers and associated tracks), we can give competing methods some advantages in order to perform approximate head-to-head comparison. We show that even under such optimistic scenarios, BNP-Track is capable of tracking multiple diffraction-limited point emitters conventional tracking methods cannot resolve thereby extending the superresolution paradigm to dynamical targets.

Deep Learning in Diverse Intelligent Sensor Based Systems

Deep learning has become a predominant method for solving data analysis problems in virtually all fields of science and engineering. The increasing complexity and the large volume of data collected by diverse sensor systems have spurred the development of deep learning methods and have fundamentally transformed the way the data are acquired, processed, analyzed, and interpreted. With the rapid development of deep learning technology and its ever-increasing range of successful applications across diverse sensor systems, there is an urgent need to provide a comprehensive investigation of deep learning in this domain from a holistic view. This survey paper aims to contribute to this by systematically investigating deep learning models/methods and their applications across diverse sensor systems. It also provides a comprehensive summary of deep learning implementation tips and links to tutorials, open-source codes, and pretrained models, which can serve as an excellent self-contained reference for deep learning practitioners and those seeking to innovate deep learning in this space. In addition, this paper provides insights into research topics in diverse sensor systems where deep learning has not yet been well-developed, and highlights challenges and future opportunities. This survey serves as a catalyst to accelerate the application and transformation of deep learning in diverse sensor systems.

A finger in every pie - the versatility of chemokines

In this issue of Biomedical Journal we encounter the chemokine superfamily and its clinical potential. The time course from 56 days zero COVID-19 to a resurgence in cases is presented, as well as a possible solution to overcome rejection in vascularized composite allotransplantation. We are shown the opportunity deep learning (DL) offers in the case of tracking single cells and particles, and also use of DL to bring all hands on deck to counter the current challenge of the COVID-19 pandemic. This issue contains articles about the effect of low energy shock waves in cystitis; the negative effect of high fructose on aortic valve stenosis; a study about the outcome of fecal microbiota transplantation in case of refractory Clostridioides difficile infection; a novel long non-coding RNA that could serve in treating triple-negative breast cancer; the benefits of acupressure in patients with restless leg syndrome; and Filamin A mutations in abnormal neuronal migration development. Finally, a link between jaw surgery and the psychological impact on the patient is explored; a method presented that allows identification of cervical characteristics associated with difficult embryo transfer; and a letter suggesting new parameters to evaluate the use of bone-substitute augmentation in the treatment of osteoporotic intertrochanteric fractures.

Rapid Temperature-Dependent Rheological Measurements of Non-Newtonian Solutions Using a Machine-Learning Aided Microfluidic Rheometer

Biofluids such as synovial fluid, blood plasma, and saliva contain several proteins which impart non-Newtonian properties to the biofluids. The concentration of such protein macromolecules in biofluids is regarded as an important biomarker for the diagnosis of several health conditions, including cardiovascular disorders, joint quality, and Alzheimer's. Existing technologies for the measurements of macromolecules in biofluids are limited; they require a long turnaround time, or require complex protocols, thus calling for alternative, more suitable, methodologies aimed at such measurements. According to the well-established relations for polymer solutions, the concentration of macromolecules in solutions can also be derived via measurement of rheological properties such as shear-viscosity and the longest relaxation time. We here introduce a microfluidic rheometer for rapid simultaneous measurement of shear viscosity and longest relaxation time of non-Newtonian solutions at different temperatures. At variance with previous technologies, our microfluidic rheometer provides a very short turnaround time of around 2 min or less thanks to the implementation of a machine-learning algorithm. We validated our platform on several aqueous solutions of poly(ethylene oxide). We also performed measurements on hyaluronic acid solutions in the clinical range for joint grade assessment. We observed monotonic behavior with the concentration for both rheological properties, thus speculating on their use as potential rheo-markers, i.e., rheological biomarkers, across several disease states.