Robust classification of cell cycle phase and biological feature extraction by image-based deep learning

Computational methods for biofabrication in tissue engineering and regenerative medicine - a literature review

This literature review rigorously examines the growing scientific interest in computational methods for Tissue Engineering and Regenerative Medicine biofabrication, a leading-edge area in biomedical innovation, emphasizing the need for accurate, multi-stage, and multi-component biofabrication process models. The paper presents a comprehensive bibliometric and contextual analysis, followed by a literature review, to shed light on the vast potential of computational methods in this domain. It reveals that most existing methods focus on single biofabrication process stages and components, and there is a significant gap in approaches that utilize accurate models encompassing both biological and technological aspects. This analysis underscores the indispensable role of these methods in understanding and effectively manipulating complex biological systems and the necessity for developing computational methods that span multiple stages and components. The review concludes that such comprehensive computational methods are essential for developing innovative and efficient Tissue Engineering and Regenerative Medicine biofabrication solutions, driving forward advancements in this dynamic and evolving field.

Cell identity revealed by precise cell cycle state mapping links data modalities

Several methods for cell cycle inference from sequencing data exist and are widely adopted. In contrast, methods for classification of cell cycle state from imaging data are scarce. We have for the first time integrated sequencing and imaging derived cell cycle pseudo-times for assigning 449 imaged cells to 693 sequenced cells at an average resolution of 3.4 and 2.4 cells for sequencing and imaging data respectively. Data integration revealed thousands of pathways and organelle features that are correlated with each other, including several previously known interactions and novel associations. The ability to assign the transcriptome state of a profiled cell to its closest living relative, which is still actively growing and expanding opens the door for genotype-phenotype mapping at single cell resolution forward in time.

AI analysis of super-resolution microscopy: Biological discovery in the absence of ground truth

Super-resolution microscopy, or nanoscopy, enables the use of fluorescent-based molecular localization tools to study molecular structure at the nanoscale level in the intact cell, bridging the mesoscale gap to classical structural biology methodologies. Analysis of super-resolution data by artificial intelligence (AI), such as machine learning, offers tremendous potential for the discovery of new biology, that, by definition, is not known and lacks ground truth. Herein, we describe the application of weakly supervised paradigms to super-resolution microscopy and its potential to enable the accelerated exploration of the nanoscale architecture of subcellular macromolecules and organelles.

Image-based discrimination of the early stages of mesenchymal stem cell differentiation

Mesenchymal stem cells (MSCs) are self-renewing, multipotent cells, which can be used in cellular and tissue therapeutics. MSCs cell number can be expanded in vitro, but premature differentiation results in reduced cell number and compromised therapeutic efficacies. Current techniques fail to discriminate the "stem-like" population from early stages (12 h) of differentiated MSC population. Here, we imaged nuclear structure and actin architecture using immunofluorescence and used deep learning-based computer vision technology to discriminate the early stages (6-12 h) of MSC differentiation. Convolutional neural network models trained by nucleus and actin images have high accuracy in reporting MSC differentiation; nuclear images alone can identify early stages of differentiation. Concurrently, we show that chromatin fluidity and heterochromatin levels or localization change during early MSC differentiation. This study quantifies changes in cell architecture during early MSC differentiation and describes a novel image-based diagnostic tool that could be widely used in MSC culture, expansion and utilization.

Applying interpretable machine learning in computational biology-pitfalls, recommendations and opportunities for new developments

Recent advances in machine learning have enabled the development of next-generation predictive models for complex computational biology problems, thereby spurring the use of interpretable machine learning (IML) to unveil biological insights. However, guidelines for using IML in computational biology are generally underdeveloped. We provide an overview of IML methods and evaluation techniques and discuss common pitfalls encountered when applying IML methods to computational biology problems. We also highlight open questions, especially in the era of large language models, and call for collaboration between IML and computational biology researchers.

Deep learning unlocks label-free viability assessment of cancer spheroids in microfluidics

Despite recent advances in cancer treatment, refining therapeutic agents remains a critical task for oncologists. Precise evaluation of drug effectiveness necessitates the use of 3D cell culture instead of traditional 2D monolayers. Microfluidic platforms have enabled high-throughput drug screening with 3D models, but current viability assays for 3D cancer spheroids have limitations in reliability and cytotoxicity. This study introduces a deep learning model for non-destructive, label-free viability estimation based on phase-contrast images, providing a cost-effective, high-throughput solution for continuous spheroid monitoring in microfluidics. Microfluidic technology facilitated the creation of a high-throughput cancer spheroid platform with approximately 12 000 spheroids per chip for drug screening. Validation involved tests with eight conventional chemotherapeutic drugs, revealing a strong correlation between viability assessed via LIVE/DEAD staining and phase-contrast morphology. Extending the model's application to novel compounds and cell lines not in the training dataset yielded promising results, implying the potential for a universal viability estimation model. Experiments with an alternative microscopy setup supported the model's transferability across different laboratories. Using this method, we also tracked the dynamic changes in spheroid viability during the course of drug administration. In summary, this research integrates a robust platform with high-throughput microfluidic cancer spheroid assays and deep learning-based viability estimation, with broad applicability to various cell lines, compounds, and research settings.

Graph Network-Based Simulation of Multicellular Dynamics Driven by Concentrated Polymer Brush-Modified Cellulose Nanofibers

Manipulating the three-dimensional (3D) structures of cells is important for facilitating to repair or regenerate tissues. A self-assembly system of cells with cellulose nanofibers (CNFs) and concentrated polymer brushes (CPBs) has been developed to fabricate various cell 3D structures. To further generate tissues at an implantable level, it is necessary to carry out a large number of experiments using different cell culture conditions and material properties; however this is practically intractable. To address this issue, we present a graph-neural network-based simulator (GNS) that can be trained by using assembly process images to predict the assembly status of future time steps. A total of 24 (25 steps) time-series images were recorded (four repeats for each of six different conditions), and each image was transformed into a graph by regarding the cells as nodes and the connecting neighboring cells as edges. Using the obtained data, the performances of the GNS were examined under three scenarios (i.e., changing a pair of the training and testing data) to verify the possibility of using the GNS as a predictor for further time steps. It was confirmed that the GNS could reasonably reproduce the assembly process, even under the toughest scenario, in which the experimental conditions differed between the training and testing data. Practically, this means that the GNS trained by the first 24 h images could predict the cell types obtained 3 weeks later. This result could reduce the number of experiments required to find the optimal conditions for generating cells with desired 3D structures. Ultimately, our approach could accelerate progress in regenerative medicine.

Metrics reloaded: recommendations for image analysis validation

Increasing evidence shows that flaws in machine learning (ML) algorithm validation are an underestimated global problem. In biomedical image analysis, chosen performance metrics often do not reflect the domain interest, and thus fail to adequately measure scientific progress and hinder translation of ML techniques into practice. To overcome this, we created Metrics Reloaded, a comprehensive framework guiding researchers in the problem-aware selection of metrics. Developed by a large international consortium in a multistage Delphi process, it is based on the novel concept of a problem fingerprint-a structured representation of the given problem that captures all aspects that are relevant for metric selection, from the domain interest to the properties of the target structure(s), dataset and algorithm output. On the basis of the problem fingerprint, users are guided through the process of choosing and applying appropriate validation metrics while being made aware of potential pitfalls. Metrics Reloaded targets image analysis problems that can be interpreted as classification tasks at image, object or pixel level, namely image-level classification, object detection, semantic segmentation and instance segmentation tasks. To improve the user experience, we implemented the framework in the Metrics Reloaded online tool. Following the convergence of ML methodology across application domains, Metrics Reloaded fosters the convergence of validation methodology. Its applicability is demonstrated for various biomedical use cases.

Analysis of Plant-Specific ANTH Domain-Containing Protein in Marchantia polymorpha

Membrane trafficking is a fundamental mechanism for protein and lipid transport in eukaryotic cells and exhibits marked diversity among eukaryotic lineages with distinctive body plans and lifestyles. Diversification of the membrane trafficking system is associated with the expansion and secondary loss of key machinery components, including RAB GTPases, soluble N-ethylmaleimide-sensitive factor attachment protein receptors (SNAREs) and adaptor proteins, during plant evolution. The number of AP180 N-terminal homology (ANTH) proteins, an adaptor family that regulates vesicle formation and cargo sorting during clathrin-mediated endocytosis, increases during plant evolution. In the genome of Arabidopsis thaliana, 18 genes for ANTH proteins have been identified, a higher number than that in yeast and animals, suggesting a distinctive diversification of ANTH proteins. Conversely, the liverwort Marchantia polymorpha possesses a simpler repertoire; only two genes encoding canonical ANTH proteins have been identified in its genome. Intriguingly, a non-canonical ANTH protein is encoded in the genome of M. polymorpha, which also harbors a putative kinase domain. Similar proteins have been detected in sporadic lineages of plants, suggesting their ancient origin and multiple secondary losses during evolution. We named this unique ANTH group phosphatidylinositol-binding clathrin assembly protein-K (PICALM-K) and characterized it in M. polymorpha using genetic, cell biology-based and artificial intelligence (AI)-based approaches. Our results indicate a flagella-related function of MpPICALM-K in spermatozoids, which is distinct from that of canonical ANTH proteins. Therefore, ANTH proteins have undergone significant functional diversification during evolution, and PICALM-K represents a plant-unique ANTH protein that is delivered by neofunctionalization through exon shuffling.

Machine learning extracts oncogenic-specific γ-H2AX foci formation pattern upon genotoxic stress

H2AX is a histone H2A variant that becomes phosphorylated upon genotoxic stress. The phosphorylated H2AX (γ-H2AX) plays an antioncogenic role in the DNA damage response and its foci patterns are highly variable, in terms of intensities and sizes. However, whether characteristic γ-H2AX foci patterns are associated with oncogenesis (oncogenic-specific γ-H2AX foci patterns) remains unknown. We previously reported that a defect in the acetyltransferase activity of TIP60 promotes cancer cell growth in human cell lines. In this study, we compared γ-H2AX foci patterns between TIP60 wild-type cells and TIP60 HAT mutant cells by using machine learning. When focused solely on the intensity and size of γ-H2AX foci, we extracted the TIP60 HAT mutant-like oncogenic-specific γ-H2AX foci pattern among all datasets of γ-H2AX foci patterns. Furthermore, by using the dimensionality reduction method UMAP, we also observed TIP60 HAT mutant-like oncogenic-specific γ-H2AX foci patterns in TIP60 wild-type cells. In summary, we propose the existence of an oncogenic-specific γ-H2AX foci pattern and the importance of a machine learning approach to extract oncogenic signaling among the γ-H2AX foci variations.

SPECHT: Self-tuning Plausibility based object detection Enables quantification of Conflict in Heterogeneous multi-scale microscopy

Identification of small objects in fluorescence microscopy is a non-trivial task burdened by parameter-sensitive algorithms, for which there is a clear need for an approach that adapts dynamically to changing imaging conditions. Here, we introduce an adaptive object detection method that, given a microscopy image and an image level label, uses kurtosis-based matching of the distribution of the image differential to express operator intent in terms of recall or precision. We show how a theoretical upper bound of the statistical distance in feature space enables application of belief theory to obtain statistical support for each detected object, capturing those aspects of the image that support the label, and to what extent. We validate our method on 2 datasets: distinguishing sub-diffraction limit caveolae and scaffold by stimulated emission depletion (STED) super-resolution microscopy; and detecting amyloid-β deposits in confocal microscopy retinal cross-sections of neuropathologically confirmed Alzheimer's disease donor tissue. Our results are consistent with biological ground truth and with previous subcellular object classification results, and add insight into more nuanced class transition dynamics. We illustrate the novel application of belief theory to object detection in heterogeneous microscopy datasets and the quantification of conflict of evidence in a joint belief function. By applying our method successfully to diffraction-limited confocal imaging of tissue sections and super-resolution microscopy of subcellular structures, we demonstrate multi-scale applicability.

A Primer on Deep Learning-Based Cellular Image Classification of Changes in the Spatial Distribution of the Golgi Apparatus After Experimental Manipulation

The visual classification of cell images according to differences in the spatial patterns of subcellular structure is an important methodology in cell and developmental biology. Experimental perturbation of cell function can induce changes in the spatial distribution of organelles and their associated markers or labels. Here, we demonstrate how to achieve accurate, unbiased, high-throughput image classification using an artificial intelligence (AI) algorithm. We show that a convolutional neural network (CNN) algorithm can classify distinct patterns of Golgi images after drug or siRNA treatments, and we review our methods from cell preparation to image acquisition and CNN analysis.

Classification of scanning electron microscope images of pharmaceutical excipients using deep convolutional neural networks with transfer learning

Convolutional Neural Networks (CNNs) are image analysis techniques that have been applied to image classification in various fields. In this study, we applied a CNN to classify scanning electron microscopy (SEM) images of pharmaceutical raw material powders to determine if a CNN can evaluate particle morphology. We tested 10 pharmaceutical excipients with widely different particle morphologies. SEM images for each excipient were acquired and divided into training, validation, and test sets. Classification models were constructed by applying transfer learning to pretrained CNN models such as VGG16 and ResNet50. The results of a 5-fold cross-validation showed that the classification accuracy of the CNN model was sufficiently high using either pretrained model and that the type of excipient could be classified with high accuracy. The results suggest that the CNN model can detect differences in particle morphology, such as particle size, shape, and surface condition. By applying Grad-CAM to the constructed CNN model, we succeeded in finding particularly important regions in the particle image of the excipients. CNNs have been found to have the potential to be applied to the identification and characterization of raw material powders for pharmaceutical development.

Cell Cycle Stage Classification Using Phase Imaging with Computational Specificity

Traditional methods for cell cycle stage classification rely heavily on fluorescence microscopy to monitor nuclear dynamics. These methods inevitably face the typical phototoxicity and photobleaching limitations of fluorescence imaging. Here, we present a cell cycle detection workflow using the principle of phase imaging with computational specificity (PICS). The proposed method uses neural networks to extract cell cycle-dependent features from quantitative phase imaging (QPI) measurements directly. Our results indicate that this approach attains very good accuracy in classifying live cells into G1, S, and G2/M stages, respectively. We also demonstrate that the proposed method can be applied to study single-cell dynamics within the cell cycle as well as cell population distribution across different stages of the cell cycle. We envision that the proposed method can become a nondestructive tool to analyze cell cycle progression in fields ranging from cell biology to biopharma applications.

Neural network fast-classifies biological images through features selecting to power automated microscopy

Artificial intelligence is nowadays used for cell detection and classification in optical microscopy during post-acquisition analysis. The microscopes are now fully automated and next expected to be smart by making acquisition decisions based on the images. It calls for analysing them on the fly. Biology further imposes training on a reduced data set due to cost and time to prepare the samples and have the data sets annotated by experts. We propose a real-time image processing compliant with these specifications by balancing accurate detection and execution performance. We characterised the images using a generic, high-dimensional feature extractor. We then classified the images using machine learning to understand the contribution of each feature in decision and execution time. We found that the non-linear-classifier random forests outperformed Fisher's linear discriminant. More importantly, the most discriminant and time-consuming features could be excluded without significant accuracy loss, offering a substantial gain in execution time. It suggests a feature-group redundancy likely related to the biology of the observed cells. We offer a method to select fast and discriminant features. In our assay, a 79.6 ± 2.4% accurate classification of a cell took 68.7 ± 3.5 ms (mean ± SD, 5-fold cross-validation nested in 10 bootstrap repeats), corresponding to 14 cells per second, dispatched into eight phases of the cell cycle, using 12 feature groups and operating a consumer market ARM-based embedded system. A simple neural network offered similar performances paving the way to faster training and classification, using parallel execution on a general-purpose graphic processing unit. Finally, this strategy is also usable for deep neural networks paving the way to optimizing these algorithms for smart microscopy.

eHooke: A tool for automated image analysis of spherical bacteria based on cell cycle progression

Fluorescence microscopy is a critical tool for cell biology studies on bacterial cell division and morphogenesis. Because the analysis of fluorescence microscopy images evolved beyond initial qualitative studies, numerous images analysis tools were developed to extract quantitative parameters on cell morphology and organization. To understand cellular processes required for bacterial growth and division, it is particularly important to perform such analysis in the context of cell cycle progression. However, manual assignment of cell cycle stages is laborious and prone to user bias. Although cell elongation can be used as a proxy for cell cycle progression in rod-shaped or ovoid bacteria, that is not the case for cocci, such as Staphylococcus aureus. Here, we describe eHooke, an image analysis framework developed specifically for automated analysis of microscopy images of spherical bacterial cells. eHooke contains a trained artificial neural network to automatically classify the cell cycle phase of individual S. aureus cells. Users can then apply various functions to obtain biologically relevant information on morphological features of individual cells and cellular localization of proteins, in the context of the cell cycle.

An Imbalanced Image Classification Method for the Cell Cycle Phase

The cell cycle is an important process in cellular life. In recent years, some image processing methods have been developed to determine the cell cycle stages of individual cells. However, in most of these methods, cells have to be segmented, and their features need to be extracted. During feature extraction, some important information may be lost, resulting in lower classification accuracy. Thus, we used a deep learning method to retain all cell features. In order to solve the problems surrounding insufficient numbers of original images and the imbalanced distribution of original images, we used the Wasserstein generative adversarial network-gradient penalty (WGAN-GP) for data augmentation. At the same time, a residual network (ResNet) was used for image classification. ResNet is one of the most used deep learning classification networks. The classification accuracy of cell cycle images was achieved more effectively with our method, reaching 83.88%. Compared with an accuracy of 79.40% in previous experiments, our accuracy increased by 4.48%. Another dataset was used to verify the effect of our model and, compared with the accuracy from previous results, our accuracy increased by 12.52%. The results showed that our new cell cycle image classification system based on WGAN-GP and ResNet is useful for the classification of imbalanced images. Moreover, our method could potentially solve the low classification accuracy in biomedical images caused by insufficient numbers of original images and the imbalanced distribution of original images.

Learning deep features for dead and living breast cancer cell classification without staining

Automated cell classification in cancer biology is a challenging topic in computer vision and machine learning research. Breast cancer is the most common malignancy in women that usually involves phenotypically diverse populations of breast cancer cells and an heterogeneous stroma. In recent years, automated microscopy technologies are allowing the study of live cells over extended periods of time, simplifying the task of compiling large image databases. For instance, there have been several studies oriented towards building machine learning systems capable of automatically classifying images of different cell types (i.e. motor neurons, stem cells). In this work we were interested in classifying breast cancer cells as live or dead, based on a set of automatically retrieved morphological characteristics using image processing techniques. Our hypothesis is that live-dead classification can be performed without any staining and using only bright-field images as input. We tackled this problem using the JIMT-1 breast cancer cell line that grows as an adherent monolayer. First, a vast image set composed by JIMT-1 human breast cancer cells that had been exposed to a chemotherapeutic drug treatment (doxorubicin and paclitaxel) or vehicle control was compiled. Next, several classifiers were trained based on well-known convolutional neural networks (CNN) backbones to perform supervised classification using labels obtained from fluorescence microscopy images associated with each bright-field image. Model performances were evaluated and compared on a large number of bright-field images. The best model reached an AUC = 0.941 for classifying breast cancer cells without treatment. Furthermore, it reached AUC = 0.978 when classifying breast cancer cells under drug treatment. Our results highlight the potential of machine learning and computational image analysis to build new diagnosis tools that benefit the biomedical field by reducing cost, time, and stimulating work reproducibility. More importantly, we analyzed the way our classifiers clusterize bright-field images in the learned high-dimensional embedding and linked these groups to salient visual characteristics in live-dead cell biology observed by trained experts.

Subcellular proteomics

The eukaryotic cell is compartmentalized into subcellular niches, including membrane-bound and membrane-less organelles. Proteins localize to these niches to fulfil their function, enabling discreet biological processes to occur in synchrony. Dynamic movement of proteins between niches is essential for cellular processes such as signalling, growth, proliferation, motility and programmed cell death, and mutations causing aberrant protein localization are associated with a wide range of diseases. Determining the location of proteins in different cell states and cell types and how proteins relocalize following perturbation is important for understanding their functions, related cellular processes and pathologies associated with their mislocalization. In this Primer, we cover the major spatial proteomics methods for determining the location, distribution and abundance of proteins within subcellular structures. These technologies include fluorescent imaging, protein proximity labelling, organelle purification and cell-wide biochemical fractionation. We describe their workflows, data outputs and applications in exploring different cell biological scenarios, and discuss their main limitations. Finally, we describe emerging technologies and identify areas that require technological innovation to allow better characterization of the spatial proteome.

In Situ Classification of Cell Types in Human Kidney Tissue Using 3D Nuclear Staining

To understand the physiology and pathology of disease, capturing the heterogeneity of cell types within their tissue environment is fundamental. In such an endeavor, the human kidney presents a formidable challenge because its complex organizational structure is tightly linked to key physiological functions. Advances in imaging-based cell classification may be limited by the need to incorporate specific markers that can link classification to function. Multiplex imaging can mitigate these limitations, but requires cumulative incorporation of markers, which may lead to tissue exhaustion. Furthermore, the application of such strategies in large scale 3-dimensional (3D) imaging is challenging. Here, we propose that 3D nuclear signatures from a DNA stain, DAPI, which could be incorporated in most experimental imaging, can be used for classifying cells in intact human kidney tissue. We developed an unsupervised approach that uses 3D tissue cytometry to generate a large training dataset of nuclei images (NephNuc), where each nucleus is associated with a cell type label. We then devised various supervised machine learning approaches for kidney cell classification and demonstrated that a deep learning approach outperforms classical machine learning or shape-based classifiers. Specifically, a custom 3D convolutional neural network (NephNet3D) trained on nuclei image volumes achieved a balanced accuracy of 80.26%. Importantly, integrating NephNet3D classification with tissue cytometry allowed in situ visualization of cell type classifications in kidney tissue. In conclusion, we present a tissue cytometry and deep learning approach for in situ classification of cell types in human kidney tissue using only a DNA stain. This methodology is generalizable to other tissues and has potential advantages on tissue economy and non-exhaustive classification of different cell types.