Deep Learning in Label-free Cell Classification

Deep Learning-Based Automated Cell Detection-Facilitated Meat Quality Evaluation

Meat consumption is increasing globally. The safety and quality of meat are considered important issues for human health. During evaluations of meat quality and freshness, microbiological parameters are often analyzed. Counts of indicator cells can provide important references for meat quality. In order to eliminate the error of manual operation and improve detection efficiency, this paper proposed a Convolutional Neural Network (CNN) with a backbone called Detect-Cells-Rapidly-Net (DCRNet), which can identify and count stained cells automatically. The DCRNet replaces the single channel of residual blocks with the aggregated residual blocks to learn more features with fewer parameters. The DCRNet combines the deformable convolution network to fit flexible shapes of stained animal cells. The proposed CNN with DCRNet is self-adaptive to different resolutions of images. The experimental results indicate that the proposed CNN with DCRNet achieves an Average Precision of 81.2% and is better than traditional neural networks for this task. The difference between the results of the proposed method and manual counting is less than 0.5% of the total number of cells. The results indicate that DCRNet is a promising solution for cell detection and can be equipped in future meat quality monitoring systems.

Data-driven classification of individual cells by their non-Markovian motion

We present a method to differentiate organisms solely by their motion based on the generalized Langevin equation (GLE) and use it to distinguish two different swimming modes of strongly confined unicellular microalgae Chlamydomonas reinhardtii. The GLE is a general model for active or passive motion of organisms and particles that can be derived from a time-dependent general many-body Hamiltonian and in particular includes non-Markovian effects (i.e., the trajectory memory of its past). We extract all GLE parameters from individual cell trajectories and perform an unbiased cluster analysis to group them into different classes. For the specific cell population employed in the experiments, the GLE-based assignment into the two different swimming modes works perfectly, as checked by control experiments. The classification and sorting of single cells and organisms is important in different areas; our method, which is based on motion trajectories, offers wide-ranging applications in biology and medicine.

Artificial Intelligence in Urologic Robotic Oncologic Surgery: A Narrative Review

With the rapid increase in computer processing capacity over the past two decades, machine learning techniques have been applied in many sectors of daily life. Machine learning in therapeutic settings is also gaining popularity. We analysed current studies on machine learning in robotic urologic surgery. We searched PubMed/Medline and Google Scholar up to December 2023. Search terms included "urologic surgery", "artificial intelligence", "machine learning", "neural network", "automation", and "robotic surgery". Automatic preoperative imaging, intraoperative anatomy matching, and bleeding prediction has been a major focus. Early artificial intelligence (AI) therapeutic outcomes are promising. Robot-assisted surgery provides precise telemetry data and a cutting-edge viewing console to analyse and improve AI integration in surgery. Machine learning enhances surgical skill feedback, procedure effectiveness, surgical guidance, and postoperative prediction. Tension-sensors on robotic arms and augmented reality can improve surgery. This provides real-time organ motion monitoring, improving precision and accuracy. As datasets develop and electronic health records are used more and more, these technologies will become more effective and useful. AI in robotic surgery is intended to improve surgical training and experience. Both seek precision to improve surgical care. AI in ''master-slave'' robotic surgery offers the detailed, step-by-step examination of autonomous robotic treatments.

Advancing Intelligent Organ-on-a-Chip Systems with Comprehensive In Situ Bioanalysis

In vitro models are essential to a broad range of biomedical research, such as pathological studies, drug development, and personalized medicine. As a potentially transformative paradigm for 3D in vitro models, organ-on-a-chip (OOC) technology has been extensively developed to recapitulate sophisticated architectures and dynamic microenvironments of human organs by applying the principles of life sciences and leveraging micro- and nanoscale engineering capabilities. A pivotal function of OOC devices is to support multifaceted and timely characterization of cultured cells and their microenvironments. However, in-depth analysis of OOC models typically requires biomedical assay procedures that are labor-intensive and interruptive. Herein, the latest advances toward intelligent OOC (iOOC) systems, where sensors integrated with OOC devices continuously report cellular and microenvironmental information for comprehensive in situ bioanalysis, are examined. It is proposed that the multimodal data in iOOC systems can support closed-loop control of the in vitro models and offer holistic biomedical insights for diverse applications. Essential techniques for establishing iOOC systems are surveyed, encompassing in situ sensing, data processing, and dynamic modulation. Eventually, the future development of iOOC systems featuring cross-disciplinary strategies is discussed.

Revealing the clinical potential of high-resolution organoids

The symbiotic interplay of organoid technology and advanced imaging strategies yields innovative breakthroughs in research and clinical applications. Organoids, intricate three-dimensional cell cultures derived from pluripotent or adult stem/progenitor cells, have emerged as potent tools for in vitro modeling, reflecting in vivo organs and advancing our grasp of tissue physiology and disease. Concurrently, advanced imaging technologies such as confocal, light-sheet, and two-photon microscopy ignite fresh explorations, uncovering rich organoid information. Combined with advanced imaging technologies and the power of artificial intelligence, organoids provide new insights that bridge experimental models and real-world clinical scenarios. This review explores exemplary research that embodies this technological synergy and how organoids reshape personalized medicine and therapeutics.

Multi-omics and artificial intelligence predict clinical outcomes of immunotherapy in non-small cell lung cancer patients

In recent years, various types of immunotherapy, particularly the use of immune checkpoint inhibitors targeting programmed cell death 1 or programmed death ligand 1 (PD-L1), have revolutionized the management and prognosis of non-small cell lung cancer. PD-L1 is frequently used as a biomarker for predicting the likely benefit of immunotherapy for patients. However, some patients receiving immunotherapy have high response rates despite having low levels of PD-L1. Therefore, the identification of this group of patients is extremely important to improve prognosis. The tumor microenvironment contains tumor, stromal, and infiltrating immune cells with its composition differing significantly within tumors, between tumors, and between individuals. The omics approach aims to provide a comprehensive assessment of each patient through high-throughput extracted features, promising a more comprehensive characterization of this complex ecosystem. However, features identified by high-throughput methods are complex and present analytical challenges to clinicians and data scientists. It is thus feasible that artificial intelligence could assist in the identification of features that are beyond human discernment as well as in the performance of repetitive tasks. In this paper, we review the prediction of immunotherapy efficacy by different biomarkers (genomic, transcriptomic, proteomic, microbiomic, and radiomic), together with the use of artificial intelligence and the challenges and future directions of these fields.

Deep learning-based predictive classification of functional subpopulations of hematopoietic stem cells and multipotent progenitors

BACKGROUND

Hematopoietic stem cells (HSCs) and multipotent progenitors (MPPs) play a pivotal role in maintaining lifelong hematopoiesis. The distinction between stem cells and other progenitors, as well as the assessment of their functions, has long been a central focus in stem cell research. In recent years, deep learning has emerged as a powerful tool for cell image analysis and classification/prediction.

METHODS

In this study, we explored the feasibility of employing deep learning techniques to differentiate murine HSCs and MPPs based solely on their morphology, as observed through light microscopy (DIC) images.

RESULTS

After rigorous training and validation using extensive image datasets, we successfully developed a three-class classifier, referred to as the LSM model, capable of reliably distinguishing long-term HSCs, short-term HSCs, and MPPs. The LSM model extracts intrinsic morphological features unique to different cell types, irrespective of the methods used for cell identification and isolation, such as surface markers or intracellular GFP markers. Furthermore, employing the same deep learning framework, we created a two-class classifier that effectively discriminates between aged HSCs and young HSCs. This discovery is particularly significant as both cell types share identical surface markers yet serve distinct functions. This classifier holds the potential to offer a novel, rapid, and efficient means of assessing the functional states of HSCs, thus obviating the need for time-consuming transplantation experiments.

CONCLUSION

Our study represents the pioneering use of deep learning to differentiate HSCs and MPPs under steady-state conditions. This novel and robust deep learning-based platform will provide a basis for the future development of a new generation stem cell identification and separation system. It may also provide new insight into the molecular mechanisms underlying stem cell self-renewal.

Generative Adversarial Network Model to Classify Human Induced Pluripotent Stem Cell-Cardiomyocytes based on Maturation Level

Objective

Our study develops a generative adversarial network (GAN)-based method that generates faithful synthetic image data of human cardiomyocytes at varying stages in their maturation process, as a tool to significantly enhance the classification accuracy of cells and ultimately assist the throughput of computational analysis of cellular structure and functions.

Methods

Human induced pluripotent stem cell derived cardiomyocytes (hiPSC-CMs) were cultured on micropatterned collagen coated hydrogels of physiological stiffnesses to facilitate maturation and optical measurements were performed for their structural and functional analyses. Control groups were cultured on collagen coated glass well plates. These image recordings were used as the real data to train the GAN model.

Results

The results show the GAN approach is able to replicate true features from the real data, and inclusion of such synthetic data significantly improves the classification accuracy compared to usage of only real experimental data that is often limited in scale and diversity.

Conclusion

The proposed model outperformed four conventional machine learning algorithms with respect to improved data generalization ability and data classification accuracy by incorporating synthetic data.

Significance

This work demonstrates the importance of integrating synthetic data in situations where there are limited sample sizes and thus, effectively addresses the challenges imposed by data availability.

Patient-Derived Microphysiological Systems for Precision Medicine

Patient-derived microphysiological systems (P-MPS) have emerged as powerful tools in precision medicine that provide valuable insight into individual patient characteristics. This review discusses the development of P-MPS as an integration of patient-derived samples, including patient-derived cells, organoids, and induced pluripotent stem cells, into well-defined MPSs. Emphasizing the necessity of P-MPS development, its significance as a nonclinical assessment approach that bridges the gap between traditional in vitro models and clinical outcomes is highlighted. Additionally, guidance is provided for engineering approaches to develop microfluidic devices and high-content analysis for P-MPSs, enabling high biological relevance and high-throughput experimentation. The practical implications of the P-MPS are further examined by exploring the clinically relevant outcomes obtained from various types of patient-derived samples. The construction and analysis of these diverse samples within the P-MPS have resulted in physiologically relevant data, paving the way for the development of personalized treatment strategies. This study describes the significance of the P-MPS in precision medicine, as well as its unique capacity to offer valuable insights into individual patient characteristics.

Real-time simultaneous refractive index and thickness mapping of sub-cellular biology at the diffraction limit

Mapping the cellular refractive index (RI) is a central task for research involving the composition of microorganisms and the development of models providing automated medical screenings with accuracy beyond 95%. These models require significantly enhancing the state-of-the-art RI mapping capabilities to provide large amounts of accurate RI data at high throughput. Here, we present a machine-learning-based technique that obtains a biological specimen's real-time RI and thickness maps from a single image acquired with a conventional color camera. This technology leverages a suitably engineered nanostructured membrane that stretches a biological analyte over its surface and absorbs transmitted light, generating complex reflection spectra from each sample point. The technique does not need pre-existing sample knowledge. It achieves 10-4 RI sensitivity and sub-nanometer thickness resolution on diffraction-limited spatial areas. We illustrate practical application by performing sub-cellular segmentation of HCT-116 colorectal cancer cells, obtaining complete three-dimensional reconstruction of the cellular regions with a characteristic length of 30 μm. These results can facilitate the development of real-time label-free technologies for biomedical studies on microscopic multicellular dynamics.

[WITHDRAWN] MIML: Multiplex Image Machine Learning for High Precision Cell Classification via Mechanical Traits within Microfluidic Systems

This paper has been withdrawn by Khayrul Islam.

On the use of deep learning for phase recovery

Phase recovery (PR) refers to calculating the phase of the light field from its intensity measurements. As exemplified from quantitative phase imaging and coherent diffraction imaging to adaptive optics, PR is essential for reconstructing the refractive index distribution or topography of an object and correcting the aberration of an imaging system. In recent years, deep learning (DL), often implemented through deep neural networks, has provided unprecedented support for computational imaging, leading to more efficient solutions for various PR problems. In this review, we first briefly introduce conventional methods for PR. Then, we review how DL provides support for PR from the following three stages, namely, pre-processing, in-processing, and post-processing. We also review how DL is used in phase image processing. Finally, we summarize the work in DL for PR and provide an outlook on how to better use DL to improve the reliability and efficiency of PR. Furthermore, we present a live-updating resource ( https://github.com/kqwang/phase-recovery ) for readers to learn more about PR.

Interpretable unsupervised learning enables accurate clustering with high-throughput imaging flow cytometry

A primary challenge of high-throughput imaging flow cytometry (IFC) is to analyze the vast amount of imaging data, especially in applications where ground truth labels are unavailable or hard to obtain. We present an unsupervised deep embedding algorithm, the Deep Convolutional Autoencoder-based Clustering (DCAEC) model, to cluster label-free IFC images without any prior knowledge of input labels. The DCAEC model first encodes the input images into the latent representations and then clusters based on the latent representations. Using the DCAEC model, we achieve a balanced accuracy of 91.9% for human white blood cell (WBC) clustering and 97.9% for WBC/leukemia clustering using the 3D IFC images and 3D DCAEC model. Above all, although no human recognizable features can separate the clusters of cells with protein localization, we demonstrate the fused DCAEC model can achieve a cluster balanced accuracy of 85.3% from the label-free 2D transmission and 3D side scattering images. To reveal how the neural network recognizes features beyond human ability, we use the gradient-weighted class activation mapping method to discover the cluster-specific visual patterns automatically. Evaluation results show that the automatically identified salient image regions have strong cluster-specific visual patterns for different clusters, which we believe is a stride for the interpretable neural network for cell analysis with high-throughput IFCs.

Deep learning-based predictive classification of functional subpopulations of hematopoietic stem cells and multipotent progenitors

Background

Hematopoietic stem cells (HSCs) and multipotent progenitors (MPPs) play a pivotal role in maintaining lifelong hematopoiesis. The distinction between stem cells and other progenitors, as well as the assessment of their functions, has long been a central focus in stem cell research. In recent years, deep learning has emerged as a powerful tool for cell image analysis and classification/prediction.

Methods

In this study, we explored the feasibility of employing deep learning techniques to differentiate murine HSCs and MPPs based solely on their morphology, as observed through light microscopy (DIC) images.

Results

After rigorous training and validation using extensive image datasets, we successfully developed a three-class classifier, referred to as the LSM model, capable of reliably distinguishing long-term HSCs (LT-HSCs), short-term HSCs (ST-HSCs), and MPPs. The LSM model extracts intrinsic morphological features unique to different cell types, irrespective of the methods used for cell identification and isolation, such as surface markers or intracellular GFP markers. Furthermore, employing the same deep learning framework, we created a two-class classifier that effectively discriminates between aged HSCs and young HSCs. This discovery is particularly significant as both cell types share identical surface markers yet serve distinct functions. This classifier holds the potential to offer a novel, rapid, and efficient means of assessing the functional states of HSCs, thus obviating the need for time-consuming transplantation experiments.

Conclusion

Our study represents the pioneering use of deep learning to differentiate HSCs and MPPs under steady-state conditions. With ongoing advancements in model algorithms and their integration into various imaging systems, deep learning stands poised to become an invaluable tool, significantly impacting stem cell research.

Artificial intelligence-enabled quantitative phase imaging methods for life sciences

Quantitative phase imaging, integrated with artificial intelligence, allows for the rapid and label-free investigation of the physiology and pathology of biological systems. This review presents the principles of various two-dimensional and three-dimensional label-free phase imaging techniques that exploit refractive index as an intrinsic optical imaging contrast. In particular, we discuss artificial intelligence-based analysis methodologies for biomedical studies including image enhancement, segmentation of cellular or subcellular structures, classification of types of biological samples and image translation to furnish subcellular and histochemical information from label-free phase images. We also discuss the advantages and challenges of artificial intelligence-enabled quantitative phase imaging analyses, summarize recent notable applications in the life sciences, and cover the potential of this field for basic and industrial research in the life sciences.

Deep Learning Approach for the Localization and Analysis of Surface Plasmon Scattering

Surface plasmon resonance microscopy (SPRM) combines the principles of traditional microscopy with the versatility of surface plasmons to develop label-free imaging methods. This paper describes a proof-of-principles approach based on deep learning that utilized the Y-Net convolutional neural network model to improve the detection and analysis methodology of SPRM. A machine-learning based image analysis technique was used to provide a method for the one-shot analysis of SPRM images to estimate scattering parameters such as the scatterer location. The method was assessed by applying the approach to SPRM images and reconstructing an image from the network output for comparison with the original image. The results showed that deep learning can localize scatterers and predict other variables of scattering objects with high accuracy in a noisy environment. The results also confirmed that with a larger field of view, deep learning can be used to improve traditional SPRM such that it localizes and produces scatterer characteristics in one shot, considerably increasing the detection capabilities of SPRM.

Machine learning implementation strategy in imaging and impedance flow cytometry

Imaging and impedance flow cytometry is a label-free technique that has shown promise as a potential replacement for standard flow cytometry. This is due to its ability to provide rich information and archive high-throughput analysis. Recently, significant efforts have been made to leverage machine learning for processing the abundant data generated by those techniques, enabling rapid and accurate analysis. Harnessing the power of machine learning, imaging and impedance flow cytometry has demonstrated its capability to address various complex phenotyping scenarios. Herein, we present a comprehensive overview of the detailed strategies for implementing machine learning in imaging and impedance flow cytometry. We initiate the discussion by outlining the commonly employed setup to acquire the data (i.e., image or signal) from the cell. Subsequently, we delve into the necessary processes for extracting features from the acquired image or signal data. Finally, we discuss how these features can be utilized for cell phenotyping through the application of machine learning algorithms. Furthermore, we discuss the existing challenges and provide insights for future perspectives of intelligent imaging and impedance flow cytometry.

Label-free tumor cells classification using deep learning and high-content imaging

Many studies have shown that cellular morphology can be used to distinguish spiked-in tumor cells in blood sample background. However, most validation experiments included only homogeneous cell lines and inadequately captured the broad morphological heterogeneity of cancer cells. Furthermore, normal, non-blood cells could be erroneously classified as cancer because their morphology differ from blood cells. Here, we constructed a dataset of microscopic images of organoid-derived cancer and normal cell with diverse morphology and developed a proof-of-concept deep learning model that can distinguish cancer cells from normal cells within an unlabeled microscopy image. In total, more than 75,000 organoid-drived cells from 3 cholangiocarcinoma patients were collected. The model achieved an area under the receiver operating characteristics curve (AUROC) of 0.78 and can generalize to cell images from an unseen patient. These resources serve as a foundation for an automated, robust platform for circulating tumor cell detection.

On-chip label-free cell classification based directly on off-axis holograms and spatial-frequency-invariant deep learning

We present a rapid label-free imaging flow cytometry and cell classification approach based directly on raw digital holograms. Off-axis holography enables real-time acquisition of cells during rapid flow. However, classification of the cells typically requires reconstruction of their quantitative phase profiles, which is time-consuming. Here, we present a new approach for label-free classification of individual cells based directly on the raw off-axis holographic images, each of which contains the complete complex wavefront (amplitude and quantitative phase profiles) of the cell. To obtain this, we built a convolutional neural network, which is invariant to the spatial frequencies and directions of the interference fringes of the off-axis holograms. We demonstrate the effectiveness of this approach using four types of cancer cells. This approach has the potential to significantly improve both speed and robustness of imaging flow cytometry, enabling real-time label-free classification of individual cells.

PPSW-SHAP: Towards Interpretable Cell Classification Using Tree-Based SHAP Image Decomposition and Restoration for High-Throughput Bright-Field Imaging

Advancements in high-throughput microscopy imaging have transformed cell analytics, enabling functionally relevant, rapid, and in-depth bioanalytics with Artificial Intelligence (AI) as a powerful driving force in cell therapy (CT) manufacturing. High-content microscopy screening often suffers from systematic noise, such as uneven illumination or vignetting artifacts, which can result in false-negative findings in AI models. Traditionally, AI models have been expected to learn to deal with these artifacts, but success in an inductive framework depends on sufficient training examples. To address this challenge, we propose a two-fold approach: (1) reducing noise through an image decomposition and restoration technique called the Periodic Plus Smooth Wavelet transform (PPSW) and (2) developing an interpretable machine learning (ML) platform using tree-based Shapley Additive exPlanations (SHAP) to enhance end-user understanding. By correcting artifacts during pre-processing, we lower the inductive learning load on the AI and improve end-user acceptance through a more interpretable heuristic approach to problem solving. Using a dataset of human Mesenchymal Stem Cells (MSCs) cultured under diverse density and media environment conditions, we demonstrate supervised clustering with mean SHAP values, derived from the 'DFT Modulus' applied to the decomposition of bright-field images, in the trained tree-based ML model. Our innovative ML framework offers end-to-end interpretability, leading to improved precision in cell characterization during CT manufacturing.

Label-free liquid biopsy through the identification of tumor cells by machine learning-powered tomographic phase imaging flow cytometry

Image-based identification of circulating tumor cells in microfluidic cytometry condition is one of the most challenging perspectives in the Liquid Biopsy scenario. Here we show a machine learning-powered tomographic phase imaging flow cytometry system capable to provide high-throughput 3D phase-contrast tomograms of each single cell. In fact, we show that discrimination of tumor cells against white blood cells is potentially achievable with the aid of artificial intelligence in a label-free flow-cyto-tomography method. We propose a hierarchical machine learning decision-maker, working on a set of features calculated from the 3D tomograms of the cells' refractive index. We prove that 3D morphological features are adequately distinctive to identify tumor cells versus the white blood cell background in the first stage and, moreover, in recognizing the tumor type at the second decision step. Proof-of-concept experiments are shown, in which two different tumor cell lines, namely neuroblastoma cancer cells and ovarian cancer cells, are used against monocytes. The reported results allow claiming the identification of tumor cells with a success rate higher than 97% and with an accuracy over 97% in discriminating between the two cancer cell types, thus opening in a near future the route to a new Liquid Biopsy tool for detecting and classifying circulating tumor cells in blood by stain-free method.

The Use of Machine Learning for Predicting Complications of Free-Flap Head and Neck Reconstruction

BACKGROUND

Machine learning has been increasingly used for surgical outcome prediction, yet applications in head and neck reconstruction are not well-described. In this study, we developed and evaluated the performance of ML algorithms in predicting postoperative complications in head and neck free-flap reconstruction.

METHODS

We conducted a comprehensive review of patients who underwent microvascular head and neck reconstruction between January 2005 and December 2018. Data were used to develop and evaluate nine supervised ML algorithms in predicting overall complications, major recipient-site complication, and total flap loss.

RESULTS

We identified 4000 patients who met inclusion criteria. Overall, 33.7% of patients experienced a complication, 26.5% experienced a major recipient-site complication, and 1.7% suffered total flap loss. The k-nearest neighbors algorithm demonstrated the best overall performance for predicting any complication (AUROC = 0.61, sensitivity = 0.60). Regularized regression had the best performance for predicting major recipient-site complications (AUROC = 0.68, sensitivity = 0.66), and decision trees were the best predictors of total flap loss (AUROC = 0.66, sensitivity = 0.50).

CONCLUSIONS

ML accurately identified patients at risk of experiencing postsurgical complications, including total flap loss. Predictions from ML models may provide insight in the perioperative setting and facilitate shared decision making.

Label-free macrophage phenotype classification using machine learning methods

Macrophages are heterogeneous innate immune cells that are functionally shaped by their surrounding microenvironment. Diverse macrophage populations have multifaceted differences related to their morphology, metabolism, expressed markers, and functions, where the identification of the different phenotypes is of an utmost importance in modelling immune response. While expressed markers are the most used signature to classify phenotypes, multiple reports indicate that macrophage morphology and autofluorescence are also valuable clues that can be used in the identification process. In this work, we investigated macrophage autofluorescence as a distinct feature for classifying six different macrophage phenotypes, namely: M0, M1, M2a, M2b, M2c, and M2d. The identification was based on extracted signals from multi-channel/multi-wavelength flow cytometer. To achieve the identification, we constructed a dataset containing 152,438 cell events each having a response vector of 45 optical signals fingerprint. Based on this dataset, we applied different supervised machine learning methods to detect phenotype specific fingerprint from the response vector, where the fully connected neural network architecture provided the highest classification accuracy of 75.8% for the six phenotypes compared simultaneously. Furthermore, by restricting the number of phenotypes in the experiment, the proposed framework produces higher classification accuracies, averaging 92.0%, 91.9%, 84.2%, and 80.4% for a pool of two, three, four, five phenotypes, respectively. These results indicate the potential of the intrinsic autofluorescence for classifying macrophage phenotypes, with the proposed method being quick, simple, and cost-effective way to accelerate the discovery of macrophage phenotypical diversity.

A method for real-time mechanical characterisation of microcapsules

Characterising the mechanical properties of flowing microcapsules is important from both fundamental and applied points of view. In the present study, we develop a novel multilayer perceptron (MLP)-based machine learning (ML) approach, for real-time simultaneous predictions of the membrane mechanical law type, shear and area-dilatation moduli of microcapsules, from their camera-recorded steady profiles in tube flow. By MLP, we mean a neural network where many perceptrons are organised into layers. A perceptron is a basic element that conducts input-output mapping operation. We test the performance of the present approach using both simulation and experimental data. We find that with a reasonably high prediction accuracy, our method can reach an unprecedented low prediction latency of less than 1 millisecond on a personal computer. That is the overall computational time, without using parallel computing, from a single experimental image to multiple capsule mechanical parameters. It is faster than a recently proposed convolutional neural network-based approach by two orders of magnitude, for it only deals with the one-dimensional capsule boundary instead of the entire two-dimensional capsule image. Our new approach may serve as the foundation of a promising tool for real-time mechanical characterisation and online active sorting of deformable microcapsules and biological cells in microfluidic devices.

Smart systems in producing algae-based protein to improve functional food ingredients industries

Production and extraction systems of algal protein and handling process of functional food ingredients need to control several parameters such as temperature, pH, intensity, and turbidity. Many researchers have investigated the Internet of Things (IoT) approach for enhancing the yield of microalgae biomass and machine learning for identifying and classifying microalgae. However, there have been few specific studies on using IoT and artificial intelligence (AI) for production and extraction of algal protein as well as functional food ingredients processing. In order to improve the production of algal protein and functional food ingredients, the implementation of smart system is a must to have real-time monitoring, remote control system, quick response to sudden events, prediction and characterisation. Techniques of IoT and AI are expected to help functional food industries to have a big breakthrough in the future. Manufacturing and implementation of beneficial smart systems are important to provide convenience and to increase the efficiency of work by using the interconnectivity of IoT devices to have good capturing, processing, archiving, analyzing, and automation. This review investigates the possibilities of implementation of IoT and AI in production and extraction of algal protein and processing of functional food ingredients.

Classification of red cell dynamics with convolutional and recurrent neural networks: a sickle cell disease case study

The fraction of red blood cells adopting a specific motion under low shear flow is a promising inexpensive marker for monitoring the clinical status of patients with sickle cell disease. Its high-throughput measurement relies on the video analysis of thousands of cell motions for each blood sample to eliminate a large majority of unreliable samples (out of focus or overlapping cells) and discriminate between tank-treading and flipping motion, characterizing highly and poorly deformable cells respectively. Moreover, these videos are of different durations (from 6 to more than 100 frames). We present a two-stage end-to-end machine learning pipeline able to automatically classify cell motions in videos with a high class imbalance. By extending, comparing, and combining two state-of-the-art methods, a convolutional neural network (CNN) model and a recurrent CNN, we are able to automatically discard 97% of the unreliable cell sequences (first stage) and classify highly and poorly deformable red cell sequences with 97% accuracy and an F1-score of 0.94 (second stage). Dataset and codes are publicly released for the community.

Visualizing knowledge evolution trends and research hotspots of artificial intelligence in colorectal cancer: A bibliometric analysis

BACKGROUND

In recent years, the rapid development of artificial intelligence (AI) technology has created a new diagnostic and therapeutic opportunity for colorectal cancer (CRC). Numerous academic and clinical studies have demonstrated that high-level auxiliary diagnosis and treatment systems based on AI technology can significantly improve the readability of medical data, objectively provide a reliable and comprehensive reference for physicians, reduce the experience gap between physicians, and aid physicians in making more accurate diagnosis decisions. In this study, we used bibliometric techniques to visually analyze the literature about AI in the CRC field and summarize the current situation and research hotspots in this field.

METHODS

The relevant literature on AI in the field of CRC research was obtained from the Web of Science Core Collection (WoSCC) database. The software CiteSpace was utilized to analyze the number of papers, countries, institutions, authors, journals, cited literature, and keywords of the included literature and generate a visual knowledge map. The present study aims to evaluate the origin, current hotspots, and research trends of AI in CRC using bibliometric analysis.

RESULTS

As of March 2022, 64 nations/regions, 230 institutions, 245 journals, and 300 authors had published 562 AI-related articles in the field of CRC. Since 2016, each year has seen an exponential increase. China and the United States were the largest contributors, with the largest number of beneficial research institutions and the closest collaboration relationship. The World Journal of Gastroenterology is this field's most widely published journal. Diagnosis and treatment research, gene and immunology research, intestinal polyp research, tumor grading research, gastrointestinal endoscopy research, and prognosis research comprised the six topics derived from high-frequency keyword cluster analysis.

CONCLUSION

In recent years, field research has been a popular topic of discussion. The results of our bibliometric analysis allow us to comprehend better the current situation and trend of this research field, and the quantitative data indicators can serve as a guide for the research and application of global scholars.

Pixel-level multimodal fusion deep networks for predicting subcellular organelle localization from label-free live-cell imaging

Complex intracellular organizations are commonly represented by dividing the metabolic process of cells into different organelles. Therefore, identifying sub-cellular organelle architecture is significant for understanding intracellular structural properties, specific functions, and biological processes in cells. However, the discrimination of these structures in the natural organizational environment and their functional consequences are not clear. In this article, we propose a new pixel-level multimodal fusion (PLMF) deep network which can be used to predict the location of cellular organelle using label-free cell optical microscopy images followed by deep-learning-based automated image denoising. It provides valuable insights that can be of tremendous help in improving the specificity of label-free cell optical microscopy by using the Transformer-Unet network to predict the ground truth imaging which corresponds to different sub-cellular organelle architectures. The new prediction method proposed in this article combines the advantages of a transformer's global prediction and CNN's local detail analytic ability of background features for label-free cell optical microscopy images, so as to improve the prediction accuracy. Our experimental results showed that the PLMF network can achieve over 0.91 Pearson's correlation coefficient (PCC) correlation between estimated and true fractions on lung cancer cell-imaging datasets. In addition, we applied the PLMF network method on the cell images for label-free prediction of several different subcellular components simultaneously, rather than using several fluorescent labels. These results open up a new way for the time-resolved study of subcellular components in different cells, especially for cancer cells.

Recent Advances of Utilizing Artificial Intelligence in Lab on a Chip for Diagnosis and Treatment

Nowadays, artificial intelligence (AI) creates numerous promising opportunities in the life sciences. AI methods can be significantly advantageous for analyzing the massive datasets provided by biotechnology systems for biological and biomedical applications. Microfluidics, with the developments in controlled reaction chambers, high-throughput arrays, and positioning systems, generate big data that is not necessarily analyzed successfully. Integrating AI and microfluidics can pave the way for both experimental and analytical throughputs in biotechnology research. Microfluidics enhances the experimental methods and reduces the cost and scale, while AI methods significantly improve the analysis of huge datasets obtained from high-throughput and multiplexed microfluidics. This review briefly presents a survey of the role of AI and microfluidics in biotechnology. Also, the incorporation of AI with microfluidics is comprehensively investigated. Specifically, recent studies that perform flow cytometry cell classification, cell isolation, and a combination of them by gaining from both AI methods and microfluidic techniques are covered. Despite all current challenges, various fields of biotechnology can be remarkably affected by the combination of AI and microfluidic technologies. Some of these fields include point-of-care systems, precision, personalized medicine, regenerative medicine, prognostics, diagnostics, and treatment of oncology and non-oncology-related diseases.

Multiple Parallel Fusion Network for Predicting Protein Subcellular Localization from Stimulated Raman Scattering (SRS) Microscopy Images in Living Cells

Stimulated Raman Scattering Microscopy (SRS) is a powerful tool for label-free detailed recognition and investigation of the cellular and subcellular structures of living cells. Determining subcellular protein localization from the cell level of SRS images is one of the basic goals of cell biology, which can not only provide useful clues for their functions and biological processes but also help to determine the priority and select the appropriate target for drug development. However, the bottleneck in predicting subcellular protein locations of SRS cell imaging lies in modeling complicated relationships concealed beneath the original cell imaging data owing to the spectral overlap information from different protein molecules. In this work, a multiple parallel fusion network, MPFnetwork, is proposed to study the subcellular locations from SRS images. This model used a multiple parallel fusion model to construct feature representations and combined multiple nonlinear decomposing algorithms as the automated subcellular detection method. Our experimental results showed that the MPFnetwork could achieve over 0.93 dice correlation between estimated and true fractions on SRS lung cancer cell datasets. In addition, we applied the MPFnetwork method to cell images for label-free prediction of several different subcellular components simultaneously, rather than using several fluorescent labels. These results open up a new method for the time-resolved study of subcellular components in different cells, especially cancer cells.

Biosensors and machine learning for enhanced detection, stratification, and classification of cells: a review

Biological cells, by definition, are the basic units which contain the fundamental molecules of life of which all living things are composed. Understanding how they function and differentiating cells from one another, therefore, is of paramount importance for disease diagnostics as well as therapeutics. Sensors focusing on the detection and stratification of cells have gained popularity as technological advancements have allowed for the miniaturization of various components inching us closer to Point-of-Care (POC) solutions with each passing day. Furthermore, Machine Learning has allowed for enhancement in the analytical capabilities of these various biosensing modalities, especially the challenging task of classification of cells into various categories using a data-driven approach rather than physics-driven. In this review, we provide an account of how Machine Learning has been applied explicitly to sensors that detect and classify cells. We also provide a comparison of how different sensing modalities and algorithms affect the classifier accuracy and the dataset size required.

High-throughput "read-on-ski" automated imaging and label-free detection system for toxicity screening of compounds using personalised human kidney organoids

Organoid models are used to study kidney physiology, such as the assessment of nephrotoxicity and underlying disease processes. Personalized human pluripotent stem cell-derived kidney organoids are ideal models for compound toxicity studies, but there is a need to accelerate basic and translational research in the field. Here, we developed an automated continuous imaging setup with the "read-on-ski" law of control to maximize temporal resolution with minimum culture plate vibration. High-accuracy performance was achieved: organoid screening and imaging were performed at a spatial resolution of 1.1 μm for the entire multi-well plate under 3 min. We used the in-house developed multi-well spinning device and cisplatin-induced nephrotoxicity model to evaluate the toxicity in kidney organoids using this system. The acquired images were processed via machine learning-based classification and segmentation algorithms, and the toxicity in kidney organoids was determined with 95% accuracy. The results obtained by the automated "read-on-ski" imaging device, combined with label-free and non-invasive algorithms for detection, were verified using conventional biological procedures. Taking advantage of the close-to-in vivo-kidney organoid model, this new development opens the door for further application of scaled-up screening using organoids in basic research and drug discovery.

Artificial Intelligence-Assisted Score Analysis for Predicting the Expression of the Immunotherapy Biomarker PD-L1 in Lung Cancer

Programmed cell death ligand 1 (PD-L1) is a critical biomarker for predicting the response to immunotherapy. However, traditional quantitative evaluation of PD-L1 expression using immunohistochemistry staining remains challenging for pathologists. Here we developed a deep learning (DL)-based artificial intelligence (AI) model to automatically analyze the immunohistochemical expression of PD-L1 in lung cancer patients. A total of 1,288 patients with lung cancer were included in the study. The diagnostic ability of three different AI models (M1, M2, and M3) was assessed in both PD-L1 (22C3) and PD-L1 (SP263) assays. M2 and M3 showed improved performance in the evaluation of PD-L1 expression in the PD-L1 (22C3) assay, especially at 1% cutoff. Highly accurate performance in the PD-L1 (SP263) was also achieved, with accuracy and specificity of 96.4 and 96.8% in both M2 and M3, respectively. Moreover, the diagnostic results of these three AI-assisted models were highly consistent with those from the pathologist. Similar performances of M1, M2, and M3 in the 22C3 dataset were also obtained in lung adenocarcinoma and lung squamous cell carcinoma in both sampling methods. In conclusion, these results suggest that AI-assisted diagnostic models in PD-L1 expression are a promising tool for improving the efficiency of clinical pathologists.

Detection of live breast cancer cells in bright-field microscopy images containing white blood cells by image analysis and deep learning

SIGNIFICANCE

Circulating tumor cells (CTCs) are important biomarkers for cancer management. Isolated CTCs from blood are stained to detect and enumerate CTCs. However, the staining process is laborious and moreover makes CTCs unsuitable for drug testing and molecular characterization.

AIM

The goal is to develop and test deep learning (DL) approaches to detect unstained breast cancer cells in bright-field microscopy images that contain white blood cells (WBCs).

APPROACH

We tested two convolutional neural network (CNN) approaches. The first approach allows investigation of the prominent features extracted by CNN to discriminate in vitro cancer cells from WBCs. The second approach is based on faster region-based convolutional neural network (Faster R-CNN).

RESULTS

Both approaches detected cancer cells with higher than 95% sensitivity and 99% specificity with the Faster R-CNN being more efficient and suitable for deployment presenting an improvement of 4% in sensitivity. The distinctive feature that CNN uses for discrimination is cell size, however, in the absence of size difference, the CNN was found to be capable of learning other features. The Faster R-CNN was found to be robust with respect to intensity and contrast image transformations.

CONCLUSIONS

CNN-based DL approaches could be potentially applied to detect patient-derived CTCs from images of blood samples.

Machine learning-enabled cancer diagnostics with widefield polarimetric second-harmonic generation microscopy

The extracellular matrix (ECM) collagen undergoes major remodeling during tumorigenesis. However, alterations to the ECM are not widely considered in cancer diagnostics, due to mostly uniform appearance of collagen fibers in white light images of hematoxylin and eosin-stained (H&E) tissue sections. Polarimetric second-harmonic generation (P-SHG) microscopy enables label-free visualization and ultrastructural investigation of non-centrosymmetric molecules, which, when combined with texture analysis, provides multiparameter characterization of tissue collagen. This paper demonstrates whole slide imaging of breast tissue microarrays using high-throughput widefield P-SHG microscopy. The resulting P-SHG parameters are used in classification to differentiate tumor from normal tissue, resulting in 94.2% for both accuracy and F1-score, and 6.3% false discovery rate. Subsequently, the trained classifier is employed to predict tumor tissue with 91.3% accuracy, 90.7% F1-score, and 13.8% false omission rate. As such, we show that widefield P-SHG microscopy reveals collagen ultrastructure over large tissue regions and can be utilized as a sensitive biomarker for cancer diagnostics and prognostics studies.

Imaging approaches for monitoring three-dimensional cell and tissue culture systems

The past decade has seen an increasing demand for more complex, reproducible and physiologically relevant tissue cultures that can mimic the structural and biological features of living tissues. Monitoring the viability, development and responses of such tissues in real-time are challenging due to the complexities of cell culture physical characteristics and the environments in which these cultures need to be maintained in. Significant developments in optics, such as optical manipulation, improved detection and data analysis, have made optical imaging a preferred choice for many three-dimensional (3D) cell culture monitoring applications. The aim of this review is to discuss the challenges associated with imaging and monitoring 3D tissues and cell culture, and highlight topical label-free imaging tools that enable bioengineers and biophysicists to non-invasively characterise engineered living tissues.

A Review of Optical Neural Networks

With the continuous miniaturization of conventional integrated circuits, obstacles such as excessive cost, increased resistance to electronic motion, and increased energy consumption are gradually slowing down the development of electrical computing and constraining the application of deep learning. Optical neuromorphic computing presents various opportunities and challenges compared with the realm of electronics. Algorithms running on optical hardware have the potential to meet the growing computational demands of deep learning and artificial intelligence. Here, we review the development of optical neural networks and compare various research proposals. We focus on fiber-based neural networks. Finally, we describe some new research directions and challenges.

Influences of Microscopic Imaging Conditions on Accuracy of Cell Morphology Discrimination Using Convolutional Neural Network of Deep Learning

Recently, automated cell culture devices have become necessary for cell therapy applications. The maintenance of cell functions is critical for cell expansion. However, there are risks of losing these functions, owing to disturbances in the surrounding environment and culturing procedures. Therefore, there is a need for a non-invasive and highly accurate evaluation method for cell phenotypes. In this study, we focused on an automated discrimination technique using image processing with a deep learning algorithm. This study aimed to clarify the effects of the optical magnification of the microscope and cell size in each image on the discrimination accuracy for cell phenotypes and morphologies. Myoblast cells (C2C12 cell line) were cultured and differentiated into myotubes. Microscopic images of the cultured cells were acquired at magnifications of 40× and 100×. A deep learning architecture was constructed to discriminate between undifferentiated and differentiated cells. The discrimination accuracy exceeded 90% even at a magnification of 40× for well-developed myogenic differentiation. For the cells under immature myogenic differentiation, a high optical magnification of 100× was required to maintain a discrimination accuracy over 90%. The microscopic optical magnification should be adjusted according to the cell differentiation to improve the efficiency of image-based cell discrimination.

Deep Learning-Assisted Automated Single Cell Electroporation Platform for Effective Genetic Manipulation of Hard-to-Transfect Cells

Genome engineering of cells using CRISPR/Cas systems has opened new avenues for pharmacological screening and investigating the molecular mechanisms of disease. A critical step in many such studies is the intracellular delivery of the gene editing machinery and the subsequent manipulation of cells. However, these workflows often involve processes such as bulk electroporation for intracellular delivery and fluorescence activated cell sorting for cell isolation that can be harsh to sensitive cell types such as human-induced pluripotent stem cells (hiPSCs). This often leads to poor viability and low overall efficacy, requiring the use of large starting samples. In this work, a fully automated version of the nanofountain probe electroporation (NFP-E) system, a nanopipette-based single-cell electroporation method is presented that provides superior cell viability and efficiency compared to traditional methods. The automated system utilizes a deep convolutional network to identify cell locations and a cell-nanopipette contact algorithm to position the nanopipette over each cell for the application of electroporation pulses. The automated NFP-E is combined with microconfinement arrays for cell isolation to demonstrate a workflow that can be used for CRISPR/Cas9 gene editing and cell tracking with potential applications in screening studies and isogenic cell line generation.

Neuromorphic computing for content-based image retrieval

Neuromorphic computing mimics the neural activity of the brain through emulating spiking neural networks. In numerous machine learning tasks, neuromorphic chips are expected to provide superior solutions in terms of cost and power efficiency. Here, we explore the application of Loihi, a neuromorphic computing chip developed by Intel, for the computer vision task of image retrieval. We evaluated the functionalities and the performance metrics that are critical in content-based visual search and recommender systems using deep-learning embeddings. Our results show that the neuromorphic solution is about 2.5 times more energy-efficient compared with an ARM Cortex-A72 CPU and 12.5 times more energy-efficient compared with NVIDIA T4 GPU for inference by a lightweight convolutional neural network when batch size is 1 while maintaining the same level of matching accuracy. The study validates the potential of neuromorphic computing in low-power image retrieval, as a complementary paradigm to the existing von Neumann architectures.

OC_Finder: Osteoclast Segmentation, Counting, and Classification Using Watershed and Deep Learning

Osteoclasts are multinucleated cells that exclusively resorb bone matrix proteins and minerals on the bone surface. They differentiate from monocyte/macrophage lineage cells in the presence of osteoclastogenic cytokines such as the receptor activator of nuclear factor-κB ligand (RANKL) and are stained positive for tartrate-resistant acid phosphatase (TRAP). In vitro osteoclast formation assays are commonly used to assess the capacity of osteoclast precursor cells for differentiating into osteoclasts wherein the number of TRAP-positive multinucleated cells is counted as osteoclasts. Osteoclasts are manually identified on cell culture dishes by human eyes, which is a labor-intensive process. Moreover, the manual procedure is not objective and results in lack of reproducibility. To accelerate the process and reduce the workload for counting the number of osteoclasts, we developed OC_Finder, a fully automated system for identifying osteoclasts in microscopic images. OC_Finder consists of cell image segmentation with a watershed algorithm and cell classification using deep learning. OC_Finder detected osteoclasts differentiated from wild-type and Sh3bp2KI/+ precursor cells at a 99.4% accuracy for segmentation and at a 98.1% accuracy for classification. The number of osteoclasts classified by OC_Finder was at the same accuracy level with manual counting by a human expert. OC_Finder also showed consistent performance on additional datasets collected with different microscopes with different settings by different operators. Together, successful development of OC_Finder suggests that deep learning is a useful tool to perform prompt and accurate unbiased classification and detection of specific cell types in microscopic images.

Deep Learning-Enabled Technologies for Bioimage Analysis

Deep learning (DL) is a subfield of machine learning (ML), which has recently demonstrated its potency to significantly improve the quantification and classification workflows in biomedical and clinical applications. Among the end applications profoundly benefitting from DL, cellular morphology quantification is one of the pioneers. Here, we first briefly explain fundamental concepts in DL and then we review some of the emerging DL-enabled applications in cell morphology quantification in the fields of embryology, point-of-care ovulation testing, as a predictive tool for fetal heart pregnancy, cancer diagnostics via classification of cancer histology images, autosomal polycystic kidney disease, and chronic kidney diseases.

Light sheet based volume flow cytometry (VFC) for rapid volume reconstruction and parameter estimation on the go

Optical imaging is paramount for disease diagnosis and to access its progression over time. The proposed optical flow imaging (VFC/iLIFE) is a powerful technique that adds new capabilities (3D volume visualization, organelle-level resolution, and multi-organelle screening) to the existing system. Unlike state-of-the-art point-illumination-based biomedical imaging techniques, the sheet-based VFC technique is capable of single-shot sectional visualization, high throughput interrogation, real-time parameter estimation, and instant volume reconstruction with organelle-level resolution of live specimens. The specimen flow system was realized on a multichannel (Y-type) microfluidic chip that enables visualization of organelle distribution in several cells in-parallel at a relatively high flow-rate (2000 nl/min). The calibration of VFC system requires the study of point emitters (fluorescent beads) at physiologically relevant flow-rates (500-2000 nl/min) for determining flow-induced optical aberration in the system point spread function (PSF). Subsequently, the recorded raw images and volumes were computationally deconvolved with flow-variant PSF to reconstruct the cell volume. High throughput investigation of the mitochondrial network in HeLa cancer cell was carried out at sub-cellular resolution in real-time and critical parameters (mitochondria count and size distribution, morphology, entropy, and cell strain statistics) were determined on-the-go. These parameters determine the physiological state of cells, and the changes over-time, revealing the metastatic progression of diseases. Overall, the developed VFC system enables real-time monitoring of sub-cellular organelle organization at a high-throughput with high-content capacity.

Differential diagnosis of hereditary anemias from a fraction of blood drop by digital holography and hierarchical machine learning

Anemia affects about the 25% of the global population and can provoke severe diseases, ranging from weakness and dizziness to pregnancy problems, arrhythmias and hearth failures. About 10% of the patients are affected by rare anemias of which 80% are hereditary. Early differential diagnosis of anemia enables prescribing patients a proper treatment and diet, which is effective to mitigate the associated symptoms. Nevertheless, the differential diagnosis of these conditions is often difficult due to shared and overlapping phenotypes. Indeed, the complete blood count and unaided peripheral blood smear observation cannot always provide a reliable differential diagnosis, so that biomedical assays and genetic tests are needed. These procedures are not error-free, require skilled personnel, and severely impact the financial resources of national health systems. Here we show a differential screening system for hereditary anemias that relies on holographic imaging and artificial intelligence. Label-free holographic imaging is aided by a hierarchical machine learning decider that works even in the presence of a very limited dataset but is enough accurate for discerning between different anemia classes with minimal morphological dissimilarities. It is worth to notice that only a few tens of cells from each patient are sufficient to obtain a correct diagnosis, with the advantage of significantly limiting the volume of blood drawn. This work paves the way to a wider use of home screening systems for point of care blood testing and telemedicine with lab-on-chip platforms.

An Overview of Organs-on-Chips Based on Deep Learning

Microfluidic-based organs-on-chips (OoCs) are a rapidly developing technology in biomedical and chemical research and have emerged as one of the most advanced and promising in vitro models. The miniaturization, stimulated tissue mechanical forces, and microenvironment of OoCs offer unique properties for biomedical applications. However, the large amount of data generated by the high parallelization of OoC systems has grown far beyond the scope of manual analysis by researchers with biomedical backgrounds. Deep learning, an emerging area of research in the field of machine learning, can automatically mine the inherent characteristics and laws of "big data" and has achieved remarkable applications in computer vision, speech recognition, and natural language processing. The integration of deep learning in OoCs is an emerging field that holds enormous potential for drug development, disease modeling, and personalized medicine. This review briefly describes the basic concepts and mechanisms of microfluidics and deep learning and summarizes their successful integration. We then analyze the combination of OoCs and deep learning for image digitization, data analysis, and automation. Finally, the problems faced in current applications are discussed, and future perspectives and suggestions are provided to further strengthen this integration.

Generative Adversarial Networks for Morphological-Temporal Classification of Stem Cell Images

Frequently, neural network training involving biological images suffers from a lack of data, resulting in inefficient network learning. This issue stems from limitations in terms of time, resources, and difficulty in cellular experimentation and data collection. For example, when performing experimental analysis, it may be necessary for the researcher to use most of their data for testing, as opposed to model training. Therefore, the goal of this paper is to perform dataset augmentation using generative adversarial networks (GAN) to increase the classification accuracy of deep convolutional neural networks (CNN) trained on induced pluripotent stem cell microscopy images. The main challenges are: 1. modeling complex data using GAN and 2. training neural networks on augmented datasets that contain generated data. To address these challenges, a temporally constrained, hierarchical classification scheme that exploits domain knowledge is employed for model learning. First, image patches of cell colonies from gray-scale microscopy images are generated using GAN, and then these images are added to the real dataset and used to address class imbalances at multiple stages of training. Overall, a 2% increase in both true positive rate and F1-score is observed using this method as compared to a straightforward, imbalanced classification network, with some greater improvements on a classwise basis. This work demonstrates that synergistic model design involving domain knowledge is key for biological image analysis and improves model learning in high-throughput scenarios.

Phenotypic drug screening in a human fibrosis model identified a novel class of antifibrotic therapeutics

Fibrogenic processes instigate fatal chronic diseases leading to organ failure and death. Underlying biological processes involve induced massive deposition of extracellular matrix (ECM) by aberrant fibroblasts. We subjected diseased primary human lung fibroblasts to an advanced three-dimensional phenotypic high-content assay and screened a repurposing drug library of small molecules for inhibiting ECM deposition. Fibrotic Pattern Detection by Artificial Intelligence identified tranilast as an effective inhibitor. Structure-activity relationship studies confirmed N-(2-butoxyphenyl)-3-(phenyl)acrylamides (N23Ps) as a novel and highly potent compound class. N23Ps suppressed myofibroblast transdifferentiation, ECM deposition, cellular contractility, and altered cell shapes, thus advocating a unique mode of action. Mechanistically, transcriptomics identified SMURF2 as a potential therapeutic target network. Antifibrotic activity of N23Ps was verified by proteomics in a human ex vivo tissue fibrosis disease model, suppressing profibrotic markers SERPINE1 and CXCL8. Conclusively, N23Ps are a novel class of highly potent compounds inhibiting organ fibrosis in patients.

Label-Free Assessment of the Drug Resistance of Epithelial Ovarian Cancer Cells in a Microfluidic Holographic Flow Cytometer Boosted through Machine Learning

About 75% of epithelial ovarian cancer (EOC) patients suffer from relapsing and develop drug resistance after primary chemotherapy. The commonly used clinical examinations and biological tumor tissue models for chemotherapeutic sensitivity are time-consuming and expensive. Research studies showed that the cell morphology-based method is promising to be a new route for chemotherapeutic sensitivity evaluation. Here, we offer how the drug resistance of EOC cells can be assessed through a label-free and high-throughput microfluidic flow cytometer equipped with a digital holographic microscope reinforced by machine learning. It is the first time that such type of assessment is performed to the best of our knowledge. Several morphologic and texture features at a single-cell level have been extracted from the quantitative phase images. In addition, we compared four common machine learning algorithms, including naive Bayes, decision tree, K-nearest neighbors, support vector machine (SVM), and fully connected network. The result shows that the SVM classifier achieves the optimal performance with an accuracy of 92.2% and an area under the curve of 0.96. This study demonstrates that the proposed method achieves high-accuracy, high-throughput, and label-free assessment of the drug resistance of EOC cells. Furthermore, it reflects strong potentialities to develop data-driven individualized chemotherapy treatments in the future.

A weakly supervised deep learning approach for label-free imaging flow-cytometry-based blood diagnostics

The application of machine learning approaches to imaging flow cytometry (IFC) data has the potential to transform the diagnosis of hematological diseases. However, the need for manually labeled single-cell images for machine learning model training has severely limited its clinical application. To address this, we present iCellCnn, a weakly supervised deep learning approach for label-free IFC-based blood diagnostics. We demonstrate the capability of iCellCnn to achieve diagnosis of Sézary syndrome (SS) from patient samples on the basis of bright-field IFC images of T cells obtained after fluorescence-activated cell sorting of human peripheral blood mononuclear cell specimens. With a sample size of four healthy donors and five SS patients, iCellCnn achieved a 100% classification accuracy. As iCellCnn is not restricted to the diagnosis of SS, we expect such weakly supervised approaches to tap the diagnostic potential of IFC by providing automatic data-driven diagnosis of diseases with so-far unknown morphological manifestations.