Label-free detection of cellular drug responses by high-throughput bright-field imaging and machine learning

Deep learning unlocks label-free viability assessment of cancer spheroids in microfluidics

Despite recent advances in cancer treatment, refining therapeutic agents remains a critical task for oncologists. Precise evaluation of drug effectiveness necessitates the use of 3D cell culture instead of traditional 2D monolayers. Microfluidic platforms have enabled high-throughput drug screening with 3D models, but current viability assays for 3D cancer spheroids have limitations in reliability and cytotoxicity. This study introduces a deep learning model for non-destructive, label-free viability estimation based on phase-contrast images, providing a cost-effective, high-throughput solution for continuous spheroid monitoring in microfluidics. Microfluidic technology facilitated the creation of a high-throughput cancer spheroid platform with approximately 12 000 spheroids per chip for drug screening. Validation involved tests with eight conventional chemotherapeutic drugs, revealing a strong correlation between viability assessed via LIVE/DEAD staining and phase-contrast morphology. Extending the model's application to novel compounds and cell lines not in the training dataset yielded promising results, implying the potential for a universal viability estimation model. Experiments with an alternative microscopy setup supported the model's transferability across different laboratories. Using this method, we also tracked the dynamic changes in spheroid viability during the course of drug administration. In summary, this research integrates a robust platform with high-throughput microfluidic cancer spheroid assays and deep learning-based viability estimation, with broad applicability to various cell lines, compounds, and research settings.

Semi-automated, high-content imaging of drug transporter knockout sea urchin (Lytechinus pictus) embryos

A defining feature of sea urchins is their extreme fecundity. Urchins produce millions of transparent, synchronously developing embryos, ideal for spatial and temporal analysis of development. This biological feature has been effectively utilized for ensemble measurement of biochemical changes. However, it has been underutilized in imaging studies, where single embryo measurements are used. Here we present an example of how stable genetics and high content imaging, along with machine learning-based image analysis, can be used to exploit the fecundity and synchrony of sea urchins in imaging-based drug screens. Building upon our recently created sea urchin ABCB1 knockout line, we developed a high-throughput assay to probe the role of this drug transporter in embryos. We used high content imaging to compare accumulation and toxicity of canonical substrates and inhibitors of the transporter, including fluorescent molecules and antimitotic cancer drugs, in homozygous knockout and wildtype embryos. To measure responses from the resulting image data, we used a nested convolutional neural network, which rapidly classified embryos according to fluorescence or cell division. This approach identified sea urchin embryos with 99.8% accuracy and determined two-cell and aberrant embryos with 96.3% and 89.1% accuracy, respectively. The results revealed that ABCB1 knockout embryos accumulated the transporter substrate calcein 3.09 times faster than wildtypes. Similarly, knockouts were 4.71 and 3.07 times more sensitive to the mitotic poisons vinblastine and taxol. This study paves the way for large scale pharmacological screens in the sea urchin embryo.

AI in cellular engineering and reprogramming

During the last decade, artificial intelligence (AI) has increasingly been applied in biophysics and related fields, including cellular engineering and reprogramming, offering novel approaches to understand, manipulate, and control cellular function. The potential of AI lies in its ability to analyze complex datasets and generate predictive models. AI algorithms can process large amounts of data from single-cell genomics and multiomic technologies, allowing researchers to gain mechanistic insights into the control of cell identity and function. By integrating and interpreting these complex datasets, AI can help identify key molecular events and regulatory pathways involved in cellular reprogramming. This knowledge can inform the design of precision engineering strategies, such as the development of new transcription factor and signaling molecule cocktails, to manipulate cell identity and drive authentic cell fate across lineage boundaries. Furthermore, when used in combination with computational methods, AI can accelerate and improve the analysis and understanding of the intricate relationships between genes, proteins, and cellular processes. In this review article, we explore the current state of AI applications in biophysics with a specific focus on cellular engineering and reprogramming. Then, we showcase a couple of recent applications where we combined machine learning with experimental and computational techniques. Finally, we briefly discuss the challenges and prospects of AI in cellular engineering and reprogramming, emphasizing the potential of these technologies to revolutionize our ability to engineer cells for a variety of applications, from disease modeling and drug discovery to regenerative medicine and biomanufacturing.

Passive Focusing of Single Cells Using Microwell Arrays for High-Accuracy Image-Activated Sorting

Sorting single cells from a population was of critical importance in areas such as cell line development and cell therapy. Image-based sorting is becoming a promising technique for the nonlabeling isolation of cells due to the capability of providing the details of cell morphology. This study reported the focusing of cells using microwell arrays and the following automatic size sorting based on the real-time recognition of cells. The simulation first demonstrated the converged streamlines to the symmetrical plane contributed to the focusing effect. Then, the influence of connecting microchannel, flowing length, particle size, and the sample flow rate on the focusing effect was experimentally analyzed. Both microspheres and cells could be aligned in a straight line at the Reynolds number (Re) of 0.027-0.187 and 0.027-0.08, respectively. The connecting channel was proved to drastically improve the focusing performance. Afterward, a tapered microwell array was utilized to focus sphere/cell spreading in a wide channel to a straight line. Finally, a custom algorithm was employed to identify and sort the size of microspheres/K562 cells with a throughput of 1 event/s and an accuracy of 97.8/97.1%. The proposed technique aligned cells to a straight line at low Reynolds numbers and greatly facilitated the image-activated sorting without the need for a high-speed camera or flow control components with high frequency. Therefore, it is of enormous application potential in the field of nonlabeled separation of single cells.

Is AI essential? Examining the need for deep learning in image-activated sorting of Saccharomyces cerevisiae

Artificial intelligence (AI) has become a focal point across a multitude of societal sectors, with science not being an exception. Particularly in the life sciences, imaging flow cytometry has increasingly integrated AI for automated management and categorization of extensive cell image data. However, the necessity of AI over traditional classification methods when extending imaging flow cytometry to include cell sorting remains uncertain, primarily due to the time constraints between image acquisition and sorting actuation. AI-enabled image-activated cell sorting (IACS) methods remain substantially limited, even as recent advancements in IACS have found success while largely relying on traditional feature gating strategies. Here we assess the necessity of AI for image classification in IACS by contrasting the performance of feature gating, classical machine learning (ML), and deep learning (DL) with convolutional neural networks (CNNs) in the differentiation of Saccharomyces cerevisiae mutant images. We show that classical ML could only yield a 2.8-fold enhancement in target enrichment capability, albeit at the cost of a 13.7-fold increase in processing time. Conversely, a CNN could offer an 11.0-fold improvement in enrichment capability at an 11.5-fold increase in processing time. We further executed IACS on mixed mutant populations and quantified target strain enrichment via downstream DNA sequencing to substantiate the applicability of DL for the proposed study. Our findings validate the feasibility and value of employing DL in IACS for morphology-based genetic screening of S. cerevisiae, encouraging its incorporation in future advancements of similar technologies.

Enhancing single-cell biology through advanced AI-powered microfluidics

Microfluidic technology has largely benefited both fundamental biological research and translational clinical diagnosis with its advantages in high-throughput, single-cell resolution, high integrity, and wide-accessibility. Despite the merits we obtained from microfluidics in the last two decades, the current requirement of intelligence in biomedicine urges the microfluidic technology to process biological big data more efficiently and intelligently. Thus, the current readout technology based on the direct detection of the signals in either optics or electrics was not able to meet the requirement. The implementation of artificial intelligence (AI) in microfluidic technology matches up with the large-scale data usually obtained in the high-throughput assays of microfluidics. At the same time, AI is able to process the multimodal datasets obtained from versatile microfluidic devices, including images, videos, electric signals, and sequences. Moreover, AI provides the microfluidic technology with the capability to understand and decipher the obtained datasets rather than simply obtaining, which eventually facilitates fundamental and translational research in many areas, including cell type discovery, cell signaling, single-cell genetics, and diagnosis. In this Perspective, we will highlight the recent advances in employing AI for single-cell biology and present an outlook on the future direction with more advanced AI algorithms.

Evaluating the utility of brightfield image data for mechanism of action prediction

Fluorescence staining techniques, such as Cell Painting, together with fluorescence microscopy have proven invaluable for visualizing and quantifying the effects that drugs and other perturbations have on cultured cells. However, fluorescence microscopy is expensive, time-consuming, labor-intensive, and the stains applied can be cytotoxic, interfering with the activity under study. The simplest form of microscopy, brightfield microscopy, lacks these downsides, but the images produced have low contrast and the cellular compartments are difficult to discern. Nevertheless, by harnessing deep learning, these brightfield images may still be sufficient for various predictive purposes. In this study, we compared the predictive performance of models trained on fluorescence images to those trained on brightfield images for predicting the mechanism of action (MoA) of different drugs. We also extracted CellProfiler features from the fluorescence images and used them to benchmark the performance. Overall, we found comparable and largely correlated predictive performance for the two imaging modalities. This is promising for future studies of MoAs in time-lapse experiments for which using fluorescence images is problematic. Explorations based on explainable AI techniques also provided valuable insights regarding compounds that were better predicted by one modality over the other.

Deep learning with microfluidics for on-chip droplet generation, control, and analysis

Droplet microfluidics has gained widespread attention in recent years due to its advantages of high throughput, high integration, high sensitivity and low power consumption in droplet-based micro-reaction. Meanwhile, with the rapid development of computer technology over the past decade, deep learning architectures have been able to process vast amounts of data from various research fields. Nowadays, interdisciplinarity plays an increasingly important role in modern research, and deep learning has contributed greatly to the advancement of many professions. Consequently, intelligent microfluidics has emerged as the times require, and possesses broad prospects in the development of automated and intelligent devices for integrating the merits of microfluidic technology and artificial intelligence. In this article, we provide a general review of the evolution of intelligent microfluidics and some applications related to deep learning, mainly in droplet generation, control, and analysis. We also present the challenges and emerging opportunities in this field.

Microsystem Advances through Integration with Artificial Intelligence

Microfluidics is a rapidly growing discipline that involves studying and manipulating fluids at reduced length scale and volume, typically on the scale of micro- or nanoliters. Under the reduced length scale and larger surface-to-volume ratio, advantages of low reagent consumption, faster reaction kinetics, and more compact systems are evident in microfluidics. However, miniaturization of microfluidic chips and systems introduces challenges of stricter tolerances in designing and controlling them for interdisciplinary applications. Recent advances in artificial intelligence (AI) have brought innovation to microfluidics from design, simulation, automation, and optimization to bioanalysis and data analytics. In microfluidics, the Navier-Stokes equations, which are partial differential equations describing viscous fluid motion that in complete form are known to not have a general analytical solution, can be simplified and have fair performance through numerical approximation due to low inertia and laminar flow. Approximation using neural networks trained by rules of physical knowledge introduces a new possibility to predict the physicochemical nature. The combination of microfluidics and automation can produce large amounts of data, where features and patterns that are difficult to discern by a human can be extracted by machine learning. Therefore, integration with AI introduces the potential to revolutionize the microfluidic workflow by enabling the precision control and automation of data analysis. Deployment of smart microfluidics may be tremendously beneficial in various applications in the future, including high-throughput drug discovery, rapid point-of-care-testing (POCT), and personalized medicine. In this review, we summarize key microfluidic advances integrated with AI and discuss the outlook and possibilities of combining AI and microfluidics.

SIC50: Determining drug inhibitory concentrations using a vision transformer and an optimized Sobel operator

As a measure of cytotoxic potency, half-maximal inhibitory concentration (IC50) is the concentration at which a drug exerts half of its maximal inhibitory effect against target cells. It can be determined by various methods that require applying additional reagents or lysing the cells. Here, we describe a label-free Sobel-edge-based method, which we name SIC50, for the evaluation of IC50. SIC50 classifies preprocessed phase-contrast images with a state-of-the-art vision transformer and allows for the continuous assessment of IC50 in a faster and more cost-efficient manner. We have validated this method using four drugs and 1,536-well plates and also built a web application. We anticipate that this method will assist in the high-throughput screening of chemical libraries (e.g., small-molecule drugs, small interfering RNA [siRNA], and microRNA and drug discovery).

Trends and Potential of Machine Learning and Deep Learning in Drug Study at Single-Cell Level

Cancer treatments always face challenging problems, particularly drug resistance due to tumor cell heterogeneity. The existing datasets include the relationship between gene expression and drug sensitivities; however, the majority are based on tissue-level studies. Study drugs at the single-cell level are perspective to overcome minimal residual disease caused by subclonal resistant cancer cells retained after initial curative therapy. Fortunately, machine learning techniques can help us understand how different types of cells respond to different cancer drugs from the perspective of single-cell gene expression. Good modeling using single-cell data and drug response information will not only improve machine learning for cell-drug outcome prediction but also facilitate the discovery of drugs for specific cancer subgroups and specific cancer treatments. In this paper, we review machine learning and deep learning approaches in drug research. By analyzing the application of these methods on cancer cell lines and single-cell data and comparing the technical gap between single-cell sequencing data analysis and single-cell drug sensitivity analysis, we hope to explore the trends and potential of drug research at the single-cell data level and provide more inspiration for drug research at the single-cell level. We anticipate that this review will stimulate the innovative use of machine learning methods to address new challenges in precision medicine more broadly.

Patterning Wettability for Open-Surface Fluidic Manipulation: Fundamentals and Applications

Effective manipulation of liquids on open surfaces without external energy input is indispensable for the advancement of point-of-care diagnostic devices. Open-surface microfluidics has the potential to benefit health care, especially in the developing world. This review highlights the prospects for harnessing capillary forces on surface-microfluidic platforms, chiefly by inducing smooth gradients or sharp steps of wettability on substrates, to elicit passive liquid transport and higher-order fluidic manipulations without off-the-chip energy sources. A broad spectrum of the recent progress in the emerging field of passive surface microfluidics is highlighted, and its promise for developing facile, low-cost, easy-to-operate microfluidic devices is discussed in light of recent applications, not only in the domain of biomedical microfluidics but also in the general areas of energy and water conservation.

Label-Free Imaging Analysis of Patient-Derived Cholangiocarcinoma Organoids after Sorafenib Treatment

Monitoring tumor growth dynamics is crucial for understanding cancer. To establish an in vitro method for the continuous assessment of patient-specific tumor growth, tumor organoids were generated from patients with intrahepatic CCA (iCCA). Organoid growth was monitored for 48 h by label-free live brightfield imaging. Growth kinetics were calculated and validated by MTS assay as well as immunohistochemistry of Ki67 to determine proliferation rates. We exposed iCCA organoids (iCCAOs) and non-tumor intrahepatic cholangiocyte organoids (ICOs) to sub-therapeutic concentrations of sorafenib. Monitoring the expansion rate of iCCAOs and ICOs revealed that iCCAO growth was inhibited by sorafenib in a time- and dose-dependent fashion, while ICOs were unaffected. Quantification of the proliferation marker Ki67 confirmed inhibition of iCCAO growth by roughly 50% after 48 h of treatment with 4 µM sorafenib. We established a robust analysis pipeline combining brightfield microscopy and a straightforward image processing approach for the label-free growth monitoring of patient-derived iCCAOs. Combined with bioanalytical validation, this approach is suitable for a fast and efficient high-throughput drug screening in tumor organoids to develop patient-specific systemic treatment options.

Pixel-level multimodal fusion deep networks for predicting subcellular organelle localization from label-free live-cell imaging

Complex intracellular organizations are commonly represented by dividing the metabolic process of cells into different organelles. Therefore, identifying sub-cellular organelle architecture is significant for understanding intracellular structural properties, specific functions, and biological processes in cells. However, the discrimination of these structures in the natural organizational environment and their functional consequences are not clear. In this article, we propose a new pixel-level multimodal fusion (PLMF) deep network which can be used to predict the location of cellular organelle using label-free cell optical microscopy images followed by deep-learning-based automated image denoising. It provides valuable insights that can be of tremendous help in improving the specificity of label-free cell optical microscopy by using the Transformer-Unet network to predict the ground truth imaging which corresponds to different sub-cellular organelle architectures. The new prediction method proposed in this article combines the advantages of a transformer's global prediction and CNN's local detail analytic ability of background features for label-free cell optical microscopy images, so as to improve the prediction accuracy. Our experimental results showed that the PLMF network can achieve over 0.91 Pearson's correlation coefficient (PCC) correlation between estimated and true fractions on lung cancer cell-imaging datasets. In addition, we applied the PLMF network method on the cell images for label-free prediction of several different subcellular components simultaneously, rather than using several fluorescent labels. These results open up a new way for the time-resolved study of subcellular components in different cells, especially for cancer cells.

Multiple Parallel Fusion Network for Predicting Protein Subcellular Localization from Stimulated Raman Scattering (SRS) Microscopy Images in Living Cells

Stimulated Raman Scattering Microscopy (SRS) is a powerful tool for label-free detailed recognition and investigation of the cellular and subcellular structures of living cells. Determining subcellular protein localization from the cell level of SRS images is one of the basic goals of cell biology, which can not only provide useful clues for their functions and biological processes but also help to determine the priority and select the appropriate target for drug development. However, the bottleneck in predicting subcellular protein locations of SRS cell imaging lies in modeling complicated relationships concealed beneath the original cell imaging data owing to the spectral overlap information from different protein molecules. In this work, a multiple parallel fusion network, MPFnetwork, is proposed to study the subcellular locations from SRS images. This model used a multiple parallel fusion model to construct feature representations and combined multiple nonlinear decomposing algorithms as the automated subcellular detection method. Our experimental results showed that the MPFnetwork could achieve over 0.93 dice correlation between estimated and true fractions on SRS lung cancer cell datasets. In addition, we applied the MPFnetwork method to cell images for label-free prediction of several different subcellular components simultaneously, rather than using several fluorescent labels. These results open up a new method for the time-resolved study of subcellular components in different cells, especially cancer cells.

Machine learning approaches for biomolecular, biophysical, and biomaterials research

A fluent conversation with a virtual assistant, person-tailored news feeds, and deep-fake images created within seconds-all those things that have been unthinkable for a long time are now a part of our everyday lives. What these examples have in common is that they are realized by different means of machine learning (ML), a technology that has fundamentally changed many aspects of the modern world. The possibility to process enormous amount of data in multi-hierarchical, digital constructs has paved the way not only for creating intelligent systems but also for obtaining surprising new insight into many scientific problems. However, in the different areas of biosciences, which typically rely heavily on the collection of time-consuming experimental data, applying ML methods is a bit more challenging: Here, difficulties can arise from small datasets and the inherent, broad variability, and complexity associated with studying biological objects and phenomena. In this Review, we give an overview of commonly used ML algorithms (which are often referred to as "machines") and learning strategies as well as their applications in different bio-disciplines such as molecular biology, drug development, biophysics, and biomaterials science. We highlight how selected research questions from those fields were successfully translated into machine readable formats, discuss typical problems that can arise in this context, and provide an overview of how to resolve those encountered difficulties.

Deep learning-based image processing in optical microscopy

Optical microscopy has emerged as a key driver of fundamental research since it provides the ability to probe into imperceptible structures in the biomedical world. For the detailed investigation of samples, a high-resolution image with enhanced contrast and minimal damage is preferred. To achieve this, an automated image analysis method is preferable over manual analysis in terms of both speed of acquisition and reduced error accumulation. In this regard, deep learning (DL)-based image processing can be highly beneficial. The review summarises and critiques the use of DL in image processing for the data collected using various optical microscopic techniques. In tandem with optical microscopy, DL has already found applications in various problems related to image classification and segmentation. It has also performed well in enhancing image resolution in smartphone-based microscopy, which in turn enablse crucial medical assistance in remote places.

Graphical abstract

Microscopic Imaging Methods for Organ-on-a-Chip Platforms

Microscopic imaging is essential and the most popular method for in situ monitoring and evaluating the outcome of various organ-on-a-chip (OOC) platforms, including the number and morphology of mammalian cells, gene expression, protein secretions, etc. This review presents an overview of how various imaging methods can be used to image organ-on-a-chip platforms, including transillumination imaging (including brightfield, phase-contrast, and holographic optofluidic imaging), fluorescence imaging (including confocal fluorescence and light-sheet fluorescence imaging), and smartphone-based imaging (including microscope attachment-based, quantitative phase, and lens-free imaging). While various microscopic imaging methods have been demonstrated for conventional microfluidic devices, a relatively small number of microscopic imaging methods have been demonstrated for OOC platforms. Some methods have rarely been used to image OOCs. Specific requirements for imaging OOCs will be discussed in comparison to the conventional microfluidic devices and future directions will be introduced in this review.

Light sheet based volume flow cytometry (VFC) for rapid volume reconstruction and parameter estimation on the go

Optical imaging is paramount for disease diagnosis and to access its progression over time. The proposed optical flow imaging (VFC/iLIFE) is a powerful technique that adds new capabilities (3D volume visualization, organelle-level resolution, and multi-organelle screening) to the existing system. Unlike state-of-the-art point-illumination-based biomedical imaging techniques, the sheet-based VFC technique is capable of single-shot sectional visualization, high throughput interrogation, real-time parameter estimation, and instant volume reconstruction with organelle-level resolution of live specimens. The specimen flow system was realized on a multichannel (Y-type) microfluidic chip that enables visualization of organelle distribution in several cells in-parallel at a relatively high flow-rate (2000 nl/min). The calibration of VFC system requires the study of point emitters (fluorescent beads) at physiologically relevant flow-rates (500-2000 nl/min) for determining flow-induced optical aberration in the system point spread function (PSF). Subsequently, the recorded raw images and volumes were computationally deconvolved with flow-variant PSF to reconstruct the cell volume. High throughput investigation of the mitochondrial network in HeLa cancer cell was carried out at sub-cellular resolution in real-time and critical parameters (mitochondria count and size distribution, morphology, entropy, and cell strain statistics) were determined on-the-go. These parameters determine the physiological state of cells, and the changes over-time, revealing the metastatic progression of diseases. Overall, the developed VFC system enables real-time monitoring of sub-cellular organelle organization at a high-throughput with high-content capacity.

From imaging a single cell to implementing precision medicine: an exciting new era

In the age of high-throughput, single-cell biology, single-cell imaging has evolved not only in terms of technological advancements but also in its translational applications. The synchronous advancements of imaging and computational biology have produced opportunities of merging the two, providing the scientific community with tools towards observing, understanding, and predicting cellular and tissue phenotypes and behaviors. Furthermore, multiplexed single-cell imaging and machine learning algorithms now enable patient stratification and predictive diagnostics of clinical specimens. Here, we provide an overall summary of the advances in single-cell imaging, with a focus on high-throughput microscopy phenomics and multiplexed proteomic spatial imaging platforms. We also review various computational tools that have been developed in recent years for image processing and downstream applications used in biomedical sciences. Finally, we discuss how harnessing systems biology approaches and data integration across disciplines can further strengthen the exciting applications and future implementation of single-cell imaging on precision medicine.

Exploiting machine learning for bestowing intelligence to microfluidics

Intelligent microfluidics is an emerging cross-discipline research area formed by combining microfluidics with machine learning. It uses the advantages of microfluidics, such as high throughput and controllability, and the powerful data processing capabilities of machine learning, resulting in improved systems in biotechnology and chemistry. Compared to traditional microfluidics using manual analysis methods, intelligent microfluidics needs less human intervention, and results in a more user-friendly experience with faster processing. There is a paucity of literature reviewing this burgeoning and highly promising cross-discipline. Therefore, we herein comprehensively and systematically summarize several aspects of microfluidic applications enabled by machine learning. We list the types of microfluidics used in intelligent microfluidic applications over the last five years, as well as the machine learning algorithms and the hardware used for training. We also present the most recent advances in key technologies, developments, challenges, and the emerging opportunities created by intelligent microfluidics.

Translation of Cellular Protein Localization Using Convolutional Networks

Protein localization in cells has been analyzed by fluorescent labeling using indirect immunofluorescence and fluorescent protein tagging. However, the relationships between the localization of different proteins had not been analyzed using artificial intelligence. Here, we applied convolutional networks for the prediction of localization of the cytoskeletal proteins from the localization of the other proteins. Lamellipodia are one of the actin-dependent subcellular structures involved in cell migration and are mainly generated by the Wiskott-Aldrich syndrome protein (WASP)-family verprolin homologous protein 2 (WAVE2) and the membrane remodeling I-BAR domain protein IRSp53. Focal adhesion is another actin-based structure that contains vinculin protein and promotes lamellipodia formation and cell migration. In contrast, microtubules are not directly related to actin filaments. The convolutional network was trained using images of actin filaments paired with WAVE2, IRSp53, vinculin, and microtubules. The generated images of WAVE2, IRSp53, and vinculin were highly similar to their real images. In contrast, the microtubule images generated from actin filament images were inferior without the generation of filamentous structures, suggesting that microscopic images of actin filaments provide more information about actin-related protein localization. Collectively, this study suggests that image translation by the convolutional network can predict the localization of functionally related proteins, and the convolutional network might be used to describe the relationships between the proteins by their localization.

Functional liquid droplets for analyte sensing and energy harvesting

Over the past century, rapid miniaturization of technologies has helped in the development of efficient, flexible, portable, robust, and compact applications with minimal wastage of materials. In this direction, of late, the usage of mesoscale liquid droplets has emerged as an alternative platform because of the following advantages: (i) a droplet is incompressible and at the same time deformable, (ii) interfacial area of a spherical droplet is minimum for a given amount of mass; and (iii) a droplet interface allows facile mass, momentum, and energy transfer. Subsequently, such attributes have aided towards the design of diverse droplet-based microfluidic technologies. For example, the microdroplets have been utilized as micro-reactors, colorimetric or electrochemical (EC) sensors, drug-delivery vehicles, and energy harvesters. Further, a number of recently reported lab-on-a-chip technologies exploit the motility, storage, and mixing capacities of the microdroplets. In view of this background, the review initiates discussion by highlighting the different attributes of the microdroplets such as size, shape, surface to volume ratio, wettability, and contact line. Thereafter, the effects of the surface or body forces on the properties of the droplets have been elaborated. Finally, the different aspects of such liquid droplet systems towards technological adaptations in health care, sensing, and energy harvesting have been presented. The review concludes with a tight summary on the potential avenues for further developments.

Image3C, a multimodal image-based and label-independent integrative method for single-cell analysis

Image-based cell classification has become a common tool to identify phenotypic changes in cell populations. However, this methodology is limited to organisms possessing well-characterized species-specific reagents (e.g., antibodies) that allow cell identification, clustering, and convolutional neural network (CNN) training. In the absence of such reagents, the power of image-based classification has remained mostly off-limits to many research organisms. We have developed an image-based classification methodology we named Image3C (Image-Cytometry Cell Classification) that does not require species-specific reagents nor pre-existing knowledge about the sample. Image3C combines image-based flow cytometry with an unbiased, high-throughput cell clustering pipeline and CNN integration. Image3C exploits intrinsic cellular features and non-species-specific dyes to perform de novo cell composition analysis and detect changes between different conditions. Therefore, Image3C expands the use of image-based analyses of cell population composition to research organisms in which detailed cellular phenotypes are unknown or for which species-specific reagents are not available.

Toward deep biophysical cytometry: prospects and challenges

The biophysical properties of cells reflect their identities, underpin their homeostatic state in health, and define the pathogenesis of disease. Recent leapfrogging advances in biophysical cytometry now give access to this information, which is obscured in molecular assays, with a discriminative power that was once inconceivable. However, biophysical cytometry should go 'deeper' in terms of exploiting the information-rich cellular biophysical content, generating a molecular knowledge base of cellular biophysical properties, and standardizing the protocols for wider dissemination. Overcoming these barriers, which requires concurrent innovations in microfluidics, optical imaging, and computer vision, could unleash the enormous potential of biophysical cytometry not only for gaining a new mechanistic understanding of biological systems but also for identifying new cost-effective biomarkers of disease.

Optical Machine Learning Using Time-Lens Deep Neural NetWorks

As a high-throughput data analysis technique, photon time stretching (PTS) is widely used in the monitoring of rare events such as cancer cells, rough waves, and the study of electronic and optical transient dynamics. The PTS technology relies on high-speed data collection, and the large amount of data generated poses a challenge to data storage and real-time processing. Therefore, how to use compatible optical methods to filter and process data in advance is particularly important. The time-lens proposed, based on the duality of time and space as an important data processing method derived from PTS, achieves imaging of time signals by controlling the phase information of the timing signals. In this paper, an optical neural network based on the time-lens (TL-ONN) is proposed, which applies the time-lens to the layer algorithm of the neural network to realize the forward transmission of one-dimensional data. The recognition function of this optical neural network for speech information is verified by simulation, and the test recognition accuracy reaches 95.35%. This architecture can be applied to feature extraction and classification, and is expected to be a breakthrough in detecting rare events such as cancer cell identification and screening.

Deep learning-enabled imaging flow cytometry for high-speed Cryptosporidium and Giardia detection

Imaging flow cytometry has become a popular technology for bioparticle image analysis because of its capability of capturing thousands of images per second. Nevertheless, the vast number of images generated by imaging flow cytometry imposes great challenges for data analysis especially when the species have similar morphologies. In this work, we report a deep learning-enabled high-throughput system for predicting Cryptosporidium and Giardia in drinking water. This system combines imaging flow cytometry and an efficient artificial neural network called MCellNet, which achieves a classification accuracy >99.6%. The system can detect Cryptosporidium and Giardia with a sensitivity of 97.37% and a specificity of 99.95%. The high-speed analysis reaches 346 frames per second, outperforming the state-of-the-art deep learning algorithm MobileNetV2 in speed (251 frames per second) with a comparable classification accuracy. The reported system empowers rapid, accurate, and high throughput bioparticle detection in clinical diagnostics, environmental monitoring and other potential biosensing applications.

Intelligent Platelet Morphometry

Technological advances in image-based platelet analysis or platelet morphometry are critical for a better understanding of the structure and function of platelets in biological research as well as for the development of better clinical strategies in medical practice. Recently, the advent of high-throughput optical imaging and deep learning has boosted platelet morphometry to the next level by providing a new set of capabilities beyond what is achievable with traditional platelet morphometry, shedding light on the unexplored domain of platelet analysis. This Opinion article introduces emerging opportunities in 'intelligent' platelet morphometry, which are expected to pave the way for a new class of diagnostics, pharmacometrics, and therapeutics.

Use of artificial intelligence to enhance phenotypic drug discovery

Research and development (R&D) productivity across the pharmaceutical industry has received close scrutiny over the past two decades, especially taking into consideration reports of attrition rates and the colossal cost for drug development. The respective merits of the two main drug discovery approaches, phenotypic and target based, have divided opinion across the research community, because each hold different advantages for identifying novel molecular entities with a successful path to the market. Nevertheless, both have low translatability in the clinic. Artificial intelligence (AI) and adoption of machine learning (ML) tools offer the promise of revolutionising drug development, and overcoming obstacles in the drug discovery pipeline. Here, we assess the potential of target-driven and phenotypic-based approaches and offer a holistic description of the current state of the field, from both a scientific and industry perspective. With the emerging partnerships between AI/ML and pharma still in their relative infancy, we investigate the potential and current limitations with a particular focus on phenotypic drug discovery. Finally, we emphasise the value of public-private partnerships (PPPs) and cross-disciplinary collaborations to foster innovation and facilitate efficient drug discovery programmes.

Single-cell cytometry via multiplexed fluorescence prediction by label-free reflectance microscopy

Traditional imaging cytometry uses fluorescence markers to identify specific structures but is limited in throughput by the labeling process. We develop a label-free technique that alleviates the physical staining and provides multiplexed readouts via a deep learning-augmented digital labeling method. We leverage the rich structural information and superior sensitivity in reflectance microscopy and show that digital labeling predicts accurate subcellular features after training on immunofluorescence images. We demonstrate up to three times improvement in the prediction accuracy over the state of the art. Beyond fluorescence prediction, we demonstrate that single cell-level structural phenotypes of cell cycles are correctly reproduced by the digital multiplexed images, including Golgi twins, Golgi haze during mitosis, and DNA synthesis. We further show that the multiplexed readouts enable accurate multiparametric single-cell profiling across a large cell population. Our method can markedly improve the throughput for imaging cytometry toward applications for phenotyping, pathology, and high-content screening.

AI on a chip

Artificial intelligence (AI) has dramatically changed the landscape of science, industry, defence, and medicine in the last several years. Supported by considerably enhanced computational power and cloud storage, the field of AI has shifted from mostly theoretical studies in the discipline of computer science to diverse real-life applications such as drug design, material discovery, speech recognition, self-driving cars, advertising, finance, medical imaging, and astronomical observation, where AI-produced outcomes have been proven to be comparable or even superior to the performance of human experts. In these applications, what is essentially important for the development of AI is the data needed for machine learning. Despite its prominent importance, the very first process of the AI development, namely data collection and data preparation, is typically the most laborious task and is often a limiting factor of constructing functional AI algorithms. Lab-on-a-chip technology, in particular microfluidics, is a powerful platform for both the construction and implementation of AI in a large-scale, cost-effective, high-throughput, automated, and multiplexed manner, thereby overcoming the above bottleneck. On this platform, high-throughput imaging is a critical tool as it can generate high-content information (e.g., size, shape, structure, composition, interaction) of objects on a large scale. High-throughput imaging can also be paired with sorting and DNA/RNA sequencing to conduct a massive survey of phenotype-genotype relations whose data is too complex to analyze with traditional computational tools, but is analyzable with the power of AI. In addition to its function as a data provider, lab-on-a-chip technology can also be employed to implement the developed AI for accurate identification, characterization, classification, and prediction of objects in mixed, heterogeneous, or unknown samples. In this review article, motivated by the excellent synergy between AI and lab-on-a-chip technology, we outline fundamental elements, recent advances, future challenges, and emerging opportunities of AI with lab-on-a-chip technology or "AI on a chip" for short.

Classification of cell morphology with quantitative phase microscopy and machine learning

We describe and compare two machine learning approaches for cell classification based on label-free quantitative phase imaging with transport of intensity equation methods. In one approach, we design a multilevel integrated machine learning classifier including various individual models such as artificial neural network, extreme learning machine and generalized logistic regression. In another approach, we apply a pretrained convolutional neural network using transfer learning for the classification. As a validation, we show the performances of both approaches on classification between macrophages cultured in normal gravity and microgravity with quantitative phase imaging. The multilevel integrated classifier achieves average accuracy 93.1%, which is comparable to the average accuracy 93.5% obtained by convolutional neural network. The presented quantitative phase imaging system with two classification approaches could be helpful to biomedical scientists for easy and accurate cell analysis.

Fast intelligent cell phenotyping for high-throughput optofluidic time-stretch microscopy based on the XGBoost algorithm

SIGNIFICANCE

The use of optofluidic time-stretch flow cytometry enables extreme-throughput cell imaging but suffers from the difficulties of capturing and processing a large amount of data. As significant amounts of continuous image data are generated, the images require identification with high speed.

AIM

We present an intelligent cell phenotyping framework for high-throughput optofluidic time-stretch microscopy based on the XGBoost algorithm, which is able to classify obtained cell images rapidly and accurately. The applied image recognition consists of density-based spatial clustering of applications with noise outlier detection, histograms of oriented gradients combining gray histogram fused feature, and XGBoost classification.

APPROACH

We tested the ability of this framework against other previously proposed or commonly used algorithms to phenotype two groups of cell images. We quantified their performances with measures of classification ability and computational complexity based on AUC and test runtime. The tested cell image datasets were acquired from high-throughput imaging of over 20,000 drug-treated and untreated cells with an optofluidic time-stretch microscope.

RESULTS

The framework we built beats other methods with an accuracy of over 97% and a classification frequency of 3000  cells  /  s. In addition, we determined the optimal structure of training sets according to model performances under different training set components.

CONCLUSIONS

The proposed XGBoost-based framework acts as a promising solution to processing large flow image data. This work provides a foundation for future cell sorting and clinical practice of high-throughput imaging cytometers.

Label-Free Leukemia Monitoring by Computer Vision

Acute lymphoblastic leukemia (ALL) is the most common childhood cancer. While there are a number of well‐recognized prognostic biomarkers at diagnosis, the most powerful independent prognostic factor is the response of the leukemia to induction chemotherapy (Campana and Pui: Blood 129 (2017) 1913–1918). Given the potential for machine learning to improve precision medicine, we tested its capacity to monitor disease in children undergoing ALL treatment. Diagnostic and on‐treatment bone marrow samples were labeled with an ALL‐discriminating antibody combination and analyzed by imaging flow cytometry. Ignoring the fluorescent markers and using only features extracted from bright‐field and dark‐field cell images, a deep learning model was able to identify ALL cells at an accuracy of >88%. This antibody‐free, single cell method is cheap, quick, and could be adapted to a simple, laser‐free cytometer to allow automated, point‐of‐care testing to detect slow early responders. Adaptation to other types of leukemia is feasible, which would revolutionize residual disease monitoring. © 2020 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry.

Deep Learning-Based Single-Cell Optical Image Studies

Optical imaging technology that has the advantages of high sensitivity and cost-effectiveness greatly promotes the progress of nondestructive single-cell studies. Complex cellular image analysis tasks such as three-dimensional reconstruction call for machine-learning technology in cell optical image research. With the rapid developments of high-throughput imaging flow cytometry, big data cell optical images are always obtained that may require machine learning for data analysis. In recent years, deep learning has been prevalent in the field of machine learning for large-scale image processing and analysis, which brings a new dawn for single-cell optical image studies with an explosive growth of data availability. Popular deep learning techniques offer new ideas for multimodal and multitask single-cell optical image research. This article provides an overview of the basic knowledge of deep learning and its applications in single-cell optical image studies. We explore the feasibility of applying deep learning techniques to single-cell optical image analysis, where popular techniques such as transfer learning, multimodal learning, multitask learning, and end-to-end learning have been reviewed. Image preprocessing and deep learning model training methods are then summarized. Applications based on deep learning techniques in the field of single-cell optical image studies are reviewed, which include image segmentation, super-resolution image reconstruction, cell tracking, cell counting, cross-modal image reconstruction, and design and control of cell imaging systems. In addition, deep learning in popular single-cell optical imaging techniques such as label-free cell optical imaging, high-content screening, and high-throughput optical imaging cytometry are also mentioned. Finally, the perspectives of deep learning technology for single-cell optical image analysis are discussed. © 2020 International Society for Advancement of Cytometry.

Intelligent frequency-shifted optofluidic time-stretch quantitative phase imaging

Optofluidic time-stretch quantitative phase imaging (OTS-QPI) is a powerful tool as it enables high-throughput (>10,000 cell/s) QPI of single live cells. OTS-QPI is based on decoding temporally stretched spectral interferograms that carry the spatial profiles of cells flowing on a microfluidic chip. However, the utility of OTS-QPI is troubled by difficulties in phase retrieval from the high-frequency region of the temporal interferograms, such as phase-unwrapping errors, high instrumentation cost, and large data volume. To overcome these difficulties, we propose and experimentally demonstrate frequency-shifted OTS-QPI by bringing the phase information to the baseband region. Furthermore, to show its boosted utility, we use it to demonstrate image-based classification of leukemia cells with high accuracy over 96% and evaluation of drug-treated leukemia cells via deep learning.

Intelligent whole-blood imaging flow cytometry for simple, rapid, and cost-effective drug-susceptibility testing of leukemia

Drug susceptibility (also called chemosensitivity) is an important criterion for developing a therapeutic strategy for various cancer types such as breast cancer and leukemia. Recently, functional assays such as high-content screening together with genomic analysis have been shown to be effective for predicting drug susceptibility, but their clinical applicability is poor since they are time-consuming (several days long), labor-intensive, and costly. Here we present a highly simple, rapid, and cost-effective liquid biopsy for ex vivo drug-susceptibility testing of leukemia. The method is based on an extreme-throughput (>1 million cells per second), label-free, whole-blood imaging flow cytometer with a deep convolutional autoencoder, enabling image-based identification of the drug susceptibility of every single white blood cell in whole blood within 24 hours by simply flowing a drug-treated whole blood sample as little as 500 μL into the imaging flow cytometer without labeling. Our results show that the method accurately evaluates the drug susceptibility of white blood cells from untreated patients with acute lymphoblastic leukemia. Our method holds promise for affordable precision medicine.

A practical guide to intelligent image-activated cell sorting

Intelligent image-activated cell sorting (iIACS) is a machine-intelligence technology that performs real-time intelligent image-based sorting of single cells with high throughput. iIACS extends beyond the capabilities of fluorescence-activated cell sorting (FACS) from fluorescence intensity profiles of cells to multidimensional images, thereby enabling high-content sorting of cells or cell clusters with unique spatial chemical and morphological traits. Therefore, iIACS serves as an integral part of holistic single-cell analysis by enabling direct links between population-level analysis (flow cytometry), cell-level analysis (microscopy), and gene-level analysis (sequencing). Specifically, iIACS is based on a seamless integration of high-throughput cell microscopy (e.g., multicolor fluorescence imaging, bright-field imaging), cell focusing, cell sorting, and deep learning on a hybrid software-hardware data management infrastructure, enabling real-time automated operation for data acquisition, data processing, intelligent decision making, and actuation. Here, we provide a practical guide to iIACS that describes how to design, build, characterize, and use an iIACS machine. The guide includes the consideration of several important design parameters, such as throughput, sensitivity, dynamic range, image quality, sort purity, and sort yield; the development and integration of optical, microfluidic, electrical, computational, and mechanical components; and the characterization and practical usage of the integrated system. Assuming that all components are readily available, a team of several researchers experienced in optics, electronics, digital signal processing, microfluidics, mechatronics, and flow cytometry can complete this protocol in ~3 months.

Quantitative Phase Imaging Flow Cytometry for Ultra-Large-Scale Single-Cell Biophysical Phenotyping

Cellular biophysical properties are the effective label-free phenotypes indicative of differences in cell types, states, and functions. However, current biophysical phenotyping methods largely lack the throughput and specificity required in the majority of cell-based assays that involve large-scale single-cell characterization for inquiring the inherently complex heterogeneity in many biological systems. Further confounded by the lack of reported robust reproducibility and quality control, widespread adoption of single-cell biophysical phenotyping in mainstream cytometry remains elusive. To address this challenge, here we present a label-free imaging flow cytometer built upon a recently developed ultrafast quantitative phase imaging (QPI) technique, coined multi-ATOM, that enables label-free single-cell QPI, from which a multitude of subcellularly resolvable biophysical phenotypes can be parametrized, at an experimentally recorded throughput of >10,000 cells/s-a capability that is otherwise inaccessible in current QPI. With the aim to translate multi-ATOM into mainstream cytometry, we report robust system calibration and validation (from image acquisition to phenotyping reproducibility) and thus demonstrate its ability to establish high-dimensional single-cell biophysical phenotypic profiles at ultra-large-scale (>1,000,000 cells). Such a combination of throughput and content offers sufficiently high label-free statistical power to classify multiple human leukemic cell types at high accuracy (~92-97%). This system could substantiate the significance of high-throughput QPI flow cytometry in enabling next frontier in large-scale image-derived single-cell analysis applied in biological discovery and cost-effective clinical diagnostics. © 2019 International Society for Advancement of Cytometry.

High-Performance All-Inorganic CsPbCl3 Perovskite Nanocrystal Photodetectors with Superior Stability

All-inorganic perovskites nanostructures, such as CsPbCl₃ nanocrystals (NCs), are promising in many applications including light-emitting diodes, photovoltaics, and photodetectors. Despite the impressive performance that was demonstrated, a critical issue remains due to the instability of the perovskites in ambient. Herein, we report a method of passivating crystalline CsPbCl₃ NC surfaces with 3-mercaptopropionic acid (MPA), and superior ambient stability is achieved. The printing of these colloidal NCs on the channel of graphene field-effect transistors (GFETs) on solid Si/SiO₂ and flexible polyethylene terephthalate substrates was carried out to obtain CsPbCl₃ NCs/GFET heterojunction photodetectors for flexible and visible-blind ultraviolet detection at wavelength below 400 nm. Besides ambient stability, the additional benefits of passivating surface charge trapping by the defects on CsPbCl₃ NCs and facilitating high-efficiency charge transfer between the CsPbCl₃ NCs and graphene were provided by MPA. Extraordinary optoelectronic performance was obtained on the CsPbCl₃ NCs/graphene devices including a high ultraviolet responsivity exceeding 10⁶ A/W, a high detectivity of 2 × 10¹³ Jones, a fast photoresponse time of 0.3 s, and ambient stability with less than 10% degradation of photoresponse after 2400 h. This result demonstrates the crucial importance of the perovskite NC surface passivation not only to the performance but also to the stability of the perovskite optoelectronic devices.

Defect-Assisted Broad-Band Photosensitivity with High Responsivity in Au/Self-Seeded TiO2 NR/Au-Based Back-to-Back Schottky Junctions

TiO₂ nanorods (NRs) have generated much interest for both fundamental understanding of defect formation and technological applications in energy harvesting, optoelectronics, and catalysis. Herein, we have grown TiO₂ NR films on glass substrates using a self-seeded approach and annealed them in H₂ ambient to modify their surface defects. It has been shown that broad-band photosensing properties of Au/self-seeded TiO₂ NR/Au-based two back-to-back Schottky junctions (SJs) for a broad wavelength of light are much superior as compared to those of the pristine and the control samples. Photoresponsivity values for the H₂-annealed sample are 0.42, 0.71, 0.07, and 0.08 A/W for detecting, respectively, 350, 400, 470, and 570 nm lights. Very low dark current and high photocurrent lead to a gain value as high as 1.85 × 10⁴ for 400 nm light. Unprecedentedly modified NR-based SJs show excellent photoresponsivity for detecting as low as 25, 36, 48, and 28 μW/cm² power densities of 350, 400, 470, and 570 nm lights, respectively. It is found that Ti³⁺ defects play a key role in an efficient photoelectron transfer from TiO₂ to Au. Our work, for the first time, highlights the simplicity and reveals the rationale behind the excellent properties of Au/self-seeded TiO₂ NR film/Au back-to-back SJs.

Label-free classification of cells based on supervised machine learning of subcellular structures

It is demonstrated that cells can be classified by pattern recognition of the subcellular structure of non-stained live cells, and the pattern recognition was performed by machine learning. Human white blood cells and five types of cancer cell lines were imaged by quantitative phase microscopy, which provides morphological information without staining quantitatively in terms of optical thickness of cells. Subcellular features were then extracted from the obtained images as training data sets for the machine learning. The built classifier successfully classified WBCs from cell lines (area under ROC curve = 0.996). This label-free, non-cytotoxic cell classification based on the subcellular structure of QPM images has the potential to serve as an automated diagnosis of single cells.

Microfluidic droplets content classification and analysis through convolutional neural networks in a liquid biopsy workflow

In a recent paper we presented an innovative method of liquid biopsy, for the detection of circulating tumor cells (CTC) in the peripheral blood. Using microfluidics, CTC are individually encapsulated in water-in-oil droplets and selected by their increased rate of extracellular acidification (ECAR). During the analysis, empty or debris-containing droplets are discarded manually by screening images of positive droplets, increasing the operator-dependency and time-consumption of the assay. In this work, we addressed the limitations of the current method integrating computer vision techniques in the analysis. We implemented an automatic classification of droplets using convolutional neural networks, correctly classifying more than 96% of droplets. A second limitation of the technique is that ECAR is computed using an average droplet volume, without considering small variations in extracellular volume which can occur due to the normal variability in the size of the droplets or cells. Here, with the use of neural networks for object detection, we segmented the images of droplets and cells to measure their relative volumes, correcting over- or under-estimation of ECAR, which was present up to 20%. Finally, we evaluated whether droplet images contained additional information. We preliminarily gave a proof-of-concept demonstration showing that white blood cells expression of CD45 can be predicted with 82.9% accuracy, based on bright-field cell images alone. Then, we applied the method to classify acid droplets as coming from metastatic breast cancer patients or healthy donors, obtaining an accuracy of 90.2%.

Ultrafast polarization bio-imaging based on coherent detection and time-stretch techniques

Optical polarization imaging has played an important role in many biological and biomedical applications, as it provides a label-free and non-invasive detection scheme to reveal the polarization information of optical rotation, birefringence, and photoelasticity distribution inherent in biological samples. However, the imaging speeds of the previously demonstrated polarization imaging techniques were often limited by the slow frame rates of the arrayed imaging detectors, which usually run at frame rates of several hundred hertz. By combining the optical coherent detection of orthogonal polarizations and the optical time-stretch imaging technique, we achieved ultrafast polarization bio-imaging at an extremely fast record line scanning rate up to 100 MHz without averaging. We experimentally demonstrated the superior performance of our method by imaging three slices of different kinds of biological samples with the retrieved Jones matrix and polarization-sensitive information including birefringence and diattenuation. The proposed system in this paper may find potential applications for ultrafast polarization dynamics in living samples or some other advanced biomedical research.

COMBImage: a modular parallel processing framework for pairwise drug combination analysis that quantifies temporal changes in label-free video microscopy movies

BACKGROUND

Large-scale pairwise drug combination analysis has lately gained momentum in drug discovery and development projects, mainly due to the employment of advanced experimental-computational pipelines. This is fortunate as drug combinations are often required for successful treatment of complex diseases. Furthermore, most new drugs cannot totally replace the current standard-of-care medication, but rather have to enter clinical use as add-on treatment. However, there is a clear deficiency of computational tools for label-free and temporal image-based drug combination analysis that go beyond the conventional but relatively uninformative end point measurements.

RESULTS

COMBImage is a fast, modular and instrument independent computational framework for in vitro pairwise drug combination analysis that quantifies temporal changes in label-free video microscopy movies. Jointly with automated analyses of temporal changes in cell morphology and confluence, it performs and displays conventional cell viability and synergy end point analyses. The image processing algorithms are parallelized using Google's MapReduce programming model and optimized with respect to method-specific tuning parameters. COMBImage is shown to process time-lapse microscopy movies from 384-well plates within minutes on a single quad core personal computer. This framework was employed in the context of an ongoing drug discovery and development project focused on glioblastoma multiforme; the most deadly form of brain cancer. Interesting add-on effects of two investigational cytotoxic compounds when combined with vorinostat were revealed on recently established clonal cultures of glioma-initiating cells from patient tumor samples. Therapeutic synergies, when normal astrocytes were used as a toxicity cell model, reinforced the pharmacological interest regarding their potential clinical use.

CONCLUSIONS

COMBImage enables, for the first time, fast and optimized pairwise drug combination analyses of temporal changes in label-free video microscopy movies. Providing this jointly with conventional cell viability based end point analyses, it could help accelerating and guiding any drug discovery and development project, without use of cell labeling and the need to employ a particular live cell imaging instrument.