Area-based cell colony surviving fraction evaluation: A novel fully automatic approach using general-purpose acquisition hardware

Large-scale time-lapse scanning electron microscopy image mosaic using a smooth stitching strategy

Due to the trade-off between the field of view and resolution of various microscopes, obtaining a wide-view panoramic image through high-resolution image tiles is frequently encountered and demanded in numerous applications. Here, we propose an automatic image mosaic strategy for sequential 2D time-lapse scanning electron microscopy (SEM) images. This method can accurately compute pairwise translations among serial image tiles with indeterminate overlapping areas. The detection and matching of feature points are limited by geographical coordinates, thus avoiding accidental mismatching. Moreover, the nonlinear deformation of the mosaic part is also taken into account. A smooth stitching field is utilized to gradually transform the perspective transformation in overlapping regions into the linear transformation in non-overlapping regions. Experimental results demonstrate that better image stitching accuracy can be achieved compared with some other image mosaic algorithms. Such a method has potential applications in high-resolution large-area analysis using serial microscopy images. RESEARCH HIGHLIGHTS: An automatic image mosaic strategy for processing sequential scanning electron microscopy images is proposed. A smooth stitching field is applied in the image mosaic. Improved stitching accuracy is achieved compared with other conventional mosaic methods.

Automatic Segmentation and Classification for Antinuclear Antibody Images Based on Deep Learning

Antinuclear antibodies (ANAs) testing is the main serological diagnosis screening test for autoimmune diseases. ANAs testing is conducted principally by the indirect immunofluorescence (IIF) on human epithelial cell-substrate (HEp-2) protocol. However, due to its high variability and human subjectivity, there is an insistent need to develop an efficient method for automatic image segmentation and classification. This article develops an automatic segmentation and classification framework based on artificial intelligence (AI) on the ANA images. The Otsu thresholding method and watershed segmentation algorithm are adopted to segment IIF images of cells. Moreover, multiple texture features such as scale-invariant feature transform (SIFT), local binary pattern (LBP), cooccurrence among adjacent LBPs (CoALBP), and rotation invariant cooccurrence among adjacent LBPs (RIC-LBP) are utilized. Firstly, this article adopts traditional machine learning methods such as support vector machine (SVM), k-nearest neighbor algorithm (KNN), and random forest (RF) and then uses ensemble classifier (ECLF) combined with soft voting rules to merge these machine learning methods for classification. The deep learning method InceptionResNetV2 is also utilized to train on the classification of cell images. Eventually, the best accuracy of 0.9269 on the Changsha dataset and 0.9635 on the ICPR 2016 dataset for the traditional methods is obtained by a combination of SIFT and RIC-LBP with the ECLF classifier, and the best accuracy obtained by the InceptionResNetV2 is 0.9465 and 0.9836 separately, which outperforms other schemes.

Segmentation and Tracking of Mammary Epithelial Organoids in Brightfield Microscopy

We present an automated and deep-learning-based workflow to quantitatively analyze the spatiotemporal development of mammary epithelial organoids in two-dimensional time-lapse (2D+t) sequences acquired using a brightfield microscope at high resolution. It involves a convolutional neural network (U-Net), purposely trained using computer-generated bioimage data created by a conditional generative adversarial network (pix2pixHD), to infer semantic segmentation, adaptive morphological filtering to identify organoid instances, and a shape-similarity-constrained, instance-segmentation-correcting tracking procedure to reliably cherry-pick the organoid instances of interest in time. By validating it using real 2D+t sequences of mouse mammary epithelial organoids of morphologically different phenotypes, we clearly demonstrate that the workflow achieves reliable segmentation and tracking performance, providing a reproducible and laborless alternative to manual analyses of the acquired bioimage data.

Using Bland-Altman Analysis to Identify Appropriate Clonogenic Assay Colony Counting Techniques

OBJECTIVE

Determine the interchangeability of various methods utilized for counting colonies in clonogenic assays.

METHODS

Clonogenic assays of 2 head and neck cancer cell lines were counted through 4 different counting modalities: Manual counting pen, via microscope, 1 publicly available automated algorithm, and a semiautomated algorithm presented by the authors. Each method counted individual wells (N = 24). Pen and microscopic counts were performed by 2 observers. Parameters included both low-growth (<150 colonies/well) and high-growth (>150 colonies/well) cell lines. Correlational and Bland-Altman analyses were performed using SPSS software.

RESULTS

Interobserver manual pen count correlation R2 value in both growth conditions was 0.902; controlling for only low-growth conditions decreased R2 to 0.660. Correlation of microscopic versus pen counts R2 values for observers 1 and 2 were 0.955 and 0.775, respectively. Comparing techniques, Bland-Altman revealed potential bias with respect to the magnitude of measurement (P < .001) for both observers. Correlation of microscopic counts for both interobserver (R2 = 0.902) and intraobserver (R2 = 0.916) were analyzed. Bland-Altman revealed no bias (P = .489). Automated versus microscopic counts revealed no bias between methodologies (P = .787) and a lower correlation coefficient (R2 = 0.384). Semiautomated versus microscopic counts revealed no bias with respect to magnitude of measurement for either observer (P = .327, .229); Pearson correlation was 0.985 (R2 = 0.970) and 0.965 (R2 = 0.931) for observer 1 and 2. Semiautomated versus manual pen colony counts revealed a significant bias with respect to magnitude of measurement (P < .001).

CONCLUSION

Counting with a manual pen demonstrated significant bias when compared to microscopic and semiautomated colony counts; 2 methods were deemed to be interchangeable. Thus, training algorithms based on manual counts may introduce this bias as well. Algorithms trained to select colonies based on size (pixels2) and shape (circularity) should be prioritized. Solely relying on Bland-Altman or correlational analyses when determining method interchangeability should be avoided; they rather should be used in conjunction.

WBC Image Segmentation Based on Residual Networks and Attentional Mechanisms

White blood cell (WBC) morphology examination plays a crucial role in diagnosing many diseases. One of the most important steps in WBC morphology analysis is WBC image segmentation, which remains a challenging task. To address the problems of low segmentation accuracy caused by color similarity, uneven brightness, and irregular boundary between WBC regions and the background, a WBC image segmentation network based on U-Net combining residual networks and attention mechanism was proposed. Firstly, the ResNet50 residual block is used to form the main unit of the encoder structure, which helps to overcome the overfitting problem caused by a small number of training samples by improving the network's feature extraction capacity and loading the pretraining weight. Secondly, the SE module is added to the decoder structure to make the model pay more attention to useful features while suppressing useless ones. In addition, atrous convolution is utilized to recover full-resolution feature maps in the decoder structure to increase the receptive field of the convolution layer. Finally, network parameters are optimized using the Adam optimization technique in conjunction with the binary cross-entropy loss function. Experimental results on BCISC and LISC datasets show that the proposed approach has higher segmentation accuracy and robustness.

Leukocyte Segmentation Method Based on Adaptive Retinex Correction and U-Net

To address the issues of uneven illumination and inconspicuous leukocyte properties in the gathered cell pictures, a leukocyte segmentation method based on adaptive retinex correction and U-net was proposed. The procedure begins by processing a peripheral blood image to clearly distinguish leukocytes from other components in the image. The adaptive retinex correction, which is based on multiscale retinex with colour replication (MSRCR), redefines the colour recovery function by introducing Michelson contrast. Then, the image is trained with the U-net convolutional neural network, and the leukocyte segmentation is completed. The innovation is in the manner of processing peripheral blood images, which improves the accuracy of leukocyte segmentation. This study conducts experimental evaluations on the Cellavision, BCCD, and LISC datasets. The experimental results show that the method in this study is better than the current best method, and the segmentation accuracy rate reaches 98.87%.

Improved Otsu and Kapur approach for white blood cells segmentation based on LebTLBO optimization for the detection of Leukemia

The diagnosis of leukemia involves the detection of the abnormal characteristics of blood cells by a trained pathologist. Currently, this is done manually by observing the morphological characteristics of white blood cells in the microscopic images. Though there are some equipment- based and chemical-based tests available, the use and adaptation of the automated computer vision-based system is still an issue. There are certain software frameworks available in the literature; however, they are still not being adopted commercially. So there is a need for an automated and software- based framework for the detection of leukemia. In software-based detection, segmentation is the first critical stage that outputs the region of interest for further accurate diagnosis. Therefore, this paper explores an efficient and hybrid segmentation that proposes a more efficient and effective system for leukemia diagnosis. A very popular publicly available database, the acute lymphoblastic leukemia image database (ALL-IDB), is used in this research. First, the images are pre-processed and segmentation is done using Multilevel thresholding with Otsu and Kapur methods. To further optimize the segmentation performance, the Learning enthusiasm-based teaching-learning-based optimization (LebTLBO) algorithm is employed. Different metrics are used for measuring the system performance. A comparative analysis of the proposed methodology is done with existing benchmarks methods. The proposed approach has proven to be better than earlier techniques with measuring parameters of PSNR and Similarity index. The result shows a significant improvement in the performance measures with optimizing threshold algorithms and the LebTLBO technique.

A quantum-inspired classifier for clonogenic assay evaluations

Recent advances in Quantum Machine Learning (QML) have provided benefits to several computational processes, drastically reducing the time complexity. Another approach of combining quantum information theory with machine learning—without involving quantum computers—is known as Quantum-inspired Machine Learning (QiML), which exploits the expressive power of the quantum language to increase the accuracy of the process (rather than reducing the time complexity). In this work, we propose a large-scale experiment based on the application of a binary classifier inspired by quantum information theory to the biomedical imaging context in clonogenic assay evaluation to identify the most discriminative feature, allowing us to enhance cell colony segmentation. This innovative approach offers a two-fold result: (1) among the extracted and analyzed image features, homogeneity is shown to be a relevant feature in detecting challenging cell colonies; and (2) the proposed quantum-inspired classifier is a novel and outstanding methodology, compared to conventional machine learning classifiers, for the evaluation of clonogenic assays.

ACDC: Automated Cell Detection and Counting for Time-Lapse Fluorescence Microscopy

Advances in microscopy imaging technologies have enabled the visualization of live-cell dynamic processes using time-lapse microscopy imaging. However, modern methods exhibit several limitations related to the training phases and to time constraints, hindering their application in the laboratory practice. In this work, we present a novel method, named Automated Cell Detection and Counting (ACDC), designed for activity detection of fluorescent labeled cell nuclei in time-lapse microscopy. ACDC overcomes the limitations of the literature methods, by first applying bilateral filtering on the original image to smooth the input cell images while preserving edge sharpness, and then by exploiting the watershed transform and morphological filtering. Moreover, ACDC represents a feasible solution for the laboratory practice, as it can leverage multi-core architectures in computer clusters to efficiently handle large-scale imaging datasets. Indeed, our Parent-Workers implementation of ACDC allows to obtain up to a 3.7× speed-up compared to the sequential counterpart. ACDC was tested on two distinct cell imaging datasets to assess its accuracy and effectiveness on images with different characteristics. We achieved an accurate cell-count and nuclei segmentation without relying on large-scale annotated datasets, a result confirmed by the average Dice Similarity Coefficients of 76.84 and 88.64 and the Pearson coefficients of 0.99 and 0.96, calculated against the manual cell counting, on the two tested datasets.

A Rapid Method for Information Extraction from Borehole Log Images

Borehole logs are very important for geological analysis and application. Extracting structured information from borehole logs in the image format is the key to any analysis and application based on borehole data. The current method has defects in solving the beard phenomenon of the borehole log and the identification of special geological symbols. This paper proposes an automatic extraction method for borehole log information by combining the structural analysis based on the corner mark, as well as the structural understanding based on deep learning. The principles and key technologies of the method are described in detail. The performance of the method was tested by specific examples. This method is implemented on a geological information platform called QuantyView. The information extraction of 100 borehole logs with the same specification is used to verify the effectiveness of the proposed method. The results show that the method can not only effectively solve the inconsistency between the thickness and the description information in the borehole log but it can also address the low recognition efficiency of professional vocabulary, which can improve the extraction efficiency and accuracy of the borehole log information.

MF2C3: Multi-Feature Fuzzy Clustering to Enhance Cell Colony Detection in Automated Clonogenic Assay Evaluation

A clonogenic assay is a biological technique for calculating the Surviving Fraction (SF) that quantifies the anti-proliferative effect of treatments on cell cultures: this evaluation is often performed via manual counting of cell colony-forming units. Unfortunately, this procedure is error-prone and strongly affected by operator dependence. Besides, conventional assessment does not deal with the colony size, which is generally correlated with the delivered radiation dose or administered cytotoxic agent. Relying upon the direct proportional relationship between the Area Covered by Colony (ACC) and the colony count and size, along with the growth rate, we propose MF2C3, a novel computational method leveraging spatial Fuzzy C-Means clustering on multiple local features (i.e., entropy and standard deviation extracted from the input color images acquired by a general-purpose flat-bed scanner) for ACC-based SF quantification, by considering only the covering percentage. To evaluate the accuracy of the proposed fully automatic approach, we compared the SFs obtained by MF2C3 against the conventional counting procedure on four different cell lines. The achieved results revealed a high correlation with the ground-truth measurements based on colony counting, by outperforming our previously validated method using local thresholding on L*u*v* color well images. In conclusion, the proposed multi-feature approach, which inherently leverages the concept of symmetry in the pixel local distributions, might be reliably used in biological studies.

Proton Therapy and Src Family Kinase Inhibitor Combined Treatments on U87 Human Glioblastoma Multiforme Cell Line

Glioblastoma Multiforme (GBM) is the most common of malignant gliomas in adults with an exiguous life expectancy. Standard treatments are not curative and the resistance to both chemotherapy and conventional radiotherapy (RT) plans is the main cause of GBM care failures. Proton therapy (PT) shows a ballistic precision and a higher dose conformity than conventional RT. In this study we investigated the radiosensitive effects of a new targeted compound, SRC inhibitor, named Si306, in combination with PT on the U87 glioblastoma cell line. Clonogenic survival assay, dose modifying factor calculation and linear-quadratic model were performed to evaluate radiosensitizing effects mediated by combination of the Si306 with PT. Gene expression profiling by microarray was also conducted after PT treatments alone or combined, to identify gene signatures as biomarkers of response to treatments. Our results indicate that the Si306 compound exhibits a radiosensitizing action on the U87 cells causing a synergic cytotoxic effect with PT. In addition, microarray data confirm the SRC role as the main Si306 target and highlights new genes modulated by the combined action of Si306 and PT. We suggest, the Si306 as a new candidate to treat GBM in combination with PT, overcoming resistance to conventional treatments.

Radiosensitizing effect of curcumin-loaded lipid nanoparticles in breast cancer cells

In breast cancer (BC) care, radiotherapy is considered an efficient treatment, prescribed both for controlling localized tumors or as a therapeutic option in case of inoperable, incompletely resected or recurrent tumors. However, approximately 90% of BC-related deaths are due to the metastatic tumor progression. Then, it is strongly desirable to improve tumor radiosensitivity using molecules with synergistic action. The main aim of this study is to develop curcumin-loaded solid nanoparticles (Cur-SLN) in order to increase curcumin bioavailability and to evaluate their radiosensitizing ability in comparison to free curcumin (free-Cur), by using an in vitro approach on BC cell lines. In addition, transcriptomic and metabolomic profiles, induced by Cur-SLN treatments, highlighted networks involved in this radiosensitization ability. The non tumorigenic MCF10A and the tumorigenic MCF7 and MDA-MB-231 BC cell lines were used. Curcumin-loaded solid nanoparticles were prepared using ethanolic precipitation and the loading capacity was evaluated by UV spectrophotometer analysis. Cell survival after treatments was evaluated by clonogenic assay. Dose–response curves were generated testing three concentrations of free-Cur and Cur-SLN in combination with increasing doses of IR (2–9 Gy). IC₅₀ value and Dose Modifying Factor (DMF) was measured to quantify the sensitivity to curcumin and to combined treatments. A multi-“omic” approach was used to explain the Cur-SLN radiosensitizer effect by microarray and metobolomic analysis. We have shown the efficacy of the Cur-SLN formulation as radiosensitizer on three BC cell lines. The DMFs values, calculated at the isoeffect of SF = 50%, showed that the Luminal A MCF7 resulted sensitive to the combined treatments using increasing concentration of vehicled curcumin Cur-SLN (DMF: 1,78 with 10 µM Cur-SLN.) Instead, triple negative MDA-MB-231 cells were more sensitive to free-Cur, although these cells also receive a radiosensitization effect by combination with Cur-SLN (DMF: 1.38 with 10 µM Cur-SLN). The Cur-SLN radiosensitizing function, evaluated by transcriptomic and metabolomic approach, revealed anti-oxidant and anti-tumor effects. Curcumin loaded- SLN can be suggested in future preclinical and clinical studies to test its concomitant use during radiotherapy treatments with the double implications of being a radiosensitizing molecule against cancer cells, with a protective role against IR side effects.