High-throughput flow cytometry data normalization for clinical trials

Potential and challenges of clinical high-dimensional flow cytometry: A call to action

Clinical biomarker strategies increasingly integrate translational research to gain new insights into disease mechanisms or to define better biomarkers in clinical trials. High-dimensional flow cytometry (HDFCM) holds the promise to enhance the exploratory potential beyond traditional, targeted biomarker strategies. However, the increased complexity of HDFCM poses several challenges, which need to be addressed in order to fully leverage its potential and to align with current regulatory requirements in clinical flow cytometry. These challenges include among others extended timelines for assay development and validation, the necessity for extensive knowledge in HDFCM, and sophisticated data analysis strategies. However, no guidelines exist on how to manage such challenges in adopting clinical HDFCM. Our CYTO 2024 workshop "Potential and challenges of clinical high-dimensional flow cytometry" aimed to find consensus across the pharmaceutical industry and broader scientific community on the overall benefits and most urgent challenges of HDFCM in clinical trials. Here, we summarize the insights we gained from our workshop. While this report does not provide a blueprint, it is a first step in defining and summarizing the most pressing challenges in implementing HDFCM in clinical trials. Furthermore, we compile current efforts with the goal to overcome some of these challenges. As such we bring the scientific community and health authorities together to build solutions, which will accelerate and simplify the full adoption of HDFCM in clinical trials.

Comparison of three machine learning algorithms for classification of B-cell neoplasms using clinical flow cytometry data

Multiparameter flow cytometry data is visually inspected by expert personnel as part of standard clinical disease diagnosis practice. This is a demanding and costly process, and recent research has demonstrated that it is possible to utilize artificial intelligence (AI) algorithms to assist in the interpretive process. Here we report our examination of three previously published machine learning methods for classification of flow cytometry data and apply these to a B-cell neoplasm dataset to obtain predicted disease subtypes. Each of the examined methods classifies samples according to specific disease categories using ungated flow cytometry data. We compare and contrast the three algorithms with respect to their architectures, and we report the multiclass classification accuracies and relative required computation times. Despite different architectures, two of the methods, flowCat and EnsembleCNN, had similarly good accuracies with relatively fast computational times. We note a speed advantage for EnsembleCNN, particularly in the case of addition of training data and retraining of the classifier.

A flow-cytometry-based pipeline for the rapid quantification of C2C12 cell differentiation

The C2C12 cell line represents a simple in vitro model for cell differentiation. Here, we present a flow-cytometry-based pipeline to quantitate C2C12 cell differentiation based on myosin heavy-chain marker expression. We describe steps for cell seeding, transfection, drug treatment, differentiation, and labeling. We then detail procedures for flow cytometry acquisition and introduce the R script FlowFate for automated analysis, including the study of dose-dependent effects of GFP-tagged genes on differentiation. For complete details on the use and execution of this protocol, please refer to Chippalkatti et al. (2023).1.

Flow Cytometry: The Next Revolution

Unmasking the subtleties of the immune system requires both a comprehensive knowledge base and the ability to interrogate that system with intimate sensitivity. That task, to a considerable extent, has been handled by an iterative expansion in flow cytometry methods, both in technological capability and also in accompanying advances in informatics. As the field of fluorescence-based cytomics matured, it reached a technological barrier at around 30 parameter analyses, which stalled the field until spectral flow cytometry created a fundamental transformation that will likely lead to the potential of 100 simultaneous parameter analyses within a few years. The simultaneous advance in informatics has now become a watershed moment for the field as it competes with mature systematic approaches such as genomics and proteomics, allowing cytomics to take a seat at the multi-omics table. In addition, recent technological advances try to combine the speed of flow systems with other detection methods, in addition to fluorescence alone, which will make flow-based instruments even more indispensable in any biological laboratory. This paper outlines current approaches in cell analysis and detection methods, discusses traditional and microfluidic sorting approaches as well as next-generation instruments, and provides an early look at future opportunities that are likely to arise.

Multiparameter flow cytometry in the evaluation of myelodysplasia: Analytical issues: Recommendations from the European LeukemiaNet/International Myelodysplastic Syndrome Flow Cytometry Working Group

Multiparameter flow cytometry (MFC) is one of the essential ancillary methods in bone marrow (BM) investigation of patients with cytopenia and suspected myelodysplastic syndrome (MDS). MFC can also be applied in the follow-up of MDS patients undergoing treatment. This document summarizes recommendations from the International/European Leukemia Net Working Group for Flow Cytometry in Myelodysplastic Syndromes (ELN iMDS Flow) on the analytical issues in MFC for the diagnostic work-up of MDS. Recommendations for the analysis of several BM cell subsets such as myeloid precursors, maturing granulocytic and monocytic components and erythropoiesis are given. A core set of 17 markers identified as independently related to a cytomorphologic diagnosis of myelodysplasia is suggested as mandatory for MFC evaluation of BM in a patient with cytopenia. A myeloid precursor cell (CD34⁺ CD19^- ) count >3% should be considered immunophenotypically indicative of myelodysplasia. However, MFC results should always be evaluated as part of an integrated hematopathology work-up. Looking forward, several machine-learning-based analytical tools of interest should be applied in parallel to conventional analytical methods to investigate their usefulness in integrated diagnostics, risk stratification, and potentially even in the evaluation of response to therapy, based on MFC data. In addition, compiling large uniform datasets is desirable, as most of the machine-learning-based methods tend to perform better with larger numbers of investigated samples, especially in such a heterogeneous disease as MDS.

cyCombine allows for robust integration of single-cell cytometry datasets within and across technologies

Combining single-cell cytometry datasets increases the analytical flexibility and the statistical power of data analyses. However, in many cases the full potential of co-analyses is not reached due to technical variance between data from different experimental batches. Here, we present cyCombine, a method to robustly integrate cytometry data from different batches, experiments, or even different experimental techniques, such as CITE-seq, flow cytometry, and mass cytometry. We demonstrate that cyCombine maintains the biological variance and the structure of the data, while minimizing the technical variance between datasets. cyCombine does not require technical replicates across datasets, and computation time scales linearly with the number of cells, allowing for integration of massive datasets. Robust, accurate, and scalable integration of cytometry data enables integration of multiple datasets for primary data analyses and the validation of results using public datasets.

Analyzing high-dimensional cytometry data using FlowSOM

The dimensionality of cytometry data has strongly increased in the last decade, and in many situations the traditional manual downstream analysis becomes insufficient. The field is therefore slowly moving toward more automated approaches, and in this paper we describe the protocol for analyzing high-dimensional cytometry data using FlowSOM, a clustering and visualization algorithm based on a self-organizing map. FlowSOM is used to distinguish cell populations from cytometry data in an unsupervised way and can help to gain deeper insights in fields such as immunology and oncology. Since the original FlowSOM publication (2015), we have validated the tool on a wide variety of datasets, and to write this protocol, we made use of this experience to improve the user-friendliness of the package (e.g., comprehensive functions replacing commonly required scripts). Where the original paper focused mainly on the algorithm description, this protocol offers user guidelines on how to implement the procedure, detailed parameter descriptions and troubleshooting recommendations. The protocol provides clearly annotated R code, and is therefore relevant for all scientists interested in computational high-dimensional analyses without requiring a strong bioinformatics background. We demonstrate the complete workflow, starting from data preparation (such as compensation, transformation and quality control), including detailed discussion of the different FlowSOM parameters and visualization options, and concluding with how the results can be further used to answer biological questions, such as statistical comparison between groups of interest. An average FlowSOM analysis takes 1-3 h to complete, though quality issues can increase this time considerably.

CytoPy: An autonomous cytometry analysis framework

Cytometry analysis has seen a considerable expansion in recent years in the maximum number of parameters that can be acquired in a single experiment. In response to this technological advance there has been an increased effort to develop new computational methodologies for handling high-dimensional single cell data acquired by flow or mass cytometry. Despite the success of numerous algorithms and published packages to replicate and outperform traditional manual analysis, widespread adoption of these techniques has yet to be realised in the field of immunology. Here we present CytoPy, a Python framework for automated analysis of cytometry data that integrates a document-based database for a data-centric and iterative analytical environment. In addition, our algorithm-agnostic design provides a platform for open-source cytometry bioinformatics in the Python ecosystem. We demonstrate the ability of CytoPy to phenotype T cell subsets in whole blood samples even in the presence of significant batch effects due to technical and user variation. The complete analytical pipeline was then used to immunophenotype the local inflammatory infiltrate in individuals with and without acute bacterial infection. CytoPy is open-source and licensed under the MIT license. CytoPy is available at https://github.com/burtonrj/CytoPy, with notebooks accompanying this manuscript (https://github.com/burtonrj/CytoPyManuscript) and software documentation at https://cytopy.readthedocs.io/.

High Throughput Multi-Omics Approaches for Clinical Trial Evaluation and Drug Discovery

High throughput single cell multi-omics platforms, such as mass cytometry (cytometry by time-of-flight; CyTOF), high dimensional imaging (>6 marker; Hyperion, MIBIscope, CODEX, MACSima) and the recently evolved genomic cytometry (Citeseq or REAPseq) have enabled unprecedented insights into many biological and clinical questions, such as hematopoiesis, transplantation, cancer, and autoimmunity. In synergy with constantly adapting new single-cell analysis approaches and subsequent accumulating big data collections from these platforms, whole atlases of cell types and cellular and sub-cellular interaction networks are created. These atlases build an ideal scientific discovery environment for reference and data mining approaches, which often times reveals new cellular disease networks. In this review we will discuss how combinations and fusions of different -omic workflows on a single cell level can be used to examine cellular phenotypes, immune effector functions, and even dynamic changes, such as metabolomic state of different cells in a sample or even in a defined tissue location. We will touch on how pre-print platforms help in optimization and reproducibility of workflows, as well as community outreach. We will also shortly discuss how leveraging single cell multi-omic approaches can be used to accelerate cellular biomarker discovery during clinical trials to predict response to therapy, follow responsive cell types, and define novel druggable target pathways. Single cell proteome approaches already have changed how we explore cellular mechanism in disease and during therapy. Current challenges in the field are how we share these disruptive technologies to the scientific communities while still including new approaches, such as genomic cytometry and single cell metabolomics.

Alterations in B cell subsets correlate with body composition parameters in female adolescents with anorexia nervosa

Anorexia nervosa (AN) is a severe eating disorder and often associated with altered humoral immune responses. However, distinct B cell maturation stages in peripheral blood in adolescents with AN have not been characterized. Treatment effects and the relationship between clinical and B cell parameters are also not fully understood. Here we investigated the phenotype of circulating B cell subsets and the relationship with body composition in adolescents with AN before (T0, n = 24) and after 6 weeks (T1, n = 20) of treatment. Using multi-parameter flow cytometry, we found increased percentages of antigen-experienced B cells and plasmablasts in patients with AN compared to healthy controls (n = 20). In contrast, percentages of CD1d⁺CD5⁺ B cells and transitional B cells with immunoregulatory roles were reduced at T0 and T1. These B cell frequencies correlated positively with fat mass, fat mass index (FMI), free fat mass index, and body mass index standard deviation score. In addition, scavenger-like receptor CD5 expression levels were downregulated on transitional B cells and correlated with fat mass and FMI in AN. Our findings that regulatory B cell subgroups were reduced in AN and their strong relationship with body composition parameters point toward an impact of immunoregulatory B cells in the pathogenesis of AN.

A review on methods for diagnosis of breast cancer cells and tissues

Breast cancer has seriously been threatening physical and mental health of women in the world, and its morbidity and mortality also show clearly upward trend in China over time. Through inquiry, we find that survival rate of patients with early‐stage breast cancer is significantly higher than those with middle‐ and late‐stage breast cancer, hence, it is essential to conduct research to quickly diagnose breast cancer. Until now, many methods for diagnosing breast cancer have been developed, mainly based on imaging and molecular biotechnology examination. These methods have great contributions in screening and confirmation of breast cancer. In this review article, we introduce and elaborate the advances of these methods, and then conclude some gold standard diagnostic methods for certain breast cancer patients. We lastly discuss how to choose the most suitable diagnostic methods for breast cancer patients. In general, this article not only summarizes application and development of these diagnostic methods, but also provides the guidance for researchers who work on diagnosis of breast cancer.

SwiftReg cluster registration automatically reduces flow cytometry data variability including batch effects

Biological differences of interest in large, high-dimensional flow cytometry datasets are often obscured by undesired variations caused by differences in cytometers, reagents, or operators. Each variation type requires a different correction strategy, and their unknown contributions to overall variability hinder automated correction. We now describe swiftReg, an automated method that reduces undesired sources of variability between samples and particularly between batches. A high-resolution cluster map representing the multidimensional data is generated using the SWIFT algorithm, and shifts in cluster positions between samples are measured. Subpopulations are aligned between samples by displacing cell parameter values according to registration vectors derived from independent or locally-averaged cluster shifts. Batch variation is addressed by registering batch control or consensus samples, and applying the resulting shifts to individual samples. swiftReg selectively reduces batch variation, enhancing detection of biological differences. swiftReg outputs registered datasets as standard .FCS files to facilitate further analysis by other tools.

Rebhahn et al. develop swiftReg that automatically corrects undesired sources of variability of flow cytometry data. To identify batch variation, this method registers an internal standard or consensus sample from each batch and applies the resulting registration shifts to individual samples, reducing the batch variation while preserving biological differences.

Key steps and methods in the experimental design and data analysis of highly multi-parametric flow and mass cytometry

High-dimensional, single-cell cell technologies revolutionized the way to study biological systems, and polychromatic flow cytometry (FC) and mass cytometry (MC) are two of the drivers of this revolution. As up to 30-50 dimensions respectively can be measured per single-cell, they allow deep phenotyping combined with cellular functions studies, like cytokine production or protein phosphorylation. In parallel, the bioinformatics field develops algorithms that are able to process incoming data and extract the most useful and meaningful biological information. However, the success of automated analysis tools depends on the generation of high-quality data. In this review we present the most recent FC and MC computational approaches that are used to prepare, process and interpret high-content cytometry data. We also underscore proper experimental design as a key step for obtaining good quality data.

CytoNorm: A Normalization Algorithm for Cytometry Data

High‐dimensional flow cytometry has matured to a level that enables deep phenotyping of cellular systems at a clinical scale. The resulting high‐content data sets allow characterizing the human immune system at unprecedented single cell resolution. However, the results are highly dependent on sample preparation and measurements might drift over time. While various controls exist for assessment and improvement of data quality in a single sample, the challenges of cross‐sample normalization attempts have been limited to aligning marker distributions across subjects. These approaches, inspired by bulk genomics and proteomics assays, ignore the single‐cell nature of the data and risk the removal of biologically relevant signals. This work proposes CytoNorm, a normalization algorithm to ensure internal consistency between clinical samples based on shared controls across various study batches. Data from the shared controls is used to learn the appropriate transformations for each batch (e.g., each analysis day). Importantly, some sources of technical variation are strongly influenced by the amount of protein expressed on specific cell types, requiring several population‐specific transformations to normalize cells from a heterogeneous sample. To address this, our approach first identifies the overall cellular distribution using a clustering step, and calculates subset‐specific transformations on the control samples by computing their quantile distributions and aligning them with splines. These transformations are then applied to all other clinical samples in the batch to remove the batch‐specific variations. We evaluated the algorithm on a customized data set with two shared controls across batches. One control sample was used for calculation of the normalization transformations and the second control was used as a blinded test set and evaluated with Earth Mover's distance. Additional results are provided using two real‐world clinical data sets. Overall, our method compared favorably to standard normalization procedures. The algorithm is implemented in the R package “CytoNorm” and available via the following link: http://www.github.com/saeyslab/CytoNorm © 2019 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry.

Guidelines for the use of flow cytometry and cell sorting in immunological studies (second edition)

These guidelines are a consensus work of a considerable number of members of the immunology and flow cytometry community. They provide the theory and key practical aspects of flow cytometry enabling immunologists to avoid the common errors that often undermine immunological data. Notably, there are comprehensive sections of all major immune cell types with helpful Tables detailing phenotypes in murine and human cells. The latest flow cytometry techniques and applications are also described, featuring examples of the data that can be generated and, importantly, how the data can be analysed. Furthermore, there are sections detailing tips, tricks and pitfalls to avoid, all written and peer-reviewed by leading experts in the field, making this an essential research companion.

Supervised Machine Learning with CITRUS for Single Cell Biomarker Discovery

CITRUS is a supervised machine learning algorithm designed to analyze single cell data, identify cell populations, and identify changes in the frequencies or functional marker expression patterns of those populations that are significantly associated with an outcome. The algorithm is a black box that includes steps to cluster cell populations, characterize these populations, and identify the significant characteristics. This chapter describes how to optimize the use of CITRUS by combining it with upstream and downstream data analysis and visualization tools.

Data-Driven Flow Cytometry Analysis

The emergence of flow and mass cytometry technologies capable of generating 40-dimensional data has spurred research into automated methodologies that address bottlenecks across the entire analysis process from quality checking, data transformation, and cell population identification, to biomarker identification and visualizations. We review these approaches in the context of the stepwise progression through the different steps, including normalization, automated gating, outlier detection, and graphical presentation of results.

Immune Cell Profiling During Switching from Natalizumab to Fingolimod Reveals Differential Effects on Systemic Immune-Regulatory Networks and on Trafficking of Non-T Cell Populations into the Cerebrospinal Fluid-Results from the ToFingo Successor Study

Leukocyte sequestration is an established therapeutic concept in multiple sclerosis (MS) as represented by the trafficking drugs natalizumab (NAT) and fingolimod (FTY). However, the precise consequences of targeting immune cell trafficking for immunoregulatory network functions are only incompletely understood. In the present study, we performed an in-depth longitudinal characterization of functional and phenotypic immune signatures in peripheral blood (PB) and cerebrospinal fluid (CSF) of 15 MS patients during switching from long-term NAT to FTY treatment after a defined 8-week washout period within a clinical trial (ToFingo successor study; ClinicalTrials.gov: NCT02325440). Unbiased visualization and analysis of high-dimensional single cell flow-cytometry data revealed that switching resulted in a profound alteration of more than 80% of investigated innate and adaptive immune cell subpopulations in the PB, revealing an unexpectedly broad effect of trafficking drugs on peripheral immune signatures. Longitudinal CSF analysis demonstrated that NAT and FTY both reduced T cell subset counts and proportions in the CSF of MS patients with equal potency; NAT however was superior with regard to sequestering non-T cell populations out of the CSF, including B cells, natural killer cells and inflammatory monocytes, suggesting that disease exacerbation in the context of switching might be driven by non-T cell populations. Finally, correlation of our immunological data with signs of disease exacerbation in this small cohort suggested that both (i) CD49d expression levels under NAT at the time of treatment cessation and (ii) swiftness of FTY-mediated effects on immune cell subsets in the PB together may predict stability during switching later on.

flowVS: channel-specific variance stabilization in flow cytometry

Background

Comparing phenotypes of heterogeneous cell populations from multiple biological conditions is at the heart of scientific discovery based on flow cytometry (FC). When the biological signal is measured by the average expression of a biomarker, standard statistical methods require that variance be approximately stabilized in populations to be compared. Since the mean and variance of a cell population are often correlated in fluorescence-based FC measurements, a preprocessing step is needed to stabilize the within-population variances.

Results

We present a variance-stabilization algorithm, called flowVS, that removes the mean-variance correlations from cell populations identified in each fluorescence channel. flowVS transforms each channel from all samples of a data set by the inverse hyperbolic sine (asinh) transformation. For each channel, the parameters of the transformation are optimally selected by Bartlett’s likelihood-ratio test so that the populations attain homogeneous variances. The optimum parameters are then used to transform the corresponding channels in every sample. flowVS is therefore an explicit variance-stabilization method that stabilizes within-population variances in each channel by evaluating the homoskedasticity of clusters with a likelihood-ratio test.

With two publicly available datasets, we show that flowVS removes the mean-variance dependence from raw FC data and makes the within-population variance relatively homogeneous. We demonstrate that alternative transformation techniques such as flowTrans, flowScape, logicle, and FCSTrans might not stabilize variance. Besides flow cytometry, flowVS can also be applied to stabilize variance in microarray data. With a publicly available data set we demonstrate that flowVS performs as well as the VSN software, a state-of-the-art approach developed for microarrays.

Conclusions

The homogeneity of variance in cell populations across FC samples is desirable when extracting features uniformly and comparing cell populations with different levels of marker expressions. The newly developed flowVS algorithm solves the variance-stabilization problem in FC and microarrays by optimally transforming data with the help of Bartlett’s likelihood-ratio test. On two publicly available FC datasets, flowVS stabilizes within-population variances more evenly than the available transformation and normalization techniques. flowVS-based variance stabilization can help in performing comparison and alignment of phenotypically identical cell populations across different samples. flowVS and the datasets used in this paper are publicly available in Bioconductor.

Use of internal control T-cell populations in the flow cytometric evaluation for T-cell neoplasms

OBJECTIVES

Flow cytometry is an important tool for identification of neoplastic T-cells, but immunophenotypic abnormalities are often subtle and must be distinguished from nonneoplastic subsets. Use of internal control (IC) T-cells in the evaluation for T-cell neoplasms was explored, both as a quality measure and as a reference for evaluating abnormal antigen expression.

METHODS

All peripheral blood specimens (3-month period), or those containing abnormal T-cells (29-month period), stained with CD45 V500, CD2 V450, CD3 PE-Cy7, CD7 PE, CD4 Per-CP-Cy5.5, CD8 APC-H7, CD56 APC, CD16&57 FITC, were evaluated. IC T-cells were identified (DIVA, BD Biosciences) and median fluorescence intensity (MFI) recorded. Selected files were merged and reference templates generated (Infinicyt, Cytognos).

RESULTS

IC T-cells were present in all specimens, including those with abnormal T-cells, but subsets were less well-represented. IC T-cell CD3 MFI differed between instruments (p = 0.0007) and subsets (p < 0.001), but not specimen categories, and served as a longitudinal process control. Merged files highlighted small unusual IC-T subsets: CD2+(dim) (0.25% total), CD2- (0.03% total). An IC reference template highlighted neoplastic T-cells, but was limited by staining variability (IC CD3 MFI reference samples different from test (p = 0.003)).

CONCLUSIONS

IC T-cells present in the majority of specimens can serve as positive and longitudinal process controls. Use of IC T-cells as an internal reference is limited by variable representation of subsets. Analysis of merged IC T-cells from previously analyzed patient samples can alert the interpreter to less-well-recognized non-neoplastic subsets. However, application of a merged file IC reference template was limited by staining variability. © 2016 Clinical Cytometry Society.

flowClean: Automated identification and removal of fluorescence anomalies in flow cytometry data

Modern flow cytometry systems can be coupled to plate readers for high-throughput acquisition. These systems allow hundreds of samples to be analyzed in a single day. Quality control of the data remains challenging, however, and is further complicated when a large number of parameters is measured in an experiment. Our examination of 29,228 publicly available FCS files from laboratories worldwide indicates 13.7% have a fluorescence anomaly. In particular, fluorescence measurements for a sample over the collection time may not remain stable due to fluctuations in fluid dynamics; the impact of instabilities may differ between samples and among parameters. Therefore, we hypothesized that tracking cell populations (which represent a summary of all parameters) in centered log ratio space would provide a sensitive and consistent method of quality control. Here, we present flowClean, an algorithm to track subset frequency changes within a sample during acquisition, and flag time periods with fluorescence perturbations leading to the emergence of false populations. Aberrant time periods are reported as a new parameter and added to a revised data file, allowing users to easily review and exclude those events from further analysis. We apply this method to proof-of-concept datasets and also to a subset of data from a recent vaccine trial. The algorithm flags events that are suspicious by visual inspection, as well as those showing more subtle effects that might not be consistently flagged by investigators reviewing the data manually, and out-performs the current state-of-the-art. flowClean is available as an R package on Bioconductor, as a module on the free-to-use GenePattern web server, and as a plugin for FlowJo X. © 2016 International Society for Advancement of Cytometry.

Standardizing Flow Cytometry Immunophenotyping Analysis from the Human ImmunoPhenotyping Consortium

Standardization of immunophenotyping requires careful attention to reagents, sample handling, instrument setup, and data analysis, and is essential for successful cross-study and cross-center comparison of data. Experts developed five standardized, eight-color panels for identification of major immune cell subsets in peripheral blood. These were produced as pre-configured, lyophilized, reagents in 96-well plates. We present the results of a coordinated analysis of samples across nine laboratories using these panels with standardized operating procedures (SOPs). Manual gating was performed by each site and by a central site. Automated gating algorithms were developed and tested by the FlowCAP consortium. Centralized manual gating can reduce cross-center variability, and we sought to determine whether automated methods could streamline and standardize the analysis. Within-site variability was low in all experiments, but cross-site variability was lower when central analysis was performed in comparison with site-specific analysis. It was also lower for clearly defined cell subsets than those based on dim markers and for rare populations. Automated gating was able to match the performance of central manual analysis for all tested panels, exhibiting little to no bias and comparable variability. Standardized staining, data collection, and automated gating can increase power, reduce variability, and streamline analysis for immunophenotyping.

Promises and Pitfalls of High-Throughput Biological Assays

This chapter discusses some of the pitfalls encountered when performing biomedical research involving high-throughput "omics" data and presents some strategies and guidelines that researchers should follow when undertaking such studies. We discuss common errors in experimental design and data analysis that lead to irreproducible and non-replicable research and provide some guidelines to avoid these common mistakes so that researchers may have confidence in study outcomes, even if the results are negative. We discuss the importance of ranking and prespecifying hypotheses, performing power analysis, careful experimental design, and preplanning of statistical analyses in order to avoid the "fishing expedition" data analysis strategy, which is doomed to fail. The impact of multiple testing on false-positive rates is discussed, particularly in the context of the analysis of high-throughput data, and methods to correct for it are presented, as well as approaches to detect and correct for experimental biases and batch effects, which often plague high-throughput assays. We highlight the importance of sharing data and analysis code to facilitate reproducibility and present tools and software that are appropriate for this purpose.

Analysis of cell-mediated immune responses in support of dengue vaccine development efforts

Dengue vaccine development has made significant strides, but a better understanding of how vaccine-induced immune responses correlate with vaccine efficacy can greatly accelerate development, testing, and deployment as well as ameliorate potential risks and safety concerns. Advances in basic immunology knowledge and techniques have already improved our understanding of cell-mediated immunity of natural dengue virus infection and vaccination. We conclude that the evidence base is adequate to argue for inclusion of assessments of cell-mediated immunity as part of clinical trials of dengue vaccines, although further research to identify useful correlates of protective immunity is needed.

Receptor occupancy assessment by flow cytometry as a pharmacodynamic biomarker in biopharmaceutical development

Receptor occupancy (RO) assays are designed to quantify the binding of therapeutics to their targets on the cell surface and are frequently used to generate pharmacodynamic (PD) biomarker data in nonclinical and clinical studies of biopharmaceuticals. When combined with the pharmacokinetic (PK) profile, RO data can establish PKPD relationships, which are crucial for informing dose decisions. RO is commonly measured by flow cytometry on fresh blood specimens and is subject to numerous technical and logistical challenges. To ensure that reliable and high quality results are generated from RO assays, careful assay design, key reagent characterization, data normalization/reporting, and thorough planning for implementation are of critical importance during development. In this article, the authors share their experiences and perspectives in these areas and discuss challenges and potential solutions when developing and implementing a flow cytometry‐based RO method in support of biopharmaceutical drug development. © 2015 The Authors Cytometry Part B: Clinical Cytometry Published by Wiley Periodicals, Inc.

AUTOMATED GATING OF PORTABLE CYTOMETER DATA BASED ON SKEW t MIXTURE MODELS

A major component of flow cytometry (FCM) data analysis involves gating, which is the process of identifying homogeneous groups of cells. With the rapid development of the portable flow cytometer, manual gating techniques have been unable to meet the demand for accurate and rapid analysis of samples. To provide a practical application for portable devices, we propose a flexible, statistical model-based clustering approach for identifying cell populations in FCM data. This approach, which mimics the manual gating process, employs a finite mixture model with a density function of skew t distribution and estimates parameters via an expectation maximization algorithm. Data analysis from an experiment on a patient’s peripheral blood samples have proven that the proposed methodology yields better results in terms of robustness against outliers than current state-of-the-art automated gating methods, has more flexibility in clustering symmetric data and leads to lower misclassification rates (misclassification rates of skew t method is 0.06442) when handling highly asymmetric data. The method we proposed will improve data analysis of portable flow cytometers, especially when the users have no professional training.

immunoClust--An automated analysis pipeline for the identification of immunophenotypic signatures in high-dimensional cytometric datasets

Multiparametric fluorescence and mass cytometry offers new perspectives to disclose and to monitor the high diversity of cell populations in the peripheral blood for biomarker research. While high-end cytometric devices are currently available to detect theoretically up to 120 individual parameters at the single cell level, software tools are needed to analyze these complex datasets automatically in acceptable time and without operator bias or knowledge. We developed an automated analysis pipeline, immunoClust, for uncompensated fluorescence and mass cytometry data, which consists of two parts. First, cell events of each sample are grouped into individual clusters. Subsequently, a classification algorithm assorts these cell event clusters into populations comparable between different samples. The clustering of cell events is designed for datasets with large event counts in high dimensions as a global unsupervised method, sensitive to identify rare cell types even when next to large populations. Both parts use model-based clustering with an iterative expectation maximization algorithm and the integrated classification likelihood to obtain the clusters. A detailed description of both algorithms is presented. Testing and validation was performed using 1) blood cell samples of defined composition that were depleted of particular cell subsets by magnetic cell sorting, 2) datasets of the FlowCAP III challenges to identify populations of rare cell types and 3) high-dimensional fluorescence and mass-cytometry datasets for comparison with conventional manual gating procedures. In conclusion, the immunoClust-algorithm is a promising tool to standardize and automate the analysis of high-dimensional cytometric datasets. As a prerequisite for interpretation of such data, it will support our efforts in developing immunological biomarkers for chronic inflammatory disorders and therapy recommendations in personalized medicine. immunoClust is implemented as an R-package and is provided as source code from www.bioconductor.org.

Polychromatic flow cytometry in evaluating rheumatic disease patients

B cells are central players in multiple autoimmune rheumatic diseases as a result of the imbalance between pathogenic and protective B-cell functions, which are presumably mediated by distinct populations. Yet the functional role of different B-cell populations and the contribution of specific subsets to disease pathogenesis remain to be fully understood owing to a large extent to the use of pauci-color flow cytometry. Despite its limitations, this approach has been instrumental in providing a global picture of multiple B-cell abnormalities in multiple human rheumatic diseases, more prominently systemic lupus erythematosus, rheumatoid arthritis and Sjogren’s syndrome. Accordingly, these studies represent the focus of this review. In addition, we also discuss the added value of tapping into the potential of polychromatic flow cytometry to unravel a higher level of B-cell heterogeneity, provide a more nuanced view of B-cell abnormalities in disease and create the foundation for a precise understanding of functional division of labor among the different phenotypic subsets. State-of-the-art polychromatic flow cytometry and novel multidimensional analytical approaches hold tremendous promise for our understanding of disease pathogenesis, the generation of disease biomarkers, patient stratification and personalized therapeutic approaches.

OpenCyto: an open source infrastructure for scalable, robust, reproducible, and automated, end-to-end flow cytometry data analysis

Flow cytometry is used increasingly in clinical research for cancer, immunology and vaccines. Technological advances in cytometry instrumentation are increasing the size and dimensionality of data sets, posing a challenge for traditional data management and analysis. Automated analysis methods, despite a general consensus of their importance to the future of the field, have been slow to gain widespread adoption. Here we present OpenCyto, a new BioConductor infrastructure and data analysis framework designed to lower the barrier of entry to automated flow data analysis algorithms by addressing key areas that we believe have held back wider adoption of automated approaches. OpenCyto supports end-to-end data analysis that is robust and reproducible while generating results that are easy to interpret. We have improved the existing, widely used core BioConductor flow cytometry infrastructure by allowing analysis to scale in a memory efficient manner to the large flow data sets that arise in clinical trials, and integrating domain-specific knowledge as part of the pipeline through the hierarchical relationships among cell populations. Pipelines are defined through a text-based csv file, limiting the need to write data-specific code, and are data agnostic to simplify repetitive analysis for core facilities. We demonstrate how to analyze two large cytometry data sets: an intracellular cytokine staining (ICS) data set from a published HIV vaccine trial focused on detecting rare, antigen-specific T-cell populations, where we identify a new subset of CD8 T-cells with a vaccine-regimen specific response that could not be identified through manual analysis, and a CyTOF T-cell phenotyping data set where a large staining panel and many cell populations are a challenge for traditional analysis. The substantial improvements to the core BioConductor flow cytometry packages give OpenCyto the potential for wide adoption. It can rapidly leverage new developments in computational cytometry and facilitate reproducible analysis in a unified environment.