Thinking outside the gate: single-cell assessments in multiple dimensions

Guidelines for the use of flow cytometry and cell sorting in immunological studies (third edition)

The third edition of Flow Cytometry Guidelines provides the key aspects to consider when performing flow cytometry experiments and includes comprehensive sections describing phenotypes and functional assays of all major human and murine immune cell subsets. Notably, the Guidelines contain helpful tables highlighting phenotypes and key differences between human and murine cells. Another useful feature of this edition is the flow cytometry analysis of clinical samples with examples of flow cytometry applications in the context of autoimmune diseases, cancers as well as acute and chronic infectious diseases. Furthermore, there are sections detailing tips, tricks and pitfalls to avoid. All sections are written and peer-reviewed by leading flow cytometry experts and immunologists, making this edition an essential and state-of-the-art handbook for basic and clinical researchers.

Development of an objective index, neural activity score (NAS), reveals neural network ontogeny and treatment effects on microelectrode arrays

Microelectrode arrays (MEAs) are valuable tools for electrophysiological analysis, providing assessment of neural network health and development. Analysis can be complex, however, requiring intensive processing of large data sets consisting of many activity parameters, leading to information loss as studies subjectively report relatively few metrics in the interest of simplicity. In screening assays, many groups report simple overall activity (i.e. firing rate) but omit network connectivity changes (e.g. burst characteristics and synchrony) that may not be evident from basic parameters. Our goal was to develop an objective process to capture most of the valuable information gained from MEAs in neural development and toxicity studies. We implemented principal component analysis (PCA) to reduce the high dimensionality of MEA data. Upon analysis, we found the first principal component was strongly correlated to time, representing neural culture development; therefore, factor loadings were used to create a single index score-named neural activity score (NAS)-reflecting neural maturation. For validation, we applied NAS to studies analyzing various treatments. In all cases, NAS accurately recapitulated expected results, suggesting viability of NAS to measure network health and development. This approach may be adopted by other researchers using MEAs to analyze complicated treatment effects and multicellular interactions.

Single-cell peripheral immunoprofiling of Alzheimer's and Parkinson's diseases

Peripheral blood mononuclear cells (PBMCs) may provide insight into the pathogenesis of Alzheimer's disease (AD) or Parkinson's disease (PD). We investigated PBMC samples from 132 well-characterized research participants using seven canonical immune stimulants, mass cytometric identification of 35 PBMC subsets, and single-cell quantification of 15 intracellular signaling markers, followed by machine learning model development to increase predictive power. From these, three main intracellular signaling pathways were identified specifically in PBMC subsets from people with AD versus controls: reduced activation of PLCγ2 across many cell types and stimulations and selectively variable activation of STAT1 and STAT5, depending on stimulant and cell type. Our findings functionally buttress the now multiply-validated observation that a rare coding variant in PLCG2 is associated with a decreased risk of AD. Together, these data suggest enhanced PLCγ2 activity as a potential new therapeutic target for AD with a readily accessible pharmacodynamic biomarker.

A Cancer Biologist's Primer on Machine Learning Applications in High-Dimensional Cytometry

The application of machine learning and artificial intelligence to high-dimensional cytometry data sets has increasingly become a staple of bioinformatic data analysis over the past decade. This is especially true in the field of cancer biology, where protocols for collecting multiparameter single-cell data in a high-throughput fashion are rapidly developed. As the use of machine learning methodology in cytometry becomes increasingly common, there is a need for cancer biologists to understand the basic theory and applications of a variety of algorithmic tools for analyzing and interpreting cytometry data. We introduce the reader to several keystone machine learning-based analytic approaches with an emphasis on defining key terms and introducing a conceptual framework for making translational or clinically relevant discoveries. The target audience consists of cancer cell biologists and physician-scientists interested in applying these tools to their own data, but who may have limited training in bioinformatics. © 2020 International Society for Advancement of Cytometry.

Identification of a super-functional Tfh-like subpopulation in murine lupus by pattern perception

Dysregulated cytokine expression by T cells plays a pivotal role in the pathogenesis of autoimmune diseases. However, the identification of the corresponding pathogenic subpopulations is a challenge, since a distinction between physiological variation and a new quality in the expression of protein markers requires combinatorial evaluation. Here, we were able to identify a super-functional follicular helper T cell (Tfh)-like subpopulation in lupus-prone NZBxW mice with our binning approach "pattern recognition of immune cells (PRI)". PRI uncovered a subpopulation of IL-21⁺ IFN-γ^high PD-1^low CD40L^high CXCR5^- Bcl-6^- T cells specifically expanded in diseased mice. In addition, these cells express high levels of TNF-α and IL-2, and provide B cell help for IgG production in an IL-21 and CD40L dependent manner. This super-functional T cell subset might be a superior driver of autoimmune processes due to a polyfunctional and high cytokine expression combined with Tfh-like properties.

From Bivariate to Multivariate Analysis of Cytometric Data: Overview of Computational Methods and Their Application in Vaccination Studies

Flow and mass cytometry are used to quantify the expression of multiple extracellular or intracellular molecules on single cells, allowing the phenotypic and functional characterization of complex cell populations. Multiparametric flow cytometry is particularly suitable for deep analysis of immune responses after vaccination, as it allows to measure the frequency, the phenotype, and the functional features of antigen-specific cells. When many parameters are investigated simultaneously, it is not feasible to analyze all the possible bi-dimensional combinations of marker expression with classical manual analysis and the adoption of advanced automated tools to process and analyze high-dimensional data sets becomes necessary. In recent years, the development of many tools for the automated analysis of multiparametric cytometry data has been reported, with an increasing record of publications starting from 2014. However, the use of these tools has been preferentially restricted to bioinformaticians, while few of them are routinely employed by the biomedical community. Filling the gap between algorithms developers and final users is fundamental for exploiting the advantages of computational tools in the analysis of cytometry data. The potentialities of automated analyses range from the improvement of the data quality in the pre-processing steps up to the unbiased, data-driven examination of complex datasets using a variety of algorithms based on different approaches. In this review, an overview of the automated analysis pipeline is provided, spanning from the pre-processing phase to the automated population analysis. Analysis based on computational tools might overcame both the subjectivity of manual gating and the operator-biased exploration of expected populations. Examples of applications of automated tools that have successfully improved the characterization of different cell populations in vaccination studies are also presented.

Computational Analysis of Multiparametric Flow Cytometric Data to Dissect B Cell Subsets in Vaccine Studies

The generation of the B cell response upon vaccination is characterized by the induction of different functional and phenotypic subpopulations and is strongly dependent on the vaccine formulation, including the adjuvant used. Here, we have profiled the different B cell subsets elicited upon vaccination, using machine learning methods for interpreting high‐dimensional flow cytometry data sets. The B cell response elicited by an adjuvanted vaccine formulation, compared to the antigen alone, was characterized using two automated methods based on clustering (FlowSOM) and dimensional reduction (t‐SNE) approaches. The clustering method identified, based on multiple marker expression, different B cell populations, including plasmablasts, plasma cells, germinal center B cells and their subsets, while this profiling was more difficult with t‐SNE analysis. When undefined phenotypes were detected, their characterization could be improved by integrating the t‐SNE spatial visualization of cells with the FlowSOM clusters. The frequency of some cellular subsets, in particular plasma cells, was significantly higher in lymph nodes of mice primed with the adjuvanted formulation compared to antigen alone. Thanks to this automatic data analysis it was possible to identify, in an unbiased way, different B cell populations and also intermediate stages of cell differentiation elicited by immunization, thus providing a signature of B cell recall response that can be hardly obtained with the classical bidimensional gating analysis. © 2019 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry.

CytoML for cross-platform cytometry data sharing

CytoML is an R/Bioconductor package that enables cross‐platform import, export, and sharing of gated cytometry data. It currently supports Cytobank, FlowJo, Diva, and R, allowing users to import gated cytometry data from commercial platforms into R. Once data are available in R, the data can be further manipulated. For example it can be combined with other computational and analytic approaches, and the results can be exported to FlowJo or Cytobank to be explored by researchers using those platforms. We demonstrate how CytoML and related R packages can be used as a tool to import, modify and export several samples stained with the T cell panel from the FlowCAP IV Lyoplate data set. Once imported, the gating is modified using computational approaches, and exported for visualization in Cytobank and FlowJo. We further show how CytoML can be used to import gated data from a publicly accessible mass cytometry experiment from Cytobank. CytoML is the only tool that allows such sharing of gated cytometry data between researchers working across different platforms, and it will serve as a useful tool for validating and verifying the reproducibility of analyses. © 2018 The Authors. Cytometry Part A published by Wiley Periodicals, Inc. on behalf of International Society for Advancement of Cytometry.

Guidelines for the use of flow cytometry and cell sorting in immunological studies (second edition)

These guidelines are a consensus work of a considerable number of members of the immunology and flow cytometry community. They provide the theory and key practical aspects of flow cytometry enabling immunologists to avoid the common errors that often undermine immunological data. Notably, there are comprehensive sections of all major immune cell types with helpful Tables detailing phenotypes in murine and human cells. The latest flow cytometry techniques and applications are also described, featuring examples of the data that can be generated and, importantly, how the data can be analysed. Furthermore, there are sections detailing tips, tricks and pitfalls to avoid, all written and peer-reviewed by leading experts in the field, making this an essential research companion.

A Computational Pipeline for the Diagnosis of CVID Patients

Common variable immunodeficiency (CVID) is one of the most frequently diagnosed primary antibody deficiencies (PADs), a group of disorders characterized by a decrease in one or more immunoglobulin (sub)classes and/or impaired antibody responses caused by inborn defects in B cells in the absence of other major immune defects. CVID patients suffer from recurrent infections and disease-related, non-infectious, complications such as autoimmune manifestations, lymphoproliferation, and malignancies. A timely diagnosis is essential for optimal follow-up and treatment. However, CVID is by definition a diagnosis of exclusion, thereby covering a heterogeneous patient population and making it difficult to establish a definite diagnosis. To aid the diagnosis of CVID patients, and distinguish them from other PADs, we developed an automated machine learning pipeline which performs automated diagnosis based on flow cytometric immunophenotyping. Using this pipeline, we analyzed the immunophenotypic profile in a pediatric and adult cohort of 28 patients with CVID, 23 patients with idiopathic primary hypogammaglobulinemia, 21 patients with IgG subclass deficiency, six patients with isolated IgA deficiency, one patient with isolated IgM deficiency, and 100 unrelated healthy controls. Flow cytometry analysis is traditionally done by manual identification of the cell populations of interest. Yet, this approach has severe limitations including subjectivity of the manual gating and bias toward known populations. To overcome these limitations, we here propose an automated computational flow cytometry pipeline that successfully distinguishes CVID phenotypes from other PADs and healthy controls. Compared to the traditional, manual analysis, our pipeline is fully automated, performing automated quality control and data pre-processing, automated population identification (gating) and deriving features from these populations to build a machine learning classifier to distinguish CVID from other PADs and healthy controls. This results in a more reproducible flow cytometry analysis, and improves the diagnosis compared to manual analysis: our pipelines achieve on average a balanced accuracy score of 0.93 (±0.07), whereas using the manually extracted populations, an averaged balanced accuracy score of 0.72 (±0.23) is achieved.

flowLearn: fast and precise identification and quality checking of cell populations in flow cytometry

Motivation

Identification of cell populations in flow cytometry is a critical part of the analysis and lays the groundwork for many applications and research discovery. The current paradigm of manual analysis is time consuming and subjective. A common goal of users is to replace manual analysis with automated methods that replicate their results. Supervised tools provide the best performance in such a use case, however they require fine parameterization to obtain the best results. Hence, there is a strong need for methods that are fast to setup, accurate and interpretable.

Results

flowLearn is a semi-supervised approach for the quality-checked identification of cell populations. Using a very small number of manually gated samples, through density alignments it is able to predict gates on other samples with high accuracy and speed. On two state-of-the-art datasets, our tool achieves median(F1)-measures exceeding 0.99 for 31%, and 0.90 for 80% of all analyzed populations. Furthermore, users can directly interpret and adjust automated gates on new sample files to iteratively improve the initial training.

Availability and implementation

FlowLearn is available as an R package on https://github.com/mlux86/flowLearn. Evaluation data is publicly available online. Details can be found in the Supplementary Material.

Supplementary information

Supplementary data are available at Bioinformatics online.

Evaluation of inflammatory skin infiltrate following Aedes aegypti bites in sensitized and non-sensitized mice reveals saliva-dependent and immune-dependent phenotypes

During probing and blood feeding, haematophagous mosquitoes inoculate a mixture of salivary molecules into their vertebrate hosts' skin. In addition to the anti-haemostatic and immunomodulatory activities, mosquito saliva also triggers acute inflammatory reactions, especially in sensitized hosts. Here, we characterize the oedema and the cellular infiltrate following Aedes aegypti mosquito bites in the skin of sensitized and non-sensitized BALB/c mice by flow cytometry. Ae. aegypti bites induced an increased oedema in the ears of both non-sensitized and salivary gland extract- (SGE-)sensitized mice, peaking at 6 hr and 24 hr after exposure, respectively. The quantification of the total cell number in the ears revealed that the cellular recruitment was more robust in SGE-sensitized mice than in non-sensitized mice, and the histological evaluation confirmed these findings. The immunophenotyping performed by flow cytometry revealed that mosquito bites were able to produce complex changes in cell populations present in the ears of non-sensitized and SGE-sensitized mice. When compared with steady-state ears, the leucocyte populations significantly recruited to the skin after mosquito bites in non-sensitized and sensitized mice were eosinophils, neutrophils, monocytes, inflammatory monocytes, mast cells, B-cells and CD4⁺ T-cells, each one with its specific kinetics. The changes in the absolute number of cells suggested two cell recruitment profiles: (i) a saliva-dependent migration; and (ii) a migration dependent on the immune status of the host. These findings suggest that mosquito bites influence the skin microenvironment by inducing differential cell migration, which is dependent on the degree of host sensitization to salivary molecules.

High-Parameter Single-Cell Analysis

Thousands of transcripts and proteins confer function and discriminate cell types in the body. Using high-parameter technologies, we can now measure many of these markers at once, and multiple platforms are now capable of analysis on a cell-by-cell basis. Three high-parameter single-cell technologies have particular potential for discovering new biomarkers, revealing disease mechanisms, and increasing our fundamental understanding of cell biology. We review these three platforms (high-parameter flow cytometry, mass cytometry, and a new class of technologies called integrated molecular cytometry platforms) in this article. We describe the underlying hardware and instrumentation, the reagents involved, and the limitations and advantages of each platform. We also highlight the emerging field of high-parameter single-cell data analysis, providing an accessible overview of the data analysis process and choice of tools.

High-Dimensional Immunophenotyping with Fluorescence-Based Cytometry: A Practical Guidebook

Recent technological advances have greatly diversified the platforms that are available for high-dimensional single-cell immunophenotyping, including mass cytometry, single-cell RNA sequencing, and fluorescent-based flow cytometry. The latter is currently the most commonly used approach, and modern instrumentation allows for the measurement of up to 30 parameters, revealing deep insights into the complexity of the immune system.Here, we provide a practical guidebook for the successful design and execution of complex fluorescence-based immunophenotyping panels. We address common misconceptions and caveats, and also discuss challenges that are associated with the quality control and analysis of these data sets.

Supervised Machine Learning with CITRUS for Single Cell Biomarker Discovery

CITRUS is a supervised machine learning algorithm designed to analyze single cell data, identify cell populations, and identify changes in the frequencies or functional marker expression patterns of those populations that are significantly associated with an outcome. The algorithm is a black box that includes steps to cluster cell populations, characterize these populations, and identify the significant characteristics. This chapter describes how to optimize the use of CITRUS by combining it with upstream and downstream data analysis and visualization tools.

Data-Driven Flow Cytometry Analysis

The emergence of flow and mass cytometry technologies capable of generating 40-dimensional data has spurred research into automated methodologies that address bottlenecks across the entire analysis process from quality checking, data transformation, and cell population identification, to biomarker identification and visualizations. We review these approaches in the context of the stepwise progression through the different steps, including normalization, automated gating, outlier detection, and graphical presentation of results.

A standardized immune phenotyping and automated data analysis platform for multicenter biomarker studies

The analysis and validation of flow cytometry-based biomarkers in clinical studies are limited by the lack of standardized protocols that are reproducible across multiple centers and suitable for use with either unfractionated blood or cryopreserved PBMCs. Here we report the development of a platform that standardizes a set of flow cytometry panels across multiple centers, with high reproducibility in blood or PBMCs from either healthy subjects or patients 100 days after hematopoietic stem cell transplantation. Inter-center comparisons of replicate samples showed low variation, with interindividual variation exceeding inter-center variation for most populations (coefficients of variability <20% and interclass correlation coefficients >0.75). Exceptions included low-abundance populations defined by markers with indistinct expression boundaries (e.g., plasmablasts, monocyte subsets) or populations defined by markers sensitive to cryopreservation, such as CD62L and CD45RA. Automated gating pipelines were developed and validated on an independent data set, revealing high Spearman's correlations (rs >0.9) with manual analyses. This workflow, which includes pre-formatted antibody cocktails, standardized protocols for acquisition, and validated automated analysis pipelines, can be readily implemented in multicenter clinical trials. This approach facilitates the collection of robust immune phenotyping data and comparison of data from independent studies.

CytoBinning: Immunological insights from multi-dimensional data

New cytometric techniques continue to push the boundaries of multi-parameter quantitative data acquisition at the single-cell level particularly in immunology and medicine. Sophisticated analysis methods for such ever higher dimensional datasets are rapidly emerging, with advanced data representations and dimensional reduction approaches. However, these are not yet standardized and clinical scientists and cell biologists are not yet experienced in their interpretation. More fundamentally their range of statistical validity is not yet fully established. We therefore propose a new method for the automated and unbiased analysis of high-dimensional single cell datasets that is simple and robust, with the goal of reducing this complex information into a familiar 2D scatter plot representation that is of immediate utility to a range of biomedical and clinical settings. Using publicly available flow cytometry and mass cytometry datasets we demonstrate that this method (termed CytoBinning), recapitulates the results of traditional manual cytometric analyses and leads to new and testable hypotheses.

Clinically validated machine learning algorithm for detecting residual diseases with multicolor flow cytometry analysis in acute myeloid leukemia and myelodysplastic syndrome

Background

Multicolor flow cytometry (MFC) analysis is widely used to identify minimal residual disease (MRD) after treatment for acute myeloid leukemia (AML) and myelodysplastic syndrome (MDS). However, current manual interpretation suffers from drawbacks of time consuming and interpreter idiosyncrasy. Artificial intelligence (AI), with the expertise in assisting repetitive or complex analysis, represents a potential solution for these drawbacks.

Methods

From 2009 to 2016, 5333 MFC data from 1742 AML or MDS patients were collected. The 287 MFC data at post-induction were selected as the outcome set for clinical outcome validation. The rest were 4:1 randomized into the training set (n = 4039) and the validation set (n = 1007). AI algorithm learned a multi-dimensional MFC phenotype from the training set and input it to support vector machine (SVM) classifier after Gaussian mixture model (GMM) modeling, and the performance was evaluated in The validation set.

Findings

Promising accuracies (84·6% to 92·4%) and AUCs (0·921–0·950) were achieved by the developed algorithms. Interestingly, the algorithm from even one testing tube achieved similar performance. The clinical significance was validated in the outcome set, and normal MFC interpreted by the AI predicted better progression-free survival (10·9 vs 4·9 months, p < 0·0001) and overall survival (13·6 vs 6·5 months, p < 0·0001) for AML.

Interpretation

Through large-scaled clinical validation, we showed that AI algorithms can produce efficient and clinically-relevant MFC analysis. This approach also possesses a great advantage of the ability to integrate other clinical tests.

Fund

This work was supported by the Ministry of Science and Technology (107-2634-F-007-006 and 103–2314-B-002-185-MY2) of Taiwan.

Automatically generate two-dimensional gating hierarchy from clustered cytometry data

Cytometry is an important technique widely used in medicine and biological research. Biologists traditionally analyze single-cell cytometry data by manual gating, which can be subjective and labor intensive. To address this issue, many automated and semiautomated methods have been developed. These advanced methods are designed to speed up and standardize the analysis of cytometry data, but their popularity is limited by their visualizations which are not intuitive to biologists who are accustomed to the conventional biaxial gating plots. In this article, we present a new method called Cluster-to-Gate (C2G) that can take clustering results as input, and automatically generate a nested two-dimensional gating hierarchy, which is a visualization representation that biologists are familiar with. This method can generate gating sequences for multiple target populations simultaneously and summarize them in one hierarchical tree that represents the gating hierarchy. We have tested this method on target populations defined by manual gating, automated clustering algorithms (k-means for example), and visualization-assisted methods (SPADE and tSNE). We have demonstrated that C2G is able to generate gating sequences that capture cell populations defined by the various clustering strategies, and robust to over-clustered and overlapping target populations. © 2018 International Society for Advancement of Cytometry.

DAFi: A directed recursive data filtering and clustering approach for improving and interpreting data clustering identification of cell populations from polychromatic flow cytometry data

Computational methods for identification of cell populations from polychromatic flow cytometry data are changing the paradigm of cytometry bioinformatics. Data clustering is the most common computational approach to unsupervised identification of cell populations from multidimensional cytometry data. However, interpretation of the identified data clusters is labor-intensive. Certain types of user-defined cell populations are also difficult to identify by fully automated data clustering analysis. Both are roadblocks before a cytometry lab can adopt the data clustering approach for cell population identification in routine use. We found that combining recursive data filtering and clustering with constraints converted from the user manual gating strategy can effectively address these two issues. We named this new approach DAFi: Directed Automated Filtering and Identification of cell populations. Design of DAFi preserves the data-driven characteristics of unsupervised clustering for identifying novel cell subsets, but also makes the results interpretable to experimental scientists through mapping and merging the multidimensional data clusters into the user-defined two-dimensional gating hierarchy. The recursive data filtering process in DAFi helped identify small data clusters which are otherwise difficult to resolve by a single run of the data clustering method due to the statistical interference of the irrelevant major clusters. Our experiment results showed that the proportions of the cell populations identified by DAFi, while being consistent with those by expert centralized manual gating, have smaller technical variances across samples than those from individual manual gating analysis and the nonrecursive data clustering analysis. Compared with manual gating segregation, DAFi-identified cell populations avoided the abrupt cut-offs on the boundaries. DAFi has been implemented to be used with multiple data clustering methods including K-means, FLOCK, FlowSOM, and the ClusterR package. For cell population identification, DAFi supports multiple options including clustering, bisecting, slope-based gating, and reversed filtering to meet various autogating needs from different scientific use cases. © 2018 International Society for Advancement of Cytometry.

ImmPort, toward repurposing of open access immunological assay data for translational and clinical research

Immunology researchers are beginning to explore the possibilities of reproducibility, reuse and secondary analyses of immunology data. Open-access datasets are being applied in the validation of the methods used in the original studies, leveraging studies for meta-analysis, or generating new hypotheses. To promote these goals, the ImmPort data repository was created for the broader research community to explore the wide spectrum of clinical and basic research data and associated findings. The ImmPort ecosystem consists of four components–Private Data, Shared Data, Data Analysis, and Resources—for data archiving, dissemination, analyses, and reuse. To date, more than 300 studies have been made freely available through the Shared Data portal (www.immport.org/immport-open), which allows research data to be repurposed to accelerate the translation of new insights into discoveries.

High throughput automated analysis of big flow cytometry data

The rapid expansion of flow cytometry applications has outpaced the functionality of traditional manual analysis tools used to interpret flow cytometry data. Scientists are faced with the daunting prospect of manually identifying interesting cell populations in 50-dimensional datasets, equalling the complexity previously only reached in mass cytometry. Data can no longer be analyzed or interpreted fully by manual approaches. While automated gating has been the focus of intense efforts, there are many significant additional steps to the analytical pipeline (e.g., cleaning the raw files, event outlier detection, extracting immunophenotypes). We review the components of a customized automated analysis pipeline that can be generally applied to large scale flow cytometry data. We demonstrate these methodologies on data collected by the International Mouse Phenotyping Consortium (IMPC).

Automated Analysis of Clinical Flow Cytometry Data: A Chronic Lymphocytic Leukemia Illustration

Flow cytometry is used in cell-based diagnostic evaluation for blood-borne malignancies including leukemia and lymphoma. The current practice for cytometry data analysis relies on manual gating to identify cell subsets in complex mixtures, which is subjective, labor-intensive, and poorly reproducible. This article reviews recent efforts to develop, validate, and disseminate automated computational methods and pipelines for cytometry data analysis that could help overcome the limitations of manual analysis and provide for efficient and data-driven diagnostic applications. It demonstrates the performance of an optimized computational pipeline in a pilot study of chronic lymphocytic leukemia data from the authors' clinical diagnostic laboratory.

How to make usage of the standardized EuroFlow 8-color protocols possible for instruments of different manufacturers

A critical component of the EuroFlow standardization of leukemia/lymphoma immunophenotyping is instrument setup. Initially, the EuroFlow consortium developed a step-by-step standard operating protocol for instrument setup of ≥8-color flow cytometers that were available in 2006, when the EuroFlow activities started. Currently, there are 14 instruments from 9 manufacturers capable of 3-laser excitation and ≥8 color measurements. The specific adaptations required in the instrument set-up to enable them to acquire the standardized 8-color EuroFlow protocols are described here. Overall, all 14 instruments can be fitted with similar violet, blue and red lasers for simultaneous measurements of ≥8 fluorescent dyes. Since individual instruments differ both on their dynamic range (scale) and emission filters, it is not accurate to simply recalculate the target values to different scale, but adjustment of PMT voltages to a given emission filter and fluorochrome, is essential. For this purpose, EuroFlow has developed an approach using Type IIB (spectrally matching) particles to set-up standardized and fully comparable fluorescence measurements, in instruments from different manufacturers, as demonstrated here for the FACSCanto II, and Navios and MACSQuant flow cytometers. Data acquired after such adjustment on any of the tested cytometry platforms could be fully superimposed and therefore analyzed together. The proposed approach can be used to derive target values for any combination of spectrally distinct fluorochromes and any distinct emission filter of any new flow cytometry platform, which enables the measurement of the 8-color EuroFlow panels in a standardized way, by creating superimposable datafiles.

What to expect when you're expecting

Applying systems immunology to study human pregnancy.

Automated Analysis of Flow Cytometry Data to Reduce Inter-Lab Variation in the Detection of Major Histocompatibility Complex Multimer-Binding T Cells

Manual analysis of flow cytometry data and subjective gate-border decisions taken by individuals continue to be a source of variation in the assessment of antigen-specific T cells when comparing data across laboratories, and also over time in individual labs. Therefore, strategies to provide automated analysis of major histocompatibility complex (MHC) multimer-binding T cells represent an attractive solution to decrease subjectivity and technical variation. The challenge of using an automated analysis approach is that MHC multimer-binding T cell populations are often rare and therefore difficult to detect. We used a highly heterogeneous dataset from a recent MHC multimer proficiency panel to assess if MHC multimer-binding CD8+ T cells could be analyzed with computational solutions currently available, and if such analyses would reduce the technical variation across different laboratories. We used three different methods, FLOw Clustering without K (FLOCK), Scalable Weighted Iterative Flow-clustering Technique (SWIFT), and ReFlow to analyze flow cytometry data files from 28 laboratories. Each laboratory screened for antigen-responsive T cell populations with frequency ranging from 0.01 to 1.5% of lymphocytes within samples from two donors. Experience from this analysis shows that all three programs can be used for the identification of high to intermediate frequency of MHC multimer-binding T cell populations, with results very similar to that of manual gating. For the less frequent populations (<0.1% of live, single lymphocytes), SWIFT outperformed the other tools. As used in this study, none of the algorithms offered a completely automated pipeline for identification of MHC multimer populations, as varying degrees of human interventions were needed to complete the analysis. In this study, we demonstrate the feasibility of using automated analysis pipelines for assessing and identifying even rare populations of antigen-responsive T cells and discuss the main properties, differences, and advantages of the different methods tested.

Identifying Cell Populations in Flow Cytometry Data Using Phenotypic Signatures

Single-cell flow cytometry is a technology that measures the expression of several cellular markers simultaneously for a large number of cells. Identification of homogeneous cell populations, currently done by manual biaxial gating, is highly subjective and time consuming. To overcome the shortcomings of manual gating, automatic algorithms have been proposed. However, the performance of these methods highly depends on the shape of populations and the dimension of the data. In this paper, we have developed a time-efficient method that accurately identifies cellular populations. This is done based on a novel technique that estimates the initial number of clusters in high dimension and identifies the final clusters by merging clusters using their phenotypic signatures in low dimension. The proposed method is called SigClust. We have applied SigClust to four public datasets and compared it with five well known methods in the field. The results are promising and indicate higher performance and accuracy compared to similar approaches reported in literature.

A bioinformatics roadmap for the human vaccines project

Biomedical research has become a data intensive science in which high throughput experimentation is producing comprehensive data about biological systems at an ever-increasing pace. The Human Vaccines Project is a new public-private partnership, with the goal of accelerating development of improved vaccines and immunotherapies for global infectious diseases and cancers by decoding the human immune system. To achieve its mission, the Project is developing a Bioinformatics Hub as an open-source, multidisciplinary effort with the overarching goal of providing an enabling infrastructure to support the data processing, analysis and knowledge extraction procedures required to translate high throughput, high complexity human immunology research data into biomedical knowledge, to determine the core principles driving specific and durable protective immune responses.

Validation of biomarkers to predict response to immunotherapy in cancer: Volume I - pre-analytical and analytical validation

Immunotherapies have emerged as one of the most promising approaches to treat patients with cancer. Recently, there have been many clinical successes using checkpoint receptor blockade, including T cell inhibitory receptors such as cytotoxic T-lymphocyte-associated antigen 4 (CTLA-4) and programmed cell death-1 (PD-1). Despite demonstrated successes in a variety of malignancies, responses only typically occur in a minority of patients in any given histology. Additionally, treatment is associated with inflammatory toxicity and high cost. Therefore, determining which patients would derive clinical benefit from immunotherapy is a compelling clinical question.

Although numerous candidate biomarkers have been described, there are currently three FDA-approved assays based on PD-1 ligand expression (PD-L1) that have been clinically validated to identify patients who are more likely to benefit from a single-agent anti-PD-1/PD-L1 therapy. Because of the complexity of the immune response and tumor biology, it is unlikely that a single biomarker will be sufficient to predict clinical outcomes in response to immune-targeted therapy. Rather, the integration of multiple tumor and immune response parameters, such as protein expression, genomics, and transcriptomics, may be necessary for accurate prediction of clinical benefit. Before a candidate biomarker and/or new technology can be used in a clinical setting, several steps are necessary to demonstrate its clinical validity. Although regulatory guidelines provide general roadmaps for the validation process, their applicability to biomarkers in the cancer immunotherapy field is somewhat limited. Thus, Working Group 1 (WG1) of the Society for Immunotherapy of Cancer (SITC) Immune Biomarkers Task Force convened to address this need. In this two volume series, we discuss pre-analytical and analytical (Volume I) as well as clinical and regulatory (Volume II) aspects of the validation process as applied to predictive biomarkers for cancer immunotherapy. To illustrate the requirements for validation, we discuss examples of biomarker assays that have shown preliminary evidence of an association with clinical benefit from immunotherapeutic interventions. The scope includes only those assays and technologies that have established a certain level of validation for clinical use (fit-for-purpose). Recommendations to meet challenges and strategies to guide the choice of analytical and clinical validation design for specific assays are also provided.

Clinical Outcome Prediction Using Single-Cell Data

Single-cell technologies like flow cytometry (FCM) provide valuable biological data for knowledge discovery in complex cellular systems like tissues and organs. FCM data contains multi-dimensional information about the cellular heterogeneity of intricate cellular systems. It is possible to correlate single-cell markers with phenotypic properties of those systems. Cell population identification and clinical outcome prediction from single-cell measurements are challenging problems in the field of single cell analysis. In this paper, we propose a hybrid learning approach to predict clinical outcome using samples' single-cell FCM data. The proposed method is efficient in both i) identification of cellular clusters in each sample's FCM data and ii) predict clinical outcome (healthy versus unhealthy) for each subject. Our method is robust and the experimental results indicate promising performance.

Single and multi-subject clustering of flow cytometry data for cell-type identification and anomaly detection

BACKGROUND

Measurement of various markers of single cells using flow cytometry has several biological applications. These applications include improving our understanding of behavior of cellular systems, identifying rare cell populations and personalized medication. A common critical issue in the existing methods is identification of the number of cellular populations which heavily affects the accuracy of results. Furthermore, anomaly detection is crucial in flow cytometry experiments. In this work, we propose a two-stage clustering technique for cell type identification in single subject flow cytometry data and extend it for anomaly detection among multiple subjects.

RESULTS

Our experimentation on 42 flow cytometry datasets indicates high performance and accurate clustering (F-measure > 91 %) in identifying main cellular populations. Furthermore, our anomaly detection technique evaluated on Acute Myeloid Leukemia dataset results in only <2 % false positives.

Computational flow cytometry: helping to make sense of high-dimensional immunology data

Recent advances in flow cytometry allow scientists to measure an increasing number of parameters per cell, generating huge and high-dimensional datasets. To analyse, visualize and interpret these data, newly available computational techniques should be adopted, evaluated and improved upon by the immunological community. Computational flow cytometry is emerging as an important new field at the intersection of immunology and computational biology; it allows new biological knowledge to be extracted from high-throughput single-cell data. This Review provides non-experts with a broad and practical overview of the many recent developments in computational flow cytometry.

Clustering Single-Cell Expression Data Using Random Forest Graphs

Complex tissues such as brain and bone marrow are made up of multiple cell types. As the study of biological tissue structure progresses, the role of cell-type-specific research becomes increasingly important. Novel sequencing technology such as single-cell cytometry provides researchers access to valuable biological data. Applying machine-learning techniques to these high-throughput datasets provides deep insights into the cellular landscape of the tissue where those cells are a part of. In this paper, we propose the use of random-forest-based single-cell profiling, a new machine-learning-based technique, to profile different cell types of intricate tissues using single-cell cytometry data. Our technique utilizes random forests to capture cell marker dependences and model the cellular populations using the cell network concept. This cellular network helps us discover what cell types are in the tissue. Our experimental results on public-domain datasets indicate promising performance and accuracy of our technique in extracting cell populations of complex tissues.

Multi-parametric cytometry from a complex cellular sample: Improvements and limits of manual versus computational-based interactive analyses

The wide possibilities opened by the developments of multi-parametric cytometry are limited by the inadequacy of the classical methods of analysis to the multi-dimensional characteristics of the data. While new computational tools seemed ideally adapted and were applied successfully, their adoption is still low among the flow cytometrists. In the purpose to integrate unsupervised computational tools for the management of multi-stained samples, we investigated their advantages and limits by comparison to manual gating on a typical sample analyzed in immunomonitoring routine. A single tube of PBMC, containing 11 populations characterized by different sizes and stained with 9 fluorescent markers, was used. We investigated the impact of the strategy choice on manual gating variability, an undocumented pitfall of the analysis process, and we identified rules to optimize it. While assessing automatic gating as an alternate, we introduced the Multi-Experiment Viewer software (MeV) and validated it for merging clusters and annotating interactively populations. This procedure allowed the finding of both targeted and unexpected populations. However, the careful examination of computed clusters in standard dot plots revealed some heterogeneity, often below 10%, that was overcome by increasing the number of clusters to be computed. MeV facilitated the identification of populations by displaying both the MFI and the marker signature of the dataset simultaneously. The procedure described here appears fully adapted to manage homogeneously high number of multi-stained samples and allows improving multi-parametric analyses in a way close to the classic approach. © 2016 International Society for Advancement of Cytometry.

Standardizing Flow Cytometry Immunophenotyping Analysis from the Human ImmunoPhenotyping Consortium

Standardization of immunophenotyping requires careful attention to reagents, sample handling, instrument setup, and data analysis, and is essential for successful cross-study and cross-center comparison of data. Experts developed five standardized, eight-color panels for identification of major immune cell subsets in peripheral blood. These were produced as pre-configured, lyophilized, reagents in 96-well plates. We present the results of a coordinated analysis of samples across nine laboratories using these panels with standardized operating procedures (SOPs). Manual gating was performed by each site and by a central site. Automated gating algorithms were developed and tested by the FlowCAP consortium. Centralized manual gating can reduce cross-center variability, and we sought to determine whether automated methods could streamline and standardize the analysis. Within-site variability was low in all experiments, but cross-site variability was lower when central analysis was performed in comparison with site-specific analysis. It was also lower for clearly defined cell subsets than those based on dim markers and for rare populations. Automated gating was able to match the performance of central manual analysis for all tested panels, exhibiting little to no bias and comparable variability. Standardized staining, data collection, and automated gating can increase power, reduce variability, and streamline analysis for immunophenotyping.