Multicenter experiment for quality control of peptide-centric LC-MS/MS analysis - A longitudinal performance assessment with nLC coupled to orbitrap MS analyzers

Multicenter Collaborative Study to Optimize Mass Spectrometry Workflows of Clinical Specimens

The foundation for integrating mass spectrometry (MS)-based proteomics into systems medicine is the development of standardized start-to-finish and fit-for-purpose workflows for clinical specimens. An essential step in this pursuit is to highlight the common ground in a diverse landscape of different sample preparation techniques and liquid chromatography-mass spectrometry (LC-MS) setups. With the aim to benchmark and improve the current best practices among the proteomics MS laboratories of the CLINSPECT-M consortium, we performed two consecutive round-robin studies with full freedom to operate in terms of sample preparation and MS measurements. The six study partners were provided with two clinically relevant sample matrices: plasma and cerebrospinal fluid (CSF). In the first round, each laboratory applied their current best practice protocol for the respective matrix. Based on the achieved results and following a transparent exchange of all lab-specific protocols within the consortium, each laboratory could advance their methods before measuring the same samples in the second acquisition round. Both time points are compared with respect to identifications (IDs), data completeness, and precision, as well as reproducibility. As a result, the individual performances of participating study centers were improved in the second measurement, emphasizing the effect and importance of the expert-driven exchange of best practices for direct practical improvements.

Quartet protein reference materials and datasets for multi-platform assessment of label-free proteomics

BACKGROUND

Quantitative proteomics is an indispensable tool in life science research. However, there is a lack of reference materials for evaluating the reproducibility of label-free liquid chromatography-tandem mass spectrometry (LC-MS/MS)-based measurements among different instruments and laboratories.

RESULTS

Here, we develop the Quartet standard as a proteome reference material with built-in truths, and distribute the same aliquots to 15 laboratories with nine conventional LC-MS/MS platforms across six cities in China. Relative abundance of over 12,000 proteins on 816 mass spectrometry files are obtained and compared for reproducibility among the instruments and laboratories to ultimately generate proteomics benchmark datasets. There is a wide dynamic range of proteomes spanning about 7 orders of magnitude, and the injection order has marked effects on quantitative instead of qualitative characteristics.

CONCLUSION

Overall, the Quartet offers valuable standard materials and data resources for improving the quality control of proteomic analyses as well as the reproducibility and reliability of research findings.

Multi-laboratory experiment PME11 for the standardization of phosphoproteome analysis

Global analysis of protein phosphorylation by mass spectrometry proteomic techniques has emerged in the last decades as a powerful tool in biological and biomedical research. However, there are several factors that make the global study of the phosphoproteome more challenging than measuring non-modified proteins. The low stoichiometry of the phosphorylated species and the need to retrieve residue specific information require particular attention on sample preparation, data acquisition and processing to ensure reproducibility, qualitative and quantitative robustness and ample phosphoproteome coverage in phosphoproteomic workflows. Aiming to investigate the effect of different variables in the performance of proteome wide phosphoprotein analysis protocols, ProteoRed-ISCIII and EuPA launched the Proteomics Multicentric Experiment 11 (PME11). A reference sample consisting of a yeast protein extract spiked in with different amounts of a phosphomix standard (Sigma/Merck) was distributed to 31 laboratories around the globe. Thirty-six datasets from 23 laboratories were analyzed. Our results indicate the suitability of the PME11 reference sample to benchmark and optimize phosphoproteomics strategies, weighing the influence of different factors, as well as to rank intra and inter laboratory performance.

Quality control in mass spectrometry-based proteomics

Mass spectrometry is a highly complex analytical technique and mass spectrometry-based proteomics experiments can be subject to a large variability, which forms an obstacle to obtaining accurate and reproducible results. Therefore, a comprehensive and systematic approach to quality control is an essential requirement to inspire confidence in the generated results. A typical mass spectrometry experiment consists of multiple different phases including the sample preparation, liquid chromatography, mass spectrometry, and bioinformatics stages. We review potential sources of variability that can impact the results of a mass spectrometry experiment occurring in all of these steps, and we discuss how to monitor and remedy the negative influences on the experimental results. Furthermore, we describe how specialized quality control samples of varying sample complexity can be incorporated into the experimental workflow and how they can be used to rigorously assess detailed aspects of the instrument performance.

Round robin study of formalin-fixed paraffin-embedded tissues in mass spectrometry imaging

Mass spectrometry imaging (MSI) has provided many results with translational character, which still have to be proven robust in large patient cohorts and across different centers. Although formalin-fixed paraffin-embedded (FFPE) specimens are most common in clinical practice, no MSI multicenter study has been reported for FFPE samples. Here, we report the results of the first round robin MSI study on FFPE tissues with the goal to investigate the consequences of inter- and intracenter technical variation on masking biological effects. A total of four centers were involved with similar MSI instrumentation and sample preparation equipment. A FFPE multi-organ tissue microarray containing eight different types of tissue was analyzed on a peptide and metabolite level, which enabled investigating different molecular and biological differences. Statistical analyses revealed that peptide intercenter variation was significantly lower and metabolite intercenter variation was significantly higher than the respective intracenter variations. When looking at relative univariate effects of mass signals with statistical discriminatory power, the metabolite data was more reproducible across centers compared to the peptide data. With respect to absolute effects (cross-center common intensity scale), multivariate classifiers were able to reach on average > 90% accuracy for peptides and > 80% for metabolites if trained with sufficient amount of cross-center data. Overall, our study showed that MSI data from FFPE samples could be reproduced to a high degree across centers. While metabolite data exhibited more reproducibility with respect to relative effects, peptide data-based classifiers were more directly transferable between centers and therefore more robust than expected. Graphical abstract ᅟ.

QCloud: A cloud-based quality control system for mass spectrometry-based proteomics laboratories

The increasing number of biomedical and translational applications in mass spectrometry-based proteomics poses new analytical challenges and raises the need for automated quality control systems. Despite previous efforts to set standard file formats, data processing workflows and key evaluation parameters for quality control, automated quality control systems are not yet widespread among proteomics laboratories, which limits the acquisition of high-quality results, inter-laboratory comparisons and the assessment of variability of instrumental platforms. Here we present QCloud, a cloud-based system to support proteomics laboratories in daily quality assessment using a user-friendly interface, easy setup, automated data processing and archiving, and unbiased instrument evaluation. QCloud supports the most common targeted and untargeted proteomics workflows, it accepts data formats from different vendors and it enables the annotation of acquired data and reporting incidences. A complete version of the QCloud system has successfully been developed and it is now open to the proteomics community (http://qcloud.crg.eu). QCloud system is an open source project, publicly available under a Creative Commons License Attribution-ShareAlike 4.0.

Current trends in quantitative proteomics - an update

Proteins can provide insights into biological processes at the functional level, so they are very promising biomarker candidates. The quantification of proteins in biological samples has been routinely used for the diagnosis of diseases and monitoring the treatment. Although large-scale protein quantification in complex samples is still a challenging task, a great amount of effort has been made to advance the technologies that enable quantitative proteomics. Seven years ago, in 2009, we wrote an article about the current trends in quantitative proteomics. In writing this current paper, we realized that, today, we have an even wider selection of potential tools for quantitative proteomics. These tools include new derivatization reagents, novel sampling formats, new types of analyzers and scanning techniques, and recently developed software to assist in assay development and data analysis. In this review article, we will discuss these innovative methods, and their current and potential applications in proteomics. Copyright © 2017 John Wiley & Sons, Ltd.

The Human Proteome Organization-Proteomics Standards Initiative Quality Control Working Group: Making Quality Control More Accessible for Biological Mass Spectrometry

To have confidence in results acquired during biological mass spectrometry experiments, a systematic approach to quality control is of vital importance. Nonetheless, until now, only scattered initiatives have been undertaken to this end, and these individual efforts have often not been complementary. To address this issue, the Human Proteome Organization-Proteomics Standards Initiative has established a new working group on quality control at its meeting in the spring of 2016. The goal of this working group is to provide a unifying framework for quality control data. The initial focus will be on providing a community-driven standardized file format for quality control. For this purpose, the previously proposed qcML format will be adapted to support a variety of use cases for both proteomics and metabolomics applications, and it will be established as an official PSI format. An important consideration is to avoid enforcing restrictive requirements on quality control but instead provide the basic technical necessities required to support extensive quality control for any type of mass spectrometry-based workflow. We want to emphasize that this is an open community effort, and we seek participation from all scientists with an interest in this field.

A multicentric study to evaluate the use of relative retention times in targeted proteomics

Despite the maturity reached by targeted proteomic strategies, reliable and standardized protocols are urgently needed to enhance reproducibility among different laboratories and analytical platforms, facilitating a more widespread use in biomedical research. To achieve this goal, the use of dimensionless relative retention times (iRT), defined on the basis of peptide standard retention times (RT), has lately emerged as a powerful tool. The robustness, reproducibility and utility of this strategy were examined for the first time in a multicentric setting, involving 28 laboratories that included 24 of the Spanish network of proteomics laboratories (ProteoRed-ISCIII). According to the results obtained in this study, dimensionless retention time values (iRTs) demonstrated to be a useful tool for transferring and sharing peptide retention times across different chromatographic set-ups both intra- and inter-laboratories. iRT values also showed very low variability over long time periods. Furthermore, parallel quantitative analyses showed a high reproducibility despite the variety of experimental strategies used, either MRM (multiple reaction monitoring) or pseudoMRM, and the diversity of analytical platforms employed.

BIOLOGICAL SIGNIFICANCE

From the very beginning of proteomics as an analytical science there has been a growing interest in developing standardized methods and experimental procedures in order to ensure the highest quality and reproducibility of the results. In this regard, the recent (2012) introduction of the dimensionless retention time concept has been a significant advance. In our multicentric (28 laboratories) study we explore the usefulness of this concept in the context of a targeted proteomics experiment, demonstrating that dimensionless retention time values is a useful tool for transferring and sharing peptide retention times across different chromatographic set-ups.

The Clinical Significance of Glycoprotein Phospholipase D Levels in Distinguishing Early Stage Latent Autoimmune Diabetes in Adults and Type 2 Diabetes

Autoantibodies have been widely used as markers of latent autoimmune diabetes in adults (LADA); however, the specificity and sensitivity of autoantibodies as markers of LADA are weak compared with those found in type 1 diabetes (T1DM). In this study, we aimed to identify other plasma proteins as potential candidates that can be used effectively to determine early stage LADA and type 2 diabetes (T2DM) to facilitate early diagnosis and treatment. These issues were addressed by studying new-onset ‘classic’ T1DM (n = 156), LADA (n = 174), T2DM (n = 195) and healthy cohorts (n = 166). Plasma samples were obtained from the four cohorts. We employed isobaric tag for relative and absolute quantitation (iTRAQ) together with liquid chromatography tandem mass spectrometry (LC-MS) to identify plasma proteins with significant changes in LADA. The changes were validated by Western blot and ELISA analyses. Among the four cohorts, 311 unique proteins were identified in three iTRAQ runs, with 157 present across the three data sets. Among them, 49/311 (16.0%) proteins had significant changes in LADA compared with normal controls, including glycoprotein phospholipase D (GPLD1), which was upregulated in LADA. Western blot and ELISA analyses showed that GPLD1 levels were higher in both LADA and T1DM cohorts than in both T2DM and healthy cohorts, while there were no significant differences in the plasma concentrations of GPLD1 between the LADA and T1DM cohorts. GPLD1 is implicated as a potential candidate plasma protein for determining early stage LADA and T2DM.

Unsupervised Quality Assessment of Mass Spectrometry Proteomics Experiments by Multivariate Quality Control Metrics

Despite many technological and computational advances, the results of a mass spectrometry proteomics experiment are still subject to a large variability. For the understanding and evaluation of how technical variability affects the results of an experiment, several computationally derived quality control metrics have been introduced. However, despite the availability of these metrics, a systematic approach to quality control is often still lacking because the metrics are not fully understood and are hard to interpret. Here, we present a toolkit of powerful techniques to analyze and interpret multivariate quality control metrics to assess the quality of mass spectrometry proteomics experiments. We show how unsupervised techniques applied to these quality control metrics can provide an initial discrimination between low-quality experiments and high-quality experiments prior to manual investigation. Furthermore, we provide a technique to obtain detailed information on the quality control metrics that are related to the decreased performance, which can be used as actionable information to improve the experimental setup. Our toolkit is released as open-source and can be downloaded from https://bitbucket.org/proteinspector/qc_analysis/ .

The 2012/2013 ABRF Proteomic Research Group Study: Assessing Longitudinal Intralaboratory Variability in Routine Peptide Liquid Chromatography Tandem Mass Spectrometry Analyses

Questions concerning longitudinal data quality and reproducibility of proteomic laboratories spurred the Protein Research Group of the Association of Biomolecular Resource Facilities (ABRF-PRG) to design a study to systematically assess the reproducibility of proteomic laboratories over an extended period of time. Developed as an open study, initially 64 participants were recruited from the broader mass spectrometry community to analyze provided aliquots of a six bovine protein tryptic digest mixture every month for a period of nine months. Data were uploaded to a central repository, and the operators answered an accompanying survey. Ultimately, 45 laboratories submitted a minimum of eight LC-MSMS raw data files collected in data-dependent acquisition (DDA) mode. No standard operating procedures were enforced; rather the participants were encouraged to analyze the samples according to usual practices in the laboratory. Unlike previous studies, this investigation was not designed to compare laboratories or instrument configuration, but rather to assess the temporal intralaboratory reproducibility. The outcome of the study was reassuring with 80% of the participating laboratories performing analyses at a medium to high level of reproducibility and quality over the 9-month period. For the groups that had one or more outlying experiments, the major contributing factor that correlated to the survey data was the performance of preventative maintenance prior to the LC-MSMS analyses. Thus, the Protein Research Group of the Association of Biomolecular Resource Facilities recommends that laboratories closely scrutinize the quality control data following such events. Additionally, improved quality control recording is imperative. This longitudinal study provides evidence that mass spectrometry-based proteomics is reproducible. When quality control measures are strictly adhered to, such reproducibility is comparable among many disparate groups. Data from the study are available via ProteomeXchange under the accession code PXD002114.