Interlaboratory studies and initiatives developing standards for proteomics

A Multipathway Phosphopeptide Standard for Rapid Phosphoproteomics Assay Development

Recent advances in methodology have made phosphopeptide analysis a tractable problem for many proteomics researchers. There are now a wide variety of robust and accessible enrichment strategies to generate phosphoproteomes while free or inexpensive software tools for quantitation and site localization have simplified phosphoproteome analysis workflow tremendously. As a research group under the Association for Biomolecular Resource Facilities umbrella, the Proteomics Standards Research Group has worked to develop a multipathway phosphopeptide standard based on a mixture of heavy-labeled phosphopeptides designed to enable researchers to rapidly develop assays. This mixture contains 131 mass spectrometry vetted phosphopeptides specifically chosen to cover as many known biologically interesting phosphosites as possible from seven different signaling networks: AMPK signaling, death and apoptosis signaling, ErbB signaling, insulin/insulin-like growth factor-1 signaling, mTOR signaling, PI3K/AKT signaling, and stress (p38/SAPK/JNK) signaling. Here, we describe a characterization of this mixture spiked into a HeLa tryptic digest stimulated with both epidermal growth factor and insulin-like growth factor-1 to activate the MAPK and PI3K/AKT/mTOR pathways. We further demonstrate a comparison of phosphoproteomic profiling of HeLa performed independently in five labs using this phosphopeptide mixture with data-independent acquisition. Despite different experimental and instrumentation processes, we found that labs could produce reproducible, harmonized datasets by reporting measurements as ratios to the standard, while intensity measurements showed lower consistency between labs even after normalization. Our results suggest that widely available, biologically relevant phosphopeptide standards can act as a quantitative "yardstick" across laboratories and sample preparations enabling experimental designs larger than a single laboratory can perform. Raw data files are publicly available in the MassIVE dataset MSV000090564.

Mass Spectral Analysis of Synthetic Peptides: Implications in Proteomics

Sequence determination of peptides is a crucial step in mass spectrometry-based proteomics. Peptide sequences are determined either by database search or by de novo sequencing using tandem mass spectrometry. Determination of all the theoretical expected peptide fragments and eliminating false discoveries remains a challenge in proteomics. Developing standards for evaluating the performance of mass spectrometers and algorithms used for identification of proteins is important for proteomics studies. The current study is focused on these aspects by using synthetic peptides. A total of 599 peptides were designed from in silico tryptic digest with 1 or 2 missed cleavages from 199 human proteins, and synthetic peptides corresponding to these sequences were obtained. The peptides were mixed together, and analysis was carried out using liquid chromatography-electrospray ionization tandem mass spectrometry on a Q-Exactive HF mass spectrometer. The peptides and proteins were identified with SEQUEST program. The analysis was carried out using the proteomics workflows. A total of 573 peptides representing 196 proteins could be identified, and a spectral library was created for these peptides. Analysis parameters such as "no enzyme selection" gave the maximum number of detected peptides as compared with trypsin in the selection. False discoveries could be identified. This study highlights the limitations of peptide detection and the need for developing powerful algorithms along with tools to evaluate mass spectrometers and algorithms. It also shows the limitations of peptide detection even with high-end mass spectrometers. The mass spectral data are available in ProteomeXchange with accession no. PXD017992.

Mass Spectral Analysis of Synthetic Peptides: Implications in Proteomics

Sequence determination of peptides is a crucial step in mass spectrometry-based proteomics. Peptide sequences are determined either by database search or by de novo sequencing using tandem mass spectrometry. Determination of all the theoretical expected peptide fragments and eliminating false discoveries remains a challenge in proteomics. Developing standards for evaluating the performance of mass spectrometers and algorithms used for identification of proteins is important for proteomics studies. The current study is focused on these aspects by using synthetic peptides. A total of 599 peptides were designed from in silico tryptic digest with 1 or 2 missed cleavages from 199 human proteins, and synthetic peptides corresponding to these sequences were obtained. The peptides were mixed together, and analysis was carried out using liquid chromatography-electrospray ionization tandem mass spectrometry on a Q-Exactive HF mass spectrometer. The peptides and proteins were identified with SEQUEST program. The analysis was carried out using the proteomics workflows. A total of 573 peptides representing 196 proteins could be identified, and a spectral library was created for these peptides. Analysis parameters such as "no enzyme selection" gave the maximum number of detected peptides as compared with trypsin in the selection. False discoveries could be identified. This study highlights the limitations of peptide detection and the need for developing powerful algorithms along with tools to evaluate mass spectrometers and algorithms. It also shows the limitations of peptide detection even with high-end mass spectrometers. The mass spectral data are available in ProteomeXchange with accession no. PXD017992.

A Review of the Scientific Rigor, Reproducibility, and Transparency Studies Conducted by the ABRF Research Groups

Shared research resource facilities, also known as core laboratories (Cores), are responsible for generating a significant and growing portion of the research data in academic biomedical research institutions. Cores represent a central repository for institutional knowledge management, with deep expertise in the strengths and limitations of technology and its applications. They inherently support transparency and scientific reproducibility by protecting against cognitive bias in research design and data analysis, and they have institutional responsibility for the conduct of research (research ethics, regulatory compliance, and financial accountability) performed in their Cores. The Association of Biomolecular Resource Facilities (ABRF) is a FASEB-member scientific society whose members are scientists and administrators that manage or support Cores. The ABRF Research Groups (RGs), representing expertise for an array of cutting-edge and established technology platforms, perform multicenter research studies to determine and communicate best practices and community-based standards. This review provides a summary of the contributions of the ABRF RGs to promote scientific rigor and reproducibility in Cores from the published literature, ABRF meetings, and ABRF RGs communications.

Mass Spectrometry Advances and Perspectives for the Characterization of Emerging Adoptive Cell Therapies

Adoptive cell therapy is an emerging anti-cancer modality, whereby the patient's own immune cells are engineered to express T-cell receptor (TCR) or chimeric antigen receptor (CAR). CAR-T cell therapies have advanced the furthest, with recent approvals of two treatments by the Food and Drug Administration of Kymriah (trisagenlecleucel) and Yescarta (axicabtagene ciloleucel). Recent developments in proteomic analysis by mass spectrometry (MS) make this technology uniquely suited to enable the comprehensive identification and quantification of the relevant biochemical architecture of CAR-T cell therapies and fulfill current unmet needs for CAR-T product knowledge. These advances include improved sample preparation methods, enhanced separation technologies, and extension of MS-based proteomic to single cells. Innovative technologies such as proteomic analysis of raw material quality attributes (MQA) and final product quality attributes (PQA) may provide insights that could ultimately fuel development strategies and lead to broad implementation.

Detecting post-translational modification signatures as potential biomarkers in clinical mass spectrometry

INTRODUCTION

Numerous diseases are caused by changes in post-translational modifications (PTMs). Therefore, the number of clinical proteomics studies that include the analysis of PTMs is increasing. Combining complementary information-for example changes in protein abundance, PTM levels, with the genome and transcriptome (proteogenomics)-holds great promise for discovering important drivers and markers of disease, as variations in copy number, expression levels, or mutations without spatial/functional/isoform information is often insufficient or even misleading. Areas covered: We discuss general considerations, requirements, pitfalls, and future perspectives in applying PTM-centric proteomics to clinical samples. This includes samples obtained from a human subject, for instance (i) bodily fluids such as plasma, urine, or cerebrospinal fluid, (ii) primary cells such as reproductive cells, blood cells, and (iii) tissue samples/biopsies. Expert commentary: PTM-centric discovery proteomics can substantially contribute to the understanding of disease mechanisms by identifying signatures with potential diagnostic or even therapeutic relevance but may require coordinated efforts of interdisciplinary and eventually multi-national consortia, such as initiated in the cancer moonshot program. Additionally, robust and standardized mass spectrometry (MS) assays-particularly targeted MS, MALDI imaging, and immuno-MALDI-may be transferred to the clinic to improve patient stratification for precision medicine, and guide therapies.

Quality control in mass spectrometry-based proteomics

Mass spectrometry is a highly complex analytical technique and mass spectrometry-based proteomics experiments can be subject to a large variability, which forms an obstacle to obtaining accurate and reproducible results. Therefore, a comprehensive and systematic approach to quality control is an essential requirement to inspire confidence in the generated results. A typical mass spectrometry experiment consists of multiple different phases including the sample preparation, liquid chromatography, mass spectrometry, and bioinformatics stages. We review potential sources of variability that can impact the results of a mass spectrometry experiment occurring in all of these steps, and we discuss how to monitor and remedy the negative influences on the experimental results. Furthermore, we describe how specialized quality control samples of varying sample complexity can be incorporated into the experimental workflow and how they can be used to rigorously assess detailed aspects of the instrument performance.

Integrated Chemometrics and Statistics to Drive Successful Proteomics Biomarker Discovery

Protein biomarkers are of great benefit for clinical research and applications, as they are powerful means for diagnosing, monitoring and treatment prediction of different diseases. Even though numerous biomarkers have been reported, the translation to clinical practice is still limited. This mainly due to: (i) incorrect biomarker selection, (ii) insufficient validation of potential biomarkers, and (iii) insufficient clinical use. In this review, we focus on the biomarker selection process and critically discuss the chemometrical and statistical decisions made in proteomics biomarker discovery to increase to selection of high value biomarkers. The characteristics of the data, the computational resources, the type of biomarker that is searched for and the validation strategy influence the decision making of the chemometrical and statistical methods and a decision made for one component directly influences the choice for another. Incorrect decisions could increase the false positive and negative rate of biomarkers which requires independent confirmation of outcome by other techniques and for comparison between different related studies. There are few guidelines for authors regarding data analysis documentation in peer reviewed journals, making it hard to reproduce successful data analysis strategies. Here we review multiple chemometrical and statistical methods for their value in proteomics-based biomarker discovery and propose to include key components in scientific documentation.

Challenges and Opportunities for Biological Mass Spectrometry Core Facilities in the Developing World

The developing world is seeing rapid growth in the availability of biological mass spectrometry (MS), particularly through core facilities. As proteomics and metabolomics becomes locally feasible for investigators in these nations, application areas associated with high burden in these nations, such as infectious disease, will see greatly increased research output. This article evaluates the rapid growth of MS in South Africa (currently approaching 20 laboratories) as a model for establishing MS core facilities in other nations of the developing world. Facilities should emphasize new services rather than new instruments. The reduction of the delays associated with reagent and other supply acquisition would benefit both facilities and the users who make use of their services. Instrument maintenance and repair, often mediated by an in-country business for an international vendor, is also likely to operate on a slower schedule than in the wealthiest nations. A key challenge to facilities in the developing world is educating potential facility users in how best to design experiments for proteomics and metabolomics, what reagents are most likely to introduce problematic artifacts, and how to interpret results from the facility. Here, we summarize the experience of 6 different institutions to raise the level of biological MS available to researchers in South Africa.

Harmonizing lipidomics: NIST interlaboratory comparison exercise for lipidomics using SRM 1950-Metabolites in Frozen Human Plasma

As the lipidomics field continues to advance, self-evaluation within the community is critical. Here, we performed an interlaboratory comparison exercise for lipidomics using Standard Reference Material (SRM) 1950-Metabolites in Frozen Human Plasma, a commercially available reference material. The interlaboratory study comprised 31 diverse laboratories, with each laboratory using a different lipidomics workflow. A total of 1,527 unique lipids were measured across all laboratories and consensus location estimates and associated uncertainties were determined for 339 of these lipids measured at the sum composition level by five or more participating laboratories. These evaluated lipids detected in SRM 1950 serve as community-wide benchmarks for intra- and interlaboratory quality control and method validation. These analyses were performed using nonstandardized laboratory-independent workflows. The consensus locations were also compared with a previous examination of SRM 1950 by the LIPID MAPS consortium. While the central theme of the interlaboratory study was to provide values to help harmonize lipids, lipid mediators, and precursor measurements across the community, it was also initiated to stimulate a discussion regarding areas in need of improvement.

Designing Successful Proteomics Experiments

Because proteomics experiments are so complex they can readily fail, and do so without clear cause. Using standard experimental design techniques and incorporating quality control can greatly increase the chances of success. This chapter introduces the relevant concepts and provides examples specific to proteomic workflows. Applying these notions to design successful proteomics experiments is straightforward. It can help identify failure causes and greatly increase the likelihood of inter-laboratory reproducibility.

RePLiCal: A QconCAT Protein for Retention Time Standardization in Proteomics Studies

This study introduces a new reversed-phase liquid chromatography retention time (RT) standard, RePLiCal (Reversed-phase liquid chromatography calibrant), produced using QconCAT technology. The synthetic protein contains 27 lysine-terminating calibrant peptides, meaning that the same complement of standards can be generated using either Lys-C or trypsin-based digestion protocols. RePLiCal was designed such that each constituent peptide is unique with respect to all eukaryotic proteomes, thereby enabling integration into a wide range of proteomic analyses. RePLiCal has been benchmarked against three commercially available peptide RT standard kits and outperforms all in terms of LC gradient coverage. RePLiCal also provides a higher number of calibrant points for chromatographic retention time standardization and normalization. The standard provides stable RTs over long analysis times and can be readily transferred between different LC gradients and nUHPLC instruments. Moreover, RePLiCal can be used to predict RTs for other peptides in a timely manner. Furthermore, it is shown that RePLiCal can be used effectively to evaluate trapping column performance for nUHPLC instruments using trap-elute configurations, to optimize gradients to maximize peptide and protein identification rates, and to recalibrate the m/z scale of mass spectrometry data post-acquisition.

Independent highly sensitive characterization of asparagine deamidation and aspartic acid isomerization by sheathless CZE-ESI-MS/MS

Amino acids residues are commonly submitted to various physicochemical modifications occurring at physiological pH and temperature. Post-translational modifications (PTMs) require comprehensive characterization because of their major influence on protein structure and involvement in numerous in vivo process or signaling. Mass spectrometry (MS) has gradually become an analytical tool of choice to characterize PTMs; however, some modifications are still challenging because of sample faint modification levels or difficulty to separate an intact peptide from modified counterparts before their transfer to the ionization source. Here, we report the implementation of capillary zone electrophoresis coupled to electrospray ionization tandem mass spectrometry (CZE-ESI-MS/MS) by the intermediate of a sheathless interfacing for independent and highly sensitive characterization of asparagine deamidation (deaN) and aspartic acid isomerization (isoD). CZE selectivity regarding deaN and isoD was studied extensively using different sets of synthetic peptides based on actual tryptic peptides. Results demonstrated CZE ability to separate the unmodified peptide from modified homologous exhibiting deaN, isoD or both independently with a resolution systematically superior to 1.29. Developed CZE-ESI-MS/MS method was applied for the characterization of monoclonal antibodies and complex protein mixture. Conserved CZE selectivity could be demonstrated even for complex samples, and foremost results obtained showed that CZE selectivity is similar regardless of the composition of the peptide. Separation of modified peptides prior to the MS analysis allowed to characterize and estimate modification levels of the sample independently for deaN and isoD even for peptides affected by both modifications and, as a consequence, enables to distinguish the formation of l-aspartic acid or d-aspartic acid generated from deaN. Separation based on peptide modification allowed, as supported by the ESI efficiency provided by CZE-ESI-MS/MS properties, and enabled to characterize and estimate studied PTMs with an unprecedented sensitivity and proved the relevance of implementing an electrophoretic driven separation for MS-based peptide analysis.

On the outside looking in: redefining the role of analytical chemistry in the biosciences

Analytical chemistry has much to offer to an improved understanding of biological systems.

Proteomics Is Analytical Chemistry: Fitness-for-Purpose in the Application of Top-Down and Bottom-Up Analyses

Molecular mechanisms underlying health and disease function at least in part based on the flexibility and fine-tuning afforded by protein isoforms and post-translational modifications. The ability to effectively and consistently resolve these protein species or proteoforms, as well as assess quantitative changes is therefore central to proteomic analyses. Here we discuss the pros and cons of currently available and developing analytical techniques from the perspective of the full spectrum of available tools and their current applications, emphasizing the concept of fitness-for-purpose in experimental design based on consideration of sample size and complexity; this necessarily also addresses analytical reproducibility and its variance. Data quality is considered the primary criterion, and we thus emphasize that the standards of Analytical Chemistry must apply throughout any proteomic analysis.

A standardized kit for automated quantitative assessment of candidate protein biomarkers in human plasma

Background: An increasingly popular mass spectrometry-based quantitative approach for health-related research in the biomedical field involves the use of stable isotope-labeled standards (SIS) and multiple/selected reaction monitoring (MRM/SRM). To improve inter-laboratory precision and enable more widespread use of this ‘absolute’ quantitative technique in disease-biomarker assessment studies, methods must be standardized. Results/methodology: Using this MRM-with-SIS-peptide approach, we developed an automated method (encompassing sample preparation, processing and analysis) for quantifying 76 candidate protein markers (spanning >4 orders of magnitude in concentration) in neat human plasma. Discussion/conclusion: The assembled biomarker assessment kit – the ‘BAK-76’ – contains the essential materials (SIS mixes), methods (for acquisition and analysis), and tools (Qualis-SIS software) for performing biomarker discovery or verification studies in a rapid and standardized manner.

Translating clinical proteomics: the importance of study design

Mass spectrometry-based clinical proteomics approaches were introduced into the biomedical field more than two decades ago. Despite recent developments both in the field of mass spectrometry and bioinformatics, the gap between proteomics results and their translation into clinical practice still needs to be closed, as implementation of proteomics results in the clinic appears to be scarce. An extra focus on the importance of the experimental design is therefore of crucial importance.

DIGESTIF: a universal quality standard for the control of bottom-up proteomics experiments

In bottom-up mass spectrometry-based proteomics analyses, variability at any step of the process, particularly during sample proteolysis, directly affects the sensitivity, accuracy, and precision of peptide detection and quantification. Currently, no generic internal standards are available to control the quality of sample processing steps. This makes it difficult to assess the comparability of MS proteomic data obtained under different experimental conditions. Here, we describe the design, synthesis, and validation of a universal protein standard, called DIGESTIF, that can be added to any biological sample. The DIGESTIF standard consists of a soluble recombinant protein scaffold to which a set of 11 artificial peptides (iRT peptides) with good ionization properties has been incorporated. In the protein scaffold, the amino acids flanking iRT peptide cleavage sites were selected either to favor or hinder protease cleavage. After sample processing, the retention time and relative intensity pattern of the released iRT peptides can be used to assess the quality of sample workup, the extent of digestion, and the performance of the LC-MS system. Thus, DIGESTIF can be used to standardize a broad spectrum of applications, ranging from simple replicate measurements to large-scale biomarker screening in biomedical applications.

Integration of omics sciences to advance biology and medicine

In the past two decades, our ability to study cellular and molecular systems has been transformed through the development of omics sciences. While unlimited potential lies within massive omics datasets, the success of omics sciences to further our understanding of human disease and/or translating these findings to clinical utility remains elusive due to a number of factors. A significant limiting factor is the integration of different omics datasets (i.e., integromics) for extraction of biological and clinical insights. To this end, the National Cancer Institute (NCI) and the National Heart, Lung and Blood Institute (NHLBI) organized a joint workshop in June 2012 with the focus on integration issues related to multi-omics technologies that needed to be resolved in order to realize the full utility of integrating omics datasets by providing a glimpse into the disease as an integrated “system”. The overarching goals were to (1) identify challenges and roadblocks in omics integration, and (2) facilitate the full maturation of ‘integromics’ in biology and medicine. Participants reached a consensus on the most significant barriers for integrating omics sciences and provided recommendations on viable approaches to overcome each of these barriers within the areas of technology, bioinformatics and clinical medicine.

qcML: an exchange format for quality control metrics from mass spectrometry experiments

Quality control is increasingly recognized as a crucial aspect of mass spectrometry based proteomics. Several recent papers discuss relevant parameters for quality control and present applications to extract these from the instrumental raw data. What has been missing, however, is a standard data exchange format for reporting these performance metrics. We therefore developed the qcML format, an XML-based standard that follows the design principles of the related mzML, mzIdentML, mzQuantML, and TraML standards from the HUPO-PSI (Proteomics Standards Initiative). In addition to the XML format, we also provide tools for the calculation of a wide range of quality metrics as well as a database format and interconversion tools, so that existing LIMS systems can easily add relational storage of the quality control data to their existing schema. We here describe the qcML specification, along with possible use cases and an illustrative example of the subsequent analysis possibilities. All information about qcML is available at http://code.google.com/p/qcml.

Bioinformatics for proteomics: opportunities at the interface between the scientists, their experiments, and the community

Within the last decade, bioinformatics has moved from command line scripts dedicated to single experiments towards production grade software integrated in experimental workflows providing a rich environment for biological investigation. Located at the interface between the scientists, their experiments, and the community, bioinformatics acts as a gateway to a wide source of information. This chapter does not list tools and methods, but rather hints at how bioinformatics can help in improving biological projects, all the way from their initial design to the dissemination of the results.

Machine learning applications in proteomics research: how the past can boost the future

Machine learning is a subdiscipline within artificial intelligence that focuses on algorithms that allow computers to learn solving a (complex) problem from existing data. This ability can be used to generate a solution to a particularly intractable problem, given that enough data are available to train and subsequently evaluate an algorithm on. Since MS-based proteomics has no shortage of complex problems, and since publicly available data are becoming available in ever growing amounts, machine learning is fast becoming a very popular tool in the field. We here therefore present an overview of the different applications of machine learning in proteomics that together cover nearly the entire wet- and dry-lab workflow, and that address key bottlenecks in experiment planning and design, as well as in data processing and analysis.

Phosphoproteomics--more than meets the eye

PTMs enable cells to adapt to internal and external stimuli in the milliseconds to seconds time regime. Protein phosphorylation is probably the most important of these modifications as it affects protein structure and interactions, critically influencing the life cycle of a cell. In the last 15 years, new insights into phosphorylation have been provided by highly sensitive MS-based approaches combined with specific phosphopeptide enrichment strategies. Although so far research has mainly focused on the discovery and characterization of O-phosphorylation, this review also briefly outlines the current knowledge about N-phosphorylation depicting its ubiquitous relevance. Further, common pitfalls in sample preparation, LC-MS analysis, and subsequent data analysis are discussed as well as issues regarding quality and comparability of studies on protein phosphorylation.