Consistency of predictive signature genes and classifiers generated using different microarray platforms

The Molecular Microscope Diagnostic System: Assessment of Rejection and Injury in Heart Transplant Biopsies

This review describes the development of the Molecular Microscope Diagnostic System (MMDx) for heart transplant endomyocardial biopsies (EMBs). MMDx-Heart uses microarrays to measure biopsy-based gene expression and ensembles of machine learning algorithms to interpret the results and compare each new biopsy to a large reference set of earlier biopsies. MMDx assesses T cell-mediated rejection (TCMR), antibody-mediated rejection (AMR), recent parenchymal injury, and atrophy-fibrosis, continually "learning" from new biopsies. Rejection-associated transcripts mapped in kidney transplants and experimental systems were used to identify TCMR, AMR, and recent injury-induced inflammation. Rejection and injury emerged as gradients of intensity, rather than binary classes. AMR was one-third donor-specific antibody (DSA)-negative, and many EMBs first considered to have no rejection displayed minor AMR-like changes, with increased probability of DSA positivity and subtle inflammation. Rejection-associated transcript-based algorithms now classify EMBs as "Normal," "Minor AMR changes," "AMR," "possible AMR," "TCMR," "possible TCMR," and "recent injury." Additionally, MMDx uses injury-associated transcript sets to assess the degree of parenchymal injury and atrophy-fibrosis in every biopsy and study the effect of rejection on the parenchyma. TCMR directly injures the parenchyma whereas AMR usually induces microcirculation stress but relatively little initial parenchymal damage, although slowly inducing parenchymal atrophy-fibrosis. Function (left ventricular ejection fraction) and short-term risk of failure are strongly determined by parenchymal injury. These discoveries can guide molecular diagnostic applications, either as a central MMDx system or adapted to other platforms. MMDx can also help calibrate noninvasive blood-based biomarkers to avoid unnecessary biopsies and monitor response to therapy.

Protocol for using Ciclops to build models trained on cross-platform transcriptome data for clinical outcome prediction

Designing robust, generalizable models based on cross-platform data to predict clinical outcomes remains challenging. Building explainable models is important because models may perform differently depending on the conditions of the samples. Here, we describe the use of Ciclops (cross-platform training in clinical outcome predictions), freely available software that can build explainable models to deliver across cross-platform datasets for predicting clinical outcomes. This protocol also utilizes SHAP, a post-training analysis allowing for assessing potential biomarkers of the clinical outcome under study.

For complete details on the use and execution of this protocol, please refer to Zhang et al. (2022).

•

Build robust clinical outcome prediction models using cross-platform transcriptome data

•

Applicable to datasets from different studies measuring different clinical outcomes

•

Perform key preprocessing steps of imputation and cross-platform quantile normalization

•

Analyze feature importance in LightGBM, XGBoost, and Random Forest models with SHAP

Publisher’s note: Undertaking any experimental protocol requires adherence to local institutional guidelines for laboratory safety and ethics.

A Comparison of the TempO-Seq S1500+ Platform to RNA-Seq and Microarray Using Rat Liver Mode of Action Samples

The TempO-Seq^TM platform allows for targeted transcriptomic analysis and is currently used by many groups to perform high-throughput gene expression analysis. Herein we performed a comparison of gene expression characteristics measured using 45 purified RNA samples from the livers of rats exposed to chemicals that fall into one of five modes of action (MOAs). These samples have been previously evaluated using Affymetrix^TM rat genome 230 2.0 microarrays and Illumina® whole transcriptome RNA-Seq. Comparison of these data with TempO-Seq analysis using the rat S1500+ beta gene set identified clear differences in the platforms related to signal to noise, root mean squared error, and/or sources of variability. Microarray and TempO-Seq captured the most variability in terms of MOA and chemical treatment whereas RNA-Seq had higher noise and larger differences between samples within a MOA. However, analysis of the data by hierarchical clustering, gene subnetwork connectivity and biological process representation of MOA-varying genes revealed that the samples clearly grouped by treatment as opposed to gene expression platform. Overall these findings demonstrate that the results from the TempO-Seq platform are consistent with findings on other more established approaches for measuring the genome-wide transcriptome.

Easy Printing of High Viscous Microdots by Spontaneous Breakup of Thin Fibers

Electrohydrodynamic jetting is emerging as a successful technique for printing inks with resolutions well beyond those offered by conventional inkjet printers. However, the variety of printable inks is still limited to those with relatively low viscosities (typically <20 mPa s) due to nozzle clogging problems. Here, we show the possibility of printing ordered microdots of high viscous inks such as poly(lactic-co-glycolic acid) (PLGA) by exploiting the spontaneous breakup of a thin fiber generated through nozzle-free pyro-electrospinning. The PLGA fiber is deposited onto a partially wetting surface, and the breakup is achieved simply by applying an appropriate thermal stimulation, which is able to induce polymer melting and hence a mechanism of surface area minimization due to the Plateau-Rayleigh instability. The results show that this technique is a good candidate for extending the printability at the microscale to high viscous inks, thus extending their applicability to additional applications, such as cell behavior under controlled morphological constraints.

Prior knowledge transfer across transcriptional data sets and technologies using compositional statistics yields new mislabelled ovarian cell line

Here, we describe gene expression compositional assignment (GECA), a powerful, yet simple method based on compositional statistics that can validate the transfer of prior knowledge, such as gene lists, into independent data sets, platforms and technologies. Transcriptional profiling has been used to derive gene lists that stratify patients into prognostic molecular subgroups and assess biomarker performance in the pre-clinical setting. Archived public data sets are an invaluable resource for subsequent in silico validation, though their use can lead to data integration issues. We show that GECA can be used without the need for normalising expression levels between data sets and can outperform rank-based correlation methods. To validate GECA, we demonstrate its success in the cross-platform transfer of gene lists in different domains including: bladder cancer staging, tumour site of origin and mislabelled cell lines. We also show its effectiveness in transferring an epithelial ovarian cancer prognostic gene signature across technologies, from a microarray to a next-generation sequencing setting. In a final case study, we predict the tumour site of origin and histopathology of epithelial ovarian cancer cell lines. In particular, we identify and validate the commonly-used cell line OVCAR-5 as non-ovarian, being gastrointestinal in origin. GECA is available as an open-source R package.

Competence Classification of Cumulus and Granulosa Cell Transcriptome in Embryos Matched by Morphology and Female Age

Objective

By focussing on differences in the mural granulosa cell (MGC) and cumulus cell (CC) transcriptomes from follicles resulting in competent (live birth) and non-competent (no pregnancy) oocytes the study aims on defining a competence classifier expression profile in the two cellular compartments. Design: A case-control study. Setting: University based facilities for clinical services and research. Patients: MGC and CC samples from 60 women undergoing IVF treatment following the long GnRH-agonist protocol were collected. Samples from 16 oocytes where live birth was achieved and 16 age- and embryo morphology matched incompetent oocytes were included in the study.

Methods

MGC and CC were isolated immediately after oocyte retrieval. From the 16 competent and non-competent follicles, mRNA was extracted and expression profile generated on the Human Gene 1.0 ST Affymetrix array. Live birth prediction analysis using machine learning algorithms (support vector machines) with performance estimation by leave-one-out cross validation and independent validation on an external data set.

Results

We defined a signature of 30 genes expressed in CC predictive of live birth. This live birth prediction model had an accuracy of 81%, a sensitivity of 0.83, a specificity of 0.80, a positive predictive value of 0.77, and a negative predictive value of 0.86. Receiver operating characteristic analysis found an area under the curve of 0.86, significantly greater than random chance. When applied on 3 external data sets with the end-point outcome measure of blastocyst formation, the signature resulted in 62%, 75% and 88% accuracy, respectively. The genes in the classifier are primarily connected to apoptosis and involvement in formation of extracellular matrix. We were not able to define a robust MGC classifier signature that could classify live birth with accuracy above random chance level.

Conclusion

We have developed a cumulus cell classifier, which showed a promising performance on external data. This suggests that the gene signature at least partly include genes that relates to competence in the developing blastocyst.

The FDA's Experience with Emerging Genomics Technologies-Past, Present, and Future

The rapid advancement of emerging genomics technologies and their application for assessing safety and efficacy of FDA-regulated products require a high standard of reliability and robustness supporting regulatory decision-making in the FDA. To facilitate the regulatory application, the FDA implemented a novel data submission program, Voluntary Genomics Data Submission (VGDS), and also to engage the stakeholders. As part of the endeavor, for the past 10 years, the FDA has led an international consortium of regulatory agencies, academia, pharmaceutical companies, and genomics platform providers, which was named MicroArray Quality Control Consortium (MAQC), to address issues such as reproducibility, precision, specificity/sensitivity, and data interpretation. Three projects have been completed so far assessing these genomics technologies: gene expression microarrays, whole genome genotyping arrays, and whole transcriptome sequencing (i.e., RNA-seq). The resultant studies provide the basic parameters for fit-for-purpose application of these new data streams in regulatory environments, and the solutions have been made available to the public through peer-reviewed publications. The latest MAQC project is also called the SEquencing Quality Control (SEQC) project focused on next-generation sequencing. Using reference samples with built-in controls, SEQC studies have demonstrated that relative gene expression can be measured accurately and reliably across laboratories and RNA-seq platforms. Besides prediction performance comparable to microarrays in clinical settings and safety assessments, RNA-seq is shown to have better sensitivity for low expression and reveal novel transcriptomic features. Future effort of MAQC will be focused on quality control of whole genome sequencing and targeted sequencing.

Transcriptomics: a sword to cut the Gordian knot of traditional Chinese medicine

The systemic effects of traditional Chinese medicine (TCM) seem to be a Gordian knot, impossible to untie for decades. With the advent of transcriptomics, a useful sword is provided to cut the knot and shed some light on complex bioprocesses and intrinsic connections among them. Here, we revisit studies on TCM ZHENGs using this approach, highlight its applications on elucidating the potential scientific basis of ZHENG and investigating mechanisms of action for the TCM formula, and demonstrating its unique role in novel TCM drug design and discovery through active ingredient detection from TCM and compatibility theory study of TCM. The limitations and future perspectives of transcriptomics approaches to TCM study are also discussed.

Standardization efforts enabling next-generation sequencing and microarray based biomarkers for precision medicine

Microarrays and next-generation sequencing technologies have been increasingly employed in biomedical research. However, before they can be reliably used as clinical biomarker tests, standardization and quality control measures need to be developed to ensure their analytical validity. This review summarizes community-wide efforts such as the MicroArray and Sequencing Quality Control (MAQC/SEQC) project which have identified factors influencing the performance of these technologies. Consequently, consensus-based standards and well-documented best practices have been developed to improve the quality of scientific research, and reference materials and reference datasets have been made available for evaluating the technical proficiency in future studies. These efforts have built the foundation on which the translational application of genomics based technologies can help realize precision medicine.

Release of (and lessons learned from mining) a pioneering large toxicogenomics database

AIM

We release the Janssen Toxicogenomics database. This rat liver gene-expression database was generated using Codelink microarrays, and has been used over the past years within Janssen to derive signatures for multiple end points and to classify proprietary compounds.

MATERIALS & METHODS

The release consists of gene-expression responses to 124 compounds, selected to give a broad coverage of liver-active compounds. A selection of the compounds were also analyzed on Affymetrix microarrays.

RESULTS

The release includes results of an in-house reannotation pipeline to Entrez gene annotations, to classify probes into different confidence classes. High confidence unambiguously annotated probes were used to create gene-level data which served as starting point for cross-platform comparisons. Connectivity map-based similarity methods show excellent agreement between Codelink and Affymetrix runs of the same samples. We also compared our dataset with the Japanese Toxicogenomics Project and observed reasonable agreement, especially for compounds with stronger gene signatures. We describe an R-package containing the gene-level data and show how it can be used for expression-based similarity searches.

CONCLUSION

Comparing the same biological samples run on the Affymetrix and the Codelink platform, good correspondence is observed using connectivity mapping approaches. As expected, this correspondence is smaller when the data are compared with an independent dataset such as TG-GATE. We hope that this collection of gene-expression profiles will be incorporated in toxicogenomics pipelines of users.

An investigation of biomarkers derived from legacy microarray data for their utility in the RNA-seq era

BACKGROUND

Gene expression microarray has been the primary biomarker platform ubiquitously applied in biomedical research, resulting in enormous data, predictive models, and biomarkers accrued. Recently, RNA-seq has looked likely to replace microarrays, but there will be a period where both technologies co-exist. This raises two important questions: Can microarray-based models and biomarkers be directly applied to RNA-seq data? Can future RNA-seq-based predictive models and biomarkers be applied to microarray data to leverage past investment?

RESULTS

We systematically evaluated the transferability of predictive models and signature genes between microarray and RNA-seq using two large clinical data sets. The complexity of cross-platform sequence correspondence was considered in the analysis and examined using three human and two rat data sets, and three levels of mapping complexity were revealed. Three algorithms representing different modeling complexity were applied to the three levels of mappings for each of the eight binary endpoints and Cox regression was used to model survival times with expression data. In total, 240,096 predictive models were examined.

CONCLUSIONS

Signature genes of predictive models are reciprocally transferable between microarray and RNA-seq data for model development, and microarray-based models can accurately predict RNA-seq-profiled samples; while RNA-seq-based models are less accurate in predicting microarray-profiled samples and are affected both by the choice of modeling algorithm and the gene mapping complexity. The results suggest continued usefulness of legacy microarray data and established microarray biomarkers and predictive models in the forthcoming RNA-seq era.

The concordance between RNA-seq and microarray data depends on chemical treatment and transcript abundance

The concordance of RNA-sequencing (RNA-seq) with microarrays for genome-wide analysis of differential gene expression has not been rigorously assessed using a range of chemical treatment conditions. Here we use a comprehensive study design to generate Illumina RNA-seq and Affymetrix microarray data from the same liver samples of rats exposed in triplicate to varying degrees of perturbation by 27 chemicals representing multiple modes of action (MOAs). The cross-platform concordance in terms of differentially expressed genes (DEGs) or enriched pathways is linearly correlated with treatment effect size (R(2)0.8). Furthermore, the concordance is also affected by transcript abundance and biological complexity of the MOA. RNA-seq outperforms microarray (93% versus 75%) in DEG verification as assessed by quantitative PCR, with the gain mainly due to its improved accuracy for low-abundance transcripts. Nonetheless, classifiers to predict MOAs perform similarly when developed using data from either platform. Therefore, the endpoint studied and its biological complexity, transcript abundance and the genomic application are important factors in transcriptomic research and for clinical and regulatory decision making.

Microarray-based RNA profiling of breast cancer: batch effect removal improves cross-platform consistency

Microarray is a powerful technique used extensively for gene expression analysis. Different technologies are available, but lack of standardization makes it challenging to compare and integrate data. Furthermore, batch-related biases within datasets are common but often not tackled. We have analyzed the same 234 breast cancers on two different microarray platforms. One dataset contained known batch-effects associated with the fabrication procedure used. The aim was to assess the significance of correcting for systematic batch-effects when integrating data from different platforms. We here demonstrate the importance of detecting batch-effects and how tools, such as ComBat, can be used to successfully overcome such systematic variations in order to unmask essential biological signals. Batch adjustment was found to be particularly valuable in the detection of more delicate differences in gene expression. Furthermore, our results show that prober adjustment is essential for integration of gene expression data obtained from multiple sources. We show that high-variance genes are highly reproducibly expressed across platforms making them particularly well suited as biomarkers and for building gene signatures, exemplified by prediction of estrogen-receptor status and molecular subtypes. In conclusion, the study emphasizes the importance of utilizing proper batch adjustment methods when integrating data across different batches and platforms.

Prediction of clinically relevant safety signals of nephrotoxicity through plasma metabolite profiling

Addressing safety concerns such as drug-induced kidney injury (DIKI) early in the drug pharmaceutical development process ensures both patient safety and efficient clinical development. We describe a unique adjunct to standard safety assessment wherein the metabolite profile of treated animals is compared with the MetaMap Tox metabolomics database in order to predict the potential for a wide variety of adverse events, including DIKI. To examine this approach, a study of five compounds (phenytoin, cyclosporin A, doxorubicin, captopril, and lisinopril) was initiated by the Technology Evaluation Consortium under the auspices of the Drug Safety Executive Council (DSEC). The metabolite profiles for rats treated with these compounds matched established reference patterns in the MetaMap Tox metabolomics database indicative of each compound's well-described clinical toxicities. For example, the DIKI associated with cyclosporine A and doxorubicin was correctly predicted by metabolite profiling, while no evidence for DIKI was found for phenytoin, consistent with its clinical picture. In some cases the clinical toxicity (hepatotoxicity), not generally seen in animal studies, was detected with MetaMap Tox. Thus metabolite profiling coupled with the MetaMap Tox metabolomics database offers a unique and powerful approach for augmenting safety assessment and avoiding clinical adverse events such as DIKI.

A network pharmacology approach to evaluating the efficacy of chinese medicine using genome-wide transcriptional expression data

The research of multicomponent drugs, such as in Chinese Medicine, on both mechanism dissection and drug discovery is challenging, especially the approaches to systematically evaluating the efficacy at a molecular level. Here, we presented a network pharmacology-based approach to evaluating the efficacy of multicomponent drugs by genome-wide transcriptional expression data and applied it to Shenmai injection (SHENMAI), a widely used Chinese Medicine composed of red ginseng (RG) and Radix Ophiopogonis (RO) in clinically treating myocardial ischemia (MI) diseases. The disease network, MI network in this case, was constructed by combining the protein-protein interactions (PPI) involved in the MI enriched pathways. The therapeutic efficacy of SHENMAI, RG, and RO was therefore evaluated by a network parameter, namely, network recovery index (NRI), which quantitatively evaluates the overall recovery rate in MI network. The NRI of SHENMAI, RG, and RO were 0.865, 0.425, and 0.271 respectively [corrected], which indicated SHENMAI exerts protective effects and the synergistic effect of RG and RO on treating myocardial ischemia disease. The successful application of SHENMAI implied that the proposed network pharmacology-based approach could help researchers to better evaluate a multicomponent drug on a systematic and molecular level.

Application of DNA microarray technology to gerontological studies

Gene expression patterns change dramatically in aging and age-related events. The DNA microarray is now recognized as a useful device in molecular biology and widely used to identify the molecular mechanisms of aging and the biological effects of drugs for therapeutic purpose in age-related diseases. Recently, numerous technological advantages have led to the evolution of DNA microarrays and microarray-based techniques, revealing the genomic modification and all transcriptional activity. Here, we show the step-by-step methods currently used in our lab to handling the oligonucleotide microarray and miRNA microarray. Moreover, we introduce the protocols of ribonucleoprotein [RNP] immunoprecipitation followed by microarray analysis (RIP-chip) which reveal the target mRNA of age-related RNA-binding proteins.

Reverse engineering biomolecular systems using -omic data: challenges, progress and opportunities

Recent advances in high-throughput biotechnologies have led to the rapid growing research interest in reverse engineering of biomolecular systems (REBMS). 'Data-driven' approaches, i.e. data mining, can be used to extract patterns from large volumes of biochemical data at molecular-level resolution while 'design-driven' approaches, i.e. systems modeling, can be used to simulate emergent system properties. Consequently, both data- and design-driven approaches applied to -omic data may lead to novel insights in reverse engineering biological systems that could not be expected before using low-throughput platforms. However, there exist several challenges in this fast growing field of reverse engineering biomolecular systems: (i) to integrate heterogeneous biochemical data for data mining, (ii) to combine top-down and bottom-up approaches for systems modeling and (iii) to validate system models experimentally. In addition to reviewing progress made by the community and opportunities encountered in addressing these challenges, we explore the emerging field of synthetic biology, which is an exciting approach to validate and analyze theoretical system models directly through experimental synthesis, i.e. analysis-by-synthesis. The ultimate goal is to address the present and future challenges in reverse engineering biomolecular systems (REBMS) using integrated workflow of data mining, systems modeling and synthetic biology.

Evaluation of drug-induced tissue injury by measuring alanine aminotransferase (ALT) activity in silkworm hemolymph

Background

Our previous studies suggest silkworms can be used as model animals instead of mammals in pharmacologic studies to develop novel therapeutic medicines. We examined the usefulness of the silkworm larvae Bombyx mori as an animal model for evaluating tissue injury induced by various cytotoxic drugs. Drugs that induce hepatotoxic effects in mammals were injected into the silkworm hemocoel, and alanine aminotransferase (ALT) activity was measured in the hemolymph 1 day later.

Results

Injection of CCl₄ into the hemocoel led to an increase in ALT activity. The increase in ALT activity was attenuated by pretreatment with N-acetyl-_L-cysteine. Injection of benzoic acid derivatives, ferric sulfate, sodium valproate, tetracycline, amiodarone hydrochloride, methyldopa, ketoconazole, pemoline (Betanamin), N-nitroso-fenfluramine, and _D-galactosamine also increased ALT activity.

Conclusions

These findings indicate that silkworms are useful for evaluating the effects of chemicals that induce tissue injury in mammals.

Direct integration of intensity-level data from Affymetrix and Illumina microarrays improves statistical power for robust reanalysis

Background

Affymetrix GeneChips and Illumina BeadArrays are the most widely used commercial single channel gene expression microarrays. Public data repositories are an extremely valuable resource, providing array-derived gene expression measurements from many thousands of experiments. Unfortunately many of these studies are underpowered and it is desirable to improve power by combining data from more than one study; we sought to determine whether platform-specific bias precludes direct integration of probe intensity signals for combined reanalysis.

Results

Using Affymetrix and Illumina data from the microarray quality control project, from our own clinical samples, and from additional publicly available datasets we evaluated several approaches to directly integrate intensity level expression data from the two platforms. After mapping probe sequences to Ensembl genes we demonstrate that, ComBat and cross platform normalisation (XPN), significantly outperform mean-centering and distance-weighted discrimination (DWD) in terms of minimising inter-platform variance. In particular we observed that DWD, a popular method used in a number of previous studies, removed systematic bias at the expense of genuine biological variability, potentially reducing legitimate biological differences from integrated datasets.

Conclusion

Normalised and batch-corrected intensity-level data from Affymetrix and Illumina microarrays can be directly combined to generate biologically meaningful results with improved statistical power for robust, integrated reanalysis.

Quality assurance of RNA expression profiling in clinical laboratories

RNA expression profiles are increasingly used to diagnose and classify disease, based on expression patterns of as many as several thousand RNAs. To ensure quality of expression profiling services in clinical settings, a standard operating procedure incorporates multiple quality indicators and controls, beginning with preanalytic specimen preparation and proceeding thorough analysis, interpretation, and reporting. Before testing, histopathological examination of each cellular specimen, along with optional cell enrichment procedures, ensures adequacy of the input tissue. Other tactics include endogenous controls to evaluate adequacy of RNA and exogenous or spiked controls to evaluate run- and patient-specific performance of the test system, respectively. Unique aspects of quality assurance for array-based tests include controls for the pertinent outcome signatures that often supersede controls for each individual analyte, built-in redundancy for critical analytes or biochemical pathways, and software-supported scrutiny of abundant data by a laboratory physician who interprets the findings in a manner facilitating appropriate medical intervention. Access to high-quality reagents, instruments, and software from commercial sources promotes standardization and adoption in clinical settings, once an assay is vetted in validation studies as being analytically sound and clinically useful. Careful attention to the well-honed principles of laboratory medicine, along with guidance from government and professional groups on strategies to preserve RNA and manage large data sets, promotes clinical-grade assay performance.

Predictive Power Estimation Algorithm (PPEA)--a new algorithm to reduce overfitting for genomic biomarker discovery

Toxicogenomics promises to aid in predicting adverse effects, understanding the mechanisms of drug action or toxicity, and uncovering unexpected or secondary pharmacology. However, modeling adverse effects using high dimensional and high noise genomic data is prone to over-fitting. Models constructed from such data sets often consist of a large number of genes with no obvious functional relevance to the biological effect the model intends to predict that can make it challenging to interpret the modeling results. To address these issues, we developed a novel algorithm, Predictive Power Estimation Algorithm (PPEA), which estimates the predictive power of each individual transcript through an iterative two-way bootstrapping procedure. By repeatedly enforcing that the sample number is larger than the transcript number, in each iteration of modeling and testing, PPEA reduces the potential risk of overfitting. We show with three different cases studies that: (1) PPEA can quickly derive a reliable rank order of predictive power of individual transcripts in a relatively small number of iterations, (2) the top ranked transcripts tend to be functionally related to the phenotype they are intended to predict, (3) using only the most predictive top ranked transcripts greatly facilitates development of multiplex assay such as qRT-PCR as a biomarker, and (4) more importantly, we were able to demonstrate that a small number of genes identified from the top-ranked transcripts are highly predictive of phenotype as their expression changes distinguished adverse from nonadverse effects of compounds in completely independent tests. Thus, we believe that the PPEA model effectively addresses the over-fitting problem and can be used to facilitate genomic biomarker discovery for predictive toxicology and drug responses.

Clinical implementation of RNA signatures for pharmacogenomic decision-making

RNA profiling is increasingly used to predict drug response, dose, or toxicity based on analysis of drug pharmacokinetic or pharmacodynamic pathways. Before implementing multiplexed RNA arrays in clinical practice, validation studies are carried out to demonstrate sufficient evidence of analytic and clinical performance, and to establish an assay protocol with quality assurance measures. Pathologists assure quality by selecting input tissue and by interpreting results in the context of the input tissue as well as the technologies that were used and the clinical setting in which the test was ordered. A strength of RNA profiling is the array-based measurement of tens to thousands of RNAs at once, including redundant tests for critical analytes or pathways to promote confidence in test results. Instrument and reagent manufacturers are crucial for supplying reliable components of the test system. Strategies for quality assurance include careful attention to RNA preservation and quality checks at pertinent steps in the assay protocol, beginning with specimen collection and proceeding through the various phases of transport, processing, storage, analysis, interpretation, and reporting. Specimen quality is checked by probing housekeeping transcripts, while spiked and exogenous controls serve as a check on analytic performance of the test system. Software is required to manipulate abundant array data and present it for interpretation by a laboratory physician who reports results in a manner facilitating therapeutic decision-making. Maintenance of the assay requires periodic documentation of personnel competency and laboratory proficiency. These strategies are shepherding genomic arrays into clinical settings to provide added value to patients and to the larger health care system.

Transcriptional profiling to identify biomarkers of disease and drug response

The discovery, biological qualification and analytical validation of genomic biomarkers requires extensive collaborations between individuals with expertise in biology, statistics, bioinformatics, chemistry, clinical medicine, regulatory science and so on. For clinical utility, blood-borne biomarkers (e.g., mRNA and miRNA) of organ damage, drug toxicity and/or response would be preferred to those that are tissue based. Currently used biomarkers such as serum creatinine (indicating renal dysfunction) denote organ damage whether caused by disease, physical injury or drugs. Therefore, it is anticipated that studies of disease will discover biomarkers that can also be used to identify drug-induced injury and vice versa. This article describes transcriptomic blood-borne biomarkers that have been reported to be connected with disease and drug toxicity. Much more qualification and validation needs to be carried out before many of these biomarkers can prove useful. Discussed here are some of the lessons learned and roadblocks to success.

Microarrays, deep sequencing and the true measure of the transcriptome

Microarrays first made the analysis of the transcriptome possible, and have produced much important information. Today, however, researchers are increasingly turning to direct high-throughput sequencing - RNA-Seq - which has considerable advantages for examining transcriptome fine structure - for example in the detection of allele-specific expression and splice junctions. In this article, we discuss the relative merits of the two techniques, the inherent biases in each, and whether all of the vast body of array work needs to be revisited using the newer technology. We conclude that microarrays remain useful and accurate tools for measuring expression levels, and RNA-Seq complements and extends microarray measurements.

Cross-platform comparison of microarray-based multiple-class prediction

High-throughput microarray technology has been widely applied in biological and medical decision-making research during the past decade. However, the diversity of platforms has made it a challenge to re-use and/or integrate datasets generated in different experiments or labs for constructing array-based diagnostic models. Using large toxicogenomics datasets generated using both Affymetrix and Agilent microarray platforms, we carried out a benchmark evaluation of cross-platform consistency in multiple-class prediction using three widely-used machine learning algorithms. After an initial assessment of model performance on different platforms, we evaluated whether predictive signature features selected in one platform could be directly used to train a model in the other platform and whether predictive models trained using data from one platform could predict datasets profiled using the other platform with comparable performance. Our results established that it is possible to successfully apply multiple-class prediction models across different commercial microarray platforms, offering a number of important benefits such as accelerating the possible translation of biomarkers identified with microarrays to clinically-validated assays. However, this investigation focuses on a technical platform comparison and is actually only the beginning of exploring cross-platform consistency. Further studies are needed to confirm the feasibility of microarray-based cross-platform prediction, especially using independent datasets.

Gene expression profiling in follicular lymphoma and its implication for clinical practice

Follicular lymphoma (FL) is characterized by an indolent and relapsing course. Recently, the clinical outcome of FL has been distinguished by immune microenvironment-associated gene signatures. In our study, gene expression profiling (GEP) was performed in 31 non-selected patients with follicular lymphoma (FL), 12 of whom were in relapse and the remaining 19 newly diagnosed. A custom oligonucleotide microarray (Agilent 8 × 15K) was used which contained probes for about 3500 genes, including those that had been previously published as demonstrating significant prognostic value. An unsupervised approach was not able to recognize clinically different FLs. As the previously published prognostically relevant gene signatures could not be properly verified, probably due to microarray platform differences, template matching was therefore used in order to define two gene sets with differential gene expression among our samples. These gene sets shared an overrepresentation of genes with similar biological functions and were termed 'T-CELL' and 'PROLIFERATION' profiles. The 'poor profile' was then defined by a high PROLIFERATION score (upper tertile) and/or low T-CELL score (lower tertile). The 'poor profile' cohort contained a significantly higher proportion of relapsed cases (p < 0.05, Fisher's exact test). Additionally, a comparison of samples from initial diagnosis and from relapse showed significant differences mainly in the T-CELL profile (p = 0.036; χ(2)). This supports the hypothesis that the number of T-cells and their expression pattern play a major role in FL development.

A comparison of batch effect removal methods for enhancement of prediction performance using MAQC-II microarray gene expression data

Batch effects are the systematic non-biological differences between batches (groups) of samples in microarray experiments due to various causes such as differences in sample preparation and hybridization protocols. Previous work focused mainly on the development of methods for effective batch effects removal. However, their impact on cross-batch prediction performance, which is one of the most important goals in microarray-based applications, has not been addressed. This paper uses a broad selection of data sets from the Microarray Quality Control Phase II (MAQC-II) effort, generated on three microarray platforms with different causes of batch effects to assess the efficacy of their removal. Two data sets from cross-tissue and cross-platform experiments are also included. Of the 120 cases studied using Support vector machines (SVM) and K nearest neighbors (KNN) as classifiers and Matthews correlation coefficient (MCC) as performance metric, we find that Ratio-G, Ratio-A, EJLR, mean-centering and standardization methods perform better or equivalent to no batch effect removal in 89, 85, 83, 79 and 75% of the cases, respectively, suggesting that the application of these methods is generally advisable and ratio-based methods are preferred.

The MicroArray Quality Control (MAQC)-II study of common practices for the development and validation of microarray-based predictive models

Gene expression data from microarrays are being applied to predict preclinical and clinical endpoints, but the reliability of these predictions has not been established. In the MAQC-II project, 36 independent teams analyzed six microarray data sets to generate predictive models for classifying a sample with respect to one of 13 endpoints indicative of lung or liver toxicity in rodents, or of breast cancer, multiple myeloma or neuroblastoma in humans. In total, >30,000 models were built using many combinations of analytical methods. The teams generated predictive models without knowing the biological meaning of some of the endpoints and, to mimic clinical reality, tested the models on data that had not been used for training. We found that model performance depended largely on the endpoint and team proficiency and that different approaches generated models of similar performance. The conclusions and recommendations from MAQC-II should be useful for regulatory agencies, study committees and independent investigators that evaluate methods for global gene expression analysis.