251
|
Shi L, Jones WD, Jensen RV, Harris SC, Perkins RG, Goodsaid FM, Guo L, Croner LJ, Boysen C, Fang H, Qian F, Amur S, Bao W, Barbacioru CC, Bertholet V, Cao XM, Chu TM, Collins PJ, Fan XH, Frueh FW, Fuscoe JC, Guo X, Han J, Herman D, Hong H, Kawasaki ES, Li QZ, Luo Y, Ma Y, Mei N, Peterson RL, Puri RK, Shippy R, Su Z, Sun YA, Sun H, Thorn B, Turpaz Y, Wang C, Wang SJ, Warrington JA, Willey JC, Wu J, Xie Q, Zhang L, Zhang L, Zhong S, Wolfinger RD, Tong W. The balance of reproducibility, sensitivity, and specificity of lists of differentially expressed genes in microarray studies. BMC Bioinformatics 2008; 9 Suppl 9:S10. [PMID: 18793455 PMCID: PMC2537561 DOI: 10.1186/1471-2105-9-s9-s10] [Citation(s) in RCA: 183] [Impact Index Per Article: 11.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Reproducibility is a fundamental requirement in scientific experiments. Some recent publications have claimed that microarrays are unreliable because lists of differentially expressed genes (DEGs) are not reproducible in similar experiments. Meanwhile, new statistical methods for identifying DEGs continue to appear in the scientific literature. The resultant variety of existing and emerging methods exacerbates confusion and continuing debate in the microarray community on the appropriate choice of methods for identifying reliable DEG lists. RESULTS Using the data sets generated by the MicroArray Quality Control (MAQC) project, we investigated the impact on the reproducibility of DEG lists of a few widely used gene selection procedures. We present comprehensive results from inter-site comparisons using the same microarray platform, cross-platform comparisons using multiple microarray platforms, and comparisons between microarray results and those from TaqMan - the widely regarded "standard" gene expression platform. Our results demonstrate that (1) previously reported discordance between DEG lists could simply result from ranking and selecting DEGs solely by statistical significance (P) derived from widely used simple t-tests; (2) when fold change (FC) is used as the ranking criterion with a non-stringent P-value cutoff filtering, the DEG lists become much more reproducible, especially when fewer genes are selected as differentially expressed, as is the case in most microarray studies; and (3) the instability of short DEG lists solely based on P-value ranking is an expected mathematical consequence of the high variability of the t-values; the more stringent the P-value threshold, the less reproducible the DEG list is. These observations are also consistent with results from extensive simulation calculations. CONCLUSION We recommend the use of FC-ranking plus a non-stringent P cutoff as a straightforward and baseline practice in order to generate more reproducible DEG lists. Specifically, the P-value cutoff should not be stringent (too small) and FC should be as large as possible. Our results provide practical guidance to choose the appropriate FC and P-value cutoffs when selecting a given number of DEGs. The FC criterion enhances reproducibility, whereas the P criterion balances sensitivity and specificity.
Collapse
Affiliation(s)
- Leming Shi
- National Center for Toxicological Research, US Food and Drug Administration, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Wendell D Jones
- Expression Analysis Inc., 2605 Meridian Parkway, Durham, NC 27713, USA
| | - Roderick V Jensen
- University of Massachusetts Boston, Department of Physics, 100 Morrissey Boulevard, Boston, MA 02125, USA
| | - Stephen C Harris
- National Center for Toxicological Research, US Food and Drug Administration, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Roger G Perkins
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Federico M Goodsaid
- Center for Drug Evaluation and Research, US Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, MD 20993, USA
| | - Lei Guo
- National Center for Toxicological Research, US Food and Drug Administration, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Lisa J Croner
- Biogen Idec Inc., 5200 Research Place, San Diego, CA 92122, USA
| | - Cecilie Boysen
- ViaLogy Inc., 2400 Lincoln Avenue, Altadena, CA 91001, USA
| | - Hong Fang
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Feng Qian
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Shashi Amur
- Center for Drug Evaluation and Research, US Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, MD 20993, USA
| | - Wenjun Bao
- SAS Institute Inc., SAS Campus Drive, Cary, NC 27513, USA
| | | | - Vincent Bertholet
- Eppendorf Array Technologies, rue du Séminaire 20a, 5000 Namur, Belgium
| | - Xiaoxi Megan Cao
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Tzu-Ming Chu
- SAS Institute Inc., SAS Campus Drive, Cary, NC 27513, USA
| | - Patrick J Collins
- Agilent Technologies Inc., 5301 Stevens Creek Boulevard, Santa Clara, CA 95051, USA
| | - Xiao-hui Fan
- National Center for Toxicological Research, US Food and Drug Administration, 3900 NCTR Road, Jefferson, AR 72079, USA
- Pharmaceutical Informatics Institute, Zhejiang University, Hangzhou 310027, China
| | - Felix W Frueh
- Center for Drug Evaluation and Research, US Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, MD 20993, USA
| | - James C Fuscoe
- National Center for Toxicological Research, US Food and Drug Administration, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Xu Guo
- Affymetrix Inc., 3420 Central Expressway, Santa Clara, CA 95051, USA
| | - Jing Han
- Center for Biologics Evaluation and Research, US Food and Drug Administration, 8800 Rockville Pike, Bethesda, MD 20892, USA
| | - Damir Herman
- National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health, 8600 Rockville Pike, Bethesda, MD 20894, USA
| | - Huixiao Hong
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Ernest S Kawasaki
- National Cancer Institute Advanced Technology Center, 8717 Grovemont Circle, Gaithersburg, MD 20877, USA
| | - Quan-Zhen Li
- University of Texas Southwestern Medical Center, 6000 Harry Hines Boulevard, Dallas, TX 75390, USA
| | - Yuling Luo
- Panomics Inc., 6519 Dumbarton Circle, Fremont, CA 94555, USA
| | - Yunqing Ma
- Panomics Inc., 6519 Dumbarton Circle, Fremont, CA 94555, USA
| | - Nan Mei
- National Center for Toxicological Research, US Food and Drug Administration, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Ron L Peterson
- Novartis Institutes for Biomedical Research, 250 Massachusetts Avenue, Cambridge, MA 02139, USA
| | - Raj K Puri
- Center for Biologics Evaluation and Research, US Food and Drug Administration, 8800 Rockville Pike, Bethesda, MD 20892, USA
| | - Richard Shippy
- GE Healthcare, 7700 S River Parkway, Tempe, AZ 85284, USA
| | - Zhenqiang Su
- National Center for Toxicological Research, US Food and Drug Administration, 3900 NCTR Road, Jefferson, AR 72079, USA
| | | | - Hongmei Sun
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Brett Thorn
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Yaron Turpaz
- Pharmaceutical Informatics Institute, Zhejiang University, Hangzhou 310027, China
| | - Charles Wang
- UCLA David Geffen School of Medicine, Transcriptional Genomics Core, Cedars-Sinai Medical Center, 8700 Beverly Boulevard, Los Angeles, CA 90048, USA
| | - Sue Jane Wang
- Center for Drug Evaluation and Research, US Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, MD 20993, USA
| | | | - James C Willey
- Ohio Medical University, 3000 Arlington Avenue, Toledo, OH 43614, USA
| | - Jie Wu
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Qian Xie
- Z-Tech Corporation, an ICF International Company at NCTR/FDA, 3900 NCTR Road, Jefferson, AR 72079, USA
| | - Liang Zhang
- CapitalBio Corporation, 18 Life Science Parkway, Changping District, Beijing 102206, China
| | - Lu Zhang
- Solexa Inc., 25861 Industrial Boulevard, Hayward, CA 94545, USA
| | - Sheng Zhong
- University of Illinois at Urbana-Champaign, Department of Bioengineering, 1304 W. Springfield Avenue, Urbana, IL 61801, USA
| | | | - Weida Tong
- National Center for Toxicological Research, US Food and Drug Administration, 3900 NCTR Road, Jefferson, AR 72079, USA
| |
Collapse
|
252
|
Wang XD, Reeves K, Luo FR, Xu LA, Lee F, Clark E, Huang F. Identification of candidate predictive and surrogate molecular markers for dasatinib in prostate cancer: rationale for patient selection and efficacy monitoring. Genome Biol 2008; 8:R255. [PMID: 18047674 PMCID: PMC2258199 DOI: 10.1186/gb-2007-8-11-r255] [Citation(s) in RCA: 68] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2007] [Revised: 10/22/2007] [Accepted: 11/29/2007] [Indexed: 02/08/2023] Open
Abstract
BACKGROUND Dasatinib is a potent, multi-targeted kinase inhibitor that was recently approved for treatment of chronic myelogenous leukemia resistant to imatinib. To aid the clinical development of dasatinib in prostate cancer, we utilized preclinical models to identify potential molecular markers for patient stratification and efficacy monitoring. RESULTS Using gene expression profiling, we first identified 174 genes whose expression was highly correlated with in vitro sensitivity of 16 cell lines and, thus, considered as candidate efficacy predictive markers. Among these are important prostatic cell lineage markers, cytokeratin 5, androgen receptor and prostate specific antigen. Our results indicate that 'basal type' cell lines with high expression of cytokeratin 5 and low expression of androgen receptor or prostate specific antigen are sensitive to dasatinib. To identify markers as surrogates for biological activity, we treated cell lines with dasatinib and identified genes whose expression was significantly modulated by the drug. Ten genes, including that encoding urokinase-type plasminogen activator (uPA), were found to not only be potential efficacy markers but also to have reduced expression upon dasatinib treatment. The down-regulation of uPA by dasatinib was drug-specific and correlated with the sensitivity of cell lines to dasatinib. Furthermore, EphA2, a target of dasatinib, was found to be a sensitivity biomarker. CONCLUSION Using the gene expression profiling approach and preclinical models, we have identified prostatic biomarkers that are associated with sensitivity to dasatinib. This study has provided a basis for clinical evaluation of a potential dasatinib efficacy signature in prostate cancer.
Collapse
Affiliation(s)
- Xi-De Wang
- Pharmaceutical Research Institute, Bristol-Myers Squibb, Princeton, New Jersey, 08543, USA.
| | | | | | | | | | | | | |
Collapse
|
253
|
Diez D, Grijota-Martinez C, Agretti P, De Marco G, Tonacchera M, Pinchera A, de Escobar GM, Bernal J, Morte B. Thyroid hormone action in the adult brain: gene expression profiling of the effects of single and multiple doses of triiodo-L-thyronine in the rat striatum. Endocrinology 2008; 149:3989-4000. [PMID: 18467437 DOI: 10.1210/en.2008-0350] [Citation(s) in RCA: 55] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/02/2023]
Abstract
Thyroid hormones have profound effects on mood and behavior, but the molecular basis of thyroid hormone action in the adult brain is relatively unknown. In particular, few thyroid hormone-dependent genes have been identified in the adult brain despite extensive work carried out on the developing brain. In this work we performed global analysis of gene expression in the adult rat striatum in search for genomic changes taking place after administration of T(3) to hypothyroid rats. The hormone was administered in two different schedules: 1) a single, large dose of 25 microg per 100 g body weight (SD) or 2) 1.5 microg per 100 g body weight once daily for 5 d (RD). Twenty-four hours after the single or last of multiple doses, gene expression in the striatum was analyzed using Codelink microarrays. SD caused up-regulation of 149 genes and down-regulation of 88 genes. RD caused up-regulation of 18 genes and down-regulation of one gene. The results were confirmed by hybridization to Affymetrix microarrays and by TaqMan PCR. Among the genes identified are genes involved in circadian regulation and the regulation of signaling pathways in the striatum. These results suggest that thyroid hormone is involved in regulation of striatal physiology at multiple control points. In addition, they may explain the beneficial effects of large doses of thyroid hormone in bipolar disorders.
Collapse
Affiliation(s)
- Diego Diez
- Instituto de Investigaciones Biomédicas, Consejo Superior de Investigaciones Científicas and Universidad Autónoma de Madrid, Madrid, Spain
| | | | | | | | | | | | | | | | | |
Collapse
|
254
|
Construction and application of an avian intestinal intraepithelial lymphocyte cDNA microarray (AVIELA) for gene expression profiling during Eimeria maxima infection. Vet Immunol Immunopathol 2008; 124:341-54. [DOI: 10.1016/j.vetimm.2008.04.013] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2007] [Revised: 04/14/2008] [Accepted: 04/22/2008] [Indexed: 11/19/2022]
|
255
|
Zhang M, Yao C, Guo Z, Zou J, Zhang L, Xiao H, Wang D, Yang D, Gong X, Zhu J, Li Y, Li X. Apparently low reproducibility of true differential expression discoveries in microarray studies. ACTA ACUST UNITED AC 2008; 24:2057-63. [PMID: 18632747 DOI: 10.1093/bioinformatics/btn365] [Citation(s) in RCA: 90] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
MOTIVATION Differentially expressed gene (DEG) lists detected from different microarray studies for a same disease are often highly inconsistent. Even in technical replicate tests using identical samples, DEG detection still shows very low reproducibility. It is often believed that current small microarray studies will largely introduce false discoveries. RESULTS Based on a statistical model, we show that even in technical replicate tests using identical samples, it is highly likely that the selected DEG lists will be very inconsistent in the presence of small measurement variations. Therefore, the apparently low reproducibility of DEG detection from current technical replicate tests does not indicate low quality of microarray technology. We also demonstrate that heterogeneous biological variations existing in real cancer data will further reduce the overall reproducibility of DEG detection. Nevertheless, in small subsamples from both simulated and real data, the actual false discovery rate (FDR) for each DEG list tends to be low, suggesting that each separately determined list may comprise mostly true DEGs. Rather than simply counting the overlaps of the discovery lists from different studies for a complex disease, novel metrics are needed for evaluating the reproducibility of discoveries characterized with correlated molecular changes. Supplementaty information: Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Min Zhang
- School of Bioinformatics Science and Technology, Harbin Medical University, Harbin 150086, China
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
256
|
Jordan R, Patel S, Hu H, Lyons-Weiler J. Efficiency analysis of competing tests for finding differentially expressed genes in lung adenocarcinoma. Cancer Inform 2008; 6:389-421. [PMID: 19259419 PMCID: PMC2623303 DOI: 10.4137/cin.s791] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
In this study, we introduce and use Efficiency Analysis to compare differences in the apparent internal and external consistency of competing normalization methods and tests for identifying differentially expressed genes. Using publicly available data, two lung adenocarcinoma datasets were analyzed using caGEDA (http://bioinformatics2.pitt.edu/GE2/GEDA.html) to measure the degree of differential expression of genes existing between two populations. The datasets were randomly split into at least two subsets, each analyzed for differentially expressed genes between the two sample groups, and the gene lists compared for overlapping genes. Efficiency Analysis is an intuitive method that compares the differences in the percentage of overlap of genes from two or more data subsets, found by the same test over a range of testing methods. Tests that yield consistent gene lists across independently analyzed splits are preferred to those that yield less consistent inferences. For example, a method that exhibits 50% overlap in the 100 top genes from two studies should be preferred to a method that exhibits 5% overlap in the top 100 genes. The same procedure was performed using all available normalization and transformation methods that are available through caGEDA. The ‘best’ test was then further evaluated using internal cross-validation to estimate generalizable sample classification errors using a Naïve Bayes classification algorithm. A novel test, termed D1 (a derivative of the J5 test) was found to be the most consistent, and to exhibit the lowest overall classification error, and highest sensitivity and specificity. The D1 test relaxes the assumption that few genes are differentially expressed. Efficiency Analysis can be misleading if the tests exhibit a bias in any particular dimension (e.g. expression intensity); we therefore explored intensity-scaled and segmented J5 tests using data in which all genes are scaled to share the same intensity distribution range. Efficiency Analysis correctly predicted the ‘best’ test and normalization method using the Beer dataset and also performed well with the Bhattacharjee dataset based on both efficiency and classification accuracy criteria.
Collapse
Affiliation(s)
- Rick Jordan
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh, PA 15260, USA.
| | | | | | | |
Collapse
|
257
|
Arikawa E, Sun Y, Wang J, Zhou Q, Ning B, Dial SL, Guo L, Yang J. Cross-platform comparison of SYBR Green real-time PCR with TaqMan PCR, microarrays and other gene expression measurement technologies evaluated in the MicroArray Quality Control (MAQC) study. BMC Genomics 2008; 9:328. [PMID: 18620571 PMCID: PMC2491643 DOI: 10.1186/1471-2164-9-328] [Citation(s) in RCA: 118] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2007] [Accepted: 07/11/2008] [Indexed: 12/02/2022] Open
Abstract
Background The MicroArray Quality Control (MAQC) project evaluated the inter- and intra-platform reproducibility of seven microarray platforms and three quantitative gene expression assays in profiling the expression of two commercially available Reference RNA samples (Nat Biotechnol 24:1115-22, 2006). The tested microarrays were the platforms from Affymetrix, Agilent Technologies, Applied Biosystems, GE Healthcare, Illumina, Eppendorf and the National Cancer Institute, and quantitative gene expression assays included TaqMan® Gene Expression PCR Assay, Standardized (Sta) RT-PCR™ and QuantiGene®. The data showed great consistency in gene expression measurements across different microarray platforms, different technologies and test sites. However, SYBR® Green real-time PCR, another common technique utilized by half of all real-time PCR users for gene expression measurement, was not addressed in the MAQC study. In the present study, we compared the performance of SYBR Green PCR with TaqMan PCR, microarrays and other quantitative technologies using the same two Reference RNA samples as the MAQC project. We assessed SYBR Green real-time PCR using commercially available RT2 Profiler™ PCR Arrays from SuperArray, containing primer pairs that have been experimentally validated to ensure gene-specificity and high amplification efficiency. Results The SYBR Green PCR Arrays exhibit good reproducibility among different users, PCR instruments and test sites. In addition, the SYBR Green PCR Arrays have the highest concordance with TaqMan PCR, and a high level of concordance with other quantitative methods and microarrays that were evaluated in this study in terms of fold-change correlation and overlap of lists of differentially expressed genes. Conclusion These data demonstrate that SYBR Green real-time PCR delivers highly comparable results in gene expression measurement with TaqMan PCR and other high-density microarrays.
Collapse
Affiliation(s)
- Emi Arikawa
- SuperArray Bioscience Corporation, Frederick, MD 21704, USA.
| | | | | | | | | | | | | | | |
Collapse
|
258
|
Performance comparison of two microarray platforms to assess differential gene expression in human monocyte and macrophage cells. BMC Genomics 2008; 9:302. [PMID: 18578872 PMCID: PMC2464609 DOI: 10.1186/1471-2164-9-302] [Citation(s) in RCA: 36] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2008] [Accepted: 06/25/2008] [Indexed: 12/02/2022] Open
Abstract
Background In this study we assessed the respective ability of Affymetrix and Illumina microarray methodologies to answer a relevant biological question, namely the change in gene expression between resting monocytes and macrophages derived from these monocytes. Five RNA samples for each type of cell were hybridized to the two platforms in parallel. In addition, a reference list of differentially expressed genes (DEG) was generated from a larger number of hybridizations (mRNA from 86 individuals) using the RNG/MRC two-color platform. Results Our results show an important overlap of the Illumina and Affymetrix DEG lists. In addition, more than 70% of the genes in these lists were also present in the reference list. Overall the two platforms had very similar performance in terms of biological significance, evaluated by the presence in the DEG lists of an excess of genes belonging to Gene Ontology (GO) categories relevant for the biology of monocytes and macrophages. Our results support the conclusion of the MicroArray Quality Control (MAQC) project that the criteria used to constitute the DEG lists strongly influence the degree of concordance among platforms. However the importance of prioritizing genes by magnitude of effect (fold change) rather than statistical significance (p-value) to enhance cross-platform reproducibility recommended by the MAQC authors was not supported by our data. Conclusion Functional analysis based on GO enrichment demonstrates that the 2 compared technologies delivered very similar results and identified most of the relevant GO categories enriched in the reference list.
Collapse
|
259
|
Lobenhofer EK, Auman JT, Blackshear PE, Boorman GA, Bushel PR, Cunningham ML, Fostel JM, Gerrish K, Heinloth AN, Irwin RD, Malarkey DE, Merrick BA, Sieber SO, Tucker CJ, Ward SM, Wilson RE, Hurban P, Tennant RW, Paules RS. Gene expression response in target organ and whole blood varies as a function of target organ injury phenotype. Genome Biol 2008; 9:R100. [PMID: 18570634 PMCID: PMC2481421 DOI: 10.1186/gb-2008-9-6-r100] [Citation(s) in RCA: 38] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2007] [Revised: 02/28/2008] [Accepted: 06/20/2008] [Indexed: 12/13/2022] Open
Abstract
This report details the standardized experimental design and the different data streams that were collected (histopathology, clinical chemistry, hematology and gene expression from the target tissue (liver) and a bio-available tissue (blood)) after treatment with eight known hepatotoxicants (at multiple time points and doses with multiple biological replicates). The results of the study demonstrate the classification of histopathological differences, likely reflecting differences in mechanisms of cell-specific toxicity, using either liver tissue or blood transcriptomic data.
Collapse
Affiliation(s)
| | - J Todd Auman
- NIEHS Microarray Group, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
- Current address: Institute for Pharmacogenomics and Individualized Therapy, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | | | - Gary A Boorman
- National Toxicology Program, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Pierre R Bushel
- Biostatistics Branch, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Michael L Cunningham
- National Toxicology Program, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Jennifer M Fostel
- National Center for Toxicogenomics, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
- Laboratory of Respiratory Biology, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Kevin Gerrish
- NIEHS Microarray Group, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Alexandra N Heinloth
- NIEHS Microarray Group, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Richard D Irwin
- National Toxicology Program, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - David E Malarkey
- Laboratory of Experimental Pathology, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - B Alex Merrick
- Laboratory of Respiratory Biology, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Stella O Sieber
- NIEHS Microarray Group, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Charles J Tucker
- NIEHS Microarray Group, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Sandra M Ward
- Laboratory of Experimental Pathology, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Ralph E Wilson
- Laboratory of Experimental Pathology, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Patrick Hurban
- Cogenics, a Division of Clinical Data, Inc., Morrisville, NC 27560, USA
| | - Raymond W Tennant
- Cancer Biology Group, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709, USA
| | - Richard S Paules
- Environmental Stress and Cancer Group, National Institute of Environmental Health Sciences, National Institutes of Health, Research Triangle Park, NC 27709
| |
Collapse
|
260
|
Distinct roles of adenylyl cyclases 1 and 8 in opiate dependence: behavioral, electrophysiological, and molecular studies. Biol Psychiatry 2008; 63:1013-21. [PMID: 18222416 PMCID: PMC2442273 DOI: 10.1016/j.biopsych.2007.11.021] [Citation(s) in RCA: 49] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/20/2007] [Revised: 11/21/2007] [Accepted: 11/26/2007] [Indexed: 11/22/2022]
Abstract
BACKGROUND Opiate dependence is a result of adaptive changes in signal transduction networks in several brain regions. Noradrenergic neurons of the locus coeruleus (LC) have provided a useful model system in which to understand the molecular basis of these adaptive changes. One of most robust signaling adaptations to repeated morphine exposure in this brain region is upregulation of adenylyl cyclase (AC) activity. Earlier work revealed the selective induction of two calmodulin-dependent AC isoforms, AC1 and AC8, after chronic morphine, but their role in opiate dependence has remained unknown. METHODS Whole cell recordings from LC slices, behavioral paradigms for dependence, and gene array technology have been used to dissect the role of AC1 and AC8 in chronic morphine responses. RESULTS Both AC1 and AC8 knockout mice exhibit reduced opiate dependence on the basis of attenuated withdrawal; however, partially distinct withdrawal symptoms were affected in the two lines. Loss of AC1 or AC8 also attenuated the electrophysiological effects of morphine on LC neurons: knockout of either cyclase attenuated the chronic morphine-induced enhancement of baseline firing rates as well as of regulation of neuronal firing by forskolin (an activator of ACs). The DNA microarray analysis revealed that both AC1 and AC8 affect gene regulation in the LC by chronic morphine and, in addition to common genes, each cyclase influences the expression of a distinct subset of genes. CONCLUSIONS Together, these findings provide fundamentally new insight into the molecular and cellular basis of opiate dependence.
Collapse
|
261
|
Deng X, Xu J, Wang C. Improving the power for detecting overlapping genes from multiple DNA microarray-derived gene lists. BMC Bioinformatics 2008; 9 Suppl 6:S14. [PMID: 18541049 PMCID: PMC2423437 DOI: 10.1186/1471-2105-9-s6-s14] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
Abstract
Background In DNA microarray gene expression profiling studies, a fundamental task is to extract statistically significant genes that meet certain research hypothesis. Currently, Venn diagram is a frequently used method for identifying overlapping genes that meet the investigator's research hypotheses. However this simple operation of intersecting multiple gene lists, known as the Intersection-Union Tests (IUTs), is performed without knowing the incurred changes in Type 1 error rate and can lead to loss of discovery power. Results We developed an IUT adjustment procedure, called Relaxed IUT (RIUT), which is proved to be less conservative and more powerful for intersecting independent tests than the traditional Venn diagram approach. The advantage of the RIUT procedure over traditional IUT is demonstrated by empirical Monte-Carlo simulation and two real toxicogenomic gene expression case studies. Notably, the enhanced power of RIUT enables it to identify overlapping gene sets leading to identification of certain known related pathways which were not detected using the traditional IUT method. Conclusion We showed that traditional IUT via a Venn diagram is generally conservative, which may lead to loss discovery power in DNA microarray studies. RIUT is proved to be a more powerful alternative for performing IUTs in identifying overlapping genes from multiple gene lists derived from microarray gene expression profiling.
Collapse
Affiliation(s)
- Xutao Deng
- Transcriptional Genomics Core, Burns Allen Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
| | | | | |
Collapse
|
262
|
Ding LH, Xie Y, Park S, Xiao G, Story MD. Enhanced identification and biological validation of differential gene expression via Illumina whole-genome expression arrays through the use of the model-based background correction methodology. Nucleic Acids Res 2008; 36:e58. [PMID: 18450815 PMCID: PMC2425463 DOI: 10.1093/nar/gkn234] [Citation(s) in RCA: 54] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022] Open
Abstract
Despite the tremendous growth of microarray usage in scientific studies, there is a lack of standards for background correction methodologies, especially in single-color microarray platforms. Traditional background subtraction methods often generate negative signals and thus cause large amounts of data loss. Hence, some researchers prefer to avoid background corrections, which typically result in the underestimation of differential expression. Here, by utilizing nonspecific negative control features integrated into Illumina whole genome expression arrays, we have developed a method of model-based background correction for BeadArrays (MBCB). We compared the MBCB with a method adapted from the Affymetrix robust multi-array analysis algorithm and with no background subtraction, using a mouse acute myeloid leukemia (AML) dataset. We demonstrated that differential expression ratios obtained by using the MBCB had the best correlation with quantitative RT–PCR. MBCB also achieved better sensitivity in detecting differentially expressed genes with biological significance. For example, we demonstrated that the differential regulation of Tnfr2, Ikk and NF-kappaB, the death receptor pathway, in the AML samples, could only be detected by using data after MBCB implementation. We conclude that MBCB is a robust background correction method that will lead to more precise determination of gene expression and better biological interpretation of Illumina BeadArray data.
Collapse
Affiliation(s)
- Liang-Hao Ding
- Simmons Comprehensive Cancer Center Genomics Core Facility, Department of Radiation Oncology, Division of Molecular Radiation Biology, University of Texas Southwestern Medical Center at Dallas, Dallas, TX, USA
| | | | | | | | | |
Collapse
|
263
|
Quintana A, Molinero A, Borup R, Nielsen FC, Campbell IL, Penkowa M, Hidalgo J. Effect of astrocyte-targeted production of IL-6 on traumatic brain injury and its impact on the cortical transcriptome. Dev Neurobiol 2008; 68:195-208. [PMID: 18000830 DOI: 10.1002/dneu.20584] [Citation(s) in RCA: 31] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
Interleukin-6 (IL-6) is one of the key players in the response of the brain cortex to injury. We have described previously that astrocyte-driven production of IL-6 (GFAP-IL6) in transgenic mice, although causing spontaneous neuroinflammation and long term damage, is beneficial after an acute (freeze) injury in the cortex, increasing healing and decreasing oxidative stress and apoptosis. To determine the transcriptional basis for these responses here we analyzed the global gene expression profile of the cortex, at 0 (unlesioned), 1 or 4 days post lesion (dpl), in both GFAP-IL6 mice and their control littermates. GFAP-IL6 mice showed an increase in genes associated with the inflammatory response both at 1 dpl (Iftm1, Endod1) and 4 dpl (Gfap, C4b), decreased expression of proapoptotic genes (i.e. Gadd45b, Clic4, p21) as well as reduced expression of genes involved in the control of oxidative stress (Atf4). Furthermore, the presence of IL-6 altered the expression of genes involved in hemostasis (Vwf), cell migration and proliferation (Cap2), and synaptic activity (Vamp2). All these changes in gene expression could underlie the phenotype of the GFAP-IL6 mice after injury, but many other possible factors were also identified in this study, highlighting the utility of this approach for deciphering new pathways orchestrated by IL-6.
Collapse
Affiliation(s)
- Albert Quintana
- Institute of Neurosciences and Department of Cellular Biology, Physiology and Immunology, Animal Physiology Unit, Faculty of Sciences, Autonomous University of Barcelona, Bellaterra, Barcelona, Spain
| | | | | | | | | | | | | |
Collapse
|
264
|
Nelson PT, Wang WX, Wilfred BR, Tang G. Technical variables in high-throughput miRNA expression profiling: much work remains to be done. BIOCHIMICA ET BIOPHYSICA ACTA-GENE REGULATORY MECHANISMS 2008; 1779:758-65. [PMID: 18439437 DOI: 10.1016/j.bbagrm.2008.03.012] [Citation(s) in RCA: 67] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2007] [Revised: 03/24/2008] [Accepted: 03/26/2008] [Indexed: 12/11/2022]
Abstract
MicroRNA (miRNA) gene expression profiling has provided important insights into plant and animal biology. However, there has not been ample published work about pitfalls associated with technical parameters in miRNA gene expression profiling. One source of pertinent information about technical variables in gene expression profiling is the separate and more well-established literature regarding mRNA expression profiling. However, many aspects of miRNA biochemistry are unique. For example, the cellular processing and compartmentation of miRNAs, the differential stability of specific miRNAs, and aspects of global miRNA expression regulation require specific consideration. Additional possible sources of systematic bias in miRNA expression studies include the differential impact of pre-analytical variables, substrate specificity of nucleic acid processing enzymes used in labeling and amplification, and issues regarding new miRNA discovery and annotation. We conclude that greater focus on technical parameters is required to bolster the validity, reliability, and cultural credibility of miRNA gene expression profiling studies.
Collapse
Affiliation(s)
- Peter T Nelson
- Department of Pathology and Sanders-Brown Center, University of Kentucky, Lexington, KY 40536, USA.
| | | | | | | |
Collapse
|
265
|
Gohlke JM, Armant O, Parham FM, Smith MV, Zimmer C, Castro DS, Nguyen L, Parker JS, Gradwohl G, Portier CJ, Guillemot F. Characterization of the proneural gene regulatory network during mouse telencephalon development. BMC Biol 2008; 6:15. [PMID: 18377642 PMCID: PMC2330019 DOI: 10.1186/1741-7007-6-15] [Citation(s) in RCA: 78] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2007] [Accepted: 03/31/2008] [Indexed: 12/22/2022] Open
Abstract
Background The proneural proteins Mash1 and Ngn2 are key cell autonomous regulators of neurogenesis in the mammalian central nervous system, yet little is known about the molecular pathways regulated by these transcription factors. Results Here we identify the downstream effectors of proneural genes in the telencephalon using a genomic approach to analyze the transcriptome of mice that are either lacking or overexpressing proneural genes. Novel targets of Ngn2 and/or Mash1 were identified, such as members of the Notch and Wnt pathways, and proteins involved in adhesion and signal transduction. Next, we searched the non-coding sequence surrounding the predicted proneural downstream effector genes for evolutionarily conserved transcription factor binding sites associated with newly defined consensus binding sites for Ngn2 and Mash1. This allowed us to identify potential novel co-factors and co-regulators for proneural proteins, including Creb, Tcf/Lef, Pou-domain containing transcription factors, Sox9, and Mef2a. Finally, a gene regulatory network was delineated using a novel Bayesian-based algorithm that can incorporate information from diverse datasets. Conclusion Together, these data shed light on the molecular pathways regulated by proneural genes and demonstrate that the integration of experimentation with bioinformatics can guide both hypothesis testing and hypothesis generation.
Collapse
Affiliation(s)
- Julia M Gohlke
- Environmental Systems Biology Group, Laboratory of Molecular Toxicology, National Institute of Environmental Health Sciences, RTP, NC 27709, USA.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
266
|
Ganter B, Zidek N, Hewitt PR, Müller D, Vladimirova A. Pathway analysis tools and toxicogenomics reference databases for risk assessment. Pharmacogenomics 2008; 9:35-54. [PMID: 18154447 DOI: 10.2217/14622416.9.1.35] [Citation(s) in RCA: 53] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/02/2023] Open
Abstract
The pharmaceutical industry has begun to leverage a range of new technologies (proteomics, pharmacogenomics, metabolomics and molecular toxicology [e.g., toxicogenomics]) and analysis tools that are becoming increasingly integrated in the area of drug discovery and development. The approach of analyzing the vast amount of toxicogenomics data generated using molecular pathway and networks analysis tools in combination with analysis of reference data will be the main focus of this review. We will demonstrate how this combined approach can increase the understanding of the molecular mechanisms that lead to chemical-induced toxicity and application of this knowledge to compound risk assessment. We will provide an example of the insights achieved through a molecular toxicology analysis based on the well-known hepatotoxicant lipopolysaccharide to illustrate the utility of these new tools in the analysis of complex data sets, both in vivo and in vitro. The ultimate objective is a better lead selection process that improves the chances for success across the different stages of drug discovery and development.
Collapse
Affiliation(s)
- Brigitte Ganter
- Ingenuity Systems, 1700 Seaport Blvd, Redwood City, CA 94063, USA.
| | | | | | | | | |
Collapse
|
267
|
Replogle K, Arnold AP, Ball GF, Band M, Bensch S, Brenowitz EA, Dong S, Drnevich J, Ferris M, George JM, Gong G, Hasselquist D, Hernandez AG, Kim R, Lewin HA, Liu L, Lovell PV, Mello CV, Naurin S, Rodriguez-Zas S, Thimmapuram J, Wade J, Clayton DF. The Songbird Neurogenomics (SoNG) Initiative: community-based tools and strategies for study of brain gene function and evolution. BMC Genomics 2008; 9:131. [PMID: 18366674 PMCID: PMC2329646 DOI: 10.1186/1471-2164-9-131] [Citation(s) in RCA: 123] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2007] [Accepted: 03/18/2008] [Indexed: 11/10/2022] Open
Abstract
Background Songbirds hold great promise for biomedical, environmental and evolutionary research. A complete draft sequence of the zebra finch genome is imminent, yet a need remains for application of genomic resources within a research community traditionally focused on ethology and neurobiological methods. In response, we developed a core set of genomic tools and a novel collaborative strategy to probe gene expression in diverse songbird species and natural contexts. Results We end-sequenced cDNAs from zebra finch brain and incorporated additional sequences from community sources into a database of 86,784 high quality reads. These assembled into 31,658 non-redundant contigs and singletons, which we annotated via BLAST search of chicken and human databases. The results are publicly available in the ESTIMA:Songbird database. We produced a spotted cDNA microarray with 20,160 addresses representing 17,214 non-redundant products of an estimated 11,500–15,000 genes, validating it by analysis of immediate-early gene (zenk) gene activation following song exposure and by demonstrating effective cross hybridization to genomic DNAs of other songbird species in the Passerida Parvorder. Our assembly was also used in the design of the "Lund-zfa" Affymetrix array representing ~22,000 non-redundant sequences. When the two arrays were hybridized to cDNAs from the same set of male and female zebra finch brain samples, both arrays detected a common set of regulated transcripts with a Pearson correlation coefficient of 0.895. To stimulate use of these resources by the songbird research community and to maintain consistent technical standards, we devised a "Community Collaboration" mechanism whereby individual birdsong researchers develop experiments and provide tissues, but a single individual in the community is responsible for all RNA extractions, labelling and microarray hybridizations. Conclusion Immediately, these results set the foundation for a coordinated set of 25 planned experiments by 16 research groups probing fundamental links between genome, brain, evolution and behavior in songbirds. Energetic application of genomic resources to research using songbirds should help illuminate how complex neural and behavioral traits emerge and evolve.
Collapse
Affiliation(s)
- Kirstin Replogle
- Cell & Developmental Biology, Univ, of Illinois, Urbana, IL, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
268
|
Pedotti P, 't Hoen PAC, Vreugdenhil E, Schenk GJ, Vossen RH, Ariyurek Y, de Hollander M, Kuiper R, van Ommen GJB, den Dunnen JT, Boer JM, de Menezes RX. Can subtle changes in gene expression be consistently detected with different microarray platforms? BMC Genomics 2008; 9:124. [PMID: 18331641 PMCID: PMC2335120 DOI: 10.1186/1471-2164-9-124] [Citation(s) in RCA: 40] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2007] [Accepted: 03/10/2008] [Indexed: 11/29/2022] Open
Abstract
Background The comparability of gene expression data generated with different microarray platforms is still a matter of concern. Here we address the performance and the overlap in the detection of differentially expressed genes for five different microarray platforms in a challenging biological context where differences in gene expression are few and subtle. Results Gene expression profiles in the hippocampus of five wild-type and five transgenic δC-doublecortin-like kinase mice were evaluated with five microarray platforms: Applied Biosystems, Affymetrix, Agilent, Illumina, LGTC home-spotted arrays. Using a fixed false discovery rate of 10% we detected surprising differences between the number of differentially expressed genes per platform. Four genes were selected by ABI, 130 by Affymetrix, 3,051 by Agilent, 54 by Illumina, and 13 by LGTC. Two genes were found significantly differentially expressed by all platforms and the four genes identified by the ABI platform were found by at least three other platforms. Quantitative RT-PCR analysis confirmed 20 out of 28 of the genes detected by two or more platforms and 8 out of 15 of the genes detected by Agilent only. We observed improved correlations between platforms when ranking the genes based on the significance level than with a fixed statistical cut-off. We demonstrate significant overlap in the affected gene sets identified by the different platforms, although biological processes were represented by only partially overlapping sets of genes. Aberrances in GABA-ergic signalling in the transgenic mice were consistently found by all platforms. Conclusion The different microarray platforms give partially complementary views on biological processes affected. Our data indicate that when analyzing samples with only subtle differences in gene expression the use of two different platforms might be more attractive than increasing the number of replicates. Commercial two-color platforms seem to have higher power for finding differentially expressed genes between groups with small differences in expression.
Collapse
Affiliation(s)
- Paola Pedotti
- Center for Human and Clinical Genetics, Leiden University Medical Center, Leiden, The Netherlands.
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
269
|
Kong X, Mas V, Archer KJ. A non-parametric meta-analysis approach for combining independent microarray datasets: application using two microarray datasets pertaining to chronic allograft nephropathy. BMC Genomics 2008; 9:98. [PMID: 18302764 PMCID: PMC2276496 DOI: 10.1186/1471-2164-9-98] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2007] [Accepted: 02/26/2008] [Indexed: 11/21/2022] Open
Abstract
Background With the popularity of DNA microarray technology, multiple groups of researchers have studied the gene expression of similar biological conditions. Different methods have been developed to integrate the results from various microarray studies, though most of them rely on distributional assumptions, such as the t-statistic based, mixed-effects model, or Bayesian model methods. However, often the sample size for each individual microarray experiment is small. Therefore, in this paper we present a non-parametric meta-analysis approach for combining data from independent microarray studies, and illustrate its application on two independent Affymetrix GeneChip studies that compared the gene expression of biopsies from kidney transplant recipients with chronic allograft nephropathy (CAN) to those with normal functioning allograft. Results The simulation study comparing the non-parametric meta-analysis approach to a commonly used t-statistic based approach shows that the non-parametric approach has better sensitivity and specificity. For the application on the two CAN studies, we identified 309 distinct genes that expressed differently in CAN. By applying Fisher's exact test to identify enriched KEGG pathways among those genes called differentially expressed, we found 6 KEGG pathways to be over-represented among the identified genes. We used the expression measurements of the identified genes as predictors to predict the class labels for 6 additional biopsy samples, and the predicted results all conformed to their pathologist diagnosed class labels. Conclusion We present a new approach for combining data from multiple independent microarray studies. This approach is non-parametric and does not rely on any distributional assumptions. The rationale behind the approach is logically intuitive and can be easily understood by researchers not having advanced training in statistics. Some of the identified genes and pathways have been reported to be relevant to renal diseases. Further study on the identified genes and pathways may lead to better understanding of CAN at the molecular level.
Collapse
Affiliation(s)
- Xiangrong Kong
- Department of Biostatistics, Virginia Commonwealth University, Richmond, VA 23298, USA.
| | | | | |
Collapse
|
270
|
Fielden MR, Nie A, McMillian M, Elangbam CS, Trela BA, Yang Y, Dunn RT, Dragan Y, Fransson-Stehen R, Bogdanffy M, Adams SP, Foster WR, Chen SJ, Rossi P, Kasper P, Jacobson-Kram D, Tatsuoka KS, Wier PJ, Gollub J, Halbert DN, Roter A, Young JK, Sina JF, Marlowe J, Martus HJ, Aubrecht J, Olaharski AJ, Roome N, Nioi P, Pardo I, Snyder R, Perry R, Lord P, Mattes W, Car BD. Interlaboratory evaluation of genomic signatures for predicting carcinogenicity in the rat. Toxicol Sci 2008; 103:28-34. [PMID: 18281259 DOI: 10.1093/toxsci/kfn022] [Citation(s) in RCA: 78] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/13/2023] Open
Abstract
The Critical Path Institute recently established the Predictive Safety Testing Consortium, a collaboration between several companies and the U.S. Food and Drug Administration, aimed at evaluating and qualifying biomarkers for a variety of toxicological endpoints. The Carcinogenicity Working Group of the Predictive Safety Testing Consortium has concentrated on sharing data to test the predictivity of two published hepatic gene expression signatures, including the signature by Fielden et al. (2007, Toxicol. Sci. 99, 90-100) for predicting nongenotoxic hepatocarcinogens, and the signature by Nie et al. (2006, Mol. Carcinog. 45, 914-933) for predicting nongenotoxic carcinogens. Although not a rigorous prospective validation exercise, the consortium approach created an opportunity to perform a meta-analysis to evaluate microarray data from short-term rat studies on over 150 compounds. Despite significant differences in study designs and microarray platforms between laboratories, the signatures proved to be relatively robust and more accurate than expected by chance. The accuracy of the Fielden et al. signature was between 63 and 69%, whereas the accuracy of the Nie et al. signature was between 55 and 64%. As expected, the predictivity was reduced relative to internal validation estimates reported under identical test conditions. Although the signatures were not deemed suitable for use in regulatory decision making, they were deemed worthwhile in the early assessment of drugs to aid decision making in drug development. These results have prompted additional efforts to rederive and evaluate a QPCR-based signature using these samples. When combined with a standardized test procedure and prospective interlaboratory validation, the accuracy and potential utility in preclinical applications can be ascertained.
Collapse
|
271
|
Reproducible and reliable microarray results through quality control: good laboratory proficiency and appropriate data analysis practices are essential. Curr Opin Biotechnol 2008; 19:10-8. [DOI: 10.1016/j.copbio.2007.11.003] [Citation(s) in RCA: 106] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2007] [Revised: 10/23/2007] [Accepted: 11/09/2007] [Indexed: 11/20/2022]
|
272
|
Wang Z, Beach D, Su L, Zhai R, Christiani DC. A genome-wide expression analysis in blood identifies pre-elafin as a biomarker in ARDS. Am J Respir Cell Mol Biol 2008; 38:724-32. [PMID: 18203972 DOI: 10.1165/rcmb.2007-0354oc] [Citation(s) in RCA: 48] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023] Open
Abstract
Previous microarray-based studies of acute respiratory distress syndrome (ARDS) were performed using various models to mimic disease pathogenesis. The complexity of the pathophysiologic response to direct or indirect lung injury in ARDS is difficult to reconstruct in experimental conditions. Thus, direct analysis of ARDS patient blood may provide valuable information. We investigated genome-wide gene expression profiles in paired whole blood samples from patients with ARDS (n = 8) during the acute stage (within 3 d of diagnosis) and recovery stage of ARDS (around ICU discharge). Among 126 differentially expressed genes, peptidase inhibitor 3 (PI3, encoding elafin, a potent neutrophil elastase inhibitor) had the largest fold-change (-3-fold changes, acute stage/recovery stage) in expression, indicating down-regulation during the acute stage of ARDS. We further examined plasma PI3 levels in 40 patients with ARDS and 23 at-risk control subjects from the same cohort. There was a coincidence of the microarray findings of lower PI3 gene expression with the lower plasma PI3 during the acute-stage. The plasma PI3 levels were statistically significant different among pre-diagnosis, day of diagnosis, and post-diagnosis groups (ANOVA, P = 0.001), with a trend of decreasing from pre- to post-diagnosis group. The time course of plasma PI3 decrease is well correlated with the course of early ARDS development (Pearson correlation coefficient: -0.52, P = 0.0006). Considering that PI3 can covalently binding to extracellular matrix in lung, circulating PI3 may provide a useful clinical marker for monitoring the early development of ARDS and may have implications for ARDS treatment.
Collapse
Affiliation(s)
- Zhaoxi Wang
- Department of Environmental Health, Harvard School of Public Health, Boston, Massachusetts 02115, USA.
| | | | | | | | | |
Collapse
|
273
|
Abstract
The increasing use of gene expression microarrays, and depositing of the resulting data into public repositories, means that more investigators are interested in using the technology either directly or through meta analysis of the publicly available data. The tools available for data analysis have generally been developed for use by experts in the field, making them difficult to use by the general research community. For those interested in entering the field, especially those without a background in statistics, it is difficult to understand why experimental results can be so variable. The purpose of this review is to go through the workflow of a typical microarray experiment, to show that decisions made at each step, from choice of platform through statistical analysis methods to biological interpretation, are all sources of this variability.
Collapse
|
274
|
Abstract
Public consortia provide a forum for addressing questions requiring more resources than one organization alone could bring to bear and engaging many sectors of the scientific community. They are particular well suited for tackling some of the questions encountered in the field of toxicogenomics, where the number of studies and microarray analyses would be prohibitively expensive for a single organization to carry out. Five consortia that stand out in the field of toxicogenomics are the Institutional Life Sciences Institute (ILSI) Health and Environmental Sciences Institute (HESI) Committee on the Application of Genomics to Mechanism Based Risk Assessment, the Toxicogenomics Research Consortium, the MicroArray Quality Control (MAQC) Consortium, the InnoMed PredTox effort, and the Predictive Safety Testing Consortium. Collectively, these consortia efforts have addressed issues such as reproducibility of microarray results, standard practice for assays and analysis, relevance of microarray results to conventional end points, and robustness of statistical models on diverse data sets. Their results demonstrate the impact that the pooling of resources, experience, expertise, and insight found in consortia can have.
Collapse
Affiliation(s)
- William B Mattes
- Department of Toxicology, The Critical Path Institute, Rockville, Maryland, USA
| |
Collapse
|
275
|
Mendrick DL. Toxicogenomics and classic toxicology: how to improve prediction and mechanistic understanding of human toxicity. Methods Mol Biol 2008; 460:1-22. [PMID: 18449480 DOI: 10.1007/978-1-60327-048-9_1] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/26/2023]
Abstract
The field of toxicogenomics has been advancing during the past decade or so since its origin. Most pharmaceutical companies are using it in one or more ways to improve their productivity and supplement their classic toxicology studies. Acceptance of toxicogenomics will continue to grow as regulatory concerns are addressed, proof of concept studies are disseminated more fully, and internal case studies show value for the use of this new technology in concert with classic testing.
Collapse
Affiliation(s)
- Donna L Mendrick
- Department of Toxicogenomics, Gene Logic Inc., Gaithersburg, Maryland, USA
| |
Collapse
|
276
|
Abstract
The beauty of microarray analysis of gene expression (MAGE) is that it can be used to discover some genes that were previously thought to be unrelated to a physiologic or pathologic event. During the period from 1999 to 2007, applications of MAGE in cancer investigation have shifted from molecular profiling, identifying previously undiscovered cancer types, predicting outcomes of cancer patients, revealing metastasis signatures of solid tumors, to guiding the use of therapeutics. The roles of cancer genomic signatures have evolved through three phases. In the first phase, genomic signatures were described in stored cancer specimens and dubbed as molecular portraits of cancer. When gene expression profiles were carefully correlated with sufficient clinical information of cancer patients, new subgroups of cancers with distinct outcomes were revealed. In studies of the second phase, validation of cancer signatures was emphasized and commonly performed with independent groups of cancer specimens or independent data set. In the third phase, cancer genomic signatures have been further expanded beyond depicting the molecular portrait of cancer to predicting patient outcomes and guiding the use of cancer therapeutics. Cancer genomic signatures have become an essential part of a new generation of cancer clinical trials. It is advocated that, in future clinical trials of cancer therapy, the cancer specimens of each participant should be tested for currently available predictor genomic signatures, so that the most effective treatment with the least adverse effects for each patient can be identified. Then, participants can be triaged to an appropriate study group.
Collapse
|
277
|
Archer KJ, Dumur CI, Taylor GS, Chaplin MD, Guiseppi-Elie A, Grant G, Ferreira-Gonzalez A, Garrett CT. Application of a correlation correction factor in a microarray cross-platform reproducibility study. BMC Bioinformatics 2007; 8:447. [PMID: 18005444 PMCID: PMC2211756 DOI: 10.1186/1471-2105-8-447] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2007] [Accepted: 11/15/2007] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Recent research examining cross-platform correlation of gene expression intensities has yielded mixed results. In this study, we demonstrate use of a correction factor for estimating cross-platform correlations. RESULTS In this paper, three technical replicate microarrays were hybridized to each of three platforms. The three platforms were then analyzed to assess both intra- and cross-platform reproducibility. We present various methods for examining intra-platform reproducibility. We also examine cross-platform reproducibility using Pearson's correlation. Additionally, we previously developed a correction factor for Pearson's correlation which is applicable when X and Y are measured with error. Herein we demonstrate that correcting for measurement error by estimating the "disattenuated" correlation substantially improves cross-platform correlations. CONCLUSION When estimating cross-platform correlation, it is essential to thoroughly evaluate intra-platform reproducibility as a first step. In addition, since measurement error is present in microarray gene expression data, methods to correct for attenuation are useful in decreasing the bias in cross-platform correlation estimates.
Collapse
Affiliation(s)
- Kellie J Archer
- Department of Biostatistics, Virginia Commonwealth University, 730 East Broad St,, Richmond, VA, USA.
| | | | | | | | | | | | | | | |
Collapse
|
278
|
Winstanley CA, LaPlant Q, Theobald DEH, Green TA, Bachtell RK, Perrotti LI, DiLeone RJ, Russo SJ, Garth WJ, Self DW, Nestler EJ. DeltaFosB induction in orbitofrontal cortex mediates tolerance to cocaine-induced cognitive dysfunction. J Neurosci 2007; 27:10497-507. [PMID: 17898221 PMCID: PMC6673166 DOI: 10.1523/jneurosci.2566-07.2007] [Citation(s) in RCA: 110] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
Current cocaine users show little evidence of cognitive impairment and may perform better when using cocaine, yet withdrawal from prolonged cocaine use unmasks dramatic cognitive deficits. It has been suggested that such impairments arise in part through drug-induced dysfunction within the orbitofrontal cortex (OFC), yet the neurobiological mechanisms remain unknown. We observed that chronic cocaine self-administration increased expression of the transcription factor deltaFosB within both medial and orbitofrontal regions of the rat prefrontal cortex. However, the increase in OFC deltaFosB levels was more pronounced after self-administered rather than experimenter-administered cocaine, a pattern that was not observed in other regions. We then used rodent tests of attention and decision making to determine whether deltaFosB within the OFC contributes to drug-induced alterations in cognition. Chronic cocaine treatment produced tolerance to the cognitive impairments caused by acute cocaine. Overexpression of a dominant-negative antagonist of deltaFosB, deltaJunD, in the OFC prevented this behavioral adaptation, whereas locally overexpressing deltaFosB mimicked the effects of chronic cocaine. Gene microarray analyses identified potential molecular mechanisms underlying this behavioral change, including an increase in transcription of metabotropic glutamate receptor subunit 5 and GABA(A) receptors as well as substance P. Identification of deltaFosB in the OFC as a mediator of tolerance to the effects of cocaine on cognition provides fundamentally new insight into the transcriptional modifications associated with addiction.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | - William J. Garth
- Charles River Laboratories CSS, The University of Texas Southwestern Medical Center, Dallas, Texas 75390
| | - David W. Self
- Departments of Psychiatry and Basic Neuroscience and
| | | |
Collapse
|
279
|
Cho RW, Wang X, Diehn M, Shedden K, Chen GY, Sherlock G, Gurney A, Lewicki J, Clarke MF. Isolation and molecular characterization of cancer stem cells in MMTV-Wnt-1 murine breast tumors. Stem Cells 2007; 26:364-71. [PMID: 17975224 DOI: 10.1634/stemcells.2007-0440] [Citation(s) in RCA: 233] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
In human breast cancers, a phenotypically distinct minority population of tumorigenic (TG) cancer cells (sometimes referred to as cancer stem cells) drives tumor growth when transplanted into immunodeficient mice. Our objective was to identify a mouse model of breast cancer stem cells that could have relevance to the study of human breast cancer. To do so, we used breast tumors of the mouse mammary tumor virus (MMTV)-Wnt-1 mice. MMTV-Wnt-1 breast tumors were harvested, dissociated into single-cell suspensions, and sorted by flow cytometry on Thy1, CD24, and CD45. Sorted cells were then injected into recipient background FVB/NJ female syngeneic mice. In six of seven tumors examined, Thy1+CD24+ cancer cells, which constituted approximately 1%-4% of tumor cells, were highly enriched for cells capable of regenerating new tumors compared with cells of the tumor that did not fit this profile ("not-Thy1+CD24+"). Resultant tumors had a phenotypic diversity similar to that of the original tumor and behaved in a similar manner when passaged. Microarray analysis comparing Thy1+CD24+ tumor cells to not-Thy1+CD24+ cells identified a list of differentially expressed genes. Orthologs of these differentially expressed genes predicted survival of human breast cancer patients from two different study groups. These studies suggest that there is a cancer stem cell compartment in the MMTV-Wnt-1 murine breast tumor and that there is a clinical utility of this model for the study of cancer stem cells.
Collapse
Affiliation(s)
- Robert W Cho
- Department of Pediatrics, University of Michigan Medical School, Ann Arbor, Michigan, USA
| | | | | | | | | | | | | | | | | |
Collapse
|
280
|
Mei N, Guo L, Liu R, Fuscoe JC, Chen T. Gene expression changes induced by the tumorigenic pyrrolizidine alkaloid riddelliine in liver of Big Blue rats. BMC Bioinformatics 2007; 8 Suppl 7:S4. [PMID: 18047727 PMCID: PMC2099496 DOI: 10.1186/1471-2105-8-s7-s4] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
Background Pyrrolizidine alkaloids (PAs) are probably the most common plant constituents that poison livestock, wildlife, and humans worldwide. Riddelliine is isolated from plants grown in the western United States and is a prototype of genotoxic PAs. Riddelliine was used to investigate the genotoxic effects of PAs via analysis of gene expression in the target tissue of rats in this study. Previously we observed that the mutant frequency in the liver of rats gavaged with riddelliine was 3-fold higher than that in the control group. Molecular analysis of the mutants indicated that there was a statistically significant difference between the mutational spectra from riddelliine-treated and control rats. Results Riddelliine-induced gene expression profiles in livers of Big Blue transgenic rats were determined. The female rats were gavaged with riddelliine at a dose of 1 mg/kg body weight 5 days a week for 12 weeks. Rat whole genome microarray was used to perform genome-wide gene expression studies. When a cutoff value of a two-fold change and a P-value less than 0.01 were used as gene selection criteria, 919 genes were identified as differentially expressed in riddelliine-treated rats compared to the control animals. By analysis with the Ingenuity Pathway Analysis Network, we found that these significantly changed genes were mainly involved in cancer, cell death, tissue development, cellular movement, tissue morphology, cell-to-cell signaling and interaction, and cellular growth and proliferation. We further analyzed the genes involved in metabolism, injury of endothelial cells, liver abnormalities, and cancer development in detail. Conclusion The alterations in gene expression were directly related to the pathological outcomes reported previously. These results provided further insight into the mechanisms involved in toxicity and carcinogenesis after exposure to riddelliine, and permitted us to investigate the interaction of gene products inside the signaling networks.
Collapse
Affiliation(s)
- Nan Mei
- Division of Genetic and Reproductive Toxicology, National Center for Toxicological Research, FDA, Jefferson, AR 72079, USA.
| | | | | | | | | |
Collapse
|
281
|
Chen JJ, Hsueh HM, Delongchamp RR, Lin CJ, Tsai CA. Reproducibility of microarray data: a further analysis of microarray quality control (MAQC) data. BMC Bioinformatics 2007; 8:412. [PMID: 17961233 PMCID: PMC2204045 DOI: 10.1186/1471-2105-8-412] [Citation(s) in RCA: 97] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2007] [Accepted: 10/25/2007] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Many researchers are concerned with the comparability and reliability of microarray gene expression data. Recent completion of the MicroArray Quality Control (MAQC) project provides a unique opportunity to assess reproducibility across multiple sites and the comparability across multiple platforms. The MAQC analysis presented for the conclusion of inter- and intra-platform comparability/reproducibility of microarray gene expression measurements is inadequate. We evaluate the reproducibility/comparability of the MAQC data for 12901 common genes in four titration samples generated from five high-density one-color microarray platforms and the TaqMan technology. We discuss some of the problems with the use of correlation coefficient as metric to evaluate the inter- and intra-platform reproducibility and the percent of overlapping genes (POG) as a measure for evaluation of a gene selection procedure by MAQC. RESULTS A total of 293 arrays were used in the intra- and inter-platform analysis. A hierarchical cluster analysis shows distinct differences in the measured intensities among the five platforms. A number of genes show a small fold-change in one platform and a large fold-change in another platform, even though the correlations between platforms are high. An analysis of variance shows thirty percent of gene expressions of the samples show inconsistent patterns across the five platforms. We illustrated that POG does not reflect the accuracy of a selected gene list. A non-overlapping gene can be truly differentially expressed with a stringent cut, and an overlapping gene can be non-differentially expressed with non-stringent cutoff. In addition, POG is an unusable selection criterion. POG can increase or decrease irregularly as cutoff changes; there is no criterion to determine a cutoff so that POG is optimized. CONCLUSION Using various statistical methods we demonstrate that there are differences in the intensities measured by different platforms and different sites within platform. Within each platform, the patterns of expression are generally consistent, but there is site-by-site variability. Evaluation of data analysis methods for use in regulatory decision should take no treatment effect into consideration, when there is no treatment effect, "a fold-change cutoff with a non-stringent p-value cutoff" could result in 100% false positive error selection.
Collapse
Affiliation(s)
- James J Chen
- Division of Personalized Nutrition and Medicine, National Center for Toxicological Research, Food and Drug Administration, Jefferson, Arkansas 72079, USA.
| | | | | | | | | |
Collapse
|
282
|
Gant TW. Novel and future applications of microarrays in toxicological research. Expert Opin Drug Metab Toxicol 2007. [DOI: 10.1517/17425255.3.4.599] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
283
|
Kerr KF. Extended analysis of benchmark datasets for Agilent two-color microarrays. BMC Bioinformatics 2007; 8:371. [PMID: 17915030 PMCID: PMC2174956 DOI: 10.1186/1471-2105-8-371] [Citation(s) in RCA: 16] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2007] [Accepted: 10/03/2007] [Indexed: 11/25/2022] Open
Abstract
Background As part of its broad and ambitious mission, the MicroArray Quality Control (MAQC) project reported the results of experiments using External RNA Controls (ERCs) on five microarray platforms. For most platforms, several different methods of data processing were considered. However, there was no similar consideration of different methods for processing the data from the Agilent two-color platform. While this omission is understandable given the scale of the project, it can create the false impression that there is consensus about the best way to process Agilent two-color data. It is also important to consider whether ERCs are representative of all the probes on a microarray. Results A comparison of different methods of processing Agilent two-color data shows substantial differences among methods for low-intensity genes. The sensitivity and specificity for detecting differentially expressed genes varies substantially for different methods. Analysis also reveals that the ERCs in the MAQC data only span the upper half of the intensity range, and therefore cannot be representative of all genes on the microarray. Conclusion Although ERCs demonstrate good agreement between observed and expected log-ratios on the Agilent two-color platform, such an analysis is incomplete. Simple loess normalization outperformed data processing with Agilent's Feature Extraction software for accurate identification of differentially expressed genes. Results from studies using ERCs should not be over-generalized when ERCs are not representative of all probes on a microarray.
Collapse
Affiliation(s)
- Kathleen F Kerr
- Department of Biostatistics, University of Washington, Seattle, Washington, USA.
| |
Collapse
|
284
|
Zang S, Guo R, Zhang L, Lu Y. Integration of statistical inference methods and a novel control measure to improve sensitivity and specificity of data analysis in expression profiling studies. J Biomed Inform 2007; 40:552-60. [DOI: 10.1016/j.jbi.2007.01.002] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2006] [Revised: 11/13/2006] [Accepted: 01/10/2007] [Indexed: 10/23/2022]
|
285
|
Kruzelock RP, Short W. Colorectal Cancer Therapeutics and the Challenges of Applied Pharmacogenomics. Curr Probl Cancer 2007; 31:315-66. [PMID: 17905192 DOI: 10.1016/j.currproblcancer.2007.05.001] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
|
286
|
Mackiewicz M, Shockley KR, Romer MA, Galante RJ, Zimmerman JE, Naidoo N, Baldwin DA, Jensen ST, Churchill GA, Pack AI. Macromolecule biosynthesis: a key function of sleep. Physiol Genomics 2007; 31:441-57. [PMID: 17698924 DOI: 10.1152/physiolgenomics.00275.2006] [Citation(s) in RCA: 248] [Impact Index Per Article: 14.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023] Open
Abstract
The function(s) of sleep remains a major unanswered question in biology. We assessed changes in gene expression in the mouse cerebral cortex and hypothalamus following different durations of sleep and periods of sleep deprivation. There were significant differences in gene expression between behavioral states; we identified 3,988 genes in the cerebral cortex and 823 genes in the hypothalamus with altered expression patterns between sleep and sleep deprivation. Changes in the steady-state level of transcripts for various genes are remarkably common during sleep, as 2,090 genes in the cerebral cortex and 409 genes in the hypothalamus were defined as sleep specific and changed (increased or decreased) their expression during sleep. The largest categories of overrepresented genes increasing expression with sleep were those involved in biosynthesis and transport. In both the cerebral cortex and hypothalamus, during sleep there was upregulation of multiple genes encoding various enzymes involved in cholesterol synthesis, as well as proteins for lipid transport. There was also upregulation during sleep of genes involved in synthesis of proteins, heme, and maintenance of vesicle pools, as well as antioxidant enzymes and genes encoding proteins of energy-regulating pathways. We postulate that during sleep there is a rebuilding of multiple key cellular components in preparation for subsequent wakefulness.
Collapse
Affiliation(s)
- Miroslaw Mackiewicz
- Center for Sleep and Respiratory Neurobiology, University of Pennsylvania School of Medicine, Philadelphia, Pennsylvania 19104-3403, USA.
| | | | | | | | | | | | | | | | | | | |
Collapse
|
287
|
Girgenti MJ, Newton SS. Customizing microarrays for neuroscience drug discovery. Expert Opin Drug Discov 2007; 2:1139-49. [DOI: 10.1517/17460441.2.8.1139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Affiliation(s)
- Matthew J Girgenti
- Yale University School of Medicine, Division of Molecular Psychiatry, Departments of Psychiatry and Pharmacology, 34 Park Street, New Haven, CT, 06508, USA ;
| | - Samuel S Newton
- Yale University School of Medicine, Division of Molecular Psychiatry, Departments of Psychiatry and Pharmacology, 34 Park Street, New Haven, CT, 06508, USA ;
| |
Collapse
|
288
|
Xiang G, Pan L, Xing W, Zhang L, Huang L, Yu J, Zhang R, Wu J, Cheng J, Zhou Y. Identification of activity-dependent gene expression profiles reveals specific subsets of genes induced by different routes of Ca(2+) entry in cultured rat cortical neurons. J Cell Physiol 2007; 212:126-36. [PMID: 17443680 DOI: 10.1002/jcp.21008] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Neuronal activity-dependent gene transcription is a key feature of long-lasting synaptic strengthening associated with learning and memory, as well as activity-dependent neuroprotection. To comprehensively determine the molecular alterations, we carried out genome-wide microarray analysis in cultured rat cortical neurons treated with specific pharmacological agents, a model with alterations in neuronal activity, which were monitored by multi-site electrophysiological recordings. Of the approximately 27,000 genes, the expression of 248 genes was strongly changed in response to enhanced activity. These genes encompass a large number of members of distinct families, including synaptic vesicle proteins, ion channels, signal transduction molecules, synaptic growth regulators, and others. Two subsets of these genes were further confirmed to be specifically induced by Ca(2+) influx through N-methyl-D-aspartate (NMDA) receptors and L-type voltage-gated Ca(2+) channels (VGCCs). In addition, those genes dynamically regulated by the enhanced activity were also elucidated, as well as those candidate genes associated with synaptic plasticity and neuroprotection. Our findings therefore would help define the molecular mechanisms that occur in response to neuronal activity and identify specific clusters of genes that contribute to activity-dependent and Ca(2+)-inducible modulation of brain development and function.
Collapse
Affiliation(s)
- Guangxin Xiang
- Medical Systems Biology Research Center, Tsinghua University, Beijing, China
| | | | | | | | | | | | | | | | | | | |
Collapse
|
289
|
Sotiriou C, Piccart MJ. Taking gene-expression profiling to the clinic: when will molecular signatures become relevant to patient care? Nat Rev Cancer 2007; 7:545-53. [PMID: 17585334 DOI: 10.1038/nrc2173] [Citation(s) in RCA: 370] [Impact Index Per Article: 21.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
The advent of microarray technology has enabled scientists to simultaneously investigate the expression of thousands of genes. Gene-expression profiling studies have provided a molecular classification of breast cancer into clinically relevant subtypes, new tools to predict disease recurrence and response to different treatments, and new insights into various oncogenic pathways and the process of metastatic progression. Here we describe the state of the art of gene-expression studies in breast cancer, and consider both their current limitations and future promises. We also discuss the potential of molecular signatures to have an impact on individual breast cancer patient management, and ultimately to accelerate the transition between empirical and tailored medicine.
Collapse
Affiliation(s)
- Christos Sotiriou
- Translational Research Unit, Jules Bordet Institute, 121 Boulevard de Waterloo, 1000 Brussels, Belgium
| | | |
Collapse
|
290
|
Campo Dell'Orto M, Zangrando A, Trentin L, Li R, Liu WM, te Kronnie G, Basso G, Kohlmann A. New data on robustness of gene expression signatures in leukemia: comparison of three distinct total RNA preparation procedures. BMC Genomics 2007; 8:188. [PMID: 17587440 PMCID: PMC1925098 DOI: 10.1186/1471-2164-8-188] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2006] [Accepted: 06/22/2007] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Microarray gene expression (MAGE) signatures allow insights into the transcriptional processes of leukemias and may evolve as a molecular diagnostic test. Introduction of MAGE into clinical practice of leukemia diagnosis will require comprehensive assessment of variation due to the methodologies. Here we systematically assessed the impact of three different total RNA isolation procedures on variation in expression data: method A: lysis of mononuclear cells, followed by lysate homogenization and RNA extraction; method B: organic solvent based RNA isolation, and method C: organic solvent based RNA isolation followed by purification. RESULTS We analyzed 27 pediatric acute leukemias representing nine distinct subtypes and show that method A yields better RNA quality, was associated with more differentially expressed genes between leukemia subtypes, demonstrated the lowest degree of variation between experiments, was more reproducible, and was characterized with a higher precision in technical replicates. Unsupervised and supervised analyses grouped leukemias according to lineage and clinical features in all three methods, thus underlining the robustness of MAGE to identify leukemia specific signatures. CONCLUSION The signatures in the different subtypes of leukemias, regardless of the different extraction methods used, account for the biggest source of variation in the data. Lysis of mononuclear cells, followed by lysate homogenization and RNA extraction represents the optimum method for robust gene expression data and is thus recommended for obtaining robust classification results in microarray studies in acute leukemias.
Collapse
Affiliation(s)
- Marta Campo Dell'Orto
- University of Padua, Laboratory of Molecular Diagnostic, Department of Pediatric Oncology, Via Giustiniani 3, 35128, Padua, Italy
| | - Andrea Zangrando
- University of Padua, Laboratory of Molecular Diagnostic, Department of Pediatric Oncology, Via Giustiniani 3, 35128, Padua, Italy
| | - Luca Trentin
- University of Padua, Laboratory of Molecular Diagnostic, Department of Pediatric Oncology, Via Giustiniani 3, 35128, Padua, Italy
| | - Rui Li
- Roche Molecular Systems, Inc., Department of Genomics and Oncology, Pleasanton, CA, USA
| | - Wei-min Liu
- Roche Molecular Systems, Inc., Department of Genomics and Oncology, Pleasanton, CA, USA
| | - Geertruy te Kronnie
- University of Padua, Laboratory of Molecular Diagnostic, Department of Pediatric Oncology, Via Giustiniani 3, 35128, Padua, Italy
| | - Giuseppe Basso
- University of Padua, Laboratory of Molecular Diagnostic, Department of Pediatric Oncology, Via Giustiniani 3, 35128, Padua, Italy
| | - Alexander Kohlmann
- Roche Molecular Systems, Inc., Department of Genomics and Oncology, Pleasanton, CA, USA
| |
Collapse
|
291
|
Harrison AP, Johnston CE, Orengo CA. Establishing a major cause of discrepancy in the calibration of Affymetrix GeneChips. BMC Bioinformatics 2007; 8:195. [PMID: 17562008 PMCID: PMC1904248 DOI: 10.1186/1471-2105-8-195] [Citation(s) in RCA: 14] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2006] [Accepted: 06/11/2007] [Indexed: 11/10/2022] Open
Abstract
Background Affymetrix GeneChips are a popular platform for performing whole-genome experiments on the transcriptome. There are a range of different calibration steps, and users are presented with choices of different background subtractions, normalisations and expression measures. We wished to establish which of the calibration steps resulted in the biggest uncertainty in the sets of genes reported to be differentially expressed. Results Our results indicate that the sets of genes identified as being most significantly differentially expressed, as estimated by the z-score of fold change, is relatively insensitive to the choice of background subtraction and normalisation. However, the contents of the gene list are most sensitive to the choice of expression measure. This is irrespective of whether the experiment uses a rat, mouse or human chip and whether the chip definition is made using probe mappings from Unigene, RefSeq, Entrez Gene or the original Affymetrix definitions. It is also irrespective of whether both Present and Absent, or just Present, Calls from the MAS5 algorithm are used to filter genelists, and this conclusion holds for genes of differing intensities. We also reach the same conclusion after assigning genes to be differentially expressed using t-statistics, although this approach results in a large amount of false positives in the sets of genes identified due to the small numbers of replicates typically used in microarray experiments. Conclusion The major calibration uncertainty that biologists need to consider when analysing Affymetrix data is how their multiple probe values are condensed into one expression measure.
Collapse
Affiliation(s)
- Andrew P Harrison
- Department of Biological Sciences, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UK
- Department of Mathematical Sciences, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UK
| | - Caroline E Johnston
- Department of Biological Sciences, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UK
- Department of Mathematical Sciences, University of Essex, Wivenhoe Park, Colchester, Essex, CO4 3SQ, UK
| | - Christine A Orengo
- Department of Biochemistry, University College London, Gower Street, London, WC1E 6BT, UK
| |
Collapse
|
292
|
Ach RA, Floore A, Curry B, Lazar V, Glas AM, Pover R, Tsalenko A, Ripoche H, Cardoso F, d'Assignies MS, Bruhn L, Van't Veer LJ. Robust interlaboratory reproducibility of a gene expression signature measurement consistent with the needs of a new generation of diagnostic tools. BMC Genomics 2007; 8:148. [PMID: 17553173 PMCID: PMC1904205 DOI: 10.1186/1471-2164-8-148] [Citation(s) in RCA: 42] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2007] [Accepted: 06/07/2007] [Indexed: 12/04/2022] Open
Abstract
Background The increasing use of DNA microarrays in biomedical research, toxicogenomics, pharmaceutical development, and diagnostics has focused attention on the reproducibility and reliability of microarray measurements. While the reproducibility of microarray gene expression measurements has been the subject of several recent reports, there is still a need for systematic investigation into what factors most contribute to variability of measured expression levels observed among different laboratories and different experimenters. Results We report the results of an interlaboratory comparison of gene expression array measurements on the same microarray platform, in which the RNA amplification and labeling, hybridization and wash, and slide scanning were each individually varied. Identical input RNA was used for all experiments. While some sources of variation have measurable influence on individual microarray signals, they showed very low influence on sample-to-reference ratios based on averaged triplicate measurements in the two-color experiments. RNA labeling was the largest contributor to interlaboratory variation. Conclusion Despite this variation, measurement of one particular breast cancer gene expression signature in three different laboratories was found to be highly robust, showing a high intralaboratory and interlaboratory reproducibility when using strictly controlled standard operating procedures.
Collapse
Affiliation(s)
- Robert A Ach
- Molecular Technology Lab, Agilent Laboratories, Agilent Technologies, 5301 Stevens Creek Blvd., Santa Clara, CA 95051, USA
| | - Arno Floore
- Agendia BV, Slotervaart Medical Center 9D, Louwesweg 6, 1066 EC Amsterdam, The Netherlands
| | - Bo Curry
- Molecular Technology Lab, Agilent Laboratories, Agilent Technologies, 5301 Stevens Creek Blvd., Santa Clara, CA 95051, USA
| | - Vladimir Lazar
- Institut Gustave-Roussy, 39 rue Camille Desmoulins, 94805 Villejuif Cedex, France
| | - Annuska M Glas
- Agendia BV, Slotervaart Medical Center 9D, Louwesweg 6, 1066 EC Amsterdam, The Netherlands
| | - Rob Pover
- Agendia BV, Slotervaart Medical Center 9D, Louwesweg 6, 1066 EC Amsterdam, The Netherlands
| | - Anya Tsalenko
- Molecular Technology Lab, Agilent Laboratories, Agilent Technologies, 5301 Stevens Creek Blvd., Santa Clara, CA 95051, USA
| | - Hugues Ripoche
- Institut Gustave-Roussy, 39 rue Camille Desmoulins, 94805 Villejuif Cedex, France
| | - Fatima Cardoso
- Institut Jules Bordet, 121 Blvd de Waterloo, B-1000 Brussels, Belgium
| | | | - Laurakay Bruhn
- Molecular Technology Lab, Agilent Laboratories, Agilent Technologies, 5301 Stevens Creek Blvd., Santa Clara, CA 95051, USA
| | - Laura J Van't Veer
- Agendia BV, Slotervaart Medical Center 9D, Louwesweg 6, 1066 EC Amsterdam, The Netherlands
| |
Collapse
|
293
|
Tsai MS, Hwang SM, Chen KD, Lee YS, Hsu LW, Chang YJ, Wang CN, Peng HH, Chang YL, Chao AS, Chang SD, Lee KD, Wang TH, Wang HS, Soong YK. Functional network analysis of the transcriptomes of mesenchymal stem cells derived from amniotic fluid, amniotic membrane, cord blood, and bone marrow. Stem Cells 2007; 25:2511-23. [PMID: 17556597 DOI: 10.1634/stemcells.2007-0023] [Citation(s) in RCA: 166] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
Using high-density oligonucleotide microarrays and functional network analyses, we examined whether MSCs derived from four different origins exhibited unique gene expression profiles individually and then compared the gene expression profiles of all MSCs with those of fetal organs. Our results indicated that within each group of MSCs from the same origin, the variability of the gene expression levels was smaller than that between groups of different origins. Functional genomic studies revealed the specific roles of MSCs from different origins. Our results suggest that amniotic fluid MSCs may initiate interactions with the uterus by upregulating oxytocin and thrombin receptors. Amniotic membrane MSCs may play a role in maintaining homeostasis of fluid and electrolytes by regulating the networks of endothelin, neprilysin, bradykinin receptors, and atrial natriuretic peptide. Cord blood MSCs may be involved in innate immune systems as the neonatal defense system against the earliest encountered pathogens. Adult bone marrow MSCs may be an important source not only of all blood lineages but also of bone formation. However, in spite of the different gene expression profiles seen in MSCs derived from different origins, a set of core gene expression profiles was preserved in these four kinds of MSCs. The core signature transcriptomes of all MSCs, when contrasted against those of fetal organs, included genes involved in the regulation of extracellular matrix and adhesion, transforming growth factor-beta receptor signaling, and the Wnt signaling pathways. Disclosure of potential conflicts of interest is found at the end of this article.
Collapse
Affiliation(s)
- Ming-Song Tsai
- Prenatal Diagnosis Center, Cathay General Hospital, Taipei, Taiwan
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
294
|
Fuscoe JC, Tong W, Shi L. QA/QC issues to aid regulatory acceptance of microarray gene expression data. ENVIRONMENTAL AND MOLECULAR MUTAGENESIS 2007; 48:349-53. [PMID: 17567852 DOI: 10.1002/em.20293] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
The U.S. Food and Drug Administration is responsible for (1) promoting and protecting public health by assuring the safety and effectiveness of medicines and medical devices and (2) advancing public health by helping to speed innovations that make medicines and foods safer, more effective, and more affordable. The genomics revolution has dramatically increased our knowledge of basic biology but this has not resulted in the expected acceleration of new medical product development. The Agency's Critical Path to New Medical Products stresses that new tools are needed to address this pipeline problem. Microarray technology is one of these promising tools although questions have risen about the reproducibility of measurements. The Microarray Quality Control (MAQC) Project was initiated by FDA scientists to address this issue. This large project, which evaluated reference RNA samples on seven microarray platforms, found good intralaboratory repeatability and interlaboratory reproducibility. In addition, there was high cross-platform consistency. All data are available free of cost and the reference RNA samples are available for proficiency testing. Thus, current microarray technology appears to provide both reliability and consistency for regulatory submissions.
Collapse
Affiliation(s)
- James C Fuscoe
- Center for Functional Genomics, Division of Systems Toxicology, National Center for Toxicological Research, U.S. Food and Drug Administration, Jefferson, Arkansas 72079, USA.
| | | | | |
Collapse
|
295
|
Yauk CL, Berndt ML. Review of the literature examining the correlation among DNA microarray technologies. ENVIRONMENTAL AND MOLECULAR MUTAGENESIS 2007; 48:380-94. [PMID: 17370338 PMCID: PMC2682332 DOI: 10.1002/em.20290] [Citation(s) in RCA: 42] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
DNA microarray technologies are used in a variety of biological disciplines. The diversity of platforms and analytical methods employed has raised concerns over the reliability, reproducibility and correlation of data produced across the different approaches. Initial investigations (years 2000-2003) found discrepancies in the gene expression measures produced by different microarray technologies. Increasing knowledge and control of the factors that result in poor correlation among the technologies has led to much higher levels of correlation among more recent publications (years 2004 to present). Here, we review the studies examining the correlation among microarray technologies. We find that with improvements in the technology (optimization and standardization of methods, including data analysis) and annotation, analysis across platforms yields highly correlated and reproducible results. We suggest several key factors that should be controlled in comparing across technologies, and are good microarray practice in general.
Collapse
Affiliation(s)
- Carole L Yauk
- Environmental and Occupational Toxicology Division, Safe Environments Programme, Health Canada, Ottawa, Ontario, Canada K1A 0K9.
| | | |
Collapse
|
296
|
Melov S, Tarnopolsky MA, Beckman K, Felkey K, Hubbard A. Resistance exercise reverses aging in human skeletal muscle. PLoS One 2007; 2:e465. [PMID: 17520024 PMCID: PMC1866181 DOI: 10.1371/journal.pone.0000465] [Citation(s) in RCA: 209] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2007] [Accepted: 04/25/2007] [Indexed: 01/07/2023] Open
Abstract
Human aging is associated with skeletal muscle atrophy and functional impairment (sarcopenia). Multiple lines of evidence suggest that mitochondrial dysfunction is a major contributor to sarcopenia. We evaluated whether healthy aging was associated with a transcriptional profile reflecting mitochondrial impairment and whether resistance exercise could reverse this signature to that approximating a younger physiological age. Skeletal muscle biopsies from healthy older (N = 25) and younger (N = 26) adult men and women were compared using gene expression profiling, and a subset of these were related to measurements of muscle strength. 14 of the older adults had muscle samples taken before and after a six-month resistance exercise-training program. Before exercise training, older adults were 59% weaker than younger, but after six months of training in older adults, strength improved significantly (P<0.001) such that they were only 38% lower than young adults. As a consequence of age, we found 596 genes differentially expressed using a false discovery rate cut-off of 5%. Prior to the exercise training, the transcriptome profile showed a dramatic enrichment of genes associated with mitochondrial function with age. However, following exercise training the transcriptional signature of aging was markedly reversed back to that of younger levels for most genes that were affected by both age and exercise. We conclude that healthy older adults show evidence of mitochondrial impairment and muscle weakness, but that this can be partially reversed at the phenotypic level, and substantially reversed at the transcriptome level, following six months of resistance exercise training.
Collapse
Affiliation(s)
- Simon Melov
- Buck Institute for Age Research, Novato, California, United States of America
- * To whom correspondence should be addressed. E-mail: (SM); (MT)
| | - Mark A. Tarnopolsky
- McMaster University, Department of Pediatrics and Medicine, Hamilton, Canada
- * To whom correspondence should be addressed. E-mail: (SM); (MT)
| | - Kenneth Beckman
- Center for Genetics, Children's Hospital Oakland Research Institute, Oakland, California, United States of America
| | - Krysta Felkey
- Buck Institute for Age Research, Novato, California, United States of America
| | - Alan Hubbard
- Buck Institute for Age Research, Novato, California, United States of America
| |
Collapse
|
297
|
Stafford P, Brun M. Three methods for optimization of cross-laboratory and cross-platform microarray expression data. Nucleic Acids Res 2007; 35:e72. [PMID: 17478523 PMCID: PMC1904274 DOI: 10.1093/nar/gkl1133] [Citation(s) in RCA: 38] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023] Open
Abstract
Microarray gene expression data becomes more valuable as our confidence in the results grows. Guaranteeing data quality becomes increasingly important as microarrays are being used to diagnose and treat patients (1–4). The MAQC Quality Control Consortium, the FDA's Critical Path Initiative, NCI's caBIG and others are implementing procedures that will broadly enhance data quality. As GEO continues to grow, its usefulness is constrained by the level of correlation across experiments and general applicability. Although RNA preparation and array platform play important roles in data accuracy, pre-processing is a user-selected factor that has an enormous effect. Normalization of expression data is necessary, but the methods have specific and pronounced effects on precision, accuracy and historical correlation. As a case study, we present a microarray calibration process using normalization as the adjustable parameter. We examine the impact of eight normalizations across both Agilent and Affymetrix expression platforms on three expression readouts: (1) sensitivity and power, (2) functional/biological interpretation and (3) feature selection and classification error. The reader is encouraged to measure their own discordant data, whether cross-laboratory, cross-platform or across any other variance source, and to use their results to tune the adjustable parameters of their laboratory to ensure increased correlation.
Collapse
Affiliation(s)
- Phillip Stafford
- Biodesign Institute, Arizona State University, Center for Innovations in Medicine, Tempe, AZ, USA
| | | |
Collapse
|
298
|
Klebanov L, Qiu X, Welle S, Yakovlev A. Statistical methods and microarray data. Nat Biotechnol 2007; 25:25-6; author reply 26-7. [PMID: 17211383 DOI: 10.1038/nbt0107-25] [Citation(s) in RCA: 33] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
299
|
Draft Preliminary Concept Paper: Recommendations for The Generation And Submission of Genomic Data. Biotechnol Law Rep 2007. [DOI: 10.1089/blr.2006.9998] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
300
|
|