Evaluation of software impact designed for biomedical research: Are we measuring what's meaningful?

Software is vital for the advancement of biology and medicine. Through analysis of usage and impact metrics of software, developers can help determine user and community engagement. These metrics can be used to justify additional funding, encourage additional use, and identify unanticipated use cases. Such analyses can help define improvement areas and assist with managing project resources. However, there are challenges associated with assessing usage and impact, many of which vary widely depending on the type of software being evaluated. These challenges involve issues of distorted, exaggerated, understated, or misleading metrics, as well as ethical and security concerns. More attention to the nuances, challenges, and considerations involved in capturing impact across the diverse spectrum of biological software is needed. Furthermore, some tools may be especially beneficial to a small audience, yet may not have comparatively compelling metrics of high usage. Although some principles are generally applicable, there is not a single perfect metric or approach to effectively evaluate a software tool's impact, as this depends on aspects unique to each tool, how it is used, and how one wishes to evaluate engagement. We propose more broadly applicable guidelines (such as infrastructure that supports the usage of software and the collection of metrics about usage), as well as strategies for various types of software and resources. We also highlight outstanding issues in the field regarding how communities measure or evaluate software impact. To gain a deeper understanding of the issues hindering software evaluations, as well as to determine what appears to be helpful, we performed a survey of participants involved with scientific software projects for the Informatics Technology for Cancer Research (ITCR) program funded by the National Cancer Institute (NCI). We also investigated software among this scientific community and others to assess how often infrastructure that supports such evaluations is implemented and how this impacts rates of papers describing usage of the software. We find that although developers recognize the utility of analyzing data related to the impact or usage of their software, they struggle to find the time or funding to support such analyses. We also find that infrastructure such as social media presence, more in-depth documentation, the presence of software health metrics, and clear information on how to contact developers seem to be associated with increased usage rates. Our findings can help scientific software developers make the most out of the evaluations of their software so that they can more fully benefit from such assessments.

Centralizing neurofibromatosis experimental tool knowledge with the NF Research Tools Database

Experimental tools and resources, such as animal models, cell lines, antibodies, genetic reagents and biobanks, are key ingredients in biomedical research. Investigators face multiple challenges when trying to understand the availability, applicability and accessibility of these tools. A major challenge is keeping up with current information about the numerous tools available for a particular research problem. A variety of disease-agnostic projects such as the Mouse Genome Informatics database and the Resource Identification Initiative curate a number of types of research tools. Here, we describe our efforts to build upon these resources to develop a disease-specific research tool resource for the neurofibromatosis (NF) research community. This resource, the NF Research Tools Database, is an open-access database that enables the exploration and discovery of information about NF type 1-relevant animal models, cell lines, antibodies, genetic reagents and biobanks. Users can search and explore tools, obtain detailed information about each tool as well as read and contribute their observations about the performance, reliability and characteristics of tools in the database. NF researchers will be able to use the NF Research Tools Database to promote, discover, share, reuse and characterize research tools, with the goal of advancing NF research.

Database URL: https://tools.nf.synapse.org/.

Abstract 1675: NF Research Tools Database: A knowledge base of experimental research tools for neurofibromatosis

Research tools, such as model organisms, cell lines, and antibodies, are essential to designing and executing successful biological experiments. These resources are often shared or made commercially available to support scientific progress. Given the fast pace of research, it can be difficult to keep track of the large number of available tools. Moreover, for those new to a particular disease area, learning about the array of tools available can be a major impediment. Our experience in the neurofibromatosis field has shown that researchers struggle to identify the research tools available to them, determine where tools can be acquired, and understand what tools are most well-suited for which experiments. While a variety of databases exist to help researchers find useful research tools, these databases often a) are specific to one type of research tool while being disease-agnostic, b) provide only high-level information, c) do not contain information about in-development models, and d) do not contain observational data for the research tools. To address these limitations, we created the Neurofibromatosis Research Tools Database, a user-friendly, open-access database and companion portal designed to help the neurofibromatosis type 1 (NF1) research community easily find, obtain, and use NF1-relevant research tools. This prototype database catalogs a wide variety of NF1-relevant research tools using databases such as Cellosaurus, AntibodyRegistry, RRID Portal, among others, as well as information provided in literature and from the NF community. We aggregated and curated metadata for NF1-relevant animal models, cell lines, genetic reagents, antibodies, and biobanks. The database includes core metadata for all tools, e.g., name, type of tool, synonyms, developer, as well as tool type-specific metadata, e.g., for cell lines or animal models, the type of cancer that the model recapitulates. The database is also designed to store observational data contributed directly from the research community. Our companion web portal allows users to search and filter this database interactively and easily explore these tools. This website was built within the NF Data Portal (nf.synapse.org), and is available at tools.nf.synapse.org. Community members can actively contribute to the growth of the database and portal by submitting information about the reliability, biology, usage, and other observations on each research tool. By collating and curating this information and surfacing it in an open-access exploration portal, we anticipate that this database will serve as a valuable resource to help the NF community discover, understand, and use NF1 research tools.

Citation Format: Brynn Zalmanek, James Goss, Mialy DeFelice, Jay Hodgson, Ashley Clayton, Stockard Simon, Marco Marasca, Julie Bletz, James A. Eddy, Milen Nikolov, Kevin Boske, Ljubomir Bradic, Jineta Banerjee, Kalyan Vinnakota, Caroline Morin, YooRi Kim, Robert J. Allaway. NF Research Tools Database: A knowledge base of experimental research tools for neurofibromatosis [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2022; 2022 Apr 8-13. Philadelphia (PA): AACR; Cancer Res 2022;82(12_Suppl):Abstract nr 1675.

GA4GH: International policies and standards for data sharing across genomic research and healthcare

The Global Alliance for Genomics and Health (GA4GH) aims to accelerate biomedical advances by enabling the responsible sharing of clinical and genomic data through both harmonized data aggregation and federated approaches. The decreasing cost of genomic sequencing (along with other genome-wide molecular assays) and increasing evidence of its clinical utility will soon drive the generation of sequence data from tens of millions of humans, with increasing levels of diversity. In this perspective, we present the GA4GH strategies for addressing the major challenges of this data revolution. We describe the GA4GH organization, which is fueled by the development efforts of eight Work Streams and informed by the needs of 24 Driver Projects and other key stakeholders. We present the GA4GH suite of secure, interoperable technical standards and policy frameworks and review the current status of standards, their relevance to key domains of research and clinical care, and future plans of GA4GH. Broad international participation in building, adopting, and deploying GA4GH standards and frameworks will catalyze an unprecedented effort in data sharing that will be critical to advancing genomic medicine and ensuring that all populations can access its benefits.

CRI iAtlas: an interactive portal for immuno-oncology research

The Cancer Research Institute (CRI) iAtlas is an interactive web platform for data exploration and discovery in the context of tumors and their interactions with the immune microenvironment. iAtlas allows researchers to study immune response characterizations and patterns for individual tumor types, tumor subtypes, and immune subtypes. iAtlas supports computation and visualization of correlations and statistics among features related to the tumor microenvironment, cell composition, immune expression signatures, tumor mutation burden, cancer driver mutations, adaptive cell clonality, patient survival, expression of key immunomodulators, and tumor infiltrating lymphocyte (TIL) spatial maps. iAtlas was launched to accompany the release of the TCGA PanCancer Atlas and has since been expanded to include new capabilities such as (1) user-defined loading of sample cohorts, (2) a tool for classifying expression data into immune subtypes, and (3) integration of TIL mapping from digital pathology images. We expect that the CRI iAtlas will accelerate discovery and improve patient outcomes by providing researchers access to standardized immunogenomics data to better understand the tumor immune microenvironment and its impact on patient responses to immunotherapy.

Meta-Analysis of the Alzheimer's Disease Human Brain Transcriptome and Functional Dissection in Mouse Models

We present a consensus atlas of the human brain transcriptome in Alzheimer's disease (AD), based on meta-analysis of differential gene expression in 2,114 postmortem samples. We discover 30 brain coexpression modules from seven regions as the major source of AD transcriptional perturbations. We next examine overlap with 251 brain differentially expressed gene sets from mouse models of AD and other neurodegenerative disorders. Human-mouse overlaps highlight responses to amyloid versus tau pathology and reveal age- and sex-dependent expression signatures for disease progression. Human coexpression modules enriched for neuronal and/or microglial genes broadly overlap with mouse models of AD, Huntington's disease, amyotrophic lateral sclerosis, and aging. Other human coexpression modules, including those implicated in proteostasis, are not activated in AD models but rather following other, unexpected genetic manipulations. Our results comprise a cross-species resource, highlighting transcriptional networks altered by human brain pathophysiology and identifying correspondences with mouse models for AD preclinical studies.

Abstract 1184: Comprehensive analysis with interactive exploration of immune response signatures in 10,000 tumor samples

In recent years, analysis of cancer genomics data using methods of immunogenomics has yielded valuable insight into how cancer cells interact with immune cells in the tumor microenvironment. A recent analysis of the multiple molecular platforms by The Cancer Genome Atlas (TCGA) of over 10,000 tumors comprising 33 cancer types identified six immune subtypes, spanning multiple tumor types, that are characterized by differences in: macrophage vs. lymphocyte signatures; Th1:Th2 cell ratio; extent of intratumoral heterogeneity; aneuploidy; extent of neoantigen load; signatures of cell proliferation; expression of immunomodulatory genes; and disease outcome [1]. Particular driver mutations correlate with variation in leukocyte levels across all cancers or with the fraction of individual immune cell types. Intracellular and extracellular networks (involving transcription, microRNAs, copy number and epigenetic processes) are predicted to play a role in establishing the observed tumor-immune cell interactions, both across and within immune subtypes. Additionally, machine learning methods have been applied to H&E images to extract information on which tissue regions contain tumor infiltrating lymphocytes (TILs), yielding TIL maps of whole slide images from digital pathology[2]. Spatial patterns of TILs are associated with a variety of genomic alterations, including cancer subtypes.

The CRI iAtlas (www.cri-iatlas.org) is a cloud-based platform for data exploration and discovery, allowing researchers to study TCGA immune response characterizations, and the relationships among them in individual tumor types, tumor subtypes, and immune subtypes. iAtlas supports the adaptive exploration of correlations within the cellularity of the tumor microenvironment, immune expression signatures, tumor mutation burden, cancer driver mutations, adaptive cell clonality, patient survival, and expression of key immunomodulators. iAtlas was launched in April 2018, and has since been expanded to include new capabilities such as (1) user-defined loading of cohorts, (2) a tool for classifying expression data into immune subtypes, (3) integration of TIL mapping from digital pathology images, and (4) addition of annotated genomics datasets from immunotherapy clinical trials as comparative data sources. As the resource evolves, we expect that the CRI iAtlas will help to accelerate discovery and improve patient outcomes by providing researchers greater access to immunogenomics data to better understand the immunological characteristics of the tumor microenvironment and its potential impact on patient responses to immunotherapy.

[1] Thorsson, V, et al., The Immune Landscape of Cancer; Immunity 48, p812 - 830.e14 (2018)

[2] Saltz, J et al. Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images; Cell Reports 23 pp.181-193.e7 (2018)

Citation Format: Vesteinn Thorsson, David L. Gibbs, Mary L. Disis, Elizabeth G. Demicco, Alexander J. Lazar, Jonathan S. Serody, James A. Eddy, Ilya Shmulevich, Justin Guinney, Benjamin G. Vincent. Comprehensive analysis with interactive exploration of immune response signatures in 10,000 tumor samples [abstract]. In: Proceedings of the American Association for Cancer Research Annual Meeting 2019; 2019 Mar 29-Apr 3; Atlanta, GA. Philadelphia (PA): AACR; Cancer Res 2019;79(13 Suppl):Abstract nr 1184.

Abstract B051: Facilitating translational research with interactive tools for immuno-oncology data

With the explosive growth in data and results from immuno-oncology (IO) studies, improved ways to easily share, integrate and explore available data and results are needed. The Cancer Research Institute (CRI) iAtlas (www.cri-iatlas.org) is an interactive web-based platform and set of analytic tools for studying interactions between tumors and the immune microenvironment. These tools allow researchers to explore associations among a variety of immune characterizations as well as with genomic and clinical phenotypes. The initial version of CRI iAtlas is based on an analysis performed by The Cancer Genome Atlas (TCGA) Research Network on the TCGA data set comprising over 10,000 tumor samples and 33 tumor types (Thorsson et al., 2018). The platform will be expanded to include other immunogenomic data sets and workflows. In the TCGA analysis, each tumor sample was scored for a variety of computationally estimated immune-based readouts, including immune cell composition, adaptive cell receptor repertoire, neoantigen load, and expression of genes coding for immunomodulatory proteins. Immune-based subtypes, spanning multiple tumor types, were identified. The web tool allows researchers to explore the data readouts as well as the relation between them in individual TCGA tumor types and across the global immune subtypes identified in the study. CRI iAtlas is made possible through a collaboration between CRI, Sage Bionetworks, and the Institute for Systems Biology. The main feature of the iAtlas web tool is the iAtlas Explorer, which provides several Analysis Modules to explore and visualize results. Each module presents information organized by theme, with multiple views and interactive controls to enhance and extend the information included in the original manuscript figures. Sample Group Overview: summaries of selected groups (including six immune subtypes that span cancer tissue types and molecular subtypes); Tumor Microenvironment: overall immune infiltrate and relative immune cell proportions in selected sample groups; Immune Feature Trends: distributions of immune readouts across selected groups, and associations between readouts within groups; Clinical Outcomes: trends of and associations with survival outcomes across sample groups based on immune characteristics; Immunomodulators: expression trends of genes that code for immunomodulating proteins, including checkpoint proteins. In response to community feedback, we are extending the iAtlas portal with two modules, one allowing researchers to classify their own RNAseq samples into immune subtypes, and the other allowing researchers to upload their own sample categories for analysis with the tool. As the resource evolves, we expect that the CRI iAtlas will help to accelerate discovery and improve patient outcomes by providing researchers greater access to immunogenomics data to better understand the immunologic characteristics of the tumor microenvironment and its potential impact on patient responses to immunotherapy. Reference: Thorsson et al. The immune landscape of cancer. Immunity 2018;48(4):812-30.e14. doi: 10.1016/j.immuni.2018.03.023.

Citation Format: Vesteinn Thorsson, James A. Eddy, Andrew Lamb, David L. Gibbs, Ilya Shmulevich, Justin Guinney. Facilitating translational research with interactive tools for immuno-oncology data [abstract]. In: Proceedings of the Fourth CRI-CIMT-EATI-AACR International Cancer Immunotherapy Conference: Translating Science into Survival; Sept 30-Oct 3, 2018; New York, NY. Philadelphia (PA): AACR; Cancer Immunol Res 2019;7(2 Suppl):Abstract nr B051.

The Immune Landscape of Cancer

We performed an extensive immunogenomic analysis of more than 10,000 tumors comprising 33 diverse cancer types by utilizing data compiled by TCGA. Across cancer types, we identified six immune subtypes-wound healing, IFN-γ dominant, inflammatory, lymphocyte depleted, immunologically quiet, and TGF-β dominant-characterized by differences in macrophage or lymphocyte signatures, Th1:Th2 cell ratio, extent of intratumoral heterogeneity, aneuploidy, extent of neoantigen load, overall cell proliferation, expression of immunomodulatory genes, and prognosis. Specific driver mutations correlated with lower (CTNNB1, NRAS, or IDH1) or higher (BRAF, TP53, or CASP8) leukocyte levels across all cancers. Multiple control modalities of the intracellular and extracellular networks (transcription, microRNAs, copy number, and epigenetic processes) were involved in tumor-immune cell interactions, both across and within immune subtypes. Our immunogenomics pipeline to characterize these heterogeneous tumors and the resulting data are intended to serve as a resource for future targeted studies to further advance the field.

Single-Cell RNA Sequencing Reveals Expanded Clones of Islet Antigen-Reactive CD4+ T Cells in Peripheral Blood of Subjects with Type 1 Diabetes

The significance of islet Ag-reactive T cells found in peripheral blood of type 1 diabetes (T1D) subjects is unclear, partly because similar cells are also found in healthy control (HC) subjects. We hypothesized that key disease-associated cells would show evidence of prior Ag exposure, inferred from expanded TCR clonotypes, and essential phenotypic properties in their transcriptomes. To test this, we developed single-cell RNA sequencing procedures for identifying TCR clonotypes and transcript phenotypes in individual T cells. We applied these procedures to analysis of islet Ag-reactive CD4⁺ memory T cells from the blood of T1D and HC individuals after activation with pooled immunodominant islet peptides. We found extensive TCR clonotype sharing in Ag-activated cells, especially from individual T1D subjects, consistent with in vivo T cell expansion during disease progression. The expanded clonotype from one T1D subject was detected at repeat visits spanning >15 mo, demonstrating clonotype stability. Notably, we found no clonotype sharing between subjects, indicating a predominance of "private" TCR specificities. Expanded clones from two T1D subjects recognized distinct IGRP peptides, implicating this molecule as a trigger for CD4⁺ T cell expansion. Although overall transcript profiles of cells from HC and T1D subjects were similar, profiles from the most expanded clones were distinctive. Our findings demonstrate that islet Ag-reactive CD4⁺ memory T cells with unique Ag specificities and phenotypes are expanded during disease progression and can be detected by single-cell analysis of peripheral blood.

Network reconstruction and systems analysis of plant cell wall deconstruction by Neurospora crassa

BACKGROUND

Plant biomass degradation by fungal-derived enzymes is rapidly expanding in economic importance as a clean and efficient source for biofuels. The ability to rationally engineer filamentous fungi would facilitate biotechnological applications for degradation of plant cell wall polysaccharides. However, incomplete knowledge of biomolecular networks responsible for plant cell wall deconstruction impedes experimental efforts in this direction.

RESULTS

To expand this knowledge base, a detailed network of reactions important for deconstruction of plant cell wall polysaccharides into simple sugars was constructed for the filamentous fungus Neurospora crassa. To reconstruct this network, information was integrated from five heterogeneous data types: functional genomics, transcriptomics, proteomics, genetics, and biochemical characterizations. The combined information was encapsulated into a feature matrix and the evidence weighted to assign annotation confidence scores for each gene within the network. Comparative analyses of RNA-seq and ChIP-seq data shed light on the regulation of the plant cell wall degradation network, leading to a novel hypothesis for degradation of the hemicellulose mannan. The transcription factor CLR-2 was subsequently experimentally shown to play a key role in the mannan degradation pathway of N. crassa.

CONCLUSIONS

Here we built a network that serves as a scaffold for integration of diverse experimental datasets. This approach led to the elucidation of regulatory design principles for plant cell wall deconstruction by filamentous fungi and a novel function for the transcription factor CLR-2. This expanding network will aid in efforts to rationally engineer industrially relevant hyper-production strains.

Human whole genome genotype and transcriptome data for Alzheimer's and other neurodegenerative diseases

Previous genome-wide association studies (GWAS), conducted by our group and others, have identified loci that harbor risk variants for neurodegenerative diseases, including Alzheimer's disease (AD). Human disease variants are enriched for polymorphisms that affect gene expression, including some that are known to associate with expression changes in the brain. Postulating that many variants confer risk to neurodegenerative disease via transcriptional regulatory mechanisms, we have analyzed gene expression levels in the brain tissue of subjects with AD and related diseases. Herein, we describe our collective datasets comprised of GWAS data from 2,099 subjects; microarray gene expression data from 773 brain samples, 186 of which also have RNAseq; and an independent cohort of 556 brain samples with RNAseq. We expect that these datasets, which are available to all qualified researchers, will enable investigators to explore and identify transcriptional mechanisms contributing to neurodegenerative diseases.

Fostering synergy between cell biology and systems biology

In the shared pursuit of elucidating detailed mechanisms of cell function, systems biology presents a natural complement to ongoing efforts in cell biology. Systems biology aims to characterize biological systems through integrated and quantitative modeling of cellular information. The process of model building and analysis provides value through synthesizing and cataloging information about cells and molecules, predicting mechanisms and identifying generalizable themes, generating hypotheses and guiding experimental design, and highlighting knowledge gaps and refining understanding. In turn, incorporating domain expertise and experimental data is crucial for building towards whole cell models. An iterative cycle of interaction between cell and systems biologists advances the goals of both fields and establishes a framework for mechanistic understanding of the genome-to-phenome relationship.

IL-10 alters immunoproteostasis in APP mice, increasing plaque burden and worsening cognitive behavior

Anti-inflammatory strategies are proposed to have beneficial effects in Alzheimer's disease. To explore how anti-inflammatory cytokine signaling affects Aβ pathology, we investigated the effects of adeno-associated virus (AAV2/1)-mediated expression of Interleukin (IL)-10 in the brains of APP transgenic mouse models. IL-10 expression resulted in increased Aβ accumulation and impaired memory in APP mice. A focused transcriptome analysis revealed changes consistent with enhanced IL-10 signaling and increased ApoE expression in IL-10-expressing APP mice. ApoE protein was selectively increased in the plaque-associated insoluble cellular fraction, likely because of direct interaction with aggregated Aβ in the IL-10-expressing APP mice. Ex vivo studies also show that IL-10 and ApoE can individually impair glial Aβ phagocytosis. Our observations that IL-10 has an unexpected negative effect on Aβ proteostasis and cognition in APP mouse models demonstrate the complex interplay between innate immunity and proteostasis in neurodegenerative diseases, an interaction we call immunoproteostasis.

Transcriptional analysis of aggressiveness and heterogeneity across grades of astrocytomas

Astrocytoma is the most common glioma, accounting for half of all primary brain and spinal cord tumors. Late detection and the aggressive nature of high-grade astrocytomas contribute to high mortality rates. Though many studies identify candidate biomarkers using high-throughput transcriptomic profiling to stratify grades and subtypes, few have resulted in clinically actionable results. This shortcoming can be attributed, in part, to pronounced lab effects that reduce signature robustness and varied individual gene expression among patients with the same tumor. We addressed these issues by uniformly preprocessing publicly available transcriptomic data, comprising 306 tumor samples from three astrocytoma grades (Grade 2, 3, and 4) and 30 non-tumor samples (normal brain as control tissues). Utilizing Differential Rank Conservation (DIRAC), a network-based classification approach, we examined the global and individual patterns of network regulation across tumor grades. Additionally, we applied gene-based approaches to identify genes whose expression changed consistently with increasing tumor grade and evaluated their robustness across multiple studies using statistical sampling. Applying DIRAC, we observed a global trend of greater network dysregulation with increasing tumor aggressiveness. Individual networks displaying greater differences in regulation between adjacent grades play well-known roles in calcium/PKC, EGF, and transcription signaling. Interestingly, many of the 90 individual genes found to monotonically increase or decrease with astrocytoma grade are implicated in cancer-affected processes such as calcium signaling, mitochondrial metabolism, and apoptosis. The fact that specific genes monotonically increase or decrease with increasing astrocytoma grade may reflect shared oncogenic mechanisms among phenotypically similar tumors. This work presents statistically significant results that enable better characterization of different human astrocytoma grades and hopefully can contribute towards improvements in diagnosis and therapy choices. Our results also identify a number of testable hypotheses relating to astrocytoma etiology that may prove helpful in developing much-needed biomarkers for earlier disease detection.

AUREA: an open-source software system for accurate and user-friendly identification of relative expression molecular signatures

Background

Public databases such as the NCBI Gene Expression Omnibus contain extensive and exponentially increasing amounts of high-throughput data that can be applied to molecular phenotype characterization. Collectively, these data can be analyzed for such purposes as disease diagnosis or phenotype classification. One family of algorithms that has proven useful for disease classification is based on relative expression analysis and includes the Top-Scoring Pair (TSP), k-Top-Scoring Pairs (k-TSP), Top-Scoring Triplet (TST) and Differential Rank Conservation (DIRAC) algorithms. These relative expression analysis algorithms hold significant advantages for identifying interpretable molecular signatures for disease classification, and have been implemented previously on a variety of computational platforms with varying degrees of usability. To increase the user-base and maximize the utility of these methods, we developed the program AUREA (Adaptive Unified Relative Expression Analyzer)—a cross-platform tool that has a consistent application programming interface (API), an easy-to-use graphical user interface (GUI), fast running times and automated parameter discovery.

Results

Herein, we describe AUREA, an efficient, cohesive, and user-friendly open-source software system that comprises a suite of methods for relative expression analysis. AUREA incorporates existing methods, while extending their capabilities and bringing uniformity to their interfaces. We demonstrate that combining these algorithms and adaptively tuning parameters on the training sets makes these algorithms more consistent in their performance and demonstrate the effectiveness of our adaptive parameter tuner by comparing accuracy across diverse datasets.

Conclusions

We have integrated several relative expression analysis algorithms and provided a unified interface for their implementation while making data acquisition, parameter fixing, data merging, and results analysis ‘point-and-click’ simple. The unified interface and the adaptive parameter tuning of AUREA provide an effective framework in which to investigate the massive amounts of publically available data by both ‘in silico’ and ‘bench’ scientists. AUREA can be found at http://price.systemsbiology.net/AUREA/.

Reconstruction of genome-scale metabolic models for 126 human tissues using mCADRE

Background

Human tissues perform diverse metabolic functions. Mapping out these tissue-specific functions in genome-scale models will advance our understanding of the metabolic basis of various physiological and pathological processes. The global knowledgebase of metabolic functions categorized for the human genome (Human Recon 1) coupled with abundant high-throughput data now makes possible the reconstruction of tissue-specific metabolic models. However, the number of available tissue-specific models remains incomplete compared with the large diversity of human tissues.

Results

We developed a method called metabolic Context-specificity Assessed by Deterministic Reaction Evaluation (mCADRE). mCADRE is able to infer a tissue-specific network based on gene expression data and metabolic network topology, along with evaluation of functional capabilities during model building. mCADRE produces models with similar or better functionality and achieves dramatic computational speed up over existing methods. Using our method, we reconstructed draft genome-scale metabolic models for 126 human tissue and cell types. Among these, there are models for 26 tumor tissues along with their normal counterparts, and 30 different brain tissues. We performed pathway-level analyses of this large collection of tissue-specific models and identified the eicosanoid metabolic pathway, especially reactions catalyzing the production of leukotrienes from arachidnoic acid, as potential drug targets that selectively affect tumor tissues.

Conclusions

This large collection of 126 genome-scale draft metabolic models provides a useful resource for studying the metabolic basis for a variety of human diseases across many tissues. The functionality of the resulting models and the fast computational speed of the mCADRE algorithm make it a useful tool to build and update tissue-specific metabolic models.

Mechanistic modeling of aberrant energy metabolism in human disease

Dysfunction in energy metabolism—including in pathways localized to the mitochondria—has been implicated in the pathogenesis of a wide array of disorders, ranging from cancer to neurodegenerative diseases to type II diabetes. The inherent complexities of energy and mitochondrial metabolism present a significant obstacle in the effort to understand the role that these molecular processes play in the development of disease. To help unravel these complexities, systems biology methods have been applied to develop an array of computational metabolic models, ranging from mitochondria-specific processes to genome-scale cellular networks. These constraint-based (CB) models can efficiently simulate aspects of normal and aberrant metabolism in various genetic and environmental conditions. Development of these models leverages—and also provides a powerful means to integrate and interpret—information from a wide range of sources including genomics, proteomics, metabolomics, and enzyme kinetics. Here, we review a variety of mechanistic modeling studies that explore metabolic functions, deficiency disorders, and aberrant biochemical pathways in mitochondria and related regions in the cell.

Metabolic network reconstruction and genome-scale model of butanol-producing strain Clostridium beijerinckii NCIMB 8052

BACKGROUND

Solventogenic clostridia offer a sustainable alternative to petroleum-based production of butanol--an important chemical feedstock and potential fuel additive or replacement. C. beijerinckii is an attractive microorganism for strain design to improve butanol production because it (i) naturally produces the highest recorded butanol concentrations as a byproduct of fermentation; and (ii) can co-ferment pentose and hexose sugars (the primary products from lignocellulosic hydrolysis). Interrogating C. beijerinckii metabolism from a systems viewpoint using constraint-based modeling allows for simulation of the global effect of genetic modifications.

RESULTS

We present the first genome-scale metabolic model (iCM925) for C. beijerinckii, containing 925 genes, 938 reactions, and 881 metabolites. To build the model we employed a semi-automated procedure that integrated genome annotation information from KEGG, BioCyc, and The SEED, and utilized computational algorithms with manual curation to improve model completeness. Interestingly, we found only a 34% overlap in reactions collected from the three databases--highlighting the importance of evaluating the predictive accuracy of the resulting genome-scale model. To validate iCM925, we conducted fermentation experiments using the NCIMB 8052 strain, and evaluated the ability of the model to simulate measured substrate uptake and product production rates. Experimentally observed fermentation profiles were found to lie within the solution space of the model; however, under an optimal growth objective, additional constraints were needed to reproduce the observed profiles--suggesting the existence of selective pressures other than optimal growth. Notably, a significantly enriched fraction of actively utilized reactions in simulations--constrained to reflect experimental rates--originated from the set of reactions that overlapped between all three databases (P = 3.52 × 10-9, Fisher's exact test). Inhibition of the hydrogenase reaction was found to have a strong effect on butanol formation--as experimentally observed.

CONCLUSIONS

Microbial production of butanol by C. beijerinckii offers a promising, sustainable, method for generation of this important chemical and potential biofuel. iCM925 is a predictive model that can accurately reproduce physiological behavior and provide insight into the underlying mechanisms of microbial butanol production. As such, the model will be instrumental in efforts to better understand, and metabolically engineer, this microorganism for improved butanol production.

Graphics processing unit implementations of relative expression analysis algorithms enable dramatic computational speedup

SUMMARY

The top-scoring pair (TSP) and top-scoring triplet (TST) algorithms are powerful methods for classification from expression data, but analysis of all combinations across thousands of human transcriptome samples is computationally intensive, and has not yet been achieved for TST. Implementation of these algorithms for the graphics processing unit results in dramatic speedup of two orders of magnitude, greatly increasing the searchable combinations and accelerating the pace of discovery.

AVAILABILITY

http://www.igb.illinois.edu/labs/price/downloads/.

Integrated proteomics and genomics analysis reveals a novel mesenchymal to epithelial reverting transition in leiomyosarcoma through regulation of slug

Leiomyosarcoma is one of the most common mesenchymal tumors. Proteomics profiling analysis by reverse-phase protein lysate array surprisingly revealed that expression of the epithelial marker E-cadherin (encoded by CDH1) was significantly elevated in a subset of leiomyosarcomas. In contrast, E-cadherin was rarely expressed in the gastrointestinal stromal tumors, another major mesenchymal tumor type. We further sought to 1) validate this finding, 2) determine whether there is a mesenchymal to epithelial reverting transition (MErT) in leiomyosarcoma, and if so 3) elucidate the regulatory mechanism responsible for this MErT. Our data showed that the epithelial cell markers E-cadherin, epithelial membrane antigen, cytokeratin AE1/AE3, and pan-cytokeratin were often detected immunohistochemically in leiomyosarcoma tumor cells on tissue microarray. Interestingly, the E-cadherin protein expression was correlated with better survival in leiomyosarcoma patients. Whole genome microarray was used for transcriptomics analysis, and the epithelial gene expression signature was also associated with better survival. Bioinformatics analysis of transcriptome data showed an inverse correlation between E-cadherin and E-cadherin repressor Slug (SNAI2) expression in leiomyosarcoma, and this inverse correlation was validated on tissue microarray by immunohistochemical staining of E-cadherin and Slug. Knockdown of Slug expression in SK-LMS-1 leiomyosarcoma cells by siRNA significantly increased E-cadherin; decreased the mesenchymal markers vimentin and N-cadherin (encoded by CDH2); and significantly decreased cell proliferation, invasion, and migration. An increase in Slug expression by pCMV6-XL5-Slug transfection decreased E-cadherin and increased vimentin and N-cadherin. Thus, MErT, which is mediated through regulation of Slug, is a clinically significant phenotype in leiomyosarcoma.

In silico models of cancer

Cancer is a complex disease that involves multiple types of biological interactions across diverse physical, temporal, and biological scales. This complexity presents substantial challenges for the characterization of cancer biology, and motivates the study of cancer in the context of molecular, cellular, and physiological systems. Computational models of cancer are being developed to aid both biological discovery and clinical medicine. The development of these in silico models is facilitated by rapidly advancing experimental and analytical tools that generate information-rich, high-throughput biological data. Statistical models of cancer at the genomic, transcriptomic, and pathway levels have proven effective in developing diagnostic and prognostic molecular signatures, as well as in identifying perturbed pathways. Statistically inferred network models can prove useful in settings where data overfitting can be avoided, and provide an important means for biological discovery. Mechanistically based signaling and metabolic models that apply a priori knowledge of biochemical processes derived from experiments can also be reconstructed where data are available, and can provide insight and predictive ability regarding the behavior of these systems. At longer length scales, continuum and agent-based models of the tumor microenvironment and other tissue-level interactions enable modeling of cancer cell populations and tumor progression. Even though cancer has been among the most-studied human diseases using systems approaches, significant challenges remain before the enormous potential of in silico cancer biology can be fully realized.

Relative expression analysis for molecular cancer diagnosis and prognosis

The enormous amount of biomolecule measurement data generated from high-throughput technologies has brought an increased need for computational tools in biological analyses. Such tools can enhance our understanding of human health and genetic diseases, such as cancer, by accurately classifying phenotypes, detecting the presence of disease, discriminating among cancer sub-types, predicting clinical outcomes, and characterizing disease progression. In the case of gene expression microarray data, standard statistical learning methods have been used to identify classifiers that can accurately distinguish disease phenotypes. However, these mathematical prediction rules are often highly complex, and they lack the convenience and simplicity desired for extracting underlying biological meaning or transitioning into the clinic. In this review, we survey a powerful collection of computational methods for analyzing transcriptomic microarray data that address these limitations. Relative Expression Analysis (RXA) is based only on the relative orderings among the expressions of a small number of genes. Specifically, we provide a description of the first and simplest example of RXA, the K-TSP classifier, which is based on _ pairs of genes; the case K = 1 is the TSP classifier. Given their simplicity and ease of biological interpretation, as well as their invariance to data normalization and parameter-fitting, these classifiers have been widely applied in aiding molecular diagnostics in a broad range of human cancers. We review several studies which demonstrate accurate classification of disease phenotypes (e.g., cancer vs. normal), cancer subclasses (e.g., AML vs. ALL, GIST vs. LMS), disease outcomes (e.g., metastasis, survival), and diverse human pathologies assayed through blood-borne leukocytes. The studies presented demonstrate that RXA-specifically the TSP and K-TSP classifiers-is a promising new class of computational methods for analyzing high-throughput data, and has the potential to significantly contribute to molecular cancer diagnosis and prognosis.

Identifying tightly regulated and variably expressed networks by Differential Rank Conservation (DIRAC)

A powerful way to separate signal from noise in biology is to convert the molecular data from individual genes or proteins into an analysis of comparative biological network behaviors. One of the limitations of previous network analyses is that they do not take into account the combinatorial nature of gene interactions within the network. We report here a new technique, Differential Rank Conservation (DIRAC), which permits one to assess these combinatorial interactions to quantify various biological pathways or networks in a comparative sense, and to determine how they change in different individuals experiencing the same disease process. This approach is based on the relative expression values of participating genes—i.e., the ordering of expression within network profiles. DIRAC provides quantitative measures of how network rankings differ either among networks for a selected phenotype or among phenotypes for a selected network. We examined disease phenotypes including cancer subtypes and neurological disorders and identified networks that are tightly regulated, as defined by high conservation of transcript ordering. Interestingly, we observed a strong trend to looser network regulation in more malignant phenotypes and later stages of disease. At a sample level, DIRAC can detect a change in ranking between phenotypes for any selected network. Variably expressed networks represent statistically robust differences between disease states and serve as signatures for accurate molecular classification, validating the information about expression patterns captured by DIRAC. Importantly, DIRAC can be applied not only to transcriptomic data, but to any ordinal data type.

The systems approach to medicine derives from the idea that diseased cells arise from one or more perturbed biological networks due to the net effect of interactions among multiple molecular agents; by measuring differences in the abundance of biomolecules (e.g., mRNA, proteins, metabolites) we can identify reporters of network states and uncover molecular signatures of disease. However, a major limitation of previously published network analyses is the focus on small numbers of individual, differentially-expressed genes, hence the failure to take into account combinatorial interactions. We report a new technique, Differential Rank Conservation, for identifying and measuring network-level perturbations. Our rank conservation index is based entirely on the relative levels of expression for participating genes and allows us to detect differences in network orderings between networks for a given phenotype and between phenotypes for a given network. In examining cancer subtypes and neurological disorders, we identified networks that are tightly and loosely regulated, as defined by the level of conservation of transcript ordering, and observed a strong trend to looser network regulation in more malignant phenotypes and later stages of disease. We also demonstrate that variably expressed networks represent robust differences between disease states.

Relative expression analysis for identifying perturbed pathways

The computational identification from global data sets of stable and predictive patterns of gene and protein relative expression reversals offers a simple, yet powerful approach to target therapies for personalized medicine and to identify pathways that are disease-perturbed. We previously utilized this approach to identify a molecular classifier with near 100% accuracy for differentiating gastrointestinal stromal tumor (GIST) and leiomyosarcoma (LMS), two cancers that have very similar histopathology, but require very different treatments. Differential Rank Conservation (DIRAC) is a novel approach for studying gene ordering within pathways and is based on the relative expression ranks of participating genes. DIRAC provides quantitative measures of how pathway rankings differ both within and between phenotypes. DIRAC between pathways in a selected phenotype contrasts the scenarios where either (i) pathways are ranked similarly in all samples; or (ii) the ordering of pathway genes is highly varied. We examined gene expression in GIST and LMS tumor profiles and identified pathways that appear to be tightly regulated based on high conservation of gene ordering. The second form of DIRAC manifests as a change in ranking (i.e., shuffling) between phenotypes for a selected pathway. These variably expressed pathways serve as signatures for molecular classification, and the ability to accurately classify microarray samples provided strong validation for the pathway-level expression differences identified by DIRAC.

Accomplishments in genome-scale in silico modeling for industrial and medical biotechnology

Driven by advancements in high-throughput biological technologies and the growing number of sequenced genomes, the construction of in silico models at the genome scale has provided powerful tools to investigate a vast array of biological systems and applications. Here, we review comprehensively the uses of such models in industrial and medical biotechnology, including biofuel generation, food production, and drug development. While the use of in silico models is still in its early stages for delivering to industry, significant initial successes have been achieved. For the cases presented here, genome-scale models predict engineering strategies to enhance properties of interest in an organism or to inhibit harmful mechanisms of pathogens. Going forward, genome-scale in silico models promise to extend their application and analysis scope to become a trans-formative tool in biotechnology.

In silico models of cancer

Cancer is a complex disease that involves multiple types of biological interactions across diverse physical, temporal, and biological scales. This complexity presents substantial challenges for the characterization of cancer biology, and motivates the study of cancer in the context of molecular, cellular, and physiological systems. Computational models of cancer are being developed to aid both biological discovery and clinical medicine. The development of these in silico models is facilitated by rapidly advancing experimental and analytical tools that generate information-rich, high-throughput biological data. Statistical models of cancer at the genomic, transcriptomic, and pathway levels have proven effective in developing diagnostic and prognostic molecular signatures, as well as in identifying perturbed pathways. Statistically inferred network models can prove useful in settings where data overfitting can be avoided, and provide an important means for biological discovery. Mechanistically based signaling and metabolic models that apply a priori knowledge of biochemical processes derived from experiments can also be reconstructed where data are available, and can provide insight and predictive ability regarding the behavior of these systems. At longer length scales, continuum and agent-based models of the tumor microenvironment and other tissue-level interactions enable modeling of cancer cell populations and tumor progression. Even though cancer has been among the most-studied human diseases using systems approaches, significant challenges remain before the enormous potential of in silico cancer biology can be fully realized.

Dynamic analysis of integrated signaling, metabolic, and regulatory networks

Extracellular cues affect signaling, metabolic, and regulatory processes to elicit cellular responses. Although intracellular signaling, metabolic, and regulatory networks are highly integrated, previous analyses have largely focused on independent processes (e.g., metabolism) without considering the interplay that exists among them. However, there is evidence that many diseases arise from multifunctional components with roles throughout signaling, metabolic, and regulatory networks. Therefore, in this study, we propose a flux balance analysis (FBA)–based strategy, referred to as integrated dynamic FBA (idFBA), that dynamically simulates cellular phenotypes arising from integrated networks. The idFBA framework requires an integrated stoichiometric reconstruction of signaling, metabolic, and regulatory processes. It assumes quasi-steady-state conditions for “fast” reactions and incorporates “slow” reactions into the stoichiometric formalism in a time-delayed manner. To assess the efficacy of idFBA, we developed a prototypic integrated system comprising signaling, metabolic, and regulatory processes with network features characteristic of actual systems and incorporating kinetic parameters based on typical time scales observed in literature. idFBA was applied to the prototypic system, which was evaluated for different environments and gene regulatory rules. In addition, we applied the idFBA framework in a similar manner to a representative module of the single-cell eukaryotic organism Saccharomyces cerevisiae. Ultimately, idFBA facilitated quantitative, dynamic analysis of systemic effects of extracellular cues on cellular phenotypes and generated comparable time-course predictions when contrasted with an equivalent kinetic model. Since idFBA solves a linear programming problem and does not require an exhaustive list of detailed kinetic parameters, it may be efficiently scaled to integrated intracellular systems that incorporate signaling, metabolic, and regulatory processes at the genome scale, such as the S. cerevisiae system presented here.

Cellular systems comprise many diverse components and component interactions spanning signal transduction, transcriptional regulation, and metabolism. Although signaling, metabolic, and regulatory activities are often investigated independently of one another, there is growing evidence that considerable interplay occurs among them, and that the malfunctioning of this interplay is associated with disease. The computational analysis of integrated networks has been challenging because of the varying time scales involved as well as the sheer magnitude of such systems (e.g., the numbers of rate constants involved). To this end, we developed a novel computational framework called integrated dynamic flux balance analysis (idFBA) that generates quantitative, dynamic predictions of species concentrations spanning signaling, regulatory, and metabolic processes. idFBA extends an existing approach called flux balance analysis (FBA) in that it couples “fast” and “slow” reactions, thereby facilitating the study of whole-cell phenotypes and not just sub-cellular network properties. We applied this framework to a prototypic integrated system derived from literature as well as a representative integrated yeast module (the high-osmolarity glycerol [HOG] pathway) and generated time-course predictions that matched with available experimental data. By extending this framework to larger-scale systems, phenotypic profiles of whole-cell systems could be attained expeditiously.

Systems analysis of metabolism in the pathogenic trypanosomatid Leishmania major

Systems analyses have facilitated the characterization of metabolic networks of several organisms. We have reconstructed the metabolic network of Leishmania major, a poorly characterized organism that causes cutaneous leishmaniasis in mammalian hosts. This network reconstruction accounts for 560 genes, 1112 reactions, 1101 metabolites and 8 unique subcellular localizations. Using a systems-based approach, we hypothesized a comprehensive set of lethal single and double gene deletions, some of which were validated using published data with approximately 70% accuracy. Additionally, we generated hypothetical annotations to dozens of previously uncharacterized genes in the L. major genome and proposed a minimal medium for growth. We further demonstrated the utility of a network reconstruction with two proof-of-concept examples that yielded insight into robustness of the network in the presence of enzymatic inhibitors and delineation of promastigote/amastigote stage-specific metabolism. This reconstruction and the associated network analyses of L. major is the first of its kind for a protozoan. It can serve as a tool for clarifying discrepancies between data sources, generating hypotheses that can be experimentally validated and identifying ideal therapeutic targets.

Solar considerations in the development of cutaneous melanoma

On the basis of these considerations, the possible action spectrum for melanoma can be narrowed considerably, but not confined to any one solar emission band. The physical factors discussed eliminate all but UV, visible, and NIR radiation as possible solar agents. Ionizing radiation fits neither the epidemiologic data nor first-order physical considerations. Wavelengths longer than the NIR wavelengths, although they could conceivably account for the occurrence of melanoma under clothed parts of the body, carry so little energy that they are probably unimportant. Epidemiologic evidence regarding the effects of skin pigment favors UV or visible radiation. A distinction between these two components is not obvious; UV-C and UV-B photons carry greater energy and are more likely to induce biochemical cutaneous effects, but the total flux in the UV-A and visible radiations is far greater. That UV-B radiation may play a role in melanoma is supported; at the same time, one cannot exclude the possibility that the action spectrum for melanoma is, instead, the UV-A, the visible, or even the NIR portion of the sunlight spectrum. The strong differential effect of altitude on the transmission of light of different wavelengths might serve as an important discriminating variable. If solar UV radiation is implicated in the development of melanoma, then altitude should emerge as a significant factor in epidemiologic studies. If visible or IR radiation is the active agent, then differences on the basis of altitude should be small or negligible. Intrinsic solar variations that follow the annual sunspot number appear inadequate in either the UV or the visible band to account directly for the apparent 11-year modulation of melanoma incidence found in some registries. Secondary atmospheric effects brought about by the action of solar UV changes on the ozone layer may be adequate to explain a weak 11-year modulation in melanoma incidence, although continuous measurements of UV-B flux made at sites in the United States through a full solar cycle have shown no such effect. Nor do these early measurements reveal the long-term increase in UV-B intensity expected from the destruction of stratospheric ozone by industrial pollutants over the last 10 years.

Edison the scientist

This year marks the 100th anniversary of Edison's invention of the electric lamp, one of many heralded accomplishments that brought him lasting fame. For much of life Edison enjoyed a popular reputation as a laboratory genius who personified the spirit of scientific discovery. Was he really a scientist, or only an inventor? His participation in the Draper Expedition to the solar eclipse of 1878, told here, offers a chance to evaluate the youthful Edison as an astronomer and infrared physicist.

Anomalous Solar Rotation in the Early 17th Century

The character of solar rotation has been examined for two periods in the early 17th century for which detailed sunspot drawings are available: A.D. 1625 through 1626 and 1642 through 1644. The first period occurred 20 years before the start of the Maunder sunspot minimum, 1645 through 1715; the second occurred just at its commencement. Solar rotation in the earlier period was much like that of today. In the later period, the equatorial velocity of the sun was faster by 3 to 5 percent and the differential rotation was enhanced by a factor of 3. The equatorial acceleration with declining solar activity is in the same sense as that found in recent Doppler data. It seems likely that the change in rotation of the solar surface between 1625 and 1645 was associated with the onset of the Maunder Minimum.

Far infrared airborne spectroscopy

Equipment and techniques employed in an airborne far ir (80-400 micro) spectral measurement of the solar brightness temperature are described, with particular attention paid to the scanning Michelson interferometer and the radiometric calibration. The airborne performance of several telescopic guiding systems, a liquid helium cooled bolometer, and golay cells are discussed, summarizing experience gained on twenty-five jet aircraft flights.