Questions regarding the predictive value of one evolved complex adaptive system for a second: Exemplified by the SOD1 mouse

Development and Implementation of an Integrated Preclinical Atherosclerosis Database

BACKGROUND

Basic scientists have used preclinical animal models to explore mechanisms driving human diseases for decades, resulting in thousands of publications, each supporting causative inferences. Despite substantial advances in the mechanistic construct of disease, there has been limited translation from individual studies to advances in clinical care. An integrated approach to these individual studies has the potential to improve translational success.

METHODS

Using atherosclerosis as a test case, we extracted data from the 2 most common mouse models of atherosclerosis (ApoE [apolipoprotein E]-knockout and LDLR [low-density lipoprotein receptor]-knockout). We restricted analyses to manuscripts published in 2 well-established journals, Arteriosclerosis, Thrombosis, and Vascular Biology and Circulation, as of query in 2021. Predefined variables including experimental conditions, intervention, and outcomes were extracted from each publication to produce a preclinical atherosclerosis database.

RESULTS

Extracted data include animal sex, diet, intervention type, and distinct plaque pathologies (size, inflammation, and lipid content). Procedures are provided to standardize data extraction, attribute interventions to specific genes, and transform the database for use with available transcriptomics software. The database integrates hundreds of genes, each directly tested in vivo for causation in a murine atherosclerosis model. The database is provided to allow the research community to perform integrated analyses that reflect the global impact of decades of atherosclerosis investigation.

CONCLUSIONS

This database is provided as a resource for future interrogation of sub-data sets associated with distinct plaque pathologies, cell type, or sex. We also provide the methods and software needed to expand this data set and apply this approach to the extensive repository of peer-reviewed data utilizing preclinical models to interrogate mechanisms of diverse human diseases.

Development and implementation of an integrated preclinical atherosclerosis database

Background

Basic scientists have used preclinical animal models to explore mechanisms driving human diseases for decades, resulting in thousands of publications, each supporting causative inferences. Despite substantial advances in the mechanistic construct of disease, there has been limited translation from individual studies to advances in clinical care. An integrated approach to these individual studies has the potential to improve translational success.

Methods

Using atherosclerosis as a test case, we extracted data from the two most common mouse models of atherosclerosis (ApoE and LDLR knockout). We restricted analyses to manuscripts published in two well-established journals, Arteriosclerosis, Thrombosis, and Vascular Biology and Circulation, as of query in 2021. Predefined variables including experimental conditions, intervention and outcomes were extracted from each publication to produce a preclinical atherosclerosis database.

Results

Extracted data include animal sex, diet, intervention type and distinct plaque pathologies (size, inflammation, lipid content). Procedures are provided to standardize data extraction, attribute interventions to specific genes and transform the database for use with available transcriptomics software. The database integrates hundreds of genes, each directly tested in vivo for causation in a murine atherosclerosis model. The database is provided to allow the research community to perform integrated analyses that reflect the global impact of decades of atherosclerosis investigation.

Conclusions

Future database uses include interrogation of sub-datasets associated with distinct plaque pathologies, cell-type or sex. We provide the methods and software needed to apply this approach to the extensive repository of peer-reviewed data utilizing preclinical models to interrogate mechanisms of diverse human diseases.

Trackable Intratumor Microdosing and Spatial Profiling Provide Early Insights into Activity of Investigational Agents in the Intact Tumor Microenvironment

PURPOSE

Cancer drug development is currently limited by a paradigm of preclinical evaluation that does not adequately recapitulate the complexity of the intact human tumor microenvironment (TME). To overcome this, we combined trackable intratumor microdosing (CIVO) with spatial biology readouts to directly assess drug effects in patient tumors in situ.

EXPERIMENTAL DESIGN

In a first-of-its-kind phase 0 clinical trial, we explored the effects of an investigational stage SUMOylation-activating enzyme (SAE) inhibitor, subasumstat (TAK-981) in 12 patients with head and neck carcinoma (HNC). Patients scheduled for tumor resection received percutaneous intratumor injections of subasumstat and vehicle control 1 to 4 days before surgery, resulting in spatially localized and graded regions of drug exposure (∼1,000-2,000 μm in diameter). Drug-exposed (n = 214) and unexposed regions (n = 140) were compared by GeoMx Digital Spatial Profiler, with evaluation at single-cell resolution in a subset of these by CosMx Spatial Molecular Imager.

RESULTS

Localized regions of subasumstat exposure revealed SUMO pathway inhibition, elevation of type I IFN response, and inhibition of cell cycle across all tumor samples. Single-cell analysis by CosMx demonstrated cell-cycle inhibition specific to the tumor epithelium, and IFN pathway induction commensurate with a TME shift from immune-suppressive to immune-permissive.

CONCLUSIONS

Pairing CIVO with spatial profiling enabled detailed investigation of response to subasumstat across a diverse sampling of native and intact TME. We demonstrate that drug mechanism of action can be directly evaluated in a spatially precise manner in the most translationally relevant setting: an in situ human tumor.

Autologous iPSC-Derived Human Neuromuscular Junction to Model the Pathophysiology of Hereditary Spastic Paraplegia

Hereditary spastic paraplegia (HSP) is a heterogeneous group of genetic neurodegenerative disorders, characterized by progressive lower limb spasticity and weakness resulting from retrograde axonal degeneration of motor neurons (MNs). Here, we generated in vitro human neuromuscular junctions (NMJs) from five HSP patient-specific induced pluripotent stem cell (hiPSC) lines, by means of microfluidic strategy, to model disease-relevant neuropathologic processes. The strength of our NMJ model lies in the generation of lower MNs and myotubes from autologous hiPSC origin, maintaining the genetic background of the HSP patient donors in both cell types and in the cellular organization due to the microfluidic devices. Three patients characterized by a mutation in the SPG3a gene, encoding the ATLASTIN GTPase 1 protein, and two patients with a mutation in the SPG4 gene, encoding the SPASTIN protein, were included in this study. Differentiation of the HSP-derived lines gave rise to lower MNs that could recapitulate pathological hallmarks, such as axonal swellings with accumulation of Acetyl-α-TUBULIN and reduction of SPASTIN levels. Furthermore, NMJs from HSP-derived lines were lower in number and in contact point complexity, denoting an impaired NMJ profile, also confirmed by some alterations in genes encoding for proteins associated with microtubules and responsible for axonal transport. Considering the complexity of HSP, these patient-derived neuronal and skeletal muscle cell co-cultures offer unique tools to study the pathologic mechanisms and explore novel treatment options for rescuing axonal defects and diverse cellular processes, including membrane trafficking, intracellular motility and protein degradation in HSP.

Human motor units in microfluidic devices are impaired by FUS mutations and improved by HDAC6 inhibition

Neuromuscular junctions (NMJs) ensure communication between motor neurons (MNs) and muscle; however, in MN disorders, such as amyotrophic lateral sclerosis (ALS), NMJs degenerate resulting in muscle atrophy. The aim of this study was to establish a versatile and reproducible in vitro model of a human motor unit to investigate the effects of ALS-causing mutations. Therefore, we generated a co-culture of human induced pluripotent stem cell (iPSC)-derived MNs and human primary mesoangioblast-derived myotubes in microfluidic devices. A chemotactic and volumetric gradient facilitated the growth of MN neurites through microgrooves resulting in the interaction with myotubes and the formation of NMJs. We observed that ALS-causing FUS mutations resulted in reduced neurite outgrowth as well as an impaired neurite regrowth upon axotomy. NMJ numbers were likewise reduced in the FUS-ALS model. Interestingly, the selective HDAC6 inhibitor, Tubastatin A, improved the neurite outgrowth, regrowth, and NMJ morphology, prompting HDAC6 inhibition as a potential therapeutic strategy for ALS.

•

Human motor units with functional NMJs can be generated using microfluidic devices

•

FUS-ALS motor units display impaired neurite regrowth, outgrowth and NMJ numbers

•

HDAC6 inhibition alleviate FUS-ALS motor unit pathology in vitro

Links between Nutrition, Infectious Diseases, and Microbiota: Emerging Technologies and Opportunities for Human-Focused Research

The interaction between nutrition and human infectious diseases has always been recognized. With the emergence of molecular tools and post-genomics, high-resolution sequencing technologies, the gut microbiota has been emerging as a key moderator in the complex interplay between nutrients, human body, and infections. Much of the host-microbial and nutrition research is currently based on animals or simplistic in vitro models. Although traditional in vivo and in vitro models have helped to develop mechanistic hypotheses and assess the causality of the host-microbiota interactions, they often fail to faithfully recapitulate the complexity of the human nutrient-microbiome axis in gastrointestinal homeostasis and infections. Over the last decade, remarkable progress in tissue engineering, stem cell biology, microfluidics, sequencing technologies, and computing power has taken place, which has produced a new generation of human-focused, relevant, and predictive tools. These tools, which include patient-derived organoids, organs-on-a-chip, computational analyses, and models, together with multi-omics readouts, represent novel and exciting equipment to advance the research into microbiota, infectious diseases, and nutrition from a human-biology-based perspective. After considering some limitations of the conventional in vivo and in vitro approaches, in this review, we present the main novel available and emerging tools that are suitable for designing human-oriented research.

Multiplexed Evaluation of Microdosed Antineoplastic Agents In Situ in the Tumor Microenvironment of Patients with Soft Tissue Sarcoma

PURPOSE

A persistent issue in cancer drug development is the discordance between robust antitumor drug activity observed in laboratory models and the limited benefit frequently observed when patients are treated with the same agents in clinical trials. Difficulties in accurately modeling the complexities of human tumors may underlie this problem. To address this issue, we developed Comparative In Vivo Oncology (CIVO), which enables in situ investigation of multiple microdosed drugs simultaneously in a patient's tumor. This study was designed to test CIVO's safety and feasibility in patients with soft tissue sarcoma (STS).

PATIENTS AND METHODS

We conducted a single arm, prospective, 13-patient pilot study. Patients scheduled for incisional biopsy or tumor resection were CIVO-injected 1 to 3 days prior to surgery. Saline or microdoses of anticancer agents were percutaneously injected into the tumor in a columnar fashion through each of eight needles. Following excision, drug responses were evaluated in the injected tissue.

RESULTS

The primary objective was met, establishing CIVO's feasibility and safety. Device-related adverse events were limited to transient grade 1 nonserious events. In addition, biomarker evaluation of localized tumor response to CIVO microinjected drugs by IHC or with NanoString GeoMx Digital Spatial Profiler demonstrated consistency with known mechanisms of action of each drug, impact on the tumor microenvironment, and historic clinical activity.

CONCLUSIONS

These results are an advance toward use of CIVO as a translational research tool for early evaluation of investigational agents and drug combinations in a novel approach to phase 0 trials.See related commentary by Sleijfer and Lolkema, p. 3897.

Animal to human translation: a systematic scoping review of reported concordance rates

Background

Drug development is currently hampered by high attrition rates; many developed treatments fail during clinical testing. Part of the attrition may be due to low animal-to-human translational success rates; so-called “translational failure”. As far as we know, no systematic overview of published translational success rates exists.

Systematic scoping review

The following research question was examined: “What is the observed range of the animal-to-human translational success (and failure) rates within the currently available empirical evidence?”. We searched PubMed and Embase on 16 October 2017. We included reviews and all other types of “umbrella”-studies of meta-data quantitatively comparing the translational results of studies including at least two species with one being human. We supplemented our database searches with additional strategies. All abstracts and full-text papers were screened by two independent reviewers. Our scoping review comprises 121 references, with various units of measurement: compound or intervention (k = 104), study/experiment (k = 10), and symptom or event (k = 7). Diagnostic statistics corresponded with binary and continuous definitions of successful translation. Binary definitions comprise percentages below twofold error, percentages accurately predicted, and predictive values. Quantitative definitions comprise correlation/regression (r²) and meta-analyses (percentage overlap of 95% confidence intervals). Translational success rates ranged from 0 to 100%.

Conclusion

The wide range of translational success rates observed in our study might indicate that translational success is unpredictable; i.e. it might be unclear upfront if the results of primary animal studies will contribute to translational knowledge. However, the risk of bias of the included studies was high, and much of the included evidence is old, while newer models have become available. Therefore, the reliability of the cumulative evidence from current papers on this topic is insufficient. Further in-depth “umbrella”-studies of translational success rates are still warranted. These are needed to evaluate the probabilistic evidence for predictivity of animal studies for the human situation more reliably, and to determine which factors affect this process.

Is it possible to overcome issues of external validity in preclinical animal research? Why most animal models are bound to fail

Background

The pharmaceutical industry is in the midst of a productivity crisis and rates of translation from bench to bedside are dismal. Patients are being let down by the current system of drug discovery; of the several 1000 diseases that affect humans, only a minority have any approved treatments and many of these cause adverse reactions in humans. A predominant reason for the poor rate of translation from bench to bedside is generally held to be the failure of preclinical animal models to predict clinical efficacy and safety. Attempts to explain this failure have focused on problems of internal validity in preclinical animal studies (e.g. poor study design, lack of measures to control bias). However there has been less discussion of another key factor that influences translation, namely the external validity of preclinical animal models.

Review of problems of external validity

External validity is the extent to which research findings derived in one setting, population or species can be reliably applied to other settings, populations and species. This paper argues that the reliable translation of findings from animals to humans will only occur if preclinical animal studies are both internally and externally valid. We review several key aspects that impact external validity in preclinical animal research, including unrepresentative animal samples, the inability of animal models to mimic the complexity of human conditions, the poor applicability of animal models to clinical settings and animal–human species differences. We suggest that while some problems of external validity can be overcome by improving animal models, the problem of species differences can never be overcome and will always undermine external validity and the reliable translation of preclinical findings to humans.

Conclusion

We conclude that preclinical animal models can never be fully valid due to the uncertainties introduced by species differences. We suggest that even if the next several decades were spent improving the internal and external validity of animal models, the clinical relevance of those models would, in the end, only improve to some extent. This is because species differences would continue to make extrapolation from animals to humans unreliable. We suggest that to improve clinical translation and ultimately benefit patients, research should focus instead on human-relevant research methods and technologies.

Unsolvable Problems of Biology: It Is Impossible to Create Two Identical Organisms, to Defeat Cancer, or to Map Organisms onto Their Genomes

The review is devoted to unsolvable problems of biology. 1) Problems unsolvable due to stochastic mutations occurring during DNA replication that make it impossible to create two identical organisms or even two identical complex cells (Sverdlov, E. D. (2009) Biochemistry (Moscow), 74, 939-944) and to "defeat" cancer. 2) Problems unsolvable due to multiple interactions in complex systems leading to the appearance of unpredictable emergent properties that prevent establishment of unambiguous relationships between the genetic architecture and phenotypic manifestation of the genome and make impossible to predict with certainty responses of the organism, its parts, or pathological processes to external factors. 3) Problems unsolvable because of the uncertainty principle and observer effect in biology, due to which it is impossible to obtain adequate information about cells in their tissue microenvironment by isolating and analyzing individual cells. In particular, we cannot draw conclusions on the properties of stem cells in their niches based on the properties of stem cell cultures. A strategy is proposed for constructing the pattern most closely approximated to the relationship of genotypes with their phenotypes by designing networks of intermediate phenotypes (endophenotypes).

Reagent Validation to Facilitate Experimental Reproducibility

Many results reported in the biomedical research literature cannot be independently reproduced, undermining the basic foundations of science. This overview is intended for researchers who are committed to improving the quality and integrity of biomedical science by raising awareness of both the sources of irreproducibility, and activities specifically targeted to address the issue. The irreproducibility of biomedical research is due to a variety of factors, known and unknown, that markedly influence experimental outcomes. Among the known factors are inadequate training or mentoring, or experimenter incompetence. These may result in flawed experimental design and execution that reflect a lack of planning, leading to an underpowering of a study, an absence of appropriate controls, selective data analysis, inappropriate statistical analysis, and/or investigator bias or fraud. Another frequently overlooked source of irreproducibility is failure to ensure that the equipment used is performing up to manufacturer specifications. Failure to validate/authenticate the experimental reagents is another source of irreproducibility. These include compounds, cell lines, antibodies, and the animal models used in a study. This overview discusses how a lack of validation of research reagents negatively impact experimental reproducibility, and provides guidelines to avoid these pitfalls. © 2018 by John Wiley & Sons, Inc.

Animal models of amyotrophic lateral sclerosis: A comparison of model validity

Animal models are necessary to investigate the pathogenic features underlying motor neuron degeneration and for therapeutic development in amyotrophic lateral sclerosis (ALS). Measures of model validity allow for a critical interpretation of results from each model and caution from over-interpretation of experimental models. Face and construct validity refer to the similarity in phenotype and the proposed causal factor to the human disease, respectively. More recently developed models are restricted by limited phenotype characterization, yet new models hold promise for novel disease insights, thus highlighting their importance. In this article, we evaluate the features of face and construct validity of our new zebrafish model of environmentally-induced motor neuron degeneration and discuss this in the context of current environmental and genetic ALS models, including C9orf72, mutant Cu/Zn superoxide dismutase 1 and TAR DNA-binding protein 43 mouse and zebrafish models. In this mini-review, we discuss the pros and cons to validity criteria in each model. Our zebrafish model of environmentally-induced motor neuron degeneration displays convincing features of face validity with many hallmarks of ALS-like features, and weakness in construct validity. However, the value of this model may lie in its potential to be more representative of the pathogenic features underlying sporadic ALS cases, where environmental factors may be more likely to be involved in disease etiology than single dominant gene mutations. It may be necessary to compare findings between different strains and species modeling specific genes or environmental factors to confirm findings from ALS animal models and tease out arbitrary strain- and overexpression-specific effects.

Applications and Limitations of Mouse Models for Understanding Human Atherosclerosis

Most of the biological understanding of mechanisms underlying coronary artery disease (CAD) derives from studies of mouse models. The identification of multiple CAD loci and strong candidate genes in large human genome-wide association studies (GWASs) presented an opportunity to examine the relevance of mouse models for the human disease. We comprehensively reviewed the mouse literature, including 827 literature-derived genes, and compared it to human data. First, we observed striking concordance of risk factors for atherosclerosis in mice and humans. Second, there was highly significant overlap of mouse genes with human genes identified by GWASs. In particular, of the 46 genes with strong association signals in CAD GWASs that were studied in mouse models, all but one exhibited consistent effects on atherosclerosis-related phenotypes. Third, we compared 178 CAD-associated pathways derived from human GWASs with 263 from mouse studies and observed that the majority were consistent between the species.

Multidimensional Complexity of Cancer. Simple Solutions Are Needed

Cancer is a complex system. Tumor complexity is determined not only by genetic and epigenetic heterogeneity, but also by a huge number of interactions between cancer and normal cells. The heterogeneity and complexity of a tumor causes failure of molecular targeting therapy as a tool for fighting cancer. This review considers the concepts of malignant tumors as organisms that have common characteristics despite all heterogeneity. This leads to the idea that one of the most promising strategies for fighting cancer is the use of the patient's immune system.

The European Citizens' Stop Vivisection Initiative and the revision of Directive

Animal experimentation is presented to the public as an ongoing debate between research scientists on one hand, and the animal protection community on the other. An opportunity to break out of this mindset presented itself in the form of a European Citizens' Initiative, Stop Vivisection, which challenged Directive 2010/63/EU of the European Parliament and of the Council on the protection of animals for scientific purposes. The manifesto of the initiative called upon the European Commission to replace the existing Directive with a new proposal that does away with animal experimentation, and instead makes compulsory the use of human data as a predictive modality for the study of human diseases and responses to drugs. Although the Initiative succeeded in gathering the required one million signatures, the European Commission ultimately rejected the proposal. However, some of the lessons learned from the Initiative may well be relevant to the revision of Directive 2010/63/EU, due to take place by 2017.

Expectations for the methodology and translation of animal research: a survey of the general public, medical students and animal researchers in North America

To determine what are considered acceptable standards for animal research (AR) methodology and translation rate to humans, a validated survey was sent to: a) a sample of the general public, via Sampling Survey International (SSI; Canada), Amazon Mechanical Turk (AMT; USA), a Canadian city festival (CF) and a Canadian children's hospital (CH); b) a sample of medical students (two first-year classes); and c) a sample of scientists (corresponding authors and academic paediatricians). There were 1379 responses from the general public sample (SSI, n = 557; AMT, n = 590; CF, n = 195; CH, n = 102), 205/330 (62%) medical student responses, and 23/323 (7%, too few to report) scientist responses. Asked about methodological quality, most of the general public and medical student respondents expect that: AR is of high quality (e.g. anaesthesia and analgesia are monitored, even overnight, and 'humane' euthanasia, optimal statistical design, comprehensive literature review, randomisation and blinding, are performed), and costs and difficulty are not acceptable justifications for lower quality (e.g. costs of expert consultation, or more laboratory staff). Asked about their expectations of translation to humans (of toxicity, carcinogenicity, teratogenicity and treatment findings), most expect translation more than 60% of the time. If translation occurred less than 20% of the time, a minority disagreed that this would "significantly reduce your support for AR". Medical students were more supportive of AR, even if translation occurred less than 20% of the time. Expectations for AR are much higher than empirical data show to have been achieved.

Expectations for methodology and translation of animal research: a survey of health care workers

Background

Health care workers (HCW) often perform, promote, and advocate use of public funds for animal research (AR); therefore, an awareness of the empirical costs and benefits of animal research is an important issue for HCW. We aim to determine what health-care-workers consider should be acceptable standards of AR methodology and translation rate to humans.

Methods

After development and validation, an e-mail survey was sent to all pediatricians and pediatric intensive care unit nurses and respiratory-therapists (RTs) affiliated with a Canadian University. We presented questions about demographics, methodology of AR, and expectations from AR. Responses of pediatricians and nurses/RTs were compared using Chi-square, with P < .05 considered significant.

Results

Response rate was 44/114(39%) (pediatricians), and 69/120 (58%) (nurses/RTs). Asked about methodological quality, most respondents expect that: AR is done to high quality; costs and difficulty are not acceptable justifications for low quality; findings should be reproducible between laboratories and strains of the same species; and guidelines for AR funded with public money should be consistent with these expectations. Asked about benefits of AR, most thought that there are sometimes/often large benefits to humans from AR, and disagreed that “AR rarely produces benefit to humans.” Asked about expectations of translation to humans (of toxicity, carcinogenicity, teratogenicity, and treatment findings), most: expect translation >40% of the time; thought that misleading AR results should occur <21% of the time; and that if translation was to occur <20% of the time, they would be less supportive of AR. There were few differences between pediatricians and nurses/RTs.

Conclusions

HCW have high expectations for the methodological quality of, and the translation rate to humans of findings from AR. These expectations are higher than the empirical data show having been achieved. Unless these areas of AR significantly improve, HCW support of AR may be tenuous.

Therapeutic properties of a vector carrying the HSV thymidine kinase and GM-CSF genes and delivered as a complex with a cationic copolymer

BACKGROUND

Gene-directed enzyme prodrug therapy (GDEPT) represents a technology to improve drug selectivity for cancer cells. It consists of delivery into tumor cells of a suicide gene responsible for in situ conversion of a prodrug into cytotoxic metabolites. Major limitations of GDEPT that hinder its clinical application include inefficient delivery into cancer cells and poor prodrug activation by suicide enzymes. We tried to overcome these constraints through a combination of suicide gene therapy with immunomodulating therapy. Viral vectors dominate in present-day GDEPT clinical trials due to efficient transfection and production of therapeutic genes. However, safety concerns associated with severe immune and inflammatory responses as well as high cost of the production of therapeutic viruses can limit therapeutic use of virus-based therapeutics. We tried to overcome this problem by using a simple nonviral delivery system.

METHODS

We studied the antitumor efficacy of a PEI (polyethylenimine)-PEG (polyethylene glycol) copolymer carrying the HSVtk gene combined in one vector with granulocyte-macrophage colony-stimulating factor (GM-CSF) cDNA. The system HSVtk-GM-CSF/PEI-PEG was tested in vitro in various mouse and human cell lines, ex vivo and in vivo using mouse models.

RESULTS

We showed that the HSVtk-GM-CSF/PEI-PEG system effectively inhibited the growth of transplanted human and mouse tumors, suppressed metastasis and increased animal lifespan.

CONCLUSIONS

We demonstrated that appreciable tumor shrinkage and metastasis inhibition could be achieved with a simple and low toxic chemical carrier - a PEI-PEG copolymer. Our data indicate that combined suicide and cytokine gene therapy may provide a powerful approach for the treatment of solid tumors and their metastases.

Lost in translation: the need for better tools

Although for most pharmaceutical compounds the final aim is improving human health, almost all the methods used to identify and pursue therapeutic targets and to obtain new potential drugs have traditionally focused on animal models