Round Trip: An Automated Pipeline for Experimental Design, Execution, and Analysis

Advancing reproducibility can ease the 'hard truths' of synthetic biology

Reproducibility has been identified as an outstanding challenge in science, and the field of synthetic biology is no exception. Meeting this challenge is critical to allow the transformative technological capabilities emerging from this field to reach their full potential to benefit the society. We discuss the current state of reproducibility in synthetic biology and how improvements can address some of the central shortcomings in the field. We argue that the successful adoption of reproducibility as a routine aspect of research and development requires commitment spanning researchers and relevant institutions via education, incentivization and investment in related infrastructure. The urgency of this topic pervades synthetic biology as it strives to advance fundamental insights and unlock new capabilities for safe, secure and scalable applications of biotechnology. Graphical Abstract.

Characterization of Integrase and Excisionase Activity in a Cell-Free Protein Expression System Using a Modeling and Analysis Pipeline

We present a full-stack modeling, analysis, and parameter identification pipeline to guide the modeling and design of biological systems starting from specifications to circuit implementations and parametrizations. We demonstrate this pipeline by characterizing the integrase and excisionase activity in a cell-free protein expression system. We build on existing Python tools─BioCRNpyler, AutoReduce, and Bioscrape─to create this pipeline. For enzyme-mediated DNA recombination in a cell-free system, we create detailed chemical reaction network models from simple high-level descriptions of the biological circuits and their context using BioCRNpyler. We use Bioscrape to show that the output of the detailed model is sensitive to many parameters. However, parameter identification is infeasible for this high-dimensional model; hence, we use AutoReduce to automatically obtain reduced models that have fewer parameters. This results in a hierarchy of reduced models under different assumptions to finally arrive at a minimal ODE model for each circuit. Then, we run sensitivity analysis-guided Bayesian inference using Bioscrape for each circuit to identify the model parameters. This process allows us to quantify integrase and excisionase activity in cell extracts enabling complex-circuit designs that depend on accurate control over protein expression levels through DNA recombination. The automated pipeline presented in this paper opens up a new approach to complex circuit design, modeling, reduction, and parametrization.

A toolkit for enhanced reproducibility of RNASeq analysis for synthetic biologists

Sequencing technologies, in particular RNASeq, have become critical tools in the design, build, test and learn cycle of synthetic biology. They provide a better understanding of synthetic designs, and they help identify ways to improve and select designs. While these data are beneficial to design, their collection and analysis is a complex, multistep process that has implications on both discovery and reproducibility of experiments. Additionally, tool parameters, experimental metadata, normalization of data and standardization of file formats present challenges that are computationally intensive. This calls for high-throughput pipelines expressly designed to handle the combinatorial and longitudinal nature of synthetic biology. In this paper, we present a pipeline to maximize the analytical reproducibility of RNASeq for synthetic biologists. We also explore the impact of reproducibility on the validation of machine learning models. We present the design of a pipeline that combines traditional RNASeq data processing tools with structured metadata tracking to allow for the exploration of the combinatorial design in a high-throughput and reproducible manner. We then demonstrate utility via two different experiments: a control comparison experiment and a machine learning model experiment. The first experiment compares datasets collected from identical biological controls across multiple days for two different organisms. It shows that a reproducible experimental protocol for one organism does not guarantee reproducibility in another. The second experiment quantifies the differences in experimental runs from multiple perspectives. It shows that the lack of reproducibility from these different perspectives can place an upper bound on the validation of machine learning models trained on RNASeq data.

Graphical Abstract