A transfer learning approach for predictive modeling of bioprocesses using small data

Magnetic resonance imaging-based radiomics and deep learning models for predicting lymph node metastasis of squamous cell carcinoma of the tongue

OBJECTIVE

This study aimed to establish a combined method of radiomics and deep learning (DL) in magnetic resonance imaging (MRI) to predict lymph node metastasis (LNM) preoperatively in patients with squamous cell carcinoma of the tongue.

STUDY DESIGN

In total, MR images of 196 patients with lingual squamous cell carcinoma were divided into training (n = 156) and test (n = 40) cohorts. Radiomics and DL features were extracted from MR images and selected to construct machine learning models. A DL radiomics nomogram was established via multivariate logistic regression by incorporating the radiomics signature, the DL signature, and MRI-reported LN status.

RESULTS

Nine radiomics and 3 DL features were selected. In the radiomics test cohort, the multilayer perceptron model performed best with an area under the receiver operating characteristic curve (AUC) of 0.747, but in the DL cohort, the best model (logistic regression) performed less well (AUC = 0.655). The DL radiomics nomogram showed good calibration and performance with an AUC of 0.934 (outstanding discrimination ability) in the training cohort and 0.757 (acceptable discrimination ability) in the test cohort. The decision curve analysis demonstrated that the nomogram could offer more net benefit than a single radiomics or DL signature.

CONCLUSION

The DL radiomics nomogram exhibited promising performance in predicting LNM, which facilitates personalized treatment of tongue cancer.

Predictive ability of multi-population genomic prediction methods of phenotypes for reproduction traits in Chinese and Austrian pigs

BACKGROUND

Multi-population genomic prediction can rapidly expand the size of the reference population and improve genomic prediction ability. Machine learning (ML) algorithms have shown advantages in single-population genomic prediction of phenotypes. However, few studies have explored the effectiveness of ML methods for multi-population genomic prediction.

RESULTS

In this study, 3720 Yorkshire pigs from Austria and four breeding farms in China were used, and single-trait genomic best linear unbiased prediction (ST-GBLUP), multitrait GBLUP (MT-GBLUP), Bayesian Horseshoe (BayesHE), and three ML methods (support vector regression (SVR), kernel ridge regression (KRR) and AdaBoost.R2) were compared to explore the optimal method for joint genomic prediction of phenotypes of Chinese and Austrian pigs through 10 replicates of fivefold cross-validation. In this study, we tested the performance of different methods in two scenarios: (i) including only one Austrian population and one Chinese pig population that were genetically linked based on principal component analysis (PCA) (designated as the "two-population scenario") and (ii) adding reference populations that are unrelated based on PCA to the above two populations (designated as the "multi-population scenario"). Our results show that, the use of MT-GBLUP in the two-population scenario resulted in an improvement of 7.1% in predictive ability compared to ST-GBLUP, while the use of SVR and KKR yielded improvements in predictive ability of 4.5 and 5.3%, respectively, compared to MT-GBLUP. SVR and KRR also yielded lower mean square errors (MSE) in most population and trait combinations. In the multi-population scenario, improvements in predictive ability of 29.7, 24.4 and 11.1% were obtained compared to ST-GBLUP when using, respectively, SVR, KRR, and AdaBoost.R2. However, compared to MT-GBLUP, the potential of ML methods to improve predictive ability was not demonstrated.

CONCLUSIONS

Our study demonstrates that ML algorithms can achieve better prediction performance than multitrait GBLUP models in multi-population genomic prediction of phenotypes when the populations have similar genetic backgrounds; however, when reference populations that are unrelated based on PCA are added, the ML methods did not show a benefit. When the number of populations increased, only MT-GBLUP improved predictive ability in both validation populations, while the other methods showed improvement in only one population.

Research on sound quality of roller chain transmission system based on multi-source transfer learning

To establish the sound quality evaluation model of roller chain transmission system, we collect the running noise under different working conditions. After the noise samples are preprocessed, a group of experienced testers are organized to evaluate them subjectively. Mel frequency cepstral coefficient (MFCC) of each noise sample is calculated, and the MFCC feature map is used as an objective evaluation. Combining with the subjective and objective evaluation results of the roller chain system noise, we can get the original dataset of its sound quality research. However, the number of high-quality noise samples is relatively small. Based on the sound quality research of various chain transmission systems, a novel method called multi-source transfer learning convolutional neural network (MSTL-CNN) is proposed. By transferring knowledge from multiple source tasks to target task, the difficulty of small sample sound quality prediction is solved. Compared with the problem that single source task transfer learning has too much error on some samples, MSTL-CNN can give full play to the advantages of all transfer learning models. The results also show that the MSTL-CNN proposed in this paper is significantly better than the traditional sound quality evaluation methods.

A review on machine learning approaches for microalgae cultivation systems

Microalgae plays a crucial role in biomass production within aquatic environments and are increasingly recognized for their potential in generating biofuels, biomaterials, bioactive compounds, and bio-based chemicals. This growing significance is driven by the need to address imminent global challenges such as food and fuel shortages. Enhancing the value chain of bio-based products necessitates the implementation of an advanced screening and monitoring system. This system is crucial for tailoring and optimizing the cultivation conditions, ensuring the lucrative and efficient production of the final desired product. This, in turn, underscores the necessity for robust predictive models to accurately emulate algae growth in different conditions during the initial cultivation phase and simulate their subsequent processing in the downstream stage. In pursuit of these objectives, diverse mechanistic and machine learning-based methods have been independently employed to model and optimize microalgae processes. This review article thoroughly examines the techniques delineated in the literature for modeling, predicting, and monitoring microalgal biomass across various applications such as bioenergy, pharmaceuticals, and the food industry. While highlighting the merits and limitations of each method, we delve into the realm of newly emerging hybrid approaches and conduct an exhaustive survey of this evolving methodology. The challenges currently impeding the practical implementation of hybrid techniques are explored, and drawing inspiration from successful applications in other machine-learning-assisted fields, we review various plausible solutions to overcome these obstacles.

MRI radiomics model for predicting TERT promoter mutation status in glioblastoma

BACKGROUND AND PURPOSE

The presence of TERT promoter mutations has been associated with worse prognosis and resistance to therapy for patients with glioblastoma (GBM). This study aimed to determine whether the combination model of different feature selections and classification algorithms based on multiparameter MRI can be used to predict TERT subtype in GBM patients.

METHODS

A total of 143 patients were included in our retrospective study, and 2553 features were obtained. The datasets were randomly divided into training and test sets in a ratio of 7:3. The synthetic minority oversampling technique was used to achieve data balance. The Pearson correlation coefficients were used for dimension reduction. Three feature selections and five classification algorithms were used to model the selected features. Finally, 10-fold cross validation was applied to the training dataset.

RESULTS

A model with eight features generated by recursive feature elimination (RFE) and linear discriminant analysis (LDA) showed the greatest diagnostic performance (area under the curve values for the training, validation, and testing sets: 0.983, 0.964, and 0.926, respectively), followed by relief and random forest (RF), analysis of variance and RF. Furthermore, the relief was the optimal feature selection for separately evaluating those five classification algorithms, and RF was the most preferable algorithm for separately assessing the three feature selectors. ADC entropy was the parameter that made the greatest contribution to the discrimination of TERT mutations.

CONCLUSIONS

Radiomics model generated by RFE and LDA mainly based on ADC entropy showed good performance in predicting TERT promoter mutations in GBM.

Deep Learning Radiomics for the Assessment of Telomerase Reverse Transcriptase Promoter Mutation Status in Patients With Glioblastoma Using Multiparametric MRI

BACKGROUND

Studies have shown that magnetic resonance imaging (MRI)-based deep learning radiomics (DLR) has the potential to assess glioma grade; however, its role in predicting telomerase reverse transcriptase (TERT) promoter mutation status in patients with glioblastoma (GBM) remains unclear.

PURPOSE

To evaluate the value of deep learning (DL) in multiparametric MRI-based radiomics in identifying TERT promoter mutations in patients with GBM preoperatively.

STUDY TYPE

Retrospective.

POPULATION

A total of 274 patients with isocitrate dehydrogenase-wildtype GBM were included in the study. The training and external validation cohorts included 156 (54.3 ± 12.7 years; 96 males) and 118 (54 .2 ± 13.4 years; 73 males) patients, respectively.

FIELD STRENGTH/SEQUENCE

Axial contrast-enhanced T1-weighted spin-echo inversion recovery sequence (T1CE), T1-weighted spin-echo inversion recovery sequence (T1WI), and T2-weighted spin-echo inversion recovery sequence (T2WI) on 1.5-T and 3.0-T scanners were used in this study.

ASSESSMENT

Overall tumor area regions (the tumor core and edema) were segmented, and the radiomics and DL features were extracted from preprocessed multiparameter preoperative brain MRI images-T1WI, T1CE, and T2WI. A model based on the DLR signature, clinical signature, and clinical DLR (CDLR) nomogram was developed and validated to identify TERT promoter mutation status.

STATISTICAL TESTS

The Mann-Whitney U test, Pearson test, least absolute shrinkage and selection operator, and logistic regression analysis were applied for feature selection and construction of radiomics and DL signatures. Results were considered statistically significant at P-value <0.05.

RESULTS

The DLR signature showed the best discriminative power for predicting TERT promoter mutations, yielding an AUC of 0.990 and 0.890 in the training and external validation cohorts, respectively. Furthermore, the DLR signature outperformed CDLR nomogram (P = 0.670) and significantly outperformed clinical models in the validation cohort.

DATA CONCLUSION

The multiparameter MRI-based DLR signature exhibited a promising performance for the assessment of TERT promoter mutations in patients with GBM, which could provide information for individualized treatment.

LEVEL OF EVIDENCE

3 TECHNICAL EFFICACY: Stage 2.

An Approach for the Estimation of Concentrations of Soluble Compounds in E. coli Bioprocesses

Accurate estimations of the concentrations of soluble compounds are crucial for optimizing bioprocesses involving Escherichia coli (E. coli). This study proposes a hybrid model structure that leverages off-gas analysis data and physiological parameters, including the average biomass age and specific growth rate, to estimate soluble compounds such as acetate and glutamate in fed-batch cultivations We used a hybrid recurrent neural network to establish the relationships between these parameters. To enhance the precision of the estimates, the model incorporates ensemble averaging and information gain. Ensemble averaging combines varying model inputs, leading to more robust representations of the underlying dynamics in E. coli bioprocesses. Our hybrid model estimates acetates with 1% and 8% system precision using data from the first site and the second site at GSK plc, respectively. Using the data from the second site, the precision of the approach for other solutes was as fallows: isoleucine -8%, lactate and glutamate -9%, and a 13% error for glutamine., These results, demonstrate its practical potential.

Developing high-dimensional machine learning models to improve generalization ability and overcome data insufficiency for mixed sugar fermentation simulation

Biorefinery can be promoted by building accurate machine learning models. This work proposed a strategy to enhance model's generalization ability and overcome insufficient data conditions for mixed sugar fermentation simulation. Multiple inputs single output models, using initial glucose, initial xylose, and time together as inputs, have higher generalization ability than single input single output models with time as sole input in predicting glucose, xylose, ethanol, or biomass separately. Multiple inputs multiple outputs models, integrating outputs, enhanced model accuracy and resulted in an average R² at 0.99. To overcome data insufficiency conditions, consensus yeast (CY) model, through consolidating data from 4 yeasts, obtained R² at 0.90. By adjusting the pretrained CY model, the model can save more than 50% data and get R² at 0.95 and 0.93 for yeast and bacterial fermentation simulation. The strategy can expand the application range and save costs of data curation for ANN models.

Machine learning in bioprocess development: from promise to practice

Fostered by novel analytical techniques, digitalization, and automation, modern bioprocess development provides large amounts of heterogeneous experimental data, containing valuable process information. In this context, data-driven methods like machine learning (ML) approaches have great potential to rationally explore large design spaces while exploiting experimental facilities most efficiently. Herein we demonstrate how ML methods have been applied so far in bioprocess development, especially in strain engineering and selection, bioprocess optimization, scale-up, monitoring, and control of bioprocesses. For each topic, we will highlight successful application cases, current challenges, and point out domains that can potentially benefit from technology transfer and further progress in the field of ML.

Mechanism of Qihuang needle therapy in the management of tic disorders: a clinical trial protocol

Background

Qihuang needle therapy is a newly developed acupuncture therapy to treat tic disorders in clinical practice. However, the mechanism to reduce tic severity remains unknown. Changes in intestinal flora and circulation metabolites are perhaps the potential pathogenesis of tic disorders. As a result, we present a protocol for a controlled clinical trial using multi-omics analysis to probe the mechanism of the Qihuang needle in managing tic disorders.

Methods

This is a matched-pairs design, controlled, clinical trial for patients with tic disorders. Participants will be allocated to either an experimental group or a healthy control group. The main acupoints are Baihui (GV20), Yintang (EX-HN3), and Jueyinshu (BL14). The experimental group will receive Qihuang needle therapy for a month, while the control group will receive no interventions.

Expected outcomes

The change in the severity of the tic disorder is set as the main outcome. Secondary outcomes include gastrointestinal severity index and recurrence rate, which will be calculated after a 12-week follow-up. Gut microbiota, measured by 16S rRNA gene sequencing; serum metabolomics, assessed via LC/MS; and serum zonulin, assessed by enzyme-linked immunosorbent assay (ELISA), will be used as biological specimen analysis outcomes. The present study will investigate the possible interactions between intestinal flora and serum metabolites and the improvement of clinical profiles, which may elucidate the mechanism of Qihuang needle therapy for tic disorders.

Trial registration

This trial is registered at the Chinese Clinical Trial Registry (http://www.chictr.org.cn/). Registration number: ChiCTR2200057723, Date: 2022-04-14.

Machine learning approaches for biomolecular, biophysical, and biomaterials research

A fluent conversation with a virtual assistant, person-tailored news feeds, and deep-fake images created within seconds-all those things that have been unthinkable for a long time are now a part of our everyday lives. What these examples have in common is that they are realized by different means of machine learning (ML), a technology that has fundamentally changed many aspects of the modern world. The possibility to process enormous amount of data in multi-hierarchical, digital constructs has paved the way not only for creating intelligent systems but also for obtaining surprising new insight into many scientific problems. However, in the different areas of biosciences, which typically rely heavily on the collection of time-consuming experimental data, applying ML methods is a bit more challenging: Here, difficulties can arise from small datasets and the inherent, broad variability, and complexity associated with studying biological objects and phenomena. In this Review, we give an overview of commonly used ML algorithms (which are often referred to as "machines") and learning strategies as well as their applications in different bio-disciplines such as molecular biology, drug development, biophysics, and biomaterials science. We highlight how selected research questions from those fields were successfully translated into machine readable formats, discuss typical problems that can arise in this context, and provide an overview of how to resolve those encountered difficulties.