The quality of research with real-world evidence

Personalized venlafaxine dose prediction using artificial intelligence technology: a retrospective analysis based on real-world data

BACKGROUND

Venlafaxine dose regimens vary considerably between individuals, requiring personalized dosing.

AIM

This study aimed to identify dose-related influencing factors of venlafaxine through real-world data analysis and to construct a personalized dose model using advanced artificial intelligence techniques.

METHOD

We conducted a retrospective study on patients with depression treated with venlafaxine. Significant variables were selected through a univariate analysis. Subsequently, the predictive performance of seven models (XGBoost, LightGBM, CatBoost, GBDT, ANN, TabNet, and DT) was compared. The algorithm that demonstrated optimal performance was chosen to establish the dose prediction model. Model validation used confusion matrices and ROC analysis. Additionally, a dose subgroup analysis was conducted.

RESULTS

A total of 298 patients were included. TabNet was selected to establish the venlafaxine dose prediction model, which exhibited the highest performance with an accuracy of 0.80. The analysis identified seven crucial variables correlated with venlafaxine daily dose, including blood venlafaxine concentration, total protein, lymphocytes, age, globulin, cholinesterase, and blood platelet count. The area under the curve (AUC) for predicting venlafaxine doses of 75 mg, 150 mg, and 225 mg were 0.90, 0.85, and 0.90, respectively.

CONCLUSION

We successfully developed a TabNet model to predict venlafaxine doses using real-world data. This model demonstrated substantial predictive accuracy, offering a personalized dosing regimen for venlafaxine. These findings provide valuable guidance for the clinical use of the drug.

Developing a machine learning model for predicting venlafaxine active moiety concentration: a retrospective study using real-world evidence

BACKGROUND

Venlafaxine is frequently prescribed for patients with depression. To control the concentration of venlafaxine within the therapeutic window for the best treatment effect, a model to predict venlafaxine concentration is necessary.

AIM

Our objective was to develop a prediction model for venlafaxine concentration using real-world evidence based on machine learning and deep learning techniques.

METHOD

Patients who underwent venlafaxine treatment between November 2019 and August 2022 were included in the study. Important variables affecting venlafaxine concentration were identified using a combination of univariate analysis, sequential forward selection, and machine learning techniques. Predictive performance of nine machine learning and deep learning algorithms were assessed, and the one with the optimal performance was selected for modeling. The final model was interpreted using SHapley Additive exPlanations.

RESULTS

A total of 330 eligible patients were included. Five influential variables that affect venlafaxine concentration were venlafaxine daily dose, sex, age, hyperlipidemia, and adenosine deaminase. The venlafaxine concentration prediction model was developed using the eXtreme Gradient Boosting algorithm (R2 = 0.65, mean absolute error = 77.92, root mean square error = 93.58). In the testing cohort, the accuracy of the predicted concentration within ± 30% of the actual concentration was 73.49%. In the subgroup analysis, the prediction accuracy was 69.39% within the recommended therapeutic range of venlafaxine concentration within ± 30% of the actual value.

CONCLUSION

The XGBoost model for predicting blood concentration of venlafaxine using real-world evidence was developed, guiding the adjustment of regimen in clinical practice.

Predicting Lapatinib Dose Regimen Using Machine Learning and Deep Learning Techniques Based on a Real-World Study

Lapatinib is used for the treatment of metastatic HER2(+) breast cancer. We aim to establish a prediction model for lapatinib dose using machine learning and deep learning techniques based on a real-world study. There were 149 breast cancer patients enrolled from July 2016 to June 2017 at Fudan University Shanghai Cancer Center. The sequential forward selection algorithm based on random forest was applied for variable selection. Twelve machine learning and deep learning algorithms were compared in terms of their predictive abilities (logistic regression, SVM, random forest, Adaboost, XGBoost, GBDT, LightGBM, CatBoost, TabNet, ANN, Super TML, and Wide&Deep). As a result, TabNet was chosen to construct the prediction model with the best performance (accuracy = 0.82 and AUC = 0.83). Afterward, four variables that strongly correlated with lapatinib dose were ranked via importance score as follows: treatment protocols, weight, number of chemotherapy treatments, and number of metastases. Finally, the confusion matrix was used to validate the model for a dose regimen of 1,250 mg lapatinib (precision = 81% and recall = 95%), and for a dose regimen of 1,000 mg lapatinib (precision = 87% and recall = 64%). To conclude, we established a deep learning model to predict lapatinib dose based on important influencing variables selected from real-world evidence, to achieve an optimal individualized dose regimen with good predictive performance.