1
|
Yuan X, Wan S, Wang W, Chen Y, Lin Y. A Mobile Application for Anticoagulation Management in Patients After Heart Valve Replacement: A Usability Study. Patient Prefer Adherence 2024; 18:2055-2066. [PMID: 39371198 PMCID: PMC11451460 DOI: 10.2147/ppa.s471577] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2024] [Accepted: 09/18/2024] [Indexed: 10/08/2024] Open
Abstract
Purpose Individualized anticoagulation therapy is a major challenge for patients after heart valve replacement. Mobile applications assisted by Artificial intelligence (AI) have great potential to meet the individual needs of patients. The study aimed to develop an AI technology-assisted mobile application (app) for anticoagulation management, understand patients' acceptance of such applications, and determine its feasibility. Methods After using the mobile application for anticoagulation management for 2 weeks, patients, doctors, and nurses rated its usability using the System Usability Scale (SUS). Additionally, semi-structured interviews were conducted with some patients, doctors, and nurses to gain insights about their thoughts and suggestions regarding the procedure. Results The study comprised 80 participants, including 38 patients, 18 doctors, and 24 nurses. The average SUS score for patients was 82.37±5.45; for doctors, it was 84.17±5.82; and for nurses, it was 81.88±6.44. This means the patients, physicians, and nurses rated the app highly usable. Semi-structured interviews were conducted on the app's usability with 18 participants (six nurses, three physicians, and nine patients). The interview results revealed that patients found the application of anticoagulation management simple and convenient, with high expectations for a precise dosage recommendation of anticoagulant drugs. Some patients expressed concerns regarding personal information security. Both doctors and nurses believed that elderly patients needed assistance from young family members to use the app and that it could improve patients' anticoagulant self-management ability. Some nurses also mentioned that the use of the app brought great convenience for transitional care. Conclusion This study confirmed the feasibility of using an AI technology-assisted mobile application for anticoagulation management in patients after heart valve replacement. To further develop this application, challenges lie in continuously improving the accuracy of recommended drug doses, obtaining family support, and ensuring information security.
Collapse
Affiliation(s)
- Xia Yuan
- Department of Nursing, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Department of Cardiac Surgery, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
| | - Shenmin Wan
- Department of Nursing, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Department of Cardiac Surgery, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
| | - Wenshuo Wang
- Department of Cardiac Surgery, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Shanghai Heart Valve Engineering Technology Research Center, Shanghai, People’s Republic of China
| | - Yihong Chen
- Department of Nursing, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
- Department of Cardiac Surgery, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
| | - Ying Lin
- Department of Nursing, Zhongshan Hospital, Fudan University, Shanghai, People’s Republic of China
| |
Collapse
|
2
|
Xue L, He S, Singla RK, Qin Q, Ding Y, Liu L, Ding X, Bediaga-Bañeres H, Arrasate S, Durado-Sanchez A, Zhang Y, Shen Z, Shen B, Miao L, González-Díaz H. Machine learning guided prediction of warfarin blood levels for personalized medicine based on clinical longitudinal data from cardiac surgery patients: a prospective observational study. Int J Surg 2024; 110:01279778-990000000-01621. [PMID: 38833337 PMCID: PMC11487003 DOI: 10.1097/js9.0000000000001734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/19/2024] [Accepted: 05/19/2024] [Indexed: 06/06/2024]
Abstract
BACKGROUND Warfarin is a common oral anticoagulant, and its effects vary widely among individuals. Numerous dose-prediction algorithms have been reported based on cross-sectional data generated via multiple linear regression or machine learning. This study aimed to construct an information fusion perturbation theory and machine learning prediction model of warfarin blood levels based on clinical longitudinal data from cardiac surgery patients. METHODS AND MATERIAL The data of 246 patients were obtained from electronic medical records. Continuous variables were processed by calculating the distance of the raw data with the moving average (MA ∆vki(sj)), and categorical variables in different attribute groups were processed using Euclidean distance (ED ǁ∆vk(sj)ǁ). Regression and classification analyses were performed on the raw data, MA ∆vki(sj), and ED ǁ∆vk(sj)ǁ. Different machine-learning algorithms were chosen for the STATISTICA and WEKA software. RESULTS The random forest (RF) algorithm was the best for predicting continuous outputs using the raw data. The correlation coefficients of the RF algorithm were 0.978 and 0.595 for the training and validation sets, respectively, and the mean absolute errors were 0.135 and 0.362 for the training and validation sets, respectively. The proportion of ideal predictions of the RF algorithm was 59.0%. General discriminant analysis (GDA) was the best algorithm for predicting the categorical outputs using the MA ∆vki(sj) data. The GDA algorithm's total true positive rate (TPR) was 95.4% and 95.6% for the training and validation sets, respectively, with MA ∆vki(sj) data. CONCLUSIONS An information fusion perturbation theory and machine learning model for predicting warfarin blood levels was established. A model based on the RF algorithm could be used to predict the target international normalized ratio (INR), and a model based on the GDA algorithm could be used to predict the probability of being within the target INR range under different clinical scenarios.
Collapse
Affiliation(s)
- Ling Xue
- Department of Pharmacy, the First Affiliated Hospital of Soochow University
- Department of Pharmacology, Faculty of Medicine, University of The Basque Country (UPV/EHU), Bilbao, Basque Country
| | - Shan He
- Department of Organic and Inorganic Chemistry, Faculty of Science and Technology, University of The Basque Country (UPV/EHU), Bilbao, Basque Country, Spain
- IKERDATA S.L., ZITEK, University of The Basque Country (UPV/EHU), Bilbao, Basque Country
| | - Rajeev K. Singla
- Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu, China
- School of Pharmaceutical Sciences, Lovely Professional University, Phagwara, Punjab, India
| | - Qiong Qin
- Department of Pharmacy, the First Affiliated Hospital of Soochow University
| | - Yinglong Ding
- Department of Cardiovascular Surgery, the First Affiliated Hospital of Soochow University
- Institute for Cardiovascular Science, Soochow University
| | - Linsheng Liu
- Department of Pharmacy, the First Affiliated Hospital of Soochow University
| | - Xiaoliang Ding
- Department of Pharmacy, the First Affiliated Hospital of Soochow University
| | - Harbil Bediaga-Bañeres
- IKERDATA S.L., ZITEK, University of The Basque Country (UPV/EHU), Bilbao, Basque Country
- Department of Painting, Faculty of Fine Arts, University of the Basque Country UPV/EHU, 48940, Leioa, Biscay
| | - Sonia Arrasate
- Department of Organic and Inorganic Chemistry, Faculty of Science and Technology, University of The Basque Country (UPV/EHU), Bilbao, Basque Country, Spain
| | - Aliuska Durado-Sanchez
- IKERDATA S.L., ZITEK, University of The Basque Country (UPV/EHU), Bilbao, Basque Country
- Department of Public Law, Faculty of Law, University of The Basque Country (UPV/EHU), Leioa, Biscay, Basque, Country
| | - Yuzhen Zhang
- Department of Cardiology, the First Affiliated Hospital of Soochow University
| | - Zhenya Shen
- Department of Cardiovascular Surgery, the First Affiliated Hospital of Soochow University
- Institute for Cardiovascular Science, Soochow University
| | - Bairong Shen
- Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu, China
| | - Liyan Miao
- Department of Pharmacy, the First Affiliated Hospital of Soochow University
- Institute for Interdisciplinary Drug Research and Translational Sciences, Soochow University
| | - Humberto González-Díaz
- Department of Organic and Inorganic Chemistry, Faculty of Science and Technology, University of The Basque Country (UPV/EHU), Bilbao, Basque Country, Spain
- BIOFISIKA: Basque Center for Biophysics CSIC, University of The Basque Country (UPV/EHU), Bilbao, Basque Country
- IKERBASQUE, Basque Foundation for Science, Bilbao, Basque Country, Spain
| |
Collapse
|
3
|
Xue L, Singla RK, He S, Arrasate S, González-Díaz H, Miao L, Shen B. Warfarin-A natural anticoagulant: A review of research trends for precision medication. PHYTOMEDICINE : INTERNATIONAL JOURNAL OF PHYTOTHERAPY AND PHYTOPHARMACOLOGY 2024; 128:155479. [PMID: 38493714 DOI: 10.1016/j.phymed.2024.155479] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Revised: 01/29/2024] [Accepted: 02/22/2024] [Indexed: 03/19/2024]
Abstract
BACKGROUND Warfarin is a widely prescribed anticoagulant in the clinic. It has a more considerable individual variability, and many factors affect its variability. Mathematical models can quantify the quantitative impact of these factors on individual variability. PURPOSE The aim is to comprehensively analyze the advanced warfarin dosing algorithm based on pharmacometrics and machine learning models of personalized warfarin dosage. METHODS A bibliometric analysis of the literature retrieved from PubMed and Scopus was performed using VOSviewer. The relevant literature that reported the precise dosage of warfarin calculation was retrieved from the database. The multiple linear regression (MLR) algorithm was excluded because a recent systematic review that mainly reviewed this algorithm has been reported. The following terms of quantitative systems pharmacology, mechanistic model, physiologically based pharmacokinetic model, artificial intelligence, machine learning, pharmacokinetic, pharmacodynamic, pharmacokinetics, pharmacodynamics, and warfarin were added as MeSH Terms or appearing in Title/Abstract into query box of PubMed, then humans and English as filter were added to retrieve the literature. RESULTS Bibliometric analysis revealed important co-occuring MeShH and index keywords. Further, the United States, China, and the United Kingdom were among the top countries contributing in this domain. Some studies have established personalized warfarin dosage models using pharmacometrics and machine learning-based algorithms. There were 54 related studies, including 14 pharmacometric models, 31 artificial intelligence models, and 9 model evaluations. Each model has its advantages and disadvantages. The pharmacometric model contains biological or pharmacological mechanisms in structure. The process of pharmacometric model development is very time- and labor-intensive. Machine learning is a purely data-driven approach; its parameters are more mathematical and have less biological interpretation. However, it is faster, more efficient, and less time-consuming. Most published models of machine learning algorithms were established based on cross-sectional data sourced from the database. CONCLUSION Future research on personalized warfarin medication should focus on combining the advantages of machine learning and pharmacometrics algorithms to establish a more robust warfarin dosage algorithm. Randomized controlled trials should be performed to evaluate the established algorithm of warfarin dosage. Moreover, a more user-friendly and accessible warfarin precision medicine platform should be developed.
Collapse
Affiliation(s)
- Ling Xue
- Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu, China; Department of Pharmacy, The First Affiliated Hospital of Soochow University, Suzhou, China; Department of Pharmacology, Faculty of Medicine, University of The Basque Country (UPV/EHU), Bilbao, Basque Country, Spain
| | - Rajeev K Singla
- Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu, China; School of Pharmaceutical Sciences, Lovely Professional University, Phagwara, Punjab-144411, India
| | - Shan He
- IKERDATA S.l., ZITEK, University of The Basque Country (UPVEHU), Rectorate Building, 48940, Bilbao, Basque Country, Spain; Department of Organic and Inorganic Chemistry, Faculty of Science and Technology, University of The Basque Country (UPV/EHU), P.O. Box 644, 48080, Bilbao, Basque Country, Spain
| | - Sonia Arrasate
- Department of Organic and Inorganic Chemistry, Faculty of Science and Technology, University of The Basque Country (UPV/EHU), P.O. Box 644, 48080, Bilbao, Basque Country, Spain
| | - Humberto González-Díaz
- Department of Organic and Inorganic Chemistry, Faculty of Science and Technology, University of The Basque Country (UPV/EHU), P.O. Box 644, 48080, Bilbao, Basque Country, Spain; BIOFISIKA: Basque Center for Biophysics CSIC, University of The Basque Country (UPV/EHU), Barrio Sarriena s/n, Leioa, Bizkaia 48940, Basque Country, Spain; IKERBASQUE, Basque Foundation for Science, 48011, Bilbao, Basque Country, Spain
| | - Liyan Miao
- Department of Pharmacy, The First Affiliated Hospital of Soochow University, Suzhou, China; Institute for Interdisciplinary Drug Research and Translational Sciences, Soochow University, Suzhou, China; College of Pharmaceutical Sciences, Soochow University, Suzhou, China.
| | - Bairong Shen
- Joint Laboratory of Artificial Intelligence for Critical Care Medicine, Department of Critical Care Medicine and Institutes for Systems Genetics, Frontiers Science Center for Disease-related Molecular Network, West China Hospital, Sichuan University, Chengdu, China.
| |
Collapse
|
4
|
Li QY, Tang BH, Wu YE, Yao BF, Zhang W, Zheng Y, Zhou Y, van den Anker J, Hao GX, Zhao W. Machine Learning: A New Approach for Dose Individualization. Clin Pharmacol Ther 2024; 115:727-744. [PMID: 37713106 DOI: 10.1002/cpt.3049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2023] [Accepted: 09/03/2023] [Indexed: 09/16/2023]
Abstract
The application of machine learning (ML) has shown promising results in precision medicine due to its exceptional performance in dealing with complex multidimensional data. However, using ML for individualized dosing of medicines is still in its early stage, meriting further exploration. A systematic review of study designs and modeling details of using ML for individualized dosing of different drugs was performed. We have summarized the status of the study populations, predictive targets, and data sources for ML modeling, the selection of ML algorithms and features, and the evaluation and validation of their predictive performance. We also used the Prediction model Risk of Bias Assessment Tool (PROBAST) to assess the risk of bias of included studies. Currently, ML can be used for both a priori and a posteriori dose selection and optimization, and it can also assist the implementation of therapeutic drug monitoring. However, studies are mainly focused on drugs with narrow therapeutic windows, predominantly immunosuppressants (N = 23, 35.9%) and anti-infectives (N = 21, 32.8%), and there is currently only very limited attention for special populations, such as children (N = 22, 34.4%). Most studies showed poor methodological quality and a high risk of bias. The lack of external validation and clinical utility evaluation currently limits the further clinical implementation of ML for dose individualization. We therefore have proposed several ways to improve the clinical relevance of the studies and facilitate the translation of ML models into clinical practice.
Collapse
Affiliation(s)
- Qiu-Yue Li
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Bo-Hao Tang
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Yue-E Wu
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Bu-Fan Yao
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Wei Zhang
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Yi Zheng
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Yue Zhou
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - John van den Anker
- Division of Clinical Pharmacology, Children's National Hospital, Washington, DC, USA
- Departments of Pediatrics, Pharmacology & Physiology, Genomics & Precision Medicine, The George Washington University School of Medicine and Health Sciences, Washington, DC, USA
- Department of Pediatric Pharmacology and Pharmacometrics, University of Basel Children's Hospital, Basel, Switzerland
| | - Guo-Xiang Hao
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
| | - Wei Zhao
- Department of Clinical Pharmacy, Institute of Clinical Pharmacology, Key Laboratory of Chemical Biology (Ministry of Education),NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, School of Pharmaceutical Sciences, Cheeloo College of Medicine, Shandong University, Jinan, China
- NMPA Key Laboratory for Clinical Research and Evaluation of Innovative Drug, Qilu Hospital of Shandong University, Shandong University, Jinan, China
| |
Collapse
|
5
|
Huang Y, Huang L, Han Z. Combining portable coagulometers with the Internet: A new model of warfarin anticoagulation in patients following mechanical heart valve replacement. Front Surg 2022; 9:1016278. [PMID: 36311931 PMCID: PMC9608170 DOI: 10.3389/fsurg.2022.1016278] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Accepted: 09/26/2022] [Indexed: 11/06/2022] Open
Abstract
Heart valve replacement, as a safe and effective treatment for severe valvular heart disease, can significantly improve hemodynamics in patients. However, such patients then require lifelong anticoagulant therapy. Warfarin, a cheap and highly effective vitamin K antagonist, remains the major anticoagulant recommended for lifelong use following mechanical heart valve replacement. However, the effect of warfarin anticoagulant therapy is complicated by physiological differences among patients and non-compliance with treatment at different degrees. Effective management of warfarin therapy after heart valve replacement is currently an important issue. Portable coagulometers and the emergence of the Internet have provided new opportunities for long-term management of anticoagulation therapy, but the safety and affordability of this approach remain to be fully evaluated. This paper reviews recent progress on the use of portable coagulometers and the Internet in the management of warfarin anticoagulation therapy following mechanical heart valve replacement, which offers opportunities for reducing complications during postoperative anticoagulation and for facilitating patient compliance during follow-up.
Collapse
|
6
|
Zeng J, Shao J, Lin S, Zhang H, Su X, Lian X, Zhao Y, Ji X, Zheng Z. Optimizing the dynamic treatment regime of in-hospital warfarin anticoagulation in patients after surgical valve replacement using reinforcement learning. J Am Med Inform Assoc 2022; 29:1722-1732. [PMID: 35864720 DOI: 10.1093/jamia/ocac088] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 04/18/2022] [Accepted: 05/20/2022] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVE Warfarin anticoagulation management requires sequential decision-making to adjust dosages based on patients' evolving states continuously. We aimed to leverage reinforcement learning (RL) to optimize the dynamic in-hospital warfarin dosing in patients after surgical valve replacement (SVR). MATERIALS AND METHODS 10 408 SVR cases with warfarin dosage-response data were retrospectively collected to develop and test an RL algorithm that can continuously recommend daily warfarin doses based on patients' evolving multidimensional states. The RL algorithm was compared with clinicians' actual practice and other machine learning and clinical decision rule-based algorithms. The primary outcome was the ratio of patients without in-hospital INRs >3.0 and the INR at discharge within the target range (1.8-2.5) (excellent responders). The secondary outcomes were the safety responder ratio (no INRs >3.0) and the target responder ratio (the discharge INR within 1.8-2.5). RESULTS In the test set (n = 1260), the excellent responder ratio under clinicians' guidance was significantly lower than the RL algorithm: 41.6% versus 80.8% (relative risk [RR], 0.51; 95% confidence interval [CI], 0.48-0.55), also the safety responder ratio: 83.1% versus 99.5% (RR, 0.83; 95% CI, 0.81-0.86), and the target responder ratio: 49.7% versus 81.1% (RR, 0.61; 95% CI, 0.58-0.65). The RL algorithms performed significantly better than all the other algorithms. Compared with clinicians' actual practice, the RL-optimized INR trajectory reached and maintained within the target range significantly faster and longer. DISCUSSION RL could offer interactive, practical clinical decision support for sequential decision-making tasks and is potentially adaptable for varied clinical scenarios. Prospective validation is needed. CONCLUSION An RL algorithm significantly optimized the post-operation warfarin anticoagulation quality compared with clinicians' actual practice, suggesting its potential for challenging sequential decision-making tasks.
Collapse
Affiliation(s)
- Juntong Zeng
- National Clinical Research Center of Cardiovascular Diseases, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,State Key Laboratory of Cardiovascular Disease, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, People's Republic of China
| | - Jianzhun Shao
- Department of Automation, Tsinghua University, Beijing, People's Republic of China
| | - Shen Lin
- National Clinical Research Center of Cardiovascular Diseases, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,State Key Laboratory of Cardiovascular Disease, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, People's Republic of China.,Department of Cardiovascular Surgery, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China
| | - Hongchang Zhang
- Department of Automation, Tsinghua University, Beijing, People's Republic of China
| | - Xiaoting Su
- National Clinical Research Center of Cardiovascular Diseases, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,State Key Laboratory of Cardiovascular Disease, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, People's Republic of China
| | - Xiaocong Lian
- Department of Automation, Tsinghua University, Beijing, People's Republic of China.,Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, People's Republic of China
| | - Yan Zhao
- National Clinical Research Center of Cardiovascular Diseases, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,State Key Laboratory of Cardiovascular Disease, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China
| | - Xiangyang Ji
- Department of Automation, Tsinghua University, Beijing, People's Republic of China.,Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, People's Republic of China
| | - Zhe Zheng
- National Clinical Research Center of Cardiovascular Diseases, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,State Key Laboratory of Cardiovascular Disease, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, People's Republic of China.,Department of Cardiovascular Surgery, Fuwai Hospital, National Center for Cardiovascular Diseases, Beijing, People's Republic of China.,National Health Commission Key Laboratory of Cardiovascular Regenerative Medicine, Fuwai Central-China Hospital, Central-China Branch of National Center for Cardiovascular Diseases, Zhengzhou, People's Republic of China
| |
Collapse
|
7
|
Zhang F, Liu Y, Ma W, Zhao S, Chen J, Gu Z. Nonlinear Machine Learning in Warfarin Dose Prediction: Insights from Contemporary Modelling Studies. J Pers Med 2022; 12:jpm12050717. [PMID: 35629140 PMCID: PMC9147332 DOI: 10.3390/jpm12050717] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 04/26/2022] [Accepted: 04/28/2022] [Indexed: 02/01/2023] Open
Abstract
Objective: This study aimed to systematically assess the characteristics and risk of bias of previous studies that have investigated nonlinear machine learning algorithms for warfarin dose prediction. Methods: We systematically searched PubMed, Embase, Cochrane Library, Chinese National Knowledge Infrastructure (CNKI), China Biology Medicine (CBM), China Science and Technology Journal Database (VIP), and Wanfang Database up to March 2022. We assessed the general characteristics of the included studies with respect to the participants, predictors, model development, and model evaluation. The methodological quality of the studies was determined, and the risk of bias was evaluated using the Prediction model Risk of Bias Assessment Tool (PROBAST). Results: From a total of 8996 studies, 23 were assessed in this study, of which 23 (100%) were retrospective, and 11 studies focused on the Asian population. The most common demographic and clinical predictors were age (21/23, 91%), weight (17/23, 74%), height (12/23, 52%), and amiodarone combination (11/23, 48%), while CYP2C9 (14/23, 61%), VKORC1 (14/23, 61%), and CYP4F2 (5/23, 22%) were the most common genetic predictors. Of the included studies, the MAE ranged from 1.47 to 10.86 mg/week in model development studies, from 2.42 to 5.18 mg/week in model development with external validation (same data) studies, from 12.07 to 17.59 mg/week in model development with external validation (another data) studies, and from 4.40 to 4.84 mg/week in model external validation studies. All studies were evaluated as having a high risk of bias. Factors contributing to the risk of bias include inappropriate exclusion of participants (10/23, 43%), small sample size (15/23, 65%), poor handling of missing data (20/23, 87%), and incorrect method of selecting predictors (8/23, 35%). Conclusions: Most studies on nonlinear-machine-learning-based warfarin prediction models show poor methodological quality and have a high risk of bias. The analysis domain is the major contributor to the overall high risk of bias. External validity and model reproducibility are lacking in most studies. Future studies should focus on external validity, diminish risk of bias, and enhance real-world clinical relevance.
Collapse
Affiliation(s)
- Fengying Zhang
- Department of Evidence-Based Medicine and Clinical Epidemiology, West China Hospital, Sichuan University, Chengdu 610041, China; (F.Z.); (W.M.); (S.Z.)
| | - Yan Liu
- Department of Clinical Pharmacy, Xinhua Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai 200092, China;
| | - Weijie Ma
- Department of Evidence-Based Medicine and Clinical Epidemiology, West China Hospital, Sichuan University, Chengdu 610041, China; (F.Z.); (W.M.); (S.Z.)
| | - Shengming Zhao
- Department of Evidence-Based Medicine and Clinical Epidemiology, West China Hospital, Sichuan University, Chengdu 610041, China; (F.Z.); (W.M.); (S.Z.)
| | - Jin Chen
- Department of Evidence-Based Medicine and Clinical Epidemiology, West China Hospital, Sichuan University, Chengdu 610041, China; (F.Z.); (W.M.); (S.Z.)
- Correspondence: (J.C.); (Z.G.)
| | - Zhichun Gu
- Department of Pharmacy, Ren Ji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai 200127, China
- Shanghai Anticoagulation Pharmacist Alliance, Shanghai Pharmaceutical Association, Shanghai 200040, China
- Correspondence: (J.C.); (Z.G.)
| |
Collapse
|