1
|
Mohamed Abdul Cader J, Newton MAH, Rahman J, Mohamed Abdul Cader AJ, Sattar A. Ensembling methods for protein-ligand binding affinity prediction. Sci Rep 2024; 14:24447. [PMID: 39424851 PMCID: PMC11489440 DOI: 10.1038/s41598-024-72784-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Accepted: 09/10/2024] [Indexed: 10/21/2024] Open
Abstract
Protein-ligand binding affinity prediction is a key element of computer-aided drug discovery. Most of the existing deep learning methods for protein-ligand binding affinity prediction utilize single models and suffer from low accuracy and generalization capability. In this paper, we train 13 deep learning models from combinations of 5 input features. Then, we explore all possible ensembles of the trained models to find the best ensembles. Our deep learning models use cross-attention and self-attention layers to extract short and long-range interactions. Our method is named Ensemble Binding Affinity (EBA). EBA extracts information from various models using different combinations of input features, such as simple 1D sequential and structural features of the protein-ligand complexes rather than 3D complex features. EBA is implemented to accurately predict the binding affinity of a protein-ligand complex. One of our ensembles achieves the highest Pearson correlation coefficient (R) value of 0.914 and the lowest root mean square error (RMSE) value of 0.957 on the well-known benchmark test set CASF2016. Our ensembles show significant improvements of more than 15% in R-value and 19% in RMSE on both well-known benchmark CSAR-HiQ test sets over the second-best predictor named CAPLA. Furthermore, the superior performance of the ensembles across all metrics compared to existing state-of-the-art protein-ligand binding affinity prediction methods on all five benchmark test datasets demonstrates the effectiveness and robustness of our approach. Therefore, our approach to improving binding affinity prediction between proteins and ligands can contribute to improving the success rate of potential drugs and accelerate the drug development process.
Collapse
Affiliation(s)
- Jiffriya Mohamed Abdul Cader
- School of Information and Communication Technology, Griffith University, Nathan Campus, Australia.
- Department of IT, Sri Lanka Institute of Advanced Technological Education, Colombo, Sri Lanka.
| | - M A Hakim Newton
- Institute for Integrated and Intelligent Systems (IIIS), Griffith University, Nathan Campus, Australia
- School of Information and Physical Sciences, The University of Newcastle, Callaghan, Australia
| | - Julia Rahman
- School of Information and Communication Technology, Griffith University, Nathan Campus, Australia
- Department of Computer Science and Engineering, Rajshahi University of Engineering and Technology, Rajshahi, Bangladesh
| | | | - Abdul Sattar
- School of Information and Communication Technology, Griffith University, Nathan Campus, Australia
- Institute for Integrated and Intelligent Systems (IIIS), Griffith University, Nathan Campus, Australia
| |
Collapse
|
2
|
Zeng X, Zhong KY, Meng PY, Li SJ, Lv SQ, Wen ML, Li Y. MvGraphDTA: multi-view-based graph deep model for drug-target affinity prediction by introducing the graphs and line graphs. BMC Biol 2024; 22:182. [PMID: 39183297 PMCID: PMC11346193 DOI: 10.1186/s12915-024-01981-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 08/13/2024] [Indexed: 08/27/2024] Open
Abstract
BACKGROUND Accurately identifying drug-target affinity (DTA) plays a pivotal role in drug screening, design, and repurposing in pharmaceutical industry. It not only reduces the time, labor, and economic costs associated with biological experiments but also expedites drug development process. However, achieving the desired level of computational accuracy for DTA identification methods remains a significant challenge. RESULTS We proposed a novel multi-view-based graph deep model known as MvGraphDTA for DTA prediction. MvGraphDTA employed a graph convolutional network (GCN) to extract the structural features from original graphs of drugs and targets, respectively. It went a step further by constructing line graphs with edges as vertices based on original graphs of drugs and targets. GCN was also used to extract the relationship features within their line graphs. To enhance the complementarity between the extracted features from original graphs and line graphs, MvGraphDTA fused the extracted multi-view features of drugs and targets, respectively. Finally, these fused features were concatenated and passed through a fully connected (FC) network to predict DTA. CONCLUSIONS During the experiments, we performed data augmentation on all the training sets used. Experimental results showed that MvGraphDTA outperformed the competitive state-of-the-art methods on benchmark datasets for DTA prediction. Additionally, we evaluated the universality and generalization performance of MvGraphDTA on additional datasets. Experimental outcomes revealed that MvGraphDTA exhibited good universality and generalization capability, making it a reliable tool for drug-target interaction prediction.
Collapse
Affiliation(s)
- Xin Zeng
- College of Mathematics and Computer Science, Dali University, Dali, 671003, China
| | - Kai-Yang Zhong
- College of Mathematics and Computer Science, Dali University, Dali, 671003, China
| | - Pei-Yan Meng
- College of Mathematics and Computer Science, Dali University, Dali, 671003, China
| | - Shu-Juan Li
- Yunnan Institute of Endemic Diseases Control & Prevention, Dali, 671000, China
| | - Shuang-Qing Lv
- Institute of Surveying and Information Engineering, West Yunnan University of Applied Science, Dali, 671000, China
| | - Meng-Liang Wen
- State Key Laboratory for Conservation and Utilization of Bio-Resources in Yunnan, Yunnan University, Kunming, 650000, China
| | - Yi Li
- College of Mathematics and Computer Science, Dali University, Dali, 671003, China.
| |
Collapse
|
3
|
Wu Z, Chen S, Wang Y, Li F, Xu H, Li M, Zeng Y, Wu Z, Gao Y. Current perspectives and trend of computer-aided drug design: a review and bibliometric analysis. Int J Surg 2024; 110:3848-3878. [PMID: 38502850 PMCID: PMC11175770 DOI: 10.1097/js9.0000000000001289] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Accepted: 02/22/2024] [Indexed: 03/21/2024]
Abstract
AIM Computer-aided drug design (CADD) is a drug design technique for computing ligand-receptor interactions and is involved in various stages of drug development. To better grasp the frontiers and hotspots of CADD, we conducted a review analysis through bibliometrics. METHODS A systematic review of studies published between 2000 and 20 July 2023 was conducted following the PRISMA guidelines. Literature on CADD was selected from the Web of Science Core Collection. General information, publications, output trends, countries/regions, institutions, journals, keywords, and influential authors were visually analyzed using software such as Excel, VOSviewer, RStudio, and CiteSpace. RESULTS A total of 2031 publications were included. These publications primarily originated from 99 countries or regions led by the U.S. and China. Among the contributors, MacKerell AD had the highest number of articles and the greatest influence. The Journal of Medicinal Chemistry was the most cited journal, whereas the Journal of Chemical Information and Modeling had the highest number of publications. CONCLUSIONS Influential authors in the field were identified. Current research shows active collaboration between countries, institutions, and companies. CADD technologies such as homology modeling, pharmacophore modeling, quantitative conformational relationships, molecular docking, molecular dynamics simulation, binding free energy prediction, and high-throughput virtual screening can effectively improve the efficiency of new drug discovery. Artificial intelligence-assisted drug design and screening based on CADD represent key topics that will influence future development. Furthermore, this paper will be helpful in better understanding the frontiers and hotspots of CADD.
Collapse
Affiliation(s)
- Zhenhui Wu
- School of Pharmacy, Jiangxi University of Chinese Medicine
- School of Clinical Medicine, Jiangxi University of Chinese Medicine, Nanchang
- Beijing Institute of Radiation Medicine, Academy of Military Sciences, Beijing, People’s Republic of China
| | - Shupeng Chen
- School of Clinical Medicine, Jiangxi University of Chinese Medicine, Nanchang
| | - Yihao Wang
- Beijing Institute of Radiation Medicine, Academy of Military Sciences, Beijing, People’s Republic of China
| | - Fangyang Li
- Beijing Institute of Radiation Medicine, Academy of Military Sciences, Beijing, People’s Republic of China
| | - Huanhua Xu
- School of Pharmacy, Jiangxi University of Chinese Medicine
| | - Maoxing Li
- Beijing Institute of Radiation Medicine, Academy of Military Sciences, Beijing, People’s Republic of China
| | - Yingjian Zeng
- School of Clinical Medicine, Jiangxi University of Chinese Medicine, Nanchang
| | - Zhenfeng Wu
- School of Pharmacy, Jiangxi University of Chinese Medicine
| | - Yue Gao
- School of Pharmacy, Jiangxi University of Chinese Medicine
- Beijing Institute of Radiation Medicine, Academy of Military Sciences, Beijing, People’s Republic of China
| |
Collapse
|
4
|
Wang DD, Wu W, Wang R. Structure-based, deep-learning models for protein-ligand binding affinity prediction. J Cheminform 2024; 16:2. [PMID: 38173000 PMCID: PMC10765576 DOI: 10.1186/s13321-023-00795-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2023] [Accepted: 12/10/2023] [Indexed: 01/05/2024] Open
Abstract
The launch of AlphaFold series has brought deep-learning techniques into the molecular structural science. As another crucial problem, structure-based prediction of protein-ligand binding affinity urgently calls for advanced computational techniques. Is deep learning ready to decode this problem? Here we review mainstream structure-based, deep-learning approaches for this problem, focusing on molecular representations, learning architectures and model interpretability. A model taxonomy has been generated. To compensate for the lack of valid comparisons among those models, we realized and evaluated representatives from a uniform basis, with the advantages and shortcomings discussed. This review will potentially benefit structure-based drug discovery and related areas.
Collapse
Affiliation(s)
- Debby D Wang
- School of Science and Technology, Hong Kong Metropolitan University, 81 Chung Hau Sreet, Ho Man Tin, Hong Kong, China
| | - Wenhui Wu
- College of Electronics and Information Engineering, Shenzhen University, Shenzhen, 518060, China
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen, 518060, China
| | - Ran Wang
- School of Mathematical Science, Shenzhen University, Shenzhen, 518060, China.
- Guangdong Key Laboratory of Intelligent Information Processing, Shenzhen University, Shenzhen, 518060, China.
- Shenzhen Key Laboratory of Advanced Machine Learning and Applications, Shenzhen University, Shenzhen , 518060, China.
| |
Collapse
|
5
|
Bitencourt-Ferreira G, Villarreal MA, Quiroga R, Biziukova N, Poroikov V, Tarasova O, de Azevedo Junior WF. Exploring Scoring Function Space: Developing Computational Models for Drug Discovery. Curr Med Chem 2024; 31:2361-2377. [PMID: 36944627 DOI: 10.2174/0929867330666230321103731] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2022] [Revised: 12/15/2022] [Accepted: 12/29/2022] [Indexed: 03/23/2023]
Abstract
BACKGROUND The idea of scoring function space established a systems-level approach to address the development of models to predict the affinity of drug molecules by those interested in drug discovery. OBJECTIVE Our goal here is to review the concept of scoring function space and how to explore it to develop machine learning models to address protein-ligand binding affinity. METHODS We searched the articles available in PubMed related to the scoring function space. We also utilized crystallographic structures found in the protein data bank (PDB) to represent the protein space. RESULTS The application of systems-level approaches to address receptor-drug interactions allows us to have a holistic view of the process of drug discovery. The scoring function space adds flexibility to the process since it makes it possible to see drug discovery as a relationship involving mathematical spaces. CONCLUSION The application of the concept of scoring function space has provided us with an integrated view of drug discovery methods. This concept is useful during drug discovery, where we see the process as a computational search of the scoring function space to find an adequate model to predict receptor-drug binding affinity.
Collapse
Affiliation(s)
| | - Marcos A Villarreal
- CONICET-Departamento de Matemática y Física, Instituto de Investigaciones en Fisicoquímica de Córdoba (INFIQC), Facultad de Ciencias Químicas, Universidad Nacional de Córdoba, Ciudad Universitaria, Córdoba, Argentina
| | - Rodrigo Quiroga
- CONICET-Departamento de Matemática y Física, Instituto de Investigaciones en Fisicoquímica de Córdoba (INFIQC), Facultad de Ciencias Químicas, Universidad Nacional de Córdoba, Ciudad Universitaria, Córdoba, Argentina
| | - Nadezhda Biziukova
- Institute of Biomedical Chemistry, Pogodinskaya Str., 10/8, Moscow, 119121, Russia
| | - Vladimir Poroikov
- Institute of Biomedical Chemistry, Pogodinskaya Str., 10/8, Moscow, 119121, Russia
| | - Olga Tarasova
- Institute of Biomedical Chemistry, Pogodinskaya Str., 10/8, Moscow, 119121, Russia
| | - Walter F de Azevedo Junior
- Pontifical Catholic University of Rio Grande do Sul - PUCRS, Porto Alegre-RS, Brazil
- Specialization Program in Bioinformatics, The Pontifical Catholic University of Rio Grande do Sul (PUCRS), Av. Ipiranga, 6681 Porto Alegre / RS 90619-900, Brazil
| |
Collapse
|
6
|
Aly Abdelkader G, Ngnamsie Njimbouom S, Oh TJ, Kim JD. ResBiGAAT: Residual Bi-GRU with attention for protein-ligand binding affinity prediction. Comput Biol Chem 2023; 107:107969. [PMID: 37866117 DOI: 10.1016/j.compbiolchem.2023.107969] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2023] [Revised: 09/20/2023] [Accepted: 10/05/2023] [Indexed: 10/24/2023]
Abstract
Protein-ligand interaction plays a crucial role in drug discovery, facilitating efficient drug development and enabling drug repurposing. Several computational algorithms, such as Graph Neural Networks and Convolutional Neural Networks, have been proposed to predict the binding affinity using the three-dimensional structure of ligands and proteins. However, there are limitations due to the need for experimental characterization of the three-dimensional structure of protein sequences, which is still lacking for some proteins. Moreover, these models often suffer from unnecessary complexity, resulting in extraneous computations. This study presents ResBiGAAT, a novel deep learning model that combines a deep Residual Bidirectional Gated Recurrent Unit with two-sided self-attention mechanisms. ResBiGAAT leverages protein and ligand sequence-level features and their physicochemical properties to efficiently predict protein-ligand binding affinity. Through rigorous evaluation using 5-fold cross-validation, we demonstrate the performance of our proposed approach. The model exhibits competitive performance on an external dataset, highlighting its generalizability. Our publicly available web interface, located at resbigaat.streamlit.app, allows users to conveniently input protein and ligand sequences to estimate binding affinity.
Collapse
Affiliation(s)
- Gelany Aly Abdelkader
- Department of Computer Science and Electronic Engineering, Sun Moon University, Asan 31460, the Republic of Korea
| | - Soualihou Ngnamsie Njimbouom
- Department of Computer Science and Electronic Engineering, Sun Moon University, Asan 31460, the Republic of Korea
| | - Tae-Jin Oh
- Genome‑based BioIT Convergence Institute, Asan 31460, the Republic of Korea; Department of Pharmaceutical Engineering and Biotechnology, Sun Moon University, Asan 31460, the Republic of Korea
| | - Jeong-Dong Kim
- Department of Computer Science and Electronic Engineering, Sun Moon University, Asan 31460, the Republic of Korea; Division of Computer Science and Engineering, Sun Moon University, Asan 31460, the Republic of Korea.
| |
Collapse
|
7
|
Long Y, Donald BR. Predicting Affinity Through Homology (PATH): Interpretable Binding Affinity Prediction with Persistent Homology. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.11.16.567384. [PMID: 38014181 PMCID: PMC10680814 DOI: 10.1101/2023.11.16.567384] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/29/2023]
Abstract
Accurate binding affinity prediction is crucial to structure-based drug design. Recent work used computational topology to obtain an effective representation of protein-ligand interactions. Although persistent homology encodes geometric features, previous works on binding affinity prediction using persistent homology employed uninterpretable machine learning models and failed to explain the underlying geometric and topological features that drive accurate binding affinity prediction. In this work, we propose a novel, interpretable algorithm for protein-ligand binding affinity prediction. Our algorithm achieves interpretability through an effective embedding of distances across bipartite matchings of the protein and ligand atoms into real-valued functions by summing Gaussians centered at features constructed by persistent homology. We name these functions internuclear persistent contours (IPCs) . Next, we introduce persistence fingerprints , a vector with 10 components that sketches the distances of different bipartite matching between protein and ligand atoms, refined from IPCs. Let the number of protein atoms in the protein-ligand complex be n , number of ligand atoms be m , and ω ≈ 2.4 be the matrix multiplication exponent. We show that for any 0 < ε < 1, after an 𝒪 ( mn log( mn )) preprocessing procedure, we can compute an ε -accurate approximation to the persistence fingerprint in 𝒪 ( m log 6 ω ( m/" )) time, independent of protein size. This is an improvement in time complexity by a factor of 𝒪 (( m + n ) 3 ) over any previous binding affinity prediction that uses persistent homology. We show that the representational power of persistence fingerprint generalizes to protein-ligand binding datasets beyond the training dataset. Then, we introduce PATH , Predicting Affinity Through Homology, an interpretable, small ensemble of shallow regression trees for binding affinity prediction from persistence fingerprints. We show that despite using 1,400-fold fewer features, PATH has comparable performance to a previous state-of-the-art binding affinity prediction algorithm that uses persistent homology features. Moreover, PATH has the advantage of being interpretable. Finally, we visualize the features captured by persistence fingerprint for variant HIV-1 protease complexes and show that persistence fingerprint captures binding-relevant structural mutations. The source code for PATH is released open-source as part of the osprey protein design software package.
Collapse
|
8
|
Wu J, Chen H, Cheng M, Xiong H. CurvAGN: Curvature-based Adaptive Graph Neural Networks for Predicting Protein-Ligand Binding Affinity. BMC Bioinformatics 2023; 24:378. [PMID: 37798653 PMCID: PMC10557336 DOI: 10.1186/s12859-023-05503-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 09/28/2023] [Indexed: 10/07/2023] Open
Abstract
Accurately predicting the binding affinity between proteins and ligands is crucial for drug discovery. Recent advances in graph neural networks (GNNs) have made significant progress in learning representations of protein-ligand complexes to estimate binding affinities. To improve the performance of GNNs, there frequently needs to look into protein-ligand complexes from geometric perspectives. While the "off-the-shelf" GNNs could incorporate some basic geometric structures of molecules, such as distances and angles, through modeling the complexes as homophilic graphs, these solutions seldom take into account the higher-level geometric attributes like curvatures and homology, and also heterophilic interactions.To address these limitations, we introduce the Curvature-based Adaptive Graph Neural Network (CurvAGN). This GNN comprises two components: a curvature block and an adaptive attention guided neural block (AGN). The curvature block encodes multiscale curvature informaton, then the AGN, based on an adaptive graph attention mechanism, incorporates geometry structure including angle, distance, and multiscale curvature, long-range molecular interactions, and heterophily of the graph into the protein-ligand complex representation. We demonstrate the superiority of our proposed model through experiments conducted on the PDBbind-V2016 core dataset.
Collapse
Affiliation(s)
- Jianqiu Wu
- Research Center for Graph Computing, Zhejiang Lab, Yuhang, Hangzhou, 311121, Zhejiang, China
| | - Hongyang Chen
- Research Center for Graph Computing, Zhejiang Lab, Yuhang, Hangzhou, 311121, Zhejiang, China.
| | - Minhao Cheng
- Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Jiulongwan, Hongkong, 999077, China
| | - Haoyi Xiong
- Big Data Lab, Baidu Inc., Haidian, Beijing, 100080, China
| |
Collapse
|
9
|
Jin Z, Wu T, Chen T, Pan D, Wang X, Xie J, Quan L, Lyu Q. CAPLA: improved prediction of protein-ligand binding affinity by a deep learning approach based on a cross-attention mechanism. Bioinformatics 2023; 39:btad049. [PMID: 36688724 PMCID: PMC9900214 DOI: 10.1093/bioinformatics/btad049] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 01/07/2023] [Accepted: 01/21/2023] [Indexed: 01/24/2023] Open
Abstract
MOTIVATION Accurate and rapid prediction of protein-ligand binding affinity is a great challenge currently encountered in drug discovery. Recent advances have manifested a promising alternative in applying deep learning-based computational approaches for accurately quantifying binding affinity. The structure complementarity between protein-binding pocket and ligand has a great effect on the binding strength between a protein and a ligand, but most of existing deep learning approaches usually extracted the features of pocket and ligand by these two detached modules. RESULTS In this work, a new deep learning approach based on the cross-attention mechanism named CAPLA was developed for improved prediction of protein-ligand binding affinity by learning features from sequence-level information of both protein and ligand. Specifically, CAPLA employs the cross-attention mechanism to capture the mutual effect of protein-binding pocket and ligand. We evaluated the performance of our proposed CAPLA on comprehensive benchmarking experiments on binding affinity prediction, demonstrating the superior performance of CAPLA over state-of-the-art baseline approaches. Moreover, we provided the interpretability for CAPLA to uncover critical functional residues that contribute most to the binding affinity through the analysis of the attention scores generated by the cross-attention mechanism. Consequently, these results indicate that CAPLA is an effective approach for binding affinity prediction and may contribute to useful help for further consequent applications. AVAILABILITY AND IMPLEMENTATION The source code of the method along with trained models is freely available at https://github.com/lennylv/CAPLA. SUPPLEMENTARY INFORMATION Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Zhi Jin
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China
| | - Tingfang Wu
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China
- Province Key Lab for Information Processing Technologies, Soochow University, Suzhou 215006, China
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing 210000, China
| | - Taoning Chen
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China
| | - Deng Pan
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China
| | - Xuejiao Wang
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China
| | - Jingxin Xie
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China
| | - Lijun Quan
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China
- Province Key Lab for Information Processing Technologies, Soochow University, Suzhou 215006, China
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing 210000, China
| | - Qiang Lyu
- School of Computer Science and Technology, Soochow University, Suzhou 215006, China
- Province Key Lab for Information Processing Technologies, Soochow University, Suzhou 215006, China
- Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing 210000, China
| |
Collapse
|