1
|
Liu D, Zhang Y, Yang M, Yuan J, Qu W. Extracting Mutant-Affected Protein-Protein Interactions via Gaussian-Enhanced Representation and Contrastive Learning. J Comput Biol 2023; 30:972-984. [PMID: 37682321 DOI: 10.1089/cmb.2023.0080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/09/2023] Open
Abstract
Genetic mutations can impact protein-protein interactions (PPIs) in biomedical literature. Automated extraction of PPIs affected by gene mutations from biomedical literature can aid in evaluating the clinical importance of gene variations, which is crucial for the advancement of precision medicine. In this study, a new model called the Gaussian-enhanced representation model (GRM) is introduced for PPI extraction. The model utilizes the Gaussian probability distribution to produce a target entity representation based on the BioBERT pretraining model. The GRM assigns more weight to target protein entities and their adjacent entities, resolving the problem of lengthy input text and scattered distribution of target entities in the PPI extraction task. Additionally, the model introduces a supervised contrast learning approach to enhance its effectiveness and robustness. Experiments on the BioCreative VI data set demonstrate that our proposed GRM model has achieved state-of-the-art performance.
Collapse
Affiliation(s)
- Da Liu
- School of Information Science and Technology, Dalian Maritime University, Dalian, Liaoning, China
| | - Yijia Zhang
- School of Information Science and Technology, Dalian Maritime University, Dalian, Liaoning, China
| | - Ming Yang
- School of Information Science and Technology, Dalian Maritime University, Dalian, Liaoning, China
| | - Jianyuan Yuan
- School of Information Science and Technology, Dalian Maritime University, Dalian, Liaoning, China
| | - Wen Qu
- School of Information Science and Technology, Dalian Maritime University, Dalian, Liaoning, China
| |
Collapse
|
2
|
Lai PT, Lu WL, Kuo TR, Chung CR, Han JC, Tsai RTH, Horng JT. Using a Large Margin Context-Aware Convolutional Neural Network to Automatically Extract Disease-Disease Association from Literature: Comparative Analytic Study. JMIR Med Inform 2019; 7:e14502. [PMID: 31769759 PMCID: PMC6913619 DOI: 10.2196/14502] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2019] [Revised: 07/26/2019] [Accepted: 08/11/2019] [Indexed: 12/04/2022] Open
Abstract
BACKGROUND Research on disease-disease association (DDA), like comorbidity and complication, provides important insights into disease treatment and drug discovery, and a large body of the literature has been published in the field. However, using current search tools, it is not easy for researchers to retrieve information on the latest DDA findings. First, comorbidity and complication keywords pull up large numbers of PubMed studies. Second, disease is not highlighted in search results. Finally, DDA is not identified, as currently no disease-disease association extraction (DDAE) dataset or tools are available. OBJECTIVE As there are no available DDAE datasets or tools, this study aimed to develop (1) a DDAE dataset and (2) a neural network model for extracting DDA from the literature. METHODS In this study, we formulated DDAE as a supervised machine learning classification problem. To develop the system, we first built a DDAE dataset. We then employed two machine learning models, support vector machine and convolutional neural network, to extract DDA. Furthermore, we evaluated the effect of using the output layer as features of the support vector machine-based model. Finally, we implemented large margin context-aware convolutional neural network architecture to integrate context features and convolutional neural networks through the large margin function. RESULTS Our DDAE dataset consisted of 521 PubMed abstracts. Experiment results showed that the support vector machine-based approach achieved an F1 measure of 80.32%, which is higher than the convolutional neural network-based approach (73.32%). Using the output layer of convolutional neural network as a feature for the support vector machine does not further improve the performance of support vector machine. However, our large margin context-aware-convolutional neural network achieved the highest F1 measure of 84.18% and demonstrated that combining the hinge loss function of support vector machine with a convolutional neural network into a single neural network architecture outperforms other approaches. CONCLUSIONS To facilitate the development of text-mining research for DDAE, we developed the first publicly available DDAE dataset consisting of disease mentions, Medical Subject Heading IDs, and relation annotations. We developed different conventional machine learning models and neural network architectures and evaluated their effects on our DDAE dataset. To further improve DDAE performance, we propose an large margin context-aware-convolutional neural network model for DDAE that outperforms other approaches.
Collapse
Affiliation(s)
- Po-Ting Lai
- Department of Computer Science National Tsing Hua University, Hsinchu, Province of China Taiwan
| | - Wei-Liang Lu
- Department of Computer Science & Information Engineering, National Central University, Taoyuan, Province of China Taiwan
| | - Ting-Rung Kuo
- Department of Computer Science & Information Engineering, National Central University, Taoyuan, Province of China Taiwan
| | - Chia-Ru Chung
- Department of Computer Science & Information Engineering, National Central University, Taoyuan, Province of China Taiwan
| | - Jen-Chieh Han
- Department of Computer Science & Information Engineering, National Central University, Taoyuan, Province of China Taiwan
| | - Richard Tzong-Han Tsai
- Department of Computer Science & Information Engineering, National Central University, Taoyuan, Province of China Taiwan
| | - Jorng-Tzong Horng
- Department of Computer Science & Information Engineering, National Central University, Taoyuan, Province of China Taiwan
- Department of Bioinformatics and Medical Engineering, Asia University, Taichung, Province of China Taiwan
| |
Collapse
|
3
|
Li Q, Yang Z, Zhao Z, Luo L, Li Z, Wang L, Zhang Y, Lin H, Wang J, Zhang Y. HMNPPID-human malignant neoplasm protein-protein interaction database. Hum Genomics 2019; 13:44. [PMID: 31639057 PMCID: PMC6805303 DOI: 10.1186/s40246-019-0223-5] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Protein-protein interaction (PPI) information extraction from biomedical literature helps unveil the molecular mechanisms of biological processes. Especially, the PPIs associated with human malignant neoplasms can unveil the biology behind these neoplasms. However, such PPI database is not currently available. RESULTS In this work, a database of protein-protein interactions associated with 171 kinds of human malignant neoplasms named HMNPPID is constructed. In addition, a visualization program, named VisualPPI, is provided to facilitate the analysis of the PPI network for a specific neoplasm. CONCLUSIONS HMNPPID can hopefully become an important resource for the research on PPIs of human malignant neoplasms since it provides readily available data for healthcare professionals. Thus, they do not need to dig into a large amount of biomedical literatures any more, which may accelerate the researches on the PPIs of malignant neoplasms.
Collapse
Affiliation(s)
- Qingqing Li
- College of Computer Science and Technology, Dalian University of Technology, Dalian, 116024, China
| | - Zhihao Yang
- College of Computer Science and Technology, Dalian University of Technology, Dalian, 116024, China.
| | - Zhehuan Zhao
- College of Computer Science and Technology, Dalian University of Technology, Dalian, 116024, China
| | - Ling Luo
- College of Computer Science and Technology, Dalian University of Technology, Dalian, 116024, China
| | - Zhiheng Li
- College of Computer Science and Technology, Dalian University of Technology, Dalian, 116024, China
| | - Lei Wang
- Beijing Institute of Health Administration and Medical Information, Beijing, 100850, China.
| | - Yin Zhang
- Beijing Institute of Health Administration and Medical Information, Beijing, 100850, China
| | - Hongfei Lin
- College of Computer Science and Technology, Dalian University of Technology, Dalian, 116024, China
| | - Jian Wang
- College of Computer Science and Technology, Dalian University of Technology, Dalian, 116024, China
| | - Yijia Zhang
- College of Computer Science and Technology, Dalian University of Technology, Dalian, 116024, China
| |
Collapse
|
4
|
Liu RL. Identification of conclusive association entities in biomedical articles. J Biomed Semantics 2019; 10:1. [PMID: 30616688 PMCID: PMC6322258 DOI: 10.1186/s13326-018-0194-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2018] [Accepted: 12/20/2018] [Indexed: 11/23/2022] Open
Abstract
BACKGROUND Conclusive association entities (CAEs) in a biomedical article a are those biomedical entities (e.g., genes, diseases, and chemicals) that are specifically involved in the associations concluded in a. Identification of CAEs among candidate entities in the title and the abstract of an article is essential for curation and exploration of conclusive findings in biomedical literature. However, the identification is challenging, as it is difficult to conduct semantic analysis to determine whether an entity is a specific target on which the reported findings are conclusive enough. RESULTS We investigate how five types of statistical indicators can contribute to prioritizing the candidate entities so that CAEs can be ranked on the top for exploratory analysis. The indicators work on titles and abstracts of articles. They are evaluated by the CAEs designated by biomedical experts to curate entity associations concluded in articles. The indicators have significantly different performance in ranking the CAEs identified by the biomedical experts. Some indicators do not perform well in CAE identification, even though they were used in many techniques for article retrieval and keyword extraction. Learning-based fusion of certain indicators can further improve performance. Most of the articles have at least one of their CAEs successfully ranked at top-2 positions. The CAEs can be visualized to support exploratory analysis of conclusive results on the CAEs. CONCLUSION With proper fusion of the statistical indicators, CAEs in biomedical articles can be identified for exploratory analysis. The results are essential for the indexing of biomedical articles to support validation of highly related conclusive findings in biomedical literature.
Collapse
Affiliation(s)
- Rey-Long Liu
- Department of Medical Informatics, Tzu Chi University, Hualien, Taiwan, Republic of China.
| |
Collapse
|
5
|
Zhou H, Liu Z, Ning S, Yang Y, Lang C, Lin Y, Ma K. Leveraging prior knowledge for protein-protein interaction extraction with memory network. DATABASE-THE JOURNAL OF BIOLOGICAL DATABASES AND CURATION 2018; 2018:5053999. [PMID: 30010731 PMCID: PMC6047414 DOI: 10.1093/database/bay071] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2018] [Accepted: 06/14/2018] [Indexed: 11/14/2022]
Abstract
Automatically extracting protein-protein interactions (PPIs) from biomedical literature provides additional support for precision medicine efforts. This paper proposes a novel memory network-based model (MNM) for PPI extraction, which leverages prior knowledge about protein-protein pairs with memory networks. The proposed MNM captures important context clues related to knowledge representations learned from knowledge bases. Both entity embeddings and relation embeddings of prior knowledge are effective in improving the PPI extraction model, leading to a new state-of-the-art performance on the BioCreative VI PPI dataset. The paper also shows that multiple computational layers over an external memory are superior to long short-term memory networks with the local memories.Database URL: http://www.biocreative.org/tasks/biocreative-vi/track-4/.
Collapse
Affiliation(s)
- Huiwei Zhou
- School of Computer Science and Technology, Dalian University of Technology, Chuangxinyuan Building, No. 2 Linggong Road, Ganjingzi District, Dalian, Liaoning, China
| | - Zhuang Liu
- School of Computer Science and Technology, Dalian University of Technology, Chuangxinyuan Building, No. 2 Linggong Road, Ganjingzi District, Dalian, Liaoning, China
| | - Shixian Ning
- School of Computer Science and Technology, Dalian University of Technology, Chuangxinyuan Building, No. 2 Linggong Road, Ganjingzi District, Dalian, Liaoning, China
| | - Yunlong Yang
- School of Computer Science and Technology, Dalian University of Technology, Chuangxinyuan Building, No. 2 Linggong Road, Ganjingzi District, Dalian, Liaoning, China
| | - Chengkun Lang
- School of Computer Science and Technology, Dalian University of Technology, Chuangxinyuan Building, No. 2 Linggong Road, Ganjingzi District, Dalian, Liaoning, China
| | - Yingyu Lin
- School of Foreign Languages, Dalian University of Technology, Arts Building, No. 2 Linggong Road, Ganjingzi District, Dalian, Liaoning, China
| | - Kun Ma
- School of Life Science and Medicine, Dalian University of Technology, F03 Building, No. 2 Dagong Road, Liaodongwan District, Panjin, Liaoning, China
| |
Collapse
|
6
|
Murugesan G, Abdulkadhar S, Natarajan J. Distributed smoothed tree kernel for protein-protein interaction extraction from the biomedical literature. PLoS One 2017; 12:e0187379. [PMID: 29099838 PMCID: PMC5669485 DOI: 10.1371/journal.pone.0187379] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2017] [Accepted: 10/18/2017] [Indexed: 11/24/2022] Open
Abstract
Automatic extraction of protein-protein interaction (PPI) pairs from biomedical literature is a widely examined task in biological information extraction. Currently, many kernel based approaches such as linear kernel, tree kernel, graph kernel and combination of multiple kernels has achieved promising results in PPI task. However, most of these kernel methods fail to capture the semantic relation information between two entities. In this paper, we present a special type of tree kernel for PPI extraction which exploits both syntactic (structural) and semantic vectors information known as Distributed Smoothed Tree kernel (DSTK). DSTK comprises of distributed trees with syntactic information along with distributional semantic vectors representing semantic information of the sentences or phrases. To generate robust machine learning model composition of feature based kernel and DSTK were combined using ensemble support vector machine (SVM). Five different corpora (AIMed, BioInfer, HPRD50, IEPA, and LLL) were used for evaluating the performance of our system. Experimental results show that our system achieves better f-score with five different corpora compared to other state-of-the-art systems.
Collapse
Affiliation(s)
- Gurusamy Murugesan
- Data Mining and Text Mining Laboratory, Department of Bioinformatics, Bharathiar University, Coimbatore, Tamilnadu, India
| | - Sabenabanu Abdulkadhar
- Data Mining and Text Mining Laboratory, Department of Bioinformatics, Bharathiar University, Coimbatore, Tamilnadu, India
| | - Jeyakumar Natarajan
- Data Mining and Text Mining Laboratory, Department of Bioinformatics, Bharathiar University, Coimbatore, Tamilnadu, India
- * E-mail:
| |
Collapse
|