1
|
Teunissen CE, Kimble L, Bayoumy S, Bolsewig K, Burtscher F, Coppens S, Das S, Gogishvili D, Fernandes Gomes B, Gómez de San José N, Mavrina E, Meda FJ, Mohaupt P, Mravinacová S, Waury K, Wojdała AL, Abeln S, Chiasserini D, Hirtz C, Gaetani L, Vermunt L, Bellomo G, Halbgebauer S, Lehmann S, Månberg A, Nilsson P, Otto M, Vanmechelen E, Verberk IMW, Willemse E, Zetterberg H. Methods to Discover and Validate Biofluid-Based Biomarkers in Neurodegenerative Dementias. Mol Cell Proteomics 2023; 22:100629. [PMID: 37557955 PMCID: PMC10594029 DOI: 10.1016/j.mcpro.2023.100629] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 07/24/2023] [Accepted: 07/31/2023] [Indexed: 08/11/2023] Open
Abstract
Neurodegenerative dementias are progressive diseases that cause neuronal network breakdown in different brain regions often because of accumulation of misfolded proteins in the brain extracellular matrix, such as amyloids or inside neurons or other cell types of the brain. Several diagnostic protein biomarkers in body fluids are being used and implemented, such as for Alzheimer's disease. However, there is still a lack of biomarkers for co-pathologies and other causes of dementia. Such biofluid-based biomarkers enable precision medicine approaches for diagnosis and treatment, allow to learn more about underlying disease processes, and facilitate the development of patient inclusion and evaluation tools in clinical trials. When designing studies to discover novel biofluid-based biomarkers, choice of technology is an important starting point. But there are so many technologies to choose among. To address this, we here review the technologies that are currently available in research settings and, in some cases, in clinical laboratory practice. This presents a form of lexicon on each technology addressing its use in research and clinics, its strengths and limitations, and a future perspective.
Collapse
Affiliation(s)
- Charlotte E Teunissen
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Neurochemistry Lab, Department of Laboratory Medicine, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit, Amsterdam, Netherlands.
| | - Leighann Kimble
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; KIN Center for Digital Innovation, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Sherif Bayoumy
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Neurochemistry Lab, Department of Laboratory Medicine, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit, Amsterdam, Netherlands
| | - Katharina Bolsewig
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Neurochemistry Lab, Department of Laboratory Medicine, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit, Amsterdam, Netherlands
| | - Felicia Burtscher
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Luxembourg Centre for Systems Biomedicine, University of Luxembourg, Esch-sur-Alzette, Luxembourg
| | - Salomé Coppens
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; National Measurement Laboratory at LGC, Teddington, United Kingdom
| | - Shreyasee Das
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; ADx NeuroSciences, Gent, Belgium
| | - Dea Gogishvili
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Bárbara Fernandes Gomes
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, The Sahlgrenska Academy at the University of Gothenburg, Mölndal, Sweden
| | - Nerea Gómez de San José
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Neurology, University of Ulm, Ulm, Germany
| | - Ekaterina Mavrina
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; KIN Center for Digital Innovation, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Francisco J Meda
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, The Sahlgrenska Academy at the University of Gothenburg, Mölndal, Sweden
| | - Pablo Mohaupt
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; LBPC-PPC, IRMB CHU Montpellier, INM INSERM, Université de Montpellier, Montpellier, France
| | - Sára Mravinacová
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Division of Affinity Proteomics, Department of Protein Science, KTH Royal Institute of Technology, SciLifeLab, Stockholm, Sweden
| | - Katharina Waury
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Anna Lidia Wojdała
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Section of Neurology, Department of Medicine and Surgery, University of Perugia, Perugia, Italy
| | - Sanne Abeln
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Davide Chiasserini
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Section of Physiology and Biochemistry, Department of Medicine and Surgery, University of Perugia, Perugia, Italy
| | - Christophe Hirtz
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; LBPC-PPC, IRMB CHU Montpellier, INM INSERM, Université de Montpellier, Montpellier, France
| | - Lorenzo Gaetani
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Section of Neurology, Department of Medicine and Surgery, University of Perugia, Perugia, Italy
| | - Lisa Vermunt
- Neurochemistry Lab, Department of Laboratory Medicine, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit, Amsterdam, Netherlands
| | - Giovanni Bellomo
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Section of Neurology, Department of Medicine and Surgery, University of Perugia, Perugia, Italy
| | - Steffen Halbgebauer
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Neurology, University of Ulm, Ulm, Germany; German Center for Neurodegenerative Diseases (DZNE e.V.), Ulm, Germany
| | - Sylvain Lehmann
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; LBPC-PPC, IRMB CHU Montpellier, INM INSERM, Université de Montpellier, Montpellier, France
| | - Anna Månberg
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Division of Affinity Proteomics, Department of Protein Science, KTH Royal Institute of Technology, SciLifeLab, Stockholm, Sweden
| | - Peter Nilsson
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Division of Affinity Proteomics, Department of Protein Science, KTH Royal Institute of Technology, SciLifeLab, Stockholm, Sweden
| | - Markus Otto
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Neurology, University of Ulm, Ulm, Germany; Department of Neurology, Martin-Luther-University Halle-Wittenberg, Halle, Germany
| | - Eugeen Vanmechelen
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; ADx NeuroSciences, Gent, Belgium
| | - Inge M W Verberk
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Neurochemistry Lab, Department of Laboratory Medicine, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit, Amsterdam, Netherlands
| | - Eline Willemse
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Neurochemistry Lab, Department of Laboratory Medicine, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit, Amsterdam, Netherlands
| | - Henrik Zetterberg
- MIRIADE Consortium, Multiomics Interdisciplinary Research Integration to Address DEmentia diagnosis, Amsterdam, The Netherlands; Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, The Sahlgrenska Academy at the University of Gothenburg, Mölndal, Sweden; Clinical Neurochemistry Laboratory, Sahlgrenska University Hospital, Mölndal, Sweden; Department of Neurodegenerative Disease, UCL Institute of Neurology, London, UK; UK Dementia Research Institute at UCL, London, UK; Hong Kong Center for Neurodegenerative Diseases, Clear Water Bay, Hong Kong, China; Wisconsin Alzheimer's Disease Research Center, University of Wisconsin School of Medicine and Public Health, University of Wisconsin-Madison, Madison, Wisconsin, USA
| |
Collapse
|
3
|
Abstract
The ubiquitous availability of genome sequencing data explains the popularity of machine learning-based methods for the prediction of protein properties from their amino acid sequences. Over the years, while revising our own work, reading submitted manuscripts as well as published papers, we have noticed several recurring issues, which make some reported findings hard to understand and replicate. We suspect this may be due to biologists being unfamiliar with machine learning methodology, or conversely, machine learning experts may miss some of the knowledge needed to correctly apply their methods to proteins. Here, we aim to bridge this gap for developers of such methods. The most striking issues are linked to a lack of clarity: how were annotations of interest obtained; which benchmark metrics were used; how are positives and negatives defined. Others relate to a lack of rigor: If you sneak in structural information, your method is not sequence-based; if you compare your own model to "state-of-the-art," take the best methods; if you want to conclude that some method is better than another, obtain a significance estimate to support this claim. These, and other issues, we will cover in detail. These points may have seemed obvious to the authors during writing; however, they are not always clear-cut to the readers. We also expect many of these tips to hold for other machine learning-based applications in biology. Therefore, many computational biologists who develop methods in this particular subject will benefit from a concise overview of what to avoid and what to do instead.
Collapse
Affiliation(s)
- Qingzhen Hou
- Department of Biostatistics, School of Public Health, Cheeloo College of Medicine, Shandong University, Shandong, P. R. China
- National Institute of Health Data Science of China, Shandong University, Shandong, P. R. China
| | - Katharina Waury
- Department of Computer Science, Bioinformatics Group, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - Dea Gogishvili
- Department of Computer Science, Bioinformatics Group, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| | - K. Anton Feenstra
- Department of Computer Science, Bioinformatics Group, Vrije Universiteit Amsterdam, Amsterdam, the Netherlands
| |
Collapse
|
5
|
Mavrina E, Kimble L, Waury K, Gogishvili D, Gómez de San José N, Das S, Coppens S, Fernandes Gomes B, Mravinacová S, Wojdała AL, Bolsewig K, Bayoumy S, Burtscher F, Mohaupt P, Willemse E, Teunissen C. Multi-Omics Interdisciplinary Research Integration to Accelerate Dementia Biomarker Development (MIRIADE). Front Neurol 2022; 13:890638. [PMID: 35903119 PMCID: PMC9315267 DOI: 10.3389/fneur.2022.890638] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Accepted: 05/31/2022] [Indexed: 11/13/2022] Open
Abstract
Proteomics studies have shown differential expression of numerous proteins in dementias but have rarely led to novel biomarker tests for clinical use. The Marie Curie MIRIADE project is designed to experimentally evaluate development strategies to accelerate the validation and ultimate implementation of novel biomarkers in clinical practice, using proteomics-based biomarker development for main dementias as experimental case studies. We address several knowledge gaps that have been identified in the field. First, there is the technology-translation gap of different technologies for the discovery (e.g., mass spectrometry) and the large-scale validation (e.g., immunoassays) of biomarkers. In addition, there is a limited understanding of conformational states of biomarker proteins in different matrices, which affect the selection of reagents for assay development. In this review, we aim to understand the decisions taken in the initial steps of biomarker development, which is done via an interim narrative update of the work of each ESR subproject. The results describe the decision process to shortlist biomarkers from a proteomics to develop immunoassays or mass spectrometry assays for Alzheimer's disease, Lewy body dementia, and frontotemporal dementia. In addition, we explain the approach to prepare the market implementation of novel biomarkers and assays. Moreover, we describe the development of computational protein state and interaction prediction models to support biomarker development, such as the prediction of epitopes. Lastly, we reflect upon activities involved in the biomarker development process to deduce a best-practice roadmap for biomarker development.
Collapse
Affiliation(s)
- Ekaterina Mavrina
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,KIN Center for Digital Innovation, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Leighann Kimble
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,KIN Center for Digital Innovation, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Katharina Waury
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Centre for Integrative Bioinformatics VU (IBIVU) – Center for Integrative Bioinformatics, Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Dea Gogishvili
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Centre for Integrative Bioinformatics VU (IBIVU) – Center for Integrative Bioinformatics, Department of Computer Science, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Nerea Gómez de San José
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Department of Neurology, University of Ulm, Ulm, Germany
| | - Shreyasee Das
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,ADx NeuroSciences, Gent, Belgium
| | - Salomé Coppens
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,National Measurement Laboratory at Laboratory of the Government Chemist (LGC), Teddington, United Kingdom
| | - Bárbara Fernandes Gomes
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Department of Psychiatry and Neurochemistry, Institute of Neuroscience and Physiology, the Sahlgrenska Academy at the University of Gothenburg, Mölndal, Sweden
| | - Sára Mravinacová
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Division of Affinity Proteomics, Department of Protein Science, Kungliga Tekniska Högskolan (KTH) Royal Institute of Technology, SciLifeLab, Stockholm, Sweden
| | - Anna Lidia Wojdała
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Laboratory of Clinical Neurochemistry, Department of Medicine and Surgery, University of Perugia, Perugia, Italy
| | - Katharina Bolsewig
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Sherif Bayoumy
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Felicia Burtscher
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Luxembourg Centre for Systems Biomedicine, University of Luxembourg, Esch-sur-Alzette, Luxembourg
| | - Pablo Mohaupt
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Institute for Regenerative Medicine and Biotherapy - Plateforme de Protéomique Clinique (IRMB-PPC), Institute for Neurosciences of Montpellier (INM), Université de Montpellier, Centre Hospitalier Universitaire de Montpellier, Institut National de la Santé et de la Recherche Médicale (INSERM) Centre National de la Recherche Scientifique (CNRS), Montpellier, France
| | - Eline Willemse
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
| | - Charlotte Teunissen
- MIRIADE Consortium: Multiomics Interdisciplinary Research Integration to Address DEmentia Diagnosis,Neurochemistry Laboratory, Department of Clinical Chemistry, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam, Netherlands,*Correspondence: Charlotte Teunissen
| | | |
Collapse
|
6
|
Hou Q, Stringer B, Waury K, Capel H, Haydarlou R, Xue F, Abeln S, Heringa J, Feenstra KA. SeRenDIP-CE: Sequence-based Interface Prediction for Conformational Epitopes. Bioinformatics 2021; 37:3421-3427. [PMID: 33974039 PMCID: PMC8136078 DOI: 10.1093/bioinformatics/btab321] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Revised: 03/26/2021] [Accepted: 04/26/2021] [Indexed: 11/21/2022] Open
Abstract
Motivation Antibodies play an important role in clinical research and biotechnology, with their specificity determined by the interaction with the antigen’s epitope region, as a special type of protein–protein interaction (PPI) interface. The ubiquitous availability of sequence data, allows us to predict epitopes from sequence in order to focus time-consuming wet-lab experiments toward the most promising epitope regions. Here, we extend our previously developed sequence-based predictors for homodimer and heterodimer PPI interfaces to predict epitope residues that have the potential to bind an antibody. Results We collected and curated a high quality epitope dataset from the SAbDab database. Our generic PPI heterodimer predictor obtained an AUC-ROC of 0.666 when evaluated on the epitope test set. We then trained a random forest model specifically on the epitope dataset, reaching AUC 0.694. Further training on the combined heterodimer and epitope datasets, improves our final predictor to AUC 0.703 on the epitope test set. This is better than the best state-of-the-art sequence-based epitope predictor BepiPred-2.0. On one solved antibody–antigen structure of the COVID19 virus spike receptor binding domain, our predictor reaches AUC 0.778. We added the SeRenDIP-CE Conformational Epitope predictors to our webserver, which is simple to use and only requires a single antigen sequence as input, which will help make the method immediately applicable in a wide range of biomedical and biomolecular research. Availability and implementation Webserver, source code and datasets at www.ibi.vu.nl/programs/serendipwww/. Supplementary information Supplementary data are available at Bioinformatics online.
Collapse
Affiliation(s)
- Qingzhen Hou
- Department of Biostatistics, School of Public Health, Cheeloo College of Medicine, Shandong University, Shandong 250002, P. R. China.,National institute of health data science of China, Shandong University, Shandong 250002, P. R. China
| | - Bas Stringer
- IBIVU - Center for Integrative Bioinformatics, Vrije Universiteit Amsterdam, Amsterdam 1081HV, The Netherlands
| | - Katharina Waury
- IBIVU - Center for Integrative Bioinformatics, Vrije Universiteit Amsterdam, Amsterdam 1081HV, The Netherlands
| | - Henriette Capel
- IBIVU - Center for Integrative Bioinformatics, Vrije Universiteit Amsterdam, Amsterdam 1081HV, The Netherlands
| | - Reza Haydarlou
- IBIVU - Center for Integrative Bioinformatics, Vrije Universiteit Amsterdam, Amsterdam 1081HV, The Netherlands
| | - Fuzhong Xue
- Department of Biostatistics, School of Public Health, Cheeloo College of Medicine, Shandong University, Shandong 250002, P. R. China.,National institute of health data science of China, Shandong University, Shandong 250002, P. R. China
| | - Sanne Abeln
- IBIVU - Center for Integrative Bioinformatics, Vrije Universiteit Amsterdam, Amsterdam 1081HV, The Netherlands
| | - Jaap Heringa
- IBIVU - Center for Integrative Bioinformatics, Vrije Universiteit Amsterdam, Amsterdam 1081HV, The Netherlands.,AIMMS - Amsterdam Institute for Molecules Medicines and Systems, Vrije Universiteit Amsterdam
| | - K Anton Feenstra
- IBIVU - Center for Integrative Bioinformatics, Vrije Universiteit Amsterdam, Amsterdam 1081HV, The Netherlands.,AIMMS - Amsterdam Institute for Molecules Medicines and Systems, Vrije Universiteit Amsterdam
| |
Collapse
|