1
|
Bantis LE, Brewer B, Nakas CT, Reiser B. Statistical Inference for Box-Cox based Receiver Operating Characteristic Curves. Stat Med 2024; 43:6099-6122. [PMID: 39551723 PMCID: PMC11957834 DOI: 10.1002/sim.10252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2023] [Revised: 08/14/2024] [Accepted: 10/03/2024] [Indexed: 11/19/2024]
Abstract
Receiver operating characteristic (ROC) curve analysis is widely used in evaluating the effectiveness of a diagnostic test/biomarker or classifier score. A parametric approach for statistical inference on ROC curves based on a Box-Cox transformation to normality has frequently been discussed in the literature. Many investigators have highlighted the difficulty of taking into account the variability of the estimated transformation parameter when carrying out such an analysis. This variability is often ignored and inferences are made by considering the estimated transformation parameter as fixed and known. In this paper, we will review the literature discussing the use of the Box-Cox transformation for ROC curves and the methodology for accounting for the estimation of the Box-Cox transformation parameter in the context of ROC analysis, and detail its application to a number of problems. We present a general framework for inference on any functional of interest, including common measures such as the AUC, the Youden index, and the sensitivity at a given specificity (and vice versa). We further developed a new R package (named 'rocbc') that carries out all discussed approaches and is available in CRAN.
Collapse
Affiliation(s)
- Leonidas E. Bantis
- Dept. of Biostatistics and Data Science, University of Kansas Medical Center, KS, U.S.A
| | - Benjamin Brewer
- Dept. of Biostatistics and Data Science, University of Kansas Medical Center, KS, U.S.A
| | - Christos T. Nakas
- Laboratory of Biometry, Department of Agriculture Crop Production and Rural Environment, School of Agricultural Sciences,, University of Thessaly, Fytokou Street, 38446 Volos, Greece, Greece
- Institute of Clinical Chemistry, Inselspital, Bern University Hospital, University of Bern, 3010 Bern, Switzerland
| | - Benjamin Reiser
- Dept. of Statistics, University of Haifa, Haifa 31905, Israel
| |
Collapse
|
2
|
Applied Proteomics in 'One Health'. Proteomes 2021; 9:proteomes9030031. [PMID: 34208880 PMCID: PMC8293331 DOI: 10.3390/proteomes9030031] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Revised: 06/24/2021] [Accepted: 06/25/2021] [Indexed: 12/19/2022] Open
Abstract
‘One Health’ summarises the idea that human health and animal health are interdependent and bound to the health of ecosystems. The purpose of proteomics methodologies and studies is to determine proteins present in samples of interest and to quantify changes in protein expression during pathological conditions. The objectives of this paper are to review the application of proteomics technologies within the One Health concept and to appraise their role in the elucidation of diseases and situations relevant to One Health. The paper develops in three sections. Proteomics Applications in Zoonotic Infections part discusses proteomics applications in zoonotic infections and explores the use of proteomics for studying pathogenetic pathways, transmission dynamics, diagnostic biomarkers and novel vaccines in prion, viral, bacterial, protozoan and metazoan zoonotic infections. Proteomics Applications in Antibiotic Resistance part discusses proteomics applications in mechanisms of resistance development and discovery of novel treatments for antibiotic resistance. Proteomics Applications in Food Safety part discusses the detection of allergens, exposure of adulteration, identification of pathogens and toxins, study of product traits and characterisation of proteins in food safety. Sensitive analysis of proteins, including low-abundant ones in complex biological samples, will be achieved in the future, thus enabling implementation of targeted proteomics in clinical settings, shedding light on biomarker research and promoting the One Health concept.
Collapse
|
3
|
Meling S, Skovgaard K, Bårdsen K, Helweg Heegaard PM, Ulvund MJ. Expression of selected genes isolated from whole blood, liver and obex in lambs with experimental classical scrapie and healthy controls, showing a systemic innate immune response at the clinical end-stage. BMC Vet Res 2018; 14:281. [PMID: 30208891 PMCID: PMC6134718 DOI: 10.1186/s12917-018-1607-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2018] [Accepted: 08/31/2018] [Indexed: 12/30/2022] Open
Abstract
BACKGROUND Incubation period, disease progression, pathology and clinical presentation of classical scrapie in sheep are highly dependent on PRNP genotype, time and route of inoculation and prion strain. Our experimental model with pre-colostrum inoculation of homozygous VRQ lambs has shown to be an effective model with extensive PrPSc dissemination in lymphatic tissue and a short incubation period with severe clinical disease. Serum protein analysis has shown an elevation of acute phase proteins in the clinical stages of this experimental model, and here, we investigate changes in gene expression in whole blood, liver and brain. RESULTS The animals in the scrapie group showed severe signs of illness 22 weeks post inoculation necessitating euthanasia at 23 weeks post inoculation. This severe clinical presentation was accompanied by changes in expression of several genes. The following genes were differentially expressed in whole blood: TLR2, TLR4, C3, IL1B, LF and SAA, in liver tissue, the following genes differentially expressed: TNF-α, SAA, HP, CP, AAT, TTR and TF, and in the brain tissue, the following genes were differentially expressed: HP, CP, ALB and TTR. CONCLUSIONS We report a strong and evident transcriptional innate immune response in the terminal stage of classical scrapie in these animals. The PRNP genotype and time of inoculation are believed to contribute to the clinical presentation, including the extensive dissemination of PrPSc throughout the lymphatic tissue.
Collapse
Affiliation(s)
- Siv Meling
- Faculty of Veterinary Medicine, Norwegian University of Life Sciences, Sandnes, Norway
| | - Kerstin Skovgaard
- Department of Biotechnology and Biomedicine, Technical University of Denmark, Kemitorvet, 2800 Lyngby, Denmark
| | - Kjetil Bårdsen
- Faculty of Veterinary Medicine, Norwegian University of Life Sciences, Sandnes, Norway
| | | | - Martha J. Ulvund
- Faculty of Veterinary Medicine, Norwegian University of Life Sciences, Sandnes, Norway
| |
Collapse
|
4
|
Chemonges S, Gupta R, Mills PC, Kopp SR, Sadowski P. Characterisation of the circulating acellular proteome of healthy sheep using LC-MS/MS-based proteomics analysis of serum. Proteome Sci 2017; 15:11. [PMID: 28615994 PMCID: PMC5466729 DOI: 10.1186/s12953-017-0119-z] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2016] [Accepted: 06/02/2017] [Indexed: 12/29/2022] Open
Abstract
BACKGROUND Unlike humans, there is currently no publicly available reference mass spectrometry-based circulating acellular proteome data for sheep, limiting the analysis and interpretation of a range of physiological changes and disease states. The objective of this study was to develop a robust and comprehensive method to characterise the circulating acellular proteome in ovine serum. METHODS Serum samples from healthy sheep were subjected to shotgun proteomic analysis using nano liquid chromatography nano electrospray ionisation tandem mass spectrometry (nanoLC-nanoESI-MS/MS) on a quadrupole time-of-flight instrument (TripleTOF® 5600+, SCIEX). Proteins were identified using ProteinPilot™ (SCIEX) and Mascot (Matrix Science) software based on a minimum of two unmodified highly scoring unique peptides per protein at a false discovery rate (FDR) of 1% software by searching a subset of the Universal Protein Resource Knowledgebase (UniProtKB) database (http://www.uniprot.org). PeptideShaker (CompOmics, VIB-UGent) searches were used to validate protein identifications from ProteinPilot™ and Mascot. RESULTS ProteinPilot™ and Mascot identified 245 and 379 protein groups (IDs), respectively, and PeptideShaker validated 133 protein IDs from the entire dataset. Since Mascot software is considered the industry standard and identified the most proteins, these were analysed using the Protein ANalysis THrough Evolutionary Relationships (PANTHER) classification tool revealing the association of 349 genes with 127 protein pathway hits. These data are available via ProteomeXchange with identifier PXD004989. CONCLUSIONS These results demonstrated for the first time the feasibility of characterising the ovine circulating acellular proteome using nanoLC-nanoESI-MS/MS. This peptide spectral data contributes to a protein library that can be used to identify a wide range of proteins in ovine serum.
Collapse
Affiliation(s)
- Saul Chemonges
- School of Veterinary Science, The University of Queensland, Gatton, Australia
| | - Rajesh Gupta
- Proteomics and Small Molecule Mass Spectrometry, Central Analytical Research Facility, Queensland University of Technology, Brisbane, Australia
| | - Paul C. Mills
- School of Veterinary Science, The University of Queensland, Gatton, Australia
| | - Steven R. Kopp
- School of Veterinary Science, The University of Queensland, Gatton, Australia
| | - Pawel Sadowski
- Proteomics and Small Molecule Mass Spectrometry, Central Analytical Research Facility, Queensland University of Technology, Brisbane, Australia
| |
Collapse
|
5
|
Diseases of the Nervous System. Vet Med (Auckl) 2017. [PMCID: PMC7322266 DOI: 10.1016/b978-0-7020-5246-0.00014-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
6
|
West Greenlee MH, Lind M, Kokemuller R, Mammadova N, Kondru N, Manne S, Smith J, Kanthasamy A, Greenlee J. Temporal Resolution of Misfolded Prion Protein Transport, Accumulation, Glial Activation, and Neuronal Death in the Retinas of Mice Inoculated with Scrapie. THE AMERICAN JOURNAL OF PATHOLOGY 2016; 186:2302-9. [PMID: 27521336 PMCID: PMC5012505 DOI: 10.1016/j.ajpath.2016.05.018] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2016] [Revised: 05/17/2016] [Accepted: 05/23/2016] [Indexed: 12/14/2022]
Abstract
Currently, there is a lack of pathological landmarks to describe the progression of prion disease in vivo. Our goal was to use an experimental model to determine the temporal relationship between the transport of misfolded prion protein (PrP(Sc)) from the brain to the retina, the accumulation of PrP(Sc) in the retina, the response of the surrounding retinal tissue, and loss of neurons. Retinal samples from mice inoculated with RML scrapie were collected at 30, 60, 90, 105, and 120 days post inoculation (dpi) or at the onset of clinical signs of disease (153 dpi). Retinal homogenates were tested for prion seeding activity. Antibody staining was used to assess accumulation of PrP(Sc) and the resulting response of retinal tissue. Loss of photoreceptors was used as a measure of neuronal death. PrP(Sc) seeding activity was first detected in all samples at 60 dpi. Accumulation of PrP(Sc) and coincident activation of retinal glia were first detected at 90 dpi. Activation of microglia was first detected at 105 dpi, but neuronal death was not detectable until 120 dpi. Our results demonstrate that by using the retina we can resolve the temporal separation between several key events in the pathogenesis of prion disease.
Collapse
Affiliation(s)
- M Heather West Greenlee
- Department of Biomedical Sciences, Iowa State University College of Veterinary Medicine, Ames, Iowa; Virus and Prion Disease Unit, National Animal Disease Center, US Department of Agriculture, Ames, Iowa.
| | - Melissa Lind
- Department of Biomedical Sciences, Iowa State University College of Veterinary Medicine, Ames, Iowa
| | - Robyn Kokemuller
- Virus and Prion Disease Unit, National Animal Disease Center, US Department of Agriculture, Ames, Iowa
| | - Najiba Mammadova
- Virus and Prion Disease Unit, National Animal Disease Center, US Department of Agriculture, Ames, Iowa
| | - Naveen Kondru
- Department of Biomedical Sciences, Iowa State University College of Veterinary Medicine, Ames, Iowa
| | - Sireesha Manne
- Department of Biomedical Sciences, Iowa State University College of Veterinary Medicine, Ames, Iowa
| | - Jodi Smith
- Virus and Prion Disease Unit, National Animal Disease Center, US Department of Agriculture, Ames, Iowa
| | - Anumantha Kanthasamy
- Department of Biomedical Sciences, Iowa State University College of Veterinary Medicine, Ames, Iowa
| | - Justin Greenlee
- Virus and Prion Disease Unit, National Animal Disease Center, US Department of Agriculture, Ames, Iowa
| |
Collapse
|
7
|
Katsafadou A, Tsangaris G, Billinis C, Fthenakis G. Use of proteomics in the study of microbial diseases of small ruminants. Vet Microbiol 2015; 181:27-33. [DOI: 10.1016/j.vetmic.2015.07.017] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
8
|
Abdel-Haq H. Factors intrinsic and extrinsic to blood hamper the development of a routine blood test for human prion diseases. J Gen Virol 2015; 96:479-493. [DOI: 10.1099/vir.0.070979-0] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Affiliation(s)
- Hanin Abdel-Haq
- Department of Cell Biology and Neurosciences, Istituto Superiore di Sanità, Viale Regina Elena, 299, 00161-Rome, Italy
| |
Collapse
|
9
|
Silva CJ. Applying the tools of chemistry (mass spectrometry and covalent modification by small molecule reagents) to the detection of prions and the study of their structure. Prion 2015; 8:42-50. [PMID: 24509645 DOI: 10.4161/pri.27891] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022] Open
Abstract
Prions are molecular pathogens, able to convert a normal cellular prion protein (PrP(C)) into a prion (PrP(Sc)). The information necessary for this conversion is contained in the conformation of PrP(Sc). Mass spectrometry (MS) and small-molecule covalent reactions have been used to study prions. Mass spectrometry has been used to detect and quantitate prions in the attomole range (10⁻¹⁸ mole). MS-based analysis showed that both possess identical amino acid sequences, one disulfide bond, a GPI anchor, asparagine-linked sugar antennae, and unoxidized methionines. Mass spectrometry has been used to define elements of the secondary and tertiary structure of wild-type PrP(Sc) and GPI-anchorless PrP(Sc). It has also been used to study the quaternary structure of the PrP(Sc) multimer. Small molecule reagents react differently with the same lysine in the PrP(C) conformation than in the PrP(Sc) conformation. Such differences can be detected by Western blot using mAbs with lysine-containing epitopes, such as 3F4 and 6D11. This permits the detection of PrP(Sc) without the need for proteinase K pretreatment and can be used to distinguish among prion strains. These results illustrate how two important chemical tools, mass spectrometry and covalent modification by small molecules, are being applied to the detection and structural study of prions. Furthermore these tools are or can be applied to the study of the other protein misfolding diseases such as Alzheimer Disease, Parkinson Disease, or ALS.
Collapse
|
10
|
Meling S, Kvalheim OM, Arneberg R, Bårdsen K, Hjelle A, Ulvund MJ. Investigation of serum protein profiles in scrapie infected sheep by means of SELDI-TOF-MS and multivariate data analysis. BMC Res Notes 2013; 6:466. [PMID: 24229425 PMCID: PMC3843553 DOI: 10.1186/1756-0500-6-466] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2013] [Accepted: 11/04/2013] [Indexed: 01/18/2023] Open
Abstract
Background Classical scrapie in sheep is a fatal neurodegenerative disease associated with the conversion PrPC to PrPSc. Much is known about genetic susceptibility, uptake and dissemination of PrPSc in the body, but many aspects of prion diseases are still unknown. Different proteomic techniques have been used during the last decade to investigate differences in protein profiles between affected animals and healthy controls. We have investigated the protein profiles in serum of sheep with scrapie and healthy controls by SELDI-TOF-MS and LC-MS/MS. Latent Variable methods such as Principal Component Analysis, Partial Least Squares-Discriminant Analysis and Target Projection methods were used to describe the MS data. Results The serum proteomic profiles showed variable differences between the groups both throughout the incubation period and at the clinical end stage of scrapie. At the end stage, the target projection model separated the two groups with a sensitivity of 97.8%, and serum amyloid A was identified as one of the protein peaks that differed significantly between the groups. Conclusions At the clinical end stage of classical scrapie, ten SELDI peaks significantly discriminated the scrapie group from the healthy controls. During the non-clinical incubation period, individual SELDI peaks were differently expressed between the groups at different time points. Investigations of differences in -omic profiles can contribute to new insights into the underlying disease processes and pathways, and advance our understanding of prion diseases, but comparison and validation across laboratories is difficult and challenging.
Collapse
Affiliation(s)
- Siv Meling
- Department of Production Animal Clinical Sciences, Section for Small Ruminant Research, Norwegian School of Veterinary Science, Kyrkjevegen 332-334, N-4325, Sandnes, Norway.
| | | | | | | | | | | |
Collapse
|
11
|
Ma D, Li L. Searching for reliable premortem protein biomarkers for prion diseases: progress and challenges to date. Expert Rev Proteomics 2013; 9:267-80. [PMID: 22809206 DOI: 10.1586/epr.12.20] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
Prion diseases are a unique family of fatal neurodegenerative diseases caused by abnormal folding of normal cellular prion proteins in the brain. Due to the high risk of prion disease transmission and the lack of effective treatment to cure or delay the disease progression, prion diseases pose a serious threat to public health. To control and prevent prion diseases, an early diagnosis is urgently needed. Proteomic analysis has emerged as a powerful technology to decipher biological and pathophysiological processes and identify protein biomarkers indicative of disease. In this article, the authors review the use of the latest proteomic technologies for the identification of promising prion disease biomarkers, the challenges that exist in biomarker development pipelines and the new directions for utilizing proteomics for future biomarker discovery in the context of prion disease diagnostics.
Collapse
Affiliation(s)
- Di Ma
- School of Pharmacy, University of Wisconsin at Madison, 777 Highland Avenue, Madison, WI 53705, USA
| | | |
Collapse
|
12
|
Demeler J, Schein E, von Samson-Himmelstjerna G. Advances in laboratory diagnosis of parasitic infections of sheep. Vet Parasitol 2012; 189:52-64. [DOI: 10.1016/j.vetpar.2012.03.032] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023]
|
13
|
Meling S, Bårdsen K, Ulvund MJ. Presence of an acute phase response in sheep with clinical classical scrapie. BMC Vet Res 2012; 8:113. [PMID: 22805457 PMCID: PMC3410797 DOI: 10.1186/1746-6148-8-113] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2012] [Accepted: 07/17/2012] [Indexed: 01/08/2023] Open
Abstract
Background Work with experimental scrapie in sheep has been performed on-site for many years including studies on PrPSc dissemination and histopathology of organs and tissues both at preclinical and clinical stages. In this work serum was sampled at regular intervals from lambs which were infected immediately after birth and from parallel healthy controls, and examined for acute phase proteins. In contrast to earlier experiments, which extensively studied PrPSc dissemination and histopathology in peripheral tissues and brain, this experiment is focusing on examination of serum for non-PrPSc markers that discriminates the two groups, and give insight into other on-going processes detectable in serum samples. Results There was clear evidence of an acute phase response in sheep with clinical scrapie, both experimental and natural. All the three proteins, ceruloplasmin, haptoglobin and serum amyloid A, were increased at the clinical stage of scrapie. Conclusion There was evidence of a systemic measurable acute phase response at the clinical terminal end-stage of classical scrapie.
Collapse
Affiliation(s)
- Siv Meling
- Norwegian School of Veterinary Science, Department of Production Animal Clinical Sciences, Section for Small Ruminant Research, Kyrkjevegen 332-334, N-4325, Sandnes, Norway.
| | | | | |
Collapse
|
14
|
Koene MGJ, Mulder HA, Stockhofe-Zurwieden N, Kruijt L, Smits MA. Serum protein profiles as potential biomarkers for infectious disease status in pigs. BMC Vet Res 2012; 8:32. [PMID: 22439879 PMCID: PMC3342896 DOI: 10.1186/1746-6148-8-32] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2011] [Accepted: 03/22/2012] [Indexed: 01/02/2023] Open
Abstract
Background In veterinary medicine and animal husbandry, there is a need for tools allowing the early warning of diseases. Preferably, tests should be available that warn farmers and veterinarians during the incubation periods of disease and before the onset of clinical signs. The objective of this study was to explore the potential of serum protein profiles as an early biomarker for infectious disease status. Serum samples were obtained from an experimental pig model for porcine circovirus-associated disease (PCVAD), consisting of Porcine Circovirus type 2 (PCV2) infection in combination with either Porcine Parvovirus (PPV) or Porcine Reproductive and Respiratory Syndrome virus (PRRSV). Sera were collected before and after onset of clinical signs at day 0, 5 and 19 post infection. Serum protein profiles were evaluated against sera from non-infected control animals. Results Protein profiles were generated by SELDI-TOF mass spectrometry in combination with the Proteominer™ technology to enrich for low-abundance proteins. Based on these protein profiles, the experimentally infected pigs could be classified according to their infectious disease status. Before the onset of clinical signs 88% of the infected animals could be classified correctly, after the onset of clinical sigs 93%. The sensitivity of the classification appeared to be high. The protein profiles could distinguish between separate infection models, although specificity was moderate to low. Classification of PCV2/PRRSV infected animals was superior compared to PCV2/PPV infected animals. Limiting the number of proteins in the profiles (ranging from 568 to 10) had only minor effects on the classification performance. Conclusions This study shows that serum protein profiles have potential for detection and identification of viral infections in pigs before clinical signs of the disease become visible.
Collapse
Affiliation(s)
- Miriam G J Koene
- Central Veterinary Institute of Wageningen UR, Lelystad, the Netherlands.
| | | | | | | | | |
Collapse
|