1
|
Caetano DS, Quental TB. How Important Is Budding Speciation for Comparative Studies? Syst Biol 2023; 72:1443-1453. [PMID: 37586404 DOI: 10.1093/sysbio/syad050] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Revised: 07/26/2023] [Accepted: 08/16/2023] [Indexed: 08/18/2023] Open
Abstract
The acknowledgment of evolutionary dependence among species has fundamentally changed how we ask biological questions. Phylogenetic models became the standard approach for studies with 3 or more lineages, in particular those using extant species. Most phylogenetic comparative methods (PCMs) translate relatedness into covariance, meaning that evolutionary changes before lineages split should be interpreted together whereas after the split lineages are expected to change independently. This clever realization has shaped decades of research. Here, we discuss one element of the comparative method often ignored or assumed as unimportant: if nodes of a phylogeny represent the dissolution of the ancestral lineage into two new ones or if the ancestral lineage can survive speciation events (i.e., budding). Budding speciation is often reported in paleontological studies, due to the nature of the evidence for budding in the fossil record, but it is surprisingly absent in comparative methods. Here, we show that many PCMs assume that divergence happens as a symmetric split, even if these methods do not explicitly mention this assumption. We discuss the properties of trait evolution models for continuous and discrete traits and their adequacy under a scenario of budding speciation. We discuss the effects of budding speciation under a series of plausible evolutionary scenarios and show when and how these can influence our estimates. We also propose that long-lived lineages that have survived through a series of budding speciation events and given birth to multiple new lineages can produce evolutionary patterns that challenge our intuition about the most parsimonious history of trait changes in a clade. We hope our discussion can help bridge comparative approaches in paleontology and neontology as well as foster awareness about the assumptions we make when we use phylogenetic trees.
Collapse
Affiliation(s)
- Daniel S Caetano
- Department of Biological Sciences, Towson University, 8000 York Road, Towson, MD 21252, USA
- Department of Ecology, University of São Paulo, Rua do Matão, 321 - Trav. 14, São Paulo, SP, 05508-090, Brazil
| | - Tiago B Quental
- Department of Ecology, University of São Paulo, Rua do Matão, 321 - Trav. 14, São Paulo, SP, 05508-090, Brazil
| |
Collapse
|
2
|
Boyko JD, Beaulieu JM. Reducing the biases in false correlations between discrete characters. Syst Biol 2022:6730956. [PMID: 36173613 DOI: 10.1093/sysbio/syac066] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Indexed: 11/12/2022] Open
Abstract
The correlation between two characters is often interpreted as evidence that there exists a significant and biologically important relationship between them. However, Maddison and FitzJohn (2015) recently pointed out that evidence of correlated evolution between two categorical characters is often spurious, particularly, when the dependent relationship stems from a single replicate deep in time. Here we will show that there may, in fact, be a statistical solution to the problem posed by Maddison and FitzJohn (2015) naturally embedded within the expanded model space afforded by the hidden Markov model (HMM) framework. We demonstrate that the problem of single unreplicated evolutionary events manifests itself as rate heterogeneity within our models and that this is the source of the false correlation. Therefore, we argue that this problem is better understood as model misspecification rather than a failure of comparative methods to account for phylogenetic pseudoreplication. We utilize HMMs to develop a multi-rate independent model which, when implemented, drastically reduces support for correlation. The problem itself extends beyond categorical character evolution, but we believe that the practical solution presented here may lend itself to future extensions in other areas of comparative biology.
Collapse
Affiliation(s)
- James D Boyko
- Department of Biological Sciences, University of Arkansas, Fayetteville, Arkansas, 72701 USA
| | - Jeremy M Beaulieu
- Department of Biological Sciences, University of Arkansas, Fayetteville, Arkansas, 72701 USA
| |
Collapse
|
3
|
Egrioglu E, Bas E. A new automatic forecasting method based on a new input significancy test of a single multiplicative neuron model artificial neural network. Network 2022; 33:1-16. [PMID: 35196948 DOI: 10.1080/0954898x.2022.2042609] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Revised: 02/10/2022] [Accepted: 02/10/2022] [Indexed: 06/14/2023]
Abstract
The model adequacy and input significance tests have not been proposed as features for the specification of a single multiplicative neuron model artificial neural networks in the literature. Moreover, there is no systematic approach based on hypothesis tests for using single multiplicative neuron model artificial neural networks for forecasting purposes like classical time series forecasting methods. In this study, new methods are proposed to solve these problems. The performance of the proposed test procedures is investigated in a simulation study. According to simulation results, the proposed tests have very good performance. Moreover, the test procedures are illustrated by using two real-world examples. The second contribution of the paper is that an automatic forecasting method is proposed based on input significance and model adequacy tests and the particle swarm optimization-based learning algorithm. The proposed automatic forecasting method is applied to M4 competition hourly data sets, and it is the best pure machine learning method among others in the competition. The proposed automatic forecasting method is more accurate than all benchmarks, such as MLP, RNN, and ETS, which were proposed by the competition organizers.
Collapse
Affiliation(s)
- Erol Egrioglu
- Department of Statistics, Faculty of Arts and Science, Giresun University, Giresun, Turkey
| | - Eren Bas
- Department of Statistics, Faculty of Arts and Science, Giresun University, Giresun, Turkey
| |
Collapse
|
4
|
Carstens BC, Smith ML, Duckett DJ, Fonseca EM, Thomé MTC. Assessing model adequacy leads to more robust phylogeographic inference. Trends Ecol Evol 2022; 37:402-410. [PMID: 35027224 DOI: 10.1016/j.tree.2021.12.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2021] [Revised: 12/06/2021] [Accepted: 12/14/2021] [Indexed: 11/29/2022]
Abstract
Phylogeographic studies base inferences on large data sets and complex demographic models, but these models are applied in ways that could mislead researchers and compromise their inference. Researchers face three challenges associated with the use of models: (i) 'model selection', or the identification of an appropriate model for analysis; (ii) 'evaluation of analytical results', or the interpretation of the biological significance of the resulting parameter estimates, delimitations, and topologies; and (iii) 'model evaluation', or the use of statistical approaches to assess the fit of the model to the data. The field collectively invests most of its energy in point (ii) without considering the other points; we argue that attention to points (i) and (iii) is essential to phylogeographic inference.
Collapse
Affiliation(s)
- Bryan C Carstens
- Department of Evolution, Ecology, and Organismal Biology at The Ohio State University, Columbus, OH, USA.
| | - Megan L Smith
- Department of Biology, Indiana University, Bloomington, IN, USA
| | - Drew J Duckett
- Department of Evolution, Ecology, and Organismal Biology at The Ohio State University, Columbus, OH, USA
| | - Emanuel M Fonseca
- Department of Evolution, Ecology, and Organismal Biology at The Ohio State University, Columbus, OH, USA
| | - M Tereza C Thomé
- Department of Evolution, Ecology, and Organismal Biology at The Ohio State University, Columbus, OH, USA
| |
Collapse
|
5
|
Rice A, Mayrose I. Model adequacy tests for probabilistic models of chromosome-number evolution. New Phytol 2021; 229:3602-3613. [PMID: 33226654 DOI: 10.1111/nph.17106] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/02/2020] [Accepted: 11/18/2020] [Indexed: 05/29/2023]
Abstract
Chromosome number is a central feature of eukaryote genomes. Deciphering patterns of chromosome-number change along a phylogeny is central to the inference of whole genome duplications and ancestral chromosome numbers. ChromEvol is a probabilistic inference tool that allows the evaluation of several models of chromosome-number evolution and their fit to the data. However, fitting a model does not necessarily mean that the model describes the empirical data adequately. This vulnerability may lead to incorrect conclusions when model assumptions are not met by real data. Here, we present a model adequacy test for likelihood models of chromosome-number evolution. The procedure allows us to determine whether the model can generate data with similar characteristics as those found in the observed ones. We demonstrate that using inadequate models can lead to inflated errors in several inference tasks. Applying the developed method to 200 angiosperm genera, we find that in many of these, the best-fitting model provides poor fit to the data. The inadequacy rate increases in large clades or in those in which hybridizations are present. The developed model adequacy test can help researchers to identify phylogenies whose underlying evolutionary patterns deviate substantially from current modelling assumptions and should guide future methods development.
Collapse
Affiliation(s)
- Anna Rice
- School of Plant Sciences and Food Security, George S. Wise Faculty of Life Sciences, Tel Aviv University, Tel Aviv, 69978, Israel
| | - Itay Mayrose
- School of Plant Sciences and Food Security, George S. Wise Faculty of Life Sciences, Tel Aviv University, Tel Aviv, 69978, Israel
| |
Collapse
|
6
|
Bromham L, Hua X, Cardillo M. Macroevolutionary and macroecological approaches to understanding the evolution of stress tolerance in plants. Plant Cell Environ 2020; 43:2832-2846. [PMID: 32705700 DOI: 10.1111/pce.13857] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/08/2020] [Revised: 06/26/2020] [Accepted: 07/05/2020] [Indexed: 05/24/2023]
Abstract
Environmental stress response in plants has been studied using a wide range of approaches, from lab-based investigation of biochemistry and genetics, to glasshouse studies of physiology and growth rates, to field-based trials and ecological surveys. It is also possible to investigate the evolution of environmental stress responses using macroevolutionary and macroecological analyses, analysing data from many different species, providing a new perspective on the way that environmental stress shapes the evolution and distribution of biodiversity. "Macroevoeco" approaches can produce intriguing results and new ways of looking at old problems. In this review, we focus on studies using phylogenetic analysis to illuminate macroevolutionary patterns in the evolution of environmental stress tolerance in plants. We follow a particular thread from our own research-evolution of salt tolerance-as a case study that illustrates a macroevolutionary way of thinking that opens up a range of broader questions on the evolution of environmental stress tolerances. We consider some potential future applications of macroevolutionary and macroecological analyses to understanding how diverse groups of plants evolve in response to environmental stress, which may allow better prediction of current stress tolerance and a way of predicting the capacity of species to adapt to changing environmental stresses over time.
Collapse
Affiliation(s)
- Lindell Bromham
- Macroevolution & Macroecology, Research School of Biology, Australian National University, Canberra, Australia
| | - Xia Hua
- Macroevolution & Macroecology, Research School of Biology, Australian National University, Canberra, Australia
- Mathematical Sciences Institute, Australian National University, Canberra, Australia
| | - Marcel Cardillo
- Macroevolution & Macroecology, Research School of Biology, Australian National University, Canberra, Australia
| |
Collapse
|
7
|
Abstract
In statistical phylogenetic analyses of DNA sequences, models of evolutionary change commonly assume that base composition is stationary through time and across lineages. This assumption is violated by many data sets, but it is unclear whether the magnitude of these violations is sufficient to mislead phylogenetic inference. We investigated the impacts of compositional heterogeneity on phylogenetic estimates using a method for assessing model adequacy. Based on a detailed simulation study, we found that common frequentist criteria are highly conservative, such that the model is often rejected when the phylogenetic estimates do not show clear signs of bias. We propose new criteria and provide guidelines for their usage. We apply these criteria to genome-scale data from 40 birds and find that loci with severely non-homogeneous base composition are uncommon. Our results show the importance of using well-informed diagnostic statistics when testing model adequacy for phylogenomic analyses.
Collapse
Affiliation(s)
- David A Duchêne
- School of Life and Environmental Sciences, University of Sydney, Sydney, NSW, Australia
| | - Sebastian Duchêne
- Centre for Systems Genomics, University of Melbourne, Melbourne, VIC, Australia
| | - Simon Y W Ho
- School of Life and Environmental Sciences, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
8
|
Abstract
The beta-binomial model has been widely used as an analytically tractable alternative that captures the overdispersion of an intra-correlated, binomial random variable, X. However, the model validation for X has been rarely investigated. As a beta-binomial mass function takes on a few different shapes, the model validation is examined for each of the classified shapes in this paper. Further, the mean square error (MSE) is illustrated for each shape by the maximum likelihood estimator (MLE) based on a beta-binomial model approach and the method of moments estimator (MME) in order to gauge when and how much the MLE is biased.
Collapse
Affiliation(s)
- Jongphil Kim
- Department of Biostatistics and Bioinformatics, H. Lee. Moffitt Cancer Center & Research Institute
| | - Ji-Hyun Lee
- Department of Internal Medicine, the University of New Mexico
| |
Collapse
|
9
|
Barley AJ, Thomson RC. Assessing the performance of DNA barcoding using posterior predictive simulations. Mol Ecol 2016; 25:1944-57. [PMID: 26915049 DOI: 10.1111/mec.13590] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2015] [Revised: 01/05/2016] [Accepted: 01/18/2016] [Indexed: 02/05/2023]
Abstract
Accurate estimates of biodiversity are required for research in a broad array of biological subdisciplines including ecology, evolution, systematics, conservation and biodiversity science. The use of statistical models and genetic data, particularly DNA barcoding, has been suggested as an important tool for remedying the large gaps in our current understanding of biodiversity. However, the reliability of biodiversity estimates obtained using these approaches depends on how well the statistical models that are used describe the evolutionary process underlying the genetic data. In this study, we utilize data from the Barcode of Life Database and posterior predictive simulations to assess the performance of DNA barcoding under commonly used substitution models. We demonstrate that the success of DNA barcoding varies widely across DNA substitution models and that model choice has a substantial impact on the number of operational taxonomic units identified (changing results by ~4-31%). Additionally, we demonstrate that the widely followed practice of a priori assuming the Kimura 2-parameter model for DNA barcoding is statistically unjustified and should be avoided. Using both data-based and inference-based test statistics, we detect variation in model performance across taxonomic groups, clustering algorithms, genetic divergence thresholds and substitution models. Taken together, these results illustrate the importance of considering both model selection and model adequacy in studies quantifying biodiversity.
Collapse
Affiliation(s)
- Anthony J Barley
- Department of Biology, University of Hawai'i at Mānoa, Honolulu, HI, 96822, USA
| | - Robert C Thomson
- Department of Biology, University of Hawai'i at Mānoa, Honolulu, HI, 96822, USA
| |
Collapse
|
10
|
Rabosky DL. Challenges in the estimation of extinction from molecular phylogenies: A response to Beaulieu and O'Meara. Evolution 2015; 70:218-28. [PMID: 26593734 DOI: 10.1111/evo.12820] [Citation(s) in RCA: 82] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2015] [Accepted: 11/13/2015] [Indexed: 12/15/2022]
Abstract
Time-calibrated phylogenies that contain only living species have been widely used to study the dynamics of speciation and extinction. Concerns about the reliability of phylogenetic extinction estimates were raised by Rabosky (2010), where I suggested that unaccommodated heterogeneity in speciation rate could lead to positively biased extinction estimates. In a recent article, Beaulieu and O'Meara (2015a) correctly point out several technical errors in the execution of my 2010 study and concluded that phylogenetic extinction estimates are robust to speciation rate heterogeneity under a range of model parameters. I demonstrate that Beaulieu and O'Meara underestimated the magnitude of speciation rate variation in real phylogenies and consequently did not incorporate biologically meaningful levels of rate heterogeneity into their simulations. Using parameter values drawn from the recent literature, I find that modest levels of heterogeneity in speciation rate result in a consistent, positive bias in extinction estimates that are exacerbated by phylogenetic tree size. This bias, combined with the inherent lack of information about extinction in molecular phylogenies, suggests that extinction rate estimates from phylogenies of extant taxa only should be treated with caution.
Collapse
Affiliation(s)
- Daniel L Rabosky
- Department of Ecology and Evolutionary Biology and Museum of Zoology, University of Michigan, Ann Arbor, Michigan, 48103.
| |
Collapse
|
11
|
Abstract
Molecular clock models are commonly used to estimate evolutionary rates and timescales from nucleotide sequences. The goal of these models is to account for rate variation among lineages, such that they are assumed to be adequate descriptions of the processes that generated the data. A common approach for selecting a clock model for a data set of interest is to examine a set of candidates and to select the model that provides the best statistical fit. However, this can lead to unreliable estimates if all the candidate models are actually inadequate. For this reason, a method of evaluating absolute model performance is critical. We describe a method that uses posterior predictive simulations to assess the adequacy of clock models. We test the power of this approach using simulated data and find that the method is sensitive to bias in the estimates of branch lengths, which tends to occur when using underparameterized clock models. We also compare the performance of the multinomial test statistic, originally developed to assess the adequacy of substitution models, but find that it has low power in identifying the adequacy of clock models. We illustrate the performance of our method using empirical data sets from coronaviruses, simian immunodeficiency virus, killer whales, and marine turtles. Our results indicate that methods of investigating model adequacy, including the one proposed here, should be routinely used in combination with traditional model selection in evolutionary studies. This will reveal whether a broader range of clock models to be considered in phylogenetic analysis.
Collapse
Affiliation(s)
- David A Duchêne
- Research School of Biology, Australian National University, Canberra, ACT, Australia
| | - Sebastian Duchêne
- School of Biological Sciences, University of Sydney, Sydney, NSW, Australia Marie Bashir Institute for Infectious Diseases and Biosecurity, Charles Perkins Centre, Sydney Medical School, University of Sydney, Sydney, NSW, Australia
| | - Edward C Holmes
- School of Biological Sciences, University of Sydney, Sydney, NSW, Australia Marie Bashir Institute for Infectious Diseases and Biosecurity, Charles Perkins Centre, Sydney Medical School, University of Sydney, Sydney, NSW, Australia
| | - Simon Y W Ho
- School of Biological Sciences, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
12
|
Duchêne S, Di Giallonardo F, Holmes EC. Substitution Model Adequacy and Assessing the Reliability of Estimates of Virus Evolutionary Rates and Time Scales. Mol Biol Evol 2015; 33:255-67. [PMID: 26416981 DOI: 10.1093/molbev/msv207] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Determining the time scale of virus evolution is central to understanding their origins and emergence. The phylogenetic methods commonly used for this purpose can be misleading if the substitution model makes incorrect assumptions about the data. Empirical studies consider a pool of models and select that with the highest statistical fit. However, this does not allow the rejection of all models, even if they poorly describe the data. An alternative is to use model adequacy methods that evaluate the ability of a model to predict hypothetical future observations. This can be done by comparing the empirical data with data generated under the model in question. We conducted simulations to evaluate the sensitivity of such methods with nucleotide, amino acid, and codon data. These effectively detected underparameterized models, but failed to detect mutational saturation and some instances of nonstationary base composition, which can lead to biases in estimates of tree topology and length. To test the applicability of these methods with real data, we analyzed nucleotide and amino acid data sets from the genus Flavivirus of RNA viruses. In most cases these models were inadequate, with the exception of a data set of relatively closely related sequences of Dengue virus, for which the GTR+Γ nucleotide and LG+Γ amino acid substitution models were adequate. Our results partly explain the lack of consensus over estimates of the long-term evolutionary time scale of these viruses, and indicate that assessing the adequacy of substitution models should be routinely used to determine whether estimates are reliable.
Collapse
Affiliation(s)
- Sebastián Duchêne
- Marie Bashir Institute for Infectious Diseases and Biosecurity, Charles Perkins Centre, School of Biological Sciences and Sydney Medical School, The University of Sydney, Sydney, NSW, Australia
| | - Francesca Di Giallonardo
- Marie Bashir Institute for Infectious Diseases and Biosecurity, Charles Perkins Centre, School of Biological Sciences and Sydney Medical School, The University of Sydney, Sydney, NSW, Australia
| | - Edward C Holmes
- Marie Bashir Institute for Infectious Diseases and Biosecurity, Charles Perkins Centre, School of Biological Sciences and Sydney Medical School, The University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
13
|
Elsensohn MH, Klich A, Ecochard R, Bastard M, Genolini C, Etard JF, Gustin MP. A graphical method to assess distribution assumption in group-based trajectory models. Stat Methods Med Res 2013; 25:968-82. [PMID: 23427224 DOI: 10.1177/0962280213475643] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Group-based trajectory models had a rapid development in the analysis of longitudinal data in clinical research. In these models, the assumption of homoscedasticity of the residuals is frequently made but this assumption is not always met. We developed here an easy-to-perform graphical method to assess the assumption of homoscedasticity of the residuals to apply especially in group-based trajectory models. The method is based on drawing an envelope to visualize the local dispersion of the residuals around each typical trajectory. Its efficiency is demonstrated using data on CD4 lymphocyte counts in patients with human immunodeficiency virus put on antiretroviral therapy. Four distinct distributions that take into account increasing parts of the variability of the observed data are presented. Significant differences in group structures and trajectory patterns were found according to the chosen distribution. These differences might have large impacts on the final trajectories and their characteristics; thus on potential medical decisions. With a single glance, the graphical criteria allow the choice of the distribution that best capture data variability and help dealing with a potential heteroscedasticity problem.
Collapse
Affiliation(s)
- Mad-Hélénie Elsensohn
- Hospices Civils de Lyon, Service de Biostatistique, Lyon, France; Université de Lyon, Lyon, France; Université Lyon 1, Villeurbanne, France CNRS, UMR5558, Laboratoire de Biométrie et Biologie Evolutive, Equipe Biostatistique-Santé, Villeurbanne, France
| | - Amna Klich
- Hospices Civils de Lyon, Service de Biostatistique, Lyon, France; Université de Lyon, Lyon, France; Université Lyon 1, Villeurbanne, France CNRS, UMR5558, Laboratoire de Biométrie et Biologie Evolutive, Equipe Biostatistique-Santé, Villeurbanne, France
| | - René Ecochard
- Hospices Civils de Lyon, Service de Biostatistique, Lyon, France; Université de Lyon, Lyon, France; Université Lyon 1, Villeurbanne, France CNRS, UMR5558, Laboratoire de Biométrie et Biologie Evolutive, Equipe Biostatistique-Santé, Villeurbanne, France
| | | | - Christophe Genolini
- UMR U1027, INSERM, Université Paul Sabatier, Toulouse III; CeRSME (EA 2931), UFR STAPS, Université de Paris Ouest-Nanterre-La Défense
| | - Jean-François Etard
- UMI 233 "TransVIHMI" Institut de Recherche pour le Développement, Université Montpellier 1, F-34394 Montpellier, France
| | - Marie-Paule Gustin
- Hospices Civils de Lyon, Service de Biostatistique, Lyon, France; Université de Lyon, Lyon, France; Université Lyon 1, Villeurbanne, France Département de santé publique, Institut des Sciences Pharmaceutiques et Biologiques (ISPB), Université de Lyon, Université Lyon 1, Lyon, France Equipe d'Accueil Mixte 4173; Université de Lyon, Université Lyon 1, Hôpital Nord-Ouest Villefranche-sur-Saône, Lyon, France
| |
Collapse
|