1
|
Lotspeich SC, Ashner MC, Vazquez JE, Richardson BD, Grosser KF, Bodek BE, Garcia TP. Making Sense of Censored Covariates: Statistical Methods for Studies of Huntington's Disease. ANNUAL REVIEW OF STATISTICS AND ITS APPLICATION 2024; 11:255-277. [PMID: 38962579 PMCID: PMC11220439 DOI: 10.1146/annurev-statistics-040522-095944] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/05/2024]
Abstract
The landscape of survival analysis is constantly being revolutionized to answer biomedical challenges, most recently the statistical challenge of censored covariates rather than outcomes. There are many promising strategies to tackle censored covariates, including weighting, imputation, maximum likelihood, and Bayesian methods. Still, this is a relatively fresh area of research, different from the areas of censored outcomes (i.e., survival analysis) or missing covariates. In this review, we discuss the unique statistical challenges encountered when handling censored covariates and provide an in-depth review of existing methods designed to address those challenges. We emphasize each method's relative strengths and weaknesses, providing recommendations to help investigators pinpoint the best approach to handling censored covariates in their data.
Collapse
Affiliation(s)
- Sarah C Lotspeich
- Department of Statistical Sciences, Wake Forest University, Winston-Salem, North Carolina, USA
| | - Marissa C Ashner
- Department of Biostatistics, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Jesus E Vazquez
- Department of Biostatistics, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Brian D Richardson
- Department of Biostatistics, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Kyle F Grosser
- Department of Biostatistics, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Benjamin E Bodek
- Department of Biostatistics, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| | - Tanya P Garcia
- Department of Biostatistics, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA
| |
Collapse
|
2
|
Habib N, Hughes MD, Broutet N, Thorson A, Gaillard P, Landoulsi S, McDonald SLR, Formenty P. Statistical methodologies for evaluation of the rate of persistence of Ebola virus in semen of male survivors in Sierra Leone. PLoS One 2022; 17:e0274755. [PMID: 36197875 PMCID: PMC9534448 DOI: 10.1371/journal.pone.0274755] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2021] [Accepted: 09/03/2022] [Indexed: 11/24/2022] Open
Abstract
The 2013-2016 Ebola virus (EBOV) outbreak in West Africa was the largest and most complex outbreak ever, with a total number of cases and deaths higher than in all previous EBOV outbreaks combined. The outbreak was characterized by rapid spread of the infection in nations that were weakly prepared to handle it. EBOV ribonucleic acid (RNA) is known to persist in body fluids following disease recovery, and studying this persistence is crucial for controlling such epidemics. Observational cohort studies investigating EBOV persistence in semen require following up recently recovered survivors of Ebola virus disease (EVD), from recruitment to the time when their semen tests negative for EBOV, the endpoint being time-to-event. Because recruitment of EVD survivors takes place weeks or months following disease recovery, the event of interest may have already occurred. Survival analysis methods are the best suited for the estimation of the virus persistence in body fluids but must account for left- and interval-censoring present in the data, which is a more complex problem than that of presence of right censoring alone. Using the Sierra Leone Ebola Virus Persistence Study, we discuss study design issues, endpoint of interest and statistical methodologies for interval- and right-censored non-parametric and parametric survival modelling. Using the data from 203 EVD recruited survivors, we illustrate the performance of five different survival models for estimation of persistence of EBOV in semen. The interval censored survival analytic methods produced more precise estimates of EBOV persistence in semen and were more representative of the source population than the right censored ones. The potential to apply these methods is enhanced by increased availability of statistical software to handle interval censored survival data. These methods may be applicable to diseases of a similar nature where persistence estimation of pathogens is of interest.
Collapse
Affiliation(s)
- Ndema Habib
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research, Training in Human Reproduction, Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
- * E-mail:
| | - Michael D. Hughes
- Department of Biostatistics, Harvard T.H Chan School of Public Health, Boston, Massachusetts, United States of America
| | - Nathalie Broutet
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research, Training in Human Reproduction, Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Anna Thorson
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research, Training in Human Reproduction, Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Philippe Gaillard
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research, Training in Human Reproduction, Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Sihem Landoulsi
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research, Training in Human Reproduction, Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Suzanne L. R. McDonald
- UNDP/UNFPA/UNICEF/WHO/World Bank Special Programme of Research, Development and Research, Training in Human Reproduction, Department of Sexual and Reproductive Health and Research, World Health Organization, Geneva, Switzerland
| | - Pierre Formenty
- Department of Health Emergency Interventions, World Health Organization, Geneva, Switzerland
| | | |
Collapse
|
3
|
Nevo D, Hamada T, Ogino S, Wang M. A novel calibration framework for survival analysis when a binary covariate is measured at sparse time points. Biostatistics 2020; 21:e148-e163. [PMID: 30380012 DOI: 10.1093/biostatistics/kxy063] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2018] [Revised: 08/04/2018] [Accepted: 10/02/2018] [Indexed: 01/29/2023] Open
Abstract
The goals in clinical and cohort studies often include evaluation of the association of a time-dependent binary treatment or exposure with a survival outcome. Recently, several impactful studies targeted the association between initiation of aspirin and survival following colorectal cancer (CRC) diagnosis. The value of this exposure is zero at baseline and may change its value to one at some time point. Estimating this association is complicated by having only intermittent measurements on aspirin-taking. Commonly used methods can lead to substantial bias. We present a class of calibration models for the distribution of the time of status change of the binary covariate. Estimates obtained from these models are then incorporated into the proportional hazard partial likelihood in a natural way. We develop non-parametric, semiparametric, and parametric calibration models, and derive asymptotic theory for the methods that we implement in the aspirin and CRC study. We further develop a risk-set calibration approach that is more useful in settings in which the association between the binary covariate and survival is strong.
Collapse
Affiliation(s)
- Daniel Nevo
- Departments of Biostatistics and Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Tsuyoshi Hamada
- Department of Oncologic Pathology, Dana-Farber Cancer Institute and Harvard Medical School Boston, MA, USA
| | - Shuji Ogino
- Department of Oncologic Pathology, Dana-Farber Cancer Institute and Harvard Medical School, Boston, MA, USA.,Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA.,Program in MPE Molecular Pathological Epidemiology, Department of Pathology, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Molin Wang
- Departments of Biostatistics and Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA.,Channing Division of Network & Medicine, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| |
Collapse
|
4
|
Pak D, Liu J, Ning J, Gómez G, Shen Y. Analyzing left-truncated and right-censored infectious disease cohort data with interval-censored infection onset. Stat Med 2020; 40:287-298. [PMID: 33086432 DOI: 10.1002/sim.8774] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2020] [Revised: 08/18/2020] [Accepted: 09/26/2020] [Indexed: 11/10/2022]
Abstract
In an infectious disease cohort study, individuals who have been infected with a pathogen are often recruited for follow up. The period between infection and the onset of symptomatic disease, referred to as the incubation period, is of interest because of its importance on disease surveillance and control. However, the incubation period is often difficult to ascertain due to the uncertainty associated with asymptomatic infection onset time. An additional complication is that the observed infected subjects are likely to have longer incubation periods due to the prevalent sampling. In this article, we demonstrate how to estimate the distribution of the incubation period with the uncertain infection onset, subject to left-truncation and right-censoring. We employ a family of sufficiently general parametric models, the generalized odds-rate class of regression models, for the underlying incubation period and its correlation with covariates. In simulation studies, we assess the finite sample performance of the model fitting and hazard function estimation. The proposed method is illustrated on data from the HIV/AIDS study on injection drug users admitted to a detoxification program in Badalona, Spain.
Collapse
Affiliation(s)
- Daewoo Pak
- Department of Information & Statistics, Yonsei University, Wonju, Korea.,Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Jun Liu
- Department of Plastic Surgery, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Jing Ning
- Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| | - Guadalupe Gómez
- Departament d'Estadística i Investigació Operativa and Barcelona Graduate School of Mathematics BGSMath, Universitat Politécnica de Catalunya, Barcelona, Spain
| | - Yu Shen
- Department of Biostatistics, The University of Texas MD Anderson Cancer Center, Houston, Texas, USA
| |
Collapse
|
5
|
Atem FD, Matsouaka RA, Zimmern VE. Cox regression model with randomly censored covariates. Biom J 2019; 61:1020-1032. [PMID: 30908720 DOI: 10.1002/bimj.201800275] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2018] [Revised: 02/07/2019] [Accepted: 02/07/2019] [Indexed: 11/11/2022]
Abstract
This paper deals with a Cox proportional hazards regression model, where some covariates of interest are randomly right-censored. While methods for censored outcomes have become ubiquitous in the literature, methods for censored covariates have thus far received little attention and, for the most part, dealt with the issue of limit-of-detection. For randomly censored covariates, an often-used method is the inefficient complete-case analysis (CCA) which consists in deleting censored observations in the data analysis. When censoring is not completely independent, the CCA leads to biased and spurious results. Methods for missing covariate data, including type I and type II covariate censoring as well as limit-of-detection do not readily apply due to the fundamentally different nature of randomly censored covariates. We develop a novel method for censored covariates using a conditional mean imputation based on either Kaplan-Meier estimates or a Cox proportional hazards model to estimate the effects of these covariates on a time-to-event outcome. We evaluate the performance of the proposed method through simulation studies and show that it provides good bias reduction and statistical efficiency. Finally, we illustrate the method using data from the Framingham Heart Study to assess the relationship between offspring and parental age of onset of cardiovascular events.
Collapse
Affiliation(s)
- Folefac D Atem
- Department of Biostatistics and Data Science, University of Texas Health Science Center at Houston, Houston, TX, USA
| | - Roland A Matsouaka
- Department of Biostatistics and Bioinformatics, Duke University, Durham, NC, USA.,Program for Comparative Effectiveness Methodology, Duke Clinical Research Institute, Duke University, Durham, NC, USA
| | - Vincent E Zimmern
- Department of Pediatrics, University of Texas Southwestern Medical School, Dallas, TX, USA.,Department of Pediatrics, Children Hospital Dallas, Dallas, TX, USA
| |
Collapse
|
6
|
Ahn S, Lim J, Paik MC, Sacco RL, Elkind MS. Cox model with interval-censored covariate in cohort studies. Biom J 2018; 60:797-814. [PMID: 29775990 DOI: 10.1002/bimj.201700090] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2017] [Revised: 12/19/2017] [Accepted: 02/27/2018] [Indexed: 11/07/2022]
Abstract
In cohort studies the outcome is often time to a particular event, and subjects are followed at regular intervals. Periodic visits may also monitor a secondary irreversible event influencing the event of primary interest, and a significant proportion of subjects develop the secondary event over the period of follow-up. The status of the secondary event serves as a time-varying covariate, but is recorded only at the times of the scheduled visits, generating incomplete time-varying covariates. While information on a typical time-varying covariate is missing for entire follow-up period except the visiting times, the status of the secondary event are unavailable only between visits where the status has changed, thus interval-censored. One may view interval-censored covariate of the secondary event status as missing time-varying covariates, yet missingness is partial since partial information is provided throughout the follow-up period. Current practice of using the latest observed status produces biased estimators, and the existing missing covariate techniques cannot accommodate the special feature of missingness due to interval censoring. To handle interval-censored covariates in the Cox proportional hazards model, we propose an available-data estimator, a doubly robust-type estimator as well as the maximum likelihood estimator via EM algorithm and present their asymptotic properties. We also present practical approaches that are valid. We demonstrate the proposed methods using our motivating example from the Northern Manhattan Study.
Collapse
Affiliation(s)
- Soohyun Ahn
- Department of Mathematics, Ajou University, Suwon, Korea
| | - Johan Lim
- Department of Statistics, Seoul National University, Seoul, Korea
| | | | - Ralph L Sacco
- Department of Neurology, Miller School of Medicine, University of Miami, Miami, FL, USA
| | | |
Collapse
|
7
|
Bernhardt PW. Model validation and influence diagnostics for regression models with missing covariates. Stat Med 2018; 37:1325-1342. [PMID: 29318652 DOI: 10.1002/sim.7584] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2017] [Revised: 11/01/2017] [Accepted: 11/14/2017] [Indexed: 11/11/2022]
Abstract
Missing covariate values are prevalent in regression applications. While an array of methods have been developed for estimating parameters in regression models with missing covariate data for a variety of response types, minimal focus has been given to validation of the response model and influence diagnostics. Previous research has mainly focused on estimating residuals for observations with missing covariates using expected values, after which specialized techniques are needed to conduct proper inference. We suggest a multiple imputation strategy that allows for the use of standard methods for residual analyses on the imputed data sets or a stacked data set. We demonstrate the suggested multiple imputation method by analyzing the Sleep in Mammals data in the context of a linear regression model and the New York Social Indicators Status data with a logistic regression model.
Collapse
Affiliation(s)
- Paul W Bernhardt
- Department of Mathematics and Statistics, Villanova University, Villanova, PA 19085, USA
| |
Collapse
|
8
|
Kim YJ. A modified estimating equation for a binary time varying covariate with an interval censored changing time. COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS 2016. [DOI: 10.5351/csam.2016.23.4.335] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Yang-Jin Kim
- Department of Statistics, Sookmyung Women’s University, Korea
| |
Collapse
|
9
|
Bernhardt PW, Wang HJ, Zhang D. Flexible Modeling of Survival Data with Covariates Subject to Detection Limits via Multiple Imputation. Comput Stat Data Anal 2014; 69. [PMID: 24204085 DOI: 10.1016/j.csda.2013.07.027] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Models for survival data generally assume that covariates are fully observed. However, in medical studies it is not uncommon for biomarkers to be censored at known detection limits. A computationally-efficient multiple imputation procedure for modeling survival data with covariates subject to detection limits is proposed. This procedure is developed in the context of an accelerated failure time model with a flexible seminonparametric error distribution. The consistency and asymptotic normality of the multiple imputation estimator are established and a consistent variance estimator is provided. An iterative version of the proposed multiple imputation algorithm that approximates the EM algorithm for maximum likelihood is also suggested. Simulation studies demonstrate that the proposed multiple imputation methods work well while alternative methods lead to estimates that are either biased or more variable. The proposed methods are applied to analyze the dataset from a recently-conducted GenIMS study.
Collapse
Affiliation(s)
- Paul W Bernhardt
- Department of Statistics, North Carolina State University, Raleigh, NC, USA
| | | | | |
Collapse
|
10
|
Sattar A, Sinha SK, Morris NJ. A Parametric Survival Model When a Covariate is Subject to Left-Censoring. ACTA ACUST UNITED AC 2013; Suppl 3. [PMID: 24319625 DOI: 10.4172/2155-6180.s3-002] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
PROBLEM STATEMENT Modeling survival data with a set of covariates usually assumes that the values of the covariates are fully observed. However, in a variety of applications, some values of a covariate may be left-censored due to inadequate instrument sensitivity to quantify the biospecimen. When data are left-censored, the true values are missing but are known to be smaller than the detection limit. The most commonly used ad-hoc method to deal with nondetect values is to substitute the nondetect values by the detection limit. Such ad-hoc analysis of survival data with an explanatory variable subject to left-censoring may provide biased and inefficient estimators of hazard ratios and survivor functions. METHOD We consider a parametric proportional hazards model to analyze time-to-event data. We propose a likelihood method for the estimation and inference of model parameters. In this likelihood approach, instead of replacing the nondetect values by the detection limit, we adopt a numerical integration technique to evaluate the observed data likelihood in the presence of a left-censored covariate. Monte Carlo simulations were used to demonstrate various properties of the proposed regression estimators including the consistency and efficiency. RESULTS The simulation study shows that the proposed likelihood approach provides approximately unbiased estimators of the model parameters. The proposed method also provides estimators that are more efficient than those obtained under the ad-hoc method. Also, unlike the ad-hoc estimators, the coverage probabilities of the proposed estimators are at their nominal level. Analysis of a large cohort study, genetic and inflammatory marker of sepsis study, shows discernibly different results based on the proposed method. CONCLUSION Naive use of detection limit in a parametric survival model may provide biased and inefficient estimators of hazard ratios and survivor functions. The proposed likelihood approach provides approximately unbiased and efficient estimators of hazard ratios and survivor functions.
Collapse
Affiliation(s)
- Abdus Sattar
- Department of Epidemiology & Biostatistics, Case Western Reserve University, Cleveland, OH, USA
| | | | | |
Collapse
|
11
|
Gómez G, Serrat C. Correcting the bias due to dependent censoring of the survival estimator by conditioning. STATISTICS-ABINGDON 2012. [DOI: 10.1080/02331888.2012.719514] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
12
|
Julià O, Gómez G. Simultaneous marginal survival estimators when doubly censored data is present. LIFETIME DATA ANALYSIS 2011; 17:347-372. [PMID: 20886370 DOI: 10.1007/s10985-010-9186-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2009] [Accepted: 09/13/2010] [Indexed: 05/29/2023]
Abstract
A doubly censoring scheme occurs when the lifetimes T being measured,from a well-known time origin, are exactly observed within a window [L, R] of observational time and are otherwise censored either from above (right-censored observations)or below (left-censored observations). Sample data consists on the pairs (U, δ)where U = min{R, max{T, L}} and δ indicates whether T is exactly observed (δ = 0),right-censored (δ = 1) or left-censored (δ = −1). We are interested in the estimation of the marginal behaviour of the three random variables T, L and R based on the observed pairs (U, δ).We propose new nonparametric simultaneous marginal estimators Ŝ(T) , Ŝ(L) and Ŝ(R) for the survival functions of T, L and R, respectively, by means of an inverse-probability-of-censoring approach. The proposed estimators Ŝ(T) , Ŝ(L) and Ŝ(R) are not computationally intensive, generalize the empirical survival estimator and reduce to the Kaplan-Meier estimator in the absence of left-censored data. Furthermore,Ŝ(T) is equivalent to a self-consistent estimator, is uniformly strongly consistent and asymptotically normal. The method is illustrated with data from a cohort of drug users recruited in a detoxification program in Badalona (Spain). For these data we estimate the survival function for the elapsed time from starting IV-drugs to AIDS diagnosis, as well as the potential follow-up time. A simulation study is discussed to assess the performance of the three survival estimators for moderate sample sizes and different censoring levels.
Collapse
Affiliation(s)
- Olga Julià
- Departament de Probabilitat, Lògica i Estadística, Universitat de Barcelona, Gran Via 585, 08007, Barcelona, Spain.
| | | |
Collapse
|
13
|
Gómez G, Calle ML, Oller R, Langohr K. Tutorial on methods for interval-censored data and their implementation in R. STAT MODEL 2009. [DOI: 10.1177/1471082x0900900402] [Citation(s) in RCA: 77] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Interval censoring is encountered in many practical situations when the event of interest cannot be observed and it is only known to have occurred within a time window. The theory for the analysis of interval-censored data has been developed over the past three decades and several reviews have been written. However, it is still a common practice in medical and reliability studies to simplify the interval censoring structure of the data into a more standard right censoring situation by, for instance, imputing the midpoint of the censoring interval. The availability of software for right censoring might well be the main reason for this simplifying practice. In contrast, several methods have been developed to deal with interval-censored data and the corresponding algorithms to make the procedures feasible are scattered across the statistical software or remain behind the personal computers of many researchers. The purpose of this tutorial is to present, in a pedagogical and unified manner, the methodology and the available software for analyzing interval-censored data. The paper covers frequentist non-parametric, parametric and semiparametric estimating approaches, non-parametric tests for comparing survival curves and a section on simulation of interval-censored data. The methods and the software are described using the data from a dental study.
Collapse
Affiliation(s)
- Guadalupe Gómez
- Departament d’Estadstica i I.O., Universitat Politècnica de Catalunya, Spain
| | - M Luz Calle
- Departament de Biologia de Sistemes, Universitat de Vic, Vic, Spain
| | - Ramon Oller
- Departament d’Economia, Matemàtica i Informàtica, Universitat de Vic, Vic, Spain
| | - Klaus Langohr
- Programa de Recerca en Neuropsicofarmacologia, Institut Municipal d’Investigació Mèdica, Spain
| |
Collapse
|
14
|
|