1
|
Wang Y, Cao F, Yu K, Liang J. Local Causal Discovery in Multiple Manipulated Datasets. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:7235-7247. [PMID: 35038298 DOI: 10.1109/tnnls.2021.3139389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
We consider the problem of distinguishing direct causes from direct effects of a target variable of interest from multiple manipulated datasets with unknown manipulated variables and nonidentical data distributions. Recent studies have shown that datasets attained from manipulated experiments (i.e., manipulated data) contain richer causal information than observational data for causal structure learning. Thus, in this article, we propose a new algorithm, which makes full use of the interventional properties of a causal model to discover the direct causes and direct effects of a target variable from multiple datasets with different manipulations. It is more suited to real-world cases and is also a challenge to be addressed in this article. First, we apply the backward framework to learn parents and children (PC) of a given target from multiple manipulated datasets. Second, we orient some edges connected to the target in advance through the assumption that the target variable is not manipulated and then orient the remaining undirected edges by finding invariant V-structures from multiple datasets. Third, we analyze the correctness of the proposed algorithm. To the best of our knowledge, the proposed algorithm is the first that can identify the local causal structure of a given target from multiple manipulated datasets with unknown manipulated variables. Experimental results on standard Bayesian networks validate the effectiveness of our algorithm.
Collapse
|
2
|
Ji J, Zou A, Liu J, Yang C, Zhang X, Song Y. A Survey on Brain Effective Connectivity Network Learning. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:1879-1899. [PMID: 34469315 DOI: 10.1109/tnnls.2021.3106299] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Human brain effective connectivity characterizes the causal effects of neural activities among different brain regions. Studies of brain effective connectivity networks (ECNs) for different populations contribute significantly to the understanding of the pathological mechanism associated with neuropsychiatric diseases and facilitate finding new brain network imaging markers for the early diagnosis and evaluation for the treatment of cerebral diseases. A deeper understanding of brain ECNs also greatly promotes brain-inspired artificial intelligence (AI) research in the context of brain-like neural networks and machine learning. Thus, how to picture and grasp deeper features of brain ECNs from functional magnetic resonance imaging (fMRI) data is currently an important and active research area of the human brain connectome. In this survey, we first show some typical applications and analyze existing challenging problems in learning brain ECNs from fMRI data. Second, we give a taxonomy of ECN learning methods from the perspective of computational science and describe some representative methods in each category. Third, we summarize commonly used evaluation metrics and conduct a performance comparison of several typical algorithms both on simulated and real datasets. Finally, we present the prospects and references for researchers engaged in learning ECNs.
Collapse
|
3
|
Sun Y, Zhang K, Sun C. Model-Based Transfer Reinforcement Learning Based on Graphical Model Representations. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2023; 34:1035-1048. [PMID: 34543207 DOI: 10.1109/tnnls.2021.3107375] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Reinforcement learning (RL) plays an essential role in the field of artificial intelligence but suffers from data inefficiency and model-shift issues. One possible solution to deal with such issues is to exploit transfer learning. However, interpretability problems and negative transfer may occur without explainable models. In this article, we define Relation Transfer as explainable and transferable learning based on graphical model representations, inferring the skeleton and relations among variables in a causal view and generalizing to the target domain. The proposed algorithm consists of the following three steps. First, we leverage a suitable casual discovery method to identify the causal graph based on the augmented source domain data. After that, we make inferences on the target model based on the prior causal knowledge. Finally, offline RL training on the target model is utilized as prior knowledge to improve the policy training in the target domain. The proposed method can answer the question of what to transfer and realize zero-shot transfer across related domains in a principled way. To demonstrate the robustness of the proposed framework, we conduct experiments on four classical control problems as well as one simulation to the real-world application. Experimental results on both continuous and discrete cases demonstrate the efficacy of the proposed method.
Collapse
|
4
|
Shi X, Pan Z, Miao W. Data Integration in Causal Inference. WILEY INTERDISCIPLINARY REVIEWS. COMPUTATIONAL STATISTICS 2023; 15:e1581. [PMID: 36713955 PMCID: PMC9880960 DOI: 10.1002/wics.1581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/03/2021] [Revised: 02/24/2022] [Accepted: 03/01/2022] [Indexed: 04/12/2023]
Abstract
Integrating data from multiple heterogeneous sources has become increasingly popular to achieve a large sample size and diverse study population. This paper reviews development in causal inference methods that combines multiple datasets collected by potentially different designs from potentially heterogeneous populations. We summarize recent advances on combining randomized clinical trial with external information from observational studies or historical controls, combining samples when no single sample has all relevant variables with application to two-sample Mendelian randomization, distributed data setting under privacy concerns for comparative effectiveness and safety research using real-world data, Bayesian causal inference, and causal discovery methods.
Collapse
Affiliation(s)
- Xu Shi
- Department of BiostatisticsUniversity of MichiganAnn ArborMichiganUSA
| | - Ziyang Pan
- Department of BiostatisticsUniversity of MichiganAnn ArborMichiganUSA
| | - Wang Miao
- Department of Probability and StatisticsPeking UniversityBeijingChina
| |
Collapse
|
5
|
Liu J, Ji J, Xun G, Zhang A. Inferring Effective Connectivity Networks From fMRI Time Series With a Temporal Entropy-Score. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:5993-6006. [PMID: 33886478 DOI: 10.1109/tnnls.2021.3072149] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Inferring brain-effective connectivity networks from neuroimaging data has become a very hot topic in neuroinformatics and bioinformatics. In recent years, the search methods based on Bayesian network score have been greatly developed and become an emerging method for inferring effective connectivity. However, the previous score functions ignore the temporal information from functional magnetic resonance imaging (fMRI) series data and may not be able to determine all orientations in some cases. In this article, we propose a novel score function for inferring effective connectivity from fMRI data based on the conditional entropy and transfer entropy (TE) between brain regions. The new score employs the TE to capture the temporal information and can effectively infer connection directions between brain regions. Experimental results on both simulated and real-world data demonstrate the efficacy of our proposed score function.
Collapse
|
6
|
Learning dynamic causal mechanisms from non-stationary data. APPL INTELL 2022. [DOI: 10.1007/s10489-022-03843-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
7
|
You D, Sun M, Liang S, Li R, Wang Y, Xiao J, Yuan F, Shen L, Wu X. Online feature selection for multi-source streaming features. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2022.01.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
8
|
Affiliation(s)
| | - Stefano Peluso
- Department of Statistics and Quantitative Methods, Università degli Studi di Milano-Bicocca, Milan
| |
Collapse
|
9
|
Qiao J, Bai Y, Cai R, Hao Z. Causal discovery from multi-domain data using the independence of modularities. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06507-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
10
|
Weichwald S, Peters J. Causality in Cognitive Neuroscience: Concepts, Challenges, and Distributional Robustness. J Cogn Neurosci 2020; 33:226-247. [PMID: 32812827 DOI: 10.1162/jocn_a_01623] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Whereas probabilistic models describe the dependence structure between observed variables, causal models go one step further: They predict, for example, how cognitive functions are affected by external interventions that perturb neuronal activity. In this review and perspective article, we introduce the concept of causality in the context of cognitive neuroscience and review existing methods for inferring causal relationships from data. Causal inference is an ambitious task that is particularly challenging in cognitive neuroscience. We discuss two difficulties in more detail: the scarcity of interventional data and the challenge of finding the right variables. We argue for distributional robustness as a guiding principle to tackle these problems. Robustness (or invariance) is a fundamental principle underlying causal methodology. A (correctly specified) causal model of a target variable generalizes across environments or subjects as long as these environments leave the causal mechanisms of the target intact. Consequently, if a candidate model does not generalize, then either it does not consist of the target variable's causes or the underlying variables do not represent the correct granularity of the problem. In this sense, assessing generalizability may be useful when defining relevant variables and can be used to partially compensate for the lack of interventional data.
Collapse
|
11
|
Yu K, Liu L, Li J. Learning Markov Blankets From Multiple Interventional Data Sets. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2020; 31:2005-2019. [PMID: 31478874 DOI: 10.1109/tnnls.2019.2927636] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Learning Markov blankets (MBs) plays an important role in many machine learning tasks, such as causal Bayesian network structure learning, feature selection, and domain adaptation. Since variables included in the MB of a target variable of interest have causal relationships with the target, the MB can serve as the basis of learning the global structure of a causal Bayesian network or as a reliable and robust feature set for classification, both within the same domain or across domains. In this article, we study the problem of learning the MB of a target variable from multiple interventional data sets. Data sets attained from interventional experiments contain richer causal information than passively observed data (observational data) for MB discovery. However, almost all existing MB discovery methods are designed for learning MBs from a single observational data set. To learn MBs from multiple interventional data sets, we face two challenges: 1) unknown intervention variables and 2) nonidentical data distributions. To address these challenges, we theoretically analyze: 1) under what conditions we can find the correct MB of a target variable and 2) under what conditions we can identify the causes of the target variable via discovering its MB. Based on the theoretical analysis, we propose a new algorithm for learning MBs from multiple interventional data sets, and we present the conditions/assumptions that assure the correctness of the algorithm. To the best of our knowledge, this article is the first to present the theoretical analyses about the conditions for MB discovery in multiple interventional data sets and the algorithm to find the MBs in relation to the conditions. Using benchmark Bayesian networks and real-world data sets, the experiments have validated the effectiveness and efficiency of the proposed algorithm in this article.
Collapse
|
12
|
Runge J, Bathiany S, Bollt E, Camps-Valls G, Coumou D, Deyle E, Glymour C, Kretschmer M, Mahecha MD, Muñoz-Marí J, van Nes EH, Peters J, Quax R, Reichstein M, Scheffer M, Schölkopf B, Spirtes P, Sugihara G, Sun J, Zhang K, Zscheischler J. Inferring causation from time series in Earth system sciences. Nat Commun 2019; 10:2553. [PMID: 31201306 PMCID: PMC6572812 DOI: 10.1038/s41467-019-10105-3] [Citation(s) in RCA: 144] [Impact Index Per Article: 28.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2018] [Accepted: 04/17/2019] [Indexed: 11/25/2022] Open
Abstract
The heart of the scientific enterprise is a rational effort to understand the causes behind the phenomena we observe. In large-scale complex dynamical systems such as the Earth system, real experiments are rarely feasible. However, a rapidly increasing amount of observational and simulated data opens up the use of novel data-driven causal methods beyond the commonly adopted correlation techniques. Here, we give an overview of causal inference frameworks and identify promising generic application cases common in Earth system sciences and beyond. We discuss challenges and initiate the benchmark platform causeme.net to close the gap between method users and developers.
Collapse
Affiliation(s)
- Jakob Runge
- German Aerospace Center, Institute of Data Science, Mälzer Str. 3, 07745, Jena, Germany.
- Grantham Institute, Imperial College, London, SW7 2AZ, UK.
| | - Sebastian Bathiany
- Climate Service Center Germany (GERICS), Helmholtz-Zentrum Geesthacht, Fischertwiete 1, 20095, Hamburg, Germany
- Department of Environmental Sciences, Wageningen University, P.O. Box 47, NL-6700 AA, Wageningen, The Netherlands
| | - Erik Bollt
- Department of Mathematics, Clarkson Center for Complex Systems Science (C3S2), Clarkson University, 8 Clarkson Ave., Potsdam, NY, 13699-5815, USA
| | - Gustau Camps-Valls
- Image Processing Laboratory, Universitat de València, ES-46980, Paterna (València), Spain
| | - Dim Coumou
- Department of Water and Climate Risk, Institute for Environmental Studies (IVM), VU University Amsterdam, De Boelelaan 1087, 1081 HV, Amsterdam, The Netherlands
- Potsdam Institute for Climate Impact Research, Earth System Analysis, Telegraphenberg A62, 14473, Potsdam, Germany
| | - Ethan Deyle
- Scripps Institution of Oceanography, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA
| | - Clark Glymour
- Department of Philosophy, Carnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA, 15213, USA
| | - Marlene Kretschmer
- Potsdam Institute for Climate Impact Research, Earth System Analysis, Telegraphenberg A62, 14473, Potsdam, Germany
| | - Miguel D Mahecha
- Max Planck Institute for Biogeochemistry, PO Box 100164, 07701, Jena, Germany
| | - Jordi Muñoz-Marí
- Image Processing Laboratory, Universitat de València, ES-46980, Paterna (València), Spain
| | - Egbert H van Nes
- Department of Environmental Sciences, Wageningen University, P.O. Box 47, NL-6700 AA, Wageningen, The Netherlands
| | - Jonas Peters
- Department of Mathematical Sciences, University of Copenhagen, Universitetsparken 5, 2100, København, Denmark
| | - Rick Quax
- Institute for Informatics, University of Amsterdam, PO Box 94323, 1090 GH, Amsterdam, The Netherlands
- Institute of Advanced Studies, University of Amsterdam, Oude Turfmarkt 147, 1012, GC, Amsterdam, The Netherlands
| | - Markus Reichstein
- Max Planck Institute for Biogeochemistry, PO Box 100164, 07701, Jena, Germany
| | - Marten Scheffer
- Department of Environmental Sciences, Wageningen University, P.O. Box 47, NL-6700 AA, Wageningen, The Netherlands
| | - Bernhard Schölkopf
- Max Planck Institute for Intelligent Systems, Max Planck Ring 4, 72076, Tübingen, Germany
| | - Peter Spirtes
- Department of Philosophy, Carnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA, 15213, USA
| | - George Sugihara
- Scripps Institution of Oceanography, University of California, San Diego, 9500 Gilman Drive, La Jolla, CA, 92093, USA
| | - Jie Sun
- Department of Mathematics, Clarkson Center for Complex Systems Science (C3S2), Clarkson University, 8 Clarkson Ave., Potsdam, NY, 13699-5815, USA
- Department of Physics and Department of Computer Science, Clarkson University, 8 Clarkson Ave., Potsdam, NY, 13699-5815, USA
| | - Kun Zhang
- Department of Philosophy, Carnegie Mellon University, 5000 Forbes Ave, Pittsburgh, PA, 15213, USA
| | - Jakob Zscheischler
- Institute for Atmospheric and Climate Science, ETH Zurich, Universitätstrasse 16, 8092, Zurich, Switzerland
- Climate and Environmental Physics, University of Bern, Sidlerstrasse 5, 3012, Bern, Switzerland
- Oeschger Centre for Climate Change Research, University of Bern, Bern, 3012, Switzerland
| |
Collapse
|
13
|
Glymour C, Zhang K, Spirtes P. Review of Causal Discovery Methods Based on Graphical Models. Front Genet 2019; 10:524. [PMID: 31214249 PMCID: PMC6558187 DOI: 10.3389/fgene.2019.00524] [Citation(s) in RCA: 130] [Impact Index Per Article: 26.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2018] [Accepted: 05/13/2019] [Indexed: 12/11/2022] Open
Abstract
A fundamental task in various disciplines of science, including biology, is to find underlying causal relations and make use of them. Causal relations can be seen if interventions are properly applied; however, in many cases they are difficult or even impossible to conduct. It is then necessary to discover causal relations by analyzing statistical properties of purely observational data, which is known as causal discovery or causal structure search. This paper aims to give a introduction to and a brief review of the computational methods for causal discovery that were developed in the past three decades, including constraint-based and score-based methods and those based on functional causal models, supplemented by some illustrations and applications.
Collapse
Affiliation(s)
- Clark Glymour
- Department of Philosophy, Carnegie Mellon University, Pittsburgh, PA, United States
| | - Kun Zhang
- Department of Philosophy, Carnegie Mellon University, Pittsburgh, PA, United States
| | - Peter Spirtes
- Department of Philosophy, Carnegie Mellon University, Pittsburgh, PA, United States
| |
Collapse
|
14
|
Huang B, Zhang K, Gong M, Glymour C. Causal Discovery and Forecasting in Nonstationary Environments with State-Space Models. PROCEEDINGS OF MACHINE LEARNING RESEARCH 2019; 97:2901-2910. [PMID: 31497778 PMCID: PMC6730644] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
In many scientific fields, such as economics and neuroscience, we are often faced with nonstationary time series, and concerned with both finding causal relations and forecasting the values of variables of interest, both of which are particularly challenging in such nonstationary environments. In this paper, we study causal discovery and forecasting for nonstationary time series. By exploiting a particular type of state-space model to represent the processes, we show that nonstationarity helps to identify causal structure and that forecasting naturally benefits from learned causal knowledge. Specifically, we allow changes in both causal strengths and noise variances in the nonlinear state-space models, which, interestingly, renders both the causal structure and model parameters identifiable. Given the causal model, we treat forecasting as a problem in Bayesian inference in the causal model, which exploits the timevarying property of the data and adapts to new observations in a principled manner. Experimental results on synthetic and real-world data sets demonstrate the efficacy of the proposed methods.
Collapse
Affiliation(s)
- Biwei Huang
- Department of Philosophy, Carnegie Mellon University, Pittsburgh
| | - Kun Zhang
- Department of Philosophy, Carnegie Mellon University, Pittsburgh
| | - Mingming Gong
- Department of Philosophy, Carnegie Mellon University, Pittsburgh
- Department of Biomedical Informatics, University of Pittsburgh, Pittsburgh
| | - Clark Glymour
- Department of Philosophy, Carnegie Mellon University, Pittsburgh
| |
Collapse
|
15
|
Ghassami A, Kiyavash N, Huang B, Zhang K. Multi-domain Causal Structure Learning in Linear Systems. ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 2018; 31:6266-6276. [PMID: 30971863 PMCID: PMC6453575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
We study the problem of causal structure learning in linear systems from observational data given in multiple domains, across which the causal coefficients and/or the distribution of the exogenous noises may vary. The main tool used in our approach is the principle that in a causally sufficient system, the causal modules, as well as their included parameters, change independently across domains. We first introduce our approach for finding causal direction in a system comprising two variables and propose efficient methods for identifying causal direction. Then we generalize our methods to causal structure learning in networks of variables. Most of previous work in structure learning from multi-domain data assume that certain types of invariance are held in causal modules across domains. Our approach unifies the idea in those works and generalizes to the case that there is no such invariance across the domains. Our proposed methods are generally capable of identifying causal direction from fewer than ten domains. When the invariance property holds, two domains are generally sufficient.
Collapse
Affiliation(s)
- AmirEmad Ghassami
- Department of ECE, University of Illinois at Urbana-Champaign, Urbana, IL, USA
| | - Negar Kiyavash
- School of ISyE and ECE, Georgia Institute of Technology, Atlanta, GA, USA
| | - Biwei Huang
- Department of Philosophy, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Kun Zhang
- Department of Philosophy, Carnegie Mellon University, Pittsburgh, PA, USA
| |
Collapse
|
16
|
Huang B, Zhang K, Lin Y, Schölkopf B, Glymour C. Generalized Score Functions for Causal Discovery. KDD : PROCEEDINGS. INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING 2018; 2018:1551-1560. [PMID: 30191079 PMCID: PMC6123020 DOI: 10.1145/3219819.3220104] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Discovery of causal relationships from observational data is a fundamental problem. Roughly speaking, there are two types of methods for causal discovery, constraint-based ones and score-based ones. Score-based methods avoid the multiple testing problem and enjoy certain advantages compared to constraint-based ones. However, most of them need strong assumptions on the functional forms of causal mechanisms, as well as on data distributions, which limit their applicability. In practice the precise information of the underlying model class is usually unknown. If the above assumptions are violated, both spurious and missing edges may result. In this paper, we introduce generalized score functions for causal discovery based on the characterization of general (conditional) independence relationships between random variables, without assuming particular model classes. In particular, we exploit regression in RKHS to capture the dependence in a non-parametric way. The resulting causal discovery approach produces asymptotically correct results in rather general cases, which may have nonlinear causal mechanisms, a wide class of data distributions, mixed continuous and discrete data, and multidimensional variables. Experimental results on both synthetic and real-world data demonstrate the efficacy of our proposed approach.
Collapse
Affiliation(s)
- Biwei Huang
- Department of Philosophy, Carnegie Mellon University
| | - Kun Zhang
- Department of Philosophy, Carnegie Mellon University
| | - Yizhu Lin
- Department of Philosophy, Carnegie Mellon University
| | | | - Clark Glymour
- Department of Philosophy, Carnegie Mellon University
| |
Collapse
|
17
|
Zhang K, Schölkopf B, Spirtes P, Glymour C. Learning causality and causality-related learning: some recent progress. Natl Sci Rev 2018; 5:26-29. [PMID: 30034911 PMCID: PMC6051411 DOI: 10.1093/nsr/nwx137] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Affiliation(s)
- Kun Zhang
- Department of Philosophy, Carnegie Mellon University, USA
| | | | - Peter Spirtes
- Department of Philosophy, Carnegie Mellon University, USA
| | - Clark Glymour
- Department of Philosophy, Carnegie Mellon University, USA
| |
Collapse
|
18
|
Huang B, Zhang K, Zhang J, Sanchez-Romero R, Glymour C, Schölkopf B. Behind Distribution Shift: Mining Driving Forces of Changes and Causal Arrows. PROCEEDINGS. IEEE INTERNATIONAL CONFERENCE ON DATA MINING 2017; 2017:913-918. [PMID: 31068766 DOI: 10.1109/icdm.2017.114] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
We address two important issues in causal discovery from nonstationary or heterogeneous data, where parameters associated with a causal structure may change over time or across data sets. First, we investigate how to efficiently estimate the "driving force" of the nonstationarity of a causal mechanism. That is, given a causal mechanism that varies over time or across data sets and whose qualitative structure is known, we aim to extract from data a low-dimensional and interpretable representation of the main components of the changes. For this purpose we develop a novel kernel embedding of nonstationary conditional distributions that does not rely on sliding windows. Second, the embedding also leads to a measure of dependence between the changes of causal modules that can be used to determine the directions of many causal arrows. We demonstrate the power of our methods with experiments on both synthetic and real data.
Collapse
Affiliation(s)
- Biwei Huang
- Department of Philosophy, Carnegie Mellon University.,MPI for Intelligent Systems, Tübingen, Germany
| | - Kun Zhang
- Department of Philosophy, Carnegie Mellon University
| | | | | | - Clark Glymour
- Department of Philosophy, Carnegie Mellon University
| | | |
Collapse
|