Bayesian Structure Learning with Generative Flow NetworksShow others and affiliations
2022 (English)In: Proceedings of the 38th Conference on Uncertainty in Artificial Intelligence, UAI 2022, Association For Uncertainty in Artificial Intelligence (AUAI) , 2022, p. 518-528Conference paper, Published paper (Refereed)
Abstract [en]
In Bayesian structure learning, we are interested in inferring a distribution over the directed acyclic graph (DAG) structure of Bayesian networks, from data. Defining such a distribution is very challenging, due to the combinatorially large sample space, and approximations based on MCMC are often required. Recently, a novel class of probabilistic models, called Generative Flow Networks (GFlowNets), have been introduced as a general framework for generative modeling of discrete and composite objects, such as graphs. In this work, we propose to use a GFlowNet as an alternative to MCMC for approximating the posterior distribution over the structure of Bayesian networks, given a dataset of observations. Generating a sample DAG from this approximate distribution is viewed as a sequential decision problem, where the graph is constructed one edge at a time, based on learned transition probabilities. Through evaluation on both simulated and real data, we show that our approach, called DAG-GFlowNet, provides an accurate approximation of the posterior over DAGs, and it compares favorably against other methods based on MCMC or variational inference.
Place, publisher, year, edition, pages
Association For Uncertainty in Artificial Intelligence (AUAI) , 2022. p. 518-528
Keywords [en]
Artificial intelligence, Flow graphs, Probability distributions, Acyclic graphs, Bayesia n networks, Bayesian structure learning, Composite objects, Discrete objects, Flow network, Generative model, Graph structures, Probabilistic models, Sample space, Bayesian networks
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-327050Scopus ID: 2-s2.0-85137616447OAI: oai:DiVA.org:kth-327050DiVA, id: diva2:1758487
Conference
38th Conference on Uncertainty in Artificial Intelligence, UAI 2022, 1 August - 5 August 2022, Eindhoven, Netherlands
Note
QC 20230523
2023-05-232023-05-232023-11-13Bibliographically approved