Sparse Nonparametric Graphical Models

被引:34
|
作者
Lafferty, John [1 ,2 ]
Liu, Han [3 ]
Wasserman, Larry [4 ,5 ]
机构
[1] Univ Chicago, Dept Stat, Chicago, IL 60637 USA
[2] Univ Chicago, Dept Comp Sci, Chicago, IL 60637 USA
[3] Princeton Univ, Dept Operat Res & Financial Engn, Princeton, NJ 08544 USA
[4] Carnegie Mellon Univ, Dept Stat, Pittsburgh, PA 15213 USA
[5] Carnegie Mellon Univ, Machine Learning Dept, Pittsburgh, PA 15213 USA
关键词
Kernel density estimation; Gaussian copula; high-dimensional inference; undirected graphical model; oracle inequality; consistency; SELECTION;
D O I
10.1214/12-STS391
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We present some nonparametric methods for graphical modeling. In the discrete case, where the data are binary or drawn from a finite alphabet,Markov random fields are already essentially nonparametric, since the cliques can take only a finite number of values. Continuous data are different. The Gaussian graphical model is the standard parametric model for continuous data, but it makes distributional assumptions that are often unrealistic. We discuss two approaches to building more flexible graphical models. One allows arbitrary graphs and a nonparametric extension of the Gaussian; the other uses kernel density estimation and restricts the graphs to trees and forests. Examples of both methods are presented. We also discuss possible future research directions for nonparametric graphical modeling.
引用
收藏
页码:519 / 537
页数:19
相关论文
共 50 条
  • [1] Nonparametric Neighborhood Selection in Graphical Models
    Dong, Hao
    Wang, Yuedong
    Journal of Machine Learning Research, 2022, 23
  • [2] Sparse Matrix Graphical Models
    Leng, Chenlei
    Tang, Cheng Yong
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2012, 107 (499) : 1187 - 1200
  • [3] Nonparametric Neighborhood Selection in Graphical Models
    Dong, Hao
    Wang, Yuedong
    JOURNAL OF MACHINE LEARNING RESEARCH, 2022, 23
  • [4] Bayesian nonparametric sparse VAR models
    Billio, Monica
    Casarin, Roberta
    Rossini, Luca
    JOURNAL OF ECONOMETRICS, 2019, 212 (01) : 97 - 115
  • [5] Nonparametric Finite Mixture of Gaussian Graphical Models
    Lee, Kevin H.
    Xue, Lingzhou
    TECHNOMETRICS, 2018, 60 (04) : 511 - 521
  • [6] Identification of Sparse Reciprocal Graphical Models
    Alpago, Daniele
    Zorzi, Mattia
    Ferrante, Augusto
    IEEE CONTROL SYSTEMS LETTERS, 2018, 2 (04): : 659 - 664
  • [7] Learning to Discover Sparse Graphical Models
    Belilovsky, Eugene
    Kastner, Kyle
    Varoquaux, Gad
    Blaschko, Matthew B.
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [8] Bayesian sparse graphical models and their mixtures
    Talluri, Rajesh
    Baladandayuthapani, Veerabhadran
    Mallick, Bani K.
    STAT, 2014, 3 (01): : 109 - 125
  • [9] Graphical models for sparse data: Graphical Gaussian models with vertex and edge symmetries
    Hojsgaard, Soren
    COMPSTAT 2008: PROCEEDINGS IN COMPUTATIONAL STATISTICS, 2008, : 105 - 116
  • [10] Learning Nonparametric Forest Graphical Models with Prior Information
    Zhu, Yuancheng
    Liu, Zhe
    Sun, Siqi
    ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 54, 2017, 54 : 672 - 680