The Maximum Likelihood Degree of Mixtures of Independence Models

被引:8
|
作者
Rodriguez, Jose Israel [1 ]
Wang, Botong [2 ]
机构
[1] Univ Chicago, Dept Stat, Chicago, IL 60637 USA
[2] Univ Wisconsin, Dept Math, Madison, WI 53706 USA
来源
关键词
algebraic statistics; maximum likelihood estimation; mixture models; Euler characteristics; VARIETIES; GEOMETRY; CYCLES;
D O I
10.1137/16M1088843
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
The maximum likelihood degree (ML degree) measures the algebraic complexity of a fundamental optimization problem in statistics: maximum likelihood estimation. In this problem, one maximizes the likelihood function over an algebraic statistical model. The ML degree of a model is an upper bound to the number of local extrema of the likelihood function and can be expressed as a weighted sum of Euler characteristics. The independence model (i.e., rank 1 matrices over the probability simplex) is well known to have an ML degree of one, meaning there is a unique local maximum of the likelihood function. However, for mixtures of independence models (i.e., rank 2 matrices over the probability simplex), it was an open question as to how the ML degree behaved. In this paper, we use Euler characteristics to prove an outstanding conjecture by Hauenstein, the first author, and Sturmfels; we give recursions and closed form expressions for the ML degree of mixtures of independence models.
引用
收藏
页码:484 / 506
页数:23
相关论文
共 50 条
  • [1] Marginal Likelihood Integrals for Mixtures of Independence Models
    Lin, Shaowei
    Sturmfels, Bernd
    Xu, Zhiqiang
    JOURNAL OF MACHINE LEARNING RESEARCH, 2009, 10 : 1611 - 1631
  • [2] Maximum likelihood degree of variance component models
    Gross, Elizabeth
    Drton, Mathias
    Petrovic, Sonja
    ELECTRONIC JOURNAL OF STATISTICS, 2012, 6 : 993 - 1016
  • [3] Quasi-independence models with rational maximum likelihood estimator
    Coons, Jane Ivy
    Sullivant, Seth
    JOURNAL OF SYMBOLIC COMPUTATION, 2021, 104 : 917 - 941
  • [4] The maximum likelihood degree
    Catanese, Fabrizio
    Hosten, Serkan
    Khetan, Amit
    Sturmfels, Bernd
    AMERICAN JOURNAL OF MATHEMATICS, 2006, 128 (03) : 671 - 697
  • [5] MAXIMUM-LIKELIHOOD ESTIMATION OF AUTOREGRESSIVE MODELS WITH CONDITIONAL INDEPENDENCE CONSTRAINTS
    Songsiri, Jitkomut
    Dahl, Joachim
    Vandenberghe, Lieven
    2009 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1- 8, PROCEEDINGS, 2009, : 1701 - +
  • [6] Bounding the maximum likelihood degree
    Budur, Nero
    Wang, Botong
    MATHEMATICAL RESEARCH LETTERS, 2015, 22 (06) : 1613 - 1620
  • [7] Bounding the maximum likelihood degree
    Budur, Nero
    Wang, Botong
    MATHEMATICAL RESEARCH LETTERS, 2018, 25 (06) : 1613 - 1620
  • [8] INDEPENDENCE, CLIQUE SIZE AND MAXIMUM DEGREE
    FAJTLOWICZ, S
    COMBINATORICA, 1984, 4 (01) : 35 - 38
  • [9] The maximum likelihood degree of toric varieties
    Amendola, Carlos
    Bliss, Nathan
    Burke, Isaac
    Gibbons, Courtney R.
    Helmer, Martin
    Hosten, Serkan
    Nash, Evan D.
    Rodriguez, Jose Israel
    Smolkin, Daniel
    JOURNAL OF SYMBOLIC COMPUTATION, 2019, 92 : 222 - 242
  • [10] The maximum likelihood degree of Fermat hypersurfaces
    Agostini, Daniele
    Alberelli, Davide
    Grande, Francesco
    Lella, Paolo
    JOURNAL OF ALGEBRAIC STATISTICS, 2015, 6 (02) : 108 - 132