Random Language Model

被引：23
|
作者：
DeGiuli, E. [1 ]
机构：
[1] PSL Univ, Sorbonne Univ, Inst Phys Theor Philippe Meyer, CNRS,Ecole Normale Super, F-75005 Paris, France
来源：
PHYSICAL REVIEW LETTERS | 2019年 / 122卷 / 12期
关键词：
ENTROPY;
D O I：
10.1103/PhysRevLett.122.128301
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
Many complex generative systems use languages to create structured objects. We consider a model of random languages, defined by weighted context-free grammars. As the distribution of grammar weights broadens, a transition is found from a random phase, in which sentences are indistinguishable from noise, to an organized phase in which nontrivial information is carried. This marks the emergence of deep structure in the language, and can be understood by a competition between energy and entropy.
引用
收藏
页数：6
相关论文
共 50 条
  • [1] Robustness of the random language model
    Lalegani, Fatemeh
    De Giuli, Eric
    PHYSICAL REVIEW E, 2024, 109 (05)
  • [2] LANGUAGE MODEL ADAPTATION USING RANDOM FORESTS
    Deoras, Anoop
    Jelinek, Frederick
    Su, Yi
    2010 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2010, : 5198 - 5201
  • [3] Absence of phase transition in random language model
    Nakaishi, Kai
    Hukushima, Koji
    PHYSICAL REVIEW RESEARCH, 2022, 4 (02):
  • [4] Combination of Random Indexing based Language Model and N-gram Language Model for Speech Recognition
    Fohr, Dominique
    Mella, Odile
    14TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2013), VOLS 1-5, 2013, : 2231 - 2235
  • [5] Sign Language Spotting with a Threshold Model Based on Conditional Random Fields
    Yang, Hee-Deok
    Sclaroff, Stan
    Lee, Seong-Whan
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (07) : 1264 - 1277
  • [6] An Exploration of Chinese Language International Education Exchange and Cooperation Model Based on Random Forest Model
    Suo C.
    Applied Mathematics and Nonlinear Sciences, 2024, 9 (01)
  • [7] Clustering of Russian-Language Texts by Styles Based on the Random Walk Model
    Kramarenko, A. A.
    Nekrasov, K. A.
    PHYSICS, TECHNOLOGIES AND INNOVATION (PTI-2018), 2018, 2015
  • [8] A Stylistic Classification of Russian-Language Texts Based on the Random Walk Model
    Kramarenko, A. A.
    Nekrasov, K. A.
    Filimonov, V. V.
    Zhivoderov, A. A.
    Amieva, A. A.
    IV INTERNATIONAL YOUNG RESEARCHERS' CONFERENCE: PHYSICS, TECHNOLOGIES AND INNOVATION (PTI-2017), 2017, 1886
  • [9] Random clusterings for language modeling
    Emami, A
    Jelinek, F
    2005 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS 1-5: SPEECH PROCESSING, 2005, : 581 - 584
  • [10] Language Recognition Using Latent Dynamic Conditional Random Field Model with Phonological Features
    Boonsuk, Sirinoot
    Suchato, Atiwong
    Punyabukkana, Proadpran
    Wutiwiwatchai, Chai
    Thatphithakkul, Nattanun
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2014, 2014
12345