Random Language Model

被引：23
|
作者：
DeGiuli, E. [1 ]
机构：
[1] PSL Univ, Sorbonne Univ, Inst Phys Theor Philippe Meyer, CNRS,Ecole Normale Super, F-75005 Paris, France
来源：
PHYSICAL REVIEW LETTERS | 2019年 / 122卷 / 12期
关键词：
ENTROPY;
D O I：
10.1103/PhysRevLett.122.128301
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
Many complex generative systems use languages to create structured objects. We consider a model of random languages, defined by weighted context-free grammars. As the distribution of grammar weights broadens, a transition is found from a random phase, in which sentences are indistinguishable from noise, to an organized phase in which nontrivial information is carried. This marks the emergence of deep structure in the language, and can be understood by a competition between energy and entropy.
引用
收藏
页数：6
相关论文
共 50 条
  • [21] Translating EXPRESS language model into C language model
    Yu, CY
    Wu, MH
    Liu, N
    Zhuang, YT
    Pan, YH
    ACM SIGPLAN NOTICES, 2003, 38 (06) : 30 - 39
  • [22] Establishment of a Fuzzy Comprehensive Evaluation Random Matrix Model for the Assessment of Foreign Language Translation Level in Universities
    Xie, Li
    Wu, Jin
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
  • [23] Random walk theory applied to language identification
    Marcheret, E
    Savic, M
    1997 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOLS I - V: VOL I: PLENARY, EXPERT SUMMARIES, SPECIAL, AUDIO, UNDERWATER ACOUSTICS, VLSI; VOL II: SPEECH PROCESSING; VOL III: SPEECH PROCESSING, DIGITAL SIGNAL PROCESSING; VOL IV: MULTIDIMENSIONAL SIGNAL PROCESSING, NEURAL NETWORKS - VOL V: STATISTICAL SIGNAL AND ARRAY PROCESSING, APPLICATIONS, 1997, : 1119 - 1122
  • [24] LANGUAGE, STRUCTURE AND VISION IN SMOLLETTS 'RODERICK RANDOM'
    ROSS, IC
    ETUDES ANGLAISES, 1978, 31 (01): : 52 - 63
  • [25] RECURRENT CONDITIONAL RANDOM FIELD FOR LANGUAGE UNDERSTANDING
    Yao, Kaisheng
    Peng, Baolin
    Zweig, Geoffrey
    Yu, Dong
    Li, Xiaolong
    Gao, Feng
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [26] InitialGAN: A Language GAN With Completely Random Initialization
    Ren, Da
    Li, Qing
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (12) : 18431 - 18444
  • [27] The problem of generalizing to a language population: A ''random'' controversy
    Leonard, CL
    Orchard, D
    JOURNAL OF SPEECH AND HEARING RESEARCH, 1996, 39 (02): : 406 - 413
  • [28] RANDOM NOTES OF A MODERN LANGUAGE TEACHER IN EUROPE
    Whitney, Marian P.
    MODERN LANGUAGE JOURNAL, 1921, 5 (08): : 429 - 434
  • [29] Random function model for dependent random variables
    Chen JianBing
    Wan ZhiQiang
    Song PengYan
    SCIENTIA SINICA-PHYSICA MECHANICA & ASTRONOMICA, 2018, 48 (01)
  • [30] Random matrices and the Potts model on random graphs
    Guionnet, Alice
    PROBABILITY AND STATISTICAL PHYSICS IN ST. PETERSBURG, 2016, 91 : 273 - 302
12345