The minimum description length principle for modeling recording channels

被引:5
|
作者
Kavcic, A [1 ]
Srinivasan, M
机构
[1] Harvard Univ, Div Engn & Appl Sci, Cambridge, MA 02138 USA
[2] Flar Technol, Bedminster, NJ 07921 USA
基金
美国国家科学基金会;
关键词
autoregressive processes; magnetic recording channel; maximum likelihood estimation; minimum description length; nonstationary noise; signal-dependent noise;
D O I
10.1109/49.920180
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Modeling the magnetic recording channel has long been a challenging research problem. Typically, the tradeoff has been simplicity of the model for its accuracy. For a given family of channel models, the accuracy will grow with the model size, at a price of a more complex model. In this paper, we develop a formalism that strikes a balance between these opposing criteria, The formalism is based on Rissanen's notion of minimum required complexity - the minimum description length (MDL). The family of channel models in this study is the family of signal-dependent autoregressive channel models chosen for its simplicity of description and experimentally verified modeling accuracy. For this family of models, the minimum description complexity is directly linked to the minimum required complexity of a detector. Furthermore, the minimum description principle for autoregressive models lends itself for an intuitively pleasing interpretation. The description complexity is the sum of two terms: 1) the entropy of the sequence of uncorrelated Gaussian random variables driving the autoregressive filters, which decreases with the model order (i.e., model size), and 2) a penalty term proportional to the model size. We exploit this interpretation to formulate the minimum description length criterion for the magnetic recording channel corrupted by nonlinearities and signal-dependent noise. Results on synthetically generated data are presented to validate the method. We then apply the method to data collected from the spin stand to establish the model's size and parameters that strike a balance between complexity and accuracy.
引用
收藏
页码:719 / 729
页数:11
相关论文
共 50 条
  • [21] Increasing generalizability via the principle of minimum description length Comment
    Bonifay, Wes
    BEHAVIORAL AND BRAIN SCIENCES, 2022, 45
  • [22] Minimum Description Length Principle for Fat-Tailed Distributions
    Nonchev, Bono
    NONLINEAR DYNAMICS OF ELECTRONIC SYSTEMS, 2014, 438 : 68 - 75
  • [23] Minimum Description Length Principle in Supervised Learning With Application to Lasso
    Kawakita, Masanori
    Takeuchi, Jun'ichi
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2020, 66 (07) : 4245 - 4269
  • [24] MINIMUM DESCRIPTION LENGTH PRINCIPLE FOR LINEAR MIXED EFFECTS MODELS
    Li, Li
    Yao, Fang
    Craiu, Radu V.
    Zou, Jialin
    STATISTICA SINICA, 2014, 24 (03) : 1161 - 1178
  • [25] Evaluating the significance of sequence motifs by the minimum description length principle
    Ma, QC
    Wang, JTL
    PROCEEDINGS OF THE FIFTH JOINT CONFERENCE ON INFORMATION SCIENCES, VOLS 1 AND 2, 2000, : A798 - A801
  • [26] Practical uses of the minimum description length principle in inductive learning
    1995, Austrian Soc for Artificial Intelligence, Vienna, Austria (13): : 3 - 4
  • [27] PSI-BLAST pseudocounts and the minimum description length principle
    Altschul, Stephen F.
    Gertz, E. Michael
    Agarwala, Richa
    Schaffer, Alejandro A.
    Yu, Yi-Kuo
    NUCLEIC ACIDS RESEARCH, 2009, 37 (03) : 815 - 824
  • [28] INFERRING DECISION TREES USING THE MINIMUM DESCRIPTION LENGTH PRINCIPLE
    QUINLAN, JR
    RIVEST, RL
    INFORMATION AND COMPUTATION, 1989, 80 (03) : 227 - 248
  • [29] Minimum Description Length Principle for Maximum Entropy Model Selection
    Pandey, Gaurav
    Dukkipati, Ambedkar
    2013 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS (ISIT), 2013, : 1521 - 1525
  • [30] Cluster Validity Measures Based on the Minimum Description Length Principle
    Georgieva, Olga
    Tschumitschew, Katharina
    Klawonn, Frank
    KNOWLEDGE-BASED AND INTELLIGENT INFORMATION AND ENGINEERING SYSTEMS, PT I: 15TH INTERNATIONAL CONFERENCE, KES 2011, 2011, 6881 : 82 - 89