The minimum description length principle for modeling recording channels

被引:5
|
作者
Kavcic, A [1 ]
Srinivasan, M
机构
[1] Harvard Univ, Div Engn & Appl Sci, Cambridge, MA 02138 USA
[2] Flar Technol, Bedminster, NJ 07921 USA
基金
美国国家科学基金会;
关键词
autoregressive processes; magnetic recording channel; maximum likelihood estimation; minimum description length; nonstationary noise; signal-dependent noise;
D O I
10.1109/49.920180
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Modeling the magnetic recording channel has long been a challenging research problem. Typically, the tradeoff has been simplicity of the model for its accuracy. For a given family of channel models, the accuracy will grow with the model size, at a price of a more complex model. In this paper, we develop a formalism that strikes a balance between these opposing criteria, The formalism is based on Rissanen's notion of minimum required complexity - the minimum description length (MDL). The family of channel models in this study is the family of signal-dependent autoregressive channel models chosen for its simplicity of description and experimentally verified modeling accuracy. For this family of models, the minimum description complexity is directly linked to the minimum required complexity of a detector. Furthermore, the minimum description principle for autoregressive models lends itself for an intuitively pleasing interpretation. The description complexity is the sum of two terms: 1) the entropy of the sequence of uncorrelated Gaussian random variables driving the autoregressive filters, which decreases with the model order (i.e., model size), and 2) a penalty term proportional to the model size. We exploit this interpretation to formulate the minimum description length criterion for the magnetic recording channel corrupted by nonlinearities and signal-dependent noise. Results on synthetically generated data are presented to validate the method. We then apply the method to data collected from the spin stand to establish the model's size and parameters that strike a balance between complexity and accuracy.
引用
收藏
页码:719 / 729
页数:11
相关论文
共 50 条
  • [1] The minimum description length principle in coding and modeling
    Barron, A
    Rissanen, J
    Yu, B
    IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (06) : 2743 - 2760
  • [2] Introducing the minimum description length principle
    Grünwald, P
    ADVANCES IN MINIMUM DESCRIPTION LENGTH THEORY AND APPLICATIONS, 2005, : 3 - 21
  • [3] A minimum description length principle for perception
    Chater, N
    ADVANCES IN MINIMUM DESCRIPTION LENGTH THEORY AND APPLICATIONS, 2005, : 385 - 409
  • [4] LOW-RANK DATA MODELING VIA THE MINIMUM DESCRIPTION LENGTH PRINCIPLE
    Ramirez, Ignacio
    Sapiro, Guillermo
    2012 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2012, : 2165 - 2168
  • [5] Incremental Learning with the Minimum Description Length Principle
    Murena, Pierre-Alexandre
    Cornuejols, Antoine
    Dessalles, Jean-Louis
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 1908 - 1915
  • [6] Model selection and the principle of minimum description length
    Hansen, MH
    Yu, B
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (454) : 746 - 774
  • [7] Histograms based on the minimum description length principle
    Hai Wang
    Kenneth C. Sevcik
    The VLDB Journal, 2008, 17 : 419 - 442
  • [8] Histograms based on the minimum description length principle
    Wang, Hai
    Sevcik, Kenneth C.
    VLDB JOURNAL, 2008, 17 (03): : 419 - 442
  • [9] A first look at the minimum description length principle
    Grunwald, Peter D.
    INTELLIGENT ALGORITHMS IN AMBIENT AND BIOMEDICAL COMPUTING, 2006, 7 : 187 - 213
  • [10] Minimum description length and cognitive modeling
    Su, Y
    Myung, IJ
    Pitt, MA
    Advances in Minimum Description Length Theory and Applications, 2005, : 411 - 433