The minimum description length principle for modeling recording channels

被引:5
|
作者
Kavcic, A [1 ]
Srinivasan, M
机构
[1] Harvard Univ, Div Engn & Appl Sci, Cambridge, MA 02138 USA
[2] Flar Technol, Bedminster, NJ 07921 USA
基金
美国国家科学基金会;
关键词
autoregressive processes; magnetic recording channel; maximum likelihood estimation; minimum description length; nonstationary noise; signal-dependent noise;
D O I
10.1109/49.920180
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Modeling the magnetic recording channel has long been a challenging research problem. Typically, the tradeoff has been simplicity of the model for its accuracy. For a given family of channel models, the accuracy will grow with the model size, at a price of a more complex model. In this paper, we develop a formalism that strikes a balance between these opposing criteria, The formalism is based on Rissanen's notion of minimum required complexity - the minimum description length (MDL). The family of channel models in this study is the family of signal-dependent autoregressive channel models chosen for its simplicity of description and experimentally verified modeling accuracy. For this family of models, the minimum description complexity is directly linked to the minimum required complexity of a detector. Furthermore, the minimum description principle for autoregressive models lends itself for an intuitively pleasing interpretation. The description complexity is the sum of two terms: 1) the entropy of the sequence of uncorrelated Gaussian random variables driving the autoregressive filters, which decreases with the model order (i.e., model size), and 2) a penalty term proportional to the model size. We exploit this interpretation to formulate the minimum description length criterion for the magnetic recording channel corrupted by nonlinearities and signal-dependent noise. Results on synthetically generated data are presented to validate the method. We then apply the method to data collected from the spin stand to establish the model's size and parameters that strike a balance between complexity and accuracy.
引用
收藏
页码:719 / 729
页数:11
相关论文
共 50 条
  • [41] Determining Principal Component Cardinality Through the Principle of Minimum Description Length
    Tavory, Ami
    MACHINE LEARNING, OPTIMIZATION, AND DATA SCIENCE, 2019, 11943 : 655 - 666
  • [42] Gaussian Clusters and Noise: An Approach Based on the Minimum Description Length Principle
    Luosto, Panu
    Kivinen, Jyrki
    Mannila, Heikki
    DISCOVERY SCIENCE, DS 2010, 2010, 6332 : 251 - 265
  • [43] The Whole and the Parts: The Minimum Description Length Principle and the A-Contrario Framework
    von Gioi, Rafael Grompone
    Paulino, Ignacio Ramirez
    Randall, Gregory
    SIAM JOURNAL ON IMAGING SCIENCES, 2022, 15 (03): : 1282 - 1313
  • [44] Minimum description length principle in the field of image analysis and pattern recognition
    Potapov A.S.
    Pattern Recognition and Image Analysis, 2011, 21 (02) : 156 - 159
  • [45] Principle of minimum description length as a method of improving discriminant methods of recognition
    Potapov, A. S.
    Malyshev, I. A.
    Lutsiv, V. R.
    JOURNAL OF OPTICAL TECHNOLOGY, 2006, 73 (10) : 693 - 697
  • [46] VIBR: Visualizing Bipartite Relations at Scale with the Minimum Description Length Principle
    Chan, Gromit Yeuk-Yin
    Xu, Panpan
    Dai, Zeng
    Ren, Liu
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2019, 25 (01) : 321 - 330
  • [47] Kona: A multi-junction detector using minimum description length principle
    Parida, L
    Geiger, D
    Hummel, R
    ENERGY MINIMIZATION METHODS IN COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, 1223 : 51 - 65
  • [48] Predictive Minimum Description Length Principle Approach to Inferring Gene Regulatory Networks
    Chaitankar, Vijender
    Zhang, Chaoyang
    Ghosh, Preetam
    Gong, Ping
    Perkins, Edward J.
    Deng, Youping
    SOFTWARE TOOLS AND ALGORITHMS FOR BIOLOGICAL SYSTEMS, 2011, 696 : 37 - 43
  • [49] Adaptive ripple down rules method based on minimum description length principle
    Yoshida, T
    Wada, T
    Motoda, H
    Washio, T
    2002 IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2002, : 530 - 537
  • [50] An introduction to coding theory and the two-part minimum description length principle
    Lee, TCM
    INTERNATIONAL STATISTICAL REVIEW, 2001, 69 (02) : 169 - 183