Entropy Dimension Reduction Method for Randomized Machine Learning Problems

被引：3
|
作者：
Popkov, Yu. S. [1 ,2 ]
Dubnov, Yu. A. [1 ,3 ,4 ]
Popkov, A. Yu. [1 ,3 ,5 ]
机构：
[1] Russian Acad Sci, Fed Res Ctr Informat & Control, Inst Syst Anal, Moscow, Russia
[2] Univ Haifa, Braude Coll, Carmiel, Israel
[3] Natl Res Univ, Higher Sch Econ, Moscow, Russia
[4] Moscow Inst Phys & Technol, Moscow, Russia
[5] Peoples Friendship Univ, Moscow, Russia
来源：
AUTOMATION AND REMOTE CONTROL | 2018年 / 79卷 / 11期
基金：
俄罗斯基础研究基金会;
关键词：
entropy; relative entropy; projection operators; matrix derivatives; gradient method; direct and inverse projections; INFORMATION; ALGORITHMS;
D O I：
10.1134/S0005117918110085
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
The direct and inverse projections (DIP) method was proposed to reduce the feature space to the given dimensions oriented to the problems of randomized machine learning and based on the procedure of "direct" and "inverse" design. The "projector" matrices are determined by maximizing the relative entropy. It is suggested to estimate the information losses by the absolute error calculated with the use of the Kullback-Leibler function (SRC method). An example illustrating these methods was given.
引用
收藏
页码：2038 / 2051
页数：14
相关论文
共 50 条
  • [41] A research based on application of dimension reduction technology in data visualization using machine learning
    Chen, Jianwei
    Bian, Longlong
    Kumar, Ajit
    Neware, Rahul
    INTERNATIONAL JOURNAL OF SYSTEM ASSURANCE ENGINEERING AND MANAGEMENT, 2022, 13 (SUPPL 1) : 291 - 297
  • [42] Dimensionality Reduction, Modelling, and Optimization of Multivariate Problems Based on Machine Learning
    Alswaitti, Mohammed
    Siddique, Kamran
    Jiang, Shulei
    Alomoush, Waleed
    Alrosan, Ayat
    SYMMETRY-BASEL, 2022, 14 (07):
  • [43] A high-dimension structural reliability method based on active learning Kriging and dimension reduction technique
    Zhao, Haodong
    Zhou, Changcong
    Shi, Zhuangke
    Li, Chen
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART C-JOURNAL OF MECHANICAL ENGINEERING SCIENCE, 2022, 236 (19) : 10304 - 10320
  • [44] Attribute Reduction Based on Fractal Dimension and Joint Entropy
    Li, Hong-qi
    Xu, Qing-song
    Zhu, Li-ping
    Yang, Zhong-guo
    INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND SOFTWARE ENGINEERING (AISE 2014), 2014, : 350 - 354
  • [45] On Orthogonal Projections for Dimension Reduction and Applications in Augmented Target Loss Functions for Learning Problems
    A. Breger
    J. I. Orlando
    P. Harar
    M. Dörfler
    S. Klimscha
    C. Grechenig
    B. S. Gerendas
    U. Schmidt-Erfurth
    M. Ehler
    Journal of Mathematical Imaging and Vision, 2020, 62 : 376 - 394
  • [46] Machine learning the dimension of a Fano variety
    Tom Coates
    Alexander M. Kasprzyk
    Sara Veneziale
    Nature Communications, 14
  • [47] Machine learning the dimension of a Fano variety
    Coates, Tom
    Kasprzyk, Alexander M.
    Veneziale, Sara
    NATURE COMMUNICATIONS, 2023, 14 (01)
  • [48] A Method for Sensor Reduction in a Supervised Machine Learning Classification System
    Murrell, Niko
    Bradley, Ryan
    Bajaj, Nikhil
    Whitney, Julie Gordon
    Chiu, George T. -C.
    IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2019, 24 (01) : 197 - 206
  • [49] Problems of Machine Learning
    Chervonenkis, Alexei Ya.
    PATTERN RECOGNITION AND MACHINE INTELLIGENCE, 2011, 6744 : 21 - 23
  • [50] Adaptive Randomized Dimension Reduction on Massive Data
    Darnell, Gregory
    Georgiev, Stoyan
    Mukherjee, Sayan
    Engelhardt, Barbara E.
    JOURNAL OF MACHINE LEARNING RESEARCH, 2017, 18
12345