Entropy Dimension Reduction Method for Randomized Machine Learning Problems

被引：3

作者：

Popkov, Yu. S. ^{[1
,2
]}

Dubnov, Yu. A. ^{[1
,3
,4
]}

Popkov, A. Yu. ^{[1
,3
,5
]}

机构：

[1] Russian Acad Sci, Fed Res Ctr Informat & Control, Inst Syst Anal, Moscow, Russia

[2] Univ Haifa, Braude Coll, Carmiel, Israel

[3] Natl Res Univ, Higher Sch Econ, Moscow, Russia

[4] Moscow Inst Phys & Technol, Moscow, Russia

[5] Peoples Friendship Univ, Moscow, Russia

来源：

AUTOMATION AND REMOTE CONTROL | 2018年 / 79卷 / 11期

基金：

俄罗斯基础研究基金会;

关键词：

entropy; relative entropy; projection operators; matrix derivatives; gradient method; direct and inverse projections; INFORMATION; ALGORITHMS;

D O I：

10.1134/S0005117918110085

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The direct and inverse projections (DIP) method was proposed to reduce the feature space to the given dimensions oriented to the problems of randomized machine learning and based on the procedure of "direct" and "inverse" design. The "projector" matrices are determined by maximizing the relative entropy. It is suggested to estimate the information losses by the absolute error calculated with the use of the Kullback-Leibler function (SRC method). An example illustrating these methods was given.

引用

页码：2038 / 2051

页数：14

共 50 条

[21] Dimension reduction based on small sample entropy learning for hand-writing image
Murong Yang
Jigen Peng
Ziyan Qin
Penghe Chen
Dequan Jin
Multimedia Tools and Applications, 2021, 80 : 17365 - 17376
[22] An Experimental Study of Dimension Reduction Methods on Machine Learning Algorithms with Applications to Psychometrics
Merritt, Sean H.
Christensen, Alexander P.
ADVANCES IN ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING, 2023, 3 (01): : 760 - 777
[23] Using Entropy for Dimension Reduction of Tactile Data
Schoepfer, Matthias
Pardowitz, Michael
Ritter, Helge
ICAR: 2009 14TH INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS, VOLS 1 AND 2, 2009, : 386 - 391
[24] Kernel Entropy Discriminant Analysis for Dimension Reduction
Mehta, Aditya
Sekhar, C. Chandra
PATTERN RECOGNITION AND MACHINE INTELLIGENCE, PREMI 2017, 2017, 10597 : 35 - 42
[25] Daily Load Curve Clustering Method Based on Feature Index Dimension Reduction and Entropy Weight Method
Song J.
He C.
Li X.
Liu Z.
Tang J.
Zhong W.
Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2019, 43 (20): : 65 - 72
[26] A MACHINE LEARNING METHOD TO DETERMINE INTRINSIC DIMENSION OF TIME SERIES DATA
Turchetti, Claudio
Falaschetti, Laura
2017 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2017), 2017, : 303 - 307
[27] Randomized large distortion dimension reduction
Alon Dmitriyuk
Yehoram Gordon
Positivity, 2014, 18 : 767 - 784
[28] Randomized large distortion dimension reduction
Dmitriyuk, Alon
Gordon, Yehoram
POSITIVITY, 2014, 18 (04) : 767 - 784
[29] A Discriminative Manifold Learning Based Dimension Reduction Method for Hyperspectral Classification
Du, Bo
Zhang, Liangpei
Zhang, Lefei
Chen, Tao
Wu, Ke
INTERNATIONAL JOURNAL OF FUZZY SYSTEMS, 2012, 14 (02) : 272 - 277
[30] Clustered Nystrom Method for Large Scale Manifold Learning and Dimension Reduction
Zhang, Kai
Kwok, James T.
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (10): : 1576 - 1587

← 1 2 3 4 5 →