Entropy Dimension Reduction Method for Randomized Machine Learning Problems

The direct and inverse projections (DIP) method was proposed to reduce the feature space to the given dimensions oriented to the problems of randomized machine learning and based on the procedure of "direct" and "inverse" design. The "projector" matrices are determined by maximizing the relative entropy. It is suggested to estimate the information losses by the absolute error calculated with the use of the Kullback-Leibler function (SRC method). An example illustrating these methods was given.