Constraint selection in metric learning

被引:7
|
作者
Le Capitaine, Hoel [1 ]
机构
[1] Ecole Polytech Nantes, LS2N, UMR CNRS 6004, Nantes, France
关键词
Active learning; Dynamic constraint selection; Metric learning; Sample weighting; Stochastic learning; SIMILARITY; CLASSIFIERS;
D O I
10.1016/j.knosys.2018.01.026
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A number of machine learning and knowledge-based algorithms are using a metric, or a distance, in order to compare individuals. The Euclidean distance is usually employed, but it may be more efficient to learn a parametric distance such as Mahalanobis metric. Learning such a metric is a hot topic since more than ten years now, and a number of methods have been proposed to efficiently learn it. However, the nature of the problem makes it quite difficult for large scale data, as well as data for which classes overlap. This paper presents a simple way of improving accuracy and scalability of any iterative metric learning algorithm, where constraints are obtained prior to the algorithm. The proposed approach relies on a loss-dependent weighted selection of constraints that are used for learning the metric. Using the corresponding dedicated loss function, the method clearly allows to obtain better results than stateof-the-art methods, both in terms of accuracy and time complexity. Some experimental results on real world, and potentially large, datasets are demonstrating the effectiveness of our proposition. (C) 2018 Elsevier B.V. All rights reserved.
引用
收藏
页码:91 / 103
页数:13
相关论文
共 50 条
  • [41] Portfolio selection with a drawdown constraint
    Alexander, Gordon J.
    Baptista, Alexandre M.
    JOURNAL OF BANKING & FINANCE, 2006, 30 (11) : 3171 - 3189
  • [42] Adaptive graph learning and low-rank constraint for supervised spectral feature selection
    Zhi Zhong
    Neural Computing and Applications, 2020, 32 : 6503 - 6512
  • [43] An adjacency constraint on argument selection
    Takahashi, Kei
    Ishikawa, Kiyoshi
    PACLIC 18: PROCEEDINGS OF THE 18TH PACIFIC ASIA CONFERENCE ON LANGUAGE, INFORMATION AND COMPUTATION, 2004, : 23 - 34
  • [44] Feature Selection based on Manifold-Learning with Dynamic Constraint Handling Differential Evolution
    Li, Zhihui
    Shang, Zhigang
    Qu, B. Y.
    Liang, J. J.
    2014 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2014, : 332 - 337
  • [45] Constraint selection and deterministic annealing
    Mees, AI
    Tovey, C
    JOURNAL OF GLOBAL OPTIMIZATION, 2003, 27 (2-3) : 233 - 247
  • [46] Adaptive graph learning and low-rank constraint for supervised spectral feature selection
    Zhong, Zhi
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (11): : 6503 - 6512
  • [47] A HOMERIC CONSTRAINT ON SEX SELECTION
    CAMPBELL, C
    HASTINGS CENTER REPORT, 1987, 17 (05) : 2 - 3
  • [48] Feature Selection with Cost Constraint
    Liu, Xiaoping
    Li, Xiao-Bai
    AMCIS 2017 PROCEEDINGS, 2017,
  • [49] Developmental constraint and natural selection
    Arthur, W
    EVOLUTION & DEVELOPMENT, 2003, 5 (02) : 117 - 118
  • [50] Constraint Selection and Deterministic Annealing
    Alistair I. Mees
    Cameron Tovey
    Journal of Global Optimization, 2003, 27 : 233 - 247