Tоwаrds Rоbust Tеst-timе Аdарtаtiоn Mеthоd fоr Oреn-sеt Rесоgnitiоn

被引:0
|
作者
Zhou Z. [1 ]
Zhang D.-C. [1 ]
Li Y.-F. [1 ]
Zhang M.-L. [2 ]
机构
[1] State Key Laboratory for Novel Software Technology, Nanjing University, Nanjing
[2] School of Computer Science and Engineering, Southeast University, Nanjing
来源
Ruan Jian Xue Bao/Journal of Software | 2024年 / 35卷 / 04期
关键词
distribution shift; image classification; open-set recognition; streaming data; test-time adaptation;
D O I
10.13328/j.cnki.jos.007009
中图分类号
学科分类号
摘要
Open-set recognition is an important issue for ensuring the efficient and robust deployment of machine learning models in the open world. It aims to address the challenge of encountering samples from unseen classes that emerge during testing, i.e., to accurately classify the seen classes while identifying and rejecting the unseen ones. Current open-set recognition studies assume that the covariate distribution of the seen classes remains constant during both training and testing. However, in practical scenarios, the covariate distribution is constantly shifting, which can cause previous methods to fail, and their performance may even be worse than the baseline method. Therefore, it is urgent to study novel open-set recognition methods that can adapt to the constantly changing covariate distribution so that they can robustly classify seen categories and identify unseen categories during testing. This novel problem adaptation in the open world (AOW) is named and a test-time adaptation method is proposed for open-set recognition called open-set test-time adaptation (OTA). OTA method only utilizes unlabeled test data to update the model with adaptive entropy loss and open-set entropy loss, maintaining the model’s ability to discriminate seen classes while further enhancing its ability to recognize unseen classes. Comprehensive experiments are conducted on multiple benchmark datasets with different covariate shift levels. The results show that the proposal is robust to covariate shift and demonstrates superior performance compared to many state-of-the-art methods. © 2024 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:1667 / 1681
页数:14
相关论文
共 45 条
  • [1] Deng J, Dong W, Socher R, Et al., Imagenet: A large-scale hierarchical image database, Proc. of the 2009 IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 248-255, (2009)
  • [2] Reddy DR., Speech recognition by machine: A review, Proc. of the IEEE, 64, 4, pp. 501-531, (1976)
  • [3] Stahlberg F., Neural machine translation: A review, Journal of Artificial Intelligence Research, 69, pp. 343-418, (2020)
  • [4] Dou W, Wang HM, Jia Y, Et al., A recommendation-based peer-to-peer trust model, Ruan Jian Xue Bao/Journal of Software, 15, 4, pp. 571-583, (2004)
  • [5] Neal L, Olson M, Fern X, Et al., Open set learning with counterfactual images, Proc. of the European Conf. on Computer Vision (ECCV), pp. 613-628, (2018)
  • [6] Zhu PF, Zhang WY, Wang Y, Et al., Multi-granularity inter-class correlation based contrastive learning for open set recognition, Ruan Jian Xue Bao/Journal of Software, 33, 4, pp. 1156-1169, (2022)
  • [7] Zhou Z, Guo LZ, Cheng ZZ, Et al., STEP: Out-of-distribution detection in the presence of limited in-distribution labeled data, Advances in Neural Information Processing Systems, pp. 29168-29180, (2021)
  • [8] Zhou DW, Yang Y, Zhan DC., Learning to classify with incremental new class, IEEE Trans. on Neural Networks and Learning Systems, 33, 6, pp. 2429-2443, (2021)
  • [9] Guo LZ, Zhang ZY, Jiang Y, Et al., Safe deep semi-supervised learning for unseen-class unlabeled data, Proc. of the 37th Int’l Conf. on Machine Learning, pp. 3897-3906, (2020)
  • [10] Wong K, Wang S, Ren M, Et al., Identifying unknown instances for autonomous driving, Proc. of the Conf. on Robot Learning, pp. 384-393, (2020)