ENHANCING MULTI-STEP ACTION PREDICTION FOR ACTIVE OBJECT DETECTION

被引:3
|
作者
Fang, Fen [1 ]
Xu, Qianli [1 ]
Gauthier, Nicolas [1 ]
Li, Liyuan [1 ]
Lim, Joo-Hwee [1 ,2 ]
机构
[1] ASTAR, Inst Infocomm Res, Singapore, Singapore
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
关键词
active object detection; reinforcement learning; view planning; deep q-learning network (DQN);
D O I
10.1109/ICIP42928.2021.9506078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Active vision for robots is one promising solution to open world visual detection problems. A fundamental issue is view planning, i.e., predicting next best views to capture images of interest to reduce uncertainty. While multi-step action in a reinforcement learning (RL) setup can boost the efficiency of view planning, existing methods suffer from unstable detection outcome when the Q-values of multiple branches of action advantages (i.e., action range and action type) are combined naively. To tackle this issue, we propose a novel mechanism to disentangle action range from action type through a two-stage training strategy on a deep Q-network. It combines well-crafted loss functions with respect to action range and action type to enforce separated training of these two branches. We evaluate our method on two public datasets and show that it facilitates substantial gain in view planning efficiency, while enhancing detection accuracy.
引用
收藏
页码:2189 / 2193
页数:5
相关论文
共 50 条
  • [41] Multi-step forward intelligent prediction of tool wear condition
    Zhu, Kunpeng
    Huang, Chengyi
    Li, Jun
    Jisuanji Jicheng Zhizao Xitong/Computer Integrated Manufacturing Systems, CIMS, 2024, 30 (09): : 3038 - 3049
  • [42] Learning multi-step prediction models for receding horizon control
    Terzi, Enrico
    Fagiano, Lorenzo
    Farina, Marcello
    Scattolini, Riccardo
    2018 EUROPEAN CONTROL CONFERENCE (ECC), 2018, : 1335 - 1340
  • [43] Multi-step time series prediction intervals using neuroevolution
    Cortez, Paulo
    Pereira, Pedro Jose
    Mendes, Rui
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (13): : 8939 - 8953
  • [44] A Multi-step Ahead Dyadic Particle Filter for Price Prediction
    Ntemi, Myrsini
    Kotropoulos, Constantine
    29TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2021), 2021, : 1516 - 1520
  • [45] Multi-step prediction error approach for controller performance monitoring
    Zhao, Yu
    Chu, Jian
    Su, Hongye
    Huang, Biao
    CONTROL ENGINEERING PRACTICE, 2010, 18 (01) : 1 - 12
  • [46] Multi-step prediction of time series with random missing data
    Wu, Xuedong
    Wang, Yaonan
    Mao, Jianxu
    Du, Zhaoping
    Li, Chunhua
    APPLIED MATHEMATICAL MODELLING, 2014, 38 (14) : 3512 - 3522
  • [47] Draw on advantages and avoid disadvantages by making a multi-step prediction
    Zhu, Guofeng
    Zhu, Fei
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 237
  • [48] A novel multi-step prediction for wind speed based on EMD
    Liu, Xingjie
    Mi, Zengqiang
    Yang, Qixun
    Fan, Xiaowei
    Diangong Jishu Xuebao/Transactions of China Electrotechnical Society, 2010, 25 (04): : 165 - 170
  • [49] Multi-step time series prediction intervals using neuroevolution
    Paulo Cortez
    Pedro José Pereira
    Rui Mendes
    Neural Computing and Applications, 2020, 32 : 8939 - 8953
  • [50] Error analysis of a multi-step prediction based blind equalizer
    Mannerkoski, J
    Koivunen, V
    ISCAS '99: PROCEEDINGS OF THE 1999 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL 3: ANALOG AND DIGITAL SIGNAL PROCESSING, 1999, : 86 - 89