ENHANCING MULTI-STEP ACTION PREDICTION FOR ACTIVE OBJECT DETECTION

被引:3
|
作者
Fang, Fen [1 ]
Xu, Qianli [1 ]
Gauthier, Nicolas [1 ]
Li, Liyuan [1 ]
Lim, Joo-Hwee [1 ,2 ]
机构
[1] ASTAR, Inst Infocomm Res, Singapore, Singapore
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
关键词
active object detection; reinforcement learning; view planning; deep q-learning network (DQN);
D O I
10.1109/ICIP42928.2021.9506078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Active vision for robots is one promising solution to open world visual detection problems. A fundamental issue is view planning, i.e., predicting next best views to capture images of interest to reduce uncertainty. While multi-step action in a reinforcement learning (RL) setup can boost the efficiency of view planning, existing methods suffer from unstable detection outcome when the Q-values of multiple branches of action advantages (i.e., action range and action type) are combined naively. To tackle this issue, we propose a novel mechanism to disentangle action range from action type through a two-stage training strategy on a deep Q-network. It combines well-crafted loss functions with respect to action range and action type to enforce separated training of these two branches. We evaluate our method on two public datasets and show that it facilitates substantial gain in view planning efficiency, while enhancing detection accuracy.
引用
收藏
页码:2189 / 2193
页数:5
相关论文
共 50 条
  • [21] PREDICTION OF RESIDUAL STRESS IN MULTI-STEP ORTHOGONAL CUTTING
    Shao, Yamin
    Fergani, Omar
    Welo, Torgeir
    Liang, Steven
    PROCEEDINGS OF THE ASME 10TH INTERNATIONAL MANUFACTURING SCIENCE AND ENGINEERING CONFERENCE, 2015, VOL 1, 2015,
  • [22] Partially adapting multi-step local linear prediction
    Zhao, Zhengmin
    DIGITAL SIGNAL PROCESSING, 2014, 25 : 114 - 122
  • [23] A nonparametric multi-step prediction estimator in Markovian structures
    Chen, R
    STATISTICA SINICA, 1996, 6 (03) : 603 - 615
  • [24] Methods to Improve Multi-Step Time Series Prediction
    Koesdwiady, Arief
    El Khatib, Alaa
    Karray, Fakhri
    2018 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2018,
  • [25] Trend modeling and multi-step taxi demand prediction
    Jiang, Shan
    Feng, Yuming
    Liao, Xiaofeng
    Onasanya, B. O.
    ITALIAN JOURNAL OF PURE AND APPLIED MATHEMATICS, 2024, (51): : 275 - 294
  • [26] Temporal Convolutions for Multi-Step Quadrotor Motion Prediction
    Looper, Samuel
    Waslander, Steven L.
    2022 19TH CONFERENCE ON ROBOTS AND VISION (CRV 2022), 2022, : 32 - 39
  • [27] Reciprocal Consistency Prediction Network for Multi-Step Human Trajectory Prediction
    Zhu, Wenjun
    Liu, Yanghong
    Zhang, Mengyi
    Yi, Yang
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (06) : 6042 - 6052
  • [28] Joint multi-channel multi-step spectrum prediction algorithm
    Gao, Yulong
    Zhao, Chunyan
    Fu, Ning
    2021 IEEE 94TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2021-FALL), 2021,
  • [29] Detection algorithm for multi-step attack based on CTPN
    Yan, Fen
    Huang, Hao
    Yin, Xin-Chun
    Jisuanji Xuebao/Chinese Journal of Computers, 2006, 29 (08): : 1383 - 1391
  • [30] Multi-step planning with learned effects of partial action executions
    Aktas, Hakan
    Bozdogan, Utku
    Ugur, Emre
    ADVANCED ROBOTICS, 2024, 38 (08) : 546 - 560