ENHANCING MULTI-STEP ACTION PREDICTION FOR ACTIVE OBJECT DETECTION

被引:3
|
作者
Fang, Fen [1 ]
Xu, Qianli [1 ]
Gauthier, Nicolas [1 ]
Li, Liyuan [1 ]
Lim, Joo-Hwee [1 ,2 ]
机构
[1] ASTAR, Inst Infocomm Res, Singapore, Singapore
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore, Singapore
关键词
active object detection; reinforcement learning; view planning; deep q-learning network (DQN);
D O I
10.1109/ICIP42928.2021.9506078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Active vision for robots is one promising solution to open world visual detection problems. A fundamental issue is view planning, i.e., predicting next best views to capture images of interest to reduce uncertainty. While multi-step action in a reinforcement learning (RL) setup can boost the efficiency of view planning, existing methods suffer from unstable detection outcome when the Q-values of multiple branches of action advantages (i.e., action range and action type) are combined naively. To tackle this issue, we propose a novel mechanism to disentangle action range from action type through a two-stage training strategy on a deep Q-network. It combines well-crafted loss functions with respect to action range and action type to enforce separated training of these two branches. We evaluate our method on two public datasets and show that it facilitates substantial gain in view planning efficiency, while enhancing detection accuracy.
引用
收藏
页码:2189 / 2193
页数:5
相关论文
共 50 条
  • [31] MAD: A Middleware Framework for Multi-Step Attack Detection
    Papadopoulos, Panagiotis
    Petsas, Thanasis
    Christou, Giorgos
    Vasiliadis, Giorgos
    2015 4TH INTERNATIONAL WORKSHOP ON BUILDING ANALYSIS DATASETS AND GATHERING EXPERIENCE RETURNS FOR SECURITY (BADGERS), 2015, : 8 - 15
  • [32] Multi-step planning with learned effects of partial action executions
    Aktas, Hakan
    Bozdogan, Utku
    Ugur, Emre
    Advanced Robotics, 2024, 38 (08): : 546 - 560
  • [33] A Method of Maneuver Detection Based on Multi-step Innovation
    Wang Yong
    9TH INTERNATIONAL CONFERENCE ON MECHATRONICS AND MANUFACTURING (ICMM 2018), 2018, 361
  • [34] Mechanical Search: Multi-Step Retrieval of a Target Object Occluded by Clutter
    Danielczuk, Michael
    Kurenkov, Audrey
    Balakrishna, Ashwin
    Matl, Matthew
    Wang, David
    Martin-Martin, Roberto
    Garg, Animesh
    Savarese, Silvio
    Goldberg, Ken
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 1614 - 1621
  • [35] Multi-step entropy based sensor control for visual object tracking
    Deutsch, B
    Zobel, M
    Denzler, J
    Niemann, H
    PATTERN RECOGNITION, 2004, 3175 : 359 - 366
  • [36] Iterative multi-step prediction model based on theory of evidence
    Hong, Bei
    Hu, Chang-Hua
    Jiang, Xue-Peng
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2010, 27 (12): : 1737 - 1742
  • [37] Fuzzy multi-step ahead prediction of VBR video sources
    Qiu, B
    Zhang, LR
    Wu, HR
    ICICS - PROCEEDINGS OF 1997 INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS AND SIGNAL PROCESSING, VOLS 1-3: THEME: TRENDS IN INFORMATION SYSTEMS ENGINEERING AND WIRELESS MULTIMEDIA COMMUNICATIONS, 1997, : 1623 - 1626
  • [38] Notes on multi-step ahead prediction based on the principle of concatenation
    Rossiter, J.A.
    Proceedings of the Institution of Mechanical Engineers. Part I, Journal of systems and control engineering, 1993, 207 (04) : 261 - 263
  • [39] A novel iterated multi-step prediction method of traffic flow
    Zhu, Zhengyu
    Guo, Chongxiao
    Liu, Lin
    Journal of Information and Computational Science, 2014, 11 (08): : 2569 - 2584
  • [40] Multi-object Tracking Cascade with Multi-Step Data Association and Occlusion Handling
    Al-Shakarji, Noor M.
    Bunyak, Filiz
    Seetharaman, Guna
    Palaniappan, Kannappan
    2018 15TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE (AVSS), 2018, : 423 - 428