Implicit Shape Model Trees: Recognition of 3-D Indoor Scenes and Prediction of Object Poses for Mobile Robots

被引:0
|
作者
Meissner, Pascal [1 ,3 ]
Dillmann, Ruediger [2 ]
机构
[1] Univ Aberdeen, Sch Engn, Aberdeen AB24 3UE, Scotland
[2] Karlsruhe Inst Technol KIT, Humanoids & Intelligence Syst Lab HIS, D-76131 Karlsruhe, Germany
[3] Tech Univ Appl Sci Wuerzburg Schweinfurt THWS, Ctr Artificial Intelligence & Robot CAIRO, D-97082 Wurzburg, Germany
关键词
part-based models; Hough transform; spatial relations; object arrangements; object search; mobile robotics; SEARCH;
D O I
10.3390/robotics12060158
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This article describes an approach for mobile robots to identify scenes in configurations of objects spread across dense environments. This identification is enabled by intertwining the robotic object search and the scene recognition on already detected objects. We proposed "Implicit Shape Model (ISM) trees" as a scene model to solve these two tasks together. This article presents novel algorithms for ISM trees to recognize scenes and predict object poses. For us, scenes are sets of objects, some of which are interrelated by 3D spatial relations. Yet, many false positives may occur when using single ISMs to recognize scenes. We developed ISM trees, which is a hierarchical model of multiple interconnected ISMs, to remedy this. In this article, we contribute a recognition algorithm that allows the use of these trees for recognizing scenes. ISM trees should be generated from human demonstrations of object configurations. Since a suitable algorithm was unavailable, we created an algorithm for generating ISM trees. In previous work, we integrated the object search and scene recognition into an active vision approach that we called "Active Scene Recognition". An efficient algorithm was unavailable to make their integration using predicted object poses effective. Physical experiments in this article show that the new algorithm we have contributed overcomes this problem.
引用
收藏
页数:33
相关论文
共 46 条
  • [21] Spherical Blurred Shape Model for 3-D Object and Pose Recognition: Quantitative Analysis and HCI Applications in Smart Environments
    Lopes, Oscar
    Reyes, Miguel
    Escalera, Sergio
    Gonzalez, Jordi
    IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (12) : 2379 - 2390
  • [22] Real-time global path planning for mobile robots with a complex 3-D shape in large-scale 3-D environment
    Wang, Xixun
    Moriyama, Kozo
    Brooks, Lucas
    Kameyama, Shin
    Matsuno, Fumitoshi
    ARTIFICIAL LIFE AND ROBOTICS, 2021, 26 (04) : 494 - 502
  • [23] Real-time global path planning for mobile robots with a complex 3-D shape in large-scale 3-D environment
    Xixun Wang
    Kozo Moriyama
    Lucas Brooks
    Shin Kameyama
    Fumitoshi Matsuno
    Artificial Life and Robotics, 2021, 26 : 494 - 502
  • [24] A multi-site memory model for 3-D object recognition.
    Tjan, BS
    INVESTIGATIVE OPHTHALMOLOGY & VISUAL SCIENCE, 2000, 41 (04) : S741 - S741
  • [25] 3-D Feature Point Matching for Object Recognition Based on Estimation of Local Shape Distinctiveness
    Nagase, Masanobu
    Akizuki, Shuichi
    Hashimoto, Manabu
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, PT I, 2013, 8047 : 473 - 481
  • [26] A Geometric Model for Fusing IMU into Monocular Visual Localization of 3-D Mobile Robots
    Zheng, Fan
    Liu, Yun-hui
    2016 IEEE INTERNATIONAL CONFERENCE ON REAL-TIME COMPUTING AND ROBOTICS (IEEE RCAR), 2016, : 301 - 305
  • [27] Scene Recognition for Mobile Robots by Relational Object Search using Next-Best-View Estimates from Hierarchical Implicit Shape Models
    Meissner, Pascal
    Schleicher, Ralf
    Hutmacher, Robin
    Schmidt-Rohr, Sven R.
    Dillmann, Ruediger
    2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), 2016, : 137 - 144
  • [28] 3D Object Recognition using Time of Flight Camera with Embedded GPU on Mobile Robots
    Kelenyi, Benjamin
    Molnar, Szilard
    Tamas, Levente
    PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (VISAPP), VOL 4, 2022, : 849 - 856
  • [29] Vision based Object Recognition of Mobile Robot with Kinect 3D Sensor in Indoor Environment
    Tanabe, Ryo
    Cao, Meifen
    Murao, Toshiyuki
    Hashimoto, Hiroshi
    2012 PROCEEDINGS OF SICE ANNUAL CONFERENCE (SICE), 2012, : 2203 - 2206
  • [30] Computation of shape and reflectance of 3-D object using Moire phase and reflection model
    Inagaki, A
    Tagawa, N
    Minagawa, A
    Moriya, T
    2001 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL II, PROCEEDINGS, 2001, : 177 - 180