Transparent object segmentation from casually captured videos

被引:2
|
作者
Liao, Jie [1 ]
Fu, Yanping [1 ]
Yan, Qingan [2 ]
Xiao, Chunxia [1 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan, Peoples R China
[2] JD Com, Silicon Valley Res Ctr Multimedia Software, Mountain View, CA USA
基金
中国国家自然科学基金;
关键词
object segmentation; saliency estimation; video processing;
D O I
10.1002/cav.1950
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Segmentation of transparent objects from sequences can be very useful in computer vision applications. However, without additional auxiliary information it can be hard work for traditional segmentation methods, as light in the transparent area captured by RGB cameras mostly derive from the background and the appearance of transparent objects changes with surroundings. In this article, we present a from-coarse-to-fine transparent object segmentation method, which utilizes trajectory clustering to roughly distinguish the transparent from the background and refine the segmentation based on combination information of color and distortion. We further incorporate the transparency saliency with color and trajectory smoothness throughout the video to acquire a spatiotemporal segmentation based on graph-cut. We conduct our method on various datasets. The results demonstrate that our method can successfully segment transparent objects from the background.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Towards Casually Captured 6DoF VR Videos
    Sun, Haoxi
    Zollmann, Stefanie
    2022 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR), 2022, : 180 - 183
  • [2] Unstructured Video-Based Rendering: Interactive Exploration of Casually Captured Videos
    Ballan, Luca
    Brostow, Gabriel J.
    Puwein, Jens
    Pollefeys, Marc
    ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (04):
  • [3] 3D Reconstruction and Video-Based Rendering of Casually Captured Videos
    Taneja, Aparna
    Ballan, Luca
    Puwein, Jens
    Brostow, Gabriel J.
    Pollefeys, Marc
    VIDEO PROCESSING AND COMPUTATIONAL VIDEO, 2011, 7082 : 77 - +
  • [4] Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFs
    Warburg, Frederik
    Weber, Ethan
    Tancik, Matthew
    Holynski, Aleksander
    Kanazawa, Angjoo
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 18074 - 18084
  • [5] Segmentation of underwater object in videos
    Zhu, Yuemei
    Song, Yan
    Zhang, Xin
    Lv, Pengfei
    Li, Guangliang
    He, Bo
    Yan, Tianhong
    2018 OCEANS - MTS/IEEE KOBE TECHNO-OCEANS (OTO), 2018,
  • [6] Object proposals for salient object segmentation in videos
    Kalboussi, Rahma
    Azaza, Aymen
    van de Weijer, Joost
    Abdellaoui, Mehrez
    Douik, Ali
    MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (13-14) : 8677 - 8693
  • [7] Object proposals for salient object segmentation in videos
    Rahma Kalboussi
    Aymen Azaza
    Joost van de Weijer
    Mehrez Abdellaoui
    Ali Douik
    Multimedia Tools and Applications, 2020, 79 : 8677 - 8693
  • [8] Unsupervised Object Discovery and Segmentation in Videos
    Schulter, Samuel
    Leistner, Christian
    Roth, Peter M.
    Bischof, Horst
    PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2013, 2013,
  • [9] Weakly supervised object localization and segmentation in videos
    Rochan, Mrigank
    Rahman, Shafin
    Bruce, Neil D. B.
    Wang, Yang
    IMAGE AND VISION COMPUTING, 2016, 56 : 1 - 12
  • [10] A new method of object segmentation in the basketball videos
    Wu, Lifang
    Meng, Xianglong
    Liu, Xun
    Chen, Shiju
    18TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2006, : 319 - +