A Graph-based Framework for Video Object Segmentation and Extraction in Feature Space

被引:0
|
作者
Fan, Lei [1 ,3 ]
Loui, Alexander C. [2 ]
机构
[1] Rochester Inst Technol, Digital Imaging & Remote Sensing, Rochester, NY 14623 USA
[2] Kodak Alaris Inc, Imaging R&D, Rochester, NY USA
[3] Kodak Alaris, Rochester, NY USA
关键词
Video segmentation; object extraction; graph theory; graph cut; saliency detection; spatiotemporal; consumer videos; TRACKING; COLOR;
D O I
10.1109/ISM.2015.33
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Video segmentation is the task of grouping pixels in successive video frames into perceptually coherent regions. It is a preliminary step to solve higher level problems such as automated surveillance, object tracking, video summarization, video indexing and retrieval. For consumer videos, video segmentation is a useful tool for extracting relevant and interesting content from such video sequence for further analysis or repurposing of the visual content. Given an unannotated video sequence captured by either a static or hand-held camera, our graph-based approach first effectively models the data in a high dimensional feature space, which emphasizes the correlation between similar pixels while reducing the interclass connectivity between different objects. The graph model fuses appearance, spatial, and temporal information to break a volumetric video sequence into semantic spatiotemporal key-segments. By further grouping the key-segments, a binary segmentation is able to extract a moving object of interest from a video sequence based on its unique and distinguishable regional properties. Experiment results show the robustness of our approach, which has achieved comparable or better performance when compared to several unsupervised methods.
引用
收藏
页码:266 / 271
页数:6
相关论文
共 50 条
  • [31] A ROBUST FRAMEWORK FOR REGION BASED VIDEO OBJECT SEGMENTATION
    Escudero-Vinolo, Marcos
    Bescos, Jesus
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 3461 - 3464
  • [32] Streaming graph-based hierarchical video segmentation by a simple label propagation
    de Souza, Kleber J. F.
    Araujo, Arnaldo de A.
    Guimaraes, Silvio J. F.
    do Patrocinio, Zenilton K. G., Jr.
    Cord, Matthieu
    2015 28TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES, 2015, : 119 - 125
  • [33] Graph-Based Semantic Segmentation
    Balaska, Vasiliki
    Bampis, Loukas
    Gasteratos, Antonios
    ADVANCES IN SERVICE AND INDUSTRIAL ROBOTICS, RAAD 2018, 2019, 67 : 572 - 579
  • [34] Graph-based object tracking
    Gomila, C
    Meyer, F
    2003 INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOL 2, PROCEEDINGS, 2003, : 41 - 44
  • [35] Multimodal Graph-based Transformer Framework for Biomedical Relation Extraction
    Pingali, Sriram
    Yadav, Shweta
    Dutta, Pratik
    Saha, Sriparna
    FINDINGS OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, ACL-IJCNLP 2021, 2021, : 3741 - 3747
  • [36] Video Object Segmentation Based on Guided Feature Transfer Learning
    Fiaz, Mustansar
    Mahmood, Arif
    Farooq, Sehar Shahzad
    Ali, Kamran
    Shaheryar, Muhammad
    Jung, Soon Ki
    FRONTIERS OF COMPUTER VISION (IW-FCV 2022), 2022, 1578 : 197 - 210
  • [37] Video Object Segmentation Based on Multi-Feature Clustering
    Hu, Shuangyan
    Li, Junshan
    Li, Xuhui
    Huang, Baigang
    2008 7TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION, VOLS 1-23, 2008, : 5946 - 5949
  • [38] Graph-Based Translation Via Graph Segmentation
    Li, Liangyou
    Way, Andy
    Liu, Qun
    PROCEEDINGS OF THE 54TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, VOL 1, 2016, : 97 - 107
  • [39] Enhancing Lithofacies Interpretation in Well Logs With Graph-Based Feature Extraction
    Datta, Deepan
    Jenamani, Mamata
    Routray, Aurobinda
    Singh, Sanjai K.
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [40] Video Segmentation Framework Based on Multi-kernel Representations and Feature Relevance Analysis for Object Classification
    Molina-Giraldo, S.
    Carvajal-Gonzalez, J.
    Alvarez-Meza, A. M.
    Castellanos-Dominguez, G.
    PATTERN RECOGNITION APPLICATIONS AND METHODS, ICPRAM 2013, 2015, 318 : 273 - 283