USER'S VISUAL INTENTION DRIVEN RETRIEVAL MODEL FOR SEMANTIC VIDEO SEARCH AND RETRIEVAL

被引:0
|
作者
Ranathunga, Lochandaka [1 ]
Abdullah, Nor Aniza [2 ]
Zainuddin, Roziati [2 ]
机构
[1] Univ Moratuwa, Fac Informat Technol, Katubedda, Moratuwa, Sri Lanka
[2] Univ Malaya, Fac Comp Sci & Informat Technol, Kuala Lumpur 50603, Malaysia
关键词
CDPC; Visual concepts depiction; Semantic gap; Semantic video retrieval; Semantic video search;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
There are various models of retrieval mechanisms for effective video retrieval, however, 'semantic gap' still persists. This study aims to reduce the gap by providing a graphical user interface that allows user to express the visuals in their mind into a query using semantic association of spatial and temporal visual concepts. To accomplish this, we have developed a video content depiction schema that serves as the foundation to our semantic search mechanisms, namely a generic visual concept search, Spatial Concept Association Based Search (SCABS) and Spatial Concept Transition Based Search (SCTBS). In our approach, a clear understanding between the user and the system has been established through the depiction schema and the visual retrieval mechanisms in contrast to common tag based retrieval systems. This retrieval model employs visual experiences and context knowledge of the users to generate search results. Our experiment result shows that our approach produces positive result against other approaches.
引用
收藏
页码:164 / 176
页数:13
相关论文
共 50 条
  • [41] Multiple Visual-Semantic Embedding for Video Retrieval from Query Sentence
    Nguyen, Huy Manh
    Miyazaki, Tomo
    Sugaya, Yoshihiro
    Omachi, Shinichiro
    APPLIED SCIENCES-BASEL, 2021, 11 (07):
  • [42] Multimodal search for effective video retrieval
    Natsev, Apostol
    IMAGE AND VIDEO RETRIEVAL, PROCEEDINGS, 2006, 4071 : 525 - 528
  • [43] Face Retrieval Framework Relying on User's Visual Memory
    Sato, Yugo
    Fukusato, Tsukasa
    Morishima, Shigeo
    ICMR '18: PROCEEDINGS OF THE 2018 ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL, 2018, : 274 - 282
  • [44] User Relevance Feedback in Semantic Information Retrieval
    Picariello, Antonio
    Rinaldi, Antonio M.
    INTERNATIONAL JOURNAL OF INTELLIGENT INFORMATION TECHNOLOGIES, 2007, 3 (02) : 36 - 50
  • [45] AN INTEGRATED VISUAL-SEARCH AND MEMORY RETRIEVAL MODEL OF INSPECTION
    GOLDBERG, JH
    LATORELLA, KA
    PROCEEDINGS OF THE HUMAN FACTORS SOCIETY 33RD ANNUAL MEETING, VOL 2, 1989, : 1491 - 1495
  • [46] Semantic-based surveillance video retrieval
    Hu, Weiming
    Xie, Dan
    Fu, Zhouyu
    Zeng, Wenrong
    Maybank, Steve
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (04) : 1168 - 1181
  • [47] Semantic modeling approach for video retrieval by content
    Ardizzone, Edoardo
    Hacid, Mohand-Said
    International Conference on Multimedia Computing and Systems -Proceedings, 1999, 2 : 158 - 162
  • [48] Video Retrieval System for Bridging the Semantic Gap
    Jung, Min Young
    Park, Sung Han
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2009, E92D (12): : 2516 - 2519
  • [49] Semantic video retrieval using audio analysis
    Bakker, EM
    Lew, MS
    IMAGE AND VIDEO RETRIEVAL, 2002, 2383 : 271 - 277
  • [50] Detecting automobiles and people for semantic video retrieval
    Visser, R
    Sebe, N
    Lew, MS
    16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL II, PROCEEDINGS, 2002, : 733 - 736