Hybrid Frame Rate Upconversion Method Based on Motion Vector Mapping

被引:9
|
作者
Tsai, Tsung-Han [1 ]
Lin, Hsueh-Yi [2 ]
机构
[1] Natl Cent Univ, Dept Elect Engn, Tao Yuan 32001, Taiwan
[2] Interuniv Microelect Ctr, Hsinchu 300, Taiwan
关键词
Bidirectional motion vector mapping; frame rate upconversion (FRUC); hybrid; iterative motion vector assignment; low computation complexity; noise minimization; resolution adaptive cost evaluation;
D O I
10.1109/TCSVT.2013.2269024
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Liquid crystal displays (LCDs), which serve as receivers of high visual quality video, suffer from motion blur issues. One of the methods in terminating motion blur is motion compensated frame rate upconversion, which is widely adopted in LCDs. In the previous work, i.e., particle-based frame rate upconversion, the computation complexity is high while repeated operations and some improper cost evaluation setup are observed. Therefore, in this paper, hybrid frame rate upconversion is proposed with two features. First, the cost evaluation for particle-based motion trajectory calibration is modified based on the possible noise sources and video resolution variations. Second, repeated operations in particle-based motion trajectory calibration are observed. Therefore, original particle-based motion trajectory calibration is replaced by initial motion vector assignment and subsequent motion vector mapping to achieve computation complexity reduction, while the effective search range is relatively expanded. According to the experiment results, the visual quality is enhanced by 1.87 dB on average, compared with state-of-the-art unidirectional-based frame rate upconversion approaches. On the other hand, the computation complexity of the proposed design is reduced by 25-90% based on target video resolution, concluding a high visual quality and low computation complexity frame rate upconversion design.
引用
收藏
页码:1901 / 1910
页数:10
相关论文
共 50 条
  • [21] Hierarchical prediction-based motion vector refinement for video frame-rate up-conversion
    Jiale He
    Gaobo Yang
    Jingyu Song
    Xiangling Ding
    Ran Li
    Journal of Real-Time Image Processing, 2020, 17 : 259 - 273
  • [22] Spatio-temporal Saliency-based Motion Vector Refinement for Frame Rate Up-conversion
    He, Jiale
    Yang, Gaobo
    Liu, Xin
    Ding, Xiangling
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2020, 16 (02)
  • [23] Hierarchical prediction-based motion vector refinement for video frame-rate up-conversion
    He, Jiale
    Yang, Gaobo
    Song, Jingyu
    Ding, Xiangling
    Li, Ran
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2020, 17 (02) : 259 - 273
  • [24] Frame-rate conversion using hybrid-search-based motion estimation and adaptive motion-compensated interpolation
    Kim, Young Duk
    Chang, Joonyoung
    Shin, Gun Shik
    Kang, Moon Gi
    OPTICAL ENGINEERING, 2008, 47 (09)
  • [25] Frame Rate Up-Conversion Method Based on Texture Adaptive Bilateral Motion Estimation
    Kim, Jin-Hyung
    Ko, Yun-Ho
    Kang, Hyun-Soo
    Lee, Si-Woong
    Kwon, Jae W.
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2014, 60 (03) : 445 - 452
  • [26] Frame Rate Up-Conversion Method Based on Texture Adaptive Bilateral Motion Estimation
    Kim, Jin-Hyung
    Ko, Yun-Ho
    Kang, Hyun-Soo
    Lee, Si-Woong
    Kwon, Jae Wan
    2014 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS (ICCE), 2014, : 105 - 106
  • [27] A novel multi-stage motion vector processing method for motion compensated frame interpolation
    Huang, Ai-Mei
    Nguyen, Truong
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 2641 - 2644
  • [28] Motion vector processing based on residual energy information for motion compensated frame interpolation
    Huang, Ai-Mei
    Nguyen, Truong
    2006 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP 2006, PROCEEDINGS, 2006, : 2721 - +
  • [29] MOTION VECTOR PROCESSING BASED ON TRAJECTORY CURVE ANALYSIS FOR MOTION COMPENSATED FRAME INTERPOLATION
    Huang, Ai-Mei
    Nguyen, Truong
    2009 16TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-6, 2009, : 377 - 380
  • [30] Motion-based nearest vector metric for reference frame selection in the perception of motion
    Agaoglu, Mehmet N.
    Clarke, Aaron M.
    Herzog, Michael H.
    Ogmen, Haluk
    JOURNAL OF VISION, 2016, 16 (07):