Hybrid Frame Rate Upconversion Method Based on Motion Vector Mapping

被引:9
|
作者
Tsai, Tsung-Han [1 ]
Lin, Hsueh-Yi [2 ]
机构
[1] Natl Cent Univ, Dept Elect Engn, Tao Yuan 32001, Taiwan
[2] Interuniv Microelect Ctr, Hsinchu 300, Taiwan
关键词
Bidirectional motion vector mapping; frame rate upconversion (FRUC); hybrid; iterative motion vector assignment; low computation complexity; noise minimization; resolution adaptive cost evaluation;
D O I
10.1109/TCSVT.2013.2269024
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Liquid crystal displays (LCDs), which serve as receivers of high visual quality video, suffer from motion blur issues. One of the methods in terminating motion blur is motion compensated frame rate upconversion, which is widely adopted in LCDs. In the previous work, i.e., particle-based frame rate upconversion, the computation complexity is high while repeated operations and some improper cost evaluation setup are observed. Therefore, in this paper, hybrid frame rate upconversion is proposed with two features. First, the cost evaluation for particle-based motion trajectory calibration is modified based on the possible noise sources and video resolution variations. Second, repeated operations in particle-based motion trajectory calibration are observed. Therefore, original particle-based motion trajectory calibration is replaced by initial motion vector assignment and subsequent motion vector mapping to achieve computation complexity reduction, while the effective search range is relatively expanded. According to the experiment results, the visual quality is enhanced by 1.87 dB on average, compared with state-of-the-art unidirectional-based frame rate upconversion approaches. On the other hand, the computation complexity of the proposed design is reduced by 25-90% based on target video resolution, concluding a high visual quality and low computation complexity frame rate upconversion design.
引用
收藏
页码:1901 / 1910
页数:10
相关论文
共 50 条
  • [1] Frame rate upconversion using pyramid structure and dense motion vector fields
    Kim, Jun-Geon
    Lee, Daeho
    JOURNAL OF ELECTRONIC IMAGING, 2016, 25 (03)
  • [2] Frame Rate Up-Conversion based Motion Vector Derivation for Hybrid Video Coding
    Li, Xiang
    Chen, Jianle
    Karczewicz, Marta
    2017 DATA COMPRESSION CONFERENCE (DCC), 2017, : 390 - 399
  • [3] Hierarchical Extended Bilateral Motion Estimation-Based Frame Rate Upconversion Using Learning-Based Linear Mapping
    Yoon, Sung-Jun
    Kim, Hyun-Ho
    Kim, Munchurl
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (12) : 5918 - 5932
  • [4] An Artifact Information Based Motion Vector Processing Method for Motion Compensated Frame Interpolation
    Lu, Qingchun
    Wang, Yiqing
    Fang, Xiangzhong
    JOURNAL OF DISPLAY TECHNOLOGY, 2014, 10 (09): : 775 - 784
  • [5] Motion vector processing for frame rate up conversion
    Dane, G
    Nguyen, TQ
    2004 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL III, PROCEEDINGS: IMAGE AND MULTIDIMENSIONAL SIGNAL PROCESSING SPECIAL SESSIONS, 2004, : 309 - 312
  • [6] Adaptive Interpolation/Extrapolation and Motion Vector Processing Method for Frame Rate Up Conversion
    Deng Hui-Ping
    Yu Li
    Xiong Wei
    He Qing-Di
    Li Rong
    PROCEEDINGS OF THE FIFTH INTERNATIONAL CONFERENCE ON IMAGE AND GRAPHICS (ICIG 2009), 2009, : 18 - 22
  • [7] Frame rate up-conversion based on dual criterion motion estimation and motion vector adjustment
    Chen, Junhua
    Liu, Yanfei
    SIGNAL IMAGE AND VIDEO PROCESSING, 2015, 9 (08) : 1861 - 1869
  • [8] Frame rate up-conversion based on dual criterion motion estimation and motion vector adjustment
    Junhua Chen
    Yanfei Liu
    Signal, Image and Video Processing, 2015, 9 : 1861 - 1869
  • [9] A FRAME RATE UP-CONVERSION METHOD WITH QUADRUPLE MOTION VECTOR POST-PROCESSING
    Qu, Aixi
    Liu, Ju
    Wan, Wenbo
    Xiao, Yifan
    2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, : 1686 - 1690
  • [10] Analysis of motion vector errors in motion compensated frame rate up conversion
    Dane, G
    Nguyen, TQ
    CONFERENCE RECORD OF THE THIRTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, VOLS 1 AND 2, 2003, : 1534 - 1538