AV1/AVM development at Google

被引:0
|
作者
Chong, In Suk [1 ]
Young, Joe [1 ]
Li, Shan [1 ]
McCullough, Conor [1 ]
Vitvitskyy, Stan [1 ]
Rautio, Ville-Mikko [1 ]
机构
[1] Google LLC, 1600 Amphitheatre Pkwy, Mountain View, CA 94043 USA
关键词
AV1; AVM; UGC; YouTube; ML; Google; CNN;
D O I
10.1117/12.3031747
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Google is working on a new video codec standard with multiple other industry members within Alliance of Open Media (AOM). Within Google, especially YouTube is actively driving advancements in the AV1 and AVM video codecs to enhance streaming quality and efficiency for diverse video including live and high production value content as well as user-generated content (UGC). Efforts include customizing the AV1 codec for UGC, optimizing quality/bitrate/compute tradeoffs, and developing hardware encoding/decoding support within YouTube's data centers to support AV1 at scale. To accelerate adoption, YouTube works to increase AV1 corpus coverage, expand device compatibility, and contributes to the Alliance for Open Media (AOM) for the ongoing algorithmic improvement of AV1 and AVM and the complexity reduction in both encoder and decoder. To ensure the practical feasibility of AVM, we assess hardware complexity and propose methods to reduce it. YouTube also prioritizes reducing AV1/AVM encoder complexity using approaches like machine learning-based partition search pruning. YouTube led the collective efforts to modify existing tools by chairing HW Subgroup within the AOM group, and developed statistics (bitstream) analysis tools to expedite the development of AVM. Furthermore, YouTube developed a new flow which can enable practical implementation of ML based tools. There are few ML based tools proposed for AVM which includes CNN based loop restoration filter. YouTube's ML implementation flow reduced the complexity of that tool dramatically. This multi-pronged strategy has led to the successful integration of AV1 within Google, and we strive for faster adoption of AVM in the ecosystem.
引用
收藏
页数:5
相关论文
共 50 条
  • [21] Short Video Performance Evaluation of AV1 Coding Tools
    Xing, Peiyin
    Cai, Yangang
    Li, Xufeng
    Tian, Yonghong
    2021 DATA COMPRESSION CONFERENCE (DCC 2021), 2021, : 378 - 378
  • [22] Quality Assessment of Gaming Videos Compressed via AV1
    Ashimov, Darkhan
    Martini, Maria G.
    Barman, Nabajeet
    2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,
  • [23] Frame-parallel multithreading in libaom AV1 encoder
    Shyla, Nithya Viswanathan
    Prakasan, Remya
    Chakera, Mufaddal
    Singh, Tarundeep
    Chandran, Aasaipriya
    Wang, Yunqing
    JOURNAL OF ELECTRONIC IMAGING, 2022, 31 (03)
  • [24] An Overview of Core Coding Tools in the AV1 Video Codec
    Chen, Yue
    Murherjee, Debargha
    Han, Jingning
    Grange, Adrian
    Xu, Yaowu
    Liu, Zoe
    Parker, Sarah
    Chen, Cheng
    Su, Hui
    Joshi, Urvang
    Chiang, Ching-Han
    Wang, Yunqing
    Wilkins, Paul
    Bankoski, Jim
    Trudeau, Luc
    Egge, Nathan
    Valin, Jean-Marc
    Davies, Thomas
    Midtskogent, Steinar
    Norkin, Andrey
    de Rivaz, Peter
    2018 PICTURE CODING SYMPOSIUM (PCS 2018), 2018, : 41 - 45
  • [25] Introducing AV1 Codec-Level Video Steganography
    Catania, Lorenzo
    Allegra, Dario
    Giudice, Oliver
    Stanco, Filippo
    Battiato, Sebastiano
    IMAGE ANALYSIS AND PROCESSING, ICIAP 2022, PT I, 2022, 13231 : 284 - 294
  • [26] UNIFIED SECONDARY TRANSFORM FOR INTRA CODING BEYOND AV1
    Zhao, Xin
    Liu, Shan
    2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 3393 - 3397
  • [27] Speeding Up the AV1 Global Warped Motion Compensation
    Kolodziejski, William
    Domanski, Robson
    Agostini, Luciano
    15TH IEEE LATIN AMERICAN SYMPOSIUM ON CIRCUITS AND SYSTEMS, LASCAS 2024, 2024, : 153 - 157
  • [28] HDR Video Coding For Aerial Video With VVC and AV1
    Topiwala, P.
    Dai, W.
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XLIV, 2021, 11842
  • [29] ADVANCED MOTION VECTOR DIFFERENCE CODING BEYOND AV1
    Zhao, Liang
    Zhao, Xin
    Liu, Shan
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 3631 - 3635
  • [30] Microarchitectural Performance Evaluation of AV1 Video Encoding Workloads
    Jensen, Steffen
    Lee, Jaekyu
    Sunwoo, Dam
    Horsnell, Matthew J.
    John, Lizy K.
    2022 IEEE INTERNATIONAL SYMPOSIUM ON PERFORMANCE ANALYSIS OF SYSTEMS AND SOFTWARE (ISPASS 2022), 2022, : 251 - 253