VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space

被引:0
|
作者
Lin, David Chuan-En [1 ]
Heilbron, Fabian Caba [2 ]
Lee, Joon-Young [2 ]
Wang, Oliver [3 ]
Martelaro, Nikolas [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
[2] Adobe Res, San Jose, CA USA
[3] Adobe Res, Seattle, WA USA
来源
PROCEEDINGS OF THE 16TH CONFERENCE ON CREATIVITY AND COGNITION, C&C 2024 | 2024年
关键词
video editing interface; latent space visualization;
D O I
10.1145/3635636.3656192
中图分类号
J [艺术];
学科分类号
13 ; 1301 ;
摘要
Video editing is a creative and complex endeavor andwe believe that there is potential for reimagining a new video editing interface to better support the creative and exploratory nature of video editing. We take inspiration from latent space exploration tools that help users find patterns and connections within complex datasets. We present VideoMap, a proof-of-concept video editing interface that operates on video frames projected onto a latent space. We support intuitive navigation through map-inspired navigational elements and facilitate transitioning between different latent spaces through swappable lenses. We built three VideoMap components to support editors in three common video tasks. In a user study with both professionals and non-professionals, editors found that VideoMap helps reduce grunt work, offers a user-friendly experience, provides an inspirational way of editing, and effectively supports the exploratory nature of video editing. We further demonstrate the versatility of VideoMap by implementing three extended applications. For interactive examples, we invite you to visit our project page: https://chuanenlin.com/videomap.
引用
收藏
页码:311 / 327
页数:17
相关论文
共 50 条
  • [1] Everything is There in Latent Space: Attribute Editing and Attribute Style Manipulation by StyleGAN Latent Space Exploration
    Parihar, Rishubh
    Dhiman, Ankit
    Karmali, Tejan
    Babu, R. Venkatesh
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 1828 - 1836
  • [2] Interpreting the Latent Space of GANs for Semantic Face Editing
    Shen, Yujun
    Gu, Jinjin
    Tang, Xiaoou
    Zhou, Bolei
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 9240 - 9249
  • [3] Conceptual and Hierarchical Latent Space Decomposition for Face Editing
    Ozkan, Savas
    Ozay, Mete
    Robinson, Tom
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION, ICCV, 2023, : 7214 - 7223
  • [4] Transforming the latent space of StyleGAN for real face editing
    Heyi Li
    Jinlong Liu
    Xinyu Zhang
    Yunzhi Bai
    Huayan Wang
    Klaus Mueller
    The Visual Computer, 2024, 40 : 3553 - 3568
  • [5] Disentangling the latent space of GANs for semantic face editing
    Niu, Yongjie
    Zhou, Mingquan
    Li, Zhan
    PLOS ONE, 2023, 18 (10):
  • [6] Transforming the latent space of StyleGAN for real face editing
    Li, Heyi
    Liu, Jinlong
    Zhang, Xinyu
    Bai, Yunzhi
    Wang, Huayan
    Mueller, Klaus
    VISUAL COMPUTER, 2024, 40 (05): : 3553 - 3568
  • [7] Wasserstein loss for Semantic Editing in the Latent Space of GANs
    Doubinsky, Perla
    Audebert, Nicolas
    Crucianu, Michel
    Le Borgne, Herve
    20TH INTERNATIONAL CONFERENCE ON CONTENT-BASED MULTIMEDIA INDEXING, CBMI 2023, 2023, : 55 - 60
  • [8] Space exploration First video on Mars
    Crane, Leah
    NEW SCIENTIST, 2021, 245 (3323) : 13 - 13
  • [9] Latent Space Bayesian Optimization With Latent Data Augmentation for Enhanced Exploration
    Boyar, Onur
    Takeuchi, Ichiro
    NEURAL COMPUTATION, 2024, 36 (11) : 2446 - 2478
  • [10] Design space exploration and prototyping for on-chip multimedia applications
    Lee, Hyung Gyu
    Ogras, Umit Y.
    Marculescu, Radu
    Chang, Naehyuck
    43RD DESIGN AUTOMATION CONFERENCE, PROCEEDINGS 2006, 2006, : 137 - +