VideoMap: Supporting Video Editing Exploration, Brainstorming, and Prototyping in the Latent Space

被引:0
|
作者
Lin, David Chuan-En [1 ]
Heilbron, Fabian Caba [2 ]
Lee, Joon-Young [2 ]
Wang, Oliver [3 ]
Martelaro, Nikolas [1 ]
机构
[1] Carnegie Mellon Univ, Pittsburgh, PA 15213 USA
[2] Adobe Res, San Jose, CA USA
[3] Adobe Res, Seattle, WA USA
来源
PROCEEDINGS OF THE 16TH CONFERENCE ON CREATIVITY AND COGNITION, C&C 2024 | 2024年
关键词
video editing interface; latent space visualization;
D O I
10.1145/3635636.3656192
中图分类号
J [艺术];
学科分类号
13 ; 1301 ;
摘要
Video editing is a creative and complex endeavor andwe believe that there is potential for reimagining a new video editing interface to better support the creative and exploratory nature of video editing. We take inspiration from latent space exploration tools that help users find patterns and connections within complex datasets. We present VideoMap, a proof-of-concept video editing interface that operates on video frames projected onto a latent space. We support intuitive navigation through map-inspired navigational elements and facilitate transitioning between different latent spaces through swappable lenses. We built three VideoMap components to support editors in three common video tasks. In a user study with both professionals and non-professionals, editors found that VideoMap helps reduce grunt work, offers a user-friendly experience, provides an inspirational way of editing, and effectively supports the exploratory nature of video editing. We further demonstrate the versatility of VideoMap by implementing three extended applications. For interactive examples, we invite you to visit our project page: https://chuanenlin.com/videomap.
引用
收藏
页码:311 / 327
页数:17
相关论文
共 50 条
  • [21] Deep Learning in Latent Space for Video Prediction and Compression
    Liu, Bowen
    Chen, Yu
    Liu, Shiyu
    Kim, Hun-Seok
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 701 - 710
  • [22] DASC: Learning discriminative latent space for video clustering
    Lin, Jiaxin
    Gao, Xizhan
    Zhang, Zhihan
    Deng, Haotian
    NEUROCOMPUTING, 2025, 637
  • [23] Delving into CLIP latent space for Video Anomaly Recognition
    Zanella, Luca
    Liberatori, Benedetta
    Menapace, Willi
    Poiesi, Fabio
    Wang, Yiming
    Ricci, Elisa
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 249
  • [24] Video Probabilistic Diffusion Models in Projected Latent Space
    Yu, Sihyun
    Sohn, Kihyuk
    Kim, Subin
    Shin, Jinwoo
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 18456 - 18466
  • [25] Face Editing Using Part-Based Optimization of the Latent Space
    Aliari, Mohammad Amin
    Beauchamp, Andre
    Popa, Tiberiu
    Paquette, Eric
    COMPUTER GRAPHICS FORUM, 2023, 42 (02) : 269 - 279
  • [26] Improved Attribute Manipulation in the Latent Space of StyleGAN for Semantic Face Editing
    Rai, Aashish
    Ducher, Clara
    Cooperstock, Jeremy R.
    20TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA 2021), 2021, : 38 - 43
  • [27] Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpoint
    Liu, Hongyu
    Song, Yibing
    Chen, Qifeng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 10072 - 10082
  • [28] Treatment selection using prototyping in latent-space with application to depression treatment
    Kleinerman, Akiva
    Rosenfeld, Ariel
    Benrimoh, David
    Fratila, Robert
    Armstrong, Caitrin
    Mehltretter, Joseph
    Shneider, Eliyahu
    Yaniv-Rosenfeld, Amit
    Karp, Jordan
    Reynolds, Charles F.
    Turecki, Gustavo
    Kapelner, Adam
    PLOS ONE, 2021, 16 (11):
  • [29] COMPUTER-AIDED GRID-EDITING SYSTEM FOR SUPPORTING THE DESIGN OF RAPID PROTOTYPING TRANSTIBIAL SOCKETS
    Chuang, Wei-Chiao
    Hsu, Lai-Hsing
    Huang, Gwo-Feng
    Lai, Chih-Wei
    IMECE2009, VOL 4, 2010, : 567 - 573
  • [30] Semantics-Guided Latent Space Exploration for Shape Generation
    Jahan, Tansin
    Guan, Yanran
    van Kaick, Oliver
    COMPUTER GRAPHICS FORUM, 2021, 40 (02) : 115 - 126