Mobile Tile-Based 360° Video Multicast With Cybersickness Alleviation

被引:0
|
作者
Lin, Chiao-Wen [1 ]
Yang, De-Nian [2 ]
Liao, Wanjiun [1 ]
机构
[1] Natl Taiwan Univ, Dept Elect Engn, Taipei City, Taiwan
[2] Acad Sinica, Inst Informat Sci, Res Ctr Informat Technol Innovat, Taipei City, Taiwan
关键词
Cybersickness; Streaming media; Video recording; Quality assessment; Bandwidth; Multicast algorithms; Optical flow; Mobile computing; Costs; User experience; VR; 360(degrees) video; tile-based streaming; cybersickness; multicast; 360 VR VIDEO; OPTIMIZATION; ALLOCATION;
D O I
10.1109/TMC.2024.3514852
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Virtual reality (VR) imaging is 360 degrees, which requires a large bandwidth for video transmission. To address this challenge, tile-based streaming has been proposed to deliver only the focused part of the video instead of the entire one. However, the impact of cybersickness, akin to motion sickness, on tile selection in VR has not been explored. In this paper, we investigate Multi-user Tile Streaming with Cybersickness Control (MTSCC) in an adaptive 360(degrees) video streaming system with multicast and cybersickness alleviation. We propose a novel m(2)-competitive online algorithm that utilizes Individual Sickness Indicator (ISI) and Bitrate Restriction Indicator (BRI) to evaluate user cybersickness tendency and network bandwidth efficiency. Moreover, we introduce the Video Loss Indicator (VLI) and Quality Variance Indicator (QVI) to assess video quality loss and quality difference between tiles. We also propose a multi-armed bandit (MAB) algorithm with confidence bound-based reward (video quality) and cost (cybersickness) estimation. The algorithm learns the weighting factor of each user's cost to slow down cybersickness accumulation for users with high cybersickness tendencies. We prove that the algorithm converges to an optimal solution over time. According to simulation with real network settings, our proposed algorithms outperform baselines in terms of video quality and cybersickness accumulation.
引用
收藏
页码:3423 / 3440
页数:18
相关论文
共 50 条
  • [1] Cybersickness-aware Tile-based Adaptive 360° Video Streaming
    Lin, Chiao-Wen
    Wang, Chih-Hang
    Yang, De-Nian
    Liao, Wanjiun
    2021 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2021,
  • [2] Encoding configurations for tile-based 360° Video
    Sanchez, Yago
    Bhullar, Gurdeep Singh
    Skupin, Robert
    Hellge, Cornelius
    Schierl, Thomas
    2019 IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA (ISM 2019), 2019, : 200 - 203
  • [3] Tile-Based Edge Caching for 360° Live Video Streaming
    Maniotis, Pantelis
    Thomos, Nikolaos
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) : 4938 - 4950
  • [4] TBSR: Tile-Based 360° Video Streaming with Super-Resolution on Commodity Mobile Devices
    Zhang, Lei
    Zhou, Haobin
    Wang, Haiyang
    Cui, Laizhong
    IEEE INFOCOM 2024-IEEE CONFERENCE ON COMPUTER COMMUNICATIONS, 2024, : 501 - 510
  • [5] Hybrid-360: An adaptive bitrate algorithm for tile-based 360 video streaming
    Yang, Shujie
    Hu, Jialu
    Jiang, Ke
    Xiao, Han
    Wang, Mu
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2022, 33 (04)
  • [6] Optimal Tile-Based Encoding for 360-Degree Video Streaming
    Gao, Wenxuan
    Li, Chenglin
    Lv, Haoran
    Dai, Wenrui
    Zou, Junni
    Xiong, Hongkai
    Pan, Xinlong
    Wang, Haipeng
    2022 PICTURE CODING SYMPOSIUM (PCS), 2022, : 295 - 299
  • [7] A Weighted Tile-based Approach for Viewport Adaptive 360° Video Streaming
    Yaqoob, Abid
    Muntean, Gabriel-Miro
    2020 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2020,
  • [8] Tile-based 360-degree video streaming for mobile virtual reality in cyber physical system
    Son, Jangwoo
    Ryu, Eun-Seok
    COMPUTERS & ELECTRICAL ENGINEERING, 2018, 72 : 361 - 368
  • [9] Event-driven Stitching for Tile-based Live 360 Video Streaming
    Chen, Bo
    Yan, Zhisheng
    Jin, Haiming
    Nahrstedt, Klara
    PROCEEDINGS OF THE 10TH ACM MULTIMEDIA SYSTEMS CONFERENCE (ACM MMSYS'19), 2019, : 1 - 12
  • [10] SHVC Tile-Based 360-Degree Video Streaming for Mobile VR: PC Offloading Over mmWave
    Dien Van Nguyen
    Tuan Thanh Le
    Lee, Sangsoon
    Ryu, Eun-Seok
    SENSORS, 2018, 18 (11)