Mobile Tile-Based 360° Video Multicast With Cybersickness Alleviation

被引:0
|
作者
Lin, Chiao-Wen [1 ]
Yang, De-Nian [2 ]
Liao, Wanjiun [1 ]
机构
[1] Natl Taiwan Univ, Dept Elect Engn, Taipei City, Taiwan
[2] Acad Sinica, Inst Informat Sci, Res Ctr Informat Technol Innovat, Taipei City, Taiwan
关键词
Cybersickness; Streaming media; Video recording; Quality assessment; Bandwidth; Multicast algorithms; Optical flow; Mobile computing; Costs; User experience; VR; 360(degrees) video; tile-based streaming; cybersickness; multicast; 360 VR VIDEO; OPTIMIZATION; ALLOCATION;
D O I
10.1109/TMC.2024.3514852
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Virtual reality (VR) imaging is 360 degrees, which requires a large bandwidth for video transmission. To address this challenge, tile-based streaming has been proposed to deliver only the focused part of the video instead of the entire one. However, the impact of cybersickness, akin to motion sickness, on tile selection in VR has not been explored. In this paper, we investigate Multi-user Tile Streaming with Cybersickness Control (MTSCC) in an adaptive 360(degrees) video streaming system with multicast and cybersickness alleviation. We propose a novel m(2)-competitive online algorithm that utilizes Individual Sickness Indicator (ISI) and Bitrate Restriction Indicator (BRI) to evaluate user cybersickness tendency and network bandwidth efficiency. Moreover, we introduce the Video Loss Indicator (VLI) and Quality Variance Indicator (QVI) to assess video quality loss and quality difference between tiles. We also propose a multi-armed bandit (MAB) algorithm with confidence bound-based reward (video quality) and cost (cybersickness) estimation. The algorithm learns the weighting factor of each user's cost to slow down cybersickness accumulation for users with high cybersickness tendencies. We prove that the algorithm converges to an optimal solution over time. According to simulation with real network settings, our proposed algorithms outperform baselines in terms of video quality and cybersickness accumulation.
引用
收藏
页码:3423 / 3440
页数:18
相关论文
共 50 条
  • [41] Selection of the most efficient tile size in tile-based cylinder panoramic video coding and transmission
    Feng Dai
    Yanfei Shen
    Yongdong Zhang
    Shouxun Lin
    The Visual Computer, 2007, 23 : 891 - 896
  • [42] Selection of the most efficient tile size in tile-based cylinder panoramic video coding and transmission
    Dai, Feng
    Shen, Yanfei
    Zhang, Yongdong
    Lin, Shouxun
    VISUAL COMPUTER, 2007, 23 (9-11): : 891 - 896
  • [43] Tile-Based Viewport-Adaptive Panoramic Video Streaming on Smartphones
    Qian, Feng
    Han, Bo
    Xiao, Qingyang
    Gopalakrishnan, Vijay
    MOBICOM'18: PROCEEDINGS OF THE 24TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING, 2018, : 817 - 819
  • [44] A new tile boundary artifact removal method for tile-based viewport-adaptive streaming in 360° videos
    Ahrar, Amir Mahmoud
    Roodaki, Hoda
    MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (19) : 29785 - 29803
  • [45] A new tile boundary artifact removal method for tile-based viewport-adaptive streaming in 360∘ videos
    Amir Mahmoud Ahrar
    Hoda Roodaki
    Multimedia Tools and Applications, 2021, 80 : 29785 - 29803
  • [46] TVSR-OR: Tile-based 360-degree video streaming over real time streaming protocol with optimized read
    Zeng, Qimiao
    Yin, Zhifan
    Pan, Qing
    Ma, Yunxiao
    Yu, Yuan
    Zhuang, Yirong
    Liang, Jie
    Yang, Shujie
    Xiao, Han
    TRANSACTIONS ON EMERGING TELECOMMUNICATIONS TECHNOLOGIES, 2023, 34 (05)
  • [47] Tile-based modeling and rendering
    Terai, Maki
    Fujiki, Jun
    Tsuruno, Reiji
    Tomimatsu, Kiyoshi
    SMART GRAPHICS, PROCEEDINGS, 2007, 4569 : 158 - +
  • [48] Not All the Same: Understanding and Informing Similarity Estimation in Tile-Based Video Games
    Berns, Sebastian
    Volz, Vanessa
    Tokarchuk, Laurissa
    Snodgrass, Sam
    Guckelsberger, Christian
    PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024, 2024,
  • [49] Advancing User Quality of Experience Using Viewport Archives in Viewport-Aware Tile-Based 360-Degree Video Streaming
    Dziubinski, Kiana
    Bandai, Masaki
    2021 IEEE INTERNATIONAL WORKSHOP TECHNICAL COMMITTEE ON COMMUNICATIONS QUALITY AND RELIABILITY (CQR 2021), 2021,
  • [50] A Multipath Routing Approach for Tile-based Virtual Reality Video Streaming Based on SDN
    Zou, Fanyuan
    Wang, Yumei
    Liu, Yu
    2021 IEEE 45TH ANNUAL COMPUTERS, SOFTWARE, AND APPLICATIONS CONFERENCE (COMPSAC 2021), 2021, : 560 - 565