RLC: A Reinforcement Learning-Based Charging Algorithm for Mobile Devices

被引:19
|
作者
Liu, Tang [1 ,2 ]
Wu, Baijun [3 ]
Xu, Wenzheng [4 ]
Cao, Xianbo [4 ]
Peng, Jian [4 ]
Wu, Hongyi [5 ]
机构
[1] Sichuan Normal Univ, 5 Jingan Rd, Chengdu 610066, Peoples R China
[2] State Key Lab Networking & Switching Technol, 10 Xitucheng Rd, Beijing 100876, Peoples R China
[3] Univ Louisiana Lafayette, 301 E Lewis St, Lafayette, LA 70503 USA
[4] Sichuan Univ, 24 South Sect 1,Yihuan Rd, Chengdu 610065, Peoples R China
[5] Old Dominion Univ, 231 Kaufman Hall, Norfolk, VA 23529 USA
基金
中国国家自然科学基金;
关键词
Hotspot-based wireless rechargeable networks; mobile devices; reinforcement learning; ENERGY;
D O I
10.1145/3453682
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wireless charging has been demonstrated as a promising technology for prolonging device operational lifetimes in Wireless Rechargeable Networks (WRNs). To schedule a mobile charger to move along a pre-designed trajectory to charge devices, most existing studies assume that the precise location information of devices is already known. Unfortunately, this assumption does not always hold in real mobile application, because the activities of the vast majority of mobile devices carried by mobile agents appear dynamic and random. To the best of our knowledge, this is the first work to study how to wirelessly charge mobile devices with non-deterministic mobility. We aim to provide effective charging service to them, subject to the energy capacity of the mobile charger. We formalize the effective charging problem as a charging reward maximization problem (CRMP), where the amount of reward obtained by charging a device is inversely proportional to the residual lifetime of the device. Then, we prove that CRMP is NP-hard. To derive an effective charging heuristic, an algorithm based on Reinforcement Learning (RL) is proposed. The evaluation results show that the RL-based charging algorithm achieves excellent charging effectiveness. We further interpret the learned heuristic to gain deep and valuable insights into the design options.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Recursive deep reinforcement learning-based collaborative caching relay algorithm in mobile vehicular edge network
    Wu, Honghai
    Wang, Baibing
    Ma, Huahong
    Xing, Ling
    Tongxin Xuebao/Journal on Communications, 2024, 45 (11): : 277 - 286
  • [32] Reinforcement Learning-Based Plug-in Electric Vehicle Charging With Forecasted Price
    Chis, Adriana
    Lunden, Jarmo
    Koivunen, Visa
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2017, 66 (05) : 3674 - 3684
  • [33] Reinforcement Learning-Based Multiple Constraint Electric Vehicle Charging Service Scheduling
    Liu, Yongguang
    Chen, Wei
    Huang, Zhu
    MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
  • [34] Deep reinforcement learning-based strategy for charging station participating in demand response
    Jin, Ruiyang
    Zhou, Yuke
    Lu, Chao
    Song, Jie
    APPLIED ENERGY, 2022, 328
  • [35] A safe reinforcement learning-based charging strategy for electric vehicles in residential microgrid
    Zhang, Shulei
    Jia, Runda
    Pan, Hengxin
    Cao, Yankai
    APPLIED ENERGY, 2023, 348
  • [36] Reinforcement Learning-Based Cooperative Adversarial Algorithm for UAV Cluster
    Li, Yan
    Gao, Yanlong
    Dai, Xunhua
    Nian, Xiaohong
    Wang, Haibo
    Xiong, HongYun
    PROCEEDINGS OF 2022 INTERNATIONAL CONFERENCE ON AUTONOMOUS UNMANNED SYSTEMS, ICAUS 2022, 2023, 1010 : 1129 - 1138
  • [37] A Reinforcement Learning-based Sequence Generation Algorithm for Password Guessing
    Chen, Zheng
    Zhang, Xuliang
    2022 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM 2022), 2022, : 4891 - 4896
  • [38] A reinforcement learning-based routing algorithm for large street networks
    Li, Diya
    Zhang, Zhe
    Alizadeh, Bahareh
    Zhang, Ziyi
    Duffield, Nick
    Meyer, Michelle A.
    Thompson, Courtney M.
    Gao, Huilin
    Behzadan, Amir H.
    INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2024, 38 (02) : 183 - 215
  • [39] A reinforcement learning-based load balancing algorithm for fog computing
    Tahmasebi-Pouya, Niloofar
    Sarram, Mehdi Agha
    Mostafavi, Seyedakbar
    TELECOMMUNICATION SYSTEMS, 2023, 84 (03) : 321 - 339
  • [40] A reinforcement learning-based load balancing algorithm for fog computing
    Niloofar Tahmasebi-Pouya
    Mehdi Agha Sarram
    Seyedakbar Mostafavi
    Telecommunication Systems, 2023, 84 : 321 - 339