RLC: A Reinforcement Learning-Based Charging Algorithm for Mobile Devices

被引:19
|
作者
Liu, Tang [1 ,2 ]
Wu, Baijun [3 ]
Xu, Wenzheng [4 ]
Cao, Xianbo [4 ]
Peng, Jian [4 ]
Wu, Hongyi [5 ]
机构
[1] Sichuan Normal Univ, 5 Jingan Rd, Chengdu 610066, Peoples R China
[2] State Key Lab Networking & Switching Technol, 10 Xitucheng Rd, Beijing 100876, Peoples R China
[3] Univ Louisiana Lafayette, 301 E Lewis St, Lafayette, LA 70503 USA
[4] Sichuan Univ, 24 South Sect 1,Yihuan Rd, Chengdu 610065, Peoples R China
[5] Old Dominion Univ, 231 Kaufman Hall, Norfolk, VA 23529 USA
基金
中国国家自然科学基金;
关键词
Hotspot-based wireless rechargeable networks; mobile devices; reinforcement learning; ENERGY;
D O I
10.1145/3453682
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wireless charging has been demonstrated as a promising technology for prolonging device operational lifetimes in Wireless Rechargeable Networks (WRNs). To schedule a mobile charger to move along a pre-designed trajectory to charge devices, most existing studies assume that the precise location information of devices is already known. Unfortunately, this assumption does not always hold in real mobile application, because the activities of the vast majority of mobile devices carried by mobile agents appear dynamic and random. To the best of our knowledge, this is the first work to study how to wirelessly charge mobile devices with non-deterministic mobility. We aim to provide effective charging service to them, subject to the energy capacity of the mobile charger. We formalize the effective charging problem as a charging reward maximization problem (CRMP), where the amount of reward obtained by charging a device is inversely proportional to the residual lifetime of the device. Then, we prove that CRMP is NP-hard. To derive an effective charging heuristic, an algorithm based on Reinforcement Learning (RL) is proposed. The evaluation results show that the RL-based charging algorithm achieves excellent charging effectiveness. We further interpret the learned heuristic to gain deep and valuable insights into the design options.
引用
收藏
页数:23
相关论文
共 50 条
  • [1] RLC: A Reinforcement Learning Based Charging Scheme for Battery Swap Stations
    Xu, Yutao
    Ye, Qiang
    Tang, Yujie
    Huang, Hui
    Awaisi, Kamran Sattar
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 4176 - 4181
  • [2] Deep Reinforcement Learning-based Charging Algorithm for Target Coverage and Connectivity in WRSNs
    Hung Cuong Nguyen
    Manh Cuong Dao
    Thanh Trung Nguyen
    Ngoc Khanh Doan
    Thanh Hung Nguyen
    Truong Thao Nguyen
    Phi Le Nguyen
    2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022, : 1178 - 1184
  • [3] Reinforcement Learning-Based Task Scheduling Using DVFS Techniques in Mobile Devices
    HajiKhodaverdian, Mohammadamin
    Rastaghi, Hamed
    Saadat, Milad
    Shah-Mansouri, Hamed
    2023 IEEE 34TH ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS, PIMRC, 2023,
  • [4] Deep Reinforcement Learning-Based Carrier Tuning Algorithm for Mobile Communication Networks
    Zhang, Weimin
    Zhao, Xinying
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (09) : 371 - 381
  • [5] Reinforcement learning-based mobile robot navigation
    Altuntas, Nihal
    Imal, Erkan
    Emanet, Nahit
    Ozturk, Ceyda Nur
    TURKISH JOURNAL OF ELECTRICAL ENGINEERING AND COMPUTER SCIENCES, 2016, 24 (03) : 1747 - 1767
  • [6] Improving User Experience via Reinforcement Learning-Based Resource Management on Mobile Devices
    Lu, Yufan
    Hu, Chuang
    Gong, Yili
    Cheng, Dazhao
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT II, ICIC 2024, 2024, 14863 : 383 - 395
  • [7] A deep reinforcement learning-based on-demand charging algorithm for wireless rechargeable sensor networks
    Cao, Xianbo
    Xu, Wenzheng
    Liu, Xuxun
    Peng, Jian
    Liu, Tang
    AD HOC NETWORKS, 2021, 110
  • [8] A Reinforcement Learning-based Assignment Scheme for EVs to Charging Stations
    Aljaidi, Mohammad
    Aslam, Nauman
    Chen, Xiaomin
    Kaiwartya, Omprakash
    Al-Gumaei, Yousef Ali
    Khalid, Muhammad
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [9] A Deep Reinforcement Learning-based Adaptive Charging Policy for WRSNs
    Ngoc Bui
    Phi Le Nguyen
    Viet Anh Nguyen
    Phan Thuan Do
    2022 IEEE 19TH INTERNATIONAL CONFERENCE ON MOBILE AD HOC AND SMART SYSTEMS (MASS 2022), 2022, : 661 - 667
  • [10] A meta reinforcement learning-based virtual machine placement algorithm in mobile edge computing
    Hao Xu
    Chengfeng Jian
    Cluster Computing, 2024, 27 : 1883 - 1896