RLC: A Reinforcement Learning-Based Charging Algorithm for Mobile Devices

被引:19
|
作者
Liu, Tang [1 ,2 ]
Wu, Baijun [3 ]
Xu, Wenzheng [4 ]
Cao, Xianbo [4 ]
Peng, Jian [4 ]
Wu, Hongyi [5 ]
机构
[1] Sichuan Normal Univ, 5 Jingan Rd, Chengdu 610066, Peoples R China
[2] State Key Lab Networking & Switching Technol, 10 Xitucheng Rd, Beijing 100876, Peoples R China
[3] Univ Louisiana Lafayette, 301 E Lewis St, Lafayette, LA 70503 USA
[4] Sichuan Univ, 24 South Sect 1,Yihuan Rd, Chengdu 610065, Peoples R China
[5] Old Dominion Univ, 231 Kaufman Hall, Norfolk, VA 23529 USA
基金
中国国家自然科学基金;
关键词
Hotspot-based wireless rechargeable networks; mobile devices; reinforcement learning; ENERGY;
D O I
10.1145/3453682
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Wireless charging has been demonstrated as a promising technology for prolonging device operational lifetimes in Wireless Rechargeable Networks (WRNs). To schedule a mobile charger to move along a pre-designed trajectory to charge devices, most existing studies assume that the precise location information of devices is already known. Unfortunately, this assumption does not always hold in real mobile application, because the activities of the vast majority of mobile devices carried by mobile agents appear dynamic and random. To the best of our knowledge, this is the first work to study how to wirelessly charge mobile devices with non-deterministic mobility. We aim to provide effective charging service to them, subject to the energy capacity of the mobile charger. We formalize the effective charging problem as a charging reward maximization problem (CRMP), where the amount of reward obtained by charging a device is inversely proportional to the residual lifetime of the device. Then, we prove that CRMP is NP-hard. To derive an effective charging heuristic, an algorithm based on Reinforcement Learning (RL) is proposed. The evaluation results show that the RL-based charging algorithm achieves excellent charging effectiveness. We further interpret the learned heuristic to gain deep and valuable insights into the design options.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Reinforcement Learning-Based Differential Evolution Algorithm with Levy Flight
    Liu, Xiaoyu
    Zhang, Qingke
    Xi, Hongtong
    Zhang, Huixia
    Gao, Shuang
    Zhang, Huaxiang
    BIO-INSPIRED COMPUTING: THEORIES AND APPLICATIONS, PT 1, BIC-TA 2023, 2024, 2061 : 142 - 156
  • [42] A reinforcement learning-based algorithm for the aircraft maintenance routing problem
    Ruan, J.H.
    Wang, Z.X.
    Chan, Felix T.S.
    Patnaik, S.
    Tiwari, M.K.
    Expert Systems with Applications, 2021, 169
  • [43] Reinforcement learning-based tuning algorithm applied to fuzzy identification
    Cerrada, Maxiela
    Aguilar, Jose
    Titli, Andre
    ADVANCES IN NEURAL NETWORKS - ISNN 2006, PT 1, 2006, 3971 : 623 - 630
  • [44] A reinforcement learning-based algorithm for the aircraft maintenance routing problem
    Ruan, J. H.
    Wang, Z. X.
    Chan, Felix T. S.
    Patnaik, S.
    Tiwari, M. K.
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 169
  • [45] Reinforcement Learning Based Algorithm for the Maximization of EV Charging Station Revenue
    Dimitrov, Stoyan
    Lguensat, Redouane
    2014 INTERNATIONAL CONFERENCE ON MATHEMATICS AND COMPUTERS IN SCIENCES AND IN INDUSTRY (MCSI 2014), 2014, : 235 - 239
  • [46] Learning an Effective Charging Scheme for Mobile Devices
    Liu, Tang
    Wu, Baijun
    Xu, Wenzheng
    Cao, Xianbo
    Peng, Jian
    Wu, Hongyi
    2020 IEEE 34TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM IPDPS 2020, 2020, : 202 - 211
  • [47] Reinforcement learning-based design of orienting devices for vibratory bowl feeders
    Stocker, Cosima
    Schmid, Marc
    Reinhart, Gunther
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2019, 105 (09): : 3631 - 3642
  • [48] Robust Reinforcement Learning-Based Tracking Control for Wheeled Mobile Robot
    Nguyen Tan Luy
    Nguyen Duc Thanh
    Nguyen Thien Thanh
    Nguyen Thi Phuong Ha
    2010 2ND INTERNATIONAL CONFERENCE ON COMPUTER AND AUTOMATION ENGINEERING (ICCAE 2010), VOL 1, 2010, : 171 - 176
  • [49] Deep reinforcement learning-based microservice selection in mobile edge computing
    Guo, Feiyan
    Tang, Bing
    Tang, Mingdong
    Liang, Wei
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2023, 26 (02): : 1319 - 1335
  • [50] Deep reinforcement learning-based microservice selection in mobile edge computing
    Feiyan Guo
    Bing Tang
    Mingdong Tang
    Wei Liang
    Cluster Computing, 2023, 26 : 1319 - 1335