Charging Efficiency Optimization Based on Swarm Reinforcement Learning Under Dynamic Energy Consumption for WRSN

被引:2
|
作者
Chen, Jingyang [1 ]
Li, Xiaohui [1 ]
Ding, Yuemin [2 ]
Cai, Bin [1 ]
He, Jie [1 ]
Zhao, Min [1 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China
[2] Univ Navarra, Tecnun Sch Engn, Gipuzkoa 20009, Spain
基金
中国国家自然科学基金;
关键词
Optimization; Wireless sensor networks; Sensors; Energy consumption; Reinforcement learning; Convergence; Schedules; Charging efficiency optimization; swarm reinforcement learning (SRL); wireless rechargeable sensor network (WRSN); SENSOR NETWORKS; WIRELESS; ALGORITHM;
D O I
10.1109/JSEN.2024.3407748
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Wireless rechargeable sensor networks (WRSNs) have been widely used to solve the energy constraint problem of wireless sensor networks (WSNs). Improving the charging efficiency of the mobile charger (MC) is crucial for WRSN. However, the time-varying states of WRSN caused by dynamic changes in node energy consumption during the charging process of the MC make the optimization of charging efficiency rather difficult in WRSN. To solve this problem, a kind of optimization approach based on swarm reinforcement learning (SRL) is presented in this article. The presented approach lets the multiple agents better adapt to the dynamic energy distribution in WRSN by designing a dynamic energy consumption model. Then, it utilizes a rank-based ant system (AS(rank)) to ensure that the MC gets the initial optimal requesting sensor nodes (SNs), which contributes to accelerating the convergence speed of SRL. Finally, it adopts particle swarm optimization (PSO) to improve the learning effectiveness during the exchanges of experience among multiple agents, which contributes to optimizing the charging path of MC. Extensive simulations show that the presented approach achieves better charging performance than the existing typical approaches, and it has significant advantages in terms of charging efficiency, SN dead ratio, and MC energy efficiency ratio.
引用
收藏
页码:33427 / 33441
页数:15
相关论文
共 50 条
  • [1] Optimization of multi-vehicle charging and discharging efficiency under time constraints based on reinforcement learning
    Liu, Peng
    Liu, Zhe
    Fu, Tingting
    Garg, Sahil
    Kaddoum, Georges
    Hassan, Mohammad Mehedi
    ALEXANDRIA ENGINEERING JOURNAL, 2024, 105 : 724 - 735
  • [2] Gait Parameter Optimization of Quadruped Robot Under Energy Consumption Index Based on Reinforcement Learning
    Chen, Lu
    Ma, Hongxu
    Lang, Lin
    Liu, Xiangming
    Wei, Qing
    An, Honglei
    2022 INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND MECHATRONICS (ICARM 2022), 2022, : 972 - 977
  • [3] Swarm Reinforcement Learning Algorithms Based on Particle Swarm Optimization
    Iima, Hitoshi
    Kuroe, Yasuaki
    2008 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN AND CYBERNETICS (SMC), VOLS 1-6, 2008, : 1109 - 1114
  • [4] Energy Efficiency Optimization in Heterogeneous Networks Based on Deep Reinforcement Learning
    Shi, Daoping
    Tian, Feng
    Wu, Shengchen
    2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS (ICC WORKSHOPS), 2020,
  • [5] Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning
    Kim, Byung-Gook
    Zhang, Yu
    van der Schaar, Mihaela
    Lee, Jang-Won
    IEEE TRANSACTIONS ON SMART GRID, 2016, 7 (05) : 2187 - 2198
  • [6] Deep-Reinforcement-Learning-Based Joint Energy Replenishment and Data Collection Scheme for WRSN
    Li, Jishan
    Deng, Zhichao
    Feng, Yong
    Liu, Nianbo
    SENSORS, 2024, 24 (08)
  • [7] Reinforcement-Learning-Based Optimization on Energy Efficiency in UAV Networks for IoT
    Deng, Dan
    Li, Junxia
    Jhaveri, Rutvij H. H.
    Tiwari, Prayag
    Ijaz, Muhammad Fazal
    Ou, Jiangtao
    Fan, Chengyuan
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (03) : 2767 - 2775
  • [8] PLANNING OF ENERGY CARRIERS BASED ON FINAL ENERGY CONSUMPTION USING DYNAMIC PROGRAMMING AND PARTICLE SWARM OPTIMIZATION
    Dehghani, M.
    Montazeri, Z.
    Ehsanifar, A.
    Seifi, A. R.
    Ebadi, M. J.
    Grechko, O. M.
    ELECTRICAL ENGINEERING & ELECTROMECHANICS, 2018, (05) : 62 - 71
  • [9] A novel on-demand charging strategy based on swarm reinforcement learning in WRSNs
    Wei, Zhen
    Li, Meng
    Wei, Zhenchun
    Cheng, Lei
    Lyu, Zengwei
    Liu, Fei
    IEEE Access, 2020, 8 : 84258 - 84271
  • [10] A Novel On-Demand Charging Strategy Based on Swarm Reinforcement Learning in WRSNs
    Wei, Zhen
    Li, Meng
    Wei, Zhenchun
    Cheng, Lei
    Lyu, Zengwei
    Liu, Fei
    IEEE ACCESS, 2020, 8 : 84258 - 84271