Charging Efficiency Optimization Based on Swarm Reinforcement Learning Under Dynamic Energy Consumption for WRSN

被引:2
|
作者
Chen, Jingyang [1 ]
Li, Xiaohui [1 ]
Ding, Yuemin [2 ]
Cai, Bin [1 ]
He, Jie [1 ]
Zhao, Min [1 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China
[2] Univ Navarra, Tecnun Sch Engn, Gipuzkoa 20009, Spain
基金
中国国家自然科学基金;
关键词
Optimization; Wireless sensor networks; Sensors; Energy consumption; Reinforcement learning; Convergence; Schedules; Charging efficiency optimization; swarm reinforcement learning (SRL); wireless rechargeable sensor network (WRSN); SENSOR NETWORKS; WIRELESS; ALGORITHM;
D O I
10.1109/JSEN.2024.3407748
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Wireless rechargeable sensor networks (WRSNs) have been widely used to solve the energy constraint problem of wireless sensor networks (WSNs). Improving the charging efficiency of the mobile charger (MC) is crucial for WRSN. However, the time-varying states of WRSN caused by dynamic changes in node energy consumption during the charging process of the MC make the optimization of charging efficiency rather difficult in WRSN. To solve this problem, a kind of optimization approach based on swarm reinforcement learning (SRL) is presented in this article. The presented approach lets the multiple agents better adapt to the dynamic energy distribution in WRSN by designing a dynamic energy consumption model. Then, it utilizes a rank-based ant system (AS(rank)) to ensure that the MC gets the initial optimal requesting sensor nodes (SNs), which contributes to accelerating the convergence speed of SRL. Finally, it adopts particle swarm optimization (PSO) to improve the learning effectiveness during the exchanges of experience among multiple agents, which contributes to optimizing the charging path of MC. Extensive simulations show that the presented approach achieves better charging performance than the existing typical approaches, and it has significant advantages in terms of charging efficiency, SN dead ratio, and MC energy efficiency ratio.
引用
收藏
页码:33427 / 33441
页数:15
相关论文
共 50 条
  • [21] Research on overall energy consumption optimization method for data center based on deep reinforcement learning
    Wang Simin
    Qin Lulu
    Ma Chunmiao
    Wu Weiguo
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 44 (05) : 7333 - 7349
  • [22] Energy Consumption Optimization for Heating, Ventilation and Air Conditioning Systems Based on Deep Reinforcement Learning
    Peng, Yi
    Shen, Haojun
    Tang, Xiaochang
    Zhang, Sizhe
    Zhao, Jinxiao
    Liu, Yuru
    Nie, Yuming
    IEEE ACCESS, 2023, 11 : 88265 - 88277
  • [23] Pig Building Environment Optimization Control and Energy Consumption Analysis Based on Deep Reinforcement Learning
    Xie Q.
    Wang S.
    Musabimana J.
    Guo Y.
    Liu H.
    Bao J.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 (11): : 376 - 430
  • [24] A reinforcement learning-based communication topology in particle swarm optimization
    Yue Xu
    Dechang Pi
    Neural Computing and Applications, 2020, 32 : 10007 - 10032
  • [25] A reinforcement learning-based communication topology in particle swarm optimization
    Xu, Yue
    Pi, Dechang
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (14): : 10007 - 10032
  • [26] Dynamic Multi-swarm Particle Swarm Optimization Based on Mite Learning
    Tang, Yichao
    Wei, Bo
    Xia, Xuewen
    Gui, Ling
    2019 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2019), 2019, : 2311 - 2318
  • [27] Dynamic Multi-Swarm Particle Swarm Optimization Based on Elite Learning
    Xia, Xuewen
    Tang, Yichao
    Wei, Bo
    Gui, Ling
    IEEE ACCESS, 2019, 7 : 184849 - 184865
  • [28] Research on Efficiency Optimization Based Energy Management Strategy for a Hybrid Electric Vehicle with Reinforcement Learning
    Yang N.
    Han L.
    Liu H.
    Zhang X.
    Qiche Gongcheng/Automotive Engineering, 2021, 43 (07): : 1046 - 1056
  • [29] IoT Network with Energy Efficiency for Dynamic Sink via Reinforcement Learning
    Chakravarty, Sumit
    Kumar, Arun
    WIRELESS PERSONAL COMMUNICATIONS, 2024, 136 (03) : 1719 - 1734
  • [30] Query-Based Learning for Dynamic Particle Swarm Optimization
    Chang, Ray-I
    Hsu, Hung-Min
    Lin, Shu-Yu
    Chang, Chu-Chun
    Ho, Jan-Ming
    IEEE ACCESS, 2017, 5 : 7648 - 7658