Charging Efficiency Optimization Based on Swarm Reinforcement Learning Under Dynamic Energy Consumption for WRSN

被引:2
|
作者
Chen, Jingyang [1 ]
Li, Xiaohui [1 ]
Ding, Yuemin [2 ]
Cai, Bin [1 ]
He, Jie [1 ]
Zhao, Min [1 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China
[2] Univ Navarra, Tecnun Sch Engn, Gipuzkoa 20009, Spain
基金
中国国家自然科学基金;
关键词
Optimization; Wireless sensor networks; Sensors; Energy consumption; Reinforcement learning; Convergence; Schedules; Charging efficiency optimization; swarm reinforcement learning (SRL); wireless rechargeable sensor network (WRSN); SENSOR NETWORKS; WIRELESS; ALGORITHM;
D O I
10.1109/JSEN.2024.3407748
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Wireless rechargeable sensor networks (WRSNs) have been widely used to solve the energy constraint problem of wireless sensor networks (WSNs). Improving the charging efficiency of the mobile charger (MC) is crucial for WRSN. However, the time-varying states of WRSN caused by dynamic changes in node energy consumption during the charging process of the MC make the optimization of charging efficiency rather difficult in WRSN. To solve this problem, a kind of optimization approach based on swarm reinforcement learning (SRL) is presented in this article. The presented approach lets the multiple agents better adapt to the dynamic energy distribution in WRSN by designing a dynamic energy consumption model. Then, it utilizes a rank-based ant system (AS(rank)) to ensure that the MC gets the initial optimal requesting sensor nodes (SNs), which contributes to accelerating the convergence speed of SRL. Finally, it adopts particle swarm optimization (PSO) to improve the learning effectiveness during the exchanges of experience among multiple agents, which contributes to optimizing the charging path of MC. Extensive simulations show that the presented approach achieves better charging performance than the existing typical approaches, and it has significant advantages in terms of charging efficiency, SN dead ratio, and MC energy efficiency ratio.
引用
收藏
页码:33427 / 33441
页数:15
相关论文
共 50 条
  • [41] Reinforcement-learning-based parameter adaptation method for particle swarm optimization
    Shiyuan Yin
    Min Jin
    Huaxiang Lu
    Guoliang Gong
    Wenyu Mao
    Gang Chen
    Wenchang Li
    Complex & Intelligent Systems, 2023, 9 : 5585 - 5609
  • [42] Two-order cooperative optimization of swarm control based on reinforcement learning
    Yu, Dengxiu
    Qin, Zhenhao
    Chen, Kang
    Cheong, Kang Hao
    Chen, C. L. Philip
    IET CONTROL THEORY AND APPLICATIONS, 2024, 18 (01): : 125 - 136
  • [43] Swarm Reinforcement Learning Algorithm Based on Particle Swarm Optimization Whose Personal Bests Have Lifespans
    Iima, Hitoshi
    Kuroe, Yasuaki
    NEURAL INFORMATION PROCESSING, PT 2, PROCEEDINGS, 2009, 5864 : 169 - 178
  • [44] Dynamic Matching Optimization in Ridesharing System Based on Reinforcement Learning
    Abdelmoumene, Hiba
    Bencheriet, Chemesse Ennehar
    Belleili, Habiba
    Touati, Islem
    Zemouli, Chayma
    IEEE ACCESS, 2024, 12 : 29525 - 29535
  • [45] Dynamic optimization of intersatellite link assignment based on reinforcement learning
    Ren, Weiwu
    Zhu, Jialin
    Qi, Hui
    Cong, Ligang
    Di, Xiaoqiang
    INTERNATIONAL JOURNAL OF DISTRIBUTED SENSOR NETWORKS, 2022, 18 (02)
  • [46] Deep Reinforcement Learning based dynamic optimization of bus timetable
    Ai, Guanqun
    Zuo, Xingquan
    Chen, Gang
    Wu, Binglin
    APPLIED SOFT COMPUTING, 2022, 131
  • [47] Multi-Agent Reinforcement Learning Based Energy Efficiency Optimization in NB-IoT Networks
    Guo, Yuancheng
    Xiang, Min
    2019 IEEE GLOBECOM WORKSHOPS (GC WKSHPS), 2019,
  • [48] Microgrid Optimization Strategy for Charging and Swapping Power Stations with New Energy Based on Multi-Agent Reinforcement Learning
    Sun, Hongbin
    Duan, Zhenyu
    Yang, Anyun
    SUSTAINABILITY, 2024, 16 (23)
  • [49] Energy Efficiency Optimization of Massive MIMO Systems Based on the Particle Swarm Optimization Algorithm
    Yang, Jing
    Zhang, Liping
    Zhu, Chunhua
    Guo, Xinying
    Zhang, Jiankang
    WIRELESS COMMUNICATIONS & MOBILE COMPUTING, 2021, 2021
  • [50] AutoScale: Energy Efficiency Optimization for Stochastic Edge Inference Using Reinforcement Learning
    Kim, Young Geun
    Wu, Carole-Jean
    2020 53RD ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE (MICRO 2020), 2020, : 1082 - 1096