Charging Efficiency Optimization Based on Swarm Reinforcement Learning Under Dynamic Energy Consumption for WRSN

被引:2
|
作者
Chen, Jingyang [1 ]
Li, Xiaohui [1 ]
Ding, Yuemin [2 ]
Cai, Bin [1 ]
He, Jie [1 ]
Zhao, Min [1 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China
[2] Univ Navarra, Tecnun Sch Engn, Gipuzkoa 20009, Spain
基金
中国国家自然科学基金;
关键词
Optimization; Wireless sensor networks; Sensors; Energy consumption; Reinforcement learning; Convergence; Schedules; Charging efficiency optimization; swarm reinforcement learning (SRL); wireless rechargeable sensor network (WRSN); SENSOR NETWORKS; WIRELESS; ALGORITHM;
D O I
10.1109/JSEN.2024.3407748
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Wireless rechargeable sensor networks (WRSNs) have been widely used to solve the energy constraint problem of wireless sensor networks (WSNs). Improving the charging efficiency of the mobile charger (MC) is crucial for WRSN. However, the time-varying states of WRSN caused by dynamic changes in node energy consumption during the charging process of the MC make the optimization of charging efficiency rather difficult in WRSN. To solve this problem, a kind of optimization approach based on swarm reinforcement learning (SRL) is presented in this article. The presented approach lets the multiple agents better adapt to the dynamic energy distribution in WRSN by designing a dynamic energy consumption model. Then, it utilizes a rank-based ant system (AS(rank)) to ensure that the MC gets the initial optimal requesting sensor nodes (SNs), which contributes to accelerating the convergence speed of SRL. Finally, it adopts particle swarm optimization (PSO) to improve the learning effectiveness during the exchanges of experience among multiple agents, which contributes to optimizing the charging path of MC. Extensive simulations show that the presented approach achieves better charging performance than the existing typical approaches, and it has significant advantages in terms of charging efficiency, SN dead ratio, and MC energy efficiency ratio.
引用
收藏
页码:33427 / 33441
页数:15
相关论文
共 50 条
  • [31] Competitive Swarm Optimization with Dynamic Opposition-based Learning
    Zhang, Yangfan
    Sun, Jun
    2018 IEEE INTERNATIONAL SMART CITIES CONFERENCE (ISC2), 2018,
  • [32] A multi-agent reinforcement learning-based method for server energy efficiency optimization combining DVFS and dynamic fan control
    Lin, Wenjun
    Lin, Weiwei
    Lin, Jianpeng
    Zhong, Haocheng
    Wang, Jiangtao
    He, Ligang
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2024, 42
  • [33] A novel mobile charging planning method based on swarm reinforcement learning in wireless sensor networks
    Lyu, Zengwei
    Li, Pengfei
    Wei, Zhenchun
    Xu, Juan
    Shi, Lei
    INTERNATIONAL JOURNAL OF SENSOR NETWORKS, 2023, 41 (03) : 176 - 188
  • [34] Swarm intelligence based optimization of energy consumption in cognitive radio network
    Gogoi, Ashim Jyoti
    Choudhury, Hussain Ahmed
    Baishnab, Krishna Lal
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2019, 36 (03) : 2399 - 2407
  • [35] Deep reinforcement learning based optimization of automated guided vehicle time and energy consumption in a container terminal
    Drungilas, Darius
    Kurmis, Mindaugas
    Senulis, Audrius
    Lukosius, Zydrunas
    Andziulis, Arunas
    Januteniene, Jolanta
    Bogdevicius, Marijonas
    Jankunas, Valdas
    Voznak, Miroslav
    ALEXANDRIA ENGINEERING JOURNAL, 2023, 67 : 397 - 407
  • [36] Reinforcement Learning Optimization of the Charging of a Dicke Quantum Battery
    Erdman, Paolo Andrea
    Andolina, Gian Marcello
    Giovannetti, Vittorio
    Noe, Frank
    PHYSICAL REVIEW LETTERS, 2024, 133 (24)
  • [37] Reinforcement-learning-based parameter adaptation method for particle swarm optimization
    Yin, Shiyuan
    Jin, Min
    Lu, Huaxiang
    Gong, Guoliang
    Mao, Wenyu
    Chen, Gang
    Li, Wenchang
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (05) : 5585 - 5609
  • [38] Reinforcement learning-based particle swarm optimization for sewage treatment control
    Lu Lu
    Hui Zheng
    Jing Jie
    Miao Zhang
    Rui Dai
    Complex & Intelligent Systems, 2021, 7 : 2199 - 2210
  • [39] Reinforcement learning-based particle swarm optimization for sewage treatment control
    Lu, Lu
    Zheng, Hui
    Jie, Jing
    Zhang, Miao
    Dai, Rui
    COMPLEX & INTELLIGENT SYSTEMS, 2021, 7 (05) : 2199 - 2210
  • [40] Hybrid Particle Swarm Optimization Algorithm Based on the Theory of Reinforcement Learning in Psychology
    Huang, Wenya
    Liu, Youjin
    Zhang, Xizheng
    SYSTEMS, 2023, 11 (02):