Dual-Actor Critic Adaptive Energy Management Method for EH-WSN Based on Battery Energy Neutral Operation

被引:0
|
作者
Yuan, Shuhua [1 ]
Ge, Yongqi [1 ]
Chen, Xin [1 ]
Wang, Yalin [1 ]
Liu, Rui [1 ]
Gao, Jintao [1 ]
机构
[1] Ningxia Univ, Sch Informat Engn, Ningxia 750000, Peoples R China
基金
中国国家自然科学基金;
关键词
Battery energy neutral operation (BENO); duty cycle; energy harvesting; energy management; reinforcement learning; wireless sensor network node;
D O I
10.1109/JSEN.2024.3472089
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Energy harvesting wireless sensor nodes collect energy in a nonlinear dynamic change, resulting in low ability to dynamically match the collected and consumed energy of the node in the process of maintaining energy neutral operation (ENO).To address this problem, the concept of battery ENO (BENO) is proposed by analyzing the battery energy buffer characteristics, and the dual-actor critic energy harvesting wireless sensor node adaptive energy management (DAC) method is proposed based on BENO. The method designs a dual-actor critic structure, senses ENO through the battery energy neutral value, and dynamically adjusts the duty cycle based on this value, in order to achieve the purpose of improving the ability of dynamically matching the collected energy with the consumed energy. The experiments are carried out on three datasets with different energy harvesting capabilities, and compared and analyzed with three classical algorithms, RLman, AQL and FQL. The experimental results show that compared with the other three classical algorithms, DAC sacrifices a small amount of duty cycle, but effectively improves the stability of battery energy, and improves the energy utilization and ENO performance. The BENO concept and the DAC methodology can provide guidance and references for the research of energy management in energy-harvesting wireless sensor nodes.
引用
收藏
页码:38466 / 38478
页数:13
相关论文
共 50 条
  • [31] Adaptive Battery Steering and Management System for the Optimized Operation of Stationary Battery Energy Storage Systems in Multi-Use Applications
    Badeda, Julia
    Kwiecien, Monika
    Schulte, Dominik
    Ruewald, Timo
    Sauer, Dirk Uwe
    2017 IEEE INTERNATIONAL TELECOMMUNICATIONS ENERGY CONFERENCE (INTELEC), 2017, : 287 - 293
  • [32] Battery thermal- and cabin comfort-aware collaborative energy management for plug-in fuel cell electric vehicles based on the soft actor-critic algorithm
    Deng, Lei
    Li, Shen
    Tang, Xiaolin
    Yang, Kai
    Lin, Xianke
    ENERGY CONVERSION AND MANAGEMENT, 2023, 283
  • [33] Improving energy efficiency in WSN through adaptive memetic-based clustering and routing for resource management
    Vimalarani, C.
    Selvi, C. P. Thamil
    Gopinathan, B.
    Kalavani, T.
    SUSTAINABLE COMPUTING-INFORMATICS & SYSTEMS, 2025, 45
  • [34] Non-Intrusive Load Monitoring-based Fuzzy Actor-Critic Reinforcement Learning Home Energy Management
    Hamedifar, Sima
    Liu, Shichao
    Xiao, George
    2024 IEEE 7TH INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER-PHYSICAL SYSTEMS, ICPS 2024, 2024,
  • [35] Adaptive receding horizon control for battery energy storage management with age-and-operation-dependent efficiency and degradation
    Allahham, Adib
    Greenwood, David
    Patsios, Charalampos
    Taylor, Phil
    ELECTRIC POWER SYSTEMS RESEARCH, 2022, 209
  • [36] Optimal home energy management strategy: A reinforcement learning method with actor-critic using Kronecker-factored trust region
    Chu, Yunfei
    Wei, Zhinong
    Sun, Guoqiang
    Zang, Haixiang
    Chen, Sheng
    Zhou, Yizhou
    ELECTRIC POWER SYSTEMS RESEARCH, 2022, 212
  • [37] Adaptive Robust Operation for Battery Energy Storage Systems with SoC Management in a Three- phase Unbalanced Microgrid
    Wang, Bo
    Zhang, Cuo
    2020 INTERNATIONAL CONFERENCE ON SMART GRIDS AND ENERGY SYSTEMS (SGES 2020), 2020, : 332 - 337
  • [38] Hybrid method based energy management of electric vehicles using battery-super capacitor energy storage
    Alkawak, Omar A.
    Kumar, Jambi Ratna Raja
    Daniel, Silas Stephen
    Reddy, Chinthalacheruvu Venkata Krishna
    JOURNAL OF ENERGY STORAGE, 2024, 77
  • [39] Energy management in HDHEV with dual APUs: Enhancing soft actor-critic using clustered experience replay and multi-dimensional priority sampling
    Zhang, Dongfang
    Sun, Wei
    Zou, Yuan
    Zhang, Xudong
    ENERGY, 2025, 319
  • [40] High robustness energy management strategy of hybrid electric vehicle based on improved soft actor-critic deep reinforcement learning
    Sun, Wenjing
    Zou, Yuan
    Zhang, Xudong
    Guo, Ningyuan
    Zhang, Bin
    Du, Guodong
    ENERGY, 2022, 258