Investigating the performance of multi-objective reinforcement learning techniques in the context of IoT with harvesting energy

被引:0
|
作者
Haouari, Bakhta [1 ,2 ,3 ]
Mzid, Rania [1 ,4 ]
Mosbahi, Olfa [2 ]
机构
[1] Univ Tunis El Manar, ISI, 2 Rue Abourraihan Al Bayrouni, Ariana 2080, Tunisia
[2] Univ Carthage, LISI Lab INSAT, Ctr Urbain Nord BP 676, Tunis 1080, Tunisia
[3] Univ Carthage, Tunisia Polytech Sch, BP 743, La Marsa 2078, Tunisia
[4] Univ Sfax, CES Lab ENIS, BP w3, Sfax 3038, Tunisia
来源
JOURNAL OF SUPERCOMPUTING | 2025年 / 81卷 / 04期
关键词
IoT; Energy harvesting; Multi-objective optimization; Reinforcement learning; Scalarization; Pareto Q-learning;
D O I
10.1007/s11227-025-07010-6
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In the realm of IoT, wireless sensor networks (WSNs) play a crucial role in efficient data collection and task execution. However, energy constraints, particularly in battery-powered WSNs, present significant challenges. Energy harvesting (EH) technologies extend battery life but introduce variability that can impact quality of service (QoS). This paper introduces QoSA, a reinforcement learning (RL) agent designed to optimize QoS while adhering to energy constraints in IoT gateways. QoSA employs both single-policy and multi-policy RL methods to address trade-offs between conflicting objectives. This study investigates the performance of these methods in identifying Pareto front solutions for optimal service activation. A comparative analysis highlights the strengths and weaknesses of each proposed algorithm. Experimental results show that multi-policy methods outperform their single-policy counterparts in balancing trade-offs, demonstrating their effectiveness in real-world IoT applications.
引用
收藏
页数:49
相关论文
共 50 条
  • [1] Multi-objective Reinforcement Learning for Energy Harvesting Wireless Sensor Nodes
    Shresthamali, Shaswot
    Kondo, Masaaki
    Nakamura, Hiroshi
    2021 IEEE 14TH INTERNATIONAL SYMPOSIUM ON EMBEDDED MULTICORE/MANY-CORE SYSTEMS-ON-CHIP (MCSOC 2021), 2021, : 98 - 105
  • [2] Multi-objective safe reinforcement learning: the relationship between multi-objective reinforcement learning and safe reinforcement learning
    Horie, Naoto
    Matsui, Tohgoroh
    Moriyama, Koichi
    Mutoh, Atsuko
    Inuzuka, Nobuhiro
    ARTIFICIAL LIFE AND ROBOTICS, 2019, 24 (03) : 352 - 359
  • [3] Multi-objective safe reinforcement learning: the relationship between multi-objective reinforcement learning and safe reinforcement learning
    Naoto Horie
    Tohgoroh Matsui
    Koichi Moriyama
    Atsuko Mutoh
    Nobuhiro Inuzuka
    Artificial Life and Robotics, 2019, 24 : 352 - 359
  • [4] Multi-Objective Resource Scheduling for IoT Systems Using Reinforcement Learning
    Shresthamali, Shaswot
    Kondo, Masaaki
    Nakamura, Hiroshi
    JOURNAL OF LOW POWER ELECTRONICS AND APPLICATIONS, 2022, 12 (04)
  • [5] Scalarized Multi-Objective Reinforcement Learning: Novel Design Techniques
    Van Moffaert, Kristof
    Drugan, Madalina M.
    Nowe, Ann
    PROCEEDINGS OF THE 2013 IEEE SYMPOSIUM ON ADAPTIVE DYNAMIC PROGRAMMING AND REINFORCEMENT LEARNING (ADPRL), 2013, : 191 - 199
  • [6] Multi-objective ω-Regular Reinforcement Learning
    Hahn, Ernst Moritz
    Perez, Mateo
    Schewe, Sven
    Somenzi, Fabio
    Trivedi, Ashutosh
    Wojtczak, Dominik
    FORMAL ASPECTS OF COMPUTING, 2023, 35 (02)
  • [7] Federated multi-objective reinforcement learning
    Zhao, Fangyuan
    Ren, Xuebin
    Yang, Shusen
    Zhao, Peng
    Zhang, Rui
    Xu, Xinxin
    INFORMATION SCIENCES, 2023, 624 : 811 - 832
  • [8] Multi-Objective Optimisation by Reinforcement Learning
    Liao, H. L.
    Wu, Q. H.
    2010 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION (CEC), 2010,
  • [9] Investigating the multi-objective optimization of quality and efficiency using deep reinforcement learning
    Wang, Zhenhui
    Lu, Juan
    Chen, Chaoyi
    Ma, Junyan
    Liao, Xiaoping
    APPLIED INTELLIGENCE, 2022, 52 (11) : 12873 - 12887
  • [10] Investigating the multi-objective optimization of quality and efficiency using deep reinforcement learning
    Zhenhui Wang
    Juan Lu
    Chaoyi Chen
    Junyan Ma
    Xiaoping Liao
    Applied Intelligence, 2022, 52 : 12873 - 12887