Priority Assignment Method of DAG Task on ROS2 Multithreaded Executor

被引:0
|
作者
Ji D. [1 ,2 ]
Wei Y. [1 ,2 ]
Li Y. [1 ]
Wang Y. [1 ,2 ]
机构
[1] School of Computer Science and Engineering, Northeastern University, Shenyang
[2] Key Laboratory of Intelligent Computing in Medical Image, Northeastern University, Ministry of Education, Shenyang
基金
中国国家自然科学基金;
关键词
DAG task; Monte Carlo tree search (MCTS); priority assignment; reinforcement learning (RL); robot operating system (ROS);
D O I
10.7544/issn1000-1239.202220741
中图分类号
学科分类号
摘要
With the growing popularity of the robot operating system (ROS), these systems are becoming increasingly complex, and the computing platforms they run on are transforming into multi-core platforms. In ROS, the order of task execution is determined by the underlying task scheduling strategy and the priorities assigned to the tasks. Minimizing the execution time of all tasks is a crucial goal in task scheduling for parallel systems. To address this challenge, we propose a reinforcement learning-based task priority assignment method, inspired by recent achievements in using reinforcement learning for handling various combinatorial optimization problems and considering the scheduling mechanisms and execution constraints of ROS2 multi-threaded executors. This method extracts the temporal and structural features of the task set, which is represented in the form of a directed acyclic graph (DAG), and efficiently learns the ROS2 scheduling policy through a combination of policy gradient and Monte Carlo tree search (MCTS) methods, providing a reasonable priority setting scheme. The goal of minimizing the completion time of DAG parallel tasks is achieved through this method. The proposed method is evaluated by simulating randomly generated task graphs in a simulation platform environment. The results show that it outperforms the benchmark methods. As an off-line analysis method, the proposed method can be easily extended to more complex ROS and can find a near-optimal solution in an acceptable amount of time. © 2023 Science Press. All rights reserved.
引用
收藏
页码:1086 / 1098
页数:12
相关论文
共 45 条
  • [1] Macenski S, Foote T, Gerkey B, Et al., Robot operating system 2: Design, architecture, and uses in the wild, Science Robotics, 7, 66, (2022)
  • [2] Casini D, Blass T, Lutkebohle I, Et al., Response-time analysis of ROS 2 processing chains under reservation-based scheduling, Proc of the 31st Euromicro Conf on Real-Time Systems (ECRTS), (2019)
  • [3] Tang Yue, Feng Zhiwei, Guan Nan, Et al., Response time analysis and priority assignment of processing chains on ROS 2 executors[C], Proc of the 41st IEEE Real-Time Systems Symp (RTSS), pp. 231-243, (2020)
  • [4] Bedard C, Lutkebohle I, Dagenais M., ROS2_tracing: Multipurpose low-overhead framework for real-time tracing of ROS 2[J], IEEE Robotics and Automation Letters, 7, 3, pp. 6511-6518, (2022)
  • [5] Blass T, Casini D, Bozhko S, Et al., A ROS 2 response-time analysis exploiting starvation freedom and execution-time variance[C], Proc of the 42nd IEEE Real-Time Systems Symp (RTSS), pp. 41-53, (2021)
  • [6] Kronauer T, Pohlmann J, Matthe M, Et al., Latency analysis of ROS2 multi-node systems, (2021)
  • [7] Vazirani V V., Approximation Algorithms, (2001)
  • [8] Martello S, Pisinger D, Vigo D., The three-dimensional bin packing problem[J], Operations Research, 48, 2, (2000)
  • [9] Jing Li, Chen Jianjia, Agrawal K, Et al., Analysis of federated and global scheduling for parallel real-time tasks[C], Proc of the 26th Euromicro Conf on Real-Time Systems(ECRTS), pp. 85-96, (2014)
  • [10] Melani A, Bertogna M, Bonifaci V, Et al., Response-time analysis of conditional dag tasks in multiprocessor systems[C], Proc of the 27th Euromicro Conf on Real-Time Systems(ECRTS), pp. 211-221, (2015)