Deploying SDN Control in Internet of UAVs: Q-Learning-Based Edge Scheduling

被引:20
|
作者
Zhang, Chaofeng [1 ]
Dong, Mianxiong [2 ]
Ota, Kaoru [3 ]
机构
[1] Adv Inst Ind Technol, Dept Ind Technol, Tokyo 1400011, Japan
[2] Muroran Inst Technol, Dept Sci & Informat, Muroran, Hokkaido 0508585, Japan
[3] Muroran Inst Technol, Dept Informat & Elect Engn, Muroran, Hokkaido 0508585, Japan
关键词
Data collection; Optimization; Resource management; Throughput; Routing; Cloud computing; Production; Softwarized network; wireless networks and cellar networks; machine learning; Internet of Things services; distributed management; DATA-COLLECTION; RESOURCE-MANAGEMENT; IOT; NETWORK; THINGS;
D O I
10.1109/TNSM.2021.3059159
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, wilderness monitoring provides massive data output for supporting agricultural production, environmental protection, and disaster monitoring. However, smart upgrading alone for these wireless nodes cannot meet the softwarized network needs today, relating to the explosion of multi-dimensional data and multi-species equipment. In this article, we conduct a comprehensive solution for the UAV based data collection strategy in an "air-to-ground" intelligent softwarized collection system. The innovation in this article is that after using the IoT nodes to complete the data collection process through the proposed bandwidth-weighted traffic pushing optimization (BWPTO) algorithm, the system infers the future changes according to the current network state using a deep Q-learning (DQL) network. Then, by developing the proposed AIIPO (Air-to-Ground Intelligent Information Pushing Optimization) algorithm, the entire network can "forward-looking" the uploaded information to potentially idle nodes in the future, thus achieve the optimized system performance. Through the final mathematical experiments, we prove the optimality of our proposed routing algorithm and forwarding strategy, which are more applicable in the dynamic "air-to-ground" distributed data collection system than other benchmark solutions.
引用
收藏
页码:526 / 537
页数:12
相关论文
共 50 条
  • [31] An Improved Q-Learning-Based Sensor-Scheduling Algorithm for Multi-Target Tracking
    Qu, Zhiyi
    Zhao, Xue
    Xu, Huihui
    Tang, Hongying
    Wang, Jiang
    Li, Baoqing
    SENSORS, 2022, 22 (18)
  • [32] Q-learning-based practical disturbance compensation control for hypersonic flight vehicle
    Li, Xu
    Zhang, Ziyi
    Ji, Yuehui
    Liu, Junjie
    Gao, Qiang
    PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART G-JOURNAL OF AEROSPACE ENGINEERING, 2023, 237 (08) : 1916 - 1929
  • [33] Q-Learning-Based Model Predictive Control for Energy Management in Residential Aggregator
    Ojand, Kianoosh
    Dagdougui, Hanane
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2022, 19 (01) : 70 - 81
  • [34] Q-learning-based congestion control strategy for information-centric networking
    Meng, Wei
    Zhang, Lingling
    INTERNET TECHNOLOGY LETTERS, 2021, 4 (05)
  • [35] A Q-learning-based memetic algorithm for multi-objective dynamic software project scheduling
    Shen, Xiao-Ning
    Minku, Leandro L.
    Marturi, Naresh
    Guo, Yi-Nan
    Han, Ying
    INFORMATION SCIENCES, 2018, 428 : 1 - 29
  • [36] Q-Learning-Based Multi-Rate Optimal Control for Process Industries
    Xia, Zhenxing
    Hu, Mengjie
    Dai, Wei
    Yan, Huaicheng
    Ma, Xiaoping
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2023, 70 (06) : 2006 - 2010
  • [37] A deep q-learning-based optimization of the inventory control in a linear process chain
    Dittrich, M. -A.
    Fohlmeister, S.
    PRODUCTION ENGINEERING-RESEARCH AND DEVELOPMENT, 2021, 15 (01): : 35 - 43
  • [38] Q-Learning-Based Supervisory Control Adaptability Investigation for Hybrid Electric Vehicles
    Xu, Bin
    Tang, Xiaolin
    Hu, Xiaosong
    Lin, Xianke
    Li, Huayi
    Rathod, Dhruvang
    Wang, Zhe
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 6797 - 6806
  • [39] A Q-Learning-Based Two-Layer Cooperative Intrusion Detection for Internet of Drones System
    Wu, Moran
    Zhu, Zhiliang
    Xia, Yunzhi
    Yan, Zhengbing
    Zhu, Xiangou
    Ye, Nan
    DRONES, 2023, 7 (08)
  • [40] Secure Status Updates for Internet of Drones: A Deep Q-Learning-Based Antenna Selection Approach
    Xiao, Yuquan
    Du, Qinghe
    Lut, Chen
    Wang, Yizhuo
    20TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE, IWCMC 2024, 2024, : 461 - 466