Deploying SDN Control in Internet of UAVs: Q-Learning-Based Edge Scheduling

被引:20
|
作者
Zhang, Chaofeng [1 ]
Dong, Mianxiong [2 ]
Ota, Kaoru [3 ]
机构
[1] Adv Inst Ind Technol, Dept Ind Technol, Tokyo 1400011, Japan
[2] Muroran Inst Technol, Dept Sci & Informat, Muroran, Hokkaido 0508585, Japan
[3] Muroran Inst Technol, Dept Informat & Elect Engn, Muroran, Hokkaido 0508585, Japan
关键词
Data collection; Optimization; Resource management; Throughput; Routing; Cloud computing; Production; Softwarized network; wireless networks and cellar networks; machine learning; Internet of Things services; distributed management; DATA-COLLECTION; RESOURCE-MANAGEMENT; IOT; NETWORK; THINGS;
D O I
10.1109/TNSM.2021.3059159
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, wilderness monitoring provides massive data output for supporting agricultural production, environmental protection, and disaster monitoring. However, smart upgrading alone for these wireless nodes cannot meet the softwarized network needs today, relating to the explosion of multi-dimensional data and multi-species equipment. In this article, we conduct a comprehensive solution for the UAV based data collection strategy in an "air-to-ground" intelligent softwarized collection system. The innovation in this article is that after using the IoT nodes to complete the data collection process through the proposed bandwidth-weighted traffic pushing optimization (BWPTO) algorithm, the system infers the future changes according to the current network state using a deep Q-learning (DQL) network. Then, by developing the proposed AIIPO (Air-to-Ground Intelligent Information Pushing Optimization) algorithm, the entire network can "forward-looking" the uploaded information to potentially idle nodes in the future, thus achieve the optimized system performance. Through the final mathematical experiments, we prove the optimality of our proposed routing algorithm and forwarding strategy, which are more applicable in the dynamic "air-to-ground" distributed data collection system than other benchmark solutions.
引用
收藏
页码:526 / 537
页数:12
相关论文
共 50 条
  • [1] A Q-Learning-Based Approach for Deploying Dynamic Service Function Chains
    Sun, Jian
    Huang, Guanhua
    Sun, Gang
    Yu, Hongfang
    Sangaiah, Arun Kumar
    Chang, Victor
    SYMMETRY-BASEL, 2018, 10 (11):
  • [2] A novel Q-learning-based hybrid algorithm for the optimal offloading and scheduling in mobile edge computing environments
    Yeganeh, Somayeh
    Sangar, Amin Babazadeh
    Azizi, Sadoon
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2023, 214
  • [3] Q-Learning-based Edge Node Resource Allocation Algorithm in the Environment of Power Distribution Internet of Things
    Chen, Xi
    Xin, Rui
    He, Yue
    Zhang, Bo
    Lin, Peng
    IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 446 - 450
  • [4] Q-learning-based H∞ control for LPV systems
    Wang, Hongye
    Wen, Jiwei
    Wan, Haiying
    Xue, Huiwen
    ASIAN JOURNAL OF CONTROL, 2024,
  • [5] A Q-learning-based Automatic Heuristic Design Approach for Seru Scheduling
    Zhan, Rongxin
    Cui, Zihua
    Ma, Tao
    Li, Dongni
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 253 - 257
  • [6] A Q-Learning-Based Approach for Distributed Beam Scheduling in mmWave Networks
    Zhang, Xiang
    Sarkar, Shamik
    Bhuyan, Arupjyoti
    Kasera, Sneha Kumar
    Ji, Mingyue
    2021 IEEE INTERNATIONAL SYMPOSIUM ON DYNAMIC SPECTRUM ACCESS NETWORKS (DYSPAN), 2021, : 15 - 24
  • [7] A Q-learning-based downlink scheduling in 5G systems
    Liu, Jung-Chun
    Susanto, Heru
    Huang, Chi-Jan
    Tsai, Kun-Lin
    Leu, Fang-Yie
    Hong, Zhi-Qian
    WIRELESS NETWORKS, 2024, 30 (08) : 6951 - 6972
  • [8] A Q-Learning-Based Adaptive MAC Protocol for Internet of Things Networks
    Wu, Chien-Min
    Kao, Yen-Chun
    Chang, Kai-Fu
    Tsai, Cheng-Tai
    Hou, Cheng-Chun
    IEEE ACCESS, 2021, 9 (09): : 128905 - 128918
  • [9] Q-learning-based task offloading strategy for satellite edge computing
    Shuai, Jiaqi
    Xie, Bo
    Cui, Haixia
    Wang, Jiahuan
    Wen, Weichang
    INTERNATIONAL JOURNAL OF COMMUNICATION SYSTEMS, 2024, 37 (05)
  • [10] QTSRA: A Q-learning-based Trusted Routing Algorithm in SDN Wireless Sensor Networks
    Zhang, Yujie
    Li, Peng
    Fan, Weibei
    Wang, Ruchuan
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 1881 - 1886