Deploying SDN Control in Internet of UAVs: Q-Learning-Based Edge Scheduling

被引:20
|
作者
Zhang, Chaofeng [1 ]
Dong, Mianxiong [2 ]
Ota, Kaoru [3 ]
机构
[1] Adv Inst Ind Technol, Dept Ind Technol, Tokyo 1400011, Japan
[2] Muroran Inst Technol, Dept Sci & Informat, Muroran, Hokkaido 0508585, Japan
[3] Muroran Inst Technol, Dept Informat & Elect Engn, Muroran, Hokkaido 0508585, Japan
关键词
Data collection; Optimization; Resource management; Throughput; Routing; Cloud computing; Production; Softwarized network; wireless networks and cellar networks; machine learning; Internet of Things services; distributed management; DATA-COLLECTION; RESOURCE-MANAGEMENT; IOT; NETWORK; THINGS;
D O I
10.1109/TNSM.2021.3059159
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, wilderness monitoring provides massive data output for supporting agricultural production, environmental protection, and disaster monitoring. However, smart upgrading alone for these wireless nodes cannot meet the softwarized network needs today, relating to the explosion of multi-dimensional data and multi-species equipment. In this article, we conduct a comprehensive solution for the UAV based data collection strategy in an "air-to-ground" intelligent softwarized collection system. The innovation in this article is that after using the IoT nodes to complete the data collection process through the proposed bandwidth-weighted traffic pushing optimization (BWPTO) algorithm, the system infers the future changes according to the current network state using a deep Q-learning (DQL) network. Then, by developing the proposed AIIPO (Air-to-Ground Intelligent Information Pushing Optimization) algorithm, the entire network can "forward-looking" the uploaded information to potentially idle nodes in the future, thus achieve the optimized system performance. Through the final mathematical experiments, we prove the optimality of our proposed routing algorithm and forwarding strategy, which are more applicable in the dynamic "air-to-ground" distributed data collection system than other benchmark solutions.
引用
收藏
页码:526 / 537
页数:12
相关论文
共 50 条
  • [21] Q-learning-based algorithms for dynamic transmission control in IoT equipment
    Hanieh Malekijou
    Vesal Hakami
    Nastooh Taheri Javan
    Amirhossein Malekijoo
    The Journal of Supercomputing, 2023, 79 : 75 - 108
  • [22] A Q-learning-based distributed queuing Mac protocol for Internet-of-Things networks
    Wu, Chien-Min
    Chang, Yu-Hsiu
    Tsai, Cheng-Tai
    Hou, Cheng-Chun
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2023, 2023 (01)
  • [23] Deep Q-Learning-Based Dynamic Network Slicing and Task Offloading in Edge Network
    Chiang, Yao
    Hsu, Chih-Ho
    Chen, Guan-Hao
    Wei, Hung-Yu
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (01): : 369 - 384
  • [24] Optimizing Q-Learning-Based Access Control Scheme Based on Q-Table Compression Method
    Ojetunde, Babatunde
    Yano, Kazuto
    2022 IEEE 33RD ANNUAL INTERNATIONAL SYMPOSIUM ON PERSONAL, INDOOR AND MOBILE RADIO COMMUNICATIONS (IEEE PIMRC), 2022,
  • [25] An Improved Q-Learning-Based Scheduling Strategy with Load Balancing for Infrastructure-Based Cloud Services
    Ziyath, S. Peer Mohamed
    Subramaniyan, Senthilkumar
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2022, 47 (08) : 9547 - 9555
  • [26] An Improved Q-Learning-Based Scheduling Strategy with Load Balancing for Infrastructure-Based Cloud Services
    S. Peer Mohamed Ziyath
    Senthilkumar Subramaniyan
    Arabian Journal for Science and Engineering, 2022, 47 : 9547 - 9555
  • [27] Q-SMASH: Q-Learning-based Self-Adaptation of Human-Centered Internet of Things
    Rahimi, Hamed
    Trentin, Iago Felipe
    Ramparany, Fano
    Boissier, Olivier
    2021 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE AND INTELLIGENT AGENT TECHNOLOGY (WI-IAT 2021), 2021, : 694 - 698
  • [28] A deep q-learning-based optimization of the inventory control in a linear process chain
    M.-A. Dittrich
    S. Fohlmeister
    Production Engineering, 2021, 15 : 35 - 43
  • [29] Hierarchical Distributed Q-learning-based resource allocation and UBS control in SATIN
    Jeon, Kakyeom
    Lee, Howon
    2024 IEEE 21ST CONSUMER COMMUNICATIONS & NETWORKING CONFERENCE, CCNC, 2024, : 1094 - 1095
  • [30] Scheduling Multiobjective Dynamic Surgery Problems via Q-Learning-Based Meta-Heuristics
    Yu, Hui
    Gao, Kaizhou
    Wu, Naiqi
    Zhou, MengChu
    Suganthan, Ponnuthurai N.
    Wang, Shouguang
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (06): : 3321 - 3333