Continual Reinforcement Learning for Intelligent Agricultural Management under Climate Changes

被引:1
|
作者
Wang, Zhaoan [1 ]
Jha, Kishlay [2 ]
Xiao, Shaoping [1 ]
机构
[1] Univ Iowa, Iowa Technol Inst, Dept Mech Engn, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Elect & Comp Engn, Iowa City, IA 52242 USA
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 81卷 / 01期
基金
美国国家科学基金会;
关键词
Continual learning; reinforcement learning; agricultural management; climate variability; NEURAL-NETWORKS;
D O I
10.32604/cmc.2024.055809
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Climate change poses significant challenges to agricultural management, particularly in adapting to extreme weather conditions that impact agricultural production. Existing works with traditional Reinforcement Learning (RL) methods often falter under such extreme conditions. To address this challenge, our study introduces a novel approach by integrating Continual Learning (CL) with RL to form Continual Reinforcement Learning (CRL), enhancing the adaptability of agricultural management strategies. Leveraging the Gym-DSSAT simulation environment, our research enables RL agents to learn optimal fertilization strategies based on variable weather conditions. By incorporating CL algorithms, such as Elastic Weight Consolidation (EWC), with established RL techniques like Deep Q-Networks (DQN), we developed a framework in which agents can learn and retain knowledge across diverse weather scenarios. The CRL approach was tested under climate variability to assess the robustness and adaptability of the induced policies, particularly under extreme weather events like severe droughts. Our results showed that continually learned policies exhibited superior adaptability and performance compared to optimal policies learned through the conventional RL methods, especially in challenging conditions of reduced rainfall and increased temperatures. This pioneering work, which combines CL with RL to generate adaptive policies for agricultural management, is expected to make significant advancements in precision agriculture in the era of climate change.
引用
收藏
页码:1319 / 1336
页数:18
相关论文
共 50 条
  • [1] Continual World: A Robotic Benchmark For Continual Reinforcement Learning
    Wolczyk, Maciej
    Zajac, Michal
    Pascanu, Razvan
    Kucinski, Lukasz
    Milos, Piotr
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [2] Continual Reinforcement Learning with Complex Synapses
    Kaplanis, Christos
    Shanahan, Murray
    Clopath, Claudia
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [3] Disentangling Transfer in Continual Reinforcement Learning
    Wolczyk, Maciej
    Zajac, Michal
    Pascanu, Razvan
    Kucinski, Lukasz
    Milos, Piotr
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,
  • [4] Adaptive Exploration for Continual Reinforcement Learning
    Stulp, Freek
    2012 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2012, : 1631 - 1636
  • [5] Prediction and Control in Continual Reinforcement Learning
    Anand, Nishanth
    Precup, Doina
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [6] Policy Consolidation for Continual Reinforcement Learning
    Kaplanis, Christos
    Shanahan, Murray
    Clopath, Claudia
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [7] Continual Lifelong Learning for Intelligent Agents
    Sokar, Ghada
    PROCEEDINGS OF THE THIRTIETH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2021, 2021, : 4919 - 4920
  • [8] Deep Reinforcement Learning for Intelligent Cloud Resource Management
    Zhou, Zhi
    Luo, Ke
    Chen, Xu
    IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (IEEE INFOCOM WKSHPS 2021), 2021,
  • [9] Intelligent Cloud Resource Management with Deep Reinforcement Learning
    Zhang, Yu
    Yao, Jianguo
    Guan, Haibing
    IEEE CLOUD COMPUTING, 2017, 4 (06): : 60 - 69
  • [10] Intelligent Design of Agricultural Product Packaging Layout Based on Reinforcement Learning
    Wang, Jianing
    Zhang, Yuan
    Zhu, Lei
    INNOVATIVE TECHNOLOGIES FOR PRINTING AND PACKAGING, 2023, 991 : 440 - 445