Continual Reinforcement Learning for Intelligent Agricultural Management under Climate Changes

被引:1
|
作者
Wang, Zhaoan [1 ]
Jha, Kishlay [2 ]
Xiao, Shaoping [1 ]
机构
[1] Univ Iowa, Iowa Technol Inst, Dept Mech Engn, Iowa City, IA 52242 USA
[2] Univ Iowa, Dept Elect & Comp Engn, Iowa City, IA 52242 USA
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2024年 / 81卷 / 01期
基金
美国国家科学基金会;
关键词
Continual learning; reinforcement learning; agricultural management; climate variability; NEURAL-NETWORKS;
D O I
10.32604/cmc.2024.055809
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Climate change poses significant challenges to agricultural management, particularly in adapting to extreme weather conditions that impact agricultural production. Existing works with traditional Reinforcement Learning (RL) methods often falter under such extreme conditions. To address this challenge, our study introduces a novel approach by integrating Continual Learning (CL) with RL to form Continual Reinforcement Learning (CRL), enhancing the adaptability of agricultural management strategies. Leveraging the Gym-DSSAT simulation environment, our research enables RL agents to learn optimal fertilization strategies based on variable weather conditions. By incorporating CL algorithms, such as Elastic Weight Consolidation (EWC), with established RL techniques like Deep Q-Networks (DQN), we developed a framework in which agents can learn and retain knowledge across diverse weather scenarios. The CRL approach was tested under climate variability to assess the robustness and adaptability of the induced policies, particularly under extreme weather events like severe droughts. Our results showed that continually learned policies exhibited superior adaptability and performance compared to optimal policies learned through the conventional RL methods, especially in challenging conditions of reduced rainfall and increased temperatures. This pioneering work, which combines CL with RL to generate adaptive policies for agricultural management, is expected to make significant advancements in precision agriculture in the era of climate change.
引用
收藏
页码:1319 / 1336
页数:18
相关论文
共 50 条
  • [21] Intelligent Energy Management System for Microgrids using Reinforcement Learning
    Kumar, Polamarasetty P.
    Nuvvula, Ramakrishna S. S.
    Shezan, Sk. A.
    Ahammed, Syed Riyaz
    Babu, J. M.
    Satyanarayana, Vanam
    Ali, Ahmed
    12TH INTERNATIONAL CONFERENCE ON SMART GRID, ICSMARTGRID 2024, 2024, : 322 - 328
  • [22] Connectionist Reinforcement Learning for Intelligent Unit Micro Management in StarCraft
    Shantia, Amirhosein
    Begue, Eric
    Wiering, Marco
    2011 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2011, : 1794 - 1801
  • [23] Integrating water and agricultural management under climate change
    Macleod, C. J. A.
    Haygarth, P. M.
    SCIENCE OF THE TOTAL ENVIRONMENT, 2010, 408 (23) : 5619 - 5622
  • [24] Agricultural risk management policies under climate uncertainty
    Anton, Jesus
    Cattaneo, Andrea
    Kimura, Shingo
    Lankoski, Jussi
    GLOBAL ENVIRONMENTAL CHANGE-HUMAN AND POLICY DIMENSIONS, 2013, 23 (06): : 1726 - 1736
  • [25] Agricultural land use modeling and climate change adaptation: A reinforcement learning approach
    Stetter, Christian
    Huber, Robert
    Finger, Robert
    APPLIED ECONOMIC PERSPECTIVES AND POLICY, 2024, 46 (04) : 1379 - 1405
  • [26] Multi-world Model in Continual Reinforcement Learning
    Shen, Kevin
    THIRTY-EIGTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 21, 2024, : 23757 - 23759
  • [27] Optimal tuning of continual online exploration in reinforcement learning
    Achbany, Youssef
    Fouss, Francois
    Yen, Luh
    Pirotte, Alain
    Saerens, Marco
    ARTIFICIAL NEURAL NETWORKS - ICANN 2006, PT 1, 2006, 4131 : 790 - 800
  • [28] Continual Model-Based Reinforcement Learning with Hypernetworks
    Huang, Yizhou
    Xie, Kevin
    Bharadhwaj, Homanga
    Shkurti, Florian
    2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2021), 2021, : 799 - 805
  • [29] Deep reinforcement learning for intelligent risk optimization of buildings under hazard
    Anwar, Ghazanfar Ali
    Zhang, Xiaoge
    RELIABILITY ENGINEERING & SYSTEM SAFETY, 2024, 247
  • [30] Intelligent Scheduling with Reinforcement Learning
    Cunha, Bruno
    Madureira, Ana
    Fonseca, Benjamim
    Matos, Joao
    APPLIED SCIENCES-BASEL, 2021, 11 (08):