A deep transfer learning framework for mapping high spatiotemporal resolution LAI

被引:11
|
作者
Zhou, Junxiong [1 ]
Yang, Qi [1 ]
Liu, Licheng [1 ]
Kang, Yanghui [2 ]
Jia, Xiaowei [3 ]
Chen, Min [4 ]
Ghosh, Rahul [5 ]
Xu, Shaomin [5 ]
Jiang, Chongya [6 ]
Guan, Kaiyu [6 ]
Kumar, Vipin [5 ]
Jin, Zhenong [1 ]
机构
[1] Univ Minnesota Twin Cities, Dept Bioprod & Biosyst Engn, St Paul, MN 55108 USA
[2] Univ Calif Berkeley, Dept Environm Sci Policy & Management, Berkeley, CA 94720 USA
[3] Univ Pittsburgh, Dept Comp Sci, Pittsburgh, PA 15260 USA
[4] Univ Wisconsin Madison, Coll Agr & Life Sci, Dept Forest & Wildlife Ecol, Madison, WI 53706 USA
[5] Univ Minnesota Twin Cities, Dept Comp Sci & Engn, Minneapolis, MN 55414 USA
[6] Univ Illinois, Agroecosystem Sustainabil Ctr, Urbana, IL 61801 USA
基金
美国国家科学基金会;
关键词
Leaf area index; High spatial resolution; Long short-term memory; Deep transfer learning; LEAF-AREA INDEX; RADIATIVE-TRANSFER MODELS; REFLECTANCE DATA; REGRESSION ALGORITHMS; CHLOROPHYLL CONTENT; VEGETATION INDEXES; LANDSAT; 8; SENTINEL-2; MODIS; INVERSION;
D O I
10.1016/j.isprsjprs.2023.10.017
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Leaf area index (LAI) is an important variable for characterizing vegetation structure. Contemporary satellitebased LAI products with moderate spatial resolution, such as those derived from the MODIS observations, offer unique opportunities for large-scale monitoring but are insufficient for resolving heterogeneous landscapes. Although high-resolution satellite observations can derive detailed LAI maps, the low revisit frequency and the presence of cloud cover disrupt the temporal continuity of these high-resolution data, thereby leading to the fact that most current LAI inversion models for high spatial resolution data are based on single pixel and date without fully utilizing temporal information. Moreover, LAI estimation models trained solely using satellite products or simulations are also impeded by the inconsistencies between field and satellite LAI exist owing to local atmospheric, soil, and canopy conditions, while in-situ LAI measurements are sparse and insufficient for large-scale missions. To address these challenges, this study proposed a new framework based on deep transfer learning, which includes three key features that contribute to its high performance. Firstly, a Bi-directional Long ShortTerm Memory (Bi-LSTM) model is pre-trained using MODIS reflectance and MODIS LAI products to capture the general non-linear relationship between reflectance and LAI and incorporate temporal dependencies as prior information to reduce uncertainties associated with ill-posed inversion problems and noises. Secondly, this pretrained Bi-LSTM is transferred from satellite to field by fine-tuning with sparse in-situ LAI measurements to overcome issues arising from local inconsistencies. Thirdly, reconstructed Landsat time-series images via fusing MODIS and Landsat reflectance images are used as inputs of the Bi-LSTM to generate high-quality Landsat LAI products at both high spatial and temporal resolutions. To validate the proposed approach, field LAI measurements were collected at nine locations across the contiguous U.S. from 2000 to 2018, including three land cover types: croplands, grasslands, and forest. Quantitative assessments demonstrate that the Bi-LSTM outperforms three benchmarks, including a PROSAIL-based Look-Up Table (LUT) method, a random forest-based LAI retrieval and MODIS LAI (MCD15A3H), exhibiting lower RMSE and higher R2 in most cases. Additionally, the Bi-LSTM predictions yield lower random fluctuations than estimations from the LUT & sdot;, random forest and MODIS LAI, indicating the higher robustness of the proposed framework. The findings of this study highlight the value of transfer learning in estimation of vegetation biophysical parameters, which involves pre-training using sufficient existing satellite products to produce a generalized model and transferring knowledge from in-situ measurements to bridge gaps between satellite and field. By leveraging advanced transfer learning techniques and multi-source and multi-scale data, the proposed framework enables the production of long-term LAI maps at fine resolutions, facilitating downstream applications in regions characterized by high spatial heterogeneity.
引用
收藏
页码:30 / 48
页数:19
相关论文
共 50 条
  • [41] High-resolution spatiotemporal assessment of solar potential from remote sensing data using deep learning
    Zalik, Mitja
    Mongus, Domen
    Lukac, Niko
    RENEWABLE ENERGY, 2024, 222
  • [42] Deep Learning-Based Defect Detection Framework for Ultra High Resolution Images of Tunnels
    Lee, Kisu
    Lee, Sanghyo
    Kim, Ha Young
    SUSTAINABILITY, 2023, 15 (02)
  • [43] DCCF: Deep Comprehensible Color Filter Learning Framework for High-Resolution Image Harmonization
    Xue, Ben
    Ran, Shenghui
    Chen, Quan
    Jia, Rongfei
    Zhao, Binqiang
    Tang, Xing
    COMPUTER VISION, ECCV 2022, PT VII, 2022, 13667 : 300 - 316
  • [44] Towards deep learning for connectome mapping: A block decomposition framework
    Sarwar, Tabinda
    Seguin, Caio
    Ramamohanarao, Kotagiri
    Zalesky, Andrew
    NEUROIMAGE, 2020, 212
  • [45] A Transfer Learning Framework for Deep Multi-Agent Reinforcement Learning
    Yi Liu
    Xiang Wu
    Yuming Bo
    Jiacun Wang
    Lifeng Ma
    IEEE/CAA Journal of Automatica Sinica, 2024, 11 (11) : 2346 - 2348
  • [46] A Transfer Learning Framework for Deep Multi-Agent Reinforcement Learning
    Liu, Yi
    Wu, Xiang
    Bo, Yuming
    Wang, Jiacun
    Ma, Lifeng
    IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2024, 11 (11) : 2346 - 2348
  • [47] DBlink: dynamic localization microscopy in super spatiotemporal resolution via deep learning
    Alon Saguy
    Onit Alalouf
    Nadav Opatovski
    Soohyen Jang
    Mike Heilemann
    Yoav Shechtman
    Nature Methods, 2023, 20 : 1939 - 1948
  • [48] Deep Learning of Spatiotemporal Filtering for Fast Super-Resolution Ultrasound Imaging
    Brown, Katherine G.
    Ghosh, Debabrata
    Hoyt, Kenneth
    IEEE TRANSACTIONS ON ULTRASONICS FERROELECTRICS AND FREQUENCY CONTROL, 2020, 67 (09) : 1820 - 1829
  • [49] DBlink: dynamic localization microscopy in super spatiotemporal resolution via deep learning
    Saguy, Alon
    Alalouf, Onit
    Opatovski, Nadav
    Jang, Soohyen
    Heilemann, Mike
    Shechtman, Yoav
    NATURE METHODS, 2023, 20 (12) : 1939 - 1948
  • [50] A deep learning framework for lightning forecasting with multi-source spatiotemporal data
    Geng, Yangli-Ao
    Li, Qingyong
    Lin, Tianyang
    Yao, Wen
    Xu, Liangtao
    Zheng, Dong
    Zhou, Xinyuan
    Zheng, Liming
    Lyu, Weitao
    Zhang, Yijun
    QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2021, 147 (741) : 4048 - 4062