A Transformer-Based Multimodal Model for Urban-Rural Fringe Identification

被引:1
|
作者
Jia, Furong [1 ]
Dong, Quanhua [1 ]
Huang, Zhou [1 ]
Chen, Xiao-Jian [1 ]
Wang, Yi [1 ]
Peng, Xia [3 ]
Guo, Yuan [2 ]
Ma, Ruixian [4 ]
Zhang, Fan [1 ]
Liu, Yu [1 ,5 ]
机构
[1] Peking Univ, Sch Earth & Space Sci, Inst Remote Sensing & Geog Informat Syst, Beijing 100871, Peoples R China
[2] Wuhan Univ Technol, Sch Resources & Environm Engn, Wuhan 430070, Peoples R China
[3] Beijing Union Univ, Tourism Coll, Beijing 100101, Peoples R China
[4] MIT, Senseable City Lab, Cambridge, MA 02139 USA
[5] Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Transformers; Visualization; Socioeconomics; Buildings; Labeling; Data models; Deep learning; social sensing; street view images (SVIs); urban rural fringe (URF); urbanization; LAND-USE; URBANIZATION; AREAS;
D O I
10.1109/JSTARS.2024.3439429
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As the frontier of urbanization, urban-rural fringes (URFs) transitionally connect urban construction regions to the rural hinterland, and its identification is significant for the study of urbanization-related socioeconomic changes and human dynamics. Previous research on URF identification has predominantly relied on remote sensing data, which often provides a uniform overhead perspective with limited spatial resolution. As an additional data source, street view images (SVIs) offer a valuable human-related perspective, efficiently capturing intricate transitions from urban to rural areas. However, the abundant visual information offered by SVIs has often been overlooked and multimodal techniques have seldom been explored to integrate multisource data for delineating URFs. To address this gap, this study proposes a transformed-based multimodal methodology for identifying URFs, which includes a street view panorama classifier and a remote sensing classification model. In the study area of Beijing, the experimental results indicate that an URF with a total area of 731.24 km(2) surrounds urban cores, primarily located between the fourth and sixth ring roads. The effectiveness of the proposed method is demonstrated through comparative experiments with traditional URF identification methods. In addition, a series of ablation studies demonstrate the efficacy of incorporating multisource data. Based on the delineated URFs in Beijing, this research introduced points of interest data and commuting data to analyze the socioeconomic characteristics of URFs. The findings indicate that URFs are characterized by longer commuting distances and less diverse restaurant consumption patterns compared to more urbanized regions. This study enables the accurate identification of URFs through the transform-based multimodal approach integrating SVIs. Furthermore, it provides a human-centric comprehension of URFs, which is essential for informing strategies of urban planning and development.
引用
收藏
页码:15041 / 15051
页数:11
相关论文
共 50 条
  • [41] Automatic identification of suicide notes with a transformer-based deep learning model
    Zhang, Tianlin
    Schoene, Annika M.
    Ananiadou, Sophia
    INTERNET INTERVENTIONS-THE APPLICATION OF INFORMATION TECHNOLOGY IN MENTAL AND BEHAVIOURAL HEALTH, 2021, 25
  • [42] Identifying and tracking the urban-rural fringe evolution in the urban-rural transformation period: Evidence from a rapidly urbanized rust belt city in China
    Wang, Xingjia
    Wang, Dongyan
    Lu, Jiaxi
    Gao, Wanying
    Jin, Xiaotong
    ECOLOGICAL INDICATORS, 2023, 146
  • [43] Valuing the effect of land use change on landscape services on the urban-rural fringe
    Zhou Ting
    Kennedy, Erin
    Koomen, Eric
    van Leeuwen, Eveline S.
    JOURNAL OF PLANNING LITERATURE, 2022, 37 (02) : 367 - 368
  • [44] Valuing the effect of land use change on landscape services on the urban-rural fringe
    Zhou, Ting
    Kennedy, Erin
    Koomen, Eric
    van Leeuwen, Eveline S.
    JOURNAL OF ENVIRONMENTAL PLANNING AND MANAGEMENT, 2020, 63 (13) : 2425 - 2445
  • [45] Understanding the Diversity of Urban-Rural Fringe Development in a Fast Urbanizing Region of China
    Li, Guoyu
    Cao, Yu
    He, Zhichao
    He, Ju
    Wang, Jiayi
    Fang, Xiaoqian
    REMOTE SENSING, 2021, 13 (12)
  • [46] New landscapes of conflict: land-use competition at the urban-rural fringe
    Jensen, David
    Baird, Timothy
    Blank, Gary
    LANDSCAPE RESEARCH, 2019, 44 (04) : 418 - 429
  • [47] URBAN-RURAL DIFFERENCES IN RESPONSIVENESS TO AN ALTRUISTIC MODEL
    HANSSON, RO
    SLADE, KM
    SLADE, PS
    JOURNAL OF SOCIAL PSYCHOLOGY, 1978, 105 (01): : 99 - 105
  • [48] CityTransformer: A Transformer-Based Model for Contaminant Dispersion Prediction in a Realistic Urban Area
    Yuuichi Asahi
    Naoyuki Onodera
    Yuta Hasegawa
    Takashi Shimokawabe
    Hayato Shiba
    Yasuhiro Idomura
    Boundary-Layer Meteorology, 2023, 186 : 659 - 692
  • [49] TUFusion: A Transformer-Based Universal Fusion Algorithm for Multimodal Images
    Zhao, Yangyang
    Zheng, Qingchun
    Zhu, Peihao
    Zhang, Xu
    Ma, Wenpeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1712 - 1725
  • [50] A survey of transformer-based multimodal pre-trained modals
    Han, Xue
    Wang, Yi-Tong
    Feng, Jun-Lan
    Deng, Chao
    Chen, Zhan-Heng
    Huang, Yu-An
    Su, Hui
    Hu, Lun
    Hu, Peng-Wei
    NEUROCOMPUTING, 2023, 515 : 89 - 106