A Transformer-Based Multimodal Model for Urban-Rural Fringe Identification

被引:1
|
作者
Jia, Furong [1 ]
Dong, Quanhua [1 ]
Huang, Zhou [1 ]
Chen, Xiao-Jian [1 ]
Wang, Yi [1 ]
Peng, Xia [3 ]
Guo, Yuan [2 ]
Ma, Ruixian [4 ]
Zhang, Fan [1 ]
Liu, Yu [1 ,5 ]
机构
[1] Peking Univ, Sch Earth & Space Sci, Inst Remote Sensing & Geog Informat Syst, Beijing 100871, Peoples R China
[2] Wuhan Univ Technol, Sch Resources & Environm Engn, Wuhan 430070, Peoples R China
[3] Beijing Union Univ, Tourism Coll, Beijing 100101, Peoples R China
[4] MIT, Senseable City Lab, Cambridge, MA 02139 USA
[5] Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Transformers; Visualization; Socioeconomics; Buildings; Labeling; Data models; Deep learning; social sensing; street view images (SVIs); urban rural fringe (URF); urbanization; LAND-USE; URBANIZATION; AREAS;
D O I
10.1109/JSTARS.2024.3439429
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As the frontier of urbanization, urban-rural fringes (URFs) transitionally connect urban construction regions to the rural hinterland, and its identification is significant for the study of urbanization-related socioeconomic changes and human dynamics. Previous research on URF identification has predominantly relied on remote sensing data, which often provides a uniform overhead perspective with limited spatial resolution. As an additional data source, street view images (SVIs) offer a valuable human-related perspective, efficiently capturing intricate transitions from urban to rural areas. However, the abundant visual information offered by SVIs has often been overlooked and multimodal techniques have seldom been explored to integrate multisource data for delineating URFs. To address this gap, this study proposes a transformed-based multimodal methodology for identifying URFs, which includes a street view panorama classifier and a remote sensing classification model. In the study area of Beijing, the experimental results indicate that an URF with a total area of 731.24 km(2) surrounds urban cores, primarily located between the fourth and sixth ring roads. The effectiveness of the proposed method is demonstrated through comparative experiments with traditional URF identification methods. In addition, a series of ablation studies demonstrate the efficacy of incorporating multisource data. Based on the delineated URFs in Beijing, this research introduced points of interest data and commuting data to analyze the socioeconomic characteristics of URFs. The findings indicate that URFs are characterized by longer commuting distances and less diverse restaurant consumption patterns compared to more urbanized regions. This study enables the accurate identification of URFs through the transform-based multimodal approach integrating SVIs. Furthermore, it provides a human-centric comprehension of URFs, which is essential for informing strategies of urban planning and development.
引用
收藏
页码:15041 / 15051
页数:11
相关论文
共 50 条
  • [1] An urban-rural Fringe extraction method based on Combined Urban-rural Fringe Index (CUFI)
    Duan, Hongrui
    Du, Fuguang
    Zhang, Yajing
    Jiang, Xiaojun
    Chen, Bo
    GEOCARTO INTERNATIONAL, 2024, 39 (01)
  • [2] URBAN DEMAND FOR URBAN-RURAL FRINGE LAND
    HUSHAK, LJ
    LAND ECONOMICS, 1975, 51 (02) : 112 - 123
  • [3] Resident perceptions in the urban-rural fringe
    Weaver, DB
    Lawton, LJ
    ANNALS OF TOURISM RESEARCH, 2001, 28 (02) : 439 - 458
  • [4] URBAN DEMAND FOR URBAN-RURAL FRINGE LAND - REPLY
    HUSHAK, LJ
    LAND ECONOMICS, 1977, 53 (01) : 131 - 132
  • [5] Characterising the urban-rural fringe area (URFA) in China: a review of global and local literature on urban-rural fringe areas
    Wang, Ke
    Mell, Ian
    Carter, Jeremy
    TOWN PLANNING REVIEW, 2024, 95 (06): : 617 - 642
  • [6] URBAN DEMAND FOR URBAN-RURAL FRINGE LAND - COMMENT
    VROOMAN, DH
    LAND ECONOMICS, 1977, 53 (01) : 130 - 130
  • [7] EXTENSION OF SEWER SERVICE AT URBAN-RURAL FRINGE
    DOWNING, PB
    LAND ECONOMICS, 1969, 45 (01) : 103 - 111
  • [8] Determinants of Farmland Abandonment on the Urban-Rural Fringe
    Zhou, Ting
    Koomen, Eric
    Ke, Xinli
    ENVIRONMENTAL MANAGEMENT, 2020, 65 (03) : 369 - 384
  • [9] TMBL: Transformer-based multimodal binding learning model for multimodal sentiment analysis
    Huang, Jiehui
    Zhou, Jun
    Tang, Zhenchao
    Lin, Jiaying
    Chen, Calvin Yu-Chian
    KNOWLEDGE-BASED SYSTEMS, 2024, 285
  • [10] Determinants of farmland abandonment in the urban-rural fringe of Ghana
    Bavorova, Miroslava
    Ullah, Ayat
    Nyendu, Dominic
    Prishchepov, Alexander V.
    REGIONAL ENVIRONMENTAL CHANGE, 2023, 23 (04)