A Transformer-Based Multimodal Model for Urban-Rural Fringe Identification

被引:1
|
作者
Jia, Furong [1 ]
Dong, Quanhua [1 ]
Huang, Zhou [1 ]
Chen, Xiao-Jian [1 ]
Wang, Yi [1 ]
Peng, Xia [3 ]
Guo, Yuan [2 ]
Ma, Ruixian [4 ]
Zhang, Fan [1 ]
Liu, Yu [1 ,5 ]
机构
[1] Peking Univ, Sch Earth & Space Sci, Inst Remote Sensing & Geog Informat Syst, Beijing 100871, Peoples R China
[2] Wuhan Univ Technol, Sch Resources & Environm Engn, Wuhan 430070, Peoples R China
[3] Beijing Union Univ, Tourism Coll, Beijing 100101, Peoples R China
[4] MIT, Senseable City Lab, Cambridge, MA 02139 USA
[5] Int Res Ctr Big Data Sustainable Dev Goals, Beijing 100094, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Transformers; Visualization; Socioeconomics; Buildings; Labeling; Data models; Deep learning; social sensing; street view images (SVIs); urban rural fringe (URF); urbanization; LAND-USE; URBANIZATION; AREAS;
D O I
10.1109/JSTARS.2024.3439429
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
As the frontier of urbanization, urban-rural fringes (URFs) transitionally connect urban construction regions to the rural hinterland, and its identification is significant for the study of urbanization-related socioeconomic changes and human dynamics. Previous research on URF identification has predominantly relied on remote sensing data, which often provides a uniform overhead perspective with limited spatial resolution. As an additional data source, street view images (SVIs) offer a valuable human-related perspective, efficiently capturing intricate transitions from urban to rural areas. However, the abundant visual information offered by SVIs has often been overlooked and multimodal techniques have seldom been explored to integrate multisource data for delineating URFs. To address this gap, this study proposes a transformed-based multimodal methodology for identifying URFs, which includes a street view panorama classifier and a remote sensing classification model. In the study area of Beijing, the experimental results indicate that an URF with a total area of 731.24 km(2) surrounds urban cores, primarily located between the fourth and sixth ring roads. The effectiveness of the proposed method is demonstrated through comparative experiments with traditional URF identification methods. In addition, a series of ablation studies demonstrate the efficacy of incorporating multisource data. Based on the delineated URFs in Beijing, this research introduced points of interest data and commuting data to analyze the socioeconomic characteristics of URFs. The findings indicate that URFs are characterized by longer commuting distances and less diverse restaurant consumption patterns compared to more urbanized regions. This study enables the accurate identification of URFs through the transform-based multimodal approach integrating SVIs. Furthermore, it provides a human-centric comprehension of URFs, which is essential for informing strategies of urban planning and development.
引用
收藏
页码:15041 / 15051
页数:11
相关论文
共 50 条
  • [31] Transformer-based Arabic Dialect Identification
    Lin, Wanqiu
    Madhavi, Maulik
    Das, Rohan Kumar
    Li, Haizhou
    2020 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2020), 2020, : 192 - 196
  • [32] Using home buyers' revealed preferences to define the urban-rural fringe
    LeSage, James P.
    Charles, Joni S.
    JOURNAL OF GEOGRAPHICAL SYSTEMS, 2008, 10 (01) : 1 - 21
  • [33] Analysis of the Sustainable Development Pathway of Urban-Rural Integration from the Perspective of Spatial Planning: A Case Study of the Urban-Rural Fringe of Beijing
    Zhang, Anni
    SUSTAINABILITY, 2025, 17 (05)
  • [34] The significance of quality of life and sustainability at the urban-rural fringe in the making of place-based community
    Mahon, Marie
    Fahy, Frances
    Cinneide, Micheal O.
    GEOJOURNAL, 2012, 77 (02) : 265 - 278
  • [35] MM-Transformer: A Transformer-Based Knowledge Graph Link Prediction Model That Fuses Multimodal Features
    Wang, Dongsheng
    Tang, Kangjie
    Zeng, Jun
    Pan, Yue
    Dai, Yun
    Li, Huige
    Han, Bin
    SYMMETRY-BASEL, 2024, 16 (08):
  • [36] Connecting urban area with rural hinterland: A stepwise ecological security network construction approach in the urban-rural fringe
    Liang, Chen
    Zeng, Jian
    Zhang, Ruo-Chen
    Wang, Qian-Wen
    ECOLOGICAL INDICATORS, 2022, 138
  • [37] Urban versus Rural? Conflict Lines in Land Use Disputes in the Urban-Rural Fringe Region of Schwerin, Germany
    Fienitz, Meike
    Siebert, Rosemarie
    LAND, 2021, 10 (07)
  • [38] A new approach for urban-rural fringe identification: Integrating impervious surface area and spatial continuous wavelet transform
    Peng, Jian
    Hu, Yi'na
    Liu, Yanxu
    Ma, Jing
    Zhao, Shiquan
    LANDSCAPE AND URBAN PLANNING, 2018, 175 : 72 - 79
  • [39] Urban-rural fringe identification and spatial form transformation during rapid urbanization: A case study in Wuhan, China
    Ding, Wei
    Chen, Hong
    BUILDING AND ENVIRONMENT, 2022, 226
  • [40] Hybrid convolutional transformer-based network model for finger vein identification
    Boudjellal, Sif Eddine
    Boukezzoula, Naceur-Eddine
    Boudjelal, Abdelwahhab
    JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (05)