A Computer Vision Approach for Detecting Discrepancies in Map Textual Labels

被引:0
|
作者
Salama, Abdulrahman [1 ]
Elkamhawy, Mahmoud [1 ]
Hendawi, Abdeltawab [2 ]
Sabour, Adel [1 ]
Al-Masri, Eyhab [1 ]
Tan, Ming [3 ]
Agrawal, Vashutosh [3 ]
Prakash, Ravi [3 ]
Ali, Mohamed [1 ]
机构
[1] Univ Washington, Tacoma, WA 98402 USA
[2] Univ Rhode Isl, Kingston, RI USA
[3] Microsoft Corp, Redmond, WA 98052 USA
关键词
detectron2; azure cognitive services; maps discrepancies; computer-vision; geospatial data; textual labels; faster-rcnn; neural networks;
D O I
10.1145/3603719.3603722
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Maps provide various sources of information. An important example of such information is textual labels such as cities, neighborhoods, and street names. Althoughwe treat this information as facts, and despite the massive effort done by providers to continuously improve their accuracy, this data is far from perfect. Discrepancies in textual labels rendered on the map are one of the major sources of inconsistencies across map providers. These discrepancies can have significant impacts on the reliability of the derived information and decision-making processes. Thus, it is important to validate the accuracy and consistency in such data. Most providers treat this data as their propriety data and it is not available to the public, thus we cannot compare the data directly. To address these challenges, we introduce a novel computer vision-based approach for automatically extracting and classifying labels based on the visual characteristics of the label, which indicates its category based on the format convention used by the specific map provider. Based on the extracted data, we detect the degree of discrepancies across map providers. We consider three map providers: Bing Maps, Google Maps, and OpenStreetMaps. The neural network we develop classifies the text labels with an accuracy up to 93% in all providers. We leverage our system to analyze randomly selected regions in different markets. The studied markets are USA, Germany, France, and Brazil. Experimental results and statistical analysis reveal the amount of discrepancies across map providers per region. We calculate the Jaccard distance between the extracted text sets for each pair of map providers, which represents the discrepancy percentage. Discrepancies percentages as high as 90% were found in some markets.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] A computer vision approach for detecting discrepancies in map textual labels
    Salama, Abdulrahman
    Elkamhawy, Mahmoud
    Hendawi, Abdeltawab
    Sabour, Adel
    Al-Masri, Eyhab
    Sultana, Tasnia
    Tan, Ming
    Agrawal, Vashutosh
    Prakash, Ravi
    Ali, Mohamed
    DISTRIBUTED AND PARALLEL DATABASES, 2025, 43 (01)
  • [2] MapsVision: A Computer Vision-based System for Detecting Discrepancies in Map Textual Labels
    Sabour, Adel
    Yao, Jiawei
    Salama, Abdulrahman
    Hampshire, Cordel
    Al-Masri, Eyhab
    Ali, Mohamed
    Govind, Harsh
    Tan, Ming
    Agrawal, Vashutosh
    Maresov, Egor
    Prakash, Ravi
    2022 23RD IEEE INTERNATIONAL CONFERENCE ON MOBILE DATA MANAGEMENT (MDM 2022), 2022, : 298 - 301
  • [3] Learning With Fewer Labels in Computer Vision
    Liu, Li
    Hospedales, Timothy
    Lecun, Yann
    Long, Mingsheng
    Luo, Jiebo
    Ouyang, Wanli
    Pietikainen, Matti
    Tuytelaars, Tinne
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (03) : 1319 - 1326
  • [4] ATLAS: Automatically Detecting Discrepancies Between Privacy Policies and Privacy Labels
    Jain, Akshath
    Rodriguez, David
    del Alamo, Jose M.
    Sadeh, Norman
    2023 IEEE EUROPEAN SYMPOSIUM ON SECURITY AND PRIVACY WORKSHOPS, EUROS&PW, 2023, : 94 - 107
  • [5] A Geospatial Method for Detecting Map-Based Road Segment Discrepancies
    Yao, Jiawei
    Al-Masri, Eyhab
    Ali, Mohamed
    Agrawal, Vashutosh
    Tan, Ming
    Govind, Harsh
    Sabour, Adel
    Salama, Abdulrahman
    Jiang, Daniel
    Keller, Reuben
    Jazvin, Dino
    Prakash, Ravi
    Maresov, Egor
    2022 23RD IEEE INTERNATIONAL CONFERENCE ON MOBILE DATA MANAGEMENT (MDM 2022), 2022, : 230 - 237
  • [6] Computer vision approaches for detecting missing barricades
    Chian, Eugene
    Fang, Weili
    Goh, Yang Miang
    Tian, Jing
    AUTOMATION IN CONSTRUCTION, 2021, 131
  • [7] Detecting Carcinoma Cells using Computer Vision
    Dhilipan, J.
    Agusthiyar, R.
    Aravindh, M.
    BIOSCIENCE BIOTECHNOLOGY RESEARCH COMMUNICATIONS, 2020, 13 (04): : 123 - 127
  • [8] APPLICATION OF COMPUTER VISION FOR DETECTING WATERCORE IN APPLES
    THROOP, JA
    REHKUGLER, GE
    UPCHURCH, BL
    TRANSACTIONS OF THE ASAE, 1989, 32 (06): : 2087 - 2092
  • [9] Implementation of Computer Vision in Detecting Human Poses
    Gregory, Ian
    Tedjojuwono, Samuel Mahatmaputra
    PROCEEDINGS OF 2020 INTERNATIONAL CONFERENCE ON INFORMATION MANAGEMENT AND TECHNOLOGY (ICIMTECH), 2020, : 271 - 276
  • [10] Setwise Comparison: Consistent, Scalable, Continuum Labels for Computer Vision
    Sarkar, Advait
    Morrison, Cecily
    Dorn, Jonas F.
    Bedi, Rishi
    Steinheimer, Saskia
    Boisvert, Jacques
    Burggraaff, Jessica
    D'Souza, Marcus
    Kontschieder, Peter
    Bulo, Samuel Rota
    Walsh, Lorcan
    Kamm, Christian P.
    Zaykov, Yordan
    Sellen, Abigail
    Lindley, Sian
    34TH ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, CHI 2016, 2016, : 261 - 271