A vision transformer for lightning intensity estimation using 3D weather radar

被引:5
|
作者
Lu, Mingyue [1 ,5 ]
Wang, Menglong [1 ,5 ]
Zhang, Qian [2 ]
Yu, Manzhu [3 ]
He, Caifen [4 ]
Zhang, Yadong [1 ,5 ]
Li, Yuchen [1 ,5 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Forecast & Evaluat Meteorol, Nanjing 210044, Peoples R China
[2] Xian Univ Finance & Econ, Sch Management Engn, Xian 710100, Peoples R China
[3] Penn State Univ, Dept Geog, University Pk, PA 16802 USA
[4] Ningbo Zhenhai Dist Meteorol Bur, Ningbo 315012, Peoples R China
[5] Nanjing Univ Informat Sci & Technol, Geog Sci Coll, Nanjing 210044, Peoples R China
关键词
Lightning intensity estimation; 3D weather radar; Vision transformer; SMOTE; Multicategoryclassification; TROPICAL CYCLONE INTENSITY;
D O I
10.1016/j.scitotenv.2022.158496
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Lightning has strong destructive powers; its blast wave, high temperature, and high voltage can pose a great threat to human production, life, and personal safety. The destructive power of high-intensity lightning is much greater than that of low-intensity lightning. The estimation of lightning intensity can provide an important reference for determin-ing the lightning protection level and lightning disaster risk assessment. Lightning is a type of small-scale severe con-vective weather phenomenon. Weather radar is one of the best monitoring systems that can frequently sample the detailed three-dimensional (3D) structures of convective storms, with a small spatial scale and short lifetime at high temporal and spatial resolutions. Therefore, it is possible to extract the 3D spatial feature strongly correlated with light-ning from 3D weather radar for estimating lightning intensity. This paper proposes a Vision Transformer model for lightning intensity estimation that can automatically estimate lightning intensity from 3D weather radar data. In an experiment, we transferred the task of estimating lightning intensity into a multicategory classification task. A frame-work was designed to produce lightning feature samples for model input from 3D weather radar and lightning location data. Then, the Synthetic Minority Over-Sampling Technique (SMOTE) algorithm was used to balance and optimize the sample distribution. Finally, samples were input into the proposed lightning intensity estimation model based on Vision Transformer for training and evaluation. Experimental results show that the proposed model based on Vision Transformers performs well with lightning intensity estimation.
引用
收藏
页数:10
相关论文
共 50 条
  • [21] A Lip Reading Method Based on 3D Convolutional Vision Transformer
    Wang, Huijuan
    Pu, Gangqiang
    Chen, Tingyu
    IEEE ACCESS, 2022, 10 : 77205 - 77212
  • [22] TransFusion: Multi-Modal Robust Fusion for 3D Object Detection in Foggy Weather Based on Spatial Vision Transformer
    Zhang, Cheng
    Wang, Hai
    Cai, Yingfeng
    Chen, Long
    Li, Yicheng
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (09) : 10652 - 10666
  • [23] Bridged Transformer for Vision and Point Cloud 3D Object Detection
    Wang, Yikai
    Ye, TengQi
    Cao, Lele
    Huang, Wenbing
    Sun, Fuchun
    He, Fengxiang
    Tao, Dacheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 12104 - 12113
  • [24] Toward 3D Reconstruction of Outdoor Scenes Using an MMW Radar and a Monocular Vision Sensor
    El Natour, Ghina
    Ait-Aider, Omar
    Rouveure, Raphael
    Berry, Francois
    Faure, Patrice
    SENSORS, 2015, 15 (10) : 25937 - 25967
  • [25] Enhancement of Vision-Based 3D Reconstruction Systems Using Radar for Smart Farming
    Meyer, Lukas
    Gedschold, Jonas
    Wegner, Tim Erich
    Del Galdo, Giovanni
    Kalisz, Adam
    2022 IEEE INTERNATIONAL WORKSHOP ON METROLOGY FOR AGRICULTURE AND FORESTRY (METROAGRIFOR), 2022, : 155 - 159
  • [26] 3D CVT-GAN: A 3D Convolutional Vision Transformer-GAN for PET Reconstruction
    Zeng, Pinxian
    Zhou, Luping
    Zu, Chen
    Zeng, Xinyi
    Jiao, Zhengyang
    Wu, Xi
    Zhou, Jiliu
    Shen, Dinggang
    Wang, Yan
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2022, PT VI, 2022, 13436 : 516 - 526
  • [27] Lightning 3D histopathology
    Power, Rory M.
    Huisken, Jan
    NATURE BIOMEDICAL ENGINEERING, 2017, 1 (07):
  • [28] Lie algebra approach for tracking and 3D motion estimation using monocular vision
    Bayro-Corrochano, Eduardo
    Ortegon-Aguilar, Jaime
    IMAGE AND VISION COMPUTING, 2007, 25 (06) : 907 - 921
  • [29] VSNet: classification of pulmonary nodules in 3D using vision transformer and sequence spatial attention mechanism
    Dongfang Tang
    Ting Xiao
    Fan Yang
    Conghao Zhang
    Zhe Wang
    Wen Gao
    Multimedia Tools and Applications, 2025, 84 (14) : 13885 - 13903
  • [30] Exploiting 3D volume data from the Czech weather radar network
    Novák, P
    Krácmar, J
    PHYSICS AND CHEMISTRY OF THE EARTH PART B-HYDROLOGY OCEANS AND ATMOSPHERE, 2000, 25 (10-12): : 1163 - 1168