Analysis of Detection Capability of Space Target Based on Event Camera

被引:0
|
作者
Lv Yuanyuan [1 ,2 ,3 ]
Liu Zhaohui [1 ,3 ]
Qiao Wenlong [1 ,2 ,3 ]
Zhou Liang [1 ,3 ]
Sun Xiaoxiao [1 ,2 ,3 ]
Chen Peiquan [1 ,2 ,3 ]
Li Wenkai [1 ,2 ,3 ]
Zhang Haiyang [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian 710119, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Key Lab Space Precis Measurement Technol, Xian 710119, Peoples R China
基金
中国国家自然科学基金;
关键词
Bio-inspired vision; Event camera; Space target observation; Sensitivity; Magnitude;
D O I
10.3788/gzxb20235202.0211001
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Event cameras are increasingly popular in the field of artificial vision systems as a new type of biological vision sensor. Different from traditional detectors, which capture images at a fixed rate, event cameras are inspired by biological retinas and respond asynchronously and independently to changes in the brightness of each pixel in the scene. The pixel unit independently detects the change range of the logarithmic value of the light intensity. When it exceeds the preset threshold, the pixel unit is activated and reads out the relevant information of this activation through an external unit, generally including the position of the pixel, activation time, polarity, and other information. When read out, these information are packaged into a data packet, which is called an "event". After the event is output, the photosensitive pixel unit will return to the inactive state and re-monitor the changes in the outside tight intensity. This working principle makes event cameras offer attractive properties compared to traditional cameras: large dynamic range (140 dB vs. 60 dB), high temporal resolution (in the order of us), low latency, low power consumption, and high pixel bandwidth ( in the order of kHz) resulting in reduced motion blur. Hence, Event cameras are widely used in spatial vision problems such as pose estimation, 3D reconstruction, and SLAM. With the development of the event camera, it has been gradually applied in the field of space target detection, and has shown great potential. Event cameras provide a new solution for monitoring satellites and stars for space situational awareness. However, there are few research on space situational awareness based on event cameras. Aiming at the problem of space target detection based on event cameras, we clarify the mechanism of event camera for space target observation, and systematically analyze the influencing factors that affect the detection sensitivity of space target based on event camera. Apart from theoretical analysis, we also build a detection sensitivity model of space target based on event cameras. As described by the proposed sensitivity model, the optical system parameters of the observation system, such as the clear aperture of the observation optical system, the diameter of the dispersion spot caused by the optical system, the transmittance of the optical system, the photoelectric conversion capability of the camera, and the atmospheric turbulence, determine the limit observation capability of the system. As the threshold of the event camera increases, the detection sensitivity of the system (characterized by limit magnitude) decreases linearly. Besides, we performed field experiments with telescopes using the CMOS camera and event camera. First, we conducted an experiment to observe the planetary based on the event camera. The observation results show that the event camera can be applied to space target observation. Compared with the traditional CMOS camera, the event camera has a lower spatial resolution, hut the characteristics of its low bandwidth communication, low weight, low power, and high speed make it fully meet the harsh requirements of sensors in the aerospace field, and have great application prospects in space target monitoring. In order to explore the impact of the event camera threshold setting on the detection results, we observed Polaris at different thresholds, and the results show that the low threshold makes the signal in the image more obvious but more noise events. When the weak target is observed, the too-low threshold is easy to cause the indistinguishability of noise events and signal events. When the threshold is raised, the detection sensitivity of the system decreases, and the signal is not obvious, which affects the signal recognition. Therefore, when using the event camera for space target observation, the selection of the threshold value is extremely important, riot only to ensure high detection sensitivity, but also to avoid the generation of a large number of noise events, which will affect the signal recognition. So establishing a sensitivity model of space target detection based on event camera can provide theoretical guidance for experiments. For the observation system we built, we selected five celestial objects that are easier to distinguish in the sky to calibrate the sensitivity model. The fitting results show good linearity with correlation coefficient greater than 0.95. After that, we chose three other celestial bodies to verify the model. The relative error was less than 3%, so the model we built is accurate. Event cameras are revolutionary sensors that offer many advantages over traditional, frame-based cameras. Their characteristics, such as low latency, low power, high speed and high dynamic range, make event cameras have a large potential for space target detection. In the meantime, many challenges remain ahead. By conducting theoretical analysis and experimental verification, this paper obtains the sensitivity model of space target detection based on event camera. We hope it can provide a few theoretical guidance for space target observation and other related research based on event camera.
引用
收藏
页数:12
相关论文
共 31 条
  • [1] [Anonymous], 2006 IEEE INT SOL ST
  • [2] BAGCHI S, 2020, 2020 IEEE WINTER C A
  • [3] Berner Raphael, 2013, 2013 Symposium on VLSI Circuits, pC186
  • [4] BLIZZARD D, 2017, P 60 IEEE INT MIDWES
  • [5] A 240 x 180 130 dB 3 μs Latency Global Shutter Spatiotemporal Vision Sensor
    Brandli, Christian
    Berner, Raphael
    Yang, Minhao
    Liu, Shih-Chii
    Delbruck, Tobi
    [J]. IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2014, 49 (10) : 2333 - 2341
  • [6] Cheung B, 2018, 2018 21ST INTERNATIONAL CONFERENCE ON INFORMATION FUSION (FUSION), P933, DOI 10.23919/ICIF.2018.8455718
  • [7] Star Tracking using an Event Camera
    Chin, Tat-Jun
    Bagchi, Samya
    Eriksson, Anders
    van Schaik, Andre
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, : 1646 - 1655
  • [8] Cohen G., 2017, P ADV MAUI OPTICAL S
  • [9] Development status and trend of event-based vision sensor
    Fang Ying-hong
    Xu Wei
    Piao Yong-jie
    Feng Ru-peng
    Zheng Liang-liang
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2021, 36 (12) : 1664 - 1673
  • [10] FEN Yang, 2021, RES EVENT STREAM PRO