Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI

被引:228
|
作者
McCully, Curtis [1 ]
Volgenau, Nikolaus H. [1 ]
Harbeck, Daniel-Rolf [1 ]
Lister, Tim A. [1 ]
Saunders, Eric S. [1 ]
Turner, Monica L. [1 ]
Siverd, Robert J. [1 ]
Bowman, Mark [1 ]
机构
[1] Las Cumbres Observ, 6740 Cortona Dr,Suite 102, Goleta, CA 93117 USA
关键词
pipelines; software; image processing;
D O I
10.1117/12.2314340
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Real-time processing of streaming big data
    Ali A. Safaei
    Real-Time Systems, 2017, 53 : 1 - 44
  • [42] PARALLEL PROCESSING AND REAL-TIME DATA ACQUISITION
    TAYLOR, S
    TAYLOR, R
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 1990, 37 (02) : 355 - 360
  • [43] Development of a real-time data archive system for a KSTAR real-time network
    Kwon, Giil
    Lee, Woongryol
    Lee, Taegu
    Hong, Jaesic
    FUSION ENGINEERING AND DESIGN, 2018, 127 : 202 - 206
  • [44] A Real Time Processing and Streaming of Wireless Network Data using Storm
    Maske, Mohit M.
    Prasad, Prakash
    2015 INTERNATIONAL CONFERENCE ON COMPUTATION OF POWER, ENERGY, INFORMATION AND COMMUNICATION (ICCPEIC), 2015, : 244 - 249
  • [45] Cable Laying ROV for Real-time Seafloor Observatory Network Construction
    Kawaguchi, Katsuyoshi
    Kaneko, Sho
    Nishida, Takato
    Komine, Tetsuya
    OCEANS 2009 - EUROPE, VOLS 1 AND 2, 2009, : 676 - +
  • [46] Design of a Real-Time Wireless Network for the Northern Pierre Auger Observatory
    Kieckhafer, R. M.
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2011, 58 (04) : 1784 - 1792
  • [47] The Indian River Lagoon Observatory Real-time Water Quality Data Network for Research, Education, Outreach
    Hanisak, M. Dennis
    Davis, Kristen S.
    Metzger, Ben
    SEA TECHNOLOGY, 2015, 56 (08) : 27 - 31
  • [48] Real-Time Hybrid Processing of Data from Mechanical Processes.
    Vansteenkiste, G.C.
    TEW Technische Berichte, 1974, 43 (21): : 653 - 659
  • [49] Real-Time Processing and High-Quality Imaging of Navigation Strip Data Using SSS Based on AUVs
    Tang, Yulin
    Wang, Junsen
    Jin, Shaohua
    Zhao, Jianhu
    Wang, Liming
    Bian, Gang
    Zhao, Xinyang
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (09)
  • [50] Optimization of real-time ultrasound PCIe data streaming and OpenCL processing for SAFT imaging
    Walczak, M.
    Lewandowski, M.
    Zolek, N.
    2013 IEEE INTERNATIONAL ULTRASONICS SYMPOSIUM (IUS), 2013, : 2064 - 2067