Design of LAMOST data processing and production database

被引:0
|
作者
Guo, Yanxin [1 ]
Luo, Ali [1 ]
Wang, Fengfei [1 ]
Bai, Zhongrui [1 ]
Li, Jian [1 ]
机构
[1] Chinese Acad Sci, NAOC, Natl Astron Observ, Key Lab Opt Astron, Beijing 10012, Peoples R China
关键词
LAMOST; astronomical databases; eyeball check; data flow;
D O I
10.1117/12.925959
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Before LAMOST spectra release, raw data need to go through a series of processes, i.e. a pipeline after observed, including 2D reduction, spectral analysis, eyeball identification. It is a proper strategy that utilizing a database to integrate them. By using database the coupling between relative modules would be reduced to make the adding or removing of them more convenient, and the dataflow seems to be more clearly. The information of a specific object, from target selection to intermediate results and spectrum production, can be efficiently accessed and traced back through the database search, rather than via FITS reading. Furthermore, since the pipeline has not been perfected yet, the eyeball check is needed before the spectra are released, and an appropriate database can make the feedback period of eyeball check result more conveniently, thus the improvement of the pipeline will be more purposely. Finally, database can be a data mining tools for the statistics and analysis of massive astronomical data. This article focuses on the database design and the data processing flow built on it for LAMOST. The database design requirement of the existing routines, such as input/output, the relationship or dependence between them is introduced. Accordingly, the database structure suited for multiple version data process and eyeball verification is presented. The dataflow, how the pipeline is integrated relied on such a dedicated database system and how it worked are also explained. In addition, some user interfaces, eyeball check interfaces, statistical functions are also presented.
引用
收藏
页数:6
相关论文
共 50 条
  • [21] Data release of the LAMOST pilot survey
    A-Li Luo1
    2 Nanjing Institute of Astronomical Optics and Technology
    Research in Astronomy and Astrophysics, 2012, 12 (09) : 1243 - 1246
  • [22] Design and implementation of spatiotemporal database query processing system
    Kim, DH
    Ryu, KH
    Park, CH
    JOURNAL OF SYSTEMS AND SOFTWARE, 2002, 60 (01) : 37 - 49
  • [23] Data release of the LAMOST pilot survey
    Luo, A-Li
    Zhang, Hao-Tong
    Zhao, Yong-Heng
    Zhao, Gang
    Cui, Xiang-Qun
    Li, Guo-Ping
    Chu, Yao-Quan
    Shi, Jian-Rong
    Wang, Gang
    Zhang, Jian-Nan
    Bai, Zhong-Rui
    Chen, Xiao-Yan
    Wang, Feng-Fei
    Guo, Yan-Xin
    Chen, Jian-Jun
    Du, Bing
    Kong, Xiao
    Lei, Ya-Juan
    Li, Yin-Bi
    Song, Yi-Han
    Wu, Yue
    Zhang, Yan-Xia
    Zhou, Xin-Lin
    Zuo, Fang
    Du, Peng
    He, Lin
    Hou, Wen
    Dong, Yi-Qiao
    Li, Jian
    Li, Guang-Wei
    Li, Shuang
    Song, Jing
    Tian, Yuan
    Wang, Meng-Xin
    Wu, Ke-Fei
    Yang, Hui-Qin
    Yuan, Hai-Long
    Cao, Shu-Yun
    Chen, Hai-Yuan
    Chen, Kun-Xin
    Chen, Ying
    Chu, Jia-Ru
    Feng, Lei
    Gong, Xue-Fei
    Gu, Bo-Zhong
    Hou, Yong-Hui
    Huo, Zhi-Ying
    Hu, Hong-Zhuan
    Hu, Ning-Sheng
    Hu, Zhong-Wen
    RESEARCH IN ASTRONOMY AND ASTROPHYSICS, 2012, 12 (09) : 1243 - 1246
  • [24] The Design of Observatory Control System of LAMOST
    王坚
    金革
    虞孝麒
    黄琨
    李峰
    任间
    Plasma Science and Technology, 2006, (03) : 347 - 351
  • [25] Memory Database Application in the Processing of Huge Amounts of Data
    Xiao, Daqiang
    Qian, Qi
    Yang, Jianhua
    Chen, Guang
    PROCEEDINGS OF THE 2016 5TH INTERNATIONAL CONFERENCE ON ADVANCED MATERIALS AND COMPUTER SCIENCE, 2016, 80 : 534 - 540
  • [26] The design of observatory control system of LAMOST
    Wang Jian
    Jin Ge
    Yu Xiaoqi
    Huang Kun
    Li Feng
    Ren Jian
    PLASMA SCIENCE & TECHNOLOGY, 2006, 8 (03) : 347 - 351
  • [27] Data Processing on Database Management Systems with Fuzzy Query
    Simsek, Irfan
    Topuz, Vedat
    HYBRID ARTIFICIAL INTELLIGENCE SYSTEMS, PT 1, 2010, 6076 : 170 - +
  • [28] Data reduction and calibration for LAMOST survey
    Luo, Ali
    Zhang, Jiannan
    Chen, Jianjun
    Song, Yihan
    Wu, Yue
    Bai, Zhongrui
    Wang, Fengfei
    Du, Bing
    Zhang, Haotong
    SETTING THE SCENE FOR GAIA AND LAMOST, 2014, 9 (298): : 428 - 428
  • [29] DESIGN OF DATA PROCESSING CENTER FOR BIOLOGICAL DATA
    JUENEMANN, HJ
    ANNALS OF THE NEW YORK ACADEMY OF SCIENCES, 1964, 115 (A2) : 547 - &
  • [30] The Design of Observatory Control System of LAMOST
    王坚
    金革
    虞孝麒
    黄琨
    李峰
    任间
    Plasma Science and Technology, 2006, 8 (03) : 347 - 351