Design of LAMOST data processing and production database

被引:0
|
作者
Guo, Yanxin [1 ]
Luo, Ali [1 ]
Wang, Fengfei [1 ]
Bai, Zhongrui [1 ]
Li, Jian [1 ]
机构
[1] Chinese Acad Sci, NAOC, Natl Astron Observ, Key Lab Opt Astron, Beijing 10012, Peoples R China
关键词
LAMOST; astronomical databases; eyeball check; data flow;
D O I
10.1117/12.925959
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Before LAMOST spectra release, raw data need to go through a series of processes, i.e. a pipeline after observed, including 2D reduction, spectral analysis, eyeball identification. It is a proper strategy that utilizing a database to integrate them. By using database the coupling between relative modules would be reduced to make the adding or removing of them more convenient, and the dataflow seems to be more clearly. The information of a specific object, from target selection to intermediate results and spectrum production, can be efficiently accessed and traced back through the database search, rather than via FITS reading. Furthermore, since the pipeline has not been perfected yet, the eyeball check is needed before the spectra are released, and an appropriate database can make the feedback period of eyeball check result more conveniently, thus the improvement of the pipeline will be more purposely. Finally, database can be a data mining tools for the statistics and analysis of massive astronomical data. This article focuses on the database design and the data processing flow built on it for LAMOST. The database design requirement of the existing routines, such as input/output, the relationship or dependence between them is introduced. Accordingly, the database structure suited for multiple version data process and eyeball verification is presented. The dataflow, how the pipeline is integrated relied on such a dedicated database system and how it worked are also explained. In addition, some user interfaces, eyeball check interfaces, statistical functions are also presented.
引用
收藏
页数:6
相关论文
共 50 条
  • [41] DATA PROCESSING MACHINES FOR CEMENT PRODUCTION
    CEDERKVI.T
    KJEMI, 1971, 31 (8A): : 45 - &
  • [42] Data Processing and Data Mining on Energy Consumption Database of Commercial Buildings in Shanghai
    Pan, Yiqun
    Huang, Zhizhong
    Zheng, Xiaowei
    ASHRAE TRANSACTIONS 2009, VOL 115, PT 1, 2009, 115 : 382 - +
  • [43] Design and Improvements of the Control System for LAMOST Spectrographs
    Lyu, Guanru
    Li, Jian
    Hou, Yonghui
    Wang, Shuqing
    UV/OPTICAL/IR SPACE TELESCOPES AND INSTRUMENTS: INNOVATIVE TECHNOLOGIES AND CONCEPTS IX, 2019, 11115
  • [44] Development of a thermodynamic database for cemented carbides for design and processing simulations
    Malin Ekroth
    Lucia F. S. Dumitrescu
    Karin Frisk
    Bo Jansson
    Metallurgical and Materials Transactions B, 2000, 31 : 615 - 619
  • [45] Development of a thermodynamic database for cemented carbides for design and processing simulations
    Ekroth, M
    Frisk, K
    Jansson, B
    Dumitrescu, LFS
    METALLURGICAL AND MATERIALS TRANSACTIONS B-PROCESS METALLURGY AND MATERIALS PROCESSING SCIENCE, 2000, 31 (04): : 615 - 619
  • [46] Modeling network latency and parallel processing in distributed database design
    Johansson, JM
    March, ST
    Naumann, JD
    DECISION SCIENCES, 2003, 34 (04) : 677 - 706
  • [47] Q100: The Architecture and Design of a Database Processing Unit
    Wu, Lisa
    Lottarini, Andrea
    Paine, Timothy K.
    Kim, Martha A.
    Ross, Kenneth A.
    ACM SIGPLAN NOTICES, 2014, 49 (04) : 255 - 268
  • [48] The Design and Production of Map Symbol Database Based on ArcGIS
    Xu, Jianying
    Yang, Mingyu
    APPLIED MATERIALS AND ELECTRONICS ENGINEERING, PTS 1-2, 2012, 378-379 : 405 - 408
  • [49] The design and implementation of a spatial database for the production of geological maps
    Laxton, JL
    Becken, K
    COMPUTERS & GEOSCIENCES, 1996, 22 (07) : 723 - 733
  • [50] Advancing Database System Operators with Near-Data Processing
    dos Santos, Sairo R.
    Moreira, Francis B.
    Kepe, Tiago R.
    Alves, Marco A. Z.
    30TH EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING (PDP 2022), 2022, : 127 - 134