Design of LAMOST data processing and production database

被引:0
|
作者
Guo, Yanxin [1 ]
Luo, Ali [1 ]
Wang, Fengfei [1 ]
Bai, Zhongrui [1 ]
Li, Jian [1 ]
机构
[1] Chinese Acad Sci, NAOC, Natl Astron Observ, Key Lab Opt Astron, Beijing 10012, Peoples R China
关键词
LAMOST; astronomical databases; eyeball check; data flow;
D O I
10.1117/12.925959
中图分类号
P1 [天文学];
学科分类号
0704 ;
摘要
Before LAMOST spectra release, raw data need to go through a series of processes, i.e. a pipeline after observed, including 2D reduction, spectral analysis, eyeball identification. It is a proper strategy that utilizing a database to integrate them. By using database the coupling between relative modules would be reduced to make the adding or removing of them more convenient, and the dataflow seems to be more clearly. The information of a specific object, from target selection to intermediate results and spectrum production, can be efficiently accessed and traced back through the database search, rather than via FITS reading. Furthermore, since the pipeline has not been perfected yet, the eyeball check is needed before the spectra are released, and an appropriate database can make the feedback period of eyeball check result more conveniently, thus the improvement of the pipeline will be more purposely. Finally, database can be a data mining tools for the statistics and analysis of massive astronomical data. This article focuses on the database design and the data processing flow built on it for LAMOST. The database design requirement of the existing routines, such as input/output, the relationship or dependence between them is introduced. Accordingly, the database structure suited for multiple version data process and eyeball verification is presented. The dataflow, how the pipeline is integrated relied on such a dedicated database system and how it worked are also explained. In addition, some user interfaces, eyeball check interfaces, statistical functions are also presented.
引用
收藏
页数:6
相关论文
共 50 条
  • [31] Relational Database Schema Design for Uncertain Data
    Link, Sebastian
    Prade, Henri
    CIKM'16: PROCEEDINGS OF THE 2016 ACM CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, 2016, : 1211 - 1220
  • [32] Data and operations allocation in distributed database design
    Li, Shijun
    Wang, Hanfei
    Zhou, Dongru
    Jisuanji Gongcheng/Computer Engineering, 1999, 25 (12): : 76 - 77
  • [33] The Binding Database: data management and interface design
    Chen, X
    Lin, YM
    Liu, M
    Gilson, MK
    BIOINFORMATICS, 2002, 18 (01) : 130 - 139
  • [34] Database support for evolving data in product design
    Posselt, D
    Hillebrand, G
    COMPUTERS IN INDUSTRY, 2002, 48 (01) : 59 - 69
  • [35] Reusing open data for learning database design
    Mazon, Jose-Norberto
    Lloret, Elena
    Gomez, Eva
    Aguilar, Antonia
    Mingot, Ivan
    Perez, Ernesto
    Quereda, Luisa
    2014 International Symposium on Computers in Education (SIIE), 2014, : 59 - 63
  • [36] DATA ALGEBRA AND ITS APPLICATION IN DATABASE DESIGN
    VIKAS, OM
    BASANDRA, SK
    INFORMATION PROCESSING LETTERS, 1986, 23 (01) : 47 - 54
  • [37] Database support for evolving data in product design
    Posselt, D
    Hillebrand, G
    PROCEEDINGS OF THE SIXTH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, 2001, : 377 - 383
  • [38] Relational database schema design for uncertain data
    Link, Sebastian
    Prade, Henri
    INFORMATION SYSTEMS, 2019, 84 : 88 - 110
  • [39] DATA PROCESSING, DATA TRANSMISSION AND DATA RECORDING IN PRODUCTION OPERATIONS
    KUNERTH, W
    SANNE, A
    WERKSTATTSTECHNIK ZEITSCHRIFT FUR INDUSTRIELLE FERTIGUNG, 1970, 60 (07): : 376 - &
  • [40] PRODUCTION CONTROL WITH ELECTRONIC DATA PROCESSING
    WALLER, S
    WERKSTATTSTECHNIK ZEITSCHRIFT FUR INDUSTRIELLE FERTIGUNG, 1971, 61 (03): : 159 - &