Design of Marine Data Warehouse ETL System

被引:1
|
作者
Wen WeiJun [1 ]
机构
[1] Ocean Univ China, Dept Marine Technol, Qingdao 266100, Peoples R China
来源
MECHANICAL COMPONENTS AND CONTROL ENGINEERING III | 2014年 / 668-669卷
关键词
data warehouse; ETL; marine data; data cleaning; data extracting; data transformation;
D O I
10.4028/www.scientific.net/AMM.668-669.1374
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
ETL refers to the process of data extracting, transformation and loading and is deemed as a critical step in ensuring the quality, data specification and standardization of marine environmental data. Marine data, due to their complication, field diversity and huge volume, still remain decentralized, polyphyletic and isomerous with different semantics and hence far from being able to provide effective data sources for decision making. ETL enables the construction of marine environmental data warehouse in the form of cleaning, transformation, integration, loading and periodic updating of basic marine data warehouse. The paper presents a research on rules for cleaning, transformation and integration of marine data, based on which original ETL system of marine environmental data warehouse is so designed and developed. The system further guarantees data quality and correctness in analysis and decision-making based on marine environmental data in the future.
引用
收藏
页码:1374 / 1377
页数:4
相关论文
共 50 条
  • [41] Data warehouse architecture and design
    Rifaie, Mohammad
    Kianmehr, Keivan
    Alhajj, Reda
    Ridleya, Mick J.
    PROCEEDINGS OF THE 2008 IEEE INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION, 2008, : 58 - +
  • [42] Design of A Data Warehouse for Medical Information System Using Data Mining Techniques
    Farooqui, Nafees Akhter
    Mehra, Ritika
    2018 FIFTH INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND GRID COMPUTING (IEEE PDGC), 2018, : 199 - 203
  • [43] Data warehouse modeler: A CASE tool for warehouse design
    Miller, L
    Nilakanta, S
    PROCEEDINGS OF THE THIRTY-FIRST HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES, VOL VI: ORGANIZATIONAL SYSTEMS AND TECHNOLOGY TRACK, 1998, : 42 - 48
  • [44] Incremental design of a data warehouse
    Theodoratos, D
    Sellis, T
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2000, 15 (01) : 7 - 27
  • [45] Volunteer Design of Data Warehouse
    Bimonte, Sandro
    ADVANCED INFORMATION SYSTEMS ENGINEERING, CAISE 2020, 2020, 12127 : 561 - 562
  • [46] Towards data warehouse design
    Ravat, F
    Teste, O
    Zurfluh, G
    PROCEEDINGS OF THE EIGHTH INTERNATIONAL CONFERENCE ON INFORMATION KNOWLEDGE MANAGEMENT, CIKM'99, 1999, : 359 - 366
  • [47] An Intelligent ETL Grid-Based Solution to Enable Spatial Data Warehouse Deployment in Cyber Physical System Context
    Boulekrouche, Boubaker
    Jabeur, Nafaa
    Alimazighi, Zaia
    10TH INTERNATIONAL CONFERENCE ON FUTURE NETWORKS AND COMMUNICATIONS (FNC 2015) / THE 12TH INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS AND PERVASIVE COMPUTING (MOBISPC 2015) AFFILIATED WORKSHOPS, 2015, 56 : 111 - 118
  • [48] Data warehouse design solutions
    Wiley, DL
    ONLINE, 1999, 23 (04): : 85 - 86
  • [49] Incremental Design of a Data Warehouse
    Dimitri Theodoratos
    Timos Sellis
    Journal of Intelligent Information Systems, 2000, 15 : 7 - 27
  • [50] ETL∧2-Educational Tool for Learning ETL Solving inadequacy problems of industry oriented tools in Data Warehouse teaching
    Oliveira, Rui
    Ramos, Jose
    2015 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY BASED HIGHER EDUCATION AND TRAINING (ITHET), 2015,