PARALLEL PROCESSING OF LARGE DATA SETS IN PARTICLE PHYSICS

被引：0
|
作者：
Rotaru, Marina [1 ]
Ciubancan, Mihai [1 ]
Stoicea, Gabriel [1 ]
机构：
[1] Horia Hulubei Natl Inst Phys & Nucl Engn, Reactorului 30,POB MG6, RO-077125 Magurele, Romania
来源：
ROMANIAN JOURNAL OF PHYSICS | 2016年 / 61卷 / 1-2期
关键词：
particle physics; PROOF; protocols; data analysis;
D O I：
暂无
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
The analysis of the LHC data aims to minimize the vast amounts of data and the number of observables used. After slimming and skimming the data, the remaining terabytes of ROOT files hold a selection of the events and a fiat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF has an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF-Lite, PROOF Cluster or PROOF on Demand tools. In this paper we compared performance of different methods of file access (NFS, XROOTD, RFIO). The tests were done on Bucharest ATLAS Analysis Facility.
引用
收藏
页码：245 / 252
页数：8
相关论文
共 50 条
  • [21] Entailment Processing for Large RDF Data Sets Using GPU
    Chantrapornchai, Chantana
    Choksuchat, Chidchanok
    Haidl, Michael
    Gorlatch, Sergei
    NEW TRENDS IN SOFTWARE METHODOLOGIES, TOOLS AND TECHNIQUES, 2016, 286 : 333 - 345
  • [22] Parallel k/h-means clustering for large data sets
    Stoffel, K
    Belkoniene, A
    EURO-PAR'99: PARALLEL PROCESSING, 1999, 1685 : 1451 - 1454
  • [23] Parallel Clustering Algorithm for Large-Scale Biological Data Sets
    Wang, Minchao
    Zhang, Wu
    Ding, Wang
    Dai, Dongbo
    Zhang, Huiran
    Xie, Hao
    Chen, Luonan
    Guo, Yike
    Xie, Jiang
    PLOS ONE, 2014, 9 (04):
  • [24] Parallel fuzzy c-means clustering for large data sets
    Kwok, T
    Smith, K
    Lozan, S
    Taniar, D
    EURO-PAR 2002 PARALLEL PROCESSING, PROCEEDINGS, 2002, 2400 : 365 - 374
  • [25] A Parallel Implementation for Fast Deformable Image Registration of Large Data Sets
    Zhang, L.
    Zhang, Y.
    Mohan, R.
    Dong, L.
    MEDICAL PHYSICS, 2008, 35 (06)
  • [26] Visual clustering of multidimensional and large data sets using parallel environments
    Blasiak, J
    Dzwinel, W
    HIGH-PERFORMANCE COMPUTING AND NETWORKING, 1998, 1401 : 403 - 410
  • [27] Support Vector Machines on Large Data Sets: Simple Parallel Approaches
    Meyer, Oliver
    Bischl, Bernd
    Weihs, Claus
    DATA ANALYSIS, MACHINE LEARNING AND KNOWLEDGE DISCOVERY, 2014, : 87 - 95
  • [28] Parallel Computing for Mixed-Stable Modelling of Large Data Sets
    Belovas, Igoris
    Starikovicius, Vadimas
    INFORMATION TECHNOLOGY AND CONTROL, 2015, 44 (02): : 148 - 154
  • [29] Parallel Distributed Genetic Rule Selection for Data Mining from Large Data Sets
    Nojima, Yusuke
    Mihara, Shingo
    Ishibuchi, Hisao
    SIMULATION AND MODELING RELATED TO COMPUTATIONAL SCIENCE AND ROBOTICS TECHNOLOGY, 2012, 37 : 140 - 154
  • [30] Parallel and Distributed Processing of Remote Sensing Data on Large Displays
    Lin, Ming-Li
    Chen, Ming-Da
    Hsieh, Tung-Ju
    Chang, Yang-Lang
    PROCEEDINGS OF THE 2012 IEEE 18TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2012), 2012, : 873 - 878
12345