PARALLEL PROCESSING OF LARGE DATA SETS IN PARTICLE PHYSICS

被引：0
|
作者：
Rotaru, Marina [1 ]
Ciubancan, Mihai [1 ]
Stoicea, Gabriel [1 ]
机构：
[1] Horia Hulubei Natl Inst Phys & Nucl Engn, Reactorului 30,POB MG6, RO-077125 Magurele, Romania
来源：
ROMANIAN JOURNAL OF PHYSICS | 2016年 / 61卷 / 1-2期
关键词：
particle physics; PROOF; protocols; data analysis;
D O I：
暂无
中图分类号：
O4 [物理学];
学科分类号：
0702 ;
摘要：
The analysis of the LHC data aims to minimize the vast amounts of data and the number of observables used. After slimming and skimming the data, the remaining terabytes of ROOT files hold a selection of the events and a fiat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF has an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF-Lite, PROOF Cluster or PROOF on Demand tools. In this paper we compared performance of different methods of file access (NFS, XROOTD, RFIO). The tests were done on Bucharest ATLAS Analysis Facility.
引用
收藏
页码：245 / 252
页数：8
相关论文
共 50 条
  • [31] PARALLEL PROCESSING WITH LARGE-GRAIN DATA FLOW TECHNIQUES
    BABB, RG
    COMPUTER, 1984, 17 (07) : 55 - 61
  • [32] An Efficient Parallel Computing Method for the Processing of Large Sensed Data
    Li, Dandan
    Ji, Xiaohui
    Wang, Qun
    AUTOMATIKA, 2013, 54 (04) : 471 - 482
  • [33] ANALYSIS, SYNTHESIS AND PARALLEL PROCESSING OF LARGE DATA AND KNOWLEDGE BASES
    POLYACHENKO, BE
    ANDON, FI
    GUNKO, OL
    DATA ANALYSIS, LEARNING SYMBOLIC AND NUMERIC KNOWLEDGE, 1989, : 519 - 530
  • [34] Parallel Strategy for the Large-Scale Data Streams Processing
    Yuan, Ya-Juan
    Ma, Guo-Jie
    PROCEEDINGS OF THE 2016 INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND INFORMATION SYSTEMS, 2016, 52 : 232 - 234
  • [35] Parallel processing for fuzzy sets operations
    Cretu, E
    FUZZY SETS AND SYSTEMS, 2002, 130 (03) : 305 - 320
  • [36] High Performance Parallel Processing to Cluster Visually Similar Image Data Sets
    Kanere, Ketan
    Mhatre, Hitesh
    Jaiswal, Arjun
    PROCEEDINGS OF THE 10TH INDIACOM - 2016 3RD INTERNATIONAL CONFERENCE ON COMPUTING FOR SUSTAINABLE GLOBAL DEVELOPMENT, 2016, : 2690 - 2692
  • [37] Real Time Processing of Large Data Sets from Built Infrastructure
    Varduhn, Vasco
    Mundani, Ralf-Peter
    Rank, Ernst
    IMETI 2010: 3RD INTERNATIONAL MULTI-CONFERENCE ON ENGINEERING AND TECHNOLOGICAL INNOVATION, VOL II (POST-CONFERENCE EDITION), 2010, : 248 - 253
  • [38] Pre-processing large spatial data sets with Bayesian methods
    Hyvonen, Saara
    Junttila, Esa
    Salmenkivi, Marko
    KNOWLEDGE DISCOVERY IN DATABASES: PKDD 2007, PROCEEDINGS, 2007, 4702 : 498 - +
  • [39] Efficient GPU processing method to analyze large GWAS data sets
    Agapito, Giuseppe
    Guardasole, Gaetano
    Cannataro, Mario
    2024 32ND EUROMICRO INTERNATIONAL CONFERENCE ON PARALLEL, DISTRIBUTED AND NETWORK-BASED PROCESSING, PDP 2024, 2024, : 260 - 265
  • [40] A generic interface for parallel access to large data sets from HPF applications
    Brezany, P
    Czerwinski, P
    Winslett, M
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2001, 17 (08): : 977 - 985
12345