A plugin-based approach to data analysis for the AMS experiment on the ISS

被引:0
|
作者
Formato, Valerio [1 ]
机构
[1] Ist Nazl Fis Nucl, Sez Perugia, Via A Pascoli Snc, I-06123 Perugia, PG, Italy
关键词
D O I
10.1051/epjconf/201921405038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In many HEP experiments a typical data analysis workflow requires each user to read the experiment data in order to extract meaningful information and produce relevant plots for the considered analysis. Multiple users accessing the same data result in a redundant access to the data itself, which could be factorized effectively improving the CPU efficiency of the analysis jobs and relieving stress from the storage infrastructure. To address this issue we present a modular and lightweight solution where the users code is embedded in different "analysis plugins" which are then collected and loaded at runtime for execution, where the data is read only once and shared between all the different plugins. This solution was developed for one of the data analysis groups within the AMS collaboration but is easily extendable to all kinds of analyses and workloads that need I/O access on AMS data or custom data formats and can even adapted with little effort to another HEP experiment data. This framework could then be easily embedded into a "analysis train" and we will discuss a possible implementation and different ways to optimise CPU efficiency and execution time.
引用
收藏
页数:7
相关论文
共 50 条
  • [41] Discovery of anti-prion agents using a PyMOL plugin-based logical drug design platform NAGARA
    Ma, Biao
    Yamaguchi, Keiichi
    Fukuoka, Mayuko
    Kuwata, Kazuo
    PRION, 2016, 10 : S46 - S47
  • [42] First data from the EGLE experiment onboard the ISS
    Sgrigna, Vittorio
    Altamura, Francesco
    Ascani, Simone
    Battiston, Roberto
    Bencardino, Raffaele
    Blasko, Sandor
    Buzzi, Aurora
    Casolino, Marco
    Conti, Livio
    Lucidi, Stefano
    Minori, Mauro
    Papi, Andrea
    Picozza, Piergiorgio
    Rossi, Stefano
    Stagni, Carlo
    Zilpimiani, David
    MICROGRAVITY SCIENCE AND TECHNOLOGY, 2007, 19 (5-6) : 70 - 74
  • [43] First data from the EGLE experiment onboard the ISS
    Vittorio Sgrigna
    Francesco Altamura
    Simone Ascani
    Roberto Battiston
    Raffaele Bencardino
    Sandor Blasko
    Aurora Buzzi
    Marco Casolino
    Livio Conti
    Stefano Lucidi
    Mauro Minori
    Andrea Papi
    Piergiorgio Picozza
    Stefano Rossi
    Carlo Stagni
    David Zilpimiani
    Microgravity Science and Technology, 2007, 19 : 70 - 74
  • [44] Design of experiment with sensory data: A pragmatic data analysis approach
    Pineau, Nicolas
    Moser, Mireille
    Rawyler, Fabien
    Lepage, Melissa
    Antille, Nicolas
    Rytz, Andreas
    JOURNAL OF SENSORY STUDIES, 2019, 34 (02)
  • [45] Integrated Data Analysis for Parametric Design Environment mineR: a Grasshopper plugin based on R
    Abdulmawla, Abdulmalik
    Schneider, Sven
    Bielik, Martin
    Koenig, Reinhard
    COMPUTING FOR A BETTER TOMORROW, (ECAADE 2018), VOL 2, 2018, : 319 - 326
  • [46] The GEOFLOW-experiment on ISS (part III): Bifurcation analysis
    Beltrame, P
    Egbers, C
    Hollerbach, R
    GRAVITATIONAL EFFECTS IN PHYSICO-CHEMICAL PROCESSES, 2003, 32 (02): : 191 - 197
  • [47] Examination of uncertainties in nuclear data for cosmic ray physics with the AMS experiment
    Tomassetti, Nicola
    PHYSICAL REVIEW C, 2015, 92 (04):
  • [48] AMS-02 photon data reduction approach
    Boella, G.
    Boschini, M. J.
    Consolandi, C.
    Della Torre, S.
    Gervasi, M.
    Crandi, D.
    Memola, E.
    Pensotti, S.
    Rancoita, P. C.
    Tacconi, M.
    COSMIC RAYS FOR PARTICLE AND ASTROPARTICLE PHYSICS, 2011, 6 : 36 - 43
  • [49] USING CAR4AMS, THE BAYESIAN AMS DATA ANALYSIS CODE
    Palonen, V.
    Tikkanen, P.
    Keinonen, J.
    RADIOCARBON, 2010, 52 (03) : 948 - 952
  • [50] A new approach for the analysis of data and the clustering of subjects in a CATA experiment
    Llobell, Fabien
    Cariou, Veronique
    Vigneau, Evelyne
    Labenne, Amaury
    Qannari, El Mostafa
    FOOD QUALITY AND PREFERENCE, 2019, 72 : 31 - 39