A plugin-based approach to data analysis for the AMS experiment on the ISS

被引:0
|
作者
Formato, Valerio [1 ]
机构
[1] Ist Nazl Fis Nucl, Sez Perugia, Via A Pascoli Snc, I-06123 Perugia, PG, Italy
关键词
D O I
10.1051/epjconf/201921405038
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In many HEP experiments a typical data analysis workflow requires each user to read the experiment data in order to extract meaningful information and produce relevant plots for the considered analysis. Multiple users accessing the same data result in a redundant access to the data itself, which could be factorized effectively improving the CPU efficiency of the analysis jobs and relieving stress from the storage infrastructure. To address this issue we present a modular and lightweight solution where the users code is embedded in different "analysis plugins" which are then collected and loaded at runtime for execution, where the data is read only once and shared between all the different plugins. This solution was developed for one of the data analysis groups within the AMS collaboration but is easily extendable to all kinds of analyses and workloads that need I/O access on AMS data or custom data formats and can even adapted with little effort to another HEP experiment data. This framework could then be easily embedded into a "analysis train" and we will discuss a possible implementation and different ways to optimise CPU efficiency and execution time.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] A plugin-based language to experiment with model transformation
    Cuadrado, Jesus Sanchez
    Molina, Jesus Garcia
    MODEL DRIVEN ENGINEERING LANGUAGES AND SYSTEMS, PROCEEDINGS, 2006, 4199 : 336 - 350
  • [2] EDNA: a framework for plugin-based applications applied to X-ray experiment online data analysis
    Incardona, Marie-Francoise
    Bourenkov, Gleb P.
    Levik, Karl
    Pieritz, Romeu A.
    Popov, Alexander N.
    Svensson, Olof
    JOURNAL OF SYNCHROTRON RADIATION, 2009, 16 : 872 - 879
  • [3] A Plugin-Based Software Framework for Data Acquisition and Online Processing
    Fan, Shaoshuai
    Gu, Minhao
    Zhang, Hangchang
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2025, 72 (03) : 518 - 525
  • [4] POSTER: Study of Software Plugin-based Malware
    Liang Yu
    Li Zhiqiao
    Cui Xiang
    CCS'14: PROCEEDINGS OF THE 21ST ACM CONFERENCE ON COMPUTER AND COMMUNICATIONS SECURITY, 2014, : 1463 - 1465
  • [5] VirtualExplorer: A plugin-based virtual reality framework
    Kuester, F
    Hamann, B
    Joy, KI
    STEREOSCOPIC DISPLAYS AND VIRTUAL REALITY SYSTEMS VIII, 2001, 4297 : 436 - 442
  • [6] The AMS-02 experiment on the ISS
    Casaus, Jorge
    DISCRETE 08: SYMPOSIUM ON PROSPECTS IN THE PHYSICS OF DISCRETE SYMMETRIES, 2009, 171
  • [7] An Empirical Analysis of Plugin-Based Tor Traffic over SSH Tunnel
    Guan, Zhong
    Gou, Gaopeng
    Guan, Yangyang
    Wang, Bingxu
    MILCOM 2019 - 2019 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2019,
  • [8] Benefits of plugin-based heuristic optimization software systems
    Wagner, Stefan
    Winkler, Stephan
    Pitzer, Erik
    Kronberger, Gabriel
    Beham, Andreas
    Braune, Roland
    Affenzeller, Michael
    COMPUTER AIDED SYSTEMS THEORY- EUROCAST 2007, 2007, 4739 : 747 - +
  • [9] PRSP: A Plugin-based Framework for RDF Stream Processing
    Li, Qiong
    Zhang, Xiaowang
    Feng, Zhiyong
    WWW'17 COMPANION: PROCEEDINGS OF THE 26TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB, 2017, : 815 - 816
  • [10] Plugin-based GIS application framework: Research and implementation
    Faculty of Information Engineering, China University of Geosciences, GIS Software Research and Application Engineering Center, Wuhan 430074, China
    Diqiu Kexue Zhongguo Dizhi Daxue Xuebao, 2006, 5 (609-614):