Interoperable Job Execution and Data Access through UNICORE and the Global Federated File System

被引:0
|
作者
Memon, Shahbaz [1 ,3 ]
Riedel, Morris [1 ,3 ]
Koeritz, Chris [2 ]
Grimshaw, Andrew [2 ]
机构
[1] Forschungszentrum Julich, Juelich Supercomp Ctr, Julich, Germany
[2] Univ Virginia, Dept Comp Sci, Charlottesville, VA 22903 USA
[3] Univ Iceland, Sch Engn & Nat Sci, Reykjavik, Iceland
关键词
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Computing middlewares play a vital role for abstracting complexities of backend resources by providing a seamless access to heterogeneous execution management services. Scientific communities are taking advantage of such technologies to focus on science rather than dealing with technical intricacies of accessing resources. Multi-disciplinary communities often bring dynamic requirements which are not trivial to realize. Specifically, to attain massivley parallel data processing on supercomputing resources which require an access to large data sets from widely distributed and dynamic sources located across organizational boundaries. In order to support this abstract scenario, we bring a combination that integrates UNICORE middleware and the Global Federated File System. Furthermore, the paper gives architectural and implementation perspective of UNICORE extension and its interaction with Global Federated File System space through computing, data and security standards.
引用
收藏
页码:269 / 274
页数:6
相关论文
共 50 条
  • [21] Effective and Scalable Data Access Control in Onedata Large Scale Distributed Virtual File System
    Wrzeszcz, Michal
    Opiola, Lukasz
    Zemek, Konrad
    Kryza, Bartosz
    Dutka, Lukasz
    Slota, Renata
    Kitowski, Jacek
    INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE (ICCS 2017), 2017, 108 : 445 - 454
  • [22] Secure wide area network access to CMS analysis data using the Lustre file system
    Bourilkov, D.
    Avery, P.
    Cheng, M.
    Fu, Y.
    Kim, B.
    Palencia, J.
    Budden, R.
    Benninger, K.
    Rodriquez, J. L.
    Dilascio, J.
    Dykstra, D.
    Seenu, N.
    INTERNATIONAL CONFERENCE ON COMPUTING IN HIGH ENERGY AND NUCLEAR PHYSICS 2012 (CHEP2012), PTS 1-6, 2012, 396
  • [23] A simulation provenance data management system for efficient job execution on an online computational science engineering platform
    Jin Ma
    Sik Lee
    Kum Won Cho
    Young-Kyoon Suh
    Cluster Computing, 2019, 22 : 147 - 159
  • [24] A simulation provenance data management system for efficient job execution on an online computational science engineering platform
    Ma, Jin
    Lee, Sik
    Cho, Kum Won
    Suh, Young-Kyoon
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (01): : 147 - 159
  • [25] Access to ocean data through NASA's EOS data and information system
    McDonald, KR
    Pfister, RG
    OCEAN COMMUNITY CONFERENCE'98: CELEBRATING 1998 INTERNATIONAL YEAR OF THE OCEAN, PROCEEDINGS VOLS 1 AND 2, 1998, : 50 - 54
  • [26] Achieving Interoperability in Conditional Access Systems through the Dynamic Download and Execution of Cryptographic Software for the IPTV System
    Moon, Jinyoung
    Kim, Jungtae
    Park, Jongyoul
    Paik, Euihyun
    Third 2008 International Conference on Convergence and Hybrid Information Technology, Vol 2, Proceedings, 2008, : 380 - 385
  • [27] EGRIDER GFS: A Distributed File System with Multi-source Data Access and Replication for Grid Computing
    Chen, Chun-Ting
    Hsu, Chun-Chen
    Wu, Jan-Jan
    Liu, Pangfeng
    ADVANCES IN GRID AND PERVASIVE COMPUTING, PROCEEDINGS, 2009, 5529 : 119 - +
  • [28] Improving Performance of Distributed File System through Frequent Block Access Pattern-Based Prefetching Algorithm
    Nalajala, Anusha
    Ragunathan, T.
    Rajendra, Harsha Tavidisetty
    Nikhith, Nagamlla Venkata Sai
    Gopisetty, Rathnamma
    2019 10TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2019,
  • [29] Transforming the health system through data: access and governance as central elements
    Tiscar-Gonzalez, V.
    Cuevas, J. Cayon-De las
    ENFERMERIA CLINICA, 2024, 34 (03): : 145 - 147
  • [30] Enhancing hybrid parallel file system through performance and space-aware data layout
    He, Shuibing
    Liu, Yan
    Wang, Yang
    Sun, Xian-He
    Huang, Chuanhe
    INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2016, 30 (04): : 396 - 410