Interoperable Job Execution and Data Access through UNICORE and the Global Federated File System

被引:0
|
作者
Memon, Shahbaz [1 ,3 ]
Riedel, Morris [1 ,3 ]
Koeritz, Chris [2 ]
Grimshaw, Andrew [2 ]
机构
[1] Forschungszentrum Julich, Juelich Supercomp Ctr, Julich, Germany
[2] Univ Virginia, Dept Comp Sci, Charlottesville, VA 22903 USA
[3] Univ Iceland, Sch Engn & Nat Sci, Reykjavik, Iceland
关键词
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Computing middlewares play a vital role for abstracting complexities of backend resources by providing a seamless access to heterogeneous execution management services. Scientific communities are taking advantage of such technologies to focus on science rather than dealing with technical intricacies of accessing resources. Multi-disciplinary communities often bring dynamic requirements which are not trivial to realize. Specifically, to attain massivley parallel data processing on supercomputing resources which require an access to large data sets from widely distributed and dynamic sources located across organizational boundaries. In order to support this abstract scenario, we bring a combination that integrates UNICORE middleware and the Global Federated File System. Furthermore, the paper gives architectural and implementation perspective of UNICORE extension and its interaction with Global Federated File System space through computing, data and security standards.
引用
收藏
页码:269 / 274
页数:6
相关论文
共 50 条
  • [1] ENABLING SCALABLE DATA PROCESSING AND MANAGEMENT THROUGH STANDARDS-BASED JOB EXECUTION AND THE GLOBAL FEDERATED FILE SYSTEM
    Memon, Shahbaz
    Riedel, Morris
    Memon, Shiraz
    Koeritz, Chris
    Grimshaw, Andrew
    Neukirchen, Helmut
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2016, 17 (02): : 115 - 128
  • [2] Cabinet: Managing Data Efficiently in the Global Federated File System
    Kalyanaraman, Avinash
    Grimshaw, Andrew
    2013 IEEE 9TH INTERNATIONAL CONFERENCE ON E-SCIENCE (E-SCIENCE), 2013, : 124 - 131
  • [3] GFFS - THE XSEDE GLOBAL FEDERATED FILE SYSTEM
    Grimshaw, Andrew
    Morgan, Mark
    Kalyanaraman, Avinash
    PARALLEL PROCESSING LETTERS, 2013, 23 (02)
  • [4] Interoperable access of remote sensing data through NWGISS
    Di, LP
    Yang, WL
    Deng, MX
    Deng, D
    McDonald, K
    IGARSS 2002: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM AND 24TH CANADIAN SYMPOSIUM ON REMOTE SENSING, VOLS I-VI, PROCEEDINGS: REMOTE SENSING: INTEGRATING OUR VIEW OF THE PLANET, 2002, : 255 - 257
  • [5] Optimisation to the execution performance of grid job based on distributed file system
    Hu, Liang D.
    Lin, Lin
    Zhao, Jia
    Che, Xilong
    Wei, Xiaohui
    INTERNATIONAL JOURNAL OF PARALLEL EMERGENT AND DISTRIBUTED SYSTEMS, 2012, 27 (02) : 109 - 121
  • [6] Paranoid: A global secure file access control system
    Zaffar, F
    Kedem, G
    Gehani, A
    21st Annual Computer Security Applications Conference, Proceedings, 2005, : 293 - 301
  • [7] Improved File System Security Through Restrictive Access
    Kaur, Navneet
    Singh, Maninder
    2016 INTERNATIONAL CONFERENCE ON INVENTIVE COMPUTATION TECHNOLOGIES (ICICT), VOL 3, 2015, : 95 - 99
  • [8] Enhanced resource management capabilities using standardized job management and data access interfaces within UNICORE grids
    Memon, M. Shahbaz
    Memon, A. Shiraz
    Riedel, Morris
    Schuller, Bernd
    Mallmann, Daniel
    Tweddell, Bastian
    Streit, Achim
    van de Berghe, Sven
    Snelling, David
    Li, Vivian
    Marzolla, Moreno
    Andreetto, Paolo
    2007 INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS, VOLS 1 AND 2, 2007, : 904 - +
  • [9] A Federated UDDI System for Concurrent Access to Service Data
    Liang, Qianhui
    Chung, Jen-Yao
    PROCEEDINGS OF THE ICEBE 2008: IEEE INTERNATIONAL CONFERENCE ON E-BUSINESS ENGINEERING, 2008, : 71 - +
  • [10] CMS Workflow Execution Using Intelligent Job Scheduling and Data Access Strategies
    Hasham, Khawar
    Peris, Antonio Delgado
    Anjum, Ashiq
    Evans, Dave
    Gowdy, Stephen
    Hernandez, Jose M.
    Huedo, Eduardo
    Hufnagel, Dirk
    van Lingen, Frank
    McClatchey, Richard
    Metson, Simon
    IEEE TRANSACTIONS ON NUCLEAR SCIENCE, 2011, 58 (03) : 1221 - 1232