A web service-enabled distributed workflow system for scientific data processing

被引:2
|
作者
Kalyanam, Rajesh [1 ]
Zhao, Lan [1 ]
Park, Taezoon [1 ]
Goasguen, Sebastien [2 ]
机构
[1] Purdue Univ, Rosen Ctr Adv Comp, W Lafayette, IN 47907 USA
[2] Clemson Univ, Dept Comp Sci, Clemson, SC 29643 USA
来源
11TH IEEE INTERNATIONAL WORKSHOP ON FUTURE TRENDS OF DISTRIBUTED COMPUTING SYSTEMS, PROCEEDINGS | 2007年
关键词
D O I
10.1109/FTDCS.2007.9
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents the design and implementation of a distributed data-driven workflow system on top of the TeraGrid infrastructure. The workflow system is based on a data management architecture that provides easy access to scientific data collections via the TeraGrid network. The workflow system allows researchers to construct scientific workflows for data discovery, access, transformation, and analysis. The system leverages JOpera, an open-source workflow engine and visual composer as well as a set of web service-based data and computation modules. To demonstrate its effectiveness, we create an end-to-end climate simulation data analysis workflow that connects the data management architecture to YeraGrid computation resources. We also develop a workflow monitoring service to keep track of distributed workflow execution..
引用
收藏
页码:7 / +
页数:2
相关论文
共 50 条
  • [41] Distributed Multimedia Content Processing Based on Web Service
    Zhang Shilin
    Gu Mei
    2009 INTERNATIONAL FORUM ON COMPUTER SCIENCE-TECHNOLOGY AND APPLICATIONS, VOL 2, PROCEEDINGS, 2009, : 282 - 285
  • [42] Flowstep: A web-based distributed workflow management system
    Zhang, Y
    Yang, B
    Chen, PF
    Fourth Wuhan International Conference on E-Business: The Internet Era & The Global Enterprise, Vols 1 and 2, 2005, : 599 - 609
  • [43] Based on Digital Archives for Scientific Workflow System Active Service
    Wang, Rui
    Tang, Dailu
    MATERIALS, INFORMATION, MECHANICAL, ELECTRONIC AND COMPUTER ENGINEERING (MIMECE 2016), 2016, : 137 - 142
  • [44] A Web Service Cooperative Scheduling Model for Workflow Management System
    Zeng, Bin
    Hu, Tao
    Kong, Lin
    ICICSE: 2008 INTERNATIONAL CONFERENCE ON INTERNET COMPUTING IN SCIENCE AND ENGINEERING, PROCEEDINGS, 2008, : 473 - 479
  • [45] A Dynamically Reconfigurable Workflow System Based on Web Service Technology
    Liu, Hong
    ADVANCED MECHANICAL ENGINEERING, PTS 1 AND 2, 2010, 26-28 : 892 - 899
  • [46] SciDFS: An In-situ Processing System for Scientific Array Data based on Distributed File System
    Han, Donghyoung
    Nam, Yoon-Min
    Kim, Min-Soo
    Park, Kyongseok
    Han, Sunggeun
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP), 2018, : 375 - 382
  • [47] Balanced distributed web service lookup system
    Sioutas, S.
    Sakkopoulos, E.
    Drossos, L.
    Sirmakessis, S.
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2008, 31 (02) : 149 - 162
  • [48] A web-based sensor network system with distributed data processing approach via web application
    Fukatsu, Tokihiro
    Kiura, Takuji
    Hirafuji, Masayuki
    COMPUTER STANDARDS & INTERFACES, 2011, 33 (06) : 565 - 573
  • [49] Interlinking Distributed Services for Workflow-as-a-Service Based on Linked Data
    Chen, Wuhui
    Paik, Incheon
    Tashiro, Tetsuya
    JOURNAL OF ADVANCED COMPUTATIONAL INTELLIGENCE AND INTELLIGENT INFORMATICS, 2013, 17 (04) : 561 - 572
  • [50] USING SENSORML TO DESCRIBE SCIENTIFIC WORKFLOWS IN DISTRIBUTED WEB SERVICE ENVIRONMENTS
    van Zyl, Terence
    Vahed, Anwar
    2009 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS 1-5, 2009, : 3800 - 3802