MapReduce operations with WS-VLAM workflow management system

被引：3
|
作者：
Baranowski, Mikolaj [1 ]
Belloum, Adam [1 ]
Bubak, Marian [1 ]
机构：
[1] Univ Amsterdam, Inst Informat, NL-1098 XH Amsterdam, Netherlands
来源：
2013 INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE | 2013年 / 18卷
关键词：
scientific workflow; Ruby; MapReduce; Hadoop; parallel processing;
D O I：
10.1016/j.procs.2013.05.449
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
Workflow management systems are widely used to solve scientific problems as they enable orchestration of remote and local services such as database queries, job submission and running an application. To extend the role that workflow systems play in data-intensive science, we propose a solution that integrates WMS and MapReduce model. In this paper, we discuss possible solution of combining MapReduce and workflow applications, we describe the implementation of chosen solution based on metaprogramming approach in Ruby programming language and evaluate it with an example of word count application.
引用
收藏
页码：2599 / 2602
页数：4
相关论文
共 50 条
  • [31] A strategy for an MLS workflow management system
    Kang, MH
    Froscher, JN
    Eppinger, BJ
    Moskowitz, IS
    RESEARCH ADVANCES IN DATABASE AND INFORMATION SYSTEMS SECURITY, 2000, 43 : 161 - 174
  • [32] Flexible workflow management in the OPENflow system
    Halliday, JJ
    Shrivastava, SK
    Wheater, SM
    FIFTH IEEE INTERNATIONAL ENTERPRISE DISTRIBUTED OBJECT COMPUTING CONFERENCE, PROCEEDINGS, 2001, : 82 - 92
  • [33] Metadata Management in the Taverna Workflow System
    Belhajjame, Khalid
    Wolstencroft, Katy
    Corcho, Oscar
    Oinn, Tom
    Tanoh, Franck
    William, Alan
    Goble, Carole
    CCGRID 2008: EIGHTH IEEE INTERNATIONAL SYMPOSIUM ON CLUSTER COMPUTING AND THE GRID, VOLS 1 AND 2, PROCEEDINGS, 2008, : 651 - +
  • [34] Workflow management system with smart procedures
    Chmiel, Wojciech
    Derkacz, Jan
    Jedrusik, Stanislaw
    Kadluczka, Piotr
    Mikrut, Zbigniew
    Niemiec, Marcin
    Palka, Dariusz
    Rogus, Grzegorz
    Skalna, Iwona
    Turek, Michal
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (07) : 9505 - 9526
  • [35] An architecture modelling of a workflow management system
    Min, D
    Choi, E
    ARTIFICIAL INTELLIGENCE AND SIMULATION, 2004, 3397 : 645 - 654
  • [36] Implementation of policy based management in workflow management system
    Ouyang, Song
    COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN III, 2007, 4402 : 657 - 666
  • [37] The integration of content management system and workflow management system - A conceptual model
    Han, X
    Pape, U
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON E-BUSINESS (ICEB2002), 2002, : 213 - 218
  • [38] A Chemistry-Inspired Workflow Management System for Decentralizing Workflow Execution
    Fernandez, Hector
    Tedeschi, Cedric
    Priol, Thierry
    IEEE TRANSACTIONS ON SERVICES COMPUTING, 2016, 9 (02) : 213 - 226
  • [39] Workflow history management in virtual enterprises using a light-weight workflow management system
    Muth, P
    Weissenfels, J
    Gillmann, M
    Weikum, G
    RIDE-VE '99 - NINTH INTERNATIONAL WORKSHOP ON RESEARCH ISSUES ON DATA ENGINEERING: INFORMATION TECHNOLOGY FOR VIRTUAL ENTERPRISES, PROCEEDINGS, 1999, : 148 - 155
  • [40] Introducing an operations management system
    McKay, Hugh M.
    Public Works, 1989, 120 (02): : 76 - 77
12345