Karóczkai, Krisztián and Kertész, Attila and Kacsuk, Péter (2016) A Meta-Brokering Framework for Science Gateways. JOURNAL OF GRID COMPUTING, 14 (4). pp. 678-703. ISSN 1570-7873 10.1007/s10723-016-9378-7

Preview	Text Karoczkai_678_3120381_ny.pdf Download (2MB) | Preview
	Text Karoczkai_678_3120381_z.pdf Restricted to Registered users only Download (2MB) | Request a copy

Abstract

Recently scientific communities produce a growing number of computation-intensive applications, which calls for the interoperation of distributed infrastructures including Clouds, Grids and private clusters. The European SHIWA and ER-flow projects have enabled the combination of heterogeneous scientific workflows, and their execution in a large-scale system consisting of multiple Distributed Computing Infrastructures. One of the resource management challenges of these projects is called parameter study job scheduling. A parameter study job of a workflow generally has a large number of input files to be consumed by independent job instances. In this paper we propose a meta-brokering framework for science gateways to support the execution of such workflows. In order to cope with the high uncertainty and unpredictable load of the utilized distributed infrastructures, we introduce the so called resource priority services. These tools are capable of determining and dynamically updating priorities of the available infrastructures to be selected for job instances. Our evaluations show that this approach implies an efficient distribution of job instances among the available computing resources resulting in shorter makespan for parameter study workflows.

Update Item