A Meta-Brokering Framework for Science Gateways

Karóczkai, Krisztián and Kertész, Attila and Kacsuk, Péter (2016) A Meta-Brokering Framework for Science Gateways. JOURNAL OF GRID COMPUTING, 14 (4). pp. 678-703. ISSN 1570-7873 10.1007/s10723-016-9378-7

[img] Text
Karoczkai_678_3120381_ny.pdf

Download (2MB)
[img] Text
Karoczkai_678_3120381_z.pdf
Restricted to Registered users only

Download (2MB) | Request a copy

Abstract

Recently scientific communities produce a growing number of computation-intensive applications, which calls for the interoperation of distributed infrastructures including Clouds, Grids and private clusters. The European SHIWA and ER-flow projects have enabled the combination of heterogeneous scientific workflows, and their execution in a large-scale system consisting of multiple Distributed Computing Infrastructures. One of the resource management challenges of these projects is called parameter study job scheduling. A parameter study job of a workflow generally has a large number of input files to be consumed by independent job instances. In this paper we propose a meta-brokering framework for science gateways to support the execution of such workflows. In order to cope with the high uncertainty and unpredictable load of the utilized distributed infrastructures, we introduce the so called resource priority services. These tools are capable of determining and dynamically updating priorities of the available infrastructures to be selected for job instances. Our evaluations show that this approach implies an efficient distribution of job instances among the available computing resources resulting in shorter makespan for parameter study workflows.

Item Type: Article
Subjects: Q Science > QA Mathematics and Computer Science > QA75 Electronic computers. Computer science / számítástechnika, számítógéptudomány
Divisions: Laboratory of Parallel and Distributed Systems
SWORD Depositor: MTMT Injector
Depositing User: MTMT Injector
Date Deposited: 21 Jan 2017 17:04
Last Modified: 21 Jan 2017 17:06
URI: http://eprints.sztaki.hu/id/eprint/8984

Update Item Update Item