Farkas, Zoltán and Kacsuk, Péter and Balaskó, Ákos and Santcroos, Mark and Olabarriaga, Silvia (2013) Data Bridge: solving diverse Data Access in Scientific Applications. In: IWSG, June 3-5, 2013, Zurich, Switzerland.

Preview

Text paper13.pdf Download (234kB) | Preview

Abstract

The nature of data for scientific computation is very diverse in the age of big data. First, it may be available at a number of locations, e.g. the scientist’s machine, some institutional filesystem, a remote service, or some sort of database. Second, the size of the data may vary from a few kilobytes to many terabytes. In order to be available for computation, data has to be transferred to the location where the computation takes place. This requires a diverse set of middleware tools that are compatible both with the data and the compute resources. However, using this tools requires additional knowledge and makes running the experiments an inconvenient task. In this paper we present the Data Bridge, a high-level service that can be used easily in scientific computations to perform data transfer to and from a diverse set of storage services. The Data Bridge not only unifies access to different types of storage services, but it can also be used at different levels (e.g., single jobs, parameter sweeps, scientific workflows) in scientific computations.

Item Type:	Conference or Workshop Item (Paper)
Subjects:	Q Science > QA Mathematics and Computer Science > QA75 Electronic computers. Computer science / számítástechnika, számítógéptudomány
Divisions:	Laboratory of Parallel and Distributed Systems
Depositing User:	Zoltán Farkas
Date Deposited:	13 Nov 2013 11:53
Last Modified:	17 Dec 2013 07:44
URI:	https://eprints.sztaki.hu/id/eprint/7265

Update Item