Home

About

Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network
FAQHELPSITE MAPCONTACT US


  Advanced Search  

 
The File Mover: High-Performance Data Transfer for the Grid Cosimo Anglano, Massimo Canonico
 

Summary: The File Mover: High-Performance Data Transfer for the Grid
Cosimo Anglano, Massimo Canonico
Dipartimento di Informatica, Universit`a del Piemonte Orientale, Alessandria (Italy)
Via Bellini 25/g - 15100 Alessandria, Italy
email:{cosimo.anglano,massimo.canonico}@unipmn.it
Abstract
The exploration in many scientific disciplines (e.g., High-Energy Physics, Climate Modeling, and Life Sciences)
involves the production and the analysis of massive data collections, whose archival, retrieval, and analysis require the
coordinated usage of high capacity computing, network, and storage resources. To obtain satisfactory performance,
these applications require the availability of a high-performance, reliable data transfer mechanisms, able to minimize
the data transfer time that often dominates their execution time. In this paper we present the File Mover, an efficient
data transfer system specifically tailored to the needs of data-intensive applications, that exploits the overlay networks
paradigm to provide superior performance with respect to conventional file transfer systems. An extensive experimen-
tal evaluation, carried out by means of a proof-of-concept implementation of the File Mover for a variety of network
scenarions, shows the ability of the File Mover to outperform alternative data transfer systems.
1 Introduction
The scientific exploration in many disciplines, like High-Energy Physics, Climate Modeling, and Life Sciences, more
and more involves the production and the analysis of massive data collections, whose size is in the order of tens to
hundreds of Megabytes (and sometimes even Petabytes) [28]. The archival, retrieval, and analysis of such datasets,
that are usually disseminated among scientists located over a wide geographic area, require the coordinated usage of

  

Source: Anglano, Cosimo - Dipartimento di Informatica, UniversitÓ del Piemonte Orientale "A. Avogadro"

 

Collections: Computer Technologies and Information Sciences