Advanced Search

Browse by Discipline

Scientific Societies

E-print Alerts

Add E-prints

E-print Network

  Advanced Search  

Remote Partial File Access Using Compact Pattern Descriptions

Summary: Remote Partial File Access Using
Compact Pattern Descriptions
Thorsten Sch¨utt, Andr´e Merzky, Andrei Hutanu, Florian Schintke
Zuse Institute Berlin (ZIB)
E-mail: {schuett,merzky,hutanu,schintke}@zib.de
We present a method for the efficient access to parts of
remote files. The efficiency is achieved by using a file for-
mat independent compact pattern description, that allows
to request several parts of a file in a single operation. This
results in a drastically reduced number of remote opera-
tions and network latencies if compared to common solu-
tions. We measured the time to access parts of remote files
with compact patterns, compared it with normal GridFTP
remote partial file access and observed a significant perfor-
mance increase.
Further, we discuss how the presented pattern access can
be used for an efficient read from multiple replicas and how
this can be integrated into a data management system to
support the storage of partial replicas for large scale simu-


Source: Andrzejak, Artur - Konrad-Zuse-Zentrum für Informationstechnik Berlin


Collections: Computer Technologies and Information Sciences