skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Efficient Bulk Data Replication for the Earth System Grid

Abstract

The Earth System Grid (ESG) community faces the difficult challenge of managing the distribution of massive data sets to thousands of scientists around the world. To move data replicas efficiently, the ESG has developed a data transfer management tool called the Bulk Data Mover (BDM). We describe the performance results of the current system and plans towards extending the techniques developed so far for the up- coming project, in which the ESG will employ advanced networks to move multi-TB datasets with the ulti- mate goal of helping researchers understand climate change and its potential impacts on world ecology and society.

Authors:
 [1];  [1];  [1];  [1];  [2];  [2];  [3];  [3];  [4]
  1. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  2. Lawrence Livermore National Lab. (LLNL), Livermore, CA (United States)
  3. National Energy Research Scientific Computing Center, Berkeley, CA (United States)
  4. Energy Sciences Network, Berkeley, CA (United States)
Publication Date:
Research Org.:
Ernest Orlando Lawrence Berkeley National Laboratory, Berkeley, CA (United States)
Sponsoring Org.:
USDOE; Computational Research Division
OSTI Identifier:
986313
Report Number(s):
LBNL-3821E
TRN: US201017%%197
DOE Contract Number:  
AC02-05CH11231
Resource Type:
Conference
Resource Relation:
Conference: International Symposium on Grid Computing,
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; CLIMATES; DISTRIBUTION; ECOLOGY; MANAGEMENT; PERFORMANCE; REPLICAS; Earth System Grid, climate data, Bulk Data Movement, data transfer, NetLogger

Citation Formats

Sim, Alex, Gunter, Dan, Natarajan, Vijaya, Shoshani, Arie, Williams, Dean, Long, Jeff, Hick, Jason, Lee, Jason, and Dart, Eli. Efficient Bulk Data Replication for the Earth System Grid. United States: N. p., 2010. Web.
Sim, Alex, Gunter, Dan, Natarajan, Vijaya, Shoshani, Arie, Williams, Dean, Long, Jeff, Hick, Jason, Lee, Jason, & Dart, Eli. Efficient Bulk Data Replication for the Earth System Grid. United States.
Sim, Alex, Gunter, Dan, Natarajan, Vijaya, Shoshani, Arie, Williams, Dean, Long, Jeff, Hick, Jason, Lee, Jason, and Dart, Eli. Wed . "Efficient Bulk Data Replication for the Earth System Grid". United States. https://www.osti.gov/servlets/purl/986313.
@article{osti_986313,
title = {Efficient Bulk Data Replication for the Earth System Grid},
author = {Sim, Alex and Gunter, Dan and Natarajan, Vijaya and Shoshani, Arie and Williams, Dean and Long, Jeff and Hick, Jason and Lee, Jason and Dart, Eli},
abstractNote = {The Earth System Grid (ESG) community faces the difficult challenge of managing the distribution of massive data sets to thousands of scientists around the world. To move data replicas efficiently, the ESG has developed a data transfer management tool called the Bulk Data Mover (BDM). We describe the performance results of the current system and plans towards extending the techniques developed so far for the up- coming project, in which the ESG will employ advanced networks to move multi-TB datasets with the ulti- mate goal of helping researchers understand climate change and its potential impacts on world ecology and society.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2010},
month = {3}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: