A new CDF model for data movement based on SRM

Conference · Fri Jan 01 04:00:00 EST 2010 · J.Phys.Conf.Ser.219:062052,2010

DOI:https://doi.org/10.1088/1742-6596/219/6/062052· OSTI ID:986652

Jha, Manoj Kumar; Compostella, Gabriele; Lucchesi, Donatella; Griso, Simone P; Benjamin, Doug

Being a large international collaboration established well before the full development of the Grid as the main computing tool for High Energy Physics, CDF has recently changed and improved its computing model, decentralizing some parts of it in order to be able to exploit the rising number of distributed resources available nowadays. Despite those efforts, while the large majority of CDF Monte Carlo production has moved to the Grid, data processing is still mainly performed in dedicated farms hosted at FNAL, requiring a centralized management of data and Monte Carlo samples needed for physics analysis. This rises the question on how to manage the transfer of produced Monte Carlo samples from remote Grid sites to FNAL in an efficient way; up to now CDF has relied on a non scalable centralized solution based on dedicated data servers accessed through rcp protocol, which has proven to be unsatisfactory. A new data transfer model has been designed that uses SRMs as local caches for remote Monte Carlo production sites, interfaces them with SAM, the experiment data catalog, and finally realizes the file movement exploiting the features provided by the data catalog transfer layer. We describe here the model and its integration within the current CDF computing architecture.

• Research Organization: Fermi National Accelerator Laboratory (FNAL), Batavia, IL
• Sponsoring Organization: USDOE
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 986652
• Report Number(s): FERMILAB-CONF-09-743-CD
• Conference Information: Journal Name: J.Phys.Conf.Ser.219:062052,2010
• Country of Publication: United States
• Language: English

Related Subjects

99 GENERAL AND MISCELLANEOUS
ARCHITECTURE
Computing
Instrumentation
DATA PROCESSING
FARMS
FERMILAB COLLIDER DETECTOR
HIGH ENERGY PHYSICS
MANAGEMENT
NUCLEAR PHYSICS
PHYSICS
PRODUCTION