skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: SAMGrid experiences with the Condor technology in Run II computing

Abstract

SAMGrid is a globally distributed system for data handling and job management, developed at Fermilab for the D0 and CDF experiments in Run II. The Condor system is being developed at the University of Wisconsin for management of distributed resources, computational and otherwise. We briefly review the SAMGrid architecture and its interaction with Condor, which was presented earlier. We then present our experiences using the system in production, which have two distinct aspects. At the global level, we deployed Condor-G, the Grid-extended Condor, for the resource brokering and global scheduling of our jobs. At the heart of the system is Condor's Matchmaking Service. As a more recent work at the computing element level, we have been benefiting from the large computing cluster at the University of Wisconsin campus. The architecture of the computing facility and the philosophy of Condor's resource management have prompted us to improve the application infrastructure for D0 and CDF, in aspects such as parting with the shared file system or reliance on resources being dedicated. As a result, we have increased productivity and made our applications more portable and Grid-ready. Our fruitful collaboration with the Condor team has been made possible by the Particle Physics Datamore » Grid.« less

Authors:
; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; more »; « less
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE
OSTI Identifier:
15016974
Report Number(s):
FERMILAB-CONF-04-470-CD
TRN: US0605180
DOE Contract Number:  
AC02-76CH03000
Resource Type:
Conference
Resource Relation:
Conference: Prepared for Computing in High-Energy Physics (CHEP '04), Interlaken, Switzerland, 27 Sep - 1 Oct 2004
Country of Publication:
United States
Language:
English
Subject:
43 PARTICLE ACCELERATORS; 99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; ARCHITECTURE; FERMILAB; FERMILAB COLLIDER DETECTOR; MANAGEMENT; PHYSICS; PRODUCTION; PRODUCTIVITY; RESOURCE MANAGEMENT; Computing

Citation Formats

Baranovski, A., Loebel-Carpenter, L., Garzoglio, G., Herber, R., Illingworth, R., Kennedy, R., Kreymer, A., Kumar, A., Lueking, L., Lyon, A., Merritt, W., Terekhov, I., Trumbo, J., Veseli, S., White, S., /Fermilab, St. Denis, R., /Glasgow U., Jain, S., Nishandar, A., and /Texas U., Arlington. SAMGrid experiences with the Condor technology in Run II computing. United States: N. p., 2004. Web.
Baranovski, A., Loebel-Carpenter, L., Garzoglio, G., Herber, R., Illingworth, R., Kennedy, R., Kreymer, A., Kumar, A., Lueking, L., Lyon, A., Merritt, W., Terekhov, I., Trumbo, J., Veseli, S., White, S., /Fermilab, St. Denis, R., /Glasgow U., Jain, S., Nishandar, A., & /Texas U., Arlington. SAMGrid experiences with the Condor technology in Run II computing. United States.
Baranovski, A., Loebel-Carpenter, L., Garzoglio, G., Herber, R., Illingworth, R., Kennedy, R., Kreymer, A., Kumar, A., Lueking, L., Lyon, A., Merritt, W., Terekhov, I., Trumbo, J., Veseli, S., White, S., /Fermilab, St. Denis, R., /Glasgow U., Jain, S., Nishandar, A., and /Texas U., Arlington. Wed . "SAMGrid experiences with the Condor technology in Run II computing". United States. https://www.osti.gov/servlets/purl/15016974.
@article{osti_15016974,
title = {SAMGrid experiences with the Condor technology in Run II computing},
author = {Baranovski, A. and Loebel-Carpenter, L. and Garzoglio, G. and Herber, R. and Illingworth, R. and Kennedy, R. and Kreymer, A. and Kumar, A. and Lueking, L. and Lyon, A. and Merritt, W. and Terekhov, I. and Trumbo, J. and Veseli, S. and White, S. and /Fermilab and St. Denis, R. and /Glasgow U. and Jain, S. and Nishandar, A. and /Texas U., Arlington},
abstractNote = {SAMGrid is a globally distributed system for data handling and job management, developed at Fermilab for the D0 and CDF experiments in Run II. The Condor system is being developed at the University of Wisconsin for management of distributed resources, computational and otherwise. We briefly review the SAMGrid architecture and its interaction with Condor, which was presented earlier. We then present our experiences using the system in production, which have two distinct aspects. At the global level, we deployed Condor-G, the Grid-extended Condor, for the resource brokering and global scheduling of our jobs. At the heart of the system is Condor's Matchmaking Service. As a more recent work at the computing element level, we have been benefiting from the large computing cluster at the University of Wisconsin campus. The architecture of the computing facility and the philosophy of Condor's resource management have prompted us to improve the application infrastructure for D0 and CDF, in aspects such as parting with the shared file system or reliance on resources being dedicated. As a result, we have increased productivity and made our applications more portable and Grid-ready. Our fruitful collaboration with the Condor team has been made possible by the Particle Physics Data Grid.},
doi = {},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Wed Dec 01 00:00:00 EST 2004},
month = {Wed Dec 01 00:00:00 EST 2004}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: