Scalability and interoperability within glideinWMS
Physicists have access to thousands of CPUs in grid federations such as OSG and EGEE. With the start-up of the LHC, it is essential for individuals or groups of users to wrap together available resources from multiple sites across multiple grids under a higher user-controlled layer in order to provide a homogeneous pool of available resources. One such system is glideinWMS, which is based on the Condor batch system. A general discussion of glideinWMS can be found elsewhere. Here, we focus on recent advances in extending its reach: scalability and integration of heterogeneous compute elements. We demonstrate that the new developments exceed the design goal of over 10,000 simultaneous running jobs under a single Condor schedd, using strong security protocols across global networks, and sustaining a steady-state job completion rate of a few Hz. We also show interoperability across heterogeneous computing elements achieved using client-side methods. We discuss this technique and the challenges in direct access to NorduGrid and CREAM compute elements, in addition to Globus based systems.
- Research Organization:
- Fermi National Accelerator Laboratory (FNAL), Batavia, IL
- Sponsoring Organization:
- USDOE
- DOE Contract Number:
- AC02-07CH11359
- OSTI ID:
- 986995
- Report Number(s):
- FERMILAB-CONF-10-258-CD
- Journal Information:
- J.Phys.Conf.Ser.219:062036,2010, Journal Name: J.Phys.Conf.Ser.219:062036,2010
- Country of Publication:
- United States
- Language:
- English
Similar Records
CDF GlideinWMS usage in grid computing of high energy physics
Definition and implementation of a SAML-XACML profile for authorization interoperability across grid middleware in OSG and EGEE