Homogenizing OSG and XSEDE: Providing Access to XSEDE Allocations through OSG Infrastructure

Conference · Mon Jan 01 04:00:00 EST 2018

DOI:https://doi.org/10.1145/3219104.3219157· OSTI ID:1452813

Thapa, Thapa,Suchandra ^[1]; Gardner, Robert Jr. ^[1]; Lesny, David ^[2]; Hufnagel, Dirk ^[3]; Herner, Ken ^[3]; Rynge, Mats ^[4]

---

1. Chicago U.
2. Illinois U., Urbana
3. Fermilab
4. Southern California U.

We present a system that allows individual researchers and virtual organizations (VOs) to access allocations on Stampede2 and Bridges through the Open Science Grid (OSG), a national grid infrastructure for running high throughput computing (HTC) tasks. Using this system, VOs and researchers are able to run larger workflows than can be done with OSG resources alone. This system allows a VO or user to run on XSEDE resources (with their allocation) using the same framework used with OSG resources. The system consists of two parts: the compute element (CE) that routes workloads to the appropriate user accounts and allocation on XSEDE resources, and simulated access to the CernVM Filesystem (CVMFS) servers used by OSG and VOs to distribute software and data. This allows jobs submitted through this system to work on a homogeneous environment regardless of whether they run on XSEDE HPC resources (like Stampede2 and Bridges) or OSG.

• Research Organization: Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
• DOE Contract Number: AC02-07CH11359
• OSTI ID: 1452813
• Report Number(s): FERMILAB-CONF-18-221-CD; oai:inspirehep.net:1676520
• Country of Publication: United States
• Language: English