skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: The OSG Open Facility: An On-Ramp for Opportunistic Scientific Computing

Abstract

The Open Science Grid (OSG) is a large, robust computing grid that started primarily as a collection of sites associated with large HEP experiments such as ATLAS, CDF, CMS, and DZero, but has evolved in recent years to a much larger user and resource platform. In addition to meeting the US LHC community’s computational needs, the OSG continues to be one of the largest providers of distributed high-throughput computing (DHTC) to researchers from a wide variety of disciplines via the OSG Open Facility. The Open Facility consists of OSG resources that are available opportunistically to users other than resource owners and their collaborators. In the past two years, the Open Facility has doubled its annual throughput to over 200 million wall hours. More than half of these resources are used by over 100 individual researchers from over 60 institutions in fields such as biology, medicine, math, economics, and many others. Over 10% of these individual users utilized in excess of 1 million computational hours each in the past year. The largest source of these cycles is temporary unused capacity at institutions affiliated with US LHC computational sites. An increasing fraction, however, comes from university HPC clusters and large national infrastructuremore » supercomputers offering unused capacity. Such expansions have allowed the OSG to provide ample computational resources to both individual researchers and small groups as well as sizable international science collaborations such as LIGO, AMS, IceCube, and sPHENIX. Opening up access to the Fermilab FabrIc for Frontier Experiments (FIFE) project has also allowed experiments such as mu2e and NOvA to make substantial use of Open Facility resources, the former with over 40 million wall hours in a year. We present how this expansion was accomplished as well as future plans for keeping the OSG Open Facility at the forefront of enabling scientific research by way of DHTC.« less

Authors:
ORCiD logo [1];  [1];  [1];  [2];  [3];  [4]
  1. Fermilab
  2. Chicago U.
  3. USC - ISI, Marina del Rey
  4. UC, San Diego
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
OSTI Identifier:
1423232
Report Number(s):
FERMILAB-CONF-16-736-CD
1638596
DOE Contract Number:
AC02-07CH11359
Resource Type:
Conference
Resource Relation:
Journal Name: J.Phys.Conf.Ser.; Journal Volume: 898; Journal Issue: 8; Conference: 22nd International Conference on Computing in High Energy and Nuclear Physics, San Francisco, CA, 10/10-10/14/2016
Country of Publication:
United States
Language:
English

Citation Formats

Jayatilaka, B., Levshina, T., Sehgal, C., Gardner, R., Rynge, M., and Würthwein, F.. The OSG Open Facility: An On-Ramp for Opportunistic Scientific Computing. United States: N. p., 2017. Web. doi:10.1088/1742-6596/898/8/082048.
Jayatilaka, B., Levshina, T., Sehgal, C., Gardner, R., Rynge, M., & Würthwein, F.. The OSG Open Facility: An On-Ramp for Opportunistic Scientific Computing. United States. doi:10.1088/1742-6596/898/8/082048.
Jayatilaka, B., Levshina, T., Sehgal, C., Gardner, R., Rynge, M., and Würthwein, F.. Wed . "The OSG Open Facility: An On-Ramp for Opportunistic Scientific Computing". United States. doi:10.1088/1742-6596/898/8/082048. https://www.osti.gov/servlets/purl/1423232.
@article{osti_1423232,
title = {The OSG Open Facility: An On-Ramp for Opportunistic Scientific Computing},
author = {Jayatilaka, B. and Levshina, T. and Sehgal, C. and Gardner, R. and Rynge, M. and Würthwein, F.},
abstractNote = {The Open Science Grid (OSG) is a large, robust computing grid that started primarily as a collection of sites associated with large HEP experiments such as ATLAS, CDF, CMS, and DZero, but has evolved in recent years to a much larger user and resource platform. In addition to meeting the US LHC community’s computational needs, the OSG continues to be one of the largest providers of distributed high-throughput computing (DHTC) to researchers from a wide variety of disciplines via the OSG Open Facility. The Open Facility consists of OSG resources that are available opportunistically to users other than resource owners and their collaborators. In the past two years, the Open Facility has doubled its annual throughput to over 200 million wall hours. More than half of these resources are used by over 100 individual researchers from over 60 institutions in fields such as biology, medicine, math, economics, and many others. Over 10% of these individual users utilized in excess of 1 million computational hours each in the past year. The largest source of these cycles is temporary unused capacity at institutions affiliated with US LHC computational sites. An increasing fraction, however, comes from university HPC clusters and large national infrastructure supercomputers offering unused capacity. Such expansions have allowed the OSG to provide ample computational resources to both individual researchers and small groups as well as sizable international science collaborations such as LIGO, AMS, IceCube, and sPHENIX. Opening up access to the Fermilab FabrIc for Frontier Experiments (FIFE) project has also allowed experiments such as mu2e and NOvA to make substantial use of Open Facility resources, the former with over 40 million wall hours in a year. We present how this expansion was accomplished as well as future plans for keeping the OSG Open Facility at the forefront of enabling scientific research by way of DHTC.},
doi = {10.1088/1742-6596/898/8/082048},
journal = {J.Phys.Conf.Ser.},
number = 8,
volume = 898,
place = {United States},
year = {Wed Nov 22 00:00:00 EST 2017},
month = {Wed Nov 22 00:00:00 EST 2017}
}

Conference:
Other availability
Please see Document Availability for additional information on obtaining the full-text document. Library patrons may search WorldCat to identify libraries that hold this conference proceeding.

Save / Share: