The OSG open facility: A sharing ecosystem

Jayatilaka, B.; Levshina, T.; Rynge, M.; Sehgal, C.; Slyz, M.

doi:10.1088/1742-6596/664/3/032016

Title: The OSG open facility: A sharing ecosystem

Full Record
Other Related Research

Abstract

The Open Science Grid (OSG) ties together individual experiments’ computing power, connecting their resources to create a large, robust computing grid, this computing infrastructure started primarily as a collection of sites associated with large HEP experiments such as ATLAS, CDF, CMS, and DZero. In the years since, the OSG has broadened its focus to also address the needs of other US researchers and increased delivery of Distributed High Through-put Computing (DHTC) to users from a wide variety of disciplines via the OSG Open Facility. Presently, the Open Facility delivers about 100 million computing wall hours per year to researchers who are not already associated with the owners of the computing sites, this is primarily accomplished by harvesting and organizing the temporarily unused capacity (i.e. opportunistic cycles) from the sites in the OSG. Using these methods, OSG resource providers and scientists share computing hours with researchers in many other fields to enable their science, striving to make sure that these computing power used with maximal efficiency. Furthermore, we believe that expanded access to DHTC is an essential tool for scientific innovation and work continues in expanding this service.

Authors:

Jayatilaka, B. ^[1]; Levshina, T. ^[1]; Rynge, M. ^[2]; Sehgal, C. ^[1]; Slyz, M. ^[2]

Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Univ. of Southern California, Marina de Rey, CA (United States)

Publication Date:: Wed Dec 23 00:00:00 EST 2015

Research Org.:: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)

Sponsoring Org.:: USDOE Office of Science (SC), High Energy Physics (HEP)

OSTI Identifier:: 1250775

Report Number(s):: FERMILAB-CONF-15-618-CD
Journal ID: ISSN 1742-6588; 1413817

Grant/Contract Number:: AC02-07CH11359

Resource Type:: Accepted Manuscript

Journal Name:: Journal of Physics. Conference Series

Additional Journal Information:: Journal Volume: 664; Journal Issue: 3; Conference: 21st International Conference on Computing in High Energy and Nuclear Physics, Okinawa (Japan), 13-17 Apr 2015; Journal ID: ISSN 1742-6588

Publisher:: IOP Publishing

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING

Citation Formats


                    Jayatilaka, B., Levshina, T., Rynge, M., Sehgal, C., and Slyz, M. The OSG open facility: A sharing ecosystem.  United States: N. p., 2015. 
Web.  doi:10.1088/1742-6596/664/3/032016.

Copy to clipboard


                    Jayatilaka, B., Levshina, T., Rynge, M., Sehgal, C., & Slyz, M. The OSG open facility: A sharing ecosystem.  United States.  https://doi.org/10.1088/1742-6596/664/3/032016

Copy to clipboard


                    Jayatilaka, B., Levshina, T., Rynge, M., Sehgal, C., and Slyz, M. Wed .  
"The OSG open facility: A sharing ecosystem".  United States.  https://doi.org/10.1088/1742-6596/664/3/032016.  https://www.osti.gov/servlets/purl/1250775.

Copy to clipboard


                    
@article{osti_1250775,

  title        = {The OSG open facility: A sharing ecosystem},

  author       = {Jayatilaka, B. and Levshina, T. and Rynge, M. and Sehgal, C. and Slyz, M.},

  abstractNote = {The Open Science Grid (OSG) ties together individual experiments’ computing power, connecting their resources to create a large, robust computing grid, this computing infrastructure started primarily as a collection of sites associated with large HEP experiments such as ATLAS, CDF, CMS, and DZero. In the years since, the OSG has broadened its focus to also address the needs of other US researchers and increased delivery of Distributed High Through-put Computing (DHTC) to users from a wide variety of disciplines via the OSG Open Facility. Presently, the Open Facility delivers about 100 million computing wall hours per year to researchers who are not already associated with the owners of the computing sites, this is primarily accomplished by harvesting and organizing the temporarily unused capacity (i.e. opportunistic cycles) from the sites in the OSG. Using these methods, OSG resource providers and scientists share computing hours with researchers in many other fields to enable their science, striving to make sure that these computing power used with maximal efficiency. Furthermore, we believe that expanded access to DHTC is an essential tool for scientific innovation and work continues in expanding this service.},

  doi          = {10.1088/1742-6596/664/3/032016},

  journal      = {Journal of Physics. Conference Series},

  number       = 3,

  volume       = 664,

  place        = {United States},

  year         = {Wed Dec 23 00:00:00 EST 2015},

  month        = {Wed Dec 23 00:00:00 EST 2015}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1088/1742-6596/664/3/032016

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Similar Records in DOE PAGES and OSTI.GOV collections:

The OSG Open Facility: an on-ramp for opportunistic scientific computing

Journal Article Jayatilaka, B. ; Levshina, T. ; Sehgal, C. ; ... - Journal of Physics. Conference Series

The Open Science Grid (OSG) is a large, robust computing grid that started primarily as a collection of sites associated with large HEP experiments such as ATLAS, CDF, CMS, and DZero, but has evolved in recent years to a much larger user and resource platform. In addition to meeting the US LHC community’s computational needs, the OSG continues to be one of the largest providers of distributed high-throughput computing (DHTC) to researchers from a wide variety of disciplines via the OSG Open Facility. The Open Facility consists of OSG resources that are available opportunistically to users other than resource ownersmore »« less
https://doi.org/10.1088/1742-6596/898/8/082048

Full Text Available
Supporting shared resource usage for a diverse user community: The OSG experience and lessons learned

Conference Garzoglio, Gabriele ; Levshina, Tanya ; Rynge, Mats ; ... - J.Phys.Conf.Ser.

The Open Science Grid (OSG) supports a diverse community of new and existing users in adopting and making effective use of the Distributed High Throughput Computing (DHTC) model. The LHC user community has deep local support within the experiments. For other smaller communities and individual users the OSG provides consulting and technical services through the User Support area. We describe these sometimes successful and sometimes not so successful experiences and analyze lessons learned that are helping us improve our services. The services offered include forums to enable shared learning and mutual support, tutorials and documentation for new technology, and troubleshootingmore »« less
https://doi.org/10.1088/1742-6596/396/3/032046

Full Text Available
Langston University - High Energy Physics (LU-HEP)

Technical Report Snow, Dr., Joel

This final report is presented by Langston University (LU) for the project entitled "Langston University High Energy Physics" (LUHEP) under the direction of principal investigator (PI) and project director Professor Joel Snow. The project encompassed high energy physics research performed at hadron colliders. The PI is a collaborator on the DZero experiment at Fermi National Accelerator Laboratory in Batavia, IL, USA and the ATLAS experiment at CERN in Geneva, Switzerland and was during the entire project period from April 1, 1999 until May 14, 2012. Both experiments seek to understand the fundamental constituents of the physical universe and the forcesmore »« less
https://doi.org/10.2172/1048139

Full Text Available
DZero data-intensive computing on the Open Science Grid

Journal Article Abbott, B ; /Oklahoma U. ; Baranovski, A ; ...

High energy physics experiments periodically reprocess data, in order to take advantage of improved understanding of the detector and the data processing code. Between February and May 2007, the DZero experiment has reprocessed a substantial fraction of its dataset. This consists of half a billion events, corresponding to about 100 TB of data, organized in 300,000 files. The activity utilized resources from sites around the world, including a dozen sites participating to the Open Science Grid consortium (OSG). About 1,500 jobs were run every day across the OSG, consuming and producing hundreds of Gigabytes of data. Access to OSG computingmore »« less
Full Text Available
GRACC: New generation of the OSG accounting

Journal Article Retzke, K. ; Weitzel, D. ; Bhat, S. ; ... - Journal of Physics. Conference Series

Throughout the last decade the Open Science Grid (OSG) has been fielding requests from user communities, resource owners, and funding agencies to provide information about utilization of OSG resources. Requested data include traditional accounting - core-hours utilized - as well as users certicate Distinguished Name, their affiliations, and eld of science. The OSG accounting service, Gratia, developed in 2006, is able to provide this information and much more. However, with the rapid expansion and transformation of the OSG resources and access to them, we are faced with several challenges in adapting and maintaining the current accounting service. The newest changesmore »« less
https://doi.org/10.1088/1742-6596/898/9/092044

Full Text Available

Similar Records