skip to main content
DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: GRACC: New generation of the OSG accounting

Abstract

Throughout the last decade the Open Science Grid (OSG) has been fielding requests from user communities, resource owners, and funding agencies to provide information about utilization of OSG resources. Requested data include traditional accounting - core-hours utilized - as well as users certicate Distinguished Name, their affiliations, and eld of science. The OSG accounting service, Gratia, developed in 2006, is able to provide this information and much more. However, with the rapid expansion and transformation of the OSG resources and access to them, we are faced with several challenges in adapting and maintaining the current accounting service. The newest changes include, but are not limited to, acceptance of users from numerous university campuses, whose jobs are flocking to OSG resources, expansion into new types of resources (public and private clouds, allocation-based HPC resources, and GPU farms), migration to pilot-based systems, and migration to multicore environments. In order to have a scalable, sustainable and expandable accounting service for the next few years, we are embarking on the development of the next-generation OSG accounting service, GRACC, that will be based on open-source technology and will be compatible with the existing system. It will consist of swappable, independent components, such as Logstash, Elasticsearch,more » Grafana, and RabbitMQ, that communicate through a data exchange. GRACC will continue to interface EGI and XSEDE accounting services and provide information in accordance with existing agreements. Lastly, we will present the current architecture and working prototype.« less

Authors:
 [1];  [2];  [1];  [1];  [2];  [1];  [1];  [3];  [4]
  1. Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
  2. Univ. of Nebraska, Lincoln, NE (United States)
  3. Indiana Univ., Bloomington, IN (United States)
  4. Univ. of California, San Diego, CA (United States)
Publication Date:
Research Org.:
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
Sponsoring Org.:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
OSTI Identifier:
1346351
Report Number(s):
FERMILAB-CONF-17-054-CD
Journal ID: ISSN 1742-6588; 1516366
Grant/Contract Number:  
AC02-07CH11359
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Physics. Conference Series
Additional Journal Information:
Journal Volume: 898; Conference: CHEP 2016, San Francisco, CA (United States), 8-14 Oct 2016; Journal ID: ISSN 1742-6588
Publisher:
IOP Publishing
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING

Citation Formats

Retzke, K., Weitzel, D., Bhat, S., Levshina, T., Bockelman, B., Jayatilaka, B., Sehgal, C., Quick, R., and Wuerthwein, F. GRACC: New generation of the OSG accounting. United States: N. p., 2017. Web. doi:10.1088/1742-6596/898/9/092044.
Retzke, K., Weitzel, D., Bhat, S., Levshina, T., Bockelman, B., Jayatilaka, B., Sehgal, C., Quick, R., & Wuerthwein, F. GRACC: New generation of the OSG accounting. United States. doi:10.1088/1742-6596/898/9/092044.
Retzke, K., Weitzel, D., Bhat, S., Levshina, T., Bockelman, B., Jayatilaka, B., Sehgal, C., Quick, R., and Wuerthwein, F. Sun . "GRACC: New generation of the OSG accounting". United States. doi:10.1088/1742-6596/898/9/092044. https://www.osti.gov/servlets/purl/1346351.
@article{osti_1346351,
title = {GRACC: New generation of the OSG accounting},
author = {Retzke, K. and Weitzel, D. and Bhat, S. and Levshina, T. and Bockelman, B. and Jayatilaka, B. and Sehgal, C. and Quick, R. and Wuerthwein, F.},
abstractNote = {Throughout the last decade the Open Science Grid (OSG) has been fielding requests from user communities, resource owners, and funding agencies to provide information about utilization of OSG resources. Requested data include traditional accounting - core-hours utilized - as well as users certicate Distinguished Name, their affiliations, and eld of science. The OSG accounting service, Gratia, developed in 2006, is able to provide this information and much more. However, with the rapid expansion and transformation of the OSG resources and access to them, we are faced with several challenges in adapting and maintaining the current accounting service. The newest changes include, but are not limited to, acceptance of users from numerous university campuses, whose jobs are flocking to OSG resources, expansion into new types of resources (public and private clouds, allocation-based HPC resources, and GPU farms), migration to pilot-based systems, and migration to multicore environments. In order to have a scalable, sustainable and expandable accounting service for the next few years, we are embarking on the development of the next-generation OSG accounting service, GRACC, that will be based on open-source technology and will be compatible with the existing system. It will consist of swappable, independent components, such as Logstash, Elasticsearch, Grafana, and RabbitMQ, that communicate through a data exchange. GRACC will continue to interface EGI and XSEDE accounting services and provide information in accordance with existing agreements. Lastly, we will present the current architecture and working prototype.},
doi = {10.1088/1742-6596/898/9/092044},
journal = {Journal of Physics. Conference Series},
number = ,
volume = 898,
place = {United States},
year = {2017},
month = {10}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Save / Share: