Virtual Facility at Fermilab: Infrastructure and Services Expand to Public Clouds

Journal Article · 17 February 2016 · PoS Proceedings of Science

OSTI ID:1398388

Timm, Steve ^[1]; Garzoglio, Gabriele ^[1]; Cooper, Glenn ^[1]; Fuess, Stuart ^[1]

---

1. Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)

In preparation for its new Virtual Facility Project, Fermilab has launched a program of work to determine the requirements for running a computation facility on-site, in public clouds, or a combination of both. This program builds on the work we have done to successfully run experimental workflows of 1000-VM scale both on an on-site private cloud and on Amazon AWS. To do this at scale we deployed dynamically launched and discovered caching services on the cloud. We are now testing the deployment of more complicated services on Amazon AWS using native load balancing and auto scaling features they provide. The Virtual Facility Project will design and develop a facility including infrastructure and services that can live on the site of Fermilab, off-site, or a combination of both. We expect to need this capacity to meet the peak computing requirements in the future. The Virtual Facility is intended to provision resources on the public cloud on behalf of the facility as a whole instead of having each experiment or Virtual Organization do it on their own. We will describe the policy aspects of a distributed Virtual Facility, the requirements, and plans to make a detailed comparison of the relative cost of the public and private clouds. Furthermore, this talk will present the details of the technical mechanisms we have developed to date, and the plans currently taking shape for a Virtual Facility at Fermilab.

• Research Organization: Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
• Sponsoring Organization: USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
• Grant/Contract Number: AC02-07CH11359
• OSTI ID: 1398388
• Report Number(s): FERMILAB-CONF--15-681-CD; 1426622
• Journal Information: PoS Proceedings of Science, Journal Name: PoS Proceedings of Science Vol. ISGC 2015; ISSN 1824-8039
• Publisher: SISSACopyright Statement
• Country of Publication: United States
• Language: English