Accessing Data Federations with CVMFS

Weitzel, Derek; Bockelman, Brian; Dykstra, Dave; Blomer, Jakob; Meusel, Ren

doi:10.1088/1742-6596/898/6/062044

Title: Accessing Data Federations with CVMFS

Full Record
Other Related Research

Abstract

Data federations have become an increasingly common tool for large collaborations such as CMS and Atlas to efficiently distribute large data files. Unfortunately, these typically are implemented with weak namespace semantics and a non-POSIX API. On the other hand, CVMFS has provided a POSIX-compliant read-only interface for use cases with a small working set size (such as software distribution). The metadata required for the CVMFS POSIX interface is distributed through a caching hierarchy, allowing it to scale to the level of about a hundred thousand hosts. In this paper, we will describe our contributions to CVMFS that merges the data scalability of XRootD-based data federations (such as AAA) with metadata scalability and POSIX interface of CVMFS. We modified CVMFS so it can serve unmodified files without copying them to the repository server. CVMFS 2.2.0 is also able to redirect requests for data files to servers outside of the CVMFS content distribution network. Finally, we added the ability to manage authorization and authentication using security credentials such as X509 proxy certificates. We combined these modifications with the OSGs StashCache regional XRootD caching infrastructure to create a cached data distribution network. Here, we will show performance metrics accessing the data federation throughmore »« less

Authors:

Weitzel, Derek ^[1]; Bockelman, Brian ^[1]; Dykstra, Dave ^[2]; Blomer, Jakob ^[3]; Meusel, Ren ^[3]

Univ. of Nebraska, Lincoln, NE (United States)
Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)
European Organization for Nuclear Research (CERN), Geneva (Switzerland)

Publication Date:: Thu Nov 23 00:00:00 EST 2017

Research Org.:: Fermi National Accelerator Lab. (FNAL), Batavia, IL (United States)

Sponsoring Org.:: USDOE Office of Science (SC), High Energy Physics (HEP)

OSTI Identifier:: 1399106

Report Number(s):: FERMILAB-CONF-17-407-CD
Journal ID: ISSN 1742-6588; 1630215

Grant/Contract Number:: AC02-07CH11359

Resource Type:: Accepted Manuscript

Journal Name:: Journal of Physics. Conference Series

Additional Journal Information:: Journal Volume: 898; Journal ID: ISSN 1742-6588

Publisher:: IOP Publishing

Country of Publication:: United States

Language:: English

Subject:: 96 KNOWLEDGE MANAGEMENT AND PRESERVATION

Citation Formats


                    Weitzel, Derek, Bockelman, Brian, Dykstra, Dave, Blomer, Jakob, and Meusel, Ren. Accessing Data Federations with CVMFS.  United States: N. p., 2017. 
Web.  doi:10.1088/1742-6596/898/6/062044.

Copy to clipboard


                    Weitzel, Derek, Bockelman, Brian, Dykstra, Dave, Blomer, Jakob, & Meusel, Ren. Accessing Data Federations with CVMFS.  United States.  https://doi.org/10.1088/1742-6596/898/6/062044

Copy to clipboard


                    Weitzel, Derek, Bockelman, Brian, Dykstra, Dave, Blomer, Jakob, and Meusel, Ren. Thu .  
"Accessing Data Federations with CVMFS".  United States.  https://doi.org/10.1088/1742-6596/898/6/062044.  https://www.osti.gov/servlets/purl/1399106.

Copy to clipboard


                    
@article{osti_1399106,

  title        = {Accessing Data Federations with CVMFS},

  author       = {Weitzel, Derek and Bockelman, Brian and Dykstra, Dave and Blomer, Jakob and Meusel, Ren},

  abstractNote = {Data federations have become an increasingly common tool for large collaborations such as CMS and Atlas to efficiently distribute large data files. Unfortunately, these typically are implemented with weak namespace semantics and a non-POSIX API. On the other hand, CVMFS has provided a POSIX-compliant read-only interface for use cases with a small working set size (such as software distribution). The metadata required for the CVMFS POSIX interface is distributed through a caching hierarchy, allowing it to scale to the level of about a hundred thousand hosts. In this paper, we will describe our contributions to CVMFS that merges the data scalability of XRootD-based data federations (such as AAA) with metadata scalability and POSIX interface of CVMFS. We modified CVMFS so it can serve unmodified files without copying them to the repository server. CVMFS 2.2.0 is also able to redirect requests for data files to servers outside of the CVMFS content distribution network. Finally, we added the ability to manage authorization and authentication using security credentials such as X509 proxy certificates. We combined these modifications with the OSGs StashCache regional XRootD caching infrastructure to create a cached data distribution network. Here, we will show performance metrics accessing the data federation through CVMFS compared to direct data federation access. Additionally, we will discuss the improved user experience of providing access to a data federation through a POSIX filesystem.},

  doi          = {10.1088/1742-6596/898/6/062044},

  journal      = {Journal of Physics. Conference Series},

  number       = ,

  volume       = 898,

  place        = {United States},

  year         = {Thu Nov 23 00:00:00 EST 2017},

  month        = {Thu Nov 23 00:00:00 EST 2017}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

https://doi.org/10.1088/1742-6596/898/6/062044

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Similar Records in DOE PAGES and OSTI.GOV collections:

Engineering the CernVM-Filesystem as a High Bandwidth Distributed Filesystem for Auxiliary Physics Data

Conference Dykstra, D. ; Bockelman, B. ; Blomer, J. ; ... - J.Phys.Conf.Ser.

A common use pattern in the computing models of particle physics experiments is running many distributed applications that read from a shared set of data files. We refer to this data is auxiliary data, to distinguish it from (a) event data from the detector (which tends to be different for every job), and (b) conditions data about the detector (which tends to be the same for each job in a batch of jobs). Relatively speaking, conditions data also tends to be relatively small per job where both event data and auxiliary data are larger per job. Unlike event data, auxiliarymore »« less
https://doi.org/10.1088/1742-6596/664/4/042012

Full Text Available
Web Proxy Auto Discovery for the WLCG

Journal Article Dykstra, D. ; Blomer, J. ; Blumenfeld, B. ; ... - Journal of Physics. Conference Series

All four of the LHC experiments depend on web proxies (that is, squids) at each grid site to support software distribution by the CernVM FileSystem (CVMFS). CMS and ATLAS also use web proxies for conditions data distributed through the Frontier Distributed Database caching system. ATLAS & CMS each have their own methods for their grid jobs to find out which web proxies to use for Frontier at each site, and CVMFS has a third method. Those diverse methods limit usability and flexibility, particularly for opportunistic use cases, where an experiment’s jobs are run at sites that do not primarily supportmore »« less
https://doi.org/10.1088/1742-6596/898/5/052043

Full Text Available
Virtual machine provisioning, code management, and data movement design for the Fermilab HEPCloud Facility

Journal Article Timm, S. ; Cooper, G. ; Fuess, S. ; ... - Journal of Physics. Conference Series

The Fermilab HEPCloud Facility Project has as its goal to extend the current Fermilab facility interface to provide transparent access to disparate resources including commercial and community clouds, grid federations, and HPC centers. This facility enables experiments to perform the full spectrum of computing tasks, including data-intensive simulation and reconstruction. We have evaluated the use of the commercial cloud to provide elasticity to respond to peaks of demand without overprovisioning local resources. Full scale data-intensive workflows have been successfully completed on Amazon Web Services for two High Energy Physics Experiments, CMS and NOνA, at the scale of 58000 simultaneous cores.more »« less
https://doi.org/10.1088/1742-6596/898/5/052041

Full Text Available
XRootd, disk-based, caching proxy for optimization of data access, data placement and data replication

Conference Bauerdick, L. A.T. ; Bloom, K. ; Bockelman, B. ; ... - J.Phys.Conf.Ser.

Following the success of the XRootd-based US CMS data federation, the AAA project investigated extensions of the federation architecture by developing two sample implementations of an XRootd, disk-based, caching proxy. The first one simply starts fetching a whole file as soon as a file open request is received and is suitable when completely random file access is expected or it is already known that a whole file be read. The second implementation supports on-demand downloading of partial files. Extensions to the Hadoop Distributed File System have been developed to allow for an immediate fallback to network access when local HDFSmore »« less
https://doi.org/10.1088/1742-6596/513/4/042044

Full Text Available
Homogenizing OSG and XSEDE: Providing Access to XSEDE Allocations through OSG Infrastructure

Conference Thapa, Thapa,Suchandra ; Gardner, Robert Jr. ; Lesny, David ; ...

We present a system that allows individual researchers and virtual organizations (VOs) to access allocations on Stampede2 and Bridges through the Open Science Grid (OSG), a national grid infrastructure for running high throughput computing (HTC) tasks. Using this system, VOs and researchers are able to run larger workflows than can be done with OSG resources alone. This system allows a VO or user to run on XSEDE resources (with their allocation) using the same framework used with OSG resources. The system consists of two parts: the compute element (CE) that routes workloads to the appropriate user accounts and allocation onmore »« less
https://doi.org/10.1145/3219104.3219157

Full Text Available

Similar Records