Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

Third-party transfers in WLCG using HTTP

Conference · · EPJ Web Conf.

Since its earliest days, the Worldwide LHC Computational Grid (WLCG) has relied on GridFTP to transfer data between sites. The announcement that Globus is dropping support of its open source Globus Toolkit (GT), which forms the basis for several FTP client and servers, has created an opportunity to reevaluate the use of FTP. HTTP-TPC, an extension to HTTP compatible with WebDAV, has arisen as a strong contender for an alternative approach.In this paper, we describe the HTTP-TPC protocol itself, along with the current status of its support in different implementations, and the interoperability testing done within the WLCG DOMA working group’s TPC activity. This protocol also provides the first real use-case for token-based authorisation for this community. We will demonstrate the benefits of such authorisation by showing how it allows HTTP-TPC to support new technologies (such as OAuth, OpenID Connect, Macaroons and SciTokens) without changing the protocol. We will also discuss the next steps for HTTP-TPC and the plans to use the protocol for WLCG transfers.

Research Organization:
Fermi National Accelerator Laboratory (FNAL), Batavia, IL (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP) (SC-25)
DOE Contract Number:
AC02-07CH11359
OSTI ID:
1764137
Report Number(s):
FERMILAB-CONF-20-640-SCD; oai:inspirehep.net:1831559
Journal Information:
EPJ Web Conf., Journal Name: EPJ Web Conf. Vol. 245
Country of Publication:
United States
Language:
English

References (9)

dCache, towards Federated Identities & Anonymized Delegation journal October 2017
The OAuth 2.0 Authorization Framework report October 2012
SciTokens: Capability-Based Secure Access to Remote Scientific Data
  • Withers, Alex; Bockelman, Brian; Weitzel, Derek
  • PEARC '18: Practice and Experience in Advanced Research Computing, Proceedings of the Practice and Experience on Advanced Research Computing https://doi.org/10.1145/3219104.3219135
conference July 2018
Bootstrapping a New LHC Data Transfer Ecosystem journal January 2019
Towards an HTTP Ecosystem for HEP Data Access journal June 2014
Macaroons: Cookies with Contextual Caveats for Decentralized Authorization in the Cloud conference January 2014
The GridSite Web/Grid security system journal January 2005
A security architecture for computational grids conference January 1998
Rucio: Scientific Data Management journal August 2019

Similar Records

Third-party transfers in WLCG using HTTP [Slides]
Conference · Mon Nov 04 23:00:00 EST 2019 · OSTI ID:1633093

WLCG Token Usage and Discovery
Conference · Thu Dec 31 23:00:00 EST 2020 · EPJ Web Conf. · OSTI ID:1781073

A GridFTP transport driver for Globus XIO.
Conference · Mon Dec 31 23:00:00 EST 2007 · OSTI ID:1001598

Related Subjects