skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Phoebus: Network Middleware for Next-Generation Network Computing

Abstract

The Phoebus project investigated algorithms, protocols, and middleware infrastructure to improve end-to-end performance in high speed, dynamic networks. The Phoebus system essentially serves as an adaptation point for networks with disparate capabilities or provisioning. This adaptation can take a variety of forms including acting as a provisioning agent across multiple signaling domains, providing transport protocol adaptation points, and mapping between distributed resource reservation paradigms and the optical network control plane. We have successfully developed the system and demonstrated benefits. The Phoebus system was deployed in Internet2 and in ESnet, as well as in GEANT2, RNP in Brazil and over international links to Korea and Japan. Phoebus is a system that implements a new protocol and associated forwarding infrastructure for improving throughput in high-speed dynamic networks. It was developed to serve the needs of large DOE applications on high-performance networks. The idea underlying the Phoebus model is to embed Phoebus Gateways (PGs) in the network as on-ramps to dynamic circuit networks. The gateways act as protocol translators that allow legacy applications to use dedicated paths with high performance.

Authors:
Publication Date:
Research Org.:
University of Delaware
Sponsoring Org.:
USDOE
OSTI Identifier:
1043181
Report Number(s):
FG02-04ER25642-12 Final Report
TRN: US201218%%180
DOE Contract Number:
FG02-04ER25642
Resource Type:
Technical Report
Country of Publication:
United States
Language:
English
Subject:
99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; ALGORITHMS; PERFORMANCE; TRANSLATORS; TRANSPORT; VELOCITY; NETWORK ANALYSIS; COMPUTER NETWORKS

Citation Formats

Martin Swany. Phoebus: Network Middleware for Next-Generation Network Computing. United States: N. p., 2012. Web. doi:10.2172/1043181.
Martin Swany. Phoebus: Network Middleware for Next-Generation Network Computing. United States. doi:10.2172/1043181.
Martin Swany. Sat . "Phoebus: Network Middleware for Next-Generation Network Computing". United States. doi:10.2172/1043181. https://www.osti.gov/servlets/purl/1043181.
@article{osti_1043181,
title = {Phoebus: Network Middleware for Next-Generation Network Computing},
author = {Martin Swany},
abstractNote = {The Phoebus project investigated algorithms, protocols, and middleware infrastructure to improve end-to-end performance in high speed, dynamic networks. The Phoebus system essentially serves as an adaptation point for networks with disparate capabilities or provisioning. This adaptation can take a variety of forms including acting as a provisioning agent across multiple signaling domains, providing transport protocol adaptation points, and mapping between distributed resource reservation paradigms and the optical network control plane. We have successfully developed the system and demonstrated benefits. The Phoebus system was deployed in Internet2 and in ESnet, as well as in GEANT2, RNP in Brazil and over international links to Korea and Japan. Phoebus is a system that implements a new protocol and associated forwarding infrastructure for improving throughput in high-speed dynamic networks. It was developed to serve the needs of large DOE applications on high-performance networks. The idea underlying the Phoebus model is to embed Phoebus Gateways (PGs) in the network as on-ramps to dynamic circuit networks. The gateways act as protocol translators that allow legacy applications to use dedicated paths with high performance.},
doi = {10.2172/1043181},
journal = {},
number = ,
volume = ,
place = {United States},
year = {Sat Jun 16 00:00:00 EDT 2012},
month = {Sat Jun 16 00:00:00 EDT 2012}
}

Technical Report:

Save / Share:
  • Developers of advanced network applications such as remote instrument control, distributed data management, tele-immersion and collaboration, and distributed computing face a daunting challenge: sustaining robust application performance despite time-varying resource demands and dynamically changing resource availability. It is widely recognized that network-aware middleware is key to achieving performance robustness.
  • The human brain (volume=1200cm3) consumes 20W and is capable of performing > 10^16 operations/s. Current supercomputer technology has reached 1015 operations/s, yet it requires 1500m^3 and 3MW, giving the brain a 10^12 advantage in operations/s/W/cm^3. Thus, to reach exascale computation, two achievements are required: 1) improved understanding of computation in biological tissue, and 2) a paradigm shift towards neuromorphic computing where hardware circuits mimic properties of neural tissue. To address 1), we will interrogate corticostriatal networks in mouse brain tissue slices, specifically with regard to their frequency filtering capabilities as a function of input stimulus. To address 2), we willmore » instantiate biological computing characteristics such as multi-bit storage into hardware devices with future computational and memory applications. Resistive memory devices will be modeled, designed, and fabricated in the MESA facility in consultation with our internal and external collaborators.« less
  • This proposal sought of order 1M core-hours of Institutional Computing time intended to enable computing by a new LANL Postdoc (David Stark) working under LDRD ER project 20160472ER (PI: Lin Yin) on laser-ion acceleration. The project was “off-cycle,” initiating in June of 2016 with a postdoc hire.
  • The Next Generation Safeguards Professional Network (NGSPN) was established in 2009 by Oak Ridge National Laboratory targeted towards the engagement of young professionals employed in safeguards across the many national laboratories. NGSPN focuses on providing a mechanism for young safeguards professionals to connect and foster professional relationships, facilitating knowledge transfer between current safeguards experts and the next generation of experts, and acting as an entity to represent the interests of the international community of young and mid-career safeguards professionals. This is accomplished in part with a yearly meeting held at a national laboratory site. In 2011, this meeting was heldmore » at Pacific Northwest National Laboratory. This report documents the events and results of that meeting.« less
  • Data-intensive applications, including high energy and nuclear physics, astrophysics, climate modeling, nano-scale materials science, genomics, and financing, are expected to generate exabytes of data over the coming years, which must be transferred, visualized, and analyzed by geographically distributed teams of users. High-performance network capabilities must be available to these users at the application level in a transparent, virtualized manner. Moreover, the application users must have the capability to move large datasets from local and remote locations across network environments to their home institutions. To solve these challenges, the main goal of our project is to design and evaluate high-performance datamore » transfer software to support various data-intensive applications. First, we have designed a middleware software that provides access to Remote Direct Memory Access (RDMA) functionalities. This middleware integrates network access, memory management and multitasking in its core design. We address a number of issues related to its efficient implementation, for instance, explicit buffer management and memory registration, and parallelization of RDMA operations, which are vital to delivering the benefit of RDMA to the applications. Built on top of this middleware, an implementation and experimental evaluation of the RDMA-based FTP software, RFTP, is described and evaluated. This application has been implemented by our team to exploit the full capabilities of advanced RDMA mechanisms for ultra-high speed bulk data transfer applications on Energy Sciences Network (ESnet). Second, we designed our data transfer software to optimize TCP/IP based data transfer performance such that RFTP can be fully compatible with today’s Internet. Our kernel optimization techniques with Linux system calls sendfile and splice, can reduce data copy cost. In this report, we summarize the technical challenges of our project, the primary software design methods, the major project milestones achieved, as well as the testbed evaluation work and demonstrations during our project life time.« less