skip to main content
OSTI.GOV title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Passive and Active Monitoring on a High Performance Research Network.

Abstract

The bold network challenges described in ''Internet End-to-end Performance Monitoring for the High Energy and Nuclear Physics Community'' presented at PAM 2000 have been tackled by the intrepid administrators and engineers providing the network services. After less than a year, the BaBar collaboration has collected almost 100 million particle collision events in a database approaching 165TB (Tera=10{sup 12}). Around 20TB has been exported via the Internet to the BaBar regional center at IN2P3 in Lyon, France, for processing and around 40 TB of simulated events have been imported to SLAC from Lawrence Livermore National Laboratory (LLNL). An unforseen challenge has arisen due to recent events and highlighted security concerns at DoE funded labs. New rules and regulations suggest it is only a matter of time before many active performance measurements may not be possible between many sites. Yet, at the same time, the importance of understanding every aspect of the network and eradicating packet loss for high throughput data transfers has become apparent. Work at SLAC to employ passive monitoring using netflow and OC3MON is underway and techniques to supplement and possibly replace the active measurements are being considered. This paper will detail the special needs and traffic characterization ofmore » a remarkable research project, and how the networking hurdles have been resolved (or not!) to achieve the required high data throughput. Results from active and passive measurements will be compared, and methods for achieving high throughput and the effect on the network will be assessed along with tools that directly measure throughput and applications used to actually transfer data.« less

Authors:
Publication Date:
Research Org.:
Stanford Linear Accelerator Center, Menlo Park, CA (US)
Sponsoring Org.:
USDOE Office of Energy Research (ER) (US)
OSTI Identifier:
784912
Report Number(s):
SLAC-PUB-8776
TRN: US0108685
DOE Contract Number:  
AC03-76SF00515
Resource Type:
Technical Report
Resource Relation:
Other Information: PBD: 1 May 2001
Country of Publication:
United States
Language:
English
Subject:
99 GENERAL AND MISCELLANEOUS//MATHEMATICS, COMPUTING, AND INFORMATION SCIENCE; 43 PARTICLE ACCELERATORS; INTERNET; MONITORING; PERFORMANCE; REGULATIONS; SECURITY; COORDINATED RESEARCH PROGRAMS; INTERNATIONAL COOPERATION; PEP STORAGE RINGS; DATA ACQUISITION; DATA TRANSMISSION

Citation Formats

Matthews, Warren. Passive and Active Monitoring on a High Performance Research Network.. United States: N. p., 2001. Web. doi:10.2172/784912.
Matthews, Warren. Passive and Active Monitoring on a High Performance Research Network.. United States. doi:10.2172/784912.
Matthews, Warren. Tue . "Passive and Active Monitoring on a High Performance Research Network.". United States. doi:10.2172/784912. https://www.osti.gov/servlets/purl/784912.
@article{osti_784912,
title = {Passive and Active Monitoring on a High Performance Research Network.},
author = {Matthews, Warren},
abstractNote = {The bold network challenges described in ''Internet End-to-end Performance Monitoring for the High Energy and Nuclear Physics Community'' presented at PAM 2000 have been tackled by the intrepid administrators and engineers providing the network services. After less than a year, the BaBar collaboration has collected almost 100 million particle collision events in a database approaching 165TB (Tera=10{sup 12}). Around 20TB has been exported via the Internet to the BaBar regional center at IN2P3 in Lyon, France, for processing and around 40 TB of simulated events have been imported to SLAC from Lawrence Livermore National Laboratory (LLNL). An unforseen challenge has arisen due to recent events and highlighted security concerns at DoE funded labs. New rules and regulations suggest it is only a matter of time before many active performance measurements may not be possible between many sites. Yet, at the same time, the importance of understanding every aspect of the network and eradicating packet loss for high throughput data transfers has become apparent. Work at SLAC to employ passive monitoring using netflow and OC3MON is underway and techniques to supplement and possibly replace the active measurements are being considered. This paper will detail the special needs and traffic characterization of a remarkable research project, and how the networking hurdles have been resolved (or not!) to achieve the required high data throughput. Results from active and passive measurements will be compared, and methods for achieving high throughput and the effect on the network will be assessed along with tools that directly measure throughput and applications used to actually transfer data.},
doi = {10.2172/784912},
journal = {},
number = ,
volume = ,
place = {United States},
year = {2001},
month = {5}
}

Technical Report:

Save / Share: