Time-Series Forecast Modeling on High-Bandwidth Network Measurements

doi:10.1007/s10723-016-9368-9

Title: Time-Series Forecast Modeling on High-Bandwidth Network Measurements

Full Record
Similar

Abstract

With the increasing number of geographically distributed scientific collaborations and the growing sizes of scientific data, it has become challenging for users to achieve the best possible network performance on a shared network. In this paper, we have developed a model to forecast expected bandwidth utilization on high-bandwidth wide area networks. The forecast model can improve the efficiency of the resource utilization and scheduling of data movements on high-bandwidth networks to accommodate ever increasing data volume for large-scale scientific data applications. A univariate time-series forecast model is developed with the Seasonal decomposition of Time series by Loess (STL) and the AutoRegressive Integrated Moving Average (ARIMA) on Simple Network Management Protocol (SNMP) path utilization measurement data. Compared with the traditional approach such as Box-Jenkins methodology to train the ARIMA model, our forecast model reduces computation time up to 92.6 %. It also shows resilience against abrupt network usage changes. Finally, our forecast model conducts the large number of multi-step forecast, and the forecast errors are within the mean absolute deviation (MAD) of the monitored measurements.

Authors:

Yoo, Wucherl ^[1]; Sim, Alex ^[1]

Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

Publication Date:: Fri Jun 24 00:00:00 EDT 2016

Research Org.:: Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)

Sponsoring Org.:: USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR) (SC-21)

OSTI Identifier:: 1377437

Grant/Contract Number:: AC02-05CH11231

Resource Type:: Journal Article: Accepted Manuscript

Journal Name:: Journal of Grid Computing

Additional Journal Information:: Journal Volume: 14; Journal Issue: 3; Journal ID: ISSN 1570-7873

Publisher:: Springer

Country of Publication:: United States

Language:: English

Subject:: 97 MATHEMATICS AND COMPUTING; data modeling; time series; prediction model; network measurements; network traffic

Citation Formats


                    Yoo, Wucherl, and Sim, Alex. Time-Series Forecast Modeling on High-Bandwidth Network Measurements.  United States: N. p., 2016. 
        Web.  doi:10.1007/s10723-016-9368-9.

Copy to clipboard


                    Yoo, Wucherl, & Sim, Alex. Time-Series Forecast Modeling on High-Bandwidth Network Measurements.  United States.  doi:10.1007/s10723-016-9368-9.

Copy to clipboard


                    Yoo, Wucherl, and Sim, Alex. Fri .  
        "Time-Series Forecast Modeling on High-Bandwidth Network Measurements".  United States.  
        doi:10.1007/s10723-016-9368-9.  https://www.osti.gov/servlets/purl/1377437.

Copy to clipboard


                    
@article{osti_1377437,

  title        = {Time-Series Forecast Modeling on High-Bandwidth Network Measurements},

  author       = {Yoo, Wucherl and Sim, Alex},

  abstractNote = {With the increasing number of geographically distributed scientific collaborations and the growing sizes of scientific data, it has become challenging for users to achieve the best possible network performance on a shared network. In this paper, we have developed a model to forecast expected bandwidth utilization on high-bandwidth wide area networks. The forecast model can improve the efficiency of the resource utilization and scheduling of data movements on high-bandwidth networks to accommodate ever increasing data volume for large-scale scientific data applications. A univariate time-series forecast model is developed with the Seasonal decomposition of Time series by Loess (STL) and the AutoRegressive Integrated Moving Average (ARIMA) on Simple Network Management Protocol (SNMP) path utilization measurement data. Compared with the traditional approach such as Box-Jenkins methodology to train the ARIMA model, our forecast model reduces computation time up to 92.6 %. It also shows resilience against abrupt network usage changes. Finally, our forecast model conducts the large number of multi-step forecast, and the forecast errors are within the mean absolute deviation (MAD) of the monitored measurements.},

  doi          = {10.1007/s10723-016-9368-9},

  journal      = {Journal of Grid Computing},

  number       = 3,

  volume       = 14,

  place        = {United States},

  year         = {Fri Jun 24 00:00:00 EDT 2016},

  month        = {Fri Jun 24 00:00:00 EDT 2016}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (DOE)

Publisher's Version of Record

DOI: 10.1007/s10723-016-9368-9

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 1 work

Citation information provided by
Web of Science

Save / Share:

Export Metadata

Save to My Library

Network Bandwidth Utilization Forecast Model on High Bandwidth Network

Yoo, Wucherl ; Sim, Alex

With the increasing number of geographically distributed scientific collaborations and the scale of the data size growth, it has become more challenging for users to achieve the best possible network performance on a shared network. We have developed a forecast model to predict expected bandwidth utilization for high-bandwidth wide area network. The forecast model can improve the efficiency of resource utilization and scheduling data movements on high-bandwidth network to accommodate ever increasing data volume for large-scale scientific data applications. Univariate model is developed with STL and ARIMA on SNMP path utilization data. Compared with traditional approach such as Box-Jenkins methodology,more »« less
DOI: 10.2172/1136782

Full Text Available
Network bandwidth utilization forecast model on high bandwidth networks

Yoo, Wuchert ; Sim, Alex

With the increasing number of geographically distributed scientific collaborations and the scale of the data size growth, it has become more challenging for users to achieve the best possible network performance on a shared network. We have developed a forecast model to predict expected bandwidth utilization for high-bandwidth wide area network. The forecast model can improve the efficiency of resource utilization and scheduling data movements on high-bandwidth network to accommodate ever increasing data volume for large-scale scientific data applications. Univariate model is developed with STL and ARIMA on SNMP path utilization data. Compared with traditional approach such as Box-Jenkins methodology,more »« less
DOI: 10.1109/ICCNC.2015.7069393

Full Text Available
Co-use of retention time and bandwidth measurements in evaluations of nucleotide pools by ion-exchange chromatography

Khym, J.X. ; Bynum, J.W. ; Volkin, E. - Anal. Biochem.; (United States)
DOI: 10.1016/0003-2697(77)90258-5
Generation and prediction of time series by a neural network

Eisenstein, E. ; Kanter, I. ; Kessler, D.A. ; ... - Physical Review Letters; (United States)

Generation and prediction of time series are analyzed for the case of a bit generator: a perceptron where in each time step the input units are shifted one bit to the right with the state of the leftmost input unit set equal to the output unit in the previous time step. The long-time dynamical behavior of the bit generator consists of cycles whose typical period scales polynomially with the size of the network and whose spatial structure is periodic with a typical finite wavelength. The generalization error on a cycle is zero for a finite training set, and global dynamicalmore »« less
DOI: 10.1103/PhysRevLett.74.6
The application of complex network time series analysis in turbulent heated jets

Charakopoulos, A. K. ; Karakasidis, T. E., E-mail: thkarak@uth.gr ; Liakopoulos, A. ; ... - Chaos (Woodbury, N. Y.)

In the present study, we applied the methodology of the complex network-based time series analysis to experimental temperature time series from a vertical turbulent heated jet. More specifically, we approach the hydrodynamic problem of discriminating time series corresponding to various regions relative to the jet axis, i.e., time series corresponding to regions that are close to the jet axis from time series originating at regions with a different dynamical regime based on the constructed network properties. Applying the transformation phase space method (k nearest neighbors) and also the visibility algorithm, we transformed time series into networks and evaluated the topologicalmore »« less
DOI: 10.1063/1.4875040