Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows

Fatih Aktas, Mehmet; Haldeman, Georgiana; Parashar, Manish

doi:10.1016/j.future.2015.09.011

Title: Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows

Authors:: Fatih Aktas, Mehmet; Haldeman, Georgiana; Parashar, Manish

Publication Date:: Tue Mar 01 00:00:00 EST 2016

Sponsoring Org.:: USDOE

OSTI Identifier:: 1359144

Grant/Contract Number:: SC0007455; FG02-06ER54857; 4000110839

Resource Type:: Publisher's Accepted Manuscript

Journal Name:: Future Generations Computer Systems

Additional Journal Information:: Journal Name: Future Generations Computer Systems Journal Volume: 56 Journal Issue: C; Journal ID: ISSN 0167-739X

Publisher:: Elsevier

Country of Publication:: Netherlands

Language:: English

Citation Formats


                    Fatih Aktas, Mehmet, Haldeman, Georgiana, and Parashar, Manish. Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows.  Netherlands: N. p., 2016. 
Web.  doi:10.1016/j.future.2015.09.011.

Copy to clipboard


                    Fatih Aktas, Mehmet, Haldeman, Georgiana, & Parashar, Manish. Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows.  Netherlands.  https://doi.org/10.1016/j.future.2015.09.011

Copy to clipboard


                    Fatih Aktas, Mehmet, Haldeman, Georgiana, and Parashar, Manish. Tue .  
"Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows".  Netherlands.  https://doi.org/10.1016/j.future.2015.09.011.

Copy to clipboard


                    
@article{osti_1359144,

  title        = {Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows},

  author       = {Fatih Aktas, Mehmet and Haldeman, Georgiana and Parashar, Manish},

  abstractNote = {},

  doi          = {10.1016/j.future.2015.09.011},

  journal      = {Future Generations Computer Systems},

  number       = C,

  volume       = 56,

  place        = {Netherlands},

  year         = {Tue Mar 01 00:00:00 EST 2016},

  month        = {Tue Mar 01 00:00:00 EST 2016}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (Publisher)

Publisher's Version of Record
https://doi.org/10.1016/j.future.2015.09.011

Other availability

Search WorldCat to find libraries that may hold this journal

Citation Metrics:

Cited by: 10 works

Citation information provided by
Web of Science

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

Commentaries on "Active networking and end-to-end arguments"
journal, May 1998

Chen, T. M.; Jackson, A. W.
IEEE Network, Vol. 12, Issue 3
DOI: 10.1109/65.690972

Ultrascience net: network testbed for large-scale science applications
journal, November 2005

Rao, N. S. V.; Wing, W. R.; Carter, S. M.
IEEE Communications Magazine, Vol. 43, Issue 11
DOI: 10.1109/MCOM.2005.1541694

End-to-end arguments in system design
journal, November 1984

Saltzer, J. H.; Reed, D. P.; Clark, D. D.
ACM Transactions on Computer Systems, Vol. 2, Issue 4
DOI: 10.1145/357401.357402

A survey of active network research
journal, January 1997

Tennenhouse, D. L.; Smith, J. M.; Sincoskie, W. D.
IEEE Communications Magazine, Vol. 35, Issue 1
DOI: 10.1109/35.568214

Similar Records in DOE PAGES and OSTI.GOV collections:

In-Staging Data Placement for Asynchronous Coupling of Task-Based Scientific Workflows, In: 2016 Second International Workshop on Extreme Scale Programming Models and Middlewar (ESPM2)

Conference Sun, Qian ; Romanus, Melissa ; Jin, Tong ; ... - PROCEEDINGS OF SECOND INTERNATIONAL WORKSHOP ON EXTREME SCALE PROGRAMMING MODELS AND MIDDLEWARE (ESPM2 2016)

Coupled application workflows composed of applications implemented using task-based models present new coupling and data exchange challenges, due to the asynchronous interaction and coupling behaviors between tasks of the component applications. In this paper, we present an adaptive data placement approach that addresses these challenges by dynamically adjusting to the asynchronous coupling patterns. Specifically, it places data across a set of staging cores/nodes with an awareness of the application-specific data locality requirements and the runtime task executions at these staging cores/nodes, with the goal of reducing end-to-end execution time and data movement overhead of the workflow. We experimentally demonstrate themore »« less
https://doi.org/10.1109/ESPM2.2016.12
Using cross-layer adaptations for dynamic data management in large scale coupled scientific workflows, In: SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

Conference Jin, Tong ; Zhang, Fan ; Sun, Qian ; ... - 2013 INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS (SC)

As system scales and application complexity grow, managing and processing simulation data has become a significant challenge. While recent approaches based on data staging and in-situ/in-transit data processing are promising, dynamic data volumes and distributions, such as those occurring in AMR-based simulations, make the efficient use of these techniques challenging. In this paper we propose cross-layer adaptations that address these challenges and respond at runtime to dynamic data management requirements. Specifically we explore (1) adaptations of the spatial resolution at which the data is processed, (2) dynamic placement and scheduling of data processing kernels, and (3) dynamic allocation of in-transitmore »« less
https://doi.org/10.1145/2503210.2503301
Modeling and Simulating Multiple Failure Masking enabled by Local Recovery for Stencil-based Applications at Extreme Scales

Journal Article Gamell, Marc ; Teranishi, Keita ; Mayo, Jackson ; ... - IEEE Transactions on Parallel and Distributed Systems

By obtaining multi-process hard failure resilience at the application level is a key challenge that must be overcome before the promise of exascale can be fully realized. Some previous work has shown that online global recovery can dramatically reduce the overhead of failures when compared to the more traditional approach of terminating the job and restarting it from the last stored checkpoint. If online recovery is performed in a local manner further scalability is enabled, not only due to the intrinsic lower costs of recovering locally, but also due to derived effects when using some application types. In this papermore »« less
Cited by 7
https://doi.org/10.1109/tpds.2017.2696538

Full Text Available
Autonomic Management of Application Workflows on Hybrid Computing Infrastructure

Journal Article Kim, Hyunjoo ; el-Khamra, Yaakoub ; Rodero, Ivan ; ... - Scientific Programming

In this paper, we present a programming and runtime framework that enables the autonomic management of complex application workflows on hybrid computing infrastructures. The framework is designed to address system and application heterogeneity and dynamics to ensure that application objectives and constraints are satisfied. The need for such autonomic system and application management is becoming critical as computing infrastructures become increasingly heterogeneous, integrating different classes of resources from high-end HPC systems to commodity clusters and clouds. For example, the framework presented in this paper can be used to provision the appropriate mix of resources based on application requirements and constraints.more »« less
Cited by 36
https://doi.org/10.1155/2011/940242
Scheduling and Control of Flexible Building Loads for Grid Services Based on a Virtual Battery Model

Conference Wu, Di ; Wang, Peng ; Ma, Xu ; ...

This paper presents a framework for modeling, scheduling, and controlling residential thermostatically controlled loads (TCLs) to provide multiple grid services, such as energy shifting, peak load reduction, and ancillary services. A modeling method is proposed to characterize the aggregate flexibility from heterogeneous TCLs using a battery-equivalent model. Based on the flexibility model, a multi-period optimal scheduling formulation is developed to best utilize the flexibility from building loads and maximize total benefits from stacked value streams. An algorithm is proposed to control individual TCLs to follow the desired power consumption in real-time. The proposed methods are illustrated and validated through simulations.

Similar Records

Title: Scheduling and flexible control of bandwidth and in-transit services for end-to-end application workflows

Citation Formats

Commentaries on "Active networking and end-to-end arguments" journal, May 1998

Ultrascience net: network testbed for large-scale science applications journal, November 2005

End-to-end arguments in system design journal, November 1984

A survey of active network research journal, January 1997

Commentaries on "Active networking and end-to-end arguments"
journal, May 1998

Ultrascience net: network testbed for large-scale science applications
journal, November 2005

End-to-end arguments in system design
journal, November 1984

A survey of active network research
journal, January 1997