Dynamic load balancing for a mesh‐based scientific application

doi:10.1002/cpe.5626

This content will become publicly available on January 5, 2021

Title: Dynamic load balancing for a mesh‐based scientific application

Authors:

^[1]; Banerjee, Tania ^[1]; Zwick, David ^[2]; Hackl, Jason ^[2]; Koneru, Rahul ^[2]; Ranka, Sanjay ^[1]

Department of Computer &, Information Science &, EngineeringUniversity of Florida Gainesville Florida
Department of Mechanical &, Aerospace EngineeringUniversity of Florida Gainesville Florida

Publication Date:: 2020-01-06

Sponsoring Org.:: USDOE National Nuclear Security Administration (NNSA)

OSTI Identifier:: 1581451

Resource Type:: Publisher's Accepted Manuscript

Journal Name:: Concurrency and Computation. Practice and Experience

Additional Journal Information:: Journal Name: Concurrency and Computation. Practice and Experience; Journal ID: ISSN 1532-0626

Publisher:: Wiley Blackwell (John Wiley & Sons)

Country of Publication:: United Kingdom

Language:: English

Citation Formats


                    Zhai, Keke, Banerjee, Tania, Zwick, David, Hackl, Jason, Koneru, Rahul, and Ranka, Sanjay. Dynamic load balancing for a mesh‐based scientific application.  United Kingdom: N. p., 2020. 
        Web.  doi:10.1002/cpe.5626.

Copy to clipboard


                    Zhai, Keke, Banerjee, Tania, Zwick, David, Hackl, Jason, Koneru, Rahul, & Ranka, Sanjay. Dynamic load balancing for a mesh‐based scientific application.  United Kingdom.  doi:10.1002/cpe.5626.

Copy to clipboard


                    Zhai, Keke, Banerjee, Tania, Zwick, David, Hackl, Jason, Koneru, Rahul, and Ranka, Sanjay. Mon .  
        "Dynamic load balancing for a mesh‐based scientific application".  United Kingdom.  doi:10.1002/cpe.5626.

Copy to clipboard


                    
@article{osti_1581451,

  title        = {Dynamic load balancing for a mesh‐based scientific application},

  author       = {Zhai, Keke and Banerjee, Tania and Zwick, David and Hackl, Jason and Koneru, Rahul and Ranka, Sanjay},

  abstractNote = {},

  doi          = {10.1002/cpe.5626},

  journal      = {Concurrency and Computation. Practice and Experience},

  number       = ,

  volume       = ,

  place        = {United Kingdom},

  year         = {2020},

  month        = {1}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

This content will become publicly available on January 5, 2021

Publisher's Version of Record

DOI: 10.1002/cpe.5626

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

A load-balancing algorithm for a parallel electromagnetic particle-in-cell code
journal, May 2003

Plimpton, Steven J.; Seidel, David B.; Pasik, Michael F.
Computer Physics Communications, Vol. 152, Issue 3
DOI: 10.1016/S0010-4655(02)00795-6

Automated Load Balancing Invocation Based on Application Characteristics
conference, September 2012

Menon, Harshitha; Jain, Nikhil; Zheng, Gengbin
2012 IEEE International Conference on Cluster Computing (CLUSTER)
DOI: 10.1109/CLUSTER.2012.61

Hierarchical Load Balancing for Charm++ Applications on Large Supercomputers
conference, September 2010

Zheng, Gengbin; Meneses, Esteban; Bhatele, Abhinav
2010 International Conference on Parallel Processing Workshops (ICPPW), 2010 39th International Conference on Parallel Processing Workshops
DOI: 10.1109/ICPPW.2010.65

Architecture-independent locality-improving transformations of computational graphs embedded in k -dimensions
conference, January 1995

Ou, Chao-Wei; Gunwani, Manoj; Ranka, Sanjay
Proceedings of the 9th international conference on Supercomputing - ICS '95
DOI: 10.1145/224538.224573

Automatic data distribution and load balancing with space-filling curves: implementation in CONQUEST
journal, June 2008

Brázdová, V.; Bowler, D. R.
Journal of Physics: Condensed Matter, Vol. 20, Issue 27
DOI: 10.1088/0953-8984/20/27/275223

Load balancing n-body simulations with highly non-uniform density
conference, January 2014

Pearce, Olga; Gamblin, Todd; de Supinski, Bronis R.
Proceedings of the 28th ACM international conference on Supercomputing - ICS '14
DOI: 10.1145/2597652.2597659

GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation
journal, February 2008

Hess, Berk; Kutzner, Carsten; van der Spoel, David
Journal of Chemical Theory and Computation, Vol. 4, Issue 3
DOI: 10.1021/ct700301q

Terascale spectral element algorithms and implementations
conference, January 1999

Tufo, H. M.; Fischer, P. F.
Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM) - Supercomputing '99
DOI: 10.1145/331532.331599

POSTER: Automated Load Balancer Selection Based on Application Characteristics
journal, January 2017

Menon, Harshitha; Chandrasekar, Kavitha; Kale, Laxmikant V.
ACM SIGPLAN Notices, Vol. 52, Issue 8
DOI: 10.1145/3155284.3019033

Dynamic Load Balancing for Unstructured Meshes on Space-Filling Curves
conference, May 2012

Harlacher, Daniel F.; Klimach, Harald; Roller, Sabine
2012 26th IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum
DOI: 10.1109/IPDPSW.2012.207

Honey bee behavior inspired load balancing of tasks in cloud computing environments
journal, May 2013

L. D., Dhinesh Babu; Venkata Krishna, P.
Applied Soft Computing, Vol. 13, Issue 5
DOI: 10.1016/j.asoc.2013.01.025

CMT-Bone — A Proxy Application for Compressible Multiphase Turbulent Flows
conference, December 2016

Banerjee, Tania; Hackl, Jason; Shringarpure, Mrugesh
2016 IEEE 23rd International Conference on High Performance Computing (HiPC)
DOI: 10.1109/HiPC.2016.029

Dynamic topology aware load balancing algorithms for molecular dynamics applications
conference, January 2009

Bhatelé, Abhinav; Kalé, Laxmikant V.; Kumar, Sameer
Proceedings of the 23rd international conference on Conference on Supercomputing - ICS '09
DOI: 10.1145/1542275.1542295

Dynamic Load Balancing for Compressible Multiphase Turbulence
conference, January 2018

Zhai, Keke; Banerjee, Tania; Zwick, David
Proceedings of the 2018 International Conference on Supercomputing - ICS '18
DOI: 10.1145/3205289.3205304

Quantifying load imbalance on virtualized enterprise servers
conference, January 2010

Arzuaga, Emmanuel; Kaeli, David R.
Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering - WOSP/SIPEW '10
DOI: 10.1145/1712605.1712641

A load index and load balancing algorithm for heterogeneous clusters
journal, February 2013

Bosque, Jose Luis; Toharia, Pablo; Robles, Oscar D.
The Journal of Supercomputing, Vol. 65, Issue 3
DOI: 10.1007/s11227-013-0881-3

Analysis of scalable data-privatization threading algorithms for hybrid MPI/OpenMP parallelization of molecular dynamics
journal, April 2013

Kunaseth, Manaschai; Richards, David F.; Glosli, James N.
The Journal of Supercomputing, Vol. 66, Issue 1
DOI: 10.1007/s11227-013-0915-x

A Dynamic Load Balancing Framework for Real-time Applications in Message Passing Systems
journal, May 2010

El Kabbany, Ghada F.; Wanas, Nayer M.; Hegazi, Nadia H.
International Journal of Parallel Programming, Vol. 39, Issue 2
DOI: 10.1007/s10766-010-0134-5

Software support for irregular and loosely synchronous problems
journal, January 1992

Choudhary, A.; Fox, G.; Hiranandani, S.
Computing Systems in Engineering, Vol. 3, Issue 1-4
DOI: 10.1016/0956-0521(92)90093-X

Barycentric Lagrange Interpolation
journal, January 2004

Berrut, Jean-Paul; Trefethen, Lloyd N.
SIAM Review, Vol. 46, Issue 3
DOI: 10.1137/S0036144502417715

OhHelp: a scalable domain-decomposing dynamic load balancing for particle-in-cell simulations
conference, January 2009

Nakashima, Hiroshi; Miyake, Yohei; Usui, Hideyuki
Proceedings of the 23rd international conference on Conference on Supercomputing - ICS '09
DOI: 10.1145/1542275.1542293

Total variation diminishing Runge-Kutta schemes
journal, January 1998

Gottlieb, Sigal; Shu, Chi-Wang
Mathematics of Computation of the American Mathematical Society, Vol. 67, Issue 221
DOI: 10.1090/S0025-5718-98-00913-2

Fast Parallel Direct Solvers for Coarse Grid Problems
journal, February 2001

Tufo, H. M.; Fischer, P. F.
Journal of Parallel and Distributed Computing, Vol. 61, Issue 2
DOI: 10.1006/jpdc.2000.1676

Dynamic Load Balancing for a 2D Concurrent Plasma PIC Code
journal, December 1993

Ferraro, Robert D.; Liewer, Paulett C.; Decyk, Viktor K.
Journal of Computational Physics, Vol. 109, Issue 2
DOI: 10.1006/jcph.1993.1221

Highly scalable SFC-based dynamic load balancing and its application to atmospheric modeling
journal, May 2018

Lieber, Matthias; Nagel, Wolfgang E.
Future Generation Computer Systems, Vol. 82
DOI: 10.1016/j.future.2017.04.042

Quantifying the effectiveness of load balance algorithms
conference, January 2012

Pearce, Olga; Gamblin, Todd; de Supinski, Bronis R.
Proceedings of the 26th ACM international conference on Supercomputing - ICS '12
DOI: 10.1145/2304576.2304601

A genetic algorithm based autotuning approach for performance and energy optimization
conference, December 2015

Banerjee, Tania; Ranka, Sanjay
2015 Sixth International Green and Sustainable Computing Conference (IGSC)
DOI: 10.1109/IGCC.2015.7393708

Towards energy-aware scheduling in data centers using machine learning
conference, January 2010

Berral, Josep Ll.; Goiri, Íñigo; Nou, Ramón
Proceedings of the 1st International Conference on Energy-Efficient Computing and Networking - e-Energy '10
DOI: 10.1145/1791314.1791349

Parallel Remapping of Adaptive Problems
journal, May 1997

Ou, Chao-Wei; Ranka, Sanjay
Journal of Parallel and Distributed Computing, Vol. 42, Issue 2
DOI: 10.1006/jpdc.1997.1314

Fast and parallel mapping algorithms for irregular problems
journal, January 1996

Ou, Chao-Wei; Ranka, Sanjay; Fox, Geoffrey
The Journal of Supercomputing, Vol. 10, Issue 2
DOI: 10.1007/BF00130706

The Plasma Simulation Code: A modern particle-in-cell code with patch-based load-balancing
journal, August 2016

Germaschewski, Kai; Fox, William; Abbott, Stephen
Journal of Computational Physics, Vol. 318
DOI: 10.1016/j.jcp.2016.05.013

Parallel construction of multidimensional binary search trees
journal, January 2000

Al-Furajh, I.; Aluru, S.; Goil, S.
IEEE Transactions on Parallel and Distributed Systems, Vol. 11, Issue 2
DOI: 10.1109/71.841750

Energy efficiency of load balancing for data-parallel applications in heterogeneous systems
journal, September 2016

Pérez, Borja; Stafford, Esteban; Bosque, José Luis
The Journal of Supercomputing, Vol. 73, Issue 1
DOI: 10.1007/s11227-016-1864-y

Similar records in OSTI.GOV collections:

Design of dynamic load-balancing tools for parallel applications

Conference Devine, K.D. ; Hendrickson, B.A. ; Boman, E.G. ; ...

The design of general-purpose dynamic load-balancing tools for parallel applications is more challenging than the design of static partitioning tools. Both algorithmic and software engineering issues arise. The authors have addressed many of these issues in the design of the Zoltan dynamic load-balancing library. Zoltan has an object-oriented interface that makes it easy to use and provides separation between the application and the load-balancing algorithms. It contains a suite of dynamic load-balancing algorithms, including both geometric and graph-based algorithms. Its design makes it valuable both as a partitioning tool for a variety of applications and as a research test-bed formore »« less
Full Text Available
A Novel Coarsening Method for Scalable and Efficient Mesh Generation

Technical Report Yoo, A ; Hysom, D ; Gunney, B

In this paper, we propose a novel mesh coarsening method called brick coarsening method. The proposed method can be used in conjunction with any graph partitioners and scales to very large meshes. This method reduces problem space by decomposing the original mesh into fixed-size blocks of nodes called bricks, layered in a similar way to conventional brick laying, and then assigning each node of the original mesh to appropriate brick. Our experiments indicate that the proposed method scales to very large meshes while allowing simple RCB partitioner to produce higher-quality partitions with significantly less edge cuts. Our results further indicatemore »« less
DOI: 10.2172/1018444

Full Text Available
Automated Load Balancing Invocation Based on Application Characteristics

Conference Menon, Harshitha ; Jain, Nikhil ; Zheng, Gengbin ; ... - 2012 IEEE INTERNATIONAL CONFERENCE ON CLUSTER COMPUTING (CLUSTER)

Performance of applications executed on large parallel systems suffer due to load imbalance. Load balancing is required to scale such applications to large systems. However, performing load balancing incurs a cost which may not be known a priori. In addition, application characteristics may change due to its dynamic nature and the parallel system used for execution. As a result, deciding when to balance the load to obtain the best performance is challenging. Existing approaches put this burden on the users, who rely on educated guess and extrapolation techniques to decide on a reasonable load balancing period, which may not bemore »« less
DOI: 10.1109/CLUSTER.2012.61
Final Report on Data Locality Enhancement of Dynamic Simulations for Exascale Computing

Technical Report Shen, Xipeng

The development of modern processors exhibits two trends that complicate the optimizations of modern software. The first is the increasing sensitivity of processors' throughput to irregularities in computation. With more processors produced through a massive integration of simple cores, future systems will increasingly favor regular data-level parallel computations, but deviate from the needs of applications with complex patterns. Some evidences are already shown on Graphic Processing Units (GPU): Irregular data accesses (e.g., indirect references A[D[i]]) and conditional branches are limiting many GPU applications' performance at a level an order of magnitude lower than the peak of GPU. The second hardwaremore »« less
DOI: 10.2172/1576175

Full Text Available
Applying graph partitioning methods in measurement-based dynamic load balancing

Technical Report Bhatele, Abhinav ; Fourestier, Sebastien ; Menon, Harshitha ; ...

Load imbalance leads to an increasing waste of resources as an application is scaled to more and more processors. Achieving the best parallel efficiency for a program requires optimal load balancing which is a NP-hard problem. However, finding near-optimal solutions to this problem for complex computational science and engineering applications is becoming increasingly important. Charm++, a migratable objects based programming model, provides a measurement-based dynamic load balancing framework. This framework instruments and then migrates over-decomposed objects to balance computational load and communication at runtime. This paper explores the use of graph partitioning algorithms, traditionally used for partitioning physical domains/meshes, formore »« less
DOI: 10.2172/1114706

Full Text Available

Similar Records

This content will become publicly available on January 5, 2021

Title: Dynamic load balancing for a mesh‐based scientific application

Citation Formats

A load-balancing algorithm for a parallel electromagnetic particle-in-cell code journal, May 2003

Automated Load Balancing Invocation Based on Application Characteristics conference, September 2012

Hierarchical Load Balancing for Charm++ Applications on Large Supercomputers conference, September 2010

Architecture-independent locality-improving transformations of computational graphs embedded in k -dimensions conference, January 1995

Automatic data distribution and load balancing with space-filling curves: implementation in CONQUEST journal, June 2008

Load balancing n-body simulations with highly non-uniform density conference, January 2014

GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation journal, February 2008

Terascale spectral element algorithms and implementations conference, January 1999

POSTER: Automated Load Balancer Selection Based on Application Characteristics journal, January 2017

Dynamic Load Balancing for Unstructured Meshes on Space-Filling Curves conference, May 2012

Honey bee behavior inspired load balancing of tasks in cloud computing environments journal, May 2013

CMT-Bone — A Proxy Application for Compressible Multiphase Turbulent Flows conference, December 2016

Dynamic topology aware load balancing algorithms for molecular dynamics applications conference, January 2009

Dynamic Load Balancing for Compressible Multiphase Turbulence conference, January 2018

Quantifying load imbalance on virtualized enterprise servers conference, January 2010

A load index and load balancing algorithm for heterogeneous clusters journal, February 2013

Analysis of scalable data-privatization threading algorithms for hybrid MPI/OpenMP parallelization of molecular dynamics journal, April 2013

A Dynamic Load Balancing Framework for Real-time Applications in Message Passing Systems journal, May 2010

Software support for irregular and loosely synchronous problems journal, January 1992

Barycentric Lagrange Interpolation journal, January 2004

OhHelp: a scalable domain-decomposing dynamic load balancing for particle-in-cell simulations conference, January 2009

Total variation diminishing Runge-Kutta schemes journal, January 1998

Fast Parallel Direct Solvers for Coarse Grid Problems journal, February 2001

Dynamic Load Balancing for a 2D Concurrent Plasma PIC Code journal, December 1993

Highly scalable SFC-based dynamic load balancing and its application to atmospheric modeling journal, May 2018

Quantifying the effectiveness of load balance algorithms conference, January 2012

A genetic algorithm based autotuning approach for performance and energy optimization conference, December 2015

Towards energy-aware scheduling in data centers using machine learning conference, January 2010

Parallel Remapping of Adaptive Problems journal, May 1997

Fast and parallel mapping algorithms for irregular problems journal, January 1996

The Plasma Simulation Code: A modern particle-in-cell code with patch-based load-balancing journal, August 2016

Parallel construction of multidimensional binary search trees journal, January 2000

Energy efficiency of load balancing for data-parallel applications in heterogeneous systems journal, September 2016

A load-balancing algorithm for a parallel electromagnetic particle-in-cell code
journal, May 2003

Automated Load Balancing Invocation Based on Application Characteristics
conference, September 2012

Hierarchical Load Balancing for Charm++ Applications on Large Supercomputers
conference, September 2010

Architecture-independent locality-improving transformations of computational graphs embedded in k -dimensions
conference, January 1995

Automatic data distribution and load balancing with space-filling curves: implementation in CONQUEST
journal, June 2008

Load balancing n-body simulations with highly non-uniform density
conference, January 2014

GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation
journal, February 2008

Terascale spectral element algorithms and implementations
conference, January 1999

POSTER: Automated Load Balancer Selection Based on Application Characteristics
journal, January 2017

Dynamic Load Balancing for Unstructured Meshes on Space-Filling Curves
conference, May 2012

Honey bee behavior inspired load balancing of tasks in cloud computing environments
journal, May 2013

CMT-Bone — A Proxy Application for Compressible Multiphase Turbulent Flows
conference, December 2016

Dynamic topology aware load balancing algorithms for molecular dynamics applications
conference, January 2009

Dynamic Load Balancing for Compressible Multiphase Turbulence
conference, January 2018

Quantifying load imbalance on virtualized enterprise servers
conference, January 2010

A load index and load balancing algorithm for heterogeneous clusters
journal, February 2013

Analysis of scalable data-privatization threading algorithms for hybrid MPI/OpenMP parallelization of molecular dynamics
journal, April 2013

A Dynamic Load Balancing Framework for Real-time Applications in Message Passing Systems
journal, May 2010

Software support for irregular and loosely synchronous problems
journal, January 1992

Barycentric Lagrange Interpolation
journal, January 2004

OhHelp: a scalable domain-decomposing dynamic load balancing for particle-in-cell simulations
conference, January 2009

Total variation diminishing Runge-Kutta schemes
journal, January 1998

Fast Parallel Direct Solvers for Coarse Grid Problems
journal, February 2001

Dynamic Load Balancing for a 2D Concurrent Plasma PIC Code
journal, December 1993

Highly scalable SFC-based dynamic load balancing and its application to atmospheric modeling
journal, May 2018

Quantifying the effectiveness of load balance algorithms
conference, January 2012

A genetic algorithm based autotuning approach for performance and energy optimization
conference, December 2015

Towards energy-aware scheduling in data centers using machine learning
conference, January 2010

Parallel Remapping of Adaptive Problems
journal, May 1997

Fast and parallel mapping algorithms for irregular problems
journal, January 1996

The Plasma Simulation Code: A modern particle-in-cell code with patch-based load-balancing
journal, August 2016

Parallel construction of multidimensional binary search trees
journal, January 2000

Energy efficiency of load balancing for data-parallel applications in heterogeneous systems
journal, September 2016