Dynamic load balancing for a mesh‐based scientific application

doi:10.1002/cpe.5626

Title: Dynamic load balancing for a mesh‐based scientific application

Authors:

^[1]; Banerjee, Tania ^[1]; Zwick, David ^[2]; Hackl, Jason ^[2]; Koneru, Rahul ^[2]; Ranka, Sanjay ^[1]

Department of Computer &, Information Science &, EngineeringUniversity of Florida Gainesville Florida
Department of Mechanical &, Aerospace EngineeringUniversity of Florida Gainesville Florida

Publication Date:: 2020-05-10

Sponsoring Org.:: USDOE National Nuclear Security Administration (NNSA)

OSTI Identifier:: 1581451

Resource Type:: Publisher's Accepted Manuscript

Journal Name:: Concurrency and Computation. Practice and Experience

Additional Journal Information:: Journal Name: Concurrency and Computation. Practice and Experience Journal Volume: 32 Journal Issue: 9; Journal ID: ISSN 1532-0626

Publisher:: Wiley Blackwell (John Wiley & Sons)

Country of Publication:: United Kingdom

Language:: English

Citation Formats


                    Zhai, Keke, Banerjee, Tania, Zwick, David, Hackl, Jason, Koneru, Rahul, and Ranka, Sanjay. Dynamic load balancing for a mesh‐based scientific application.  United Kingdom: N. p., 2020. 
        Web.  doi:10.1002/cpe.5626.

Copy to clipboard


                    Zhai, Keke, Banerjee, Tania, Zwick, David, Hackl, Jason, Koneru, Rahul, & Ranka, Sanjay. Dynamic load balancing for a mesh‐based scientific application.  United Kingdom.  doi:10.1002/cpe.5626.

Copy to clipboard


                    Zhai, Keke, Banerjee, Tania, Zwick, David, Hackl, Jason, Koneru, Rahul, and Ranka, Sanjay. Sun .  
        "Dynamic load balancing for a mesh‐based scientific application".  United Kingdom.  doi:10.1002/cpe.5626.

Copy to clipboard


                    
@article{osti_1581451,

  title        = {Dynamic load balancing for a mesh‐based scientific application},

  author       = {Zhai, Keke and Banerjee, Tania and Zwick, David and Hackl, Jason and Koneru, Rahul and Ranka, Sanjay},

  abstractNote = {},

  doi          = {10.1002/cpe.5626},

  journal      = {Concurrency and Computation. Practice and Experience},

  number       = 9,

  volume       = 32,

  place        = {United Kingdom},

  year         = {2020},

  month        = {5}

}

Copy to clipboard

Journal Article:

Free Publicly Available Full Text

Accepted Manuscript (Publisher)

Publisher's Version of Record
DOI: 10.1002/cpe.5626

Other availability

Search WorldCat to find libraries that may hold this journal

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

A load-balancing algorithm for a parallel electromagnetic particle-in-cell code
journal, May 2003

Plimpton, Steven J.; Seidel, David B.; Pasik, Michael F.
Computer Physics Communications, Vol. 152, Issue 3
DOI: 10.1016/S0010-4655(02)00795-6

Automated Load Balancing Invocation Based on Application Characteristics
conference, September 2012

Menon, Harshitha; Jain, Nikhil; Zheng, Gengbin
2012 IEEE International Conference on Cluster Computing (CLUSTER)
DOI: 10.1109/CLUSTER.2012.61

Hierarchical Load Balancing for Charm++ Applications on Large Supercomputers
conference, September 2010

Zheng, Gengbin; Meneses, Esteban; Bhatele, Abhinav
2010 International Conference on Parallel Processing Workshops (ICPPW), 2010 39th International Conference on Parallel Processing Workshops
DOI: 10.1109/ICPPW.2010.65

Architecture-independent locality-improving transformations of computational graphs embedded in k -dimensions
conference, January 1995

Ou, Chao-Wei; Gunwani, Manoj; Ranka, Sanjay
Proceedings of the 9th international conference on Supercomputing - ICS '95
DOI: 10.1145/224538.224573

Automatic data distribution and load balancing with space-filling curves: implementation in CONQUEST
journal, June 2008

Brázdová, V.; Bowler, D. R.
Journal of Physics: Condensed Matter, Vol. 20, Issue 27
DOI: 10.1088/0953-8984/20/27/275223

Load balancing n-body simulations with highly non-uniform density
conference, January 2014

Pearce, Olga; Gamblin, Todd; de Supinski, Bronis R.
Proceedings of the 28th ACM international conference on Supercomputing - ICS '14
DOI: 10.1145/2597652.2597659

GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation
journal, February 2008

Hess, Berk; Kutzner, Carsten; van der Spoel, David
Journal of Chemical Theory and Computation, Vol. 4, Issue 3
DOI: 10.1021/ct700301q

Terascale spectral element algorithms and implementations
conference, January 1999

Tufo, H. M.; Fischer, P. F.
Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM) - Supercomputing '99
DOI: 10.1145/331532.331599

POSTER: Automated Load Balancer Selection Based on Application Characteristics
journal, January 2017

Menon, Harshitha; Chandrasekar, Kavitha; Kale, Laxmikant V.
ACM SIGPLAN Notices, Vol. 52, Issue 8
DOI: 10.1145/3155284.3019033

Dynamic Load Balancing for Unstructured Meshes on Space-Filling Curves
conference, May 2012

Harlacher, Daniel F.; Klimach, Harald; Roller, Sabine
2012 26th IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops & PhD Forum
DOI: 10.1109/IPDPSW.2012.207

Honey bee behavior inspired load balancing of tasks in cloud computing environments
journal, May 2013

L. D., Dhinesh Babu; Venkata Krishna, P.
Applied Soft Computing, Vol. 13, Issue 5
DOI: 10.1016/j.asoc.2013.01.025

CMT-Bone — A Proxy Application for Compressible Multiphase Turbulent Flows
conference, December 2016

Banerjee, Tania; Hackl, Jason; Shringarpure, Mrugesh
2016 IEEE 23rd International Conference on High Performance Computing (HiPC)
DOI: 10.1109/HiPC.2016.029

Dynamic topology aware load balancing algorithms for molecular dynamics applications
conference, January 2009

Bhatelé, Abhinav; Kalé, Laxmikant V.; Kumar, Sameer
Proceedings of the 23rd international conference on Conference on Supercomputing - ICS '09
DOI: 10.1145/1542275.1542295

Dynamic Load Balancing for Compressible Multiphase Turbulence
conference, January 2018

Zhai, Keke; Banerjee, Tania; Zwick, David
Proceedings of the 2018 International Conference on Supercomputing - ICS '18
DOI: 10.1145/3205289.3205304

Quantifying load imbalance on virtualized enterprise servers
conference, January 2010

Arzuaga, Emmanuel; Kaeli, David R.
Proceedings of the first joint WOSP/SIPEW international conference on Performance engineering - WOSP/SIPEW '10
DOI: 10.1145/1712605.1712641

A load index and load balancing algorithm for heterogeneous clusters
journal, February 2013

Bosque, Jose Luis; Toharia, Pablo; Robles, Oscar D.
The Journal of Supercomputing, Vol. 65, Issue 3
DOI: 10.1007/s11227-013-0881-3

Analysis of scalable data-privatization threading algorithms for hybrid MPI/OpenMP parallelization of molecular dynamics
journal, April 2013

Kunaseth, Manaschai; Richards, David F.; Glosli, James N.
The Journal of Supercomputing, Vol. 66, Issue 1
DOI: 10.1007/s11227-013-0915-x

A Dynamic Load Balancing Framework for Real-time Applications in Message Passing Systems
journal, May 2010

El Kabbany, Ghada F.; Wanas, Nayer M.; Hegazi, Nadia H.
International Journal of Parallel Programming, Vol. 39, Issue 2
DOI: 10.1007/s10766-010-0134-5

Software support for irregular and loosely synchronous problems
journal, January 1992

Choudhary, A.; Fox, G.; Hiranandani, S.
Computing Systems in Engineering, Vol. 3, Issue 1-4
DOI: 10.1016/0956-0521(92)90093-X

Barycentric Lagrange Interpolation
journal, January 2004

Berrut, Jean-Paul; Trefethen, Lloyd N.
SIAM Review, Vol. 46, Issue 3
DOI: 10.1137/S0036144502417715

OhHelp: a scalable domain-decomposing dynamic load balancing for particle-in-cell simulations
conference, January 2009

Nakashima, Hiroshi; Miyake, Yohei; Usui, Hideyuki
Proceedings of the 23rd international conference on Conference on Supercomputing - ICS '09
DOI: 10.1145/1542275.1542293

Total variation diminishing Runge-Kutta schemes
journal, January 1998

Gottlieb, Sigal; Shu, Chi-Wang
Mathematics of Computation of the American Mathematical Society, Vol. 67, Issue 221
DOI: 10.1090/S0025-5718-98-00913-2

Fast Parallel Direct Solvers for Coarse Grid Problems
journal, February 2001

Tufo, H. M.; Fischer, P. F.
Journal of Parallel and Distributed Computing, Vol. 61, Issue 2
DOI: 10.1006/jpdc.2000.1676

Dynamic Load Balancing for a 2D Concurrent Plasma PIC Code
journal, December 1993

Ferraro, Robert D.; Liewer, Paulett C.; Decyk, Viktor K.
Journal of Computational Physics, Vol. 109, Issue 2
DOI: 10.1006/jcph.1993.1221

Highly scalable SFC-based dynamic load balancing and its application to atmospheric modeling
journal, May 2018

Lieber, Matthias; Nagel, Wolfgang E.
Future Generation Computer Systems, Vol. 82
DOI: 10.1016/j.future.2017.04.042

Quantifying the effectiveness of load balance algorithms
conference, January 2012

Pearce, Olga; Gamblin, Todd; de Supinski, Bronis R.
Proceedings of the 26th ACM international conference on Supercomputing - ICS '12
DOI: 10.1145/2304576.2304601

A genetic algorithm based autotuning approach for performance and energy optimization
conference, December 2015

Banerjee, Tania; Ranka, Sanjay
2015 Sixth International Green and Sustainable Computing Conference (IGSC)
DOI: 10.1109/IGCC.2015.7393708

Towards energy-aware scheduling in data centers using machine learning
conference, January 2010

Berral, Josep Ll.; Goiri, Íñigo; Nou, Ramón
Proceedings of the 1st International Conference on Energy-Efficient Computing and Networking - e-Energy '10
DOI: 10.1145/1791314.1791349

Parallel Remapping of Adaptive Problems
journal, May 1997

Ou, Chao-Wei; Ranka, Sanjay
Journal of Parallel and Distributed Computing, Vol. 42, Issue 2
DOI: 10.1006/jpdc.1997.1314

Fast and parallel mapping algorithms for irregular problems
journal, January 1996

Ou, Chao-Wei; Ranka, Sanjay; Fox, Geoffrey
The Journal of Supercomputing, Vol. 10, Issue 2
DOI: 10.1007/BF00130706

The Plasma Simulation Code: A modern particle-in-cell code with patch-based load-balancing
journal, August 2016

Germaschewski, Kai; Fox, William; Abbott, Stephen
Journal of Computational Physics, Vol. 318
DOI: 10.1016/j.jcp.2016.05.013

Parallel construction of multidimensional binary search trees
journal, January 2000

Al-Furajh, I.; Aluru, S.; Goil, S.
IEEE Transactions on Parallel and Distributed Systems, Vol. 11, Issue 2
DOI: 10.1109/71.841750

Energy efficiency of load balancing for data-parallel applications in heterogeneous systems
journal, September 2016

Pérez, Borja; Stafford, Esteban; Bosque, José Luis
The Journal of Supercomputing, Vol. 73, Issue 1
DOI: 10.1007/s11227-016-1864-y

Similar Records in DOE PAGES and OSTI.GOV collections:

Parallel tetrahedral mesh adaptation with dynamic load balancing

Journal Article Oliker, Leonid ; Biswas, Rupak ; Gabow, Harold N - Parallel Computing Journal

The ability to dynamically adapt an unstructured grid is a powerful tool for efficiently solving computational problems with evolving physical features. In this paper, we report on our experience parallelizing an edge-based adaptation scheme, called 3D-TAG, using message passing. Results show excellent speedup when a realistic helicopter rotor mesh is randomly refined. However, performance deteriorates when the mesh is refined using a solution-based error indicator since mesh adaptation for practical problems occurs in a localized region, creating a severe load imbalance. To address this problem, we have developed PLUM, a global dynamic load balancing framework for adaptive numerical computations. Evenmore »« less
DOI: 10.1016/S0167-8191(00)00047-8
Evaluating Production Load Balancing Functions for Adaptive Mesh Schemes using Mini-Applications.

Conference Vaughan, Courtenay T. ; Hammond, Simon David

Abstract not provided.
Full Text Available
Dynamic Load Balancing for Adaptive Scientific Computations via Hypergraph Partitioning.

Conference Boman, Erik G. ; Devine, Karen Dragon ; Heaphy, Robert Thomas ; ...

Abstract not provided.
Full Text Available
Load Balancing Scientific Applications

Thesis/Dissertation Pearce, Olga Tkachyshyn

The largest supercomputers have millions of independent processors, and concurrency levels are rapidly increasing. For ideal efficiency, developers of the simulations that run on these machines must ensure that computational work is evenly balanced among processors. Assigning work evenly is challenging because many large modern parallel codes simulate behavior of physical systems that evolve over time, and their workloads change over time. Furthermore, the cost of imbalanced load increases with scale because most large-scale scientific simulations today use a Single Program Multiple Data (SPMD) parallel programming model, and an increasing number of processors will wait for the slowest one atmore »« less
DOI: 10.2172/1178404

Full Text Available
Dynamic load balancing algorithm for molecular dynamics based on Voronoi cells domain decompositions

Journal Article Fattebert, J.-L. ; Richards, D.F. ; Glosli, J.N. - Computer Physics Communications

We present a new algorithm for automatic parallel load balancing in classical molecular dynamics. It assumes a spatial domain decomposition of particles into Voronoi cells. It is a gradient method which attempts to minimize a cost function by displacing Voronoi sites associated with each processor/sub-domain along steepest descent directions. Excellent load balance has been obtained for quasi-2D and 3D practical applications, with up to 440·10⁶ particles on 65,536 MPI tasks.
DOI: 10.1016/j.cpc.2012.07.013

Full Text Available

Similar Records

Title: Dynamic load balancing for a mesh‐based scientific application

Citation Formats

A load-balancing algorithm for a parallel electromagnetic particle-in-cell code journal, May 2003

Automated Load Balancing Invocation Based on Application Characteristics conference, September 2012

Hierarchical Load Balancing for Charm++ Applications on Large Supercomputers conference, September 2010

Architecture-independent locality-improving transformations of computational graphs embedded in k -dimensions conference, January 1995

Automatic data distribution and load balancing with space-filling curves: implementation in CONQUEST journal, June 2008

Load balancing n-body simulations with highly non-uniform density conference, January 2014

GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation journal, February 2008

Terascale spectral element algorithms and implementations conference, January 1999

POSTER: Automated Load Balancer Selection Based on Application Characteristics journal, January 2017

Dynamic Load Balancing for Unstructured Meshes on Space-Filling Curves conference, May 2012

Honey bee behavior inspired load balancing of tasks in cloud computing environments journal, May 2013

CMT-Bone — A Proxy Application for Compressible Multiphase Turbulent Flows conference, December 2016

Dynamic topology aware load balancing algorithms for molecular dynamics applications conference, January 2009

Dynamic Load Balancing for Compressible Multiphase Turbulence conference, January 2018

Quantifying load imbalance on virtualized enterprise servers conference, January 2010

A load index and load balancing algorithm for heterogeneous clusters journal, February 2013

Analysis of scalable data-privatization threading algorithms for hybrid MPI/OpenMP parallelization of molecular dynamics journal, April 2013

A Dynamic Load Balancing Framework for Real-time Applications in Message Passing Systems journal, May 2010

Software support for irregular and loosely synchronous problems journal, January 1992

Barycentric Lagrange Interpolation journal, January 2004

OhHelp: a scalable domain-decomposing dynamic load balancing for particle-in-cell simulations conference, January 2009

Total variation diminishing Runge-Kutta schemes journal, January 1998

Fast Parallel Direct Solvers for Coarse Grid Problems journal, February 2001

Dynamic Load Balancing for a 2D Concurrent Plasma PIC Code journal, December 1993

Highly scalable SFC-based dynamic load balancing and its application to atmospheric modeling journal, May 2018

Quantifying the effectiveness of load balance algorithms conference, January 2012

A genetic algorithm based autotuning approach for performance and energy optimization conference, December 2015

Towards energy-aware scheduling in data centers using machine learning conference, January 2010

Parallel Remapping of Adaptive Problems journal, May 1997

Fast and parallel mapping algorithms for irregular problems journal, January 1996

The Plasma Simulation Code: A modern particle-in-cell code with patch-based load-balancing journal, August 2016

Parallel construction of multidimensional binary search trees journal, January 2000

Energy efficiency of load balancing for data-parallel applications in heterogeneous systems journal, September 2016

A load-balancing algorithm for a parallel electromagnetic particle-in-cell code
journal, May 2003

Automated Load Balancing Invocation Based on Application Characteristics
conference, September 2012

Hierarchical Load Balancing for Charm++ Applications on Large Supercomputers
conference, September 2010

Architecture-independent locality-improving transformations of computational graphs embedded in k -dimensions
conference, January 1995

Automatic data distribution and load balancing with space-filling curves: implementation in CONQUEST
journal, June 2008

Load balancing n-body simulations with highly non-uniform density
conference, January 2014

GROMACS 4: Algorithms for Highly Efficient, Load-Balanced, and Scalable Molecular Simulation
journal, February 2008

Terascale spectral element algorithms and implementations
conference, January 1999

POSTER: Automated Load Balancer Selection Based on Application Characteristics
journal, January 2017

Dynamic Load Balancing for Unstructured Meshes on Space-Filling Curves
conference, May 2012

Honey bee behavior inspired load balancing of tasks in cloud computing environments
journal, May 2013

CMT-Bone — A Proxy Application for Compressible Multiphase Turbulent Flows
conference, December 2016

Dynamic topology aware load balancing algorithms for molecular dynamics applications
conference, January 2009

Dynamic Load Balancing for Compressible Multiphase Turbulence
conference, January 2018

Quantifying load imbalance on virtualized enterprise servers
conference, January 2010

A load index and load balancing algorithm for heterogeneous clusters
journal, February 2013

Analysis of scalable data-privatization threading algorithms for hybrid MPI/OpenMP parallelization of molecular dynamics
journal, April 2013

A Dynamic Load Balancing Framework for Real-time Applications in Message Passing Systems
journal, May 2010

Software support for irregular and loosely synchronous problems
journal, January 1992

Barycentric Lagrange Interpolation
journal, January 2004

OhHelp: a scalable domain-decomposing dynamic load balancing for particle-in-cell simulations
conference, January 2009

Total variation diminishing Runge-Kutta schemes
journal, January 1998

Fast Parallel Direct Solvers for Coarse Grid Problems
journal, February 2001

Dynamic Load Balancing for a 2D Concurrent Plasma PIC Code
journal, December 1993

Highly scalable SFC-based dynamic load balancing and its application to atmospheric modeling
journal, May 2018

Quantifying the effectiveness of load balance algorithms
conference, January 2012

A genetic algorithm based autotuning approach for performance and energy optimization
conference, December 2015

Towards energy-aware scheduling in data centers using machine learning
conference, January 2010

Parallel Remapping of Adaptive Problems
journal, May 1997

Fast and parallel mapping algorithms for irregular problems
journal, January 1996

The Plasma Simulation Code: A modern particle-in-cell code with patch-based load-balancing
journal, August 2016

Parallel construction of multidimensional binary search trees
journal, January 2000

Energy efficiency of load balancing for data-parallel applications in heterogeneous systems
journal, September 2016