Skip to main content
U.S. Department of Energy
Office of Scientific and Technical Information

In‐memory integration of existing software components for parallel adaptive unstructured mesh workflows

Journal Article · · Concurrency and Computation. Practice and Experience
DOI:https://doi.org/10.1002/cpe.4510· OSTI ID:1493389
 [1];  [1];  [1];  [2];  [1];  [3];  [1]
  1. SCOREC Rensselaer Polytechnic Institute Troy NY 12180 USA
  2. Sandia National Laboratories Albuquerque NM 87185 USA
  3. University of Colorado Boulder Boulder CO 80309 USA

Summary

Reliable mesh‐based simulations are needed to solve complex engineering problems. Mesh adaptivity can increase reliability by reducing discretization errors but requires multiple software components to exchange information. Often, components exchange information by reading and writing a common file format. This file‐based approach becomes a problem on massively parallel computers where filesystem bandwidth is a critical performance bottleneck. Our approach using data streams and component interfaces avoids the filesystem bottleneck. In this paper, we present these techniques and their use for coupling mesh adaptivity to the PHASTA computational fluid dynamics solver, the Albany multi‐physics framework, and the Omega3P linear accelerator frequency analysis applications. Performance results are reported on up to 16,384 cores of an Intel Knights Landing‐based system.

Sponsoring Organization:
USDOE
OSTI ID:
1493389
Journal Information:
Concurrency and Computation. Practice and Experience, Journal Name: Concurrency and Computation. Practice and Experience Journal Issue: 18 Vol. 30; ISSN 1532-0626
Publisher:
Wiley Blackwell (John Wiley & Sons)Copyright Statement
Country of Publication:
United Kingdom
Language:
English

References (49)

A stabilized finite element method for the incompressible Navier-Stokes equations using a hierarchical basis journal January 2001
The superconvergent patch recovery anda posteriori error estimates. Part 1: The recovery technique journal May 1992
Roofline Model Toolkit: A Practical Tool for Architectural and Program Analysis book January 2015
A comparison of techniques for geometry access related to mesh generation journal August 2004
Automatic p-version mesh generation for curved domains journal July 2004
Parallel anisotropic 3D mesh adaptation by mesh modification journal January 2006
ParFUM: a parallel framework for unstructured meshes for scalable dynamic physics applications journal September 2006
libMesh : a C++ library for parallel adaptive mesh refinement/coarsening simulations journal November 2006
Geometry based pre-processor for parallel fluid dynamic simulations using a hierarchical basis journal June 2007
Attribute Management System for Engineering Analysis journal November 2002
Cardiovascular flow simulation at extreme scale journal December 2009
DataSpaces: an interaction and coordination framework for coupled simulation workflows journal February 2011
Adaptive mesh refinement in strain localization problems journal September 1991
Geometry representation issues associated with p-version finite element computations journal December 1997
Error estimation and adaptive meshing in strongly nonlinear dynamic problems journal April 1999
Parallel adaptive simulation of a plunging liquid jet journal March 2010
Anisotropic mesh adaptation for CFD computations journal November 2005
Conservative interpolation between volume meshes by local Galerkin projection journal January 2011
A parallel adaptive mesh method for the numerical simulation of multiphase flows journal October 2013
Zoltan data management services for parallel dynamic applications journal January 2002
Enabling In-situ Execution of Coupled Scientific Workflow on Multi-core Platform
  • Zhang, Fan; Docan, Ciprian; Parashar, Manish
  • 2012 IEEE International Symposium on Parallel & Distributed Processing (IPDPS), 2012 IEEE 26th International Parallel and Distributed Processing Symposium https://doi.org/10.1109/IPDPS.2012.122
conference May 2012
Scalable Implicit Flow Solver for Realistic Wing Simulations with Flow Control journal November 2014
Run-Time Extensibility and Librarization of Simulation Software journal January 2015
The IBM Blue Gene/Q Compute Chip journal March 2012
Knights Landing: Second-Generation Intel Xeon Phi Product journal March 2016
Scalable Parallel I/O on a Blue Gene/Q Supercomputer Using Compression, Topology-Aware Data Aggregation, and Subfiling
  • Bui, Huy; Finkel, Hal; Vishwanath, Venkatram
  • 2014 22nd Euromicro International Conference on Parallel, Distributed and Network-Based Processing (PDP), 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing https://doi.org/10.1109/PDP.2014.60
conference February 2014
Early evaluation of IBM BlueGene/P conference November 2008
Combining in-situ and in-transit processing to enable extreme-scale scientific analysis
  • Bennett, Janine C.; Abbasi, Hasan; Bremer, Peer-Timo
  • 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.31
conference November 2012
MCREngine: A scalable checkpointing system using data-aware aggregation and compression
  • Islam, Tanzima Zerin; Mohror, Kathryn; Bagchi, Saurabh
  • 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis https://doi.org/10.1109/SC.2012.77
conference November 2012
A new set of H(curl)-conforming hierarchical basis functions for tetrahedral meshes journal January 2006
A Complexity Measure journal December 1976
p4est : Scalable Algorithms for Parallel Adaptive Mesh Refinement on Forests of Octrees journal January 2011
Improving Unstructured Mesh Partitions for Multiple Criteria Using Mesh Adjacencies journal January 2018
Modifiable Array Data Structures for Mesh Topology journal January 2017
An overview of the Trilinos project journal September 2005
I/O performance challenges at leadership scale conference January 2009
Scalable implicit finite element solver for massively parallel processing with demonstration to 160K cores conference January 2009
An Interoperable, Data-Structure-Neutral Component for Mesh Query and Manipulation journal September 2010
Topology-aware data movement and staging for I/O acceleration on Blue Gene/P supercomputing systems
  • Vishwanath, Venkatram; Hereld, Mark; Morozov, Vitali
  • Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11 https://doi.org/10.1145/2063384.2063409
conference January 2011
Electronic poster: co-visualization of full data and in situ data extracts from unstructured grid cfd at 160k cores
  • Rasquin, Michel; Sahni, Onkar; Fu, Jing
  • Proceedings of the 2011 companion on High Performance Computing Networking, Storage and Analysis Companion - SC '11 Companion https://doi.org/10.1145/2148600.2148653
conference January 2011
Fault tolerance for remote memory access programming models conference January 2014
Adaptive data placement for staging-based coupled scientific workflows
  • Sun, Qian; Parashar, Manish; Jin, Tong
  • Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '15 https://doi.org/10.1145/2807591.2807669
conference January 2015
PUMI: Parallel Unstructured Mesh Infrastructure journal May 2016
In-memory Integration of Existing Software Components for Parallel Adaptive Unstructured Mesh Workflows conference January 2016
Achieving high sustained performance in an unstructured mesh CFD application conference January 1999
The International Exascale Software Project roadmap journal January 2011
Albany: Using Component-Based Design to Develop a Flexible, Generic Multiphysics Analysis code journal January 2016
Parallel Anisotropic Tetrahedral Adaptation conference June 2012
Application of the Helios Computational Platform to Rotorcraft Flowfields
  • Sitaraman, Jayanarayanan; Wissink, Andrew; Sankaran, Venketeswaran
  • 48th AIAA Aerospace Sciences Meeting Including the New Horizons Forum and Aerospace Exposition https://doi.org/10.2514/6.2010-1230
conference June 2012

Similar Records

In-memory integration of existing software components for parallel adaptive unstructured mesh workflows
Journal Article · Sat Dec 31 23:00:00 EST 2016 · Currency and Computation (Online) · OSTI ID:1358582

Parallel algorithms for the adaptive refinement and partitioning of unstructured meshes
Conference · Wed Jun 01 00:00:00 EDT 1994 · OSTI ID:10161928

Standard and goal-oriented adaptive mesh refinement applied to radiation transport on 2D unstructured triangular meshes
Journal Article · Mon Jan 31 23:00:00 EST 2011 · Journal of Computational Physics · OSTI ID:1011140

Related Subjects