DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers

Abstract

Concurrently coupled numerical simulations using heterogeneous solvers are powerful tools for modeling multiscale phenomena. However, major modifications to existing codes are often required to enable such simulations, posing significant difficulties in practice. In this paper we present a C++ library, i.e. the Multiscale Universal Interface (MUI), which is capable of facilitating the coupling effort for a wide range of multiscale simulations. The library adopts a header-only form with minimal external dependency and hence can be easily dropped into existing codes. A data sampler concept is introduced, combined with a hybrid dynamic/static typing mechanism, to create an easily customizable framework for solver-independent data interpretation. The library integrates MPI MPMD support and an asynchronous communication protocol to handle inter-solver information exchange irrespective of the solvers' own MPI awareness. Template metaprogramming is heavily employed to simultaneously improve runtime performance and code flexibility. We validated the library by solving three different multiscale problems, which also serve to demonstrate the flexibility of the framework in handling heterogeneous models and solvers. In the first example, a Couette flow was simulated using two concurrently coupled Smoothed Particle Hydrodynamics (SPH) simulations of different spatial resolutions. In the second example, we coupled the deterministic SPH method with the stochasticmore » Dissipative Particle Dynamics (DPD) method to study the effect of surface grafting on the hydrodynamics properties on the surface. Finally, in the third example, we consider conjugate heat transfer between a solid domain and a fluid domain by coupling the particle-based energy-conserving DPD (eDPD) method with the Finite Element Method (FEM).« less

Authors:
ORCiD logo [1];  [2]; ORCiD logo [1]; ORCiD logo [1];  [3]
  1. Brown Univ., Providence, RI (United States). Division of Applied Mathematics
  2. Kobe Univ., Kobe (Japan). Graduate School of System Informatics
  3. Brown Univ., Providence, RI (United States). Division of Applied Mathematics; Pacific Northwest National Lab., Richland, WA (United States). Collaboratory on Mathematics for Mesoscopic Modeling of Materials
Publication Date:
Research Org.:
Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
Sponsoring Org.:
USDOE Office of Science (SC)
OSTI Identifier:
1565300
Alternate Identifier(s):
OSTI ID: 1249987
Grant/Contract Number:  
FA9550-12-1-0463
Resource Type:
Accepted Manuscript
Journal Name:
Journal of Computational Physics
Additional Journal Information:
Journal Volume: 297; Journal Issue: C; Journal ID: ISSN 0021-9991
Publisher:
Elsevier
Country of Publication:
United States
Language:
English
Subject:
97 MATHEMATICS AND COMPUTING; computer science; physics; multiscale modeling; concurrent coupling; multiphysics simulation; energy-conserving DPD; SPH; FEM; programming framework

Citation Formats

Tang, Yu-Hang, Kudo, Shuhei, Bian, Xin, Li, Zhen, and Karniadakis, George Em. Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers. United States: N. p., 2015. Web. doi:10.1016/j.jcp.2015.05.004.
Tang, Yu-Hang, Kudo, Shuhei, Bian, Xin, Li, Zhen, & Karniadakis, George Em. Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers. United States. https://doi.org/10.1016/j.jcp.2015.05.004
Tang, Yu-Hang, Kudo, Shuhei, Bian, Xin, Li, Zhen, and Karniadakis, George Em. Tue . "Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers". United States. https://doi.org/10.1016/j.jcp.2015.05.004. https://www.osti.gov/servlets/purl/1565300.
@article{osti_1565300,
title = {Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers},
author = {Tang, Yu-Hang and Kudo, Shuhei and Bian, Xin and Li, Zhen and Karniadakis, George Em},
abstractNote = {Concurrently coupled numerical simulations using heterogeneous solvers are powerful tools for modeling multiscale phenomena. However, major modifications to existing codes are often required to enable such simulations, posing significant difficulties in practice. In this paper we present a C++ library, i.e. the Multiscale Universal Interface (MUI), which is capable of facilitating the coupling effort for a wide range of multiscale simulations. The library adopts a header-only form with minimal external dependency and hence can be easily dropped into existing codes. A data sampler concept is introduced, combined with a hybrid dynamic/static typing mechanism, to create an easily customizable framework for solver-independent data interpretation. The library integrates MPI MPMD support and an asynchronous communication protocol to handle inter-solver information exchange irrespective of the solvers' own MPI awareness. Template metaprogramming is heavily employed to simultaneously improve runtime performance and code flexibility. We validated the library by solving three different multiscale problems, which also serve to demonstrate the flexibility of the framework in handling heterogeneous models and solvers. In the first example, a Couette flow was simulated using two concurrently coupled Smoothed Particle Hydrodynamics (SPH) simulations of different spatial resolutions. In the second example, we coupled the deterministic SPH method with the stochastic Dissipative Particle Dynamics (DPD) method to study the effect of surface grafting on the hydrodynamics properties on the surface. Finally, in the third example, we consider conjugate heat transfer between a solid domain and a fluid domain by coupling the particle-based energy-conserving DPD (eDPD) method with the Finite Element Method (FEM).},
doi = {10.1016/j.jcp.2015.05.004},
journal = {Journal of Computational Physics},
number = C,
volume = 297,
place = {United States},
year = {Tue Sep 15 00:00:00 EDT 2015},
month = {Tue Sep 15 00:00:00 EDT 2015}
}

Journal Article:

Citation Metrics:
Cited by: 50 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Multiscale Simulation of Soft Matter: From Scale Bridging to Adaptive Resolution
journal, May 2008


A review of the development of hybrid atomistic–continuum methods for dense fluids
journal, November 2009


Iterative Methods by Space Decomposition and Subspace Correction
journal, December 1992


Multiscale simulation of water flow past a C540 fullerene
journal, April 2012

  • Walther, Jens H.; Praprotnik, Matej; Kotsalis, Evangelos M.
  • Journal of Computational Physics, Vol. 231, Issue 7
  • DOI: 10.1016/j.jcp.2011.12.015

A particle-based multiscale simulation procedure within the material point method framework
journal, April 2014


Concurrent triple-scale simulation of molecular liquids
journal, March 2008

  • Delgado-Buscalioni, Rafael; Kremer, Kurt; Praprotnik, Matej
  • The Journal of Chemical Physics, Vol. 128, Issue 11
  • DOI: 10.1063/1.2890729

Multiscale simulation of non-isothermal microchannel gas flows
journal, August 2014


The CCA core specification in a distributed memory SPMD framework
journal, January 2002

  • Allan, Benjamin A.; Armstrong, Robert C.; Wolfe, Alicia P.
  • Concurrency and Computation: Practice and Experience, Vol. 14, Issue 5
  • DOI: 10.1002/cpe.651

A component-based architecture for parallel multi-physics PDE simulation
journal, January 2006


Accelerating dissipative particle dynamics simulations on GPUs: Algorithms, numerics and applications
journal, November 2014


Energy-conserving dissipative particle dynamics with temperature-dependent properties
journal, May 2014


Simulating Microscopic Hydrodynamic Phenomena with Dissipative Particle Dynamics
journal, June 1992


Statistical Mechanics of Dissipative Particle Dynamics
journal, May 1995


Effect of crystal preferred orientations on the thermal diffusivity of quartz polycrystalline aggregates at high temperature
journal, February 2009


A Common Component Architecture (CCA) based design and implementation for distributed parallel magnetotellurice forward model
conference, November 2013

  • Li, Shanshan; Mulunga, Paulus T.; Yang, Qiuge
  • 2013 6th International Conference on Information Management, Innovation Management and Industrial Engineering (ICIII)
  • DOI: 10.1109/ICIII.2013.6703612

Migration of a generic multi-physics framework to HPC environments
journal, July 2013


PPM – A highly efficient parallel particle–mesh library for the simulation of continuum systems
journal, July 2006

  • Sbalzarini, I. F.; Walther, J. H.; Bergdorf, M.
  • Journal of Computational Physics, Vol. 215, Issue 2
  • DOI: 10.1016/j.jcp.2005.11.017

Triple-decker: Interfacing atomistic–mesoscopic–continuum flow regimes
journal, March 2009

  • Fedosov, Dmitry A.; Karniadakis, George Em
  • Journal of Computational Physics, Vol. 228, Issue 4
  • DOI: 10.1016/j.jcp.2008.10.024

Hybrid molecular–continuum methods: From prototypes to coupling software
journal, February 2014

  • Neumann, Philipp; Eckhardt, Wolfgang; Bungartz, Hans-Joachim
  • Computers & Mathematics with Applications, Vol. 67, Issue 2
  • DOI: 10.1016/j.camwa.2013.07.006

A new computational paradigm in multiscale simulations: application to brain blood flow
conference, January 2011

  • Grinberg, Leopold; Insley, Joseph A.; Morozov, Vitali
  • Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11
  • DOI: 10.1145/2063384.2063390

MUPHY: A parallel MUlti PHYsics/scale code for high performance bio-fluidic simulations
journal, September 2009


A multiphysics and multiscale software environment for modeling astrophysical systems
journal, May 2009


Multi-physics simulations using a hierarchical interchangeable software interface
journal, March 2013

  • Portegies Zwart, Simon F.; McMillan, Stephen L. W.; van Elteren, Arjen
  • Computer Physics Communications, Vol. 184, Issue 3
  • DOI: 10.1016/j.cpc.2012.09.024

VMD: Visual molecular dynamics
journal, February 1996


ODEPACK++: refactoring the LSODE fortran library for use in the CCA high performance component software architecture
conference, May 2004

  • Allan, B. A.; Lefantzi, S.; Ray, J.
  • Ninth International Workshop on High-Level Parallel Programming Models and Supportive Environments, 2004. Proceedings.
  • DOI: 10.1109/hips.2004.1299196

Works referencing / citing this record:

Toward a Predictive Hierarchical Multiscale Modeling Approach for Energetic Materials
book, February 2019

  • Barnes, Brian C.; Brennan, John K.; Byrd, Edward F. C.
  • Computational Approaches for Chemistry Under Extreme Conditions
  • DOI: 10.1007/978-3-030-05600-1_10

Perspective: Dissipative particle dynamics
journal, April 2017

  • Español, Pep; Warren, Patrick B.
  • The Journal of Chemical Physics, Vol. 146, Issue 15
  • DOI: 10.1063/1.4979514

Everything you always wanted to know about SDPD⋆ (⋆but were afraid to ask)
journal, December 2017


Fluctuating hydrodynamics in periodic domains and heterogeneous adjacent multidomains: Thermal equilibrium
journal, November 2015


Analysis of hydrodynamic fluctuations in heterogeneous adjacent multidomains in shear flow
journal, March 2016


Mastering the scales: a survey on the benefits of multiscale computing software
journal, February 2019

  • Groen, Derek; Knap, Jaroslaw; Neumann, Philipp
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 377, Issue 2142
  • DOI: 10.1098/rsta.2018.0147

MaMiCo: Parallel Noise Reduction for Multi-instance Molecular-Continuum Flow Simulation
book, June 2019

  • Jarmatz, Piet; Neumann, Philipp; Rodrigues, João M. F.
  • Computational Science – ICCS 2019: 19th International Conference, Faro, Portugal, June 12–14, 2019, Proceedings, Part IV, p. 451-464
  • DOI: 10.1007/978-3-030-22747-0_34

Computing the non-Markovian coarse-grained interactions derived from the Mori–Zwanzig formalism in molecular systems: Application to polymer melts
journal, January 2017

  • Li, Zhen; Lee, Hee Sun; Darve, Eric
  • The Journal of Chemical Physics, Vol. 146, Issue 1
  • DOI: 10.1063/1.4973347

Perspective: Dissipative Particle Dynamics
text, January 2016


preCICE v2: A Sustainable and User-Friendly Coupling Library
text, January 2021


Mastering the scales: a survey on the benefits of multiscale computing software
journal, February 2019

  • Groen, Derek; Knap, Jaroslaw; Neumann, Philipp
  • Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 377, Issue 2142
  • DOI: 10.1098/rsta.2018.0147