Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers
Abstract
Concurrently coupled numerical simulations using heterogeneous solvers are powerful tools for modeling multiscale phenomena. However, major modifications to existing codes are often required to enable such simulations, posing significant difficulties in practice. In this paper we present a C++ library, i.e. the Multiscale Universal Interface (MUI), which is capable of facilitating the coupling effort for a wide range of multiscale simulations. The library adopts a header-only form with minimal external dependency and hence can be easily dropped into existing codes. A data sampler concept is introduced, combined with a hybrid dynamic/static typing mechanism, to create an easily customizable framework for solver-independent data interpretation. The library integrates MPI MPMD support and an asynchronous communication protocol to handle inter-solver information exchange irrespective of the solvers' own MPI awareness. Template metaprogramming is heavily employed to simultaneously improve runtime performance and code flexibility. We validated the library by solving three different multiscale problems, which also serve to demonstrate the flexibility of the framework in handling heterogeneous models and solvers. In the first example, a Couette flow was simulated using two concurrently coupled Smoothed Particle Hydrodynamics (SPH) simulations of different spatial resolutions. In the second example, we coupled the deterministic SPH method with the stochasticmore »
- Authors:
-
- Brown Univ., Providence, RI (United States). Division of Applied Mathematics
- Kobe Univ., Kobe (Japan). Graduate School of System Informatics
- Brown Univ., Providence, RI (United States). Division of Applied Mathematics; Pacific Northwest National Lab., Richland, WA (United States). Collaboratory on Mathematics for Mesoscopic Modeling of Materials
- Publication Date:
- Research Org.:
- Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States). Oak Ridge Leadership Computing Facility (OLCF)
- Sponsoring Org.:
- USDOE Office of Science (SC)
- OSTI Identifier:
- 1565300
- Alternate Identifier(s):
- OSTI ID: 1249987
- Grant/Contract Number:
- FA9550-12-1-0463
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Journal of Computational Physics
- Additional Journal Information:
- Journal Volume: 297; Journal Issue: C; Journal ID: ISSN 0021-9991
- Publisher:
- Elsevier
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 97 MATHEMATICS AND COMPUTING; computer science; physics; multiscale modeling; concurrent coupling; multiphysics simulation; energy-conserving DPD; SPH; FEM; programming framework
Citation Formats
Tang, Yu-Hang, Kudo, Shuhei, Bian, Xin, Li, Zhen, and Karniadakis, George Em. Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers. United States: N. p., 2015.
Web. doi:10.1016/j.jcp.2015.05.004.
Tang, Yu-Hang, Kudo, Shuhei, Bian, Xin, Li, Zhen, & Karniadakis, George Em. Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers. United States. https://doi.org/10.1016/j.jcp.2015.05.004
Tang, Yu-Hang, Kudo, Shuhei, Bian, Xin, Li, Zhen, and Karniadakis, George Em. Tue .
"Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers". United States. https://doi.org/10.1016/j.jcp.2015.05.004. https://www.osti.gov/servlets/purl/1565300.
@article{osti_1565300,
title = {Multiscale Universal Interface: A concurrent framework for coupling heterogeneous solvers},
author = {Tang, Yu-Hang and Kudo, Shuhei and Bian, Xin and Li, Zhen and Karniadakis, George Em},
abstractNote = {Concurrently coupled numerical simulations using heterogeneous solvers are powerful tools for modeling multiscale phenomena. However, major modifications to existing codes are often required to enable such simulations, posing significant difficulties in practice. In this paper we present a C++ library, i.e. the Multiscale Universal Interface (MUI), which is capable of facilitating the coupling effort for a wide range of multiscale simulations. The library adopts a header-only form with minimal external dependency and hence can be easily dropped into existing codes. A data sampler concept is introduced, combined with a hybrid dynamic/static typing mechanism, to create an easily customizable framework for solver-independent data interpretation. The library integrates MPI MPMD support and an asynchronous communication protocol to handle inter-solver information exchange irrespective of the solvers' own MPI awareness. Template metaprogramming is heavily employed to simultaneously improve runtime performance and code flexibility. We validated the library by solving three different multiscale problems, which also serve to demonstrate the flexibility of the framework in handling heterogeneous models and solvers. In the first example, a Couette flow was simulated using two concurrently coupled Smoothed Particle Hydrodynamics (SPH) simulations of different spatial resolutions. In the second example, we coupled the deterministic SPH method with the stochastic Dissipative Particle Dynamics (DPD) method to study the effect of surface grafting on the hydrodynamics properties on the surface. Finally, in the third example, we consider conjugate heat transfer between a solid domain and a fluid domain by coupling the particle-based energy-conserving DPD (eDPD) method with the Finite Element Method (FEM).},
doi = {10.1016/j.jcp.2015.05.004},
journal = {Journal of Computational Physics},
number = C,
volume = 297,
place = {United States},
year = {Tue Sep 15 00:00:00 EDT 2015},
month = {Tue Sep 15 00:00:00 EDT 2015}
}
Web of Science
Works referenced in this record:
Multiscale Simulation of Soft Matter: From Scale Bridging to Adaptive Resolution
journal, May 2008
- Praprotnik, Matej; Site, Luigi Delle; Kremer, Kurt
- Annual Review of Physical Chemistry, Vol. 59, Issue 1
A review of the development of hybrid atomistic–continuum methods for dense fluids
journal, November 2009
- Mohamed, K. M.; Mohamad, A. A.
- Microfluidics and Nanofluidics, Vol. 8, Issue 3
Iterative Methods by Space Decomposition and Subspace Correction
journal, December 1992
- Xu, Jinchao
- SIAM Review, Vol. 34, Issue 4
Multiscale simulation of water flow past a C540 fullerene
journal, April 2012
- Walther, Jens H.; Praprotnik, Matej; Kotsalis, Evangelos M.
- Journal of Computational Physics, Vol. 231, Issue 7
A particle-based multiscale simulation procedure within the material point method framework
journal, April 2014
- Chen, Zhen; Jiang, Shan; Gan, Yong
- Computational Particle Mechanics, Vol. 1, Issue 2
Concurrent triple-scale simulation of molecular liquids
journal, March 2008
- Delgado-Buscalioni, Rafael; Kremer, Kurt; Praprotnik, Matej
- The Journal of Chemical Physics, Vol. 128, Issue 11
Multiscale simulation of non-isothermal microchannel gas flows
journal, August 2014
- Patronis, Alexander; Lockerby, Duncan A.
- Journal of Computational Physics, Vol. 270
The CCA core specification in a distributed memory SPMD framework
journal, January 2002
- Allan, Benjamin A.; Armstrong, Robert C.; Wolfe, Alicia P.
- Concurrency and Computation: Practice and Experience, Vol. 14, Issue 5
A component-based architecture for parallel multi-physics PDE simulation
journal, January 2006
- Parker, Steven G.
- Future Generation Computer Systems, Vol. 22, Issue 1-2
Accelerating dissipative particle dynamics simulations on GPUs: Algorithms, numerics and applications
journal, November 2014
- Tang, Yu-Hang; Karniadakis, George Em
- Computer Physics Communications, Vol. 185, Issue 11
Energy-conserving dissipative particle dynamics with temperature-dependent properties
journal, May 2014
- Li, Zhen; Tang, Yu-Hang; Lei, Huan
- Journal of Computational Physics, Vol. 265
Simulating Microscopic Hydrodynamic Phenomena with Dissipative Particle Dynamics
journal, June 1992
- Hoogerbrugge, P. J.; Koelman, J. M. V. A.
- Europhysics Letters (EPL), Vol. 19, Issue 3
Statistical Mechanics of Dissipative Particle Dynamics
journal, May 1995
- Español, P.; Warren, P.
- Europhysics Letters (EPL), Vol. 30, Issue 4
Effect of crystal preferred orientations on the thermal diffusivity of quartz polycrystalline aggregates at high temperature
journal, February 2009
- Gibert, Benoit; Mainprice, David
- Tectonophysics, Vol. 465, Issue 1-4
A Common Component Architecture (CCA) based design and implementation for distributed parallel magnetotellurice forward model
conference, November 2013
- Li, Shanshan; Mulunga, Paulus T.; Yang, Qiuge
- 2013 6th International Conference on Information Management, Innovation Management and Industrial Engineering (ICIII)
Migration of a generic multi-physics framework to HPC environments
journal, July 2013
- Dadvand, P.; Rossi, R.; Gil, M.
- Computers & Fluids, Vol. 80
PPM – A highly efficient parallel particle–mesh library for the simulation of continuum systems
journal, July 2006
- Sbalzarini, I. F.; Walther, J. H.; Bergdorf, M.
- Journal of Computational Physics, Vol. 215, Issue 2
Triple-decker: Interfacing atomistic–mesoscopic–continuum flow regimes
journal, March 2009
- Fedosov, Dmitry A.; Karniadakis, George Em
- Journal of Computational Physics, Vol. 228, Issue 4
Hybrid molecular–continuum methods: From prototypes to coupling software
journal, February 2014
- Neumann, Philipp; Eckhardt, Wolfgang; Bungartz, Hans-Joachim
- Computers & Mathematics with Applications, Vol. 67, Issue 2
A new computational paradigm in multiscale simulations: application to brain blood flow
conference, January 2011
- Grinberg, Leopold; Insley, Joseph A.; Morozov, Vitali
- Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '11
MUPHY: A parallel MUlti PHYsics/scale code for high performance bio-fluidic simulations
journal, September 2009
- Bernaschi, M.; Melchionna, S.; Succi, S.
- Computer Physics Communications, Vol. 180, Issue 9
A multiphysics and multiscale software environment for modeling astrophysical systems
journal, May 2009
- Portegies Zwart, Simon; McMillan, Steve; Harfst, Stefan
- New Astronomy, Vol. 14, Issue 4
Multi-physics simulations using a hierarchical interchangeable software interface
journal, March 2013
- Portegies Zwart, Simon F.; McMillan, Stephen L. W.; van Elteren, Arjen
- Computer Physics Communications, Vol. 184, Issue 3
VMD: Visual molecular dynamics
journal, February 1996
- Humphrey, William; Dalke, Andrew; Schulten, Klaus
- Journal of Molecular Graphics, Vol. 14, Issue 1
ODEPACK++: refactoring the LSODE fortran library for use in the CCA high performance component software architecture
conference, May 2004
- Allan, B. A.; Lefantzi, S.; Ray, J.
- Ninth International Workshop on High-Level Parallel Programming Models and Supportive Environments, 2004. Proceedings.
Works referencing / citing this record:
Toward a Predictive Hierarchical Multiscale Modeling Approach for Energetic Materials
book, February 2019
- Barnes, Brian C.; Brennan, John K.; Byrd, Edward F. C.
- Computational Approaches for Chemistry Under Extreme Conditions
Perspective: Dissipative particle dynamics
journal, April 2017
- Español, Pep; Warren, Patrick B.
- The Journal of Chemical Physics, Vol. 146, Issue 15
Everything you always wanted to know about SDPD⋆ (⋆but were afraid to ask)
journal, December 2017
- Ellero, M.; Español, P.
- Applied Mathematics and Mechanics, Vol. 39, Issue 1
Fluctuating hydrodynamics in periodic domains and heterogeneous adjacent multidomains: Thermal equilibrium
journal, November 2015
- Bian, Xin; Li, Zhen; Deng, Mingge
- Physical Review E, Vol. 92, Issue 5
Analysis of hydrodynamic fluctuations in heterogeneous adjacent multidomains in shear flow
journal, March 2016
- Bian, Xin; Deng, Mingge; Tang, Yu-Hang
- Physical Review E, Vol. 93, Issue 3
Mastering the scales: a survey on the benefits of multiscale computing software
journal, February 2019
- Groen, Derek; Knap, Jaroslaw; Neumann, Philipp
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 377, Issue 2142
MaMiCo: Parallel Noise Reduction for Multi-instance Molecular-Continuum Flow Simulation
book, June 2019
- Jarmatz, Piet; Neumann, Philipp; Rodrigues, João M. F.
- Computational Science – ICCS 2019: 19th International Conference, Faro, Portugal, June 12–14, 2019, Proceedings, Part IV, p. 451-464
Computing the non-Markovian coarse-grained interactions derived from the Mori–Zwanzig formalism in molecular systems: Application to polymer melts
journal, January 2017
- Li, Zhen; Lee, Hee Sun; Darve, Eric
- The Journal of Chemical Physics, Vol. 146, Issue 1
Perspective: Dissipative Particle Dynamics
text, January 2016
- Español, Pep; Warren, Patrick B.
- arXiv
preCICE v2: A Sustainable and User-Friendly Coupling Library
text, January 2021
- Chourdakis, Gerasimos; Davis, Kyle; Rodenberg, Benjamin
- arXiv
Mastering the scales: a survey on the benefits of multiscale computing software
journal, February 2019
- Groen, Derek; Knap, Jaroslaw; Neumann, Philipp
- Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, Vol. 377, Issue 2142