FastPM: a new scheme for fast simulations of dark matter and haloes
Abstract
We introduce FASTPM, a highly scalable approximated particle mesh (PM) N-body solver, which implements the PM scheme enforcing correct linear displacement (1LPT) evolution via modified kick and drift factors. Employing a two-dimensional domain decomposing scheme, FASTPM scales extremely well with a very large number of CPUs. In contrast to Comoving-Lagrangian (COLA) approach, we do not require to split the force or track separately the 2LPT solution, reducing the code complexity and memory requirements. We compare FASTPM with different number of steps (Ns) and force resolution factor (B) against three benchmarks: halo mass function from friends-of-friends halo finder; halo and dark matter power spectrum; and cross-correlation coefficient (or stochasticity), relative to a high-resolution TREEPM simulation. We show that the modified time stepping scheme reduces the halo stochasticity when compared to COLA with the same number of steps and force resolution. While increasing Ns and B improves the transfer function and cross-correlation coefficient, for many applications FASTPM achieves sufficient accuracy at low Ns and B. For example, Ns = 10 and B = 2 simulation provides a substantial saving (a factor of 10) of computing time relative to Ns = 40, B = 3 simulation, yet the halo benchmarks are very similarmore »
- Authors:
-
- Univ. of California, Berkeley, CA (United States)
- Univ. of California, Berkeley, CA (United States); Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
- Publication Date:
- Research Org.:
- Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC)
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1526233
- Resource Type:
- Accepted Manuscript
- Journal Name:
- Monthly Notices of the Royal Astronomical Society
- Additional Journal Information:
- Journal Volume: 463; Journal Issue: 3; Journal ID: ISSN 0035-8711
- Publisher:
- Royal Astronomical Society
- Country of Publication:
- United States
- Language:
- English
- Subject:
- 79 ASTRONOMY AND ASTROPHYSICS
Citation Formats
Feng, Yu, Chu, Man-Yat, Seljak, Uroš, and McDonald, Patrick. FastPM: a new scheme for fast simulations of dark matter and haloes. United States: N. p., 2016.
Web. doi:10.1093/mnras/stw2123.
Feng, Yu, Chu, Man-Yat, Seljak, Uroš, & McDonald, Patrick. FastPM: a new scheme for fast simulations of dark matter and haloes. United States. https://doi.org/10.1093/mnras/stw2123
Feng, Yu, Chu, Man-Yat, Seljak, Uroš, and McDonald, Patrick. Wed .
"FastPM: a new scheme for fast simulations of dark matter and haloes". United States. https://doi.org/10.1093/mnras/stw2123. https://www.osti.gov/servlets/purl/1526233.
@article{osti_1526233,
title = {FastPM: a new scheme for fast simulations of dark matter and haloes},
author = {Feng, Yu and Chu, Man-Yat and Seljak, Uroš and McDonald, Patrick},
abstractNote = {We introduce FASTPM, a highly scalable approximated particle mesh (PM) N-body solver, which implements the PM scheme enforcing correct linear displacement (1LPT) evolution via modified kick and drift factors. Employing a two-dimensional domain decomposing scheme, FASTPM scales extremely well with a very large number of CPUs. In contrast to Comoving-Lagrangian (COLA) approach, we do not require to split the force or track separately the 2LPT solution, reducing the code complexity and memory requirements. We compare FASTPM with different number of steps (Ns) and force resolution factor (B) against three benchmarks: halo mass function from friends-of-friends halo finder; halo and dark matter power spectrum; and cross-correlation coefficient (or stochasticity), relative to a high-resolution TREEPM simulation. We show that the modified time stepping scheme reduces the halo stochasticity when compared to COLA with the same number of steps and force resolution. While increasing Ns and B improves the transfer function and cross-correlation coefficient, for many applications FASTPM achieves sufficient accuracy at low Ns and B. For example, Ns = 10 and B = 2 simulation provides a substantial saving (a factor of 10) of computing time relative to Ns = 40, B = 3 simulation, yet the halo benchmarks are very similar at z = 0. We find that for abundance matched haloes the stochasticity remains low even for Ns = 5. FASTPM compares well against less expensive schemes, being only 7 (4) times more expensive than 2LPT initial condition generator for Ns = 10 (Ns = 5). Some of the applications where FASTPM can be useful are generating a large number of mocks, producing non-linear statistics where one varies a large number of nuisance or cosmological parameters, or serving as part of an initial conditions solver.},
doi = {10.1093/mnras/stw2123},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 3,
volume = 463,
place = {United States},
year = {Wed Aug 24 00:00:00 EDT 2016},
month = {Wed Aug 24 00:00:00 EDT 2016}
}
Web of Science
Works referenced in this record:
Effective field theory of large scale structure at two loops: The apparent scale dependence of the speed of sound
journal, December 2015
- Baldauf, Tobias; Mercolli, Lorenzo; Zaldarriaga, Matias
- Physical Review D, Vol. 92, Issue 12
The Coyote Universe. i. Precision Determination of the Nonlinear Matter Power Spectrum
journal, April 2010
- Heitmann, Katrin; White, Martin; Wagner, Christian
- The Astrophysical Journal, Vol. 715, Issue 1
HACC: extreme scaling and performance across diverse architectures
conference, January 2013
- Habib, Salman; Morozov, Vitali; Frontiere, Nicholas
- Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '13
nIFTy cosmology: comparison of galaxy formation models
journal, June 2015
- Knebe, Alexander; Pearce, Frazer R.; Thomas, Peter A.
- Monthly Notices of the Royal Astronomical Society, Vol. 451, Issue 4
Fast and accurate mock catalogue generation for low-mass galaxies
journal, April 2016
- Koda, Jun; Blake, Chris; Beutler, Florian
- Monthly Notices of the Royal Astronomical Society, Vol. 459, Issue 2
P3DFFT: A Framework for Parallel Computations of Fourier Transforms in Three Dimensions
journal, January 2012
- Pekurovsky, Dmitry
- SIAM Journal on Scientific Computing, Vol. 34, Issue 4
Mock galaxy catalogues using the quick particle mesh method
journal, November 2013
- White, Martin; Tinker, Jeremy L.; McBride, Cameron K.
- Monthly Notices of the Royal Astronomical Society, Vol. 437, Issue 3
L-PICOLA: A parallel code for fast dark matter simulation
journal, September 2015
- Howlett, C.; Manera, M.; Percival, W. J.
- Astronomy and Computing, Vol. 12
Efficient construction of mock catalogs for baryon acoustic oscillation surveys
journal, May 2016
- Sunayama, Tomomi; Padmanabhan, Nikhil; Heitmann, Katrin
- Journal of Cosmology and Astroparticle Physics, Vol. 2016, Issue 05
Solving large scale structure in ten easy steps with COLA
journal, June 2013
- Tassev, Svetlin; Zaldarriaga, Matias; Eisenstein, Daniel J.
- Journal of Cosmology and Astroparticle Physics, Vol. 2013, Issue 06
Towards optimal parallel PM N-body codes: PMFAST
journal, April 2005
- Merz, Hugh; Pen, Ue-Li; Trac, Hy
- New Astronomy, Vol. 10, Issue 5
The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: modelling the clustering and halo occupation distribution of BOSS CMASS galaxies in the Final Data Release
journal, April 2016
- Rodríguez-Torres, Sergio A.; Chuang, Chia-Hsun; Prada, Francisco
- Monthly Notices of the Royal Astronomical Society, Vol. 460, Issue 2
Galaxy Groups in the sdss dr4. iii. the Luminosity and Stellar mass Functions
journal, April 2009
- Yang, Xiaohu; Mo, H. J.; van den Bosch, Frank C.
- The Astrophysical Journal, Vol. 695, Issue 2
Halo models of large scale structure
journal, December 2002
- Cooray, A.; Sheth, R.
- Physics Reports, Vol. 372, Issue 1
Simulations of baryon acoustic oscillations - I. Growth of large-scale density fluctuations: Simulations of BAO I
journal, September 2008
- Takahashi, Ryuichi; Yoshida, Naoki; Matsubara, Takahiko
- Monthly Notices of the Royal Astronomical Society, Vol. 389, Issue 4
Computing nearly singular solutions using pseudo-spectral methods
journal, September 2007
- Hou, Thomas Y.; Li, Ruo
- Journal of Computational Physics, Vol. 226, Issue 1
Critical look at cosmological perturbation theory techniques
journal, August 2009
- Carlson, Jordan; White, Martin; Padmanabhan, Nikhil
- Physical Review D, Vol. 80, Issue 4
The cosmological simulation code gadget-2
journal, December 2005
- Springel, Volker
- Monthly Notices of the Royal Astronomical Society, Vol. 364, Issue 4
Toward a Halo Mass Function for Precision Cosmology: The Limits of Universality
journal, December 2008
- Tinker, Jeremy; Kravtsov, Andrey V.; Klypin, Anatoly
- The Astrophysical Journal, Vol. 688, Issue 2
Matter power spectrum and the challenge of percent accuracy
journal, April 2016
- Schneider, Aurel; Teyssier, Romain; Potter, Doug
- Journal of Cosmology and Astroparticle Physics, Vol. 2016, Issue 04
ICE-COLA: towards fast and accurate synthetic galaxy catalogues optimizing a quasi- N -body method
journal, April 2016
- Izard, Albert; Crocce, Martin; Fosalba, Pablo
- Monthly Notices of the Royal Astronomical Society, Vol. 459, Issue 3
PFFT: An Extension of FFTW to Massively Parallel Architectures
journal, January 2013
- Pippig, Michael
- SIAM Journal on Scientific Computing, Vol. 35, Issue 3
Satellite kinematics - II. The halo mass-luminosity relation of central galaxies in SDSS
journal, January 2009
- More, Surhud; van den Bosch, Frank C.; Cacciato, Marcello
- Monthly Notices of the Royal Astronomical Society, Vol. 392, Issue 2
Bayesian physical reconstruction of initial conditions from large-scale structure surveys
journal, April 2013
- Jasche, Jens; Wandelt, Benjamin D.
- Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 2
The BlueTides simulation: first galaxies and reionization
journal, November 2015
- Feng, Yu; Di-Matteo, Tiziana; Croft, Rupert A.
- Monthly Notices of the Royal Astronomical Society, Vol. 455, Issue 3
An accurate tool for the fast generation of dark matter halo catalogues
journal, June 2013
- Monaco, P.; Sefusatti, E.; Borgani, S.
- Monthly Notices of the Royal Astronomical Society, Vol. 433, Issue 3
The cosmic code comparison project
journal, October 2008
- Heitmann, Katrin; Lukić, Zarija; Fasel, Patricia
- Computational Science & Discovery, Vol. 1, Issue 1
The Halo Mass Function: High‐Redshift Evolution and Universality
journal, December 2007
- Lukić, Zarija; Heitmann, Katrin; Habib, Salman
- The Astrophysical Journal, Vol. 671, Issue 2
TreePM: A code for cosmological N-body simulations
journal, December 2002
- Bagla, J. S.
- Journal of Astrophysics and Astronomy, Vol. 23, Issue 3-4
The initial conditions of the Universe from constrained simulations
journal, November 2012
- Kitaura, Francisco-Shu
- Monthly Notices of the Royal Astronomical Society: Letters, Vol. 429, Issue 1
A modified TreePM code
journal, July 2009
- Khandai, Nishikanta; Bagla, J. S.
- Research in Astronomy and Astrophysics, Vol. 9, Issue 8
PARTICLE MESH SIMULATIONS OF THE Lyα FOREST AND THE SIGNATURE OF BARYON ACOUSTIC OSCILLATIONS IN THE INTERGALACTIC MEDIUM
journal, March 2010
- White, Martin; Pope, Adrian; Carlson, Jordan
- The Astrophysical Journal, Vol. 713, Issue 1
Precision comparison of the power spectrum in the EFTofLSS with simulations
journal, May 2016
- Foreman, Simon; Perrier, Hideki; Senatore, Leonardo
- Journal of Cosmology and Astroparticle Physics, Vol. 2016, Issue 05
Adaptive techniques for clustered N-body cosmological simulations
journal, March 2015
- Menon, Harshitha; Wesolowski, Lukasz; Zheng, Gengbin
- Computational Astrophysics and Cosmology, Vol. 2, Issue 1
A COMPREHENSIVE ANALYSIS OF UNCERTAINTIES AFFECTING THE STELLAR MASS-HALO MASS RELATION FOR 0 < z < 4
journal, June 2010
- Behroozi, Peter S.; Conroy, Charlie; Wechsler, Risa H.
- The Astrophysical Journal, Vol. 717, Issue 1
Modelling baryon acoustic oscillations with perturbation theory and stochastic halo biasing
journal, December 2013
- Kitaura, Francisco-Shu; Yepes, Gustavo; Prada, Francisco
- Monthly Notices of the Royal Astronomical Society: Letters, Vol. 439, Issue 1
Reconstructing the Initial Density Field of the Local Universe: Methods and Tests with mock Catalogs
journal, July 2013
- Wang, Huiyuan; Mo, H. J.; Yang, Xiaohu
- The Astrophysical Journal, Vol. 772, Issue 1
Halo Zel’dovich model and perturbation theory: Dark matter power spectrum and correlation function
journal, June 2015
- Seljak, Uroš; Vlah, Zvonimir
- Physical Review D, Vol. 91, Issue 12
The evolution of large-scale structure in a universe dominated by cold dark matter
journal, May 1985
- Davis, M.; Efstathiou, G.; Frenk, C. S.
- The Astrophysical Journal, Vol. 292
Works referencing / citing this record:
Learning to predict the cosmological structure formation
journal, June 2019
- He, Siyu; Li, Yin; Feng, Yu
- Proceedings of the National Academy of Sciences, Vol. 116, Issue 28
Towards optimal extraction of cosmological information from nonlinear data
journal, December 2017
- Seljak, Uroš; Aslanyan, Grigor; Feng, Yu
- Journal of Cosmology and Astroparticle Physics, Vol. 2017, Issue 12
Exploring the posterior surface of the large scale structure reconstruction
journal, July 2018
- Feng, Yu; Seljak, Uroš; Zaldarriaga, Matias
- Journal of Cosmology and Astroparticle Physics, Vol. 2018, Issue 07
Cosmological reconstruction from galaxy light: neural network based light-matter connection
journal, October 2018
- Modi, Chirag; Feng, Yu; Seljak, Uroš
- Journal of Cosmology and Astroparticle Physics, Vol. 2018, Issue 10
Reconstructing large-scale structure with neutral hydrogen surveys
journal, November 2019
- Modi, Chirag; White, Martin; Slosar, Anže
- Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 11
ICE-COLA: fast simulations for weak lensing observables
journal, October 2017
- Izard, Albert; Fosalba, Pablo; Crocce, Martin
- Monthly Notices of the Royal Astronomical Society, Vol. 473, Issue 3
The mass-Peak Patch algorithm for fast generation of deep all-sky dark matter halo catalogues and its N -body validation
journal, November 2018
- Stein, George; Alvarez, Marcelo A.; Bond, J. Richard
- Monthly Notices of the Royal Astronomical Society, Vol. 483, Issue 2
Cylinders out of a top hat: counts-in-cells for projected densities
journal, March 2018
- Uhlemann, Cora; Pichon, Christophe; Codis, Sandrine
- Monthly Notices of the Royal Astronomical Society, Vol. 477, Issue 2
Prediction of H α and [O iii] emission line galaxy number counts for future galaxy redshift surveys
journal, October 2019
- Zhai, Zhongxu; Benson, Andrew; Wang, Yun
- Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 3
Comparing approximate methods for mock catalogues and covariance matrices II: power spectrum multipoles
journal, February 2019
- Blot, Linda; Crocce, Martin; Sefusatti, Emiliano
- Monthly Notices of the Royal Astronomical Society, Vol. 485, Issue 2
nbodykit: An Open-source, Massively Parallel Toolkit for Large-scale Structure
journal, September 2018
- Hand, Nick; Feng, Yu; Beutler, Florian
- The Astronomical Journal, Vol. 156, Issue 4
The Information Content in Cold Stellar Streams
journal, November 2018
- Bonaca, Ana; Hogg, David W.
- The Astrophysical Journal, Vol. 867, Issue 2
Statistical Properties of Paired Fixed Fields
journal, November 2018
- Villaescusa-Navarro, Francisco; Naess, Sigurd; Genel, Shy
- The Astrophysical Journal, Vol. 867, Issue 2
TARDIS. I. A Constrained Reconstruction Approach to Modeling the z ∼ 2.5 Cosmic Web Probed by Ly α Forest Tomography
journal, December 2019
- Horowitz, Benjamin; Lee, Khee-Gan; White, Martin
- The Astrophysical Journal, Vol. 887, Issue 1
Cylinders out of a top hat: Counts-in-cells for projected densities
text, January 2018
- Uhlemann, Cora; Pichon, C.; Codis, S.
- Apollo - University of Cambridge Repository
ICE-COLA: fast simulations for weak lensing observables
text, January 2017
- Izard, Albert; Fosalba, Pablo; Crocce, Martin
- arXiv
Cylinders out of a top hat: counts-in-cells for projected densities
text, January 2017
- Uhlemann, Cora; Pichon, Christophe; Codis, Sandrine
- arXiv
Exploring the posterior surface of the large scale structure reconstruction
text, January 2018
- Feng, Yu; Seljak, Uros; Zaldarriaga, Matias
- arXiv
Statistical properties of paired fixed fields
text, January 2018
- Villaescusa-Navarro, Francisco; Naess, Sigurd; Genel, Shy
- arXiv
Learning to Predict the Cosmological Structure Formation
text, January 2018
- He, Siyu; Li, Yin; Feng, Yu
- arXiv