DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: FastPM: a new scheme for fast simulations of dark matter and haloes

Abstract

We introduce FASTPM, a highly scalable approximated particle mesh (PM) N-body solver, which implements the PM scheme enforcing correct linear displacement (1LPT) evolution via modified kick and drift factors. Employing a two-dimensional domain decomposing scheme, FASTPM scales extremely well with a very large number of CPUs. In contrast to Comoving-Lagrangian (COLA) approach, we do not require to split the force or track separately the 2LPT solution, reducing the code complexity and memory requirements. We compare FASTPM with different number of steps (Ns) and force resolution factor (B) against three benchmarks: halo mass function from friends-of-friends halo finder; halo and dark matter power spectrum; and cross-correlation coefficient (or stochasticity), relative to a high-resolution TREEPM simulation. We show that the modified time stepping scheme reduces the halo stochasticity when compared to COLA with the same number of steps and force resolution. While increasing Ns and B improves the transfer function and cross-correlation coefficient, for many applications FASTPM achieves sufficient accuracy at low Ns and B. For example, Ns = 10 and B = 2 simulation provides a substantial saving (a factor of 10) of computing time relative to Ns = 40, B = 3 simulation, yet the halo benchmarks are very similarmore » at z = 0. We find that for abundance matched haloes the stochasticity remains low even for Ns = 5. FASTPM compares well against less expensive schemes, being only 7 (4) times more expensive than 2LPT initial condition generator for Ns = 10 (Ns = 5). Some of the applications where FASTPM can be useful are generating a large number of mocks, producing non-linear statistics where one varies a large number of nuisance or cosmological parameters, or serving as part of an initial conditions solver.« less

Authors:
 [1];  [1];  [2];  [3]
  1. Univ. of California, Berkeley, CA (United States)
  2. Univ. of California, Berkeley, CA (United States); Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
  3. Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States)
Publication Date:
Research Org.:
Lawrence Berkeley National Lab. (LBNL), Berkeley, CA (United States). National Energy Research Scientific Computing Center (NERSC)
Sponsoring Org.:
USDOE
OSTI Identifier:
1526233
Resource Type:
Accepted Manuscript
Journal Name:
Monthly Notices of the Royal Astronomical Society
Additional Journal Information:
Journal Volume: 463; Journal Issue: 3; Journal ID: ISSN 0035-8711
Publisher:
Royal Astronomical Society
Country of Publication:
United States
Language:
English
Subject:
79 ASTRONOMY AND ASTROPHYSICS

Citation Formats

Feng, Yu, Chu, Man-Yat, Seljak, Uroš, and McDonald, Patrick. FastPM: a new scheme for fast simulations of dark matter and haloes. United States: N. p., 2016. Web. doi:10.1093/mnras/stw2123.
Feng, Yu, Chu, Man-Yat, Seljak, Uroš, & McDonald, Patrick. FastPM: a new scheme for fast simulations of dark matter and haloes. United States. https://doi.org/10.1093/mnras/stw2123
Feng, Yu, Chu, Man-Yat, Seljak, Uroš, and McDonald, Patrick. Wed . "FastPM: a new scheme for fast simulations of dark matter and haloes". United States. https://doi.org/10.1093/mnras/stw2123. https://www.osti.gov/servlets/purl/1526233.
@article{osti_1526233,
title = {FastPM: a new scheme for fast simulations of dark matter and haloes},
author = {Feng, Yu and Chu, Man-Yat and Seljak, Uroš and McDonald, Patrick},
abstractNote = {We introduce FASTPM, a highly scalable approximated particle mesh (PM) N-body solver, which implements the PM scheme enforcing correct linear displacement (1LPT) evolution via modified kick and drift factors. Employing a two-dimensional domain decomposing scheme, FASTPM scales extremely well with a very large number of CPUs. In contrast to Comoving-Lagrangian (COLA) approach, we do not require to split the force or track separately the 2LPT solution, reducing the code complexity and memory requirements. We compare FASTPM with different number of steps (Ns) and force resolution factor (B) against three benchmarks: halo mass function from friends-of-friends halo finder; halo and dark matter power spectrum; and cross-correlation coefficient (or stochasticity), relative to a high-resolution TREEPM simulation. We show that the modified time stepping scheme reduces the halo stochasticity when compared to COLA with the same number of steps and force resolution. While increasing Ns and B improves the transfer function and cross-correlation coefficient, for many applications FASTPM achieves sufficient accuracy at low Ns and B. For example, Ns = 10 and B = 2 simulation provides a substantial saving (a factor of 10) of computing time relative to Ns = 40, B = 3 simulation, yet the halo benchmarks are very similar at z = 0. We find that for abundance matched haloes the stochasticity remains low even for Ns = 5. FASTPM compares well against less expensive schemes, being only 7 (4) times more expensive than 2LPT initial condition generator for Ns = 10 (Ns = 5). Some of the applications where FASTPM can be useful are generating a large number of mocks, producing non-linear statistics where one varies a large number of nuisance or cosmological parameters, or serving as part of an initial conditions solver.},
doi = {10.1093/mnras/stw2123},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 3,
volume = 463,
place = {United States},
year = {Wed Aug 24 00:00:00 EDT 2016},
month = {Wed Aug 24 00:00:00 EDT 2016}
}

Journal Article:
Free Publicly Available Full Text
Publisher's Version of Record

Citation Metrics:
Cited by: 97 works
Citation information provided by
Web of Science

Save / Share:

Works referenced in this record:

Effective field theory of large scale structure at two loops: The apparent scale dependence of the speed of sound
journal, December 2015


The Coyote Universe. i. Precision Determination of the Nonlinear Matter Power Spectrum
journal, April 2010


HACC: extreme scaling and performance across diverse architectures
conference, January 2013

  • Habib, Salman; Morozov, Vitali; Frontiere, Nicholas
  • Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis on - SC '13
  • DOI: 10.1145/2503210.2504566

nIFTy cosmology: comparison of galaxy formation models
journal, June 2015

  • Knebe, Alexander; Pearce, Frazer R.; Thomas, Peter A.
  • Monthly Notices of the Royal Astronomical Society, Vol. 451, Issue 4
  • DOI: 10.1093/mnras/stv1149

Fast and accurate mock catalogue generation for low-mass galaxies
journal, April 2016

  • Koda, Jun; Blake, Chris; Beutler, Florian
  • Monthly Notices of the Royal Astronomical Society, Vol. 459, Issue 2
  • DOI: 10.1093/mnras/stw763

P3DFFT: A Framework for Parallel Computations of Fourier Transforms in Three Dimensions
journal, January 2012

  • Pekurovsky, Dmitry
  • SIAM Journal on Scientific Computing, Vol. 34, Issue 4
  • DOI: 10.1137/11082748X

Mock galaxy catalogues using the quick particle mesh method
journal, November 2013

  • White, Martin; Tinker, Jeremy L.; McBride, Cameron K.
  • Monthly Notices of the Royal Astronomical Society, Vol. 437, Issue 3
  • DOI: 10.1093/mnras/stt2071

L-PICOLA: A parallel code for fast dark matter simulation
journal, September 2015


Efficient construction of mock catalogs for baryon acoustic oscillation surveys
journal, May 2016

  • Sunayama, Tomomi; Padmanabhan, Nikhil; Heitmann, Katrin
  • Journal of Cosmology and Astroparticle Physics, Vol. 2016, Issue 05
  • DOI: 10.1088/1475-7516/2016/05/051

Solving large scale structure in ten easy steps with COLA
journal, June 2013

  • Tassev, Svetlin; Zaldarriaga, Matias; Eisenstein, Daniel J.
  • Journal of Cosmology and Astroparticle Physics, Vol. 2013, Issue 06
  • DOI: 10.1088/1475-7516/2013/06/036

Towards optimal parallel PM N-body codes: PMFAST
journal, April 2005


The clustering of galaxies in the SDSS-III Baryon Oscillation Spectroscopic Survey: modelling the clustering and halo occupation distribution of BOSS CMASS galaxies in the Final Data Release
journal, April 2016

  • Rodríguez-Torres, Sergio A.; Chuang, Chia-Hsun; Prada, Francisco
  • Monthly Notices of the Royal Astronomical Society, Vol. 460, Issue 2
  • DOI: 10.1093/mnras/stw1014

Galaxy Groups in the sdss dr4. iii. the Luminosity and Stellar mass Functions
journal, April 2009


Halo models of large scale structure
journal, December 2002


Simulations of baryon acoustic oscillations - I. Growth of large-scale density fluctuations: Simulations of BAO I
journal, September 2008

  • Takahashi, Ryuichi; Yoshida, Naoki; Matsubara, Takahiko
  • Monthly Notices of the Royal Astronomical Society, Vol. 389, Issue 4
  • DOI: 10.1111/j.1365-2966.2008.13731.x

Computing nearly singular solutions using pseudo-spectral methods
journal, September 2007


Critical look at cosmological perturbation theory techniques
journal, August 2009


The cosmological simulation code gadget-2
journal, December 2005


Toward a Halo Mass Function for Precision Cosmology: The Limits of Universality
journal, December 2008

  • Tinker, Jeremy; Kravtsov, Andrey V.; Klypin, Anatoly
  • The Astrophysical Journal, Vol. 688, Issue 2
  • DOI: 10.1086/591439

Matter power spectrum and the challenge of percent accuracy
journal, April 2016

  • Schneider, Aurel; Teyssier, Romain; Potter, Doug
  • Journal of Cosmology and Astroparticle Physics, Vol. 2016, Issue 04
  • DOI: 10.1088/1475-7516/2016/04/047

ICE-COLA: towards fast and accurate synthetic galaxy catalogues optimizing a quasi- N -body method
journal, April 2016

  • Izard, Albert; Crocce, Martin; Fosalba, Pablo
  • Monthly Notices of the Royal Astronomical Society, Vol. 459, Issue 3
  • DOI: 10.1093/mnras/stw797

PFFT: An Extension of FFTW to Massively Parallel Architectures
journal, January 2013

  • Pippig, Michael
  • SIAM Journal on Scientific Computing, Vol. 35, Issue 3
  • DOI: 10.1137/120885887

Satellite kinematics - II. The halo mass-luminosity relation of central galaxies in SDSS
journal, January 2009

  • More, Surhud; van den Bosch, Frank C.; Cacciato, Marcello
  • Monthly Notices of the Royal Astronomical Society, Vol. 392, Issue 2
  • DOI: 10.1111/j.1365-2966.2008.14095.x

Bayesian physical reconstruction of initial conditions from large-scale structure surveys
journal, April 2013

  • Jasche, Jens; Wandelt, Benjamin D.
  • Monthly Notices of the Royal Astronomical Society, Vol. 432, Issue 2
  • DOI: 10.1093/mnras/stt449

The BlueTides simulation: first galaxies and reionization
journal, November 2015

  • Feng, Yu; Di-Matteo, Tiziana; Croft, Rupert A.
  • Monthly Notices of the Royal Astronomical Society, Vol. 455, Issue 3
  • DOI: 10.1093/mnras/stv2484

An accurate tool for the fast generation of dark matter halo catalogues
journal, June 2013

  • Monaco, P.; Sefusatti, E.; Borgani, S.
  • Monthly Notices of the Royal Astronomical Society, Vol. 433, Issue 3
  • DOI: 10.1093/mnras/stt907

The cosmic code comparison project
journal, October 2008


The Halo Mass Function: High‐Redshift Evolution and Universality
journal, December 2007

  • Lukić, Zarija; Heitmann, Katrin; Habib, Salman
  • The Astrophysical Journal, Vol. 671, Issue 2
  • DOI: 10.1086/523083

TreePM: A code for cosmological N-body simulations
journal, December 2002

  • Bagla, J. S.
  • Journal of Astrophysics and Astronomy, Vol. 23, Issue 3-4
  • DOI: 10.1007/BF02702282

The initial conditions of the Universe from constrained simulations
journal, November 2012

  • Kitaura, Francisco-Shu
  • Monthly Notices of the Royal Astronomical Society: Letters, Vol. 429, Issue 1
  • DOI: 10.1093/mnrasl/sls029

A modified TreePM code
journal, July 2009


PARTICLE MESH SIMULATIONS OF THE Lyα FOREST AND THE SIGNATURE OF BARYON ACOUSTIC OSCILLATIONS IN THE INTERGALACTIC MEDIUM
journal, March 2010


Precision comparison of the power spectrum in the EFTofLSS with simulations
journal, May 2016

  • Foreman, Simon; Perrier, Hideki; Senatore, Leonardo
  • Journal of Cosmology and Astroparticle Physics, Vol. 2016, Issue 05
  • DOI: 10.1088/1475-7516/2016/05/027

Adaptive techniques for clustered N-body cosmological simulations
journal, March 2015

  • Menon, Harshitha; Wesolowski, Lukasz; Zheng, Gengbin
  • Computational Astrophysics and Cosmology, Vol. 2, Issue 1
  • DOI: 10.1186/s40668-015-0007-9

A COMPREHENSIVE ANALYSIS OF UNCERTAINTIES AFFECTING THE STELLAR MASS-HALO MASS RELATION FOR 0 < z < 4
journal, June 2010


Modelling baryon acoustic oscillations with perturbation theory and stochastic halo biasing
journal, December 2013

  • Kitaura, Francisco-Shu; Yepes, Gustavo; Prada, Francisco
  • Monthly Notices of the Royal Astronomical Society: Letters, Vol. 439, Issue 1
  • DOI: 10.1093/mnrasl/slt172

Reconstructing the Initial Density Field of the Local Universe: Methods and Tests with mock Catalogs
journal, July 2013


Halo Zel’dovich model and perturbation theory: Dark matter power spectrum and correlation function
journal, June 2015


The evolution of large-scale structure in a universe dominated by cold dark matter
journal, May 1985

  • Davis, M.; Efstathiou, G.; Frenk, C. S.
  • The Astrophysical Journal, Vol. 292
  • DOI: 10.1086/163168

Works referencing / citing this record:

Learning to predict the cosmological structure formation
journal, June 2019

  • He, Siyu; Li, Yin; Feng, Yu
  • Proceedings of the National Academy of Sciences, Vol. 116, Issue 28
  • DOI: 10.1073/pnas.1821458116

Towards optimal extraction of cosmological information from nonlinear data
journal, December 2017

  • Seljak, Uroš; Aslanyan, Grigor; Feng, Yu
  • Journal of Cosmology and Astroparticle Physics, Vol. 2017, Issue 12
  • DOI: 10.1088/1475-7516/2017/12/009

Exploring the posterior surface of the large scale structure reconstruction
journal, July 2018

  • Feng, Yu; Seljak, Uroš; Zaldarriaga, Matias
  • Journal of Cosmology and Astroparticle Physics, Vol. 2018, Issue 07
  • DOI: 10.1088/1475-7516/2018/07/043

Cosmological reconstruction from galaxy light: neural network based light-matter connection
journal, October 2018


Reconstructing large-scale structure with neutral hydrogen surveys
journal, November 2019

  • Modi, Chirag; White, Martin; Slosar, Anže
  • Journal of Cosmology and Astroparticle Physics, Vol. 2019, Issue 11
  • DOI: 10.1088/1475-7516/2019/11/023

ICE-COLA: fast simulations for weak lensing observables
journal, October 2017

  • Izard, Albert; Fosalba, Pablo; Crocce, Martin
  • Monthly Notices of the Royal Astronomical Society, Vol. 473, Issue 3
  • DOI: 10.1093/mnras/stx2544

The mass-Peak Patch algorithm for fast generation of deep all-sky dark matter halo catalogues and its N -body validation
journal, November 2018

  • Stein, George; Alvarez, Marcelo A.; Bond, J. Richard
  • Monthly Notices of the Royal Astronomical Society, Vol. 483, Issue 2
  • DOI: 10.1093/mnras/sty3226

Cylinders out of a top hat: counts-in-cells for projected densities
journal, March 2018

  • Uhlemann, Cora; Pichon, Christophe; Codis, Sandrine
  • Monthly Notices of the Royal Astronomical Society, Vol. 477, Issue 2
  • DOI: 10.1093/mnras/sty664

Prediction of H α and [O iii] emission line galaxy number counts for future galaxy redshift surveys
journal, October 2019

  • Zhai, Zhongxu; Benson, Andrew; Wang, Yun
  • Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 3
  • DOI: 10.1093/mnras/stz2844

Comparing approximate methods for mock catalogues and covariance matrices II: power spectrum multipoles
journal, February 2019

  • Blot, Linda; Crocce, Martin; Sefusatti, Emiliano
  • Monthly Notices of the Royal Astronomical Society, Vol. 485, Issue 2
  • DOI: 10.1093/mnras/stz507

nbodykit: An Open-source, Massively Parallel Toolkit for Large-scale Structure
journal, September 2018


The Information Content in Cold Stellar Streams
journal, November 2018


Statistical Properties of Paired Fixed Fields
journal, November 2018

  • Villaescusa-Navarro, Francisco; Naess, Sigurd; Genel, Shy
  • The Astrophysical Journal, Vol. 867, Issue 2
  • DOI: 10.3847/1538-4357/aae52b

TARDIS. I. A Constrained Reconstruction Approach to Modeling the z ∼ 2.5 Cosmic Web Probed by Ly α Forest Tomography
journal, December 2019

  • Horowitz, Benjamin; Lee, Khee-Gan; White, Martin
  • The Astrophysical Journal, Vol. 887, Issue 1
  • DOI: 10.3847/1538-4357/ab4d4c

Cylinders out of a top hat: Counts-in-cells for projected densities
text, January 2018

  • Uhlemann, Cora; Pichon, C.; Codis, S.
  • Apollo - University of Cambridge Repository
  • DOI: 10.17863/cam.27647

ICE-COLA: fast simulations for weak lensing observables
text, January 2017


Cylinders out of a top hat: counts-in-cells for projected densities
text, January 2017


Exploring the posterior surface of the large scale structure reconstruction
text, January 2018


Statistical properties of paired fixed fields
text, January 2018


Learning to Predict the Cosmological Structure Formation
text, January 2018