The ABACUS cosmological N-body code

Garrison, Lehman H.; Eisenstein, Daniel J.; Ferrer, Douglas; Maksimova, Nina A.; Pinto, Philip A.

doi:10.1093/mnras/stab2482

Title: The ABACUS cosmological N-body code

Journal Article · 06 September 2021 · Monthly Notices of the Royal Astronomical Society

DOI: https://doi.org/10.1093/mnras/stab2482 · OSTI ID:1979511

^[1]; Eisenstein, Daniel J. ^[2]; Ferrer, Douglas ^[2]; Maksimova, Nina A. ^[2]; Pinto, Philip A. ^[3]

Flatiron Institute, New York, NY (United States); Flatioron Inst., New York, NY (United States)
Harvard & Smithsonian, Cambridge, MA (United States)
University of Arizona, Tucson, AZ (United States)

We present abacus, a fast and accurate cosmological N-body code based on a new method for calculating the gravitational potential from a static multipole mesh. The method analytically separates the near- and far-field forces, reducing the former to direct 1/r² summation and the latter to a discrete convolution over multipoles. The method achieves 70 million particle updates per second per node of the Summit supercomputer, while maintaining a median fractional force error of 10^-5. We express the simulation time-step as an event-driven ‘pipeline’, incorporating asynchronous events such as completion of co-processor work, input/output, and network communication. abacus has been used to produce the largest suite of N-body simulations to date, the abacussummit suite of 60 trillion particles, incorporating on-the-fly halo finding. abacus enables the production of mock catalogues of the volume and resolution required by the coming generation of cosmological surveys.

View Accepted Manuscript (DOE)

Cite

Export

Save

Research Organization:: Flatiron Institute, New York, NY (United States); Harvard University, Cambridge, MA (United States); UT-Battelle LLC/ORNL, Oak Ridge, TN (United States)

Sponsoring Organization:: Harvard University; National Science Foundation (NSF); Simons Foundation; USDOE Office of Science (SC)

Grant/Contract Number:: AC05-00OR22725; SC0013718

OSTI ID:: 1979511

Journal Information:: Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 1 Vol. 508; ISSN 0035-8711

Publisher:: Oxford University PressCopyright Statement

Country of Publication:: United States

Language:: English

References (53)

Die Berechnung optischer und elektrostatischer Gitterpotentiale Ewald, P. P. Annalen der Physik, Vol. 369, Issue 3 https://doi.org/10.1002/andp.19213690304	journal	January 1921
CORRFUNC: Blazing Fast Correlation Functions with AVX512F SIMD Intrinsics Sinha, Manodeep; Garrison, Lehman Communications in Computer and Information Science https://doi.org/10.1007/978-981-13-7729-7_1	book	January 2019
A fast algorithm for particle simulations Greengard, L.; Rokhlin, V. Journal of Computational Physics, Vol. 73, Issue 2 https://doi.org/10.1016/0021-9991(87)90140-9	journal	December 1987
A hierarchical O(N log N) force-calculation algorithm Barnes, Josh; Hut, Piet Nature, Vol. 324, Issue 6096 https://doi.org/10.1038/324446a0	journal	December 1986
SciPy 1.0: fundamental algorithms for scientific computing in Python Virtanen, Pauli; Gommers, Ralf; Oliphant, Travis E. Nature Methods https://doi.org/10.1038/s41592-019-0686-2	journal	February 2020
Reduced description of electric multipole potential in Cartesian coordinates Hinsen, K.; Felderhof, B. U. Journal of Mathematical Physics, Vol. 33, Issue 11 https://doi.org/10.1063/1.529869	journal	November 1992
The evolution of large-scale structure in a universe dominated by cold dark matter Davis, M.; Efstathiou, G.; Frenk, C. S. The Astrophysical Journal, Vol. 292 https://doi.org/10.1086/163168	journal	May 1985
Numerical techniques for large cosmological N-body simulations Efstathiou, G.; Davis, M.; White, S. D. M. The Astrophysical Journal Supplement Series, Vol. 57 https://doi.org/10.1086/191003	journal	January 1985
TREESPH - A unification of SPH with the hierarchical tree method Hernquist, Lars; Katz, Neal The Astrophysical Journal Supplement Series, Vol. 70 https://doi.org/10.1086/191344	journal	June 1989
Athena: A New Code for Astrophysical MHD Stone, James M.; Gardiner, Thomas A.; Teuben, Peter The Astrophysical Journal Supplement Series, Vol. 178, Issue 1 https://doi.org/10.1086/588755	journal	September 2008
Solving large scale structure in ten easy steps with COLA Tassev, Svetlin; Zaldarriaga, Matias; Eisenstein, Daniel J. Journal of Cosmology and Astroparticle Physics, Vol. 2013, Issue 06 https://doi.org/10.1088/1475-7516/2013/06/036	journal	June 2013
On the Problem of Distribution in Globular Star Clusters: (Plate 8.) Plummer, H. C. Monthly Notices of the Royal Astronomical Society, Vol. 71, Issue 5 https://doi.org/10.1093/mnras/71.5.460	journal	March 1911
The Completed SDSS-IV extended Baryon Oscillation Spectroscopic Survey: exploring the Halo Occupation Distribution model for Emission Line Galaxies Avila, S.; Gonzalez-Perez, V.; Mohammad, F. G. Monthly Notices of the Royal Astronomical Society https://doi.org/10.1093/mnras/staa2951	journal	September 2020
Quantifying resolution in cosmological N- body simulations using self-similarity Joyce, Michael; Garrison, Lehman; Eisenstein, Daniel Monthly Notices of the Royal Astronomical Society, Vol. 501, Issue 4 https://doi.org/10.1093/mnras/staa3434	journal	November 2020
Limitations to the ‘basic’ HOD model and beyond Hadzhiyska, Boryana; Bose, Sownak; Eisenstein, Daniel Monthly Notices of the Royal Astronomical Society, Vol. 493, Issue 4 https://doi.org/10.1093/mnras/staa623	journal	March 2020
Can assembly bias explain the lensing amplitude of the BOSS CMASS sample in a Planck cosmology? Yuan, Sihan; Eisenstein, Daniel J.; Leauthaud, Alexie Monthly Notices of the Royal Astronomical Society, Vol. 493, Issue 4 https://doi.org/10.1093/mnras/staa634	journal	March 2020
Good and proper: self-similarity of N -body simulations with proper force softening Garrison, Lehman H.; Joyce, Michael; Eisenstein, Daniel J. Monthly Notices of the Royal Astronomical Society, Vol. 504, Issue 3 https://doi.org/10.1093/mnras/stab1096	journal	April 2021
The Uchuu simulations: Data Release 1 and dark matter halo concentrations Ishiyama, Tomoaki; Prada, Francisco; Klypin, Anatoly A. Monthly Notices of the Royal Astronomical Society, Vol. 506, Issue 3 https://doi.org/10.1093/mnras/stab1755	journal	June 2021
Evidence for galaxy assembly bias in BOSS CMASS redshift-space galaxy correlation function Yuan, Sihan; Hadzhiyska, Boryana; Bose, Sownak Monthly Notices of the Royal Astronomical Society, Vol. 502, Issue 3 https://doi.org/10.1093/mnras/stab235	journal	January 2021
AbacusSummit : a massive set of high-accuracy, high-resolution N -body simulations Maksimova, Nina A.; Garrison, Lehman H.; Eisenstein, Daniel J. Monthly Notices of the Royal Astronomical Society, Vol. 508, Issue 3 https://doi.org/10.1093/mnras/stab2484	journal	September 2021
A new way of setting the phases for cosmological multiscale Gaussian initial conditions Jenkins, Adrian Monthly Notices of the Royal Astronomical Society, Vol. 434, Issue 3 https://doi.org/10.1093/mnras/stt1154	journal	July 2013
Improving initial conditions for cosmological N -body simulations Garrison, Lehman H.; Eisenstein, Daniel J.; Ferrer, Douglas Monthly Notices of the Royal Astronomical Society, Vol. 461, Issue 4 https://doi.org/10.1093/mnras/stw1594	journal	July 2016
FastPM: a new scheme for fast simulations of dark matter and haloes Feng, Yu; Chu, Man-Yat; Seljak, Uroš Monthly Notices of the Royal Astronomical Society, Vol. 463, Issue 3 https://doi.org/10.1093/mnras/stw2123	journal	August 2016
The host dark matter haloes of [O II] emitters at 0.5 < z < 1.5 Gonzalez-Perez, V.; Comparat, J.; Norberg, P. Monthly Notices of the Royal Astronomical Society, Vol. 474, Issue 3 https://doi.org/10.1093/mnras/stx2807	journal	October 2017
Exploring the squeezed three-point galaxy correlation function with generalized halo occupation distribution models Yuan, Sihan; Eisenstein, Daniel J.; Garrison, Lehman H. Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 2 https://doi.org/10.1093/mnras/sty1089	journal	April 2018
An iterative reconstruction of cosmological initial density fields Hada, Ryuichiro; Eisenstein, Daniel J. Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 2 https://doi.org/10.1093/mnras/sty1203	journal	May 2018
Dark matter statistics for large galaxy catalogues: power spectra and covariance matrices Klypin, Anatoly; Prada, Francisco Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 4 https://doi.org/10.1093/mnras/sty1340	journal	June 2018
Emulating galaxy clustering and galaxy–galaxy lensing into the deeply non-linear regime: methodology, information, and forecasts Wibking, Benjamin D.; Salcedo, Andrés N.; Weinberg, David H. Monthly Notices of the Royal Astronomical Society, Vol. 484, Issue 1 https://doi.org/10.1093/mnras/sty2258	journal	August 2018
Tests of acoustic scale shifts in halo-based mock galaxy catalogues Duan, Yutong; Eisenstein, Daniel Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 2 https://doi.org/10.1093/mnras/stz2578	journal	September 2019
Covariance matrices for galaxy cluster weak lensing: from virial regime to uncorrelated large-scale structure Wu, Hao-Yi; Weinberg, David H.; Salcedo, Andrés N. Monthly Notices of the Royal Astronomical Society, Vol. 490, Issue 2 https://doi.org/10.1093/mnras/stz2617	journal	September 2019
Cosmology with stacked cluster weak lensing and cluster–galaxy cross-correlations Salcedo, Andrés N.; Wibking, Benjamin D.; Weinberg, David H. Monthly Notices of the Royal Astronomical Society, Vol. 491, Issue 3 https://doi.org/10.1093/mnras/stz2963	journal	October 2019
corrfunc – a suite of blazing fast correlation functions on the CPU Sinha, Manodeep; Garrison, Lehman H. Monthly Notices of the Royal Astronomical Society, Vol. 491, Issue 2 https://doi.org/10.1093/mnras/stz3157	journal	November 2019
Cosmology with galaxy–galaxy lensing on non-perturbative scales: emulation method and application to BOSS LOWZ Wibking, Benjamin D.; Weinberg, David H.; Salcedo, Andrés N. Monthly Notices of the Royal Astronomical Society, Vol. 492, Issue 2 https://doi.org/10.1093/mnras/stz3423	journal	December 2019
Generating approximate halo catalogues for blind challenges in precision cosmology Garrison, Lehman H.; Eisenstein, Daniel J. Monthly Notices of the Royal Astronomical Society, Vol. 485, Issue 2 https://doi.org/10.1093/mnras/stz600	journal	March 2019
A high-fidelity realization of the Euclid code comparison N -body simulation with Abacus Garrison, Lehman H.; Eisenstein, Daniel J.; Pinto, Philip A. Monthly Notices of the Royal Astronomical Society, Vol. 485, Issue 3 https://doi.org/10.1093/mnras/stz634	journal	March 2019
Decorrelating the errors of the galaxy correlation function with compact transformation matrices Yuan, Sihan; Eisenstein, Daniel J. Monthly Notices of the Royal Astronomical Society, Vol. 486, Issue 1 https://doi.org/10.1093/mnras/stz899	journal	March 2019
Effective halo model: Creating a physical and accurate model of the matter power spectrum and cluster counts Philcox, Oliver H. E.; Spergel, David N.; Villaescusa-Navarro, Francisco Physical Review D, Vol. 101, Issue 12 https://doi.org/10.1103/PhysRevD.101.123520	journal	June 2020
Linear perturbative theory of the discrete cosmological N -body problem Marcos, B.; Baertschiger, T.; Joyce, M. Physical Review D, Vol. 73, Issue 10 https://doi.org/10.1103/PhysRevD.73.103507	journal	May 2006
The Design and Implementation of FFTW3 Frigo, M.; Johnson, S. G. Proceedings of the IEEE, Vol. 93, Issue 2 https://doi.org/10.1109/JPROC.2004.840301	journal	February 2005
Matplotlib: A 2D Graphics Environment Hunter, John D. Computing in Science & Engineering, Vol. 9, Issue 3 https://doi.org/10.1109/MCSE.2007.55	journal	January 2007
The NumPy Array: A Structure for Efficient Numerical Computation van der Walt, Stéfan; Colbert, S. Chris; Varoquaux, Gaël Computing in Science & Engineering, Vol. 13, Issue 2 https://doi.org/10.1109/MCSE.2011.37	journal	March 2011
The cosmological simulation code gadget-2 Springel, Volker Monthly Notices of the Royal Astronomical Society, Vol. 364, Issue 4 https://doi.org/10.1111/j.1365-2966.2005.09655.x	journal	December 2005
Scalable parallel programming with CUDA Nickolls, John; Buck, Ian; Garland, Michael Queue, Vol. 6, Issue 2 https://doi.org/10.1145/1365490.1365500	journal	March 2008
Pracniques: further remarks on reducing truncation errors Kahan, W. Communications of the ACM, Vol. 8, Issue 1 https://doi.org/10.1145/363707.363723	journal	January 1965
PKDGRAV3: beyond trillion particle cosmological simulations for the next era of galaxy surveys Potter, Douglas; Stadel, Joachim; Teyssier, Romain Computational Astrophysics and Cosmology, Vol. 4, Issue 1 https://doi.org/10.1186/s40668-017-0021-1	journal	May 2017
The Astropy Project: Building an Open-science Project and Status of the v2.0 Core Package Price-Whelan, A. M.; Sipőcz, B. M.; Günther, H. M. The Astronomical Journal, Vol. 156, Issue 3 https://doi.org/10.3847/1538-3881/aabc4f	journal	August 2018
nbodykit: An Open-source, Massively Parallel Toolkit for Large-scale Structure Hand, Nick; Feng, Yu; Beutler, Florian The Astronomical Journal, Vol. 156, Issue 4 https://doi.org/10.3847/1538-3881/aadae0	journal	September 2018
LSST: From Science Drivers to Reference Design and Anticipated Data Products Ivezić, Željko; Kahn, Steven M.; Tyson, J. Anthony The Astrophysical Journal, Vol. 873, Issue 2 https://doi.org/10.3847/1538-4357/ab042c	journal	March 2019
Testing the Detection Significance on the Large-scale Structure by a JWST Deep Field Survey Zhang, Hao; Eisenstein, Daniel J.; Garrison, Lehman H. The Astrophysical Journal, Vol. 875, Issue 2 https://doi.org/10.3847/1538-4357/ab1268	journal	April 2019
A Hybrid Deep Learning Approach to Cosmological Constraints from Galaxy Redshift Surveys Ntampaka, Michelle; Eisenstein, Daniel J.; Yuan, Sihan The Astrophysical Journal, Vol. 889, Issue 2 https://doi.org/10.3847/1538-4357/ab5f5e	journal	February 2020
The Abacus Cosmos: A Suite of Cosmological N -body Simulations Garrison, Lehman H.; Eisenstein, Daniel J.; Ferrer, Douglas The Astrophysical Journal Supplement Series, Vol. 236, Issue 2 https://doi.org/10.3847/1538-4365/aabfd3	journal	June 2018
CUBE: An Information-optimized Parallel Cosmological N -body Algorithm Yu, Hao-Ran; Pen, Ue-Li; Wang, Xin The Astrophysical Journal Supplement Series, Vol. 237, Issue 2 https://doi.org/10.3847/1538-4365/aac830	journal	July 2018
The Outer Rim Simulation: A Path to Many-core Supercomputers Heitmann, Katrin; Finkel, Hal; Pope, Adrian The Astrophysical Journal Supplement Series, Vol. 245, Issue 1 https://doi.org/10.3847/1538-4365/ab4da1	journal	November 2019

Similar Records

ABACUSSUMMIT: a massive set of high-accuracy, high-resolution N-body simulations

Journal Article · 2021 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1979512

Maksimova, Nina A.; Garrison, Lehman H.; Eisenstein, Daniel J.; +3 more

The halo light-cone catalogues of ABACUSSUMMIT

Journal Article · 2021 · Monthly Notices of the Royal Astronomical Society · OSTI ID:1979521

Hadzhiyska, Boryana; Garrison, Lehman H.; Eisenstein, Daniel; +1 more

The Abacus Cosmos: A Suite of Cosmological N-body Simulations

Journal Article · 2018 · The Astrophysical Journal. Supplement Series (Online) · OSTI ID:1542034

Garrison, Lehman H.; Eisenstein, Daniel J.; Ferrer, Douglas; +3 more

Related Subjects

79 ASTRONOMY AND ASTROPHYSICS
cosmology
methods: numerical
theory

Title: The ABACUS cosmological N-body code

Citation Formats

References (53)

Similar Records

Related Subjects