DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Beyond Fisher forecasting for cosmology

Journal Article · · Physical Review. D.
ORCiD logo [1]; ORCiD logo [2]; ORCiD logo [3]; ORCiD logo [2]
  1. Southern Methodist Univ., Dallas, TX (United States); Southern Methodist University
  2. Southern Methodist Univ., Dallas, TX (United States)
  3. Southern Methodist Univ., Dallas, TX (United States); Univ. of Illinois at Urbana-Champaign, IL (United States). National Center for Supercomputing Applications (NCSA). Center for AstroPhysical Surveys

The planning and design of future experiments rely heavily on forecasting to assess the potential scientific value provided by a hypothetical set of measurements. The Fisher information matrix, due to its convenient properties and low computational cost, provides an especially useful forecasting tool. However, the Fisher matrix only provides a reasonable approximation to the true likelihood when data are nearly Gaussian distributed and observables have nearly linear dependence on the parameters of interest. Also, Fisher forecasting techniques alone cannot be used to assess their own validity. Thorough sampling of the exact or mock likelihood can definitively determine whether a Fisher forecast is valid, though such sampling is often prohibitively expensive. Here we propose a simple test, based on the Derivative Approximation for likelihoods (DALI) technique, to determine whether the Fisher matrix provides a good approximation to the exact likelihood. We show that the Fisher matrix becomes a poor approximation to the true likelihood in regions where two-dimensional slices of level surfaces of the DALI approximation to the likelihood differ from two-dimensional slices of level surfaces of the Fisher approximation to the likelihood. We demonstrate that our method accurately predicts situations in which the Fisher approximation deviates from the true likelihood for various cosmological models and several data combinations, with only a modest increase in computational cost compared to standard Fisher forecasts.

Research Organization:
Southern Methodist Univ., Dallas, TX (United States)
Sponsoring Organization:
USDOE
Grant/Contract Number:
SC0010129
OSTI ID:
2339508
Journal Information:
Physical Review. D., Journal Name: Physical Review. D. Journal Issue: 10 Vol. 107; ISSN 2470-0010
Publisher:
American Physical Society (APS)Copyright Statement
Country of Publication:
United States
Language:
English

References (63)

Breaking the spell of Gaussianity: forecasting with higher order Fisher matrices journal May 2014
Extending the Fisher Information Matrix in Gravitational-wave Data Analysis journal June 2022
Information geometry for multiparameter models: new perspectives on the origin of simplicity journal December 2022
Inadequacies of the Fisher information matrix in gravitational-wave parameter estimation journal October 2013
On the validity of cosmological Fisher matrix forecasts journal September 2012
CMB power spectrum parameter degeneracies in the era of precision cosmology journal April 2012
Information geometry in cosmological inference problems journal January 2021
Conservative constraints on early cosmology with M ONTE P YTHON journal February 2013
Karhunen‐Loeve Eigenvalue Problems in Cosmology: How Should We Tackle Large Data Sets? journal May 1997
Geometry of nonlinear least squares with applications to sloppy models and optimization journal March 2011
A 6% measurement of the Hubble parameter at z ∼0.45: direct evidence of the epoch of cosmic re-acceleration journal May 2016
Nested Sampling
  • Skilling, John
  • BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING: 24th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering, AIP Conference Proceedings https://doi.org/10.1063/1.1835238
conference January 2004
Constraints on the redshift dependence of the dark energy potential journal June 2005
Current Cosmological Constraints from a 10 Parameter Cosmic Microwave Background Analysis journal November 2000
One Percent Determination of the Primordial Deuterium Abundance journal March 2018
Likelihood analysis of CMB temperature and polarization power spectra journal May 2008
Using Pantheon and DES supernova, baryon acoustic oscillation, and Hubble parameter data to constrain the Hubble constant, dark energy dynamics, and spatial curvature journal April 2021
The effects of He I λ10830 on helium abundance determinations journal July 2015
Inference from Iterative Simulation Using Multiple Sequences journal November 1992
On the Mathematical Foundations of Theoretical Statistics journal January 1922
Efficient Computation of Cosmic Microwave Background Anisotropies in Closed Friedmann‐Robertson‐Walker Models journal August 2000
The Logic of Inductive Inference journal January 1935
Efficient sampling of fast and slow cosmological parameters journal May 2013
Extremely expensive likelihoods: a variational-Bayes solution for precision cosmology journal March 2023
PArthENoPE revolutions journal February 2022
Cosmology with the largest galaxy cluster surveys: going beyond Fisher matrix forecasts journal February 2013
Probing small-scale baryon and dark matter isocurvature perturbations with cosmic microwave background anisotropies journal November 2021
The clustering of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey DR14 quasar sample: first measurement of baryon acoustic oscillations between redshift 0.8 and 2.2 journal October 2017
Age-dating luminous red galaxies observed with the Southern African Large Telescope journal February 2017
Beware of commonly used approximations. Part I. Errors in forecasts journal October 2020
Beware of commonly used approximations. Part II. Estimating systematic biases in the best-fit parameters journal October 2020
Multimodal nested sampling: an efficient and robust alternative to Markov Chain Monte Carlo methods for astronomical data analyses: Multimodal nested sampling journal January 2008
Raising the bar: new constraints on the Hubble parameter with cosmic chronometers at z ∼ 2 journal April 2015
PArthENoPE reloaded journal December 2018
PArthENoPE: Public algorithm evaluating the nucleosynthesis of primordial elements journal June 2008
Generalisations of Fisher Matrices journal June 2016
The impact of new d(p,γ)3 rates on Big Bang Nucleosynthesis journal March 2021
Nested sampling for general Bayesian computation journal December 2006
Cosmological-parameter determination with microwave background maps journal July 1996
Cosmic chronometers: constraining the equation of state of dark energy. I: H ( z ) measurements journal February 2010
Forecasts of non-Gaussian parameter spaces using Box-Cox transformations: Forecasts of non-Gaussian parameter spaces journal June 2011
Ultra-compact structure in intermediate-luminosity radio quasars: building a sample of standard cosmological rulers and improving the dark energy constraints up to z ~ 3 journal September 2017
MultiNest: an efficient and robust Bayesian inference tool for cosmology and particle physics journal October 2009
Review of Particle Physics journal August 2020
A fast, always positive definite and normalizable approximation of non-Gaussian likelihoods journal August 2015
Cosmological parameters from CMB and other data: A Monte Carlo approach journal November 2002
Cobaya: code for Bayesian analysis of hierarchical physical models journal May 2021
The clustering of galaxies in the completed SDSS-III Baryon Oscillation Spectroscopic Survey: cosmological analysis of the DR12 galaxy sample journal March 2017
Towards a cosmological neutrino mass detection journal December 2015
Theory of Statistical Estimation journal July 1925
Low redshift baryon acoustic oscillation measurement from the reconstructed 6-degree field galaxy survey journal September 2018
Improved constraints on the expansion rate of the Universe up to z ∼ 1.1 from the spectroscopic evolution of cosmic chronometers journal August 2012
A mathematical Examination of the Methods of determining the Accuracy of Observation by the Mean Error, and by the Mean Square Error journal June 1920
Constraints on dark energy dynamics and spatial curvature from Hubble parameter and baryon acoustic oscillation data journal July 2018
Dark Energy Survey Year 1 results: measurement of the baryon acoustic oscillation scale in the distribution of galaxies to redshift 1 journal December 2018
Baryon acoustic oscillation, Hubble parameter, and angular size measurement constraints on the Hubble constant, dark energy dynamics, and spatial curvature journal July 2019
Bayesian methods for cosmological parameter estimation from cosmic microwave background measurements journal June 2001
Four new observational H ( z ) data from luminous red galaxies in the Sloan Digital Sky Survey data release seven journal September 2014
The Simons Observatory: science goals and forecasts journal February 2019
The Completed SDSS-IV Extended Baryon Oscillation Spectroscopic Survey: Baryon Acoustic Oscillations with Ly α Forests journal October 2020
The benefits of CMB delensing journal April 2022
Why are Nonlinear Fits to Data so Challenging? journal February 2010
Cosmological constraints from H  ii starburst galaxy, quasar angular size, and other measurements journal November 2021

Similar Records

Cosmology with the largest galaxy cluster surveys: going beyond Fisher matrix forecasts
Journal Article · 2013 · Journal of Cosmology and Astroparticle Physics · OSTI ID:22282918

On the validity of cosmological Fisher matrix forecasts
Journal Article · 2012 · Journal of Cosmology and Astroparticle Physics · OSTI ID:22279934

SURVEY DESIGN FOR SPECTRAL ENERGY DISTRIBUTION FITTING: A FISHER MATRIX APPROACH
Journal Article · 2012 · Astrophysical Journal · OSTI ID:22020474