DOE PAGES title logo U.S. Department of Energy
Office of Scientific and Technical Information

Title: Periodicity significance testing with null-signal templates: reassessment of PTF’s SMBH binary candidates

Journal Article · · Monthly Notices of the Royal Astronomical Society
ORCiD logo [1]; ORCiD logo [2];  [3];  [4];  [4];  [5]
  1. University of California, Berkeley, CA (United States)
  2. Princeton Univ., NJ (United States); Flatiron Institute, New York, NY (United States)
  3. Washington State Univ., Pullman, WA (United States); Foundation for Research & Technology-Hellas, Heraklion (Greece)
  4. Columbia Univ., New York, NY (United States)
  5. University of California, Berkeley, CA (United States); Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)

Periodograms are widely employed for identifying periodicity in time series data, yet they often struggle to accurately quantify the statistical significance of detected periodic signals when the data complexity precludes reliable simulations. We develop a data-driven approach to address this challenge by introducing a null-signal template (NST). The NST is created by carefully randomizing the period of each cycle in the periodogram template, rendering it non-periodic. It has the same frequentist properties as a periodic signal template, and we show with simulations that the distribution of false positives is the same as with the original periodic template, regardless of the underlying data. Thus, performing a periodicity search with the NST acts as an effective simulation of the null (no-signal) hypothesis, without having to simulate the noise properties of the data. We apply the NST method to the supermassive black hole binaries (SMBHB) search in the Palomar Transient Factory (PTF), where Charisi et al. had previously proposed 33 high signal-to-noise candidates utilizing simulations to quantify their significance. Our approach reveals that these simulations do not capture the complexity of the real data. There are no statistically significant periodic signal detections above the non-periodic background. To improve the search sensitivity, we introduce a Gaussian quadrature based algorithm for the Bayes Factor with correlated noise as a test statistic. We show with simulations that this improves sensitivity to true signals by more than an order of magnitude. However, the Bayes Factor approach also results in no statistically significant detections in the PTF data.

Research Organization:
Lawrence Berkeley National Laboratory (LBNL), Berkeley, CA (United States)
Sponsoring Organization:
USDOE Office of Science (SC), High Energy Physics (HEP); USDOE Office of Science (SC), Advanced Scientific Computing Research (ASCR); National Aeronautics and Space Administration (NASA); National Science Foundation (NSF); European Union (EU); Heising-Simons Foundation
Grant/Contract Number:
AC02-05CH11231
OSTI ID:
2479508
Journal Information:
Monthly Notices of the Royal Astronomical Society, Journal Name: Monthly Notices of the Royal Astronomical Society Journal Issue: 2 Vol. 534; ISSN 0035-8711
Publisher:
Oxford University PressCopyright Statement
Country of Publication:
United States
Language:
English

References (46)

Least-squares frequency analysis of unequally spaced data journal February 1976
Human contribution to the European heatwave of 2003 journal December 2004
Relativistic boost as the cause of periodicity in a massive black-hole binary candidate journal September 2015
The effects of human population structure on large genetic association studies journal March 2004
Principal components analysis corrects for stratification in genome-wide association studies journal July 2006
Neyman–Pearson lemma for Bayes factors journal November 2021
Studies in astronomical time series analysis. II - Statistical aspects of spectral analysis of unevenly spaced data journal December 1982
The Palomar Transient Factory: System Overview, Performance, and First Results
  • Law, Nicholas M.; Kulkarni, Shrinivas R.; Dekany, Richard G.
  • Publications of the Astronomical Society of the Pacific, Vol. 121, Issue 886 https://doi.org/10.1086/648598
journal December 2009
Are the Variations in Quasar Optical flux Driven by Thermal Fluctuations? journal May 2009
The Population of Viscosity- and Gravitational Wave-Driven Supermassive Black hole Binaries Among Luminous Active Galactic Nuclei journal July 2009
Quantifying Quasar Variability as part of a General Approach to Classifying Continuously Varying Sources journal December 2009
Modeling the time Variability of sdss Stripe 82 Quasars as a Damped Random walk journal September 2010
The look-elsewhere effect from a unified Bayesian and frequentist perspective journal October 2020
Approximate integration formulas for certain spherically symmetric regions journal January 1963
Candidate Periodically Variable Quasars from the Dark Energy Survey and the Sloan Digital Sky Survey journal September 2020
Matched filtering with non-Gaussian noise for planet transit detections journal April 2021
Ultra-short-period massive black hole binary candidates in LSST as LISA ‘verification binaries’ journal July 2021
Self-calibrating the look-elsewhere effect: fast evaluation of the statistical significance using peak heights journal September 2021
Multimessenger time-domain signatures of supermassive black hole binaries journal December 2021
Accelerating astronomical and cosmological inference with preconditioned Monte Carlo journal August 2022
Searching for quasar candidates with periodic variations from the Zwicky Transient Facility: results and implications journal December 2023
The impact of red noise in radial velocity planet searches: only three planets orbiting GJ 581? journal December 2012
A systematic search for close supermassive black hole binaries in the Catalina Real-time Transient Survey journal August 2015
False periodicities in quasar time-domain surveys journal June 2016
A population of short-period variable quasars from PTF as supermassive black hole binary candidates journal July 2016
Detecting gravitational self-lensing from stellar-mass binaries composed of black holes or neutron stars journal November 2019
Theory of Probability book August 1998
Gravitational Radiation and the Motion of Two Point Masses journal November 1964
Multiband light curves from eccentric accreting supermassive black hole binaries journal November 2022
Analysis of LIGO data for gravitational waves from binary neutron stars journal June 2004
Bayesian (mean) most powerful tests journal November 2016
The effect of red noise on planetary transit detection journal November 2006
Assessing the statistical significance of periodogram peaks journal April 2008
Statistical Methods and Scientific Induction journal January 1955
Transiting Exoplanet Survey Satellite journal October 2014
A Critique of the Bayesian Information Criterion for Model Selection journal February 1999
Statistical Significance Testing for Mixed Priors: A Combined Bayesian and Frequentist Analysis journal September 2022
LSST: From Science Drivers to Reference Design and Anticipated Data Products journal March 2019
Supermassive Black Hole Binary Candidates from the Pan-STARRS1 Medium Deep Survey journal October 2019
Circumbinary Disks: Accretion and Torque as a Function of Mass Ratio and Disk Viscosity journal September 2020
Toward the Unambiguous Identification of Supermassive Binary Black Holes through Bayesian Inference journal September 2020
Quasars with Periodic Variability: Capabilities and Limitations of Bayesian Searches for Supermassive Black Hole Binaries in Time-domain Surveys journal September 2022
Understanding the Lomb–Scargle Periodogram journal May 2018
Did ASAS-SN Kill the Supermassive Black Hole Binary Candidate PG1302-102? journal May 2018
Massive Black Hole Binaries as LISA Precursors in the Roman High Latitude Time Domain Survey preprint January 2023
Observational Signatures of Supermassive Black Hole Binaries preprint January 2023