Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness
Abstract
ABSTRACT Trend filtering – first introduced into the astronomical literature in Paper I of this series – is a state-of-the-art statistical tool for denoising 1D signals that possess varying degrees of smoothness. In this work, we demonstrate the broad utility of trend filtering to observational astronomy by discussing how it can contribute to a variety of spectroscopic and time-domain studies. The observations we discuss are (1) the Lyman-α (Lyα) forest of quasar spectra; (2) more general spectroscopy of quasars, galaxies, and stars; (3) stellar light curves with planetary transits; (4) eclipsing binary light curves; and (5) supernova light curves. We study the Lyα forest in the greatest detail – using trend filtering to map the large-scale structure of the intergalactic medium along quasar-observer lines of sight. The remaining studies share broad themes of: (1) estimating observable parameters of light curves and spectra; and (2) constructing observational spectral/light-curve templates. We also briefly discuss the utility of trend filtering as a tool for 1D data reduction and compression.
- Authors:
-
[1];
- Department of Statistics and Data Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA, Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213, USA, McWilliams Center for Cosmology, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Department of Statistics and Data Science, Yale University, New Haven, CT 06520, USA
- McWilliams Center for Cosmology, Carnegie Mellon University, Pittsburgh, PA 15213, USA, Department of Physics, Carnegie Mellon University, Pittsburgh, PA 15213, USA, School of Physics, University of Melbourne, VIC 3010, Australia
- Publication Date:
- Sponsoring Org.:
- USDOE
- OSTI Identifier:
- 1595847
- Resource Type:
- Published Article
- Journal Name:
- Monthly Notices of the Royal Astronomical Society
- Additional Journal Information:
- Journal Name: Monthly Notices of the Royal Astronomical Society Journal Volume: 492 Journal Issue: 3; Journal ID: ISSN 0035-8711
- Publisher:
- Oxford University Press
- Country of Publication:
- United Kingdom
- Language:
- English
Citation Formats
Politsch, Collin A., Cisewski-Kehe, Jessi, Croft, Rupert A. C., and Wasserman, Larry. Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness. United Kingdom: N. p., 2020.
Web. doi:10.1093/mnras/staa110.
Politsch, Collin A., Cisewski-Kehe, Jessi, Croft, Rupert A. C., & Wasserman, Larry. Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness. United Kingdom. https://doi.org/10.1093/mnras/staa110
Politsch, Collin A., Cisewski-Kehe, Jessi, Croft, Rupert A. C., and Wasserman, Larry. Tue .
"Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness". United Kingdom. https://doi.org/10.1093/mnras/staa110.
@article{osti_1595847,
title = {Trend filtering – II. Denoising astronomical signals with varying degrees of smoothness},
author = {Politsch, Collin A. and Cisewski-Kehe, Jessi and Croft, Rupert A. C. and Wasserman, Larry},
abstractNote = {ABSTRACT Trend filtering – first introduced into the astronomical literature in Paper I of this series – is a state-of-the-art statistical tool for denoising 1D signals that possess varying degrees of smoothness. In this work, we demonstrate the broad utility of trend filtering to observational astronomy by discussing how it can contribute to a variety of spectroscopic and time-domain studies. The observations we discuss are (1) the Lyman-α (Lyα) forest of quasar spectra; (2) more general spectroscopy of quasars, galaxies, and stars; (3) stellar light curves with planetary transits; (4) eclipsing binary light curves; and (5) supernova light curves. We study the Lyα forest in the greatest detail – using trend filtering to map the large-scale structure of the intergalactic medium along quasar-observer lines of sight. The remaining studies share broad themes of: (1) estimating observable parameters of light curves and spectra; and (2) constructing observational spectral/light-curve templates. We also briefly discuss the utility of trend filtering as a tool for 1D data reduction and compression.},
doi = {10.1093/mnras/staa110},
journal = {Monthly Notices of the Royal Astronomical Society},
number = 3,
volume = 492,
place = {United Kingdom},
year = {2020},
month = {1}
}
Free Publicly Available Full Text
Publisher's Version of Record
https://doi.org/10.1093/mnras/staa110
https://doi.org/10.1093/mnras/staa110
Other availability
Search WorldCat to find libraries that may hold this journal
Cited by: 1 work
Citation information provided by
Web of Science
Web of Science
Save to My Library
You must Sign In or Create an Account in order to save documents to your library.
Works referenced in this record:
A refined measurement of the mean transmitted flux in the Lyα forest over 2 < z < 5 using composite quasar spectra
journal, February 2013
- Becker, George D.; Hewett, Paul C.; Worseck, Gábor
- Monthly Notices of the Royal Astronomical Society, Vol. 430, Issue 3
THE CARNEGIE SUPERNOVA PROJECT: FIRST PHOTOMETRY DATA RELEASE OF LOW-REDSHIFT TYPE Ia SUPERNOVAE
journal, January 2010
- Contreras, Carlos; Hamuy, Mario; Phillips, M. M.
- The Astronomical Journal, Vol. 139, Issue 2
Probing the Universe with the Ly forest -- I. Hydrodynamics of the low-density intergalactic medium
journal, May 1998
- Gnedin, N. Y.; Hui, L.
- Monthly Notices of the Royal Astronomical Society, Vol. 296, Issue 1
On Estimating Regression
journal, January 1964
- Nadaraya, E. A.
- Theory of Probability & Its Applications, Vol. 9, Issue 1
Type Ia Supernova Light Curves
journal, June 2007
- Woosley, S. E.; Kasen, D.; Blinnikov, S.
- The Astrophysical Journal, Vol. 662, Issue 1
Non-Parametric Estimation of a Multivariate Probability Density
journal, January 1969
- Epanechnikov, V. A.
- Theory of Probability & Its Applications, Vol. 14, Issue 1
The NASA Exoplanet Archive: Data and Tools for Exoplanet Research
journal, August 2013
- Akeson, R. L.; Chen, X.; Ciardi, D.
- Publications of the Astronomical Society of the Pacific, Vol. 125, Issue 930
THE COMPOSITE SPECTRUM OF STRONG Lyα FOREST ABSORBERS
journal, November 2010
- Pieri, Matthew M.; Frank, Stephan; Weinberg, David H.
- The Astrophysical Journal, Vol. 724, Issue 1
Intergalactic Helium Absorption in Cold Dark Matter Models
journal, October 1997
- Croft, Rupert A. C.; Weinberg, David H.; Katz, Neal
- The Astrophysical Journal, Vol. 488, Issue 2
A Feature at [CLC][ITAL]z[/ITAL][/CLC] ∼ 3.2 in the Evolution of the L[CLC]y[/CLC]α Forest Optical Depth
journal, January 2003
- Bernardi, Mariangela; Sheth, Ravi K.; SubbaRao, Mark
- The Astronomical Journal, Vol. 125, Issue 1
Mock Quasar-Lyman-α forest data-sets for the SDSS-III Baryon Oscillation Spectroscopic Survey
journal, May 2015
- Bautista, Julian E.; Bailey, Stephen; Font-Ribera, Andreu
- Journal of Cosmology and Astroparticle Physics, Vol. 2015, Issue 05
Fast and Flexible ADMM Algorithms for Trend Filtering
journal, July 2016
- Ramdas, Aaditya; Tibshirani, Ryan J.
- Journal of Computational and Graphical Statistics, Vol. 25, Issue 3
THE CARNEGIE SUPERNOVA PROJECT: INTRINSIC COLORS OF TYPE Ia SUPERNOVAE
journal, June 2014
- Burns, Christopher R.; Stritzinger, Maximilian; Phillips, M. M.
- The Astrophysical Journal, Vol. 789, Issue 1
Comparative Analysis of the High- and Low-Ionization Lines in the Broad-Line Region of Active Galactic Nuclei
journal, May 1996
- Marziani, P.; Sulentic, J. W.; Dultzin-Hacyan, D.
- The Astrophysical Journal Supplement Series, Vol. 104
The Linear Theory Power Spectrum from the Lyα Forest in the Sloan Digital Sky Survey
journal, December 2005
- McDonald, Patrick; Seljak, Uroš; Cen, Renyue
- The Astrophysical Journal, Vol. 635, Issue 2
Evolution of the Intergalactic Opacity: Implications for the Ionizing Background, Cosmic Star Formation, and Quasar Activity
journal, November 2008
- Faucher‐Giguère, Claude‐André; Lidz, Adam; Hernquist, Lars
- The Astrophysical Journal, Vol. 688, Issue 1
The absolute magnitudes of Type IA supernovae
journal, August 1993
- Phillips, M. M.
- The Astrophysical Journal, Vol. 413
Spectral Classification and Redshift Measurement for the Sdss-Iii Baryon Oscillation Spectroscopic Survey
journal, October 2012
- Bolton, Adam S.; Schlegel, David J.; Aubourg, Éric
- The Astronomical Journal, Vol. 144, Issue 5
The Eleventh and Twelfth data Releases of the Sloan Digital sky Survey: Final data from Sdss-Iii
journal, July 2015
- Alam, Shadab; Albareti, Franco D.; Prieto, Carlos Allende
- The Astrophysical Journal Supplement Series, Vol. 219, Issue 1
The solution path of the generalized lasso
journal, June 2011
- Tibshirani, Ryan J.; Taylor, Jonathan
- The Annals of Statistics, Vol. 39, Issue 3
OVERVIEW OF THE KEPLER SCIENCE PROCESSING PIPELINE
journal, March 2010
- Jenkins, Jon M.; Caldwell, Douglas A.; Chandrasekaran, Hema
- The Astrophysical Journal, Vol. 713, Issue 2
Analytic Light Curves for Planetary Transit Searches
journal, December 2002
- Mandel, Kaisey; Agol, Eric
- The Astrophysical Journal, Vol. 580, Issue 2
The Observability of Metal Lines Associated with the Lyα Forest
journal, May 1998
- Hellsten, Uffe; Hernquist, Lars; Katz, Neal
- The Astrophysical Journal, Vol. 499, Issue 1
Kepler Eclipsing Binary Stars. iii. Classification of Kepler Eclipsing Binary Light Curves with Locally Linear Embedding
journal, April 2012
- Matijevič, Gal; Prša, Andrej; Orosz, Jerome A.
- The Astronomical Journal, Vol. 143, Issue 5
An Open Catalog for Supernova Data
journal, January 2017
- Guillochon, James; Parrent, Jerod; Kelley, Luke Zoltan
- The Astrophysical Journal, Vol. 835, Issue 1
The relationship between infrared, optical, and ultraviolet extinction
journal, October 1989
- Cardelli, Jason A.; Clayton, Geoffrey C.; Mathis, John S.
- The Astrophysical Journal, Vol. 345
The one-dimensional Ly α forest power spectrum from BOSS
journal, November 2013
- Palanque-Delabrouille, Nathalie; Yèche, Christophe; Borde, Arnaud
- Astronomy & Astrophysics, Vol. 559
Robust Locally Weighted Regression and Smoothing Scatterplots
journal, December 1979
- Cleveland, William S.
- Journal of the American Statistical Association, Vol. 74, Issue 368
Kepler Planet-Detection Mission: Introduction and First Results
journal, January 2010
- Borucki, W. J.; Koch, D.; Basri, G.
- Science, Vol. 327, Issue 5968
The man Behind the Curtain: X-Rays Drive the uv Through nir Variability in the 2013 Active Galactic Nucleus Outburst in ngc 2617
journal, May 2014
- Shappee, B. J.; Prieto, J. L.; Grupe, D.
- The Astrophysical Journal, Vol. 788, Issue 1
Adaptive piecewise polynomial estimation via trend filtering
journal, February 2014
- Tibshirani, Ryan J.
- The Annals of Statistics, Vol. 42, Issue 1
Sdss-Iii: Massive Spectroscopic Surveys of the Distant Universe, the Milky way, and Extra-Solar Planetary Systems
journal, August 2011
- Eisenstein, Daniel J.; Weinberg, David H.; Agol, Eric
- The Astronomical Journal, Vol. 142, Issue 3
KEPLER 'S FIRST ROCKY PLANET: KEPLER-10b
journal, February 2011
- Batalha, Natalie M.; Borucki, William J.; Bryson, Stephen T.
- The Astrophysical Journal, Vol. 729, Issue 1
LYα FOREST TOMOGRAPHY FROM BACKGROUND GALAXIES: THE FIRST MEGAPARSEC-RESOLUTION LARGE-SCALE STRUCTURE MAP AT z > 2
journal, October 2014
- Lee, Khee-Gan; Hennawi, Joseph F.; Stark, Casey
- The Astrophysical Journal, Vol. 795, Issue 1
The Eighth data Release of the Sloan Digital sky Survey: First data from Sdss-Iii
journal, March 2011
- Aihara, Hiroaki; Allende Prieto, Carlos; An, Deokkeun
- The Astrophysical Journal Supplement Series, Vol. 193, Issue 2
SN 2016coi (ASASSN-16fp): An Energetic H-stripped Core-collapse Supernova from a Massive Stellar Progenitor with Large Mass Loss
journal, September 2019
- Terreran, G.; Margutti, R.; Bersier, D.
- The Astrophysical Journal, Vol. 883, Issue 2
SN 2016coi/ASASSN-16fp: an example of residual helium in a typeIc supernova?
journal, May 2018
- Prentice, S. J.; Ashall, C.; Mazzali, P. A.
- Monthly Notices of the Royal Astronomical Society, Vol. 478, Issue 3
Light-curve classification in massive variability surveys - II. Transients towards the Large Magellanic Cloud
journal, July 2004
- Belokurov, Vasily; Evans, N. Wyn; Le Du, Yann
- Monthly Notices of the Royal Astronomical Society, Vol. 352, Issue 1
Toward a Precise Measurement of Matter Clustering: Lyα Forest Data at Redshifts 2–4
journal, December 2002
- Croft, Rupert A. C.; Weinberg, David H.; Bolte, Mike
- The Astrophysical Journal, Vol. 581, Issue 1
ASASSN-16fp (SN 2016coi): a transitional supernova between Type Ic and broad-lined Ic
journal, September 2017
- Kumar, Brajesh; Singh, A.; Srivastav, S.
- Monthly Notices of the Royal Astronomical Society, Vol. 473, Issue 3
THE CARNEGIE SUPERNOVA PROJECT: LIGHT-CURVE FITTING WITH SNooPy
journal, December 2010
- Burns, Christopher R.; Stritzinger, Maximilian; Phillips, M. M.
- The Astronomical Journal, Vol. 141, Issue 1
Measuring Reddening with Sloan Digital sky Survey Stellar Spectra and Recalibrating sfd
journal, August 2011
- Schlafly, Edward F.; Finkbeiner, Douglas P.
- The Astrophysical Journal, Vol. 737, Issue 2
KEPLER ECLIPSING BINARY STARS. II. 2165 ECLIPSING BINARIES IN THE SECOND DATA RELEASE
journal, October 2011
- Slawson, Robert W.; Prša, Andrej; Welsh, William F.
- The Astronomical Journal, Vol. 142, Issue 5
Neutrino masses and cosmology with Lyman-alpha forest power spectrum
journal, November 2015
- Palanque-Delabrouille, Nathalie; Yèche, Christophe; Baur, Julien
- Journal of Cosmology and Astroparticle Physics, Vol. 2015, Issue 11
The power spectrum of the flux distribution in the Lyman forest of a large sample of UVES QSO absorption spectra (LUQAS)
journal, January 2004
- Kim, T. - S.; Viel, M.; Haehnelt, M. G.
- Monthly Notices of the Royal Astronomical Society, Vol. 347, Issue 2
KEPLER ECLIPSING BINARY STARS. I. CATALOG AND PRINCIPAL CHARACTERIZATION OF 1879 ECLIPSING BINARIES IN THE FIRST DATA RELEASE
journal, February 2011
- Prša, Andrej; Batalha, Natalie; Slawson, Robert W.
- The Astronomical Journal, Vol. 141, Issue 3
SOUSA: the Swift Optical/Ultraviolet Supernova Archive
journal, July 2014
- Brown, Peter J.; Breeveld, Alice A.; Holland, Stephen
- Astrophysics and Space Science, Vol. 354, Issue 1
KEPLER-10 c: A 2.2 EARTH RADIUS TRANSITING PLANET IN A MULTIPLE SYSTEM
journal, October 2011
- Fressin, François; Torres, Guillermo; Désert, Jean-Michel
- The Astrophysical Journal Supplement Series, Vol. 197, Issue 1
A principal component analysis of quasar UV spectra at z ~ 3
journal, May 2011
- Pâris, I.; Petitjean, P.; Rollinde, E.
- Astronomy & Astrophysics, Vol. 530
Pressure support versus thermal broadening in the Lyman α forest - I. Effects of the equation of state on longitudinal structure
journal, March 2010
- Peeples, Molly S.; Weinberg, David H.; Davé, Romeel
- Monthly Notices of the Royal Astronomical Society
Artificial Intelligence Approach to the Determination of Physical Properties of Eclipsing Binaries. I. The EBAI Project
journal, November 2008
- Prša, A.; Guinan, E. F.; Devinney, E. J.
- The Astrophysical Journal, Vol. 687, Issue 1
The Lyman Alpha Forest in the Spectra of Quasistellar Objects
journal, September 1998
- Rauch, Michael
- Annual Review of Astronomy and Astrophysics, Vol. 36, Issue 1
A wavelet analysis of the spectra of quasi-stellar objects
journal, October 2000
- Theuns, T.; Zaroubi, S.
- Monthly Notices of the Royal Astronomical Society, Vol. 317, Issue 4