Evaluation of probabilistic photometric redshift estimation approaches for The Rubin Observatory Legacy Survey of Space and Time (LSST)

Journal
Date Issued
2020
Author(s)
Schmidt, S. J.
•
Malz, A. I.
•
Soo, J. Y. H.
•
Almosallam, I. A.
•
•
•
Cohen-Tanugi, J.
•
Connolly, A. J.
•
DeRose, J.
•
Freeman, P. E.
•
Graham, M. L.
•
Iyer, K. G.
•
Jarvis, M. J.
•
Kalmbach, J. B.
•
Kovacs, E.
•
Lee, A. B.
•
Longo, G.
•
Morrison, C. B.
•
Newman, J. A.
•
Nourbakhsh, E.
•
Nuss, E.
•
Pospisil, T.
•
Tranin, H.
•
Wechsler, R. H.
•
Zhou, R.
•
Izbicki, R.
•
LSST Dark Energy Science Collaboration
DOI
Abstract
Many scientific investigations of photometric galaxy surveys require redshift estimates, whose uncertainty properties are best encapsulated by photometric redshift (photo-z) posterior probability density functions (PDFs). A plethora of photo-z PDF estimation methodologies abound, producing discrepant results with no consensus on a preferred approach. We present the results of a comprehensive experiment comparing 12 photo-z algorithms applied to mock data produced for The Rubin Observatory Legacy Survey of Space and Time Dark Energy Science Collaboration. By supplying perfect prior information, in the form of the complete template library and a representative training set as inputs to each code, we demonstrate the impact of the assumptions underlying each technique on the output photo-z PDFs. In the absence of a notion of true, unbiased photo-z PDFs, we evaluate and interpret multiple metrics of the ensemble properties of the derived photo-z PDFs as well as traditional reductions to photo-z point estimates. We report systematic biases and overall over/underbreadth of the photo-z PDFs of many popular codes, which may indicate avenues for improvement in the algorithms or implementations. Furthermore, we raise attention to the limitations of established metrics for assessing photo-z PDF accuracy; though we identify the conditional density estimate loss as a promising metric of photo-z PDF performance in the case where true redshifts are available but true photo-z PDFs are not, we emphasize the need for science-specific performance metrics.
Volume
499
Issue
2
Start page
1587
Uri
Url
Issn Identifier
0035-8711
Ads BibCode
2020MNRAS.499.1587S
Rights
open.access
File(s)
Loading...
Thumbnail Image
Name

staa2799.pdf

Description
PDF editoriale
Size

4.65 MB

Format

Adobe PDF

Checksum (MD5)

2e96397896983ecfbb91ba764cb0f9c6