Incorporating Measurement Error in Astronomical Object Classification

• Published in: The Astronomical journal Vol. 164; no. 1; pp. 6 - 19
• Main Authors: Shy, Sarah, Tak, Hyungsuk, Feigelson, Eric D., Timlin, John D., Babu, G. Jogesh
• Format: Journal Article
• Language: English
• Published: Madison The American Astronomical Society 01.07.2022; IOP Publishing
• Subjects: Astronomical data; Astronomy; Astrostatistics techniques; Astrostatistics tools; Bayesian statistics; Celestial bodies; Classification; Classifiers; Error analysis; Machine learning; Normal distribution; Quasars; Simulation; Sky surveys (astronomy); Support vector machines; Uncertainty
• ISSN: 0004-6256; 1538-3881
• DOI: 10.3847/1538-3881/ac6e64

Abstract Most general-purpose classification methods, such as support-vector machine (SVM) and random forest (RF), fail to account for an unusual characteristic of astronomical data: known measurement error uncertainties. In astronomical data, this information is often given in the data but discarded because popular machine learning classifiers cannot incorporate it. We propose a simulation-based approach that incorporates heteroscedastic measurement error into an existing classification method to better quantify uncertainty in classification. The proposed method first simulates perturbed realizations of the data from a Bayesian posterior predictive distribution of a Gaussian measurement error model. Then, a chosen classifier is fit to each simulation. The variation across the simulations naturally reflects the uncertainty propagated from the measurement errors in both labeled and unlabeled data sets. We demonstrate the use of this approach via two numerical studies. The first is a thorough simulation study applying the proposed procedure to SVM and RF, which are well-known hard and soft classifiers, respectively. The second study is a realistic classification problem of identifying high- z (2.9 ≤ z ≤ 5.1) quasar candidates from photometric data. The data are from merged catalogs of the Sloan Digital Sky Survey, the Spitzer IRAC Equatorial Survey, and the Spitzer-HETDEX Exploratory Large-Area Survey. The proposed approach reveals that out of 11,847 high- z quasar candidates identified by a random forest without incorporating measurement error, 3146 are potential misclassifications with measurement error. Additionally, out of 1.85 million objects not identified as high- z quasars without measurement error, 936 can be considered new candidates with measurement error.