A Gateway to Astronomical Image Processing: Vera C. RubinObservatory LSST Science Pipelines on AWS

The Legacy Survey of Space and Time, operated by the Vera C. Rubin Observatory, is a 10-year astronomical survey due to start operations in 2022 that will image half the sky every three nights. LSST will produce ~20TB of raw data per night which will be calibrated and analyzed in almost real time. G...

Full description

Saved in:
Bibliographic Details
Published inarXiv.org
Main Authors Bektesevic, Dino, Hsin-Fang Chiang, Kian-Tat Lim, Miller, Todd L, Thain, Greg, Jenness, Tim, Bosch, James, Salnikov, Andrei, Connolly, Andrew
Format Paper
LanguageEnglish
Published Ithaca Cornell University Library, arXiv.org 11.11.2020
Subjects
Algorithms
Image processing
Reprocessing
Sky surveys (astronomy)
Web services
Online AccessGet full text

Cover

More Information
Summary:The Legacy Survey of Space and Time, operated by the Vera C. Rubin Observatory, is a 10-year astronomical survey due to start operations in 2022 that will image half the sky every three nights. LSST will produce ~20TB of raw data per night which will be calibrated and analyzed in almost real time. Given the volume of LSST data, the traditional subset-download-process paradigm of data reprocessing faces significant challenges. We describe here, the first steps towards a gateway for astronomical science that would enable astronomers to analyze images and catalogs at scale. In this first step we focus on executing the Rubin LSST Science Pipelines, a collection of image and catalog processing algorithms, on Amazon Web Services (AWS). We describe our initial impressions on the performance, scalability and cost of deploying such a system in the cloud.
ISSN:2331-8422