A Cloud-Native Serverless Approach for Implementation of Batch Extract-Load Processes in Data Lakes

The paper presents an approach to deal with batch extract-load processes for cloud data lakes. The approach combines multiple data ingestion techniques, provides advanced failover strategies and adopts cloud-native implementation. The suggested approach. The prototype implementation utilizes Amazon...

Full description

Saved in:
Bibliographic Details
Published inData Analytics and Management in Data Intensive Domains Vol. 1427; pp. 27 - 42
Main Authors Bryzgalov, Anton, Stupnikov, Sergey
Format Book Chapter
LanguageEnglish
Published Switzerland Springer International Publishing AG 2021
Springer International Publishing
SeriesCommunications in Computer and Information Science
Subjects
Cloud-native applications
Data ingestion
Serverless computing
Online AccessGet full text
ISBN9783030811990
3030811999
ISSN1865-0929
1865-0937
DOI10.1007/978-3-030-81200-3_3

Cover

More Information
Summary:The paper presents an approach to deal with batch extract-load processes for cloud data lakes. The approach combines multiple data ingestion techniques, provides advanced failover strategies and adopts cloud-native implementation. The suggested approach. The prototype implementation utilizes Amazon Web Services platform and is based on its serverless features. The approach can be implemented also using other cloud platforms like Google Cloud Platform or Microsoft Azure.
ISBN:9783030811990
3030811999
ISSN:1865-0929
1865-0937
DOI:10.1007/978-3-030-81200-3_3