Dynamic Deployment of Scientific Workflows in the Cloud Using Container Virtualization

Scientific workflows are increasingly being migrated to the Cloud. However, workflow developers face the problem of which Cloud to choose and, more importantly, how to avoid vendor lock-in. This is because there are a range of Cloud platforms, each with different functionality and interfaces. In thi...

Full description

Saved in:
Bibliographic Details
Published in2016 IEEE International Conference on Cloud Computing Technology and Science (CloudCom) pp. 269 - 276
Main Authors Qasha, Rawaa, Cala, Jacek, Watson, Paul
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.12.2016
Subjects
Buildings
Cloud computing
Container virtualization
Containers
Dynamic deployment
Libraries
Scientific workflow
TOSCA
Virtualization
Online AccessGet full text

Cover

More Information
Summary:Scientific workflows are increasingly being migrated to the Cloud. However, workflow developers face the problem of which Cloud to choose and, more importantly, how to avoid vendor lock-in. This is because there are a range of Cloud platforms, each with different functionality and interfaces. In this paper we propose a solution - a system that allows workflows to be portable across a range of Clouds. This portability is achieved through a new framework for building, dynamically deploying and enacting workflows. It combines the TOSCA specification language and container-based virtualization. TOSCA is used to build a reusable and portable description of a workflow which can be automatically deployed and enacted using Docker containers. We describe a working implementation of our framework and evaluate it using a set of existing scientific workflows that illustrate the flexibility of the proposed approach.
ISSN:2380-8004
DOI:10.1109/CloudCom.2016.0052