Adaptive Data Transfers that Utilize Policies for Resource Sharing

With scientific data collected at unprecedented volumes and rates, the success of large scientific collaborations requires that they provide distributed data access with improved data access latencies and increased reliability to a large user community. The goal of the ADAPT (Adaptive Data Access an...

Full description

Saved in:
Bibliographic Details
Published in2012 SC Companion: High Performance Computing, Networking Storage and Analysis pp. 547 - 555
Main Authors Junmin Gu, Smith, David, Chervenak, Ann L., Sim, Alex
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.11.2012
Subjects
adaptation
data transfers
passive performance monitoring
policy
resource sharing
Online AccessGet full text

Cover

More Information
Summary:With scientific data collected at unprecedented volumes and rates, the success of large scientific collaborations requires that they provide distributed data access with improved data access latencies and increased reliability to a large user community. The goal of the ADAPT (Adaptive Data Access and Policy-driven Transfers) project is to develop and deploy a general-purpose data access framework for scientific collaborations that provides fine-grained and adaptive data transfer management and the use of site and VO policies for resource sharing. This paper presents our initial design and implementation of an adaptive data transfer framework. We also present preliminary performance measurements showing that adaptation and policy improve network performance.
ISBN:9781467362184
1467362182
DOI:10.1109/SC.Companion.2012.78