EOS developments

• Published in: Journal of physics. Conference series Vol. 898; no. 6; pp. 62032 - 62039
• Main Authors: Sindrilaru, Elvin A, Peters, Andreas J, Adde, Geoffray M, Duellmann, Dirk
• Format: Journal Article
• Language: English
• Published: Bristol IOP Publishing 01.10.2017
• Subjects: CERN; Disk drives; Performance measurement; Physics; Synchronism; User experience; User interfaces
• ISSN: 1742-6588; 1742-6596
• DOI: 10.1088/1742-6596/898/6/062032

CERN has been developing and operating EOS as a disk storage solution successfully for over 6 years. The CERN deployment provides 135 PB and stores 1.2 billion replicas distributed over two computer centres. Deployment includes four LHC instances, a shared instance for smaller experiments and since last year an instance for individual user data as well. The user instance represents the backbone of the CERNBOX service for file sharing. New use cases like synchronisation and sharing, the planned migration to reduce AFS usage at CERN and the continuous growth has brought EOS to new challenges. Recent developments include the integration and evaluation of various technologies to do the transition from a single active in-memory namespace to a scale-out implementation distributed over many meta-data servers. The new architecture aims to separate the data from the application logic and user interface code, thus providing flexibility and scalability to the namespace component. Another important goal is to provide EOS as a CERN-wide mounted filesystem with strong authentication making it a single storage repository accessible via various services and front- ends (/eos initiative). This required new developments in the security infrastructure of the EOS FUSE implementation. Furthermore, there were a series of improvements targeting the end-user experience like tighter consistency and latency optimisations. In collaboration with Seagate as Openlab partner, EOS has a complete integration of OpenKinetic object drive cluster as a high-throughput, high-availability, low-cost storage solution. This contribution will discuss these three main development projects and present new performance metrics.