I/O Acceleration via Multi-Tiered Data Buffering and Prefetching

• Published in: Journal of computer science and technology Vol. 35; no. 1; pp. 92 - 120
• Main Authors: Kougkas, Anthony, Devarajan, Hariharan, Sun, Xian-He
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.01.2020; Springer; Springer Nature B.V; Department of Computer Science, Illinois Institute of Technology, Chicago 60616, U.S.A
• Subjects: Analysis; Artificial Intelligence; Buffers; Computer Science; Data Structures and Information Theory; Design; External pressure; Heterogeneity; Information Systems Applications (incl.Internet); Metadata; Middleware; Redundancy; Regular Paper; Software Engineering; Supercomputers; Theory of Computation; Workflow; Workloads; layered buffering; hierarchical data prefetching; deep memory hierarchy; heterogeneous buffering; data-centric architecture; I/O buffering; burst buffers

Modern High-Performance Computing (HPC) systems are adding extra layers to the memory and storage hierarchy, named deep memory and storage hierarchy (DMSH), to increase I/O performance. New hardware technologies, such as NVMe and SSD, have been introduced in burst buffer installations to reduce the...