The growth of computing power of large-scale HPC clusters has lead to the need for large high-bandwidth I/O systems. However, directly writing the large and bursty datasets to centralized parallel file systems can raise significant I/O contention issues on storage servers. To meet this requirement, high speed, local storage layers – Burst Buffers are being deployed in next-generation supercomputers. In this paper, we introduce the design of a burst buffer library integrated at the MPI layer – Hyper Burst Buffer (HBB) designed for aggregated write operations.

• Share on LinkedIn
• Share on Facebook
• Share on Twitter
• Print the Article