NSDF-FUSE: A Testbed for Studying Object Storage via FUSE File Systems

Paula Olaya, Jakob Lüttgau, Naweiluo Zhou, Jay F. Lofstead, Giorgio Scorzelli, Valerio Pascucci, Michela Taufer

Abstract: This work presents NSDF-FUSE, a testbed for evaluating settings and performance of FUSE-based file systems on top of S3-compatible object storage; the testbed is part of a suite of services from the National Science Data Fabric (NSDF) project (an NSF-funded project that is delivering cyberinfrastructures for data scientists). We demonstrate how NSDF-FUSE can be deployed to evaluate eight different mapping packages that mount S3-compatible object storage to a file system, as well as six data patterns representing different I/O operations on two cloud platforms. NSDF-FUSE is open-source and can be easily extended to run with other software mapping packages and different cloud platforms.