Back To Schedule
Tuesday, July 9 • 10:10am - 10:40am
The Case for Dual-access File Systems over Object Storage

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Object storage has emerged as a low-cost and hyper-scalable alternative to distributed file systems. However, interface incompatibilities and performance limitations often compel users to either transfer data between a file system and object storage or use inefficient file connectors over object stores. The result is growing storage sprawl, unacceptably low performance, and an increase in associated storage costs. One promising solution to this problem is providing dual access, the ability to transparently read and write the same data through both file system interfaces and object storage APIs. In this position paper we argue that there is a need for dual-access file systems over object storage, and examine some representative use cases which benefit from such systems. Based on our conversations with end users, we discuss features which we believe are essential or desirable in a dual-access object storage file system (OSFS). Further, we design and implement an early prototype of Agni, an efficient dual-access OSFS which overcomes the shortcomings of existing approaches. Our preliminary experiments demonstrate that for some representative workloads Agni can improve performance by 20%--60% compared to either S3FS, a popular OSFS, or the prevalent approach of manually copying data between different storage systems.


Kunal Lillaney

Johns Hopkins University

Vasily Tarasov

IBM Research-Almaden

David Pease

IBM Research-Almaden

Randal Burns

Johns Hopkins University

Tuesday July 9, 2019 10:10am - 10:40am PDT
HotStorage: Grand Ballroom I–III