The Need for a New I/O Model

Abstract

Data-intensive applications performance is typically bounded by the time needed to transfer data through the storage and memory hierarchy. The traditional I/O model considers a two-level memory hierarchy with a fast internal memory of bounded size (memory) and a slow unbounded external memory (storage). This modeling approach closely describes reality when two key underlying assumptions hold: (i) disk reads and writes have similar cost, and (ii) applications can perform one I/O at a time. However, none of these assumptions are not true for solid-state disks (SSD) because of two fundamental SSD properties: (i) read/write asymmetry (writes are slower than reads) and (ii) concurrency (multiple I/Os can be processed because of high internal parallelism). The question we set out to answer is: How should the I/O model be adapted in light of read/write asymmetry and concurrency? We need a richer I/O model that can capture contemporary state-of-the-art (and future) devices by parameterizing asymmetry and concurrency. By capturing the device asymmetry and concurrency, we can make device-specific decisions at algorithm design time, rather than as an optimization during deployment and testing. Specifically, we envision better algorithm design for almost any component of a system that interacts with storage.


Proceedings of the Annual Conference on Innovative Data Systems Research (CIDR), 2021
Tarikul Islam Papon, Manos Athanassoulis

Local PDF | Official PDF | Project Website