Managing Storage with a File System

Presented by Keith Packard
Monday 3:40 p.m.–4:10 p.m.
Target audience: Developer

Abstract

Traditional Linux storage is built using several block layers and adding a file system on top. You can construct a block device out of a file system using the loop driver, but that interface loses some key functionality present in the block layer, most importantly the DAX interfaces.

As an alternative, we can squash some of the the loop driver functionality into a file system and present both file system interfaces as well as block device interfaces from the same driver.

This provides a uniform storage management interface where a single 'wholesale' file system aggregates a set of the available storage into a single logical store which can then be arbitrarily dis-aggregated into individual storage volumes which can then be used as traditional block devices for 'retail' file systems within the host OS or passed to virtual machines for storage in that environment.

This technique is being used within The Machine, a project within Hewlett Packard Enterprise, to provide convenient management of a pool of fabric attached memory shared among many Linux instances.

The presentation will show how the wholesale file system is managed and how the block layer is exported from it. Additional details about how storage locality is controlled using extended attributes will be included.

Presented by

Keith Packard

Keith Packard has been developing free software since 1986, working on the X Window System, the Linux kernel and rocketry electronics. He is currently a Distinguished Linux Technologist at Hewlett Packard Enterprise working as the Chief Architect for Linux on The Machine. Keith received a Usenix Lifetime Achievement award in 1999, an O'Reilly Open Source award in 2011, sits on the X.org foundation board and is a member of the Debian Technical Committee. He has spoken at numerous free software events around the world, including Linux Con, the Plumber's Conference, Linux Conf Australia, FOSDEM, FISL, Guadec, Akademy, OSCON among others.

©2016 Linux Australia and linux.conf.au 2017. Linux is a registered trademark of Linus Torvalds. Site design by Takeflight. Image credits can be found on our Colophon.