Why we’re loving VAST Data Universal Storage – it’s the secret sauce!

Why we’re loving VAST Data Universal Storage – it’s the secret sauce!

Recently Intel published a user case study on our usage of Intel Optane storage and the new storage paradigm that VAST Data Universal Storage is bringing to market.

VAST’s promise of “no compromises” has certainly resulted in faster IO, less interruptions to our cloud customers, and greater reliability and resilience.  In short, I think it is fantastic.

BUT, what is VAST’s secret sauce?  What makes it different and special?

Apart from offering a full flash, enterprise-grade storage solution at near spinning disk prices, the real smarts are buried deep within the storage.  

VAST is built on a high-performance, high-duty cycle Intel Optane cache in front of a huge amount of QLC Flash storage.  Once data has stopped changing, it is migrated from the Optane to the QLC.  It is this process where the really, really clever stuff happens.  

Because VAST rewrites the data, the storage is able to make a multitude of decisions about how to stripe, place, dedup, compress, protect, and optimise –  which isn’t normally possible with traditional block or object storage.  It can apply policies to allow the storage administrator to adjust these steps, thereby optimising the storage on a case-by-case basis.

The clever use of NVMe-oF means that the rewrite process can occur safely in the background, without incurring a performance or integrity penalty to the thousands of clients beating away on the front-side servers.

By leveraging RoCE (RDMA over converged ethernet), they can deliver low-latency, high-bandwidth access to data without imposing a high CPU load on the client or server.

From a Linux perspective, having access to the storage via NFS reduces the administrative overhead.  There is no need to build third-party kernel modules, which may or may-not be up-to-date with kernel versions and patch levels.

NFS is the most tested network file system in the Linux/Unix world.  It works across all Linux distributions, across architectures, and even to MacOS and Windows.

Bundling all this together in an appliance means the storage is simple to administer and easy to live with.

VAST Storage hasn’t just changed the way we store data, it is changing our relationship with data. 

VAST allows new and novel ways to interact with data and gives us, and our customers, greater insights as a result.

By Stuart Midgley

Stuart Midgley is DUG's CIO and self-confessed "mad scientist". He holds a PhD in theoretical physics and is a world expert in high-performance computing. Stuart designed and developed the DUG Cool system of immersive cooling technology and was instrumental in the construction of DUG's world-class greenest data centres on earth. He's just as handy behind a BBQ. After all, he owns 17 of them.

DUG Technology