Mountain West Farm Bureau Insurance
office workers empowered by business technology solutions
BLOG
2
25
2016
12.18.2020

What is Cloud Storage Durability & Do You Really Need 11 Nines?

Last updated:
9.16.2020
12.18.2020
No items found.
Strong hard drive

Cloud storage, especially object storage, is often marketed by touting its “durability,” with many providers boasting eleven or thirteen “nines”, in other words 99.999999999% reliability. It sounds great—as close to 100% reliable as you can get. But what is durability in relation to storage, and do you really need those eleven nines?

All storage resides on an underlying media, in most cases hard disk drives, and in some cases flash storage arrays. Regardless of where the media is located within the data center, different technologies can access it, split it up, and share it among different hosting products. You can read more about types of cloud storage to see how the primary platforms of file, block, and object differ.

Durability is a measurement of the tiny errors that occur in files due to these underlying media. When you write, read, and rewrite gigabytes, terabytes, and petabytes of information to the same drive, one or more individual bytes can get corrupted or lost.

Not every service provider even offers a durability rating as it can be difficult to measure and guarantee. A more important question to ask your cloud hosting provider is about how they are protecting against data loss generally. What technologies are in play? What are your odds of recovering data? How can you tie in backup?

 

Object Storage & Erasure Coding

For object storage, which is designed around storing massive quantities of files, especially media-rich files like documents, images, and video, durability becomes especially important. Once you reach the petabytes, dropping even a single nine of durability, say from 99.999999999% to 99.99999999% might mean losing 90 or 200 extra files in the case of data loss.

One method of fighting byte loss is erasure coding. When a file is copied to cloud storage, erasure coding splits it up and adds an extra piece of the file that is a duplicate. This means that when a single file is lost, it can be reconstructed from the pieces spread across the entire storage area.

So instead of worrying about the number of nines, which is hard to prove anyway, ask if erasure coding or another backup method is available to ensure the availability of your data at all times.

Erasure coding may not be available for all forms of cloud storage, however. Deduplication is another way that copies can be kept without storing two complete duplicate versions of every file for every backup. The system only copies newly changed files to your backup, keeping the storage footprint down. If the backup is corrupted, it can not be reconstructed, unlike erasure coding, but a deduped backup of block or file storage is a good way to hedge your bets against data loss.

A full copy is also faster to restore than one rebuilt from erasure-coded storage.

 

What Files Can Stand Lower Durability?

When planning your cloud storage, the vital questions become “What type of storage is best suited for my environment?” and  “Can this data stand reduced durability?” Critical business data that you need for daily operations should absolutely have a full backup and preferably multiple backups in geographically separated data centers.

If you have lower file volume, in the gigabytes or a few terabytes, durability is much less important, as losing a few bytes and corrupted files will be much smaller proportionally compared to a petabyte or exabyte environment.

Recent Blog Posts

lunavi logo alternate white and yellow
7.21.2021
07
.
19
.
2021
How Lunavi Approaches Digital Transformation: HostingAdvice Company Profile

For prospective clients and partners, the history, ethos, and capabilities of a vendor are paramount. HostingAdvice.com recently profiled Lunavi to explore our approach.

Learn more
lunavi logo alternate white and yellow
5.20.2021
04
.
26
.
2021
Test Automation Best Practices: Balancing Confidence with Efficiency

Automation can instill confidence to release software and improve the team’s ability to create high-quality applications in the fastest and most efficient way possible. Essentially, it eliminates the need to compromise or choose one set of priorities over another. Instead, it allows teams to strike a balance between confidence/coverage and speed/efficiency. But automation isn’t a one-size-fits-all solution.

Learn more
lunavi logo alternate white and yellow
4.20.2021
04
.
20
.
2021
Building Your Cloud Foundation Part 1: Core Configuration & Governance

This first area of focus establishes your cloud policy, or the way your organization consumes and manages cloud resources. Learn how to establish proper scope and mitigate tangible risks through corporate policy and standards.

Learn more