vBlog: Everyone Should Archive (period)

Everyone should archive, as a means of data management – because storage (both primary and secondary) are growing faster than storage budgets, so you can’t keep doing what you have been doing. Here is a video on the simple math of archiving/grooming your data.

As always, thanks for watching.

Video Transcript

Hi, I'm Jason Buffington, senior analyst at ESG, covering data protection. Everyone should archive, period, even if you don't have compliance mandates. Why? Because production storage is growing at roughly 43% year over year, and secondary storage is growing around 38% year over year, and your storage budget isn't growing by nearly that.

When ESG looked at archiving trends in 2014, we looked at both the preservation side of archiving for compliance retention and the grooming side of archiving where data is moved off of primary storage. Here's what IT pros like you told us. Forty-nine percent of the reasons that you groom or move data is for the benefit of primary storage. As seen in the upper right, 26% for improving primary storage performance, plus the lower left 23% for removing stagnant data. Meanwhile, another 46% of you found the primary benefits including the backup solutions, including the lower right 23% reducing the backup storage pool, plus 12% on the left for improving backup windows because you're not trying to back up all that stagnant data, and another 11% in long term storage capacity savings. All of that yields a much happier backup administrator.

Let's make this real. Assume that you have 1 terabyte of production data which, on average, equates to about 4 terabytes of secondary copies between the fulls, the incrementals, the replicas, snapshots, etcetera. That makes your total footprint 5 terabytes. Now assume 40% year over year primary storage growth. In year two, that 1 terabyte of production storage grows to 1.4, and 4X that now equates to 5.6 terabytes of secondary storage. In year three, we're up to nearly 2 terabytes of production storage and 7.8 terabytes of secondary. That's a total of 9.8 terabytes which is nearly double what we started with. I bet your storage budget isn't doubling every two years.

Let's add archiving. Assume that 30% of your data is stagnant which, by the way, is a very conservative number. That means 300 gig of that original terabyte of production data can be archived, leaving 700 gig of active data. Four times that 700 gig is only 2.8 terabytes of secondary storage. The total footprint is 700 gig of active plus 300 gig of archived plus 2.8 terabytes of secondary. That's 3.8 terabytes total. That's less than the 5 terabytes you're managing now. In year two, another 300 gig is archived. The total archive is 600 gig. The primary storage is 1.1 terabytes of active data. In year three, we're up to 1.5 terabytes of active data and a terabyte of archive. In each case, the secondary storage isn't growing nearly as much, because we're only protecting the active data.

Your numbers will vary. Your primary-secondary ratio will vary based on how you protect your data. Your storage growth numbers will vary based on your users and your applications. Heck, your stagnant data percentage will vary a lot. My guess is that it's even more than what I predicted. Any way you slice it, you will almost undoubtedly find that archiving, grooming, will benefit you in huge ways, regardless of your industry, your compliance mandates, etcetera. Make it part of your protection and management strategy today.

I'm Jason Buffington for ESG. Thanks for watching.

Topics: Storage Data Protection JBuff Information and Risk Management Data Management Jason Buffington Content Management Search Video Archiving