Setup for managing large amounts of TB's?

Capo Dei Capi · Feb 14, 2015

I currently have 7 harddrives with 7.1TB of external HDD storage and 2 external HDD with an aditional 7TB for a total of 14.1 TB of storage. What kind of setup should I go for to back my files up as well as manage the files easier so I can get rid of duplicate files as well as make it easier to add more storage in the future.

2 of my harddrives are going to be 6 years old in a few weeks so I'm kinda of getting worried about data loss.

theRevolt · Feb 14, 2015

Well you could buy the 5TB and larger and run them in Raid. Usually unlikely for both to fail at the same time. That is of course if you value your files more than the additional cost. I'd use the oldest drives for the not so important stuff that you can easily re-download.

silvermember · Feb 14, 2015

bloody hell and i thought i was crazy lol

I suggest before you get the plates on a new system copy your stuff on new HDD's, I have once lost a external plate by just lying around for month but that could be a manufacture failure as well!! However I suggest best for duplicate files is to remove them manually ( yeah a lot of work for you now) I always be behind that and do quality checks so I safe space in first place. As well you could cloud it but I guess this is not an option as it would be the case for most of us.

be safe and good luck

davids355 · Feb 14, 2015

How have you got so much data? is it all constantly used? Can you get it into the cloud? Good storage would be expensive. Best way would be file server with raid.

or hosted equivilant if you have a fast connection.

Capo Dei Capi · Feb 14, 2015

neu009 said:
Well you could buy the 5TB and larger and run them in Raid. Usually unlikely for both to fail at the same time. That is of course if you value your files more than the additional cost. I'd use the oldest drives for the not so important stuff that you can easily re-download.

I think I may go with 4TB since they are cheaper,plus I've seen better reviews.

Are Surveillance HDD's good for long term data storage compared to NAS storage drives

http://www.newegg.com/Product/Product.aspx?Item=N82E16822178505&cm_re=4TB-_-22-178-505-_-Product

vs

http://www.newegg.com/Product/Product.aspx?Item=N82E16822145912&cm_re=4TB-_-22-145-912-_-Product#top

Capo Dei Capi · Feb 15, 2015

davids355 said:
How have you got so much data? is it all constantly used? Can you get it into the cloud? Good storage would be expensive. Best way would be file server with raid.

or hosted equivilant if you have a fast connection.

I probably have about 9TB of it used up, and since my home internet connection can only do 4mbps upload(But I only get around 3.6mbps stable over a long period) It would take me about 225 days to upload to a storage provider not counting slow downs,power outages etc. I've been thinking about RAID, but some people have claimed that RAID isn't good for storage.

BillyPart · Feb 15, 2015

STKMKTFTGRU said:
I've been thinking about RAID, but some people have claimed that RAID isn't good for storage.

RAID stripe is bad because if you lose one drive you lose ALL the data on all drives. RAID 10 (stripe + mirror) is good for both speed and data redundancy. I would discourage any consideration of external USB drives as they are unreliable.

You might look into an NAS. Also consider most HD's die as a result of bad power.

Capo Dei Capi · Feb 16, 2015

I think I will go with a 10 bay hot swap enclosure, since I'll have room for up to 60TB.

http://www.tigerdirect.com/applications/SearchTools/item-details.asp?EdpNo=8066427

Setup for managing large amounts of TB's?

Capo Dei Capi

BANNED

theRevolt

Jr Vip

silvermember

Regular Member

davids355

Super Moderator

Capo Dei Capi

BANNED

Capo Dei Capi

BANNED

BillyPart

Newbie

Capo Dei Capi

BANNED

Main Menu

Marketplace

Making Money

BlackHatWorld

Other