How to use LTO tape for large project databases correctly? (Avid PC based)

[Brian Merlen]

I am sitting on 40tb of Avid DNXHD 175 X files that need to be backed up. They have been meticulously logged and have a second copy living on another raid 6 array within the same building. The data lives within dated folders from each shoot day, and we shoot tethered directly from Red to Avid via BNC using the capture tool within Avid to log and the Kona 3G card to capture.

We now need to back the whole thing up to LTO. Is there anyway using Windows 7 that we can copy the "Avid Media Files" folder all at once and have the software span it over many tapes automatically and accurately, or must this be a human intensive task of separating each couple days of files into a tape? We were told running uncompressed is safer, so we don't get a lot of room per tape 1.5tb I believe, but this is my first time using LTO (but I used to use HDV, and VHS so I am not completely tape illiterate). I am also weary to break up actual dated Avid folders into various MXFs living on different tapes, so we will need to leave open space per tape rather then break up those folders I believe to their root level and then worry about assembling it and having it re index correctly.

Has anyone here ever done something like this with Avid files? Can anyone throw me a bone lol? Thank you!!!

 

[Todd T]

The most important component will be the backup software you use with the tape drive.
You will not have to separate your files manually, you just tell application whic drives or directories you want backed up and everything will be copied and spanned across the tapes as needed.

 

[roryhinds]

If you're on Windows and not Linux then Retrospect is your best option.
You can set it up to backup the whole 40tb and it will span it over multiply tapes, you'll just have to keep feeding it new tapes when it asks for them.

LTO6 is the latest which can hold 2.5Tb uncompressed. You will mostly always backup uncompressed as the files you're backing up are already compressed into the codec of choice.

 

[Brian Merlen]

How reliable are tapes overall? How many copies do I need to really feel safe?

 

[Nick Fury]

This thread might be useful.:

http://www.reduser.net/forum/showth...roup-ArGest-Asset-(-Edit)-and-Archive-Bundles!

Giving a call to Tolis Group-definitely useful.

Thank you very much

Fury

 

[roryhinds]

Tapes are very reliable, much more so than spinning hard drives. I normally make 1 backup archive to LTO5. I've yet to be let down by a tape backup... touch wood

 

[Jeff Kilgroe]

I always make two copies (LTO) and store them in separate locations. I don't have any real suggestions for PC-based backup software. Tolis Group makes the best tape software for our industry, IMO, but it is Mac-centric. Their BRU Server software runs on the Mac, but has client software for Windows, Mac and Linux. So that's how we offload our content from non-Mac workstations. In PC land, there are lots of options to choose from though. I think going into it right now, I would definitely make sure you go with a solution that supports LTFS tape formatting and writes some redundancy into any backup file format on top of that. The unfortunate aspect of the tape backup world is that it's still stuck in a world of proprietary file structures. Makes it hard to transition from one backup solution to another.

 

[Brian Merlen]

We bought a deck and are using the standard LTFS backup software. Somehow our first tape crashed out and we are looking into it. Were on a small budget here and I don't know if the production would go for software solutions so we opted to manually sit here and move stuff ourselves. Its kind of a pain in the ass(ets) but so be it... if we could just make the darn thing work lol!

 

[Christopher*Seguine]

Brian, some windows LTFS tips for you:

Use FastCopy to make MD5 or CRC verified copies from your raid to the LTO - Its also a faster copy if you dont want to verify.
In the LTFS mounter advanced settings, change it to update the catalog only when the tape is ejected. If your doing verified copies it will spaz out every so often if you dont, just put the drive on a UPS and eject the tape after a copy is finished.
Turn on Hardware compression, counter intuitive for video - but avid mxf files are inefficient and compress well and will increase your copy speeds greatly.

Good choice, LTFS is great, proprietary tape formats like bru and retrospect do not have a future

 

[Brian Merlen]

We already have a Quantum deck and were trying to use Terracopy as our backup checksum program but it keeps crashing out. The firmware on the LTO5 deck is on the newest version. So I am looking for a new program to use. I need checksums done because the 40tb of stock feature a million dollar + project and I just want to be sure everything is safely stored offsite on tape. So I am just looking into other apps, and happily will look into all suggestions! Thanks guys! PS I am not sure I can get the production to swing for a high priced app, we are always facing budgetary issues. So any cheap but reliable solutions are very helpful, because I am not sure I can make them buy a higher end solution, thought I will attempt it...