Welcome to our community

Be a part of something great, join today!

  • Hey all, just changed over the backend after 15 years I figured time to give it a bit of an update, its probably gonna be a bit weird for most of you and i am sure there is a few bugs to work out but it should kinda work the same as before... hopefully :)

800GB LTO-4 tape solution for the Mac, A review...

Jeff Kilgroe

Well-known member
Joined
Jan 3, 2007
Messages
17,055
Reaction score
42
Points
48
Location
Colorado
Some of you may have caught my other post to a related thread in the accessories forum... Here is the actual review.

I had been trying to get a good LTO backup solution in place for a while on a Mac Pro tower. When I first started trying to figure this all out, there was very little information out there pertaining to my ideal configuration or anything similar. I wanted to go with a SAS (Serial Attached SCSI) interface rather than conventional SCSI-3. It's more future-proof and provides a much more user-friendly interface without the need for terminations and expensive cables.

One configuration I had my eye on was the Quantum LTO-4HH desktop unit, but could never get any confirmation from Quantum or any software vendors as to whether or not this unit would work on a Mac. Eventually it was pointed out to me by another reduser member (flameop), that this drive does work with the companion LSI SAS controller and the Retrospect backup software. Sure enough, checking with Quantum also confirmed this as they had qulified this drive on OSX since the last time I had looked at it. EMC Insignia had also qualified the drive for their OSX version of Retrospect. I took the plunge and bought one. I recommend doing a search on Nextag.com to pull up the best price. But I bought the drive kit and 5 additional blank tapes (6 tapes total) plus the Retrospect software all for less than $2850 after shipping costs. By comparison, this is roughly double the initial cost of setting up with an LTO-3 system. This kit is also less than half the price of the often recommended LTO-3A that connects via ethernet.

The LTO-4HH comes in a few different bundles, which to buy?

I went with the TC-L42BN-EZ kit. That is the external desktop drive, PCI express SAS controller, a 3ft SAS cable, blank 800GB tape, a cleaning cartridge and Symantec software for the PC.

This kit is also available with everything listed except for the SAS cable. This is the kit (TC-L42BN-EY) you will want if you need a longer SAS cable and it seems to sell for $30 to $50 less.

Other kit options are available for European and Asian markets. There are also internal drive kits available too. The drive (internal or external) can be purchased without the SAS HBA card, however under OSX this is probably not a wise choice to combine it with a different SAS controller. It seems the LSI is one of the few SAS controllers with proper OSX support and the only one that seems compatible with the Quantum LTO drives.

Installation, technical experience needed...

Setting up the drive was a snap. I'm an experienced IT guy, but I didn't have to flex my IT muscles on this one. From the time I started opening the box to the time I was playing around in the backup software to configure a backup set and see if the drive was working, was literally about 5 minutes.

Don't go looking for the instructions, there really aren't any included. Or at least none of any use. Just a small paper that mostly explains how to install the internal unit in case you don't know how to install an internal drive in a PC.

On the Mac, simply power down, install the card in an available slot, connect the drive and power everything on. Done. OSX handles driver support for you. Load the Retrospect software (download latest version from the web).

Operation...

In OSX, tape systems do not show up as other mounted media does. You will find tape drives listed in your system profiler, under their respective host adapters. The drive shows up as Quantum, Ultrium 4, Firmware Rev. 2104, which is current.

The only way to access the drive is with the Retrospect software. Other software solutions are better, and more expensive, but do not currently support this hardware. The good thing about Retrospect 6.1 for the Mac is it's very inexpensive, about $80 for the desktop edition and that covers backup for one workstation plus two networked client systems with the option to buy more client licenses. Buying Retrospect 6.1 now also qualifies for a free upgrade to Retrospect X, which is about to enter beta testing and it is a completely re-written application that appears to be leaps and bounds better than the current software. Retrospect 6.1 also fully supports OSX 10.5.x and is running great here.

With the current software, it's fairly straight-forward to create backup sets and schedule automated jobs, even jobs that span multiple tapes. It's also easy to open the software and do immediate backups with new sets or with pre-defined sets. I can open Retrospect and choose immediate backup, load a tape and choose my RED_Projects set from the menu. It's preset to copy all my R3D project folders (even new ones within the master folder) from my primary RAID and dump it to tape(s), very simple. It comes with a users' guide that's about 1" thick, but honestly, you won't need it. Very simple software, although it is a bit limited or restrictive in some ways.

Retrospect does full file cataloging. Which means that if a specific file or group of files need to be retrieved from a tape, it's easy to do so.

Performance...

This is my biggest complaint about Retrospect on OSX. The software makes little attempt to pre-load and cache files to be backed up. It doesn't attempt to maximize tape throughput. Backing up lots of small files can really slow things down, on my first backup of about 745GB, it took 11 hours to do the backup with a full verify pass. That translates to about 1/4 of the theoretical maximum speed of the tape drive. My drive systems are not a bottleneck as the slower of my two RAIDs can sustain 220MB/s. The faster RAID can sustain almost 450GB/s. Another backup of mostly all very large files has been done since then and I have sustained better than 65% of the advertised speed, which seems decent. That's roughly 75MB/s. But it's hard when Retrospect starts copying as it spins up the tape and then starts to slow the copy operation as it seeks to the next file on the source drives. Like I said, little effort to optimize tape write speed by prepping source data. Hopefully the upcoming Retrospect X will improve on this. This speed issue seems to be the #1 complaint in online forums about Retrospect Mac with the larger and faster tape systems like LTO-3 / LTO-4.

Conclusion...

This is a very nice backup solution onto an industry-standard archival medium. Based on my own experiences in the IT field, spanning more than a dozen years of working with backups and data storage types, I feel very confident in this solution. I would trust it more than archiving to hard drives. When considering costs, this is a very affordable solution, especially as the amounts of data being archived increase. 800GB tapes are about $70-$75 each, which gives them a cheaper $ per GB ratio than hard drives. So it's only a matter of time (or a certain number of tapes) before the cost difference offsets the initial investment into the tape drive kit. Each user will have to run the numbers to see if this solution is right for them. The legacy LTO-3 format may be a better fit for many as the tapes are still cheaper per GB (although the gap is closing fast) and the drives are less than half the cost of the LTO-4 units.

I am very pleased so far. My primary complaint is the speed I'm experiencing with Retrospect, but it is a known issue. I find the convenience of having 800GB of tape backup right at my desktop to outweigh the speed concerns as my backups can be done in off hours and I rarely back up a full 800GB in one shot. The only other complaint I have is the fan noise from this unit.

The internal cooling fan, which is on 100% all times this unit is powered on, is stupidly loud. I feel Quantum should have and could have done a lot better here. Considering this drive is intended for desktop use in an office environment, it seems odd they didn't try harder. On the bright side, I only have to power it on when I go to make a backup -- just don't forget to have it powered-up if you have a scheduled backup! It's not an advertised feature, but the drive can be powered on and off independently of the host system. SAS supports hot-plug devices as part of the standard. Make sure all cables are properly connected before powering on though! The drive itself does not support any of the SAS power features like power control and standby modes, etc.. Which would have been very nice for this external desktop unit. Given the noise issue, I would be tempted to order the internal drive kit and find a third-party enclosure to house it. Unfortunately, I have done some looking (not extensive looking) and have not found a proper enclosure. It needs an enclosure to accommodate a 5.25" Half Height drive (like a typical optical drive). The catch is finding one with a SAS interface.

All things considered, this is a very user-friendly solution that is both cost-effective and appears to be very reliable. For anyone who will be making regular backups of large amounts of data, I highly recommend investigating this option. As with all LTO formats (with the exception of the LTO-3A series), this drive is backward compatible and can read and write LTO-3 and LTO-2 tapes. It provides read-only access to LTO-1 media.
 
Not meaning to appear stupid, but what are the differences between LTO 3 and LTO 4. And thanks for the very helpful review.
Rob Gardner
 
Jeff,

Do you know if "TOLIS Tape Tools" from the makers of Bru works with the Quantum LTO-4 drives?

I have Prospect, but I want to be able to send tapes with clients in a form they can retrieve. TAR is the only universal tool for doing that.

I guess Prospect is cheap enough that any client should be able to buy it.


Mahalo,
Dusty
 
Glad you got sorted Jeff.

Our 1st archive was a full 790Gig and with a full verify took 6 hours.

this was a 3 project folders with everything from edls/audio files/ maya files/ shake scripts to large HD QT's so a usual backupset for us. So given the poor performance compared to the new osx version thats due out I'm pleased with the system... just need to get it off my desk and into a xrack now :)

Cheers

Si
 
Nice write up, thanks for taking the time.
I'm using LTO3 on Mac.

Anyone know of a SAS ExpressCard 34 for the MacBook Pro?
 
The mech is esata on the back. So an esata 34 should suffice. You'd probably need to house the deskside and extend the esata cable out the back. Or replace the esata>sas with a simple esata external.

s
 
  • Thread starter
  • Moderator
  • #7
Jeff,

Do you know if "TOLIS Tape Tools" from the makers of Bru works with the Quantum LTO-4 drives?

Dustin,

This is one question I'm hoping to answer very soon. Tolis tape tools software is not available in demo form. I have emailed Tolis Group and I'm awaiting a response. I can download their workstation software demo to see if it works as I think hardware support is consistent between all their programs.

Over the next several days I will be trying a few different software options with the tape system to see what works and what doesn't. Since most tape drives on OSX do not have specific OS level driver support, it is entirely up to the software makers to support any drives they choose. It seems that most LTO-3 SCSI drives are supported these days via ATTO or ARECA SCSI HBAs, but which HBA depends on which tape drive and which software we're talking about. None of this is very universal. LTO-4 support is still sketchy at best and it seems that Tandberg LTO-4 SCSI units are well supported by ATempo. Retrospect also supports HP drives, but only with ATTO SCSI controllers. Ultimately, the Tolis Group software would be an ideal solution for me as well. For long term archival, I would much prefer a tar volume rather than some software vendor's proprietary data container.
 
  • Thread starter
  • Moderator
  • #9
Anyone know of a SAS ExpressCard 34 for the MacBook Pro?

I don't know of any and I've looked. I don't think this unit would be a good solution for field use due to the long backup times (several hours even if we could match the full speed). IMO, this unit would be a poor fit for a Macbook Pro. You need a decent RAID to feed the drive. And that RAID would have to be accessed over Gigabit ethernet or Firewire 800 if you have a SAS controller in the EC34 slot. It would work, it just wouldn't be an elegant solution. I'm actually going to back up my Macbook Pro and another workstation tonight over gig-ethernet via the Retrospect client software, I'll see how it goes.

The mech is esata on the back. So an esata 34 should suffice. You'd probably need to house the deskside and extend the esata cable out the back. Or replace the esata>sas with a simple esata external.

Yes, but the drive mechanism is still a full SAS interface as far as I can tell. I don't think you could drive it from a SATA host. SAS and SATA often use the same internal connectors and cabling, but are not compatible. Some SAS controllers offer dual-mode (SAS and SATA) support, but only one or two obscure controllers allow mixed mode device installs and I don't know of any drives that function with either host interface. SAS to SATA cables, usually fan-out cables, don't convert between the standards... It's just that SAS and SATA share the same standard connector and cables (SAS having additional options) and we often see SATA hosts using mini-SAS connectors so that multiple SATA ports can be located on one plug.
 
FYI-I have the same setup as Jeff and agree with him 100% on this review. The only difference is that I have it connected to an Intel XServe. Same LSI card and drive.

Good stuff. Works flawlessly so far...gives me great confidence that the files are safe (unlike on a firewire drive).

Kevin
 
Yes, we have a 14 x 750 XRaid hooked in with that Server & LTO4.

Kevin
 
Hello,

Just wanted to say thanks, Jeff! I've used the Exabyte Magnum LTO-3 1x7 drive in the past at a clients location.

I needed something here and the Quantum kit worked out perfectly. Picked it up from ProVantage (www.provantage.com) and it's working great.

Takes a bit to back up 8 terrabytes, but it's worth the wait!

Best,

ATF
 
HI Jeff, I agree with your detail and experience similar. This may help. I have the following Quantum Ultrium4 LTO desktop HH desktop/external tape drive model number : TC-L42BN-EY

http://www.quantum.com/Products/TapeDrives/LTOUltrium/LTO-4HH/Index.aspx

I dont have RED ONE but have all Panasonic P2 workflow.. same issues you guys have with lousy cheap spinning disk that will eventually fail and have done so :(

I want to ARCHIVE not backup = there's a huge difference. ARchive with TWO instances!

I wanted something that is ONLY OSX based.

My setup:
•*MACPRO 8 core 3.0 [dual quad core] 8GB (v1) - OSX 10.5.4
•* Quantum Ultrium4 LTO desktop HH desktop/external tape drive model number : TC-L42BN-EY
• ATTO EXPRESSSAS R380 HBA (used for QUANTUM Ultrium SAS/IF TAPE DRIVE)
• SAS cable: SFF-8088-SFF-8088 from MACPRO (ATTO) to QUANTUM tape drive
• some ultrium Imation Ultrium LTO4 cartridges ($HK540 each = 800GB [no compression here!]
• demo copy of TOLISGROUP BRU LE for OSX - functions very similar.

Software:
•*looked around and TolisGroup have a pending BRU Producer Edition pending release http://www.tolisgroup.com/products/macosx/pe/. This is what I will buy. The BRU PE is specifically for content producers with contemporary media workflows and contemporary media formats (CMF) like P2 with DVCPROHD and RED R3D etc. I have had emails form TolisGroup and they are very very helpful. I hope to engage their beta programme ASAP.
• for a demo, just go download TOLISGROUP BRU LE (for OSX) and try it out. It looks good. Remember I am waiting for BRU "PRODUCERS Edition" -
• looked at 'bundles" of the QUANTUM desktop HH SAS drive, however there being many I was limited to someone that would ship internationally form usa. I found the people at Http://www.digitape.com to be very competitive, prompt and helpful. THey shipped me the QUANTUM bundle straight to Hong Kong..from $USD86.00 I recall came in 2-3 days from usa.

Quantum Bundle:
• nothing to get excitded about. Large box weighting 4-5KG mostly fiuy of air and styrene. You get..this
• Quantum, HH SAS i/f tape drive - model TC-L42BN-EY (all colours = black)
• miniSAS cable SFF-8088-to-SFF8470 which is useless for me as I need SFF-8088toSF8088. ($HK530 each)
• some pc software from ye olde from Symantec (Veritas) Backup Exec

Need t make sure that SAS HBA is compatible with software you're going to use. TolisGroup recommend ATTO and possibly LSI (need to chat with them). I have the ATTO R380 SAS RAID card/HBA so I'm ok.

Ideally for a 'perfect' archive workflow it would be nice to have a OSX based MAM such as CATDV or something that would have an interface to TOLISGROUP - maybe Tolis's Producers Edition has some nice proxy viewing or search.. I dunno.

My workflow is to
• PULL the P2 contents from camera to disk (drag and drop)., such that the P2 contents etc are maintained on a disk array.
• archive the P2 contents under a strict naming regime. (this is why I would like MAM integration such as in FLASHNET™ (sgluk.com) for example)
• then use FCP to log and transfer from disk array.
• I always maintain two instances of the content.
• once completed i will make a second INSTANCE of the P2 on another Ulrium4 tape volume (multi object/file). U;trium like most tape drives since 1970's support multifiled tape volumes. (locate block and fsp command)

Other software:
• well as an old RETROSPECT customer from the 1990's it really is lousy software for what it is supposed to be.
• additional software for OSX is around but these are mostly clients
• TOLISGROUP is OSX based in that like RETROSPECT it can directly control the tape drives. For a larger setup then maybe a LINUX based server and then there are many out three.
• SGL's FLASHNET™ has a flavour that is also OSX based but this is more an that I can afford for a single user. It is very good and also controls Large Tape libraries (robots using everyone's MEdiaExchanger API) and has interfaces to UNITY an QUANTEL and loads of BVS's etc etc.

QUANTUM HH ULTRIUM LTO4
• my fan is quiet... well is not annoying at all.
• turn the tape drive on when I need it.


Summary:
• like yourself I have may many years in I.T. even going back to the dark days as an IBM MVS internals developer. The thing is that TAPE drives are slow for ACCESS compared to other mediums. However if you have the issues where DISK is really cheap and thus build to fail, you need to have something else and a single instance for me does NOT cut it!

I lost on two separate occasions over 8 months 2 x 1TB Le CIe 1TB external FW disks due to bad power supplies. Completely corrupted and could not be recovered. I lost some priceless source from P2 because I only had one instance. Sad, but I am not going to be burnt again by power consuming spinning cheap disk.

TCO:
• well initially for $USD2800 I get into the system which excludes shipment from usa. (www.digitape.com)
• software for BRU Production Edition is yet to be decided but I think this will be under $USD200 for a single user.. just a guess.
•*tape medium - buy from Taiwan (Imation or FUJI) you can get it for under $USD65 for 800GB. (remember the Ultrium LTO4 will compress and claim 1.6TB using string compressor but this is nonsense for the already compressed stuff such as RED and P2 workflow and other stuff already compressed).
• so unlike disk, the cost of the archive per HOUR_of_CODEC/GB get CHEAPER the bigger it gets! SO your cost I guess around $USD0.08GB or in RED ONEWORLD you could say at 288/Mbs = around 2.16GB/min ; ~130GB/hour using $USD65/800GB tape cartridge @ $USD0.08/GB = $USD10.50 per hour to store one instance!...certainly cheaper and more reliable than cheap disk.

Access times:
• assume 800M tape length
• load and ready 10 seconds
•*locate block at 10Msec to 50% of the tape t access first lock (assume object is 50% n centre of tape voluem so gotta locate to that first block using SCSI LOCATE BLOCK command).
•*time to read in 30 mins at 288Mbs come to (click click)
• actual data on my system is around 95MBs - Quantum claim 120 .. I guess I should look in to it a bit (blocksize related maybe??)
•*682+10+65= 750 seconds = 12mins ish

hth

Warwick
Hong Kong
 
There was a fanboy vs troll war going on and suddenly a tech forum broke out...

There was a fanboy vs troll war going on and suddenly a tech forum broke out...

Shout out to Jeff & Warwick for the great info. Judging by the opaque market-speak I've been subjected to, Quantum appears to have little clue about the utility of their products in our market. BTW, what is your estimate of the user friendliness quotient of the described solution?

IT pros only.

IT pro sets it up and gives the user an orientation session.

Sophisticated user willing to crack a manual can handle it.

Ape-like creatures able, when sober, to balance on two legs are, quite frankly, overqualified.

Just askin' :detective2:
 
Shout out to Jeff & Warwick for the great info. Judging by the opaque market-speak I've been subjected to, Quantum appears to have little clue about the utility of their products in our market. BTW, what is your estimate of the user friendliness quotient of the described solution?

IT pros only.

IT pro sets it up and gives the user an orientation session.

Sophisticated user willing to crack a manual can handle it.

Ape-like creatures able, when sober, to balance on two legs are, quite frankly, overqualified.

Just askin' :detective2:

Hi Blair, YEah, Quantum. Been dealing with them recently and know a lot of them in their WW org.

Happily there are a small group of Quantum people that know some of the M&E business and also POST. Maybe there are two people in their entire organisation that I know where you can have a technical conversation about content creation workflow and post work and they will be at IBC2008.

However most of their "media and entertainment" guys are splashing around SNFS and SNSM but don't know the processes or M&E components and base their business crediibility on a few sound bites.

Same for the major I.T and storage companies.. very few have a clue I think. This is changing though!

Yes, Quantum usually have a squad of STORNEXT arbitrated file system experts with the mantra that SAN FC based filesystems are wonderful for M&E [dropping sound bite phrases in the conversation such as HD, Four-Kay (MAry Kay?), 2K, 2-DOGS etc etc but none really knows the data tape side application for M&E.

BTW there's a clever switched on guy from USA in SUN/Storagetek (Tom ??) that knows his stuff in this content creation industry.

I think Quantum (and some of their data storage competitors) are becoming wise about this CMW (contemporary media workflow) with not only the cameras such as RED and P2 etc and are looking for some additional business without just selling their 'pots and pans".

Also HP are doing the same.

Anyway, keep your head up on this.:clown2:

I think this (archiving FAT content on data tape with multiple instances) is really the way to go until some other long term 'container' shows up other than spinning disk.

More news as it happens.

fwiw
 
Back
Top