We got a $5,500 TAPE DRIVE!

Linus Tech Tips ·Linus Tech Tips ·2019-05-06 · 1,586 words · ~7 min read
Floatplane YouTube

Transcript

JSON SRT VTT 202
0:00 Okay, so obviously our devious plan
0:05 to back up our entire petabyte server
0:07 to Google Drive's cheap unlimited tier
0:10 was going to hit a snag at some point.
0:13 And from talking to Wendell over at Level One Text,
0:15 that point seems to be at about 150 terabytes of storage
0:19 when they start throttling you,
0:21 like literally throttling you.
0:22 So fine then, it's okay,
0:25 because we had a backup plan anyway.
0:28 Why store your data in the cloud
0:30 when you can store it on tapes?
0:43 So take off all your clothes.
0:50 This is the MagStore TRB3-HL8,
0:54 a Thunderbolt 3 equipped tape reader
0:57 that even in 2018 costs about 10 times more
1:01 than your mom or dad's hi-fi did back in the 1980s.
1:05 Yes, my friends, this puppy will run you about $6,000
1:10 for the single deck version
1:12 or $9,000 for the single deck version.
1:12 $9,000 for a dually.
1:16 So how on earth does that make any sense?
1:20 Let's start this story by backing up a little bit.
1:24 Ah, I get it.
1:25 So when I was growing up,
1:27 the way to archive data long-term was using optical media.
1:32 So the CD was high on its victory
1:34 over the cassette in the music industry.
1:36 I think I have a CD around here somewhere.
1:39 Oh, yes, optical media, remember that?
1:44 Anyway, CDs were slow and inconvenient to create,
1:49 assuming that you could afford a CD burner at all,
1:52 but their massive capacity meant that compared to floppy disks,
1:56 oh, I have those too, check it out,
2:00 compared to floppy disks and even zip disks,
2:03 you could store what felt like an unlimited amount
2:07 of at least certain types of files.
2:08 Because remember that a 1.44 megabyte floppy,
2:12 minus formatting overhead, could only store like a handful,
2:15 of even basic things like homework assignments.
2:19 Over time though, portable hard drives,
2:20 which have come down in cost dramatically
2:22 over the last decade or two,
2:24 and cloud storage, which is undeniably more convenient
2:27 for small backup jobs,
2:29 have gradually displaced optical media.
2:32 In spite of the booster shots
2:34 that optical disks have gotten along the way,
2:36 like rewritable capabilities,
2:38 the capacity upgrades that DVD and Blu-ray brought,
2:41 there's just a practical limit to how small you can make
2:45 the little bumps on these plastic and foil Frisbees
2:48 before the cost to make them just stops making sense.
2:52 But that doesn't mean that the expensive drive,
2:57 cheap media model is dead at all.
2:59 In fact, all this time, quietly in the background,
3:03 tape storage has been alive and well in the enterprise space
3:08 with even modern supercomputers,
3:10 like the SFU Cedar installation that we toured last year,
3:14 being equipped with
3:15 state-of-the-art tape libraries.
3:17 This product is a little different though.
3:20 So it's the same actual drive
3:22 that you would find in a data center.
3:23 They're actually all made by IBM these days
3:26 and then rebadged.
3:27 So it's LTO8, which means that each of your tapes
3:30 is gonna have a total of 12 terabytes of storage.
3:34 Now, there is this 30 terabytes on here,
3:37 but that assumes that whatever data you're putting on it
3:40 is highly compressible,
3:41 so that would not apply to the kind of media
3:44 that we would be backing up, in fact,
3:45 for most things.
3:46 Very few people use it.
3:47 So 12 terabytes is really what you can count on.
3:50 And then it also means, LTO8,
3:52 that we are compatible with either these LTO8 tapes
3:56 or LTO7.
3:57 Normally, you would get two generations
3:59 of backwards compatibility,
4:01 but there was a materials change to barium ferrite
4:04 that made that impractical this time around.
4:07 All right, so why did they put all this work
4:12 into creating a Thunderbolt 3 enclosure,
4:15 for a tape drive?
4:18 Well, for people like me,
4:21 who have hundreds of terabytes of data,
4:25 but who don't necessarily need lightning-fast access to it.
4:29 So what we're gonna do is give it a try.
4:33 Now, when I first set this up,
4:34 I actually did it on a Windows machine,
4:37 but quite frankly, I wouldn't really recommend that.
4:41 It's not a fantastic experience.
4:43 There's this whole annoying rigmarole to get the drivers,
4:46 installed, you have to disable driver signature enforcement,
4:49 you gotta make some changes in the BIOS.
4:51 It's a real hassle, but once you do get it working,
4:55 assuming that you can find an app that cooperates,
4:57 there are some driver issues on Windows as well,
5:00 it is a lot more painless than it used to be.
5:03 Now, in the old days with tape drives,
5:06 you used to have to take all the files
5:08 that you wanted to archive,
5:09 wrap them up into another type of file
5:12 called a .tar file or a tar ball.
5:15 And then if you wanted to pull anything off of it,
5:17 you had to pull the whole thing off
5:19 and then you could pick out the one file that you needed.
5:22 Now, it's basically drag and drop.
5:24 So whether you're using Finder or Windows Explorer,
5:28 it's a much more seamless experience.
5:31 Let's go ahead and load this puppy in.
5:33 Sound delightfully retro.
5:39 That was so cool.
5:40 Listen to it go.
5:44 So it takes like 30 seconds or so to initialize,
5:47 but we're just gonna enjoy those sounds together.
5:51 So the thing about tape
5:59 is that it has to be read from and written to linearly.
6:04 There's no read-write head that can jump around on the media
6:07 and obviously, unlike solid state storage,
6:09 it can't just grab an address and pull the data directly.
6:13 So you're gonna hear a lot of it reeling and un-reeling tape
6:17 whenever you use the thing.
6:19 So this is a piece of software called MyLTO.
6:22 They have a more advanced version called Pre-Roll Post
6:25 that has a bunch of database features,
6:27 but basically what this is,
6:29 you don't, strictly speaking, need it,
6:31 but what it is is it's a piece of software
6:33 for helping you keep all of your backups organized.
6:36 So in the event that you wanna go back and pull
6:38 like an old news story or something to refer back to it,
6:41 you know exactly where to go, which labeled tape to pull,
6:44 and where exactly in the folder structure you would find
6:47 the files that you're looking for.
6:50 It's gonna take a couple minutes here
6:51 to figure out exactly how much data
6:53 is in this folder on our NAS on the Vault.
6:55 So this is pulling off a petabyte project.
6:56 So this is pulling off a petabyte project.
6:56 So this is pulling off a petabyte project.
6:57 So this is pulling off a petabyte project.
6:57 So this is pulling off a petabyte project.
6:58 So that took about 20 minutes,
7:00 but the bottleneck here is just our network connection
7:02 to the Vault.
7:03 So now we can go ahead and begin.
7:19 So as you get to breaks in files,
7:21 you're gonna hear it kind of rev down,
7:22 but in general, we're able to do anywhere
7:25 from about 150 to 200 and small change megabytes per second.
7:30 from about 150 to 200 and small change megabytes per second.
7:32 And that's over the network.
7:34 You can actually do as much as 300 megabytes per second
7:37 under ideal conditions.
7:38 So if you like me were thinking initially when you saw this,
7:42 well, Thunderbolt 3, 40 gigabit per second,
7:44 like is that kind of an overkill interface for this?
7:47 The answer is actually not as much as you might think.
7:52 So there's still about 15 hours left
7:57 in order to copy about four terabytes of data.
8:01 And I believe it typically quotes this
8:03 in terms of copy time.
8:05 There's also a verification process
8:07 that it has to go through
8:08 that takes almost as long as the initial copy.
8:10 So to be clear,
8:13 it's not like you're gonna be editing video
8:16 off something like this or anything like that.
8:18 Like if you have to grab one file
8:20 that's on one end of the tape
8:21 and then one file that's on the other one,
8:23 the whole thing has to spool through.
8:25 Like it's crazy slow.
8:28 But while there is still a purpose
8:31 to having quick access to a lot of our footage,
8:33 so it's not like the vault is going anywhere.
8:36 So over Thunderbolt with a 10 gigabit network,
8:38 So over Thunderbolt with a 10 gigabit network,
8:38 we can easily back up an entire tape
8:42 over the course of a day.
8:44 And the costs compared to hard drives in Storinators
8:48 start to make a lot of sense
8:50 once you get over about the 100 to 200 terabyte range.
8:55 Add to that that these things are rated
8:57 at a 30 year shelf life,
9:01 compare that to hard drives whose lubrication
9:03 will kind of wear out and seep away,
9:06 causing them to die over time.
9:08 And tape might just be the way forward for us.
9:13 So thanks for watching guys.
9:14 If you disliked this video, you can hit that button.
9:17 But who couldn't like that sound?
9:20 But if you liked it, hit like, get subscribed,
9:22 or maybe consider checking out
9:23 where to buy the stuff we featured
9:24 at the link in the video description.
9:26 Also down there is our merch store,
9:27 which has cool shirts like this one
9:29 and our community forum, which you should definitely join.