WEBVTT 00:00:00.240 --> 00:00:01.760 Just over a year ago, 00:00:01.760 --> 00:00:06.360 we deployed an insane solution to our storage problem. 00:00:06.360 --> 00:00:08.560 The petabyte project. 00:00:08.560 --> 00:00:11.240 A petabyte of raw archival storage. 00:00:11.240 --> 00:00:13.680 I mean, that thing is freaking awesome. 00:00:13.680 --> 00:00:16.540 We have yet to have any problems with it, 00:00:16.540 --> 00:00:20.980 but there's still a major issue with this deployment. 00:00:20.980 --> 00:00:23.900 It's not geo-redundant at all, 00:00:23.900 --> 00:00:25.900 which means that if there were a fire 00:00:25.900 --> 00:00:27.820 in the Linus Media Group warehouse, 00:00:27.820 --> 00:00:30.560 or I mean really any kind of natural disaster, 00:00:30.560 --> 00:00:34.880 we could potentially lose our entire back catalog. 00:00:34.880 --> 00:00:38.580 That is anything that we haven't already uploaded to YouTube. 00:00:38.580 --> 00:00:41.840 So we endeavored to find a way to, 00:00:41.840 --> 00:00:44.020 as inexpensively as possible, 00:00:44.020 --> 00:00:46.540 back up the entire server. 00:00:46.540 --> 00:00:51.540 That's all 370 terabytes of currently stored data, 00:00:52.140 --> 00:00:55.280 plus anything we would wanna add in the future. 00:00:55.280 --> 00:00:57.600 So that's easy enough, right? 00:00:58.970 --> 00:01:02.990 You know what else is easy? 00:01:02.990 --> 00:01:06.710 Your move over to a better chair, 00:01:06.710 --> 00:01:08.170 like the ones from Noble Chairs. 00:01:08.170 --> 00:01:10.630 Their icon series real leather edition gaming chair 00:01:10.630 --> 00:01:11.670 was designed in Germany 00:01:11.670 --> 00:01:13.910 and inspired by luxury car interiors. 00:01:13.910 --> 00:01:15.750 Learn more at the link below. 00:01:15.750 --> 00:01:17.970 Just hope they weren't inspired by like the trunk 00:01:17.970 --> 00:01:29.420 of a luxury car, because that'd be very uncomfortable. 00:01:29.420 --> 00:01:30.740 Now there are a lot of different ways 00:01:30.740 --> 00:01:32.560 that we could go about backing up our server. 00:01:32.560 --> 00:01:35.020 Some of them easier and some of them harder than others, 00:01:35.020 --> 00:01:38.380 but almost all of them are gonna be limited 00:01:38.380 --> 00:01:39.020 by water. 00:01:39.020 --> 00:01:42.100 One thing, our internet bandwidth. 00:01:42.100 --> 00:01:42.940 I mean, don't get me wrong. 00:01:42.940 --> 00:01:44.620 We have a symmetric gigabit connection. 00:01:44.620 --> 00:01:45.540 I'm not complaining, 00:01:45.540 --> 00:01:49.140 but when you're talking about hundreds of terabytes 00:01:49.140 --> 00:01:50.720 that are already in the archive, 00:01:50.720 --> 00:01:55.160 and then up to a couple of terabytes a day being added, 00:01:55.160 --> 00:01:59.400 things can start to take a while, like months a while. 00:01:59.400 --> 00:02:03.320 Now, our first idea was to build something locally, 00:02:03.320 --> 00:02:07.240 fill it up with data here using our 10 gigabit network, 00:02:07.240 --> 00:02:09.340 and then ship it off site. 00:02:09.340 --> 00:02:11.860 A sort of like, ah, thank you, Jake. 00:02:11.860 --> 00:02:12.860 Oh, wow. 00:02:12.860 --> 00:02:15.040 Petabyte project part two. 00:02:15.040 --> 00:02:18.460 Now, this solution wouldn't actually 00:02:18.460 --> 00:02:21.900 expand our storage capacity, because it would just 00:02:21.900 --> 00:02:25.940 be an identical server, or that is to say two servers, 00:02:25.940 --> 00:02:27.700 with the same data on it. 00:02:27.700 --> 00:02:30.680 But since our internet service provider offers us 00:02:30.680 --> 00:02:33.740 inexpensive co-location, it would actually 00:02:33.740 --> 00:02:37.340 be very cost effective from an ongoing standpoint. 00:02:37.460 --> 00:02:40.500 Except for one small problem. 00:02:40.500 --> 00:02:45.500 If we had to buy two more decked out 60 drive store-inators, 00:02:45.960 --> 00:02:48.520 we'd be looking at, with the drives included, 00:02:48.520 --> 00:02:53.100 upwards of 70,000 US dollars. 00:02:53.100 --> 00:02:55.360 So, converted to Canadian rubles, 00:02:55.360 --> 00:03:00.360 that is getting dangerously close to six figure territory. 00:03:00.600 --> 00:03:01.900 You can take that away. 00:03:01.900 --> 00:03:04.840 So, that eliminates hard drives. 00:03:04.840 --> 00:03:05.680 You good? 00:03:05.680 --> 00:03:06.520 Yeah. 00:03:06.520 --> 00:03:07.360 Okay, just remember, lift with your back, 00:03:07.360 --> 00:03:08.700 the twisting, jerking motion. 00:03:08.700 --> 00:03:10.300 Yeah, I was working on that. 00:03:10.300 --> 00:03:12.820 So, that eliminates hard drives. 00:03:12.820 --> 00:03:14.500 What about tape storage? 00:03:14.500 --> 00:03:18.220 A rack mount tape library, like this one from HP Enterprise, 00:03:18.220 --> 00:03:21.000 only costs about five to $7,000. 00:03:21.000 --> 00:03:24.600 And high capacity 12 terabyte LTO8 tapes 00:03:24.600 --> 00:03:27.200 are about 160 bucks a piece. 00:03:27.200 --> 00:03:32.200 So, for over 500 terabytes of uncompressed backup capacity, 00:03:33.480 --> 00:03:36.560 that's actually looking pretty good by comparison. 00:03:36.560 --> 00:03:37.400 But, 00:03:37.460 --> 00:03:39.680 there's the fact that we'd need two of them, 00:03:39.680 --> 00:03:42.820 and it looks like we're still spending 00:03:42.820 --> 00:03:47.360 well over 20,000 US dollars up front. 00:03:47.360 --> 00:03:49.860 Lump sum, throw that on the black card. 00:03:49.860 --> 00:03:51.780 You know how it is. 00:03:51.780 --> 00:03:56.600 So, hardware-based solutions are not looking too peachy. 00:03:56.600 --> 00:03:59.640 What about, shoot, what's it called? 00:03:59.640 --> 00:04:04.320 It's kind of like buzzword-y, disruptive, blockchain. 00:04:04.320 --> 00:04:05.160 No. 00:04:05.160 --> 00:04:06.960 Oh, oh, oh, cloud! 00:04:06.960 --> 00:04:08.240 Cloud storage. 00:04:08.260 --> 00:04:11.080 You guys were all shrieking at us 00:04:11.080 --> 00:04:13.720 back when we originally built Petabyte Project 00:04:13.720 --> 00:04:17.180 for not using cloud storage for our archive 00:04:17.180 --> 00:04:18.640 in the first place. 00:04:18.640 --> 00:04:21.140 So, I think this is where you come in. 00:04:21.140 --> 00:04:24.940 We're gonna check out some AWS here, there, buddy. 00:04:24.940 --> 00:04:28.120 This is Glacier, so this is like slow. 00:04:28.120 --> 00:04:30.140 Start the download. 00:04:30.140 --> 00:04:31.860 Okay, so if we just wanted to back up everything 00:04:31.860 --> 00:04:32.700 we've got right now. 00:04:32.700 --> 00:04:34.680 How many-ish terabytes? 00:04:34.680 --> 00:04:36.620 $1,500 a month. 00:04:36.620 --> 00:04:38.000 Wow. 00:04:38.000 --> 00:04:38.840 Plus support. 00:04:38.840 --> 00:04:39.680 Oh, yeah. 00:04:39.680 --> 00:04:40.500 You know, you need support. 00:04:40.500 --> 00:04:41.340 Yeah. 00:04:41.340 --> 00:04:42.180 1,667. 00:04:42.180 --> 00:04:46.520 So, if we wanted to store the full, what is it? 00:04:46.520 --> 00:04:48.500 About 760 terabytes that we have? 00:04:48.500 --> 00:04:50.720 Something like that, that we could have. 00:04:50.720 --> 00:04:51.560 Holy! 00:04:51.560 --> 00:04:56.250 $3,400 a month! 00:04:56.250 --> 00:04:57.090 I mean, I get it. 00:04:57.090 --> 00:04:59.950 I guess these guys have to cover the upfront costs 00:04:59.950 --> 00:05:02.210 that they're paying for that same hardware. 00:05:02.210 --> 00:05:05.470 And they've got, you know, geo-replication 00:05:05.470 --> 00:05:07.550 and all that kind of cool stuff as well. 00:05:07.550 --> 00:05:09.250 But like, holy! 00:05:09.390 --> 00:05:10.650 Holy balls! 00:05:10.650 --> 00:05:12.610 Wait, hold on a second. 00:05:12.610 --> 00:05:16.270 Go back to that. 00:05:16.270 --> 00:05:17.750 No, no, no. 00:05:17.750 --> 00:05:22.750 This is before you even actually pull any data out of it. 00:05:23.010 --> 00:05:23.850 Okay. 00:05:23.850 --> 00:05:25.170 You have to pay to pull data out. 00:05:25.170 --> 00:05:27.030 So, let's go the cheapest one. 00:05:27.030 --> 00:05:27.870 Yeah, sure. 00:05:27.870 --> 00:05:30.610 Let's say we want to pull the whole thing. 00:05:30.610 --> 00:05:33.210 Another two grand? 00:05:33.210 --> 00:05:34.750 So, this is great. 00:05:34.750 --> 00:05:37.290 So, let's say your office burns down 00:05:37.290 --> 00:05:39.750 and you've got to pull all your data out of the cloud. 00:05:39.750 --> 00:05:42.970 You get a nice handy dandy bill for $2,000 to add in something. 00:05:42.970 --> 00:05:44.210 Any consul to injury? 00:05:44.210 --> 00:05:45.290 That's the slowest. 00:05:45.290 --> 00:05:46.570 That's the slowest speed. 00:05:46.570 --> 00:05:47.750 So, let's say we want to- 00:05:47.750 --> 00:05:49.030 Let's say you need all of it right away. 00:05:49.030 --> 00:05:50.140 Real fast. 00:05:50.140 --> 00:05:51.420 Oh, gigabytes. 00:05:51.420 --> 00:05:52.820 Oh. 00:05:52.820 --> 00:05:54.540 Whoa! 00:05:54.540 --> 00:05:55.580 12 grand. 00:05:55.580 --> 00:05:56.400 No big deal. 00:05:56.400 --> 00:05:57.240 Whatever. 00:05:57.240 --> 00:05:58.080 It's fine. 00:05:58.080 --> 00:05:58.920 Don't worry about it. 00:05:58.920 --> 00:05:59.760 Casual, right? 00:05:59.760 --> 00:06:00.600 Casual. 00:06:00.600 --> 00:06:02.880 And the crazy part of this is that other enterprise solutions 00:06:02.880 --> 00:06:06.620 from the likes of Google, Microsoft, and Backblaze 00:06:06.620 --> 00:06:10.000 aren't priced that differently. 00:06:10.000 --> 00:06:13.100 So, what are we gonna do? 00:06:13.100 --> 00:06:16.080 I'm not paying three to five grand a month 00:06:16.080 --> 00:06:18.820 to store data on tape. 00:06:18.820 --> 00:06:22.250 Wait, does Google still have unlimited storage? 00:06:22.250 --> 00:06:25.330 Well, yeah, but there's no way that's actually unlimited. 00:06:25.330 --> 00:06:26.770 Well, I mean, it's gotta be, 00:06:26.770 --> 00:06:28.750 that would be false advertising, wouldn't it be? 00:06:28.750 --> 00:06:29.590 Unlimited cloud storage. 00:06:29.590 --> 00:06:33.870 With the $10 per user tier, unlimited cloud storage, 00:06:33.870 --> 00:06:37.650 or one terabyte per user, if fewer than five users, so. 00:06:37.650 --> 00:06:39.070 We just get five users. 00:06:39.070 --> 00:06:40.830 That's like $50 a month, that's nothing. 00:06:40.830 --> 00:06:42.950 It can't be unlimited. 00:06:42.950 --> 00:06:44.530 I guess we gotta try. 00:06:44.530 --> 00:06:47.550 To find out if this loophole's actually gonna work, 00:06:47.550 --> 00:06:50.850 we fired up a Windows 10 VM on our Utility Unraid server 00:06:50.850 --> 00:06:53.690 and installed a tool called Rclone. 00:06:53.690 --> 00:06:57.490 So Jake's got the unlimited Google Drive account 00:06:57.490 --> 00:07:00.650 set up and working, so it should just be a matter 00:07:00.650 --> 00:07:04.890 of running the command and seeing what happens. 00:07:04.890 --> 00:07:08.050 So maybe start with Channel Super Fun? 00:07:08.050 --> 00:07:08.990 Channel Super Fun. 00:07:08.990 --> 00:07:10.350 How big's that? 00:07:10.350 --> 00:07:12.830 Oh, let's see. 00:07:12.830 --> 00:07:13.170 That might. 00:07:13.170 --> 00:07:14.750 That might take a while. 00:07:14.750 --> 00:07:19.150 But remember, guys, this is over 100 drives 00:07:19.150 --> 00:07:21.770 spread across two completely separate boxes 00:07:21.770 --> 00:07:25.480 that are networked to each other. 00:07:25.480 --> 00:07:26.800 Wow, this is taking forever. 00:07:26.800 --> 00:07:29.840 I think we had, I indexed the entire Petabyte project, 00:07:29.840 --> 00:07:32.910 and I think we had almost a million files on it. 00:07:32.910 --> 00:07:37.160 It took like literally, I think, a couple hours to do, 00:07:37.160 --> 00:07:38.720 but I did index the whole thing. 00:07:38.720 --> 00:07:40.660 WinDirStat doesn't work, it dies. 00:07:40.660 --> 00:07:43.840 It like, just can't handle that much. 00:07:43.840 --> 00:07:44.680 Okay. 00:07:45.060 --> 00:07:48.040 Should we see how it's going here? 00:07:48.040 --> 00:07:49.820 Oh, it's not going at all. 00:07:49.820 --> 00:07:52.630 What the heck? 00:07:52.630 --> 00:07:53.330 What? 00:07:53.330 --> 00:07:54.630 Oh. 00:07:54.630 --> 00:07:57.400 There's a limit. 00:07:57.400 --> 00:07:58.480 So you were right. 00:07:58.480 --> 00:07:58.980 Yeah. 00:07:58.980 --> 00:08:00.080 It is limited. 00:08:00.080 --> 00:08:00.860 It's limited. 00:08:00.860 --> 00:08:04.140 But it's limited in a way that the advertising's not false. 00:08:04.140 --> 00:08:06.500 So it's unlimited data. 00:08:06.500 --> 00:08:07.200 Yeah. 00:08:07.200 --> 00:08:10.040 As long as it's 750 gigs per day. 00:08:10.040 --> 00:08:11.240 Uploaded, yeah. 00:08:11.240 --> 00:08:14.240 As it turns out, Google saw Bastards Like Us 00:08:14.240 --> 00:08:14.780 coming a mile away, and it looks like, if you're going to do it, 00:08:14.780 --> 00:08:15.280 you're going to have to do it. 00:08:15.280 --> 00:08:15.780 You're going to have to do it. 00:08:15.780 --> 00:08:16.280 You're going to have to do it. 00:08:16.280 --> 00:08:16.780 You're going to have to do it. 00:08:16.780 --> 00:08:17.280 You're going to have to do it. 00:08:17.280 --> 00:08:17.780 You're going to have to do it. 00:08:17.780 --> 00:08:21.750 Like, if you don't want to have your upload cut off, 00:08:21.750 --> 00:08:24.490 you're only able to do 750 gigs a day. 00:08:24.490 --> 00:08:28.250 Otherwise, you have to wait an additional 24 hours 00:08:28.250 --> 00:08:31.670 for an upload ban to pass. 00:08:31.670 --> 00:08:36.290 So what we would have to do then is slow our uploads to just 00:08:36.290 --> 00:08:39.970 around 8 megabytes a second, which 00:08:39.970 --> 00:08:43.350 would mean that our current 370 terabytes would, uh, 00:08:43.350 --> 00:08:45.350 you got that calculator handy? 00:08:45.350 --> 00:08:47.780 370 terabytes. 00:08:47.780 --> 00:08:48.280 Oh. 00:08:48.540 --> 00:08:51.080 Would take about two years. 00:08:51.080 --> 00:08:55.660 So while Google hasn't limited our uploads, 00:08:55.660 --> 00:08:59.420 they have effectively made it completely impractical for us 00:08:59.420 --> 00:09:01.540 to abuse their system this way. 00:09:01.540 --> 00:09:04.000 Guess that makes sense. 00:09:04.000 --> 00:09:04.580 Oh, wait. 00:09:04.580 --> 00:09:05.540 Nope. 00:09:05.540 --> 00:09:07.780 We're not defeated yet. 00:09:07.780 --> 00:09:08.500 New plan. 00:09:08.500 --> 00:09:11.780 So you're actually required to pay 00:09:11.780 --> 00:09:14.780 for a minimum of five G Suite accounts 00:09:14.780 --> 00:09:18.780 in order to unlock that unlimited storage tier. 00:09:18.780 --> 00:09:19.280 But. 00:09:19.660 --> 00:09:21.790 That got us thinking. 00:09:21.790 --> 00:09:26.270 And actually I'm gonna give Jake full credit for this idea, 00:09:26.270 --> 00:09:31.840 what if we used that limitation to our advantage? 00:09:31.840 --> 00:09:32.460 Check this out. 00:09:32.460 --> 00:09:36.660 So it turns out that the 750 Gig per day upload cap 00:09:36.660 --> 00:09:41.280 is per each one of our users here. 00:09:41.280 --> 00:09:44.140 So by just adding a couple more accounts, 00:09:44.140 --> 00:09:47.080 so user 6 here and uh, Mr. Jake Tyvie, 00:09:47.080 --> 00:09:47.960 we can actually end up even if we lose, uh, our users, folks, 00:09:47.960 --> 00:09:48.080 we can actually end up even if we lose, uh, a few more accounts, 00:09:48.080 --> 00:09:48.100 we can actually end up even if we lose, uh, a few more accounts, 00:09:48.100 --> 00:09:50.040 we can actually end up even if we lose, uh, a few more accounts, 00:09:50.040 --> 00:09:57.140 if we limit each account to not go over 750 gigs a day, we can still end up maxing out our upload 00:09:57.140 --> 00:10:03.580 speed to drive at about 40 to 45 megabytes a second. Now, it's not the prettiest solution, 00:10:04.000 --> 00:10:10.920 but this has been going for a week and each one of our instances here has now done about four 00:10:10.920 --> 00:10:20.380 terabytes of data. Yeah. It's a lot of data. It's a lot of data. So conclusion time then, 00:10:20.380 --> 00:10:25.060 I guess. I mean, for now, there's no guarantee whatsoever that Google 00:10:25.060 --> 00:10:29.960 isn't going to shut down this workaround. And there's a fair number of Googlers out there, 00:10:30.000 --> 00:10:35.100 I think, that watch our videos. So us making this video sort of increases our chances. But 00:10:35.100 --> 00:10:43.040 for now, at zero upfront cost and $70 a month for our seven G Suite accounts, 00:10:43.220 --> 00:10:49.540 that's less than $1,000 a year, we have got what is quite literally the least expensive 00:10:49.540 --> 00:10:50.360 multi-tasker, multi-tasker, multi-tasker, multi-tasker, multi-tasker, multi-tasker, 00:10:50.360 --> 00:10:50.380 multi-tasker, multi-tasker, multi-tasker, multi-tasker, multi-tasker, multi-tasker. 00:10:50.380 --> 00:10:57.160 terabyte backup solution that you could have. We're basically terrible people. I'm okay with 00:10:57.160 --> 00:11:02.480 it though. I can live with myself. On the plus side though, this supports encryption on upload 00:11:02.480 --> 00:11:06.300 and download. It does. And there are no fees for pulling the data down in the event of some kind 00:11:06.300 --> 00:11:09.880 of a disaster. I mean, who knows how fast it's going to be. That helps me sleep better at night. 00:11:11.100 --> 00:11:17.500 So there you go. We're pretty happy, even if anyone watching at Google isn't. Hi, 00:11:17.500 --> 00:11:22.540 our YouTube rep. I don't know if I'm supposed to tell people your name. Oh, yeah. Probably 00:11:22.540 --> 00:11:29.570 don't. Ting is the mobile carrier that's focused on customer service and customer satisfaction. 00:11:29.570 --> 00:11:35.470 When you call Ting, you don't speak to a robot. You get put through directly to a person who can 00:11:35.470 --> 00:11:41.170 help you. And you don't pay extra for the privilege. The average Ting bill is just 23 bucks a month per 00:11:41.170 --> 00:11:47.190 device. And they've got cheaper data rates than ever. It's now just $10 a gig beyond the first 00:11:47.190 --> 00:11:53.810 gig. So go try out their savings calculator over at linus2018.ting.com. If it turns out you'll save 00:11:53.810 --> 00:11:58.830 on Ting, they'll actually cover 25% of your cancellation fee for your existing contract 00:11:58.830 --> 00:12:07.150 up to $75. And using our link, that's linus2018.ting.com, you can get 25 bucks in service 00:12:07.150 --> 00:12:11.270 credit or towards a new device. Go check it out at the link in the video description. 00:12:11.890 --> 00:12:15.930 So thanks for watching, guys. If you work for Google, well, you know what to do. But if the 00:12:15.930 --> 00:12:20.150 video was awesome, get subscribed, hit that like button, or check out the link to where to buy the 00:12:20.150 --> 00:12:23.410 stuff we featured in the video description. Also linked in the description, oh, I guess if you're 00:12:23.410 --> 00:12:23.790 a Google shopper, you can check out the link in the description. And if you're a Google shopper, 00:12:23.810 --> 00:12:27.210 shareholder, you're probably not stoked on this either. Also linked in the description is our 00:12:27.210 --> 00:12:32.170 merch store, which has cool shirts like neither of the ones I'm wearing. Do you have an LTT shirt? 00:12:32.210 --> 00:12:38.130 Like this one, cool shirts like this one, and our community forum, which you should totally join.