1 00:00:00,240 --> 00:00:01,760 Just over a year ago, 2 00:00:01,760 --> 00:00:06,360 we deployed an insane solution to our storage problem. 3 00:00:06,360 --> 00:00:08,560 The petabyte project. 4 00:00:08,560 --> 00:00:11,240 A petabyte of raw archival storage. 5 00:00:11,240 --> 00:00:13,680 I mean, that thing is freaking awesome. 6 00:00:13,680 --> 00:00:16,540 We have yet to have any problems with it, 7 00:00:16,540 --> 00:00:20,980 but there's still a major issue with this deployment. 8 00:00:20,980 --> 00:00:23,900 It's not geo-redundant at all, 9 00:00:23,900 --> 00:00:25,900 which means that if there were a fire 10 00:00:25,900 --> 00:00:27,820 in the Linus Media Group warehouse, 11 00:00:27,820 --> 00:00:30,560 or I mean really any kind of natural disaster, 12 00:00:30,560 --> 00:00:34,880 we could potentially lose our entire back catalog. 13 00:00:34,880 --> 00:00:38,580 That is anything that we haven't already uploaded to YouTube. 14 00:00:38,580 --> 00:00:41,840 So we endeavored to find a way to, 15 00:00:41,840 --> 00:00:44,020 as inexpensively as possible, 16 00:00:44,020 --> 00:00:46,540 back up the entire server. 17 00:00:46,540 --> 00:00:51,540 That's all 370 terabytes of currently stored data, 18 00:00:52,140 --> 00:00:55,280 plus anything we would wanna add in the future. 19 00:00:55,280 --> 00:00:57,600 So that's easy enough, right? 20 00:00:58,970 --> 00:01:02,990 You know what else is easy? 21 00:01:02,990 --> 00:01:06,710 Your move over to a better chair, 22 00:01:06,710 --> 00:01:08,170 like the ones from Noble Chairs. 23 00:01:08,170 --> 00:01:10,630 Their icon series real leather edition gaming chair 24 00:01:10,630 --> 00:01:11,670 was designed in Germany 25 00:01:11,670 --> 00:01:13,910 and inspired by luxury car interiors. 26 00:01:13,910 --> 00:01:15,750 Learn more at the link below. 27 00:01:15,750 --> 00:01:17,970 Just hope they weren't inspired by like the trunk 28 00:01:17,970 --> 00:01:29,420 of a luxury car, because that'd be very uncomfortable. 29 00:01:29,420 --> 00:01:30,740 Now there are a lot of different ways 30 00:01:30,740 --> 00:01:32,560 that we could go about backing up our server. 31 00:01:32,560 --> 00:01:35,020 Some of them easier and some of them harder than others, 32 00:01:35,020 --> 00:01:38,380 but almost all of them are gonna be limited 33 00:01:38,380 --> 00:01:39,020 by water. 34 00:01:39,020 --> 00:01:42,100 One thing, our internet bandwidth. 35 00:01:42,100 --> 00:01:42,940 I mean, don't get me wrong. 36 00:01:42,940 --> 00:01:44,620 We have a symmetric gigabit connection. 37 00:01:44,620 --> 00:01:45,540 I'm not complaining, 38 00:01:45,540 --> 00:01:49,140 but when you're talking about hundreds of terabytes 39 00:01:49,140 --> 00:01:50,720 that are already in the archive, 40 00:01:50,720 --> 00:01:55,160 and then up to a couple of terabytes a day being added, 41 00:01:55,160 --> 00:01:59,400 things can start to take a while, like months a while. 42 00:01:59,400 --> 00:02:03,320 Now, our first idea was to build something locally, 43 00:02:03,320 --> 00:02:07,240 fill it up with data here using our 10 gigabit network, 44 00:02:07,240 --> 00:02:09,340 and then ship it off site. 45 00:02:09,340 --> 00:02:11,860 A sort of like, ah, thank you, Jake. 46 00:02:11,860 --> 00:02:12,860 Oh, wow. 47 00:02:12,860 --> 00:02:15,040 Petabyte project part two. 48 00:02:15,040 --> 00:02:18,460 Now, this solution wouldn't actually 49 00:02:18,460 --> 00:02:21,900 expand our storage capacity, because it would just 50 00:02:21,900 --> 00:02:25,940 be an identical server, or that is to say two servers, 51 00:02:25,940 --> 00:02:27,700 with the same data on it. 52 00:02:27,700 --> 00:02:30,680 But since our internet service provider offers us 53 00:02:30,680 --> 00:02:33,740 inexpensive co-location, it would actually 54 00:02:33,740 --> 00:02:37,340 be very cost effective from an ongoing standpoint. 55 00:02:37,460 --> 00:02:40,500 Except for one small problem. 56 00:02:40,500 --> 00:02:45,500 If we had to buy two more decked out 60 drive store-inators, 57 00:02:45,960 --> 00:02:48,520 we'd be looking at, with the drives included, 58 00:02:48,520 --> 00:02:53,100 upwards of 70,000 US dollars. 59 00:02:53,100 --> 00:02:55,360 So, converted to Canadian rubles, 60 00:02:55,360 --> 00:03:00,360 that is getting dangerously close to six figure territory. 61 00:03:00,600 --> 00:03:01,900 You can take that away. 62 00:03:01,900 --> 00:03:04,840 So, that eliminates hard drives. 63 00:03:04,840 --> 00:03:05,680 You good? 64 00:03:05,680 --> 00:03:06,520 Yeah. 65 00:03:06,520 --> 00:03:07,360 Okay, just remember, lift with your back, 66 00:03:07,360 --> 00:03:08,700 the twisting, jerking motion. 67 00:03:08,700 --> 00:03:10,300 Yeah, I was working on that. 68 00:03:10,300 --> 00:03:12,820 So, that eliminates hard drives. 69 00:03:12,820 --> 00:03:14,500 What about tape storage? 70 00:03:14,500 --> 00:03:18,220 A rack mount tape library, like this one from HP Enterprise, 71 00:03:18,220 --> 00:03:21,000 only costs about five to $7,000. 72 00:03:21,000 --> 00:03:24,600 And high capacity 12 terabyte LTO8 tapes 73 00:03:24,600 --> 00:03:27,200 are about 160 bucks a piece. 74 00:03:27,200 --> 00:03:32,200 So, for over 500 terabytes of uncompressed backup capacity, 75 00:03:33,480 --> 00:03:36,560 that's actually looking pretty good by comparison. 76 00:03:36,560 --> 00:03:37,400 But, 77 00:03:37,460 --> 00:03:39,680 there's the fact that we'd need two of them, 78 00:03:39,680 --> 00:03:42,820 and it looks like we're still spending 79 00:03:42,820 --> 00:03:47,360 well over 20,000 US dollars up front. 80 00:03:47,360 --> 00:03:49,860 Lump sum, throw that on the black card. 81 00:03:49,860 --> 00:03:51,780 You know how it is. 82 00:03:51,780 --> 00:03:56,600 So, hardware-based solutions are not looking too peachy. 83 00:03:56,600 --> 00:03:59,640 What about, shoot, what's it called? 84 00:03:59,640 --> 00:04:04,320 It's kind of like buzzword-y, disruptive, blockchain. 85 00:04:04,320 --> 00:04:05,160 No. 86 00:04:05,160 --> 00:04:06,960 Oh, oh, oh, cloud! 87 00:04:06,960 --> 00:04:08,240 Cloud storage. 88 00:04:08,260 --> 00:04:11,080 You guys were all shrieking at us 89 00:04:11,080 --> 00:04:13,720 back when we originally built Petabyte Project 90 00:04:13,720 --> 00:04:17,180 for not using cloud storage for our archive 91 00:04:17,180 --> 00:04:18,640 in the first place. 92 00:04:18,640 --> 00:04:21,140 So, I think this is where you come in. 93 00:04:21,140 --> 00:04:24,940 We're gonna check out some AWS here, there, buddy. 94 00:04:24,940 --> 00:04:28,120 This is Glacier, so this is like slow. 95 00:04:28,120 --> 00:04:30,140 Start the download. 96 00:04:30,140 --> 00:04:31,860 Okay, so if we just wanted to back up everything 97 00:04:31,860 --> 00:04:32,700 we've got right now. 98 00:04:32,700 --> 00:04:34,680 How many-ish terabytes? 99 00:04:34,680 --> 00:04:36,620 $1,500 a month. 100 00:04:36,620 --> 00:04:38,000 Wow. 101 00:04:38,000 --> 00:04:38,840 Plus support. 102 00:04:38,840 --> 00:04:39,680 Oh, yeah. 103 00:04:39,680 --> 00:04:40,500 You know, you need support. 104 00:04:40,500 --> 00:04:41,340 Yeah. 105 00:04:41,340 --> 00:04:42,180 1,667. 106 00:04:42,180 --> 00:04:46,520 So, if we wanted to store the full, what is it? 107 00:04:46,520 --> 00:04:48,500 About 760 terabytes that we have? 108 00:04:48,500 --> 00:04:50,720 Something like that, that we could have. 109 00:04:50,720 --> 00:04:51,560 Holy! 110 00:04:51,560 --> 00:04:56,250 $3,400 a month! 111 00:04:56,250 --> 00:04:57,090 I mean, I get it. 112 00:04:57,090 --> 00:04:59,950 I guess these guys have to cover the upfront costs 113 00:04:59,950 --> 00:05:02,210 that they're paying for that same hardware. 114 00:05:02,210 --> 00:05:05,470 And they've got, you know, geo-replication 115 00:05:05,470 --> 00:05:07,550 and all that kind of cool stuff as well. 116 00:05:07,550 --> 00:05:09,250 But like, holy! 117 00:05:09,390 --> 00:05:10,650 Holy balls! 118 00:05:10,650 --> 00:05:12,610 Wait, hold on a second. 119 00:05:12,610 --> 00:05:16,270 Go back to that. 120 00:05:16,270 --> 00:05:17,750 No, no, no. 121 00:05:17,750 --> 00:05:22,750 This is before you even actually pull any data out of it. 122 00:05:23,010 --> 00:05:23,850 Okay. 123 00:05:23,850 --> 00:05:25,170 You have to pay to pull data out. 124 00:05:25,170 --> 00:05:27,030 So, let's go the cheapest one. 125 00:05:27,030 --> 00:05:27,870 Yeah, sure. 126 00:05:27,870 --> 00:05:30,610 Let's say we want to pull the whole thing. 127 00:05:30,610 --> 00:05:33,210 Another two grand? 128 00:05:33,210 --> 00:05:34,750 So, this is great. 129 00:05:34,750 --> 00:05:37,290 So, let's say your office burns down 130 00:05:37,290 --> 00:05:39,750 and you've got to pull all your data out of the cloud. 131 00:05:39,750 --> 00:05:42,970 You get a nice handy dandy bill for $2,000 to add in something. 132 00:05:42,970 --> 00:05:44,210 Any consul to injury? 133 00:05:44,210 --> 00:05:45,290 That's the slowest. 134 00:05:45,290 --> 00:05:46,570 That's the slowest speed. 135 00:05:46,570 --> 00:05:47,750 So, let's say we want to- 136 00:05:47,750 --> 00:05:49,030 Let's say you need all of it right away. 137 00:05:49,030 --> 00:05:50,140 Real fast. 138 00:05:50,140 --> 00:05:51,420 Oh, gigabytes. 139 00:05:51,420 --> 00:05:52,820 Oh. 140 00:05:52,820 --> 00:05:54,540 Whoa! 141 00:05:54,540 --> 00:05:55,580 12 grand. 142 00:05:55,580 --> 00:05:56,400 No big deal. 143 00:05:56,400 --> 00:05:57,240 Whatever. 144 00:05:57,240 --> 00:05:58,080 It's fine. 145 00:05:58,080 --> 00:05:58,920 Don't worry about it. 146 00:05:58,920 --> 00:05:59,760 Casual, right? 147 00:05:59,760 --> 00:06:00,600 Casual. 148 00:06:00,600 --> 00:06:02,880 And the crazy part of this is that other enterprise solutions 149 00:06:02,880 --> 00:06:06,620 from the likes of Google, Microsoft, and Backblaze 150 00:06:06,620 --> 00:06:10,000 aren't priced that differently. 151 00:06:10,000 --> 00:06:13,100 So, what are we gonna do? 152 00:06:13,100 --> 00:06:16,080 I'm not paying three to five grand a month 153 00:06:16,080 --> 00:06:18,820 to store data on tape. 154 00:06:18,820 --> 00:06:22,250 Wait, does Google still have unlimited storage? 155 00:06:22,250 --> 00:06:25,330 Well, yeah, but there's no way that's actually unlimited. 156 00:06:25,330 --> 00:06:26,770 Well, I mean, it's gotta be, 157 00:06:26,770 --> 00:06:28,750 that would be false advertising, wouldn't it be? 158 00:06:28,750 --> 00:06:29,590 Unlimited cloud storage. 159 00:06:29,590 --> 00:06:33,870 With the $10 per user tier, unlimited cloud storage, 160 00:06:33,870 --> 00:06:37,650 or one terabyte per user, if fewer than five users, so. 161 00:06:37,650 --> 00:06:39,070 We just get five users. 162 00:06:39,070 --> 00:06:40,830 That's like $50 a month, that's nothing. 163 00:06:40,830 --> 00:06:42,950 It can't be unlimited. 164 00:06:42,950 --> 00:06:44,530 I guess we gotta try. 165 00:06:44,530 --> 00:06:47,550 To find out if this loophole's actually gonna work, 166 00:06:47,550 --> 00:06:50,850 we fired up a Windows 10 VM on our Utility Unraid server 167 00:06:50,850 --> 00:06:53,690 and installed a tool called Rclone. 168 00:06:53,690 --> 00:06:57,490 So Jake's got the unlimited Google Drive account 169 00:06:57,490 --> 00:07:00,650 set up and working, so it should just be a matter 170 00:07:00,650 --> 00:07:04,890 of running the command and seeing what happens. 171 00:07:04,890 --> 00:07:08,050 So maybe start with Channel Super Fun? 172 00:07:08,050 --> 00:07:08,990 Channel Super Fun. 173 00:07:08,990 --> 00:07:10,350 How big's that? 174 00:07:10,350 --> 00:07:12,830 Oh, let's see. 175 00:07:12,830 --> 00:07:13,170 That might. 176 00:07:13,170 --> 00:07:14,750 That might take a while. 177 00:07:14,750 --> 00:07:19,150 But remember, guys, this is over 100 drives 178 00:07:19,150 --> 00:07:21,770 spread across two completely separate boxes 179 00:07:21,770 --> 00:07:25,480 that are networked to each other. 180 00:07:25,480 --> 00:07:26,800 Wow, this is taking forever. 181 00:07:26,800 --> 00:07:29,840 I think we had, I indexed the entire Petabyte project, 182 00:07:29,840 --> 00:07:32,910 and I think we had almost a million files on it. 183 00:07:32,910 --> 00:07:37,160 It took like literally, I think, a couple hours to do, 184 00:07:37,160 --> 00:07:38,720 but I did index the whole thing. 185 00:07:38,720 --> 00:07:40,660 WinDirStat doesn't work, it dies. 186 00:07:40,660 --> 00:07:43,840 It like, just can't handle that much. 187 00:07:43,840 --> 00:07:44,680 Okay. 188 00:07:45,060 --> 00:07:48,040 Should we see how it's going here? 189 00:07:48,040 --> 00:07:49,820 Oh, it's not going at all. 190 00:07:49,820 --> 00:07:52,630 What the heck? 191 00:07:52,630 --> 00:07:53,330 What? 192 00:07:53,330 --> 00:07:54,630 Oh. 193 00:07:54,630 --> 00:07:57,400 There's a limit. 194 00:07:57,400 --> 00:07:58,480 So you were right. 195 00:07:58,480 --> 00:07:58,980 Yeah. 196 00:07:58,980 --> 00:08:00,080 It is limited. 197 00:08:00,080 --> 00:08:00,860 It's limited. 198 00:08:00,860 --> 00:08:04,140 But it's limited in a way that the advertising's not false. 199 00:08:04,140 --> 00:08:06,500 So it's unlimited data. 200 00:08:06,500 --> 00:08:07,200 Yeah. 201 00:08:07,200 --> 00:08:10,040 As long as it's 750 gigs per day. 202 00:08:10,040 --> 00:08:11,240 Uploaded, yeah. 203 00:08:11,240 --> 00:08:14,240 As it turns out, Google saw Bastards Like Us 204 00:08:14,240 --> 00:08:14,780 coming a mile away, and it looks like, if you're going to do it, 205 00:08:14,780 --> 00:08:15,280 you're going to have to do it. 206 00:08:15,280 --> 00:08:15,780 You're going to have to do it. 207 00:08:15,780 --> 00:08:16,280 You're going to have to do it. 208 00:08:16,280 --> 00:08:16,780 You're going to have to do it. 209 00:08:16,780 --> 00:08:17,280 You're going to have to do it. 210 00:08:17,280 --> 00:08:17,780 You're going to have to do it. 211 00:08:17,780 --> 00:08:21,750 Like, if you don't want to have your upload cut off, 212 00:08:21,750 --> 00:08:24,490 you're only able to do 750 gigs a day. 213 00:08:24,490 --> 00:08:28,250 Otherwise, you have to wait an additional 24 hours 214 00:08:28,250 --> 00:08:31,670 for an upload ban to pass. 215 00:08:31,670 --> 00:08:36,290 So what we would have to do then is slow our uploads to just 216 00:08:36,290 --> 00:08:39,970 around 8 megabytes a second, which 217 00:08:39,970 --> 00:08:43,350 would mean that our current 370 terabytes would, uh, 218 00:08:43,350 --> 00:08:45,350 you got that calculator handy? 219 00:08:45,350 --> 00:08:47,780 370 terabytes. 220 00:08:47,780 --> 00:08:48,280 Oh. 221 00:08:48,540 --> 00:08:51,080 Would take about two years. 222 00:08:51,080 --> 00:08:55,660 So while Google hasn't limited our uploads, 223 00:08:55,660 --> 00:08:59,420 they have effectively made it completely impractical for us 224 00:08:59,420 --> 00:09:01,540 to abuse their system this way. 225 00:09:01,540 --> 00:09:04,000 Guess that makes sense. 226 00:09:04,000 --> 00:09:04,580 Oh, wait. 227 00:09:04,580 --> 00:09:05,540 Nope. 228 00:09:05,540 --> 00:09:07,780 We're not defeated yet. 229 00:09:07,780 --> 00:09:08,500 New plan. 230 00:09:08,500 --> 00:09:11,780 So you're actually required to pay 231 00:09:11,780 --> 00:09:14,780 for a minimum of five G Suite accounts 232 00:09:14,780 --> 00:09:18,780 in order to unlock that unlimited storage tier. 233 00:09:18,780 --> 00:09:19,280 But. 234 00:09:19,660 --> 00:09:21,790 That got us thinking. 235 00:09:21,790 --> 00:09:26,270 And actually I'm gonna give Jake full credit for this idea, 236 00:09:26,270 --> 00:09:31,840 what if we used that limitation to our advantage? 237 00:09:31,840 --> 00:09:32,460 Check this out. 238 00:09:32,460 --> 00:09:36,660 So it turns out that the 750 Gig per day upload cap 239 00:09:36,660 --> 00:09:41,280 is per each one of our users here. 240 00:09:41,280 --> 00:09:44,140 So by just adding a couple more accounts, 241 00:09:44,140 --> 00:09:47,080 so user 6 here and uh, Mr. Jake Tyvie, 242 00:09:47,080 --> 00:09:47,960 we can actually end up even if we lose, uh, our users, folks, 243 00:09:47,960 --> 00:09:48,080 we can actually end up even if we lose, uh, a few more accounts, 244 00:09:48,080 --> 00:09:48,100 we can actually end up even if we lose, uh, a few more accounts, 245 00:09:48,100 --> 00:09:50,040 we can actually end up even if we lose, uh, a few more accounts, 246 00:09:50,040 --> 00:09:57,140 if we limit each account to not go over 750 gigs a day, we can still end up maxing out our upload 247 00:09:57,140 --> 00:10:03,580 speed to drive at about 40 to 45 megabytes a second. Now, it's not the prettiest solution, 248 00:10:04,000 --> 00:10:10,920 but this has been going for a week and each one of our instances here has now done about four 249 00:10:10,920 --> 00:10:20,380 terabytes of data. Yeah. It's a lot of data. It's a lot of data. So conclusion time then, 250 00:10:20,380 --> 00:10:25,060 I guess. I mean, for now, there's no guarantee whatsoever that Google 251 00:10:25,060 --> 00:10:29,960 isn't going to shut down this workaround. And there's a fair number of Googlers out there, 252 00:10:30,000 --> 00:10:35,100 I think, that watch our videos. So us making this video sort of increases our chances. But 253 00:10:35,100 --> 00:10:43,040 for now, at zero upfront cost and $70 a month for our seven G Suite accounts, 254 00:10:43,220 --> 00:10:49,540 that's less than $1,000 a year, we have got what is quite literally the least expensive 255 00:10:49,540 --> 00:10:50,360 multi-tasker, multi-tasker, multi-tasker, multi-tasker, multi-tasker, multi-tasker, 256 00:10:50,360 --> 00:10:50,380 multi-tasker, multi-tasker, multi-tasker, multi-tasker, multi-tasker, multi-tasker. 257 00:10:50,380 --> 00:10:57,160 terabyte backup solution that you could have. We're basically terrible people. I'm okay with 258 00:10:57,160 --> 00:11:02,480 it though. I can live with myself. On the plus side though, this supports encryption on upload 259 00:11:02,480 --> 00:11:06,300 and download. It does. And there are no fees for pulling the data down in the event of some kind 260 00:11:06,300 --> 00:11:09,880 of a disaster. I mean, who knows how fast it's going to be. That helps me sleep better at night. 261 00:11:11,100 --> 00:11:17,500 So there you go. We're pretty happy, even if anyone watching at Google isn't. Hi, 262 00:11:17,500 --> 00:11:22,540 our YouTube rep. I don't know if I'm supposed to tell people your name. Oh, yeah. Probably 263 00:11:22,540 --> 00:11:29,570 don't. Ting is the mobile carrier that's focused on customer service and customer satisfaction. 264 00:11:29,570 --> 00:11:35,470 When you call Ting, you don't speak to a robot. You get put through directly to a person who can 265 00:11:35,470 --> 00:11:41,170 help you. And you don't pay extra for the privilege. The average Ting bill is just 23 bucks a month per 266 00:11:41,170 --> 00:11:47,190 device. And they've got cheaper data rates than ever. It's now just $10 a gig beyond the first 267 00:11:47,190 --> 00:11:53,810 gig. So go try out their savings calculator over at linus2018.ting.com. If it turns out you'll save 268 00:11:53,810 --> 00:11:58,830 on Ting, they'll actually cover 25% of your cancellation fee for your existing contract 269 00:11:58,830 --> 00:12:07,150 up to $75. And using our link, that's linus2018.ting.com, you can get 25 bucks in service 270 00:12:07,150 --> 00:12:11,270 credit or towards a new device. Go check it out at the link in the video description. 271 00:12:11,890 --> 00:12:15,930 So thanks for watching, guys. If you work for Google, well, you know what to do. But if the 272 00:12:15,930 --> 00:12:20,150 video was awesome, get subscribed, hit that like button, or check out the link to where to buy the 273 00:12:20,150 --> 00:12:23,410 stuff we featured in the video description. Also linked in the description, oh, I guess if you're 274 00:12:23,410 --> 00:12:23,790 a Google shopper, you can check out the link in the description. And if you're a Google shopper, 275 00:12:23,810 --> 00:12:27,210 shareholder, you're probably not stoked on this either. Also linked in the description is our 276 00:12:27,210 --> 00:12:32,170 merch store, which has cool shirts like neither of the ones I'm wearing. Do you have an LTT shirt? 277 00:12:32,210 --> 00:12:38,130 Like this one, cool shirts like this one, and our community forum, which you should totally join.