INSTALLING THE PETABYTE - Server Room Upgrade Vlog
Linus Tech Tips
·Linus Tech Tips
·2017-05-06
·
2,874 words · ~14 min read
0:00
So, WANIX server, the high-speed NVMe NAS that all our editors use to edit 4K, 8K video and the like, it's completely full.
0:15
Newton server, the mechanical-based vault where we store all our old projects, that's completely full too.
0:24
And to make matters worse, our new red weapon camera, capable of recording footage at a whopping 8K resolution,
0:36
is also here and capable of filling up its 1TB megs at a rate of up to 300MB per second.
0:46
Yes, a 3-second clip that could be as much as 1GB.
0:54
Fortunately,
0:55
Fortunately, Seagate, oh, there go the rails.
1:00
You might say this project's gotten off the rails already.
1:05
Fortunately, Seagate and 45Drives have partnered up with us, which means they gave us hardware,
1:12
to solve this problem once and for all.
1:16
Today, we are installing a petabyte of storage in our freshly renovated server room.
1:29
So come along for the ride.
1:43
Browse privately and securely with TunnelBear, the simple VPN app.
1:48
Try TunnelBear for free at the link in the video description.
1:52
Hey, guys, so would it be a problem if I shut down the vault for a couple hours?
1:59
The vault? Could I shut that down for a couple hours?
2:01
Uh, I don't think I...
2:05
Lock it down.
2:07
We good? We cool?
2:08
Throw away the key.
2:09
Burn it.
2:11
Burn it? No.
2:12
Don't burn it.
2:12
Burn it onto a sheet.
2:13
No.
2:14
Why do we even talk to you people?
2:16
Why don't we even talk to you people?
2:18
Burn it onto a CD.
2:20
You brought more RAM.
2:21
I like this guy.
2:22
So I guess now is a good opportunity to introduce our friends from 45Drives.
2:28
So this is Brett Kelly, who is...
2:30
What exactly?
2:32
I'm an electrical engineer.
2:33
Okay.
2:33
By education.
2:34
And I've been doing just a little bit of everything since I got to 45Drives.
2:39
And then this is Nicole, whose last name I forget.
2:42
Morrison.
2:42
Morrison.
2:43
Yes!
2:43
Oh, you got it.
2:44
Yeah.
2:45
I look after the marketing.
2:47
Okay.
2:48
So here we go.
2:50
I did manage to at least open the top of the box.
2:52
That is as far as I got.
2:54
Yeah.
2:55
As far as, um...
2:58
Uh...
2:59
Look at that documentation that I ruined.
3:04
Okay.
3:09
So you guys have made some significant changes to the Storinator since the last time that I got my hands on one.
3:15
Yes.
3:16
Now it has a screen.
3:18
It has a screen.
3:19
Oh, no, I'm not doing that.
3:21
That's yours.
3:21
Okay.
3:22
I got this.
3:23
Oh, yes.
3:27
It's stuck.
3:28
It's stuck.
3:30
There you go.
3:31
Yes!
3:34
Let's see what happens if I unscrew these without, uh...
3:36
Hey!
3:37
That was fun.
3:37
Good catch.
3:39
Hey, I drop things all the time.
3:40
I gotta be good at catching them.
3:42
So now you guys have, like, a tool-less mechanism for the drives now instead of that...
3:46
That is correct.
3:46
Well, it was tool-less before, but it was kind of like a dumb tool-less.
3:49
Yep.
3:50
Now it's like a really smart tool-less.
3:52
Cool.
3:52
So it's like a friction mount.
3:53
Yeah.
3:53
And in terms of...
3:54
Oh!
3:55
Wow, it looks like it did get a little bit wanged in shipping there.
3:58
Look at that.
3:59
I guess we might just have to take a hammer to it.
4:02
Nervous chuckles.
4:03
Uh...
4:04
Linus, can you not hammer our expensive server machine?
4:09
Well, now you can do whatever you want to it now.
4:10
Yeah, it's yours now.
4:12
There we go.
4:15
Okay, so what's in here?
4:17
So we've got our two rocket carts, Rocket 750 made by High Point.
4:21
Yep.
4:22
They, uh...
4:22
And they connect on to the LCD screen there.
4:25
We have a two-port Intel 10 gigabit NIC RJ45 copper.
4:31
Okay.
4:32
64 gigs of RAM, soon to be 128.
4:36
And a much more high-efficient power supply than the one you had last time.
4:41
Oh, okay, cool.
4:42
Yep.
4:43
Hold on, I'll find...
4:45
I'll find the rest of them.
4:48
Sorry, what's in your boot?
4:49
Uh, a couple of screws fell into my boot.
4:52
So with our introductions and the unboxing out of the way,
4:55
it's time for the most exciting part...
4:59
Inventory time!
5:04
So you might actually be wondering why we need so much RAM.
5:07
And the answer to that question is...
5:09
Brett, on his way over here, stopped and doubled up our memory
5:12
because, basically, ZFS...
5:15
As you add more and more storage to it,
5:17
and we're gonna be putting about 400 terabytes of storage
5:21
in each of these boxes,
5:22
uses RAM as sort of like a, uh...
5:25
Uh, like a map to where the data is.
5:28
So that's why, all of a sudden, we went from 64 gigs being perfectly acceptable
5:33
to really wanting 128 gigs.
5:35
So we're gonna have that much in each of our systems.
5:38
Oh, did you cut yourself?
5:44
Yes.
5:45
That's, uh, that happened fast.
5:47
We've already, uh, got first blood here.
5:49
Yeah, already an injury.
5:50
Nice!
5:51
A nice knuckle one, too.
5:52
So it's always an awkward band-aid, right?
5:54
Oh, man.
5:55
And it takes forever to heal.
5:56
I know, I was going,
5:57
Ah, it'll go away, it'll go away.
5:58
No.
5:59
See, this is why techies don't like sharing their screwdrivers.
6:02
I'm putting these screws in by hand.
6:04
While this guy over here...
6:06
Yeah, you know what, no, fine.
6:07
No, just keep it, just keep it, just keep it.
6:11
Oh, crap.
6:12
Oh, damn it, I can't even find it.
6:14
Is that it?
6:16
Yeah!
6:17
Oh, yay!
6:18
Okay, so this sucks.
6:21
There's some shipping damage on our server,
6:23
so we're gonna have to fix that
6:24
before we go move to the fun part of loading it into the server rack.
6:29
It's like, I'm sure proto-cases like metalworking engineers are...
6:37
rolling in their graves.
6:39
They're not even dead yet,
6:40
they're rolling in their graves watching me work on metal.
6:43
Does that not look pretty straight right there?
6:46
Yeah, that's right.
6:47
See, I may not be good at doing things properly,
6:49
but I'm good at doing things the crappy way.
6:52
Now, you might be thinking to yourself,
6:54
Gee, Linus,
6:56
this server sure doesn't have a lot of hard drives in it.
6:59
To which I would reply,
7:01
Baby, I am the hard drive.
7:07
And then everyone would groan and cringe and all that,
7:10
and then I would give you the real response, which is,
7:12
We're not ready to put the hard drives in yet,
7:14
because these XL60 Storinators can weigh frickin' what?
7:18
Like 100 pounds, probably, with 60 drives in them?
7:21
Yeah, you do not want to move these around full.
7:25
So we're gonna go ahead and we're gonna install the drives
7:27
once they're already on the rails.
7:29
We switched jobs this time, right?
7:31
I was the feeder before.
7:32
Were you?
7:33
Yeah.
7:34
Oh, I didn't notice.
7:35
Oh, here, yeah, I can do that for you.
7:36
Yeah, that makes more sense.
7:37
There we go.
7:40
There we go.
7:41
Yep, we're working this snake together.
7:44
See, it didn't feel dirty until I said that, did it?
7:48
So, yeah, so you pull and I feed.
7:51
There we go.
7:52
I get how this works.
7:53
Wait, no, that's not right.
7:54
No, no, no.
7:55
No, what's going on here?
7:56
We're doing this backwards.
7:57
This is my end.
7:58
Are you sure?
7:59
I know what the problem is.
8:00
It goes this way.
8:04
Brilliant.
8:05
Okay, and now we've got it backwards.
8:07
You were the fuller.
8:08
There we go.
8:09
There.
8:10
I'm glad we got this sorted out.
8:12
We're just keeping them all straight, though.
8:15
It's way easier this time.
8:16
I'd have hated for this to get embarrassing.
8:18
You've got to learn to be real good at catching.
8:21
Okay, this is starting to worry me now a little bit.
8:26
This water-cooled server has to move to the bottom of the rack.
8:30
In the event that there's a leak, the last thing we want it to do is nuke $50,000 worth
8:36
of enterprise-grade Seagate hard drives, not to mention the Storinators.
8:41
I actually want to move these existing Storinators up to put Petabyte Project at the very bottom
8:50
networking cables here, heavy hard drives here, because I like them bottom-heavy, baby.
8:57
You've seen my wife.
8:58
I clearly don't like them top-heavy.
9:00
Are you good?
9:01
Yeah.
9:03
Oh, yeah.
9:04
I'm good.
9:05
It's like he thinks he's here to install Petabyte Project.
9:06
He's actually just helping me do server room maintenance.
9:09
I got this side.
9:10
Yeah, I got as much of this side as I can.
9:12
Cool.
9:13
Look at that.
9:15
That's not so bad.
9:16
Smooth.
9:17
Good.
9:18
Server room crap with Linus and Brad.
9:19
Oh, my gosh.
9:20
Oh, my gosh.
9:21
Oh, my gosh.
9:22
Oh, my gosh.
9:23
Use the bottom server as a shelf for the top server.
9:28
No problem.
9:30
So, update time.
9:33
We have Delta 1 and Delta 2 servers deployed.
9:38
We've got our network configuration all set up.
9:41
We're running CentOS.
9:43
And it is time now to load in one Petabyte of hard drives.
9:51
Oh.
10:02
You know what?
10:04
Let's just take one box at a time.
10:05
Here it is.
10:06
First drive's going in.
10:07
Here it goes.
10:08
Oh, that's a tight fit there.
10:09
There we go.
10:10
Oh, it's in.
10:11
Okay.
10:12
So, now we just got to do that 97 more times.
10:14
Here we go.
10:15
I guess it gets less exciting after the first couple.
10:16
Yeah.
10:17
Really, I turned my back for like five seconds.
10:18
I brought the whole system down.
10:19
Five seconds.
10:20
Okay.
10:21
Let's go.
10:23
I brought the whole system down.
10:24
Five seconds.
10:25
Okay.
10:26
Let's go.
10:27
Let's go.
10:28
Let's go.
10:33
Let's go.
10:34
Let's go.
10:35
Let's go.
10:36
Let's go.
10:37
I brought the whole system down.
10:38
Five seconds.
10:39
Okay.
10:40
Let's just get this stupid thing out of here.
10:41
I'll figure out how to get it taped on there properly later.
10:44
Okay.
10:45
Okay.
10:46
So, hold on.
10:47
Let's go all the way back.
10:48
Let's start at the beginning.
10:49
Okay.
10:50
So, all the drives are in.
10:51
We're ready to fire it up.
10:52
So, first, we take our hard drives and we separate them into VDEVs.
10:55
That's correct.
10:56
Then, we take those VDEVs and we combine them into ZFS pools.
11:00
Yeah.
11:01
And the beautiful thing is it's all one command.
11:03
It does it for us.
11:04
We just tell it what we want to build.
11:06
Okay.
11:07
So, we take those pools and we divide them up into bricks.
11:11
You got it.
11:12
And then bricks we use to build up our GlusterFS cluster file system.
11:17
You got it.
11:18
So, Gluster handles the scaling.
11:21
The ZFS layer handles the device failure, all that fun stuff.
11:26
So, with Gluster then, we could add more Storinators to have more than a petabyte of data.
11:31
That's correct.
11:32
Or we could add two more identical Storinators and we could have redundancy.
11:36
Yep.
11:37
Okay.
11:39
Let's get started.
11:40
So, it looks like we might have a bunk drive.
11:43
Okay.
11:44
So, we found the device that's spitting out errors.
11:46
It's this guy right here.
11:49
So, what we're going to do, just a basic troubleshooting step is we're going to swap it with a drive
11:56
that is working.
11:57
Device SDAQ again.
11:59
So, that's the slot.
12:03
Bad cable would be bad.
12:05
Bad cable would be bad.
12:07
That'd be really bad.
12:08
But, like, that is our farthest off chance.
12:12
So, you're thinking card right now.
12:14
Right.
12:15
It turns out I don't have the right cards here to throw in a replacement if the card
12:21
is bad.
12:22
But, honestly, that to me looks not as much like a card issue and more like a connection
12:30
issue.
12:31
So, what we haven't tried yet is just a simple unplug and plug back in at the HBA level.
12:38
Yeah.
12:39
Well, should I just pop them all and pop them all back in or?
12:44
Oh, no.
12:45
You know which one it is?
12:46
Yeah.
12:47
Okay.
12:48
We got it.
12:49
It worked.
12:50
SDAQ is back.
12:51
So, the solution was we actually have a port on the card that was kind of bunk.
12:57
But, the good news is these are what?
13:00
10 ports.
13:01
10 ports.
13:02
So, these are 40 drive cards.
13:03
So, we moved everything over one.
13:06
Everything's up and running.
13:07
We're ready to rock.
13:08
Yep.
13:09
You got it.
13:12
Okay.
13:13
One little thing we have to do.
13:14
I thought for a minute there Seagate was going to have a problem.
13:15
Yeah.
13:16
They were going to have a bad drive in their sponsored video or 45 drives was going to
13:20
have a bad port on their case in their sponsored video.
13:24
Wouldn't that have been funny?
13:26
Yeah.
13:27
Hilarious.
13:28
Yeah.
13:30
It wrote at 3.8 gigabytes a second.
13:32
3.8 gigabytes per second.
13:34
Check that out.
13:35
Count all the places, kids.
13:39
3,802,232 kilobytes per second.
13:47
Windows reports, even after all the space lost to ZFS, to redundancy, to Gluster, to
13:59
solar flares, 778 terabytes of storage.
14:06
So, we have effectively more than quadrupled the old space on the vault, which by the way,
14:13
was like super done, like super duper done for.
14:17
Here's a file move test file.
14:19
Here we go.
14:20
There's a 10 Gigabyte file.
14:21
Yeah, baby.
14:22
Those are spinners.
14:23
So, let's read off it back to a hardware radar.
14:24
You ready?
14:25
So, we're reading at a consistent one Gigabyte per second.
14:26
Absolutely gorgeous.
14:27
So, there you have it.
14:28
We're all done.
14:29
Petabyte project is complete.
14:30
I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I,
14:36
I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I,
14:44
I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I,
14:48
I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I, I,
14:49
III's TMA2 modular headphone system lets you create your own headphones and offers more than a thousand
15:00
configurations
15:01
How do you choose?
15:03
Well, they're launching TMA2 Discovery an interactive music driven experience
15:08
That's integrated as a special page on their website, and that's designed to guide users to the right
15:15
headphone configuration. It's based on data from Spotify's discover weekly playlist
15:22
It's a roundup of
15:23
Recommended songs chosen for you tailored to your tastes and based on your listening habits
15:29
III then recommends you the right TMA2
15:33
Configuration based on this and to celebrate this exciting new launch III is hosting a giveaway
15:39
so try the new discovery feature at the link below and
15:44
Screenshot your
15:45
Selected TMA2 config post it to Instagram using hashtag
15:49
TMA2 discovery and you will get a chance to win
15:54
So all that's left then now is a huge
15:56
Thank you to Seagate for providing their petabyte worth of drives and to 45 drives in particular Brett
16:03
Thank you very much for coming out and a thank you to you guys for watching if you guys dislike this video
16:09
You can hit that button, but come on
16:11
If you liked it hit the like button get subscribed maybe consider out checking more
16:15
about or wait what what links in the video description right where to buy the stuff we featured at
16:20
Amazon or over at 45 drives calm depending on what you're into and also down there
16:25
We've got our merch store where you can buy cool shirts like this one as well as our community forum
16:29
Which you should totally join now that you're done doing all that stuff. You're probably wondering what to do next
16:34
So why don't you leave a comment under the video with what Brett and I did wrong?
16:40
Can't read them. I'm just kidding you guys already did that
16:45
Okay, you know what Brett Brett Brett Brett?
16:47
I actually just had a really good idea. Oh, I don't really need this KVM anymore
16:52
So now your boss doesn't have to buy you one
16:55
Thank you for coming out
16:57
It works reasonably. Well, not as well as my new one button. Thank you, man
17:02
You're very welcome. So I guess that's how it works. We just we trade a petabyte for a used KVM switch
17:08
That's right. You're the greatest person ever eight ports VGA VGA. I'll get you some cables, too
17:13
I don't think I can give you all eight cables though. I got plenty of cables. Oh you do. Yeah
17:19
No, no, the proprietary. Oh, yeah, I'll give you a couple