Preparing for 10 GIGABIT Internet! What Could Go Wrong?
Linus Tech Tips
·Linus Tech Tips
·2019-05-06
·
5,122 words · ~25 min read
0:00
so honestly the last thing i want to do is be here
0:04
in the office on a saturday agreed i mean Jake and nah Jake and Anthony
0:07
they're stoked oh yeah they're super thrilled yeah they love it but me
0:12
i wish i didn't have to be in here on a saturday but the problem is we have a
0:16
whack ton of stuff to do to fix our server room and our network
0:21
and the only time you can really do this sort of stuff
0:24
is when people aren't using it which means you have to come in on the weekend
0:28
so we need to change a bunch of our
0:37
we've gotta we've got a lot to do oh man oh i even
0:42
found out something else we get to do you guys telus came in for the site survey and we
0:47
get to redo all of this networking so
0:50
that they can get access to this to slide it out oh
0:54
you're joking right no no i'm not that was bad design it's the comb over
1:08
the best idea with glasswire you can instantly see
1:12
your current and past network activity detect malware and block badly behaving
1:17
apps on your pc or Android device use offer code Linus to get 25 off glasswire
1:22
at the link below i think step number one is to do what is
1:26
quite literally one of the scariest things that i do around here oh turn the
1:31
servers off turn the servers off oh this is going well already
1:36
oh oh boy so this is our new router it handles 10
1:41
gig it'll be running pf sense which means that we'll have much lower level
1:45
access to uh handling all of our networking tasks so uh if something goes
1:49
wrong we don't have to be like well okay is it a firmware issue we can go in and
1:53
be like yeah it's a configuration issue we can just edit this file and off we go
1:56
the reason we need it though is we're getting faster internet so it's five gig
2:00
to the broader internet but it's 10 gig to anything at the vancouver internet
2:04
exchange oh so that's like basically anything that matters so aws google so
2:08
our google backup is going to be super fast now oh yeah okay bring that down get this thing
2:13
fired up oh it's not even that heavy i carried this
2:17
thing up it's awkward and it's digging into my knee it's not even that awkward
2:21
okay there hold on i just had to lift it up a little bit now it's digging into my thigh muscle oh tasty i have been trying
2:26
to figure out for far longer than
2:30
would not be embarrassing a good way to hold this stupid
2:36
cabinet door open while i'm sliding servers in and out of it optane i mean
2:42
i'm sure if we wedged an obtain module in there it'd be perfectly fine so the
2:45
problem is that it kind of doesn't open all the
2:49
way easily so when you're trying to slide stuff out it like gets caught here
2:53
and here so here's my idea i'm gonna open it up
2:57
as much as i can then i'm gonna drill a hole in the side
3:00
of this keyboard tray
3:05
it's going the wrong way dang it
3:08
then i'm going to take the allen key that i
3:11
always have to have here anyway so that i can pull servers out and i'm going to jam it
3:17
right in there yes oh crap well now this can't lift up
3:22
and that's also in the way here's the thing johnny who originally
3:26
set up all of our vlans and all of our routing and all of that stuff has sort
3:31
of retired from the it consultancy business
3:35
so we're gonna be trying to piece together everything that he did on our
3:39
ubiquity gear and then reassemble it on our pf sense
3:44
box from supermicro here in theory this is just going to be
3:48
a simple one to one instant swap rooney it's not going to be
3:54
wow thanks Jake what a downer you still can't find it no it's like i looked
3:59
everywhere over there in the workshop too
4:02
i looked i looked through the workshop did you call alex
4:06
man the hangouts ring is like it feels pretentious hey sorry to bug
4:10
you um these the like blaster nozzle
4:14
from the compressor is missing oh he's calling where would we find that
4:18
oh i think so yes the air fittings tray
4:21
is completely empty there was two things in there i took them already oh okay no
4:25
there were two things in here that would not help us somebody put it in a dumb
4:28
spot so this is the router right here what it
4:32
took me literally less than 10 seconds to find it it was sitting okay it was
4:37
sitting on the chair that you refused to pick the things up off of last weekend i
4:42
took the doofus train going anywhere
4:47
going to the server room what server do you want first Jake
4:51
i literally don't care i'm gonna label
4:54
things better than i go put this out oh is it rainy oh actually 101 would be
4:59
good but it's kind of far away it's already dusty is all heck in there your
5:02
mom's already dusted a little heck in there you know what how does it feel
5:07
it smells like nothing
5:12
are you sure it smells oh it's it's uh it's you oh
5:17
i haven't showered in three months that's quite a thick boy did you drop
5:21
this thing uh no that happened in shipping is that what you tell everybody
5:25
whenever you drop something like yeah that happened in shipping got it you betcha
5:30
okay that's uncomfortable why did we leave that there come on go up oh you
5:35
want it on top yeah oh my god it's up so high
5:41
the server's minty bud doesn't even need this
5:45
come on this my friends is the real reason we
5:50
switched to solid-state storage so you can drop it and it doesn't break
6:02
there's another thing that we're doing today and there's another reason we're taking all the servers out people are
6:07
careless and accidentally sign hardware out particularly to albion server
6:11
because it's the top of the alphabet in our inventory system
6:15
like you i think we'll be able to figure out a lot of it by just looking at it
6:19
like just look at albion server that was checked out to it it's like this doesn't
6:22
have a z270 board in it yeah and an 8700k
6:27
we're going to need to turn this headphones in look at it we're going to need to album server really wanted those
6:31
logitech gpro headsets pretty closely oh you might have been right there's
6:35
actually some headphones checked out it's albion server i don't think they're wireless but
6:38
tuned in ear pro we got a gtx 1080 is there a 1080 in there yeah i don't think
6:43
so so um and a monitor this thing even has its own monitor hey oh yeah
6:48
every single damn time i forget how the lid comes off of this stupid server
6:54
like there's one screw back here and i could have sworn that was the whole
6:58
skadoodle the gosh darn skadoodle there bud hey wow this is a you think it just
7:03
like what if i break it is that a problem
7:06
i mean wow you are loud i'm just gonna you know
7:10
what i'm just gonna let you bask in there how long did it take me to find the nozzle
7:14
i i say that you finding the nozzle was kind of a fluke
7:19
do you want to just go clean servers or are you gonna help me no i'm gonna help
7:23
you because after they're cleaned they need they all need to be audited so i
7:27
finally got an ip address mail to access the pf sense box this cable that we had
7:32
for the test card is garabaggio
7:36
got another cable it's fine yay we're started
7:39
yeah we've got the xeon d 2.3 gigahertz 16 threads eight cores we've got 32 gigs
7:46
32 gigs of RAM it's i think i read somewhere that the bandwidth mattered or
7:50
something and i think those were the lowest capacity ecc dimms we had it
7:55
really i don't know dude i say we just let it keep the RAM
8:00
fine i like whams so we're only what an
8:03
hour and a half in i actually don't know if we're gonna have all of this done by monday i am
8:08
finished auditing one server and Anthony is copying config files
8:12
oh come on do i even care should i put
8:16
the the drive covers over the top does it matter
8:20
i just don't know if it matters Jake do these matter they're probably good for
8:24
like vibration or something oh they see they that's exactly what
8:28
they're for yeah oh god
8:32
oh we just oh we blew each other oh no that's
8:36
fortunate at least one of these bays has an SSD in it but i don't see any so far
8:41
no no no no no oh no i need
8:47
i don't even i don't even know the best way to do this
8:52
so signed out to this server are at least one
8:57
two seven ssds that are not in it
9:01
also i really hope it didn't matter that i
9:04
changed the order of these probably not hopefully oh i really hope not how many
9:09
combinations of 24 items are there
9:15
seems like kind of a lot it's probably fine
9:18
wait what am i doing why am i putting them back in i have to scan them
9:22
oh okay oh and they're jammed
9:27
uh Anthony can i borrow your vga cable and uh peripherals and stuff yeah
9:32
dang it Anthony who screws in vga it's proper procedure to screw in vga yeah
9:37
but like it's just a test bench man
9:40
i love that servers don't sound like they're booting up they sound like
9:43
they're taking off yeah it sounded like you turned on a vacuum cleaner
9:50
so this is bad this has been taking far too long to boot there was also that
9:54
weird error with the lsi controller at the beginning or avago or
9:59
whoever owns that now so all i can really do right now is like replug it
10:03
and hope for the best here this is really
10:08
not a good scene
10:12
please poop
10:18
oh oh that's good wait yes oh oh
10:21
yes he's that is that oh that's all the drive so good
10:25
holy crap i don't know how that happened
10:28
or how it got fixed which is the very worst kind of fixed
10:32
let's go ahead and shut this bad boy back down
10:37
and go throw it in the pile of audited and all good
10:42
yeah winning this is taking a lot longer than we thought hey
10:46
well look how easy that was to get off this one's a little dirtier
10:53
why is this one so dirty
10:57
yeah that's gross 10 11 12 13 14 15 16 17 18. ah
11:04
how's that teamwork all right i heard it makes the dream work
11:08
yeah really yeah that's what i heard dreamworks that's what i heard through the trademark we can't say that i don't
11:12
think we can say that so we still have as you may or may not have
11:17
noticed a pci express 16 hex slot you want to
11:20
put another one in there 40 gig or what are they 100 gig those stupid
11:24
are they 40 or 100 technically 100 that seems like a little upright i don't
11:28
think our switch does 100 though did it work with the Ethernet devices could you
11:32
connect to an Ethernet device over the infiniband as well oh yeah yeah sure
11:35
fine let's do it we actually have like six of those 40 gigabit ports on the uh
11:40
on the switch though yeah on the down low what ah
11:45
i don't know how this ended up in the baggie for it but it's not the right
11:49
size what really did it come with a low profile bracket i don't know well can we
11:54
just zip tie life oh people are gonna hate us
12:00
i dropped a bomb over here i probably wouldn't come home oh okay
12:04
i think this is the one that can technically do 40 gigabit but also can't
12:08
oh do you think those line up oh they probably do they're both malinox
12:11
probably yeah so we're just going to take the stock bracket and then we're
12:16
just going to cut out the parts we don't need and zip tie the card to the other
12:20
parts that we do still need it's a good plan
12:28
we should throw that at dennis and tell him it's a bug how's this going Anthony
12:31
i think this is about ready to go seriously basically i just need to
12:34
change the interface over so that it uses a vlan okay but uh once i change
12:38
that over to the office lan we should just be able to drop it in and it should
12:42
basically just work should or will uh well do you set up all the dhcp servers
12:47
yes so this is another change we're making we're putting the dhcp server back on
12:52
our router we're taking it off that uh vm that was running on one of the
12:57
Windows servers which we just typically already did that was uh did we turn that
13:00
off already oh i did that a long time ago when our internet broker the internet was broken for like a week
13:05
turns out our router's date was set to 2016. that was a good year though
13:10
this is clover server and this was built long enough ago that
13:14
eight terabyte drives were like pretty dece you say that like eight terabyte
13:18
drives aren't pretty decent still you're gonna wish
13:22
you never even thought of dust could you get this out of the way here
13:26
oh whoa whoa there's a lot of hard drives on there this whole bottom shelf
13:29
is full of hard drives why did we use this rack well because it's the lower
13:33
one
13:39
like that yeah you like that
13:43
no don't spin the fan lioness that's just a little it's fine
13:48
we should just do whole server room water cooler
13:51
pk actually has the proper stuff to do it
13:55
okay looking good all right why don't you roll the server for a change okay
13:59
but if i drop all the hard drives it's not my fault
14:04
did you fart again i think you're lactose intolerant oh
14:08
yeah i am oh holy crap it still smells like fart i
14:14
put the compressor in the middle so now we can walk wherever we want all right
14:19
we're heading to the uh move your foot are you only here one
14:23
thing at a time Jake is just speaking
14:28
now you don't hear nothing so for the uninitiated this is our water cooled
14:33
uh video export machine i won't really call it a server even though it's in a
14:37
2u rack mountable case because it's very
14:41
consumer hardware inside the main issue with this one is that it's at the very
14:45
bottom of the rack
14:49
oh yeah the orange RAM i forgot about that these are my old drives from like
14:54
my gaming rig you're referring they were refurbed when you refurb force 120s that
14:59
i bought like seven or eight years ago
15:10
well that's yeah that's a lot better than i expected given that oh you know
15:13
what i forgot this case is filtered probably need to
15:17
clean up not inside
15:20
so all that's left now is we're just going to blow out petabyte
15:24
projects in the server room we'll have that fan on and we're just going to blow
15:27
the dust out into the warehouse and good luck everybody else rip Anthony whoa
15:32
watch out there bud whoa bud we're getting attacked watch your toes there
15:36
bud are you ready for the full chooch
15:42
we got a x540 t2 yep e5 2620v4 that
15:46
sounds about right two x 400 128 gig
15:49
ssds xl16 does that say triple redundant
15:52
it does ooh baby a triple and then delta one should have 60 drives oh i don't
15:58
want to count Jake do you want to grab your screwdriver and then let's get this
16:01
edge router pro out of here pf sense actually has a really cool feature
16:05
what's it called carp failover or something like that something like that so we're just rolling out one for now
16:10
but in the future we can actually have them both connected and running in the
16:14
event that one does experience some kind of malfunction we can just uh
16:18
have it fail over automatically like i think at most you drop like a handful of
16:22
packets it's no big deal you say that like you don't like dropping packets
16:26
right Linus what i don't i don't even know what you're talking about you don't like dropping packets i'm just trying to
16:31
get this work done what if we have to drop packets to do it well we're
16:34
dropping a whole lot of packets right now wow this is very poorly installed
16:39
i know i [ __ ] hate it so i just take it out then
16:44
no because it's hardwired in at the back why is it
16:48
just i love security companies but the point is
16:52
we're gonna move it we're not gonna move it yet but soon all right time to go get
16:58
big bertha big bertha that's what your mom calls it
17:04
hey lioness yep i got some bad news what
17:08
i dropped it what no shut up you didn't no you didn't
17:12
wow so this is our new main switch
17:18
shut up so it's got 48 10 gig rj45 ports
17:23
and then this is delicious it's got six
17:26
more of these 40 gig qsfp plus ports or
17:29
whatever what's on the bottom that's our edge router at the bottom that's our edge
17:33
router that goes let me take some photos of everything just so for whatever
17:36
reason we have somewhat recollection
17:40
how about we just pull out everything we don't need to let everything turn this router off
17:45
okay so there's our old router and here this is our first 10 gig switch
17:51
i remember how excited i was about this thing when i first got it you ever
17:54
cleaned it oh look at those dust bunnies yeah i clean it once at least
17:58
so this is done this is done they're done
18:03
um Anthony how what are our what's our whoa that's
18:06
my screwdriver what are our chances looking like that by your butt well
18:10
given everything i know about networking yes this is not going to work it'll
18:13
never work what why not the first time shut up given everything i know all the
18:17
experience i've ever had with networking gear fine it's not going to work let me know when
18:22
you want to try it or if you want to just throw it right in and i'll set the
18:25
interfaces and shut it down all right thanks Anthony
18:29
i don't want to take up the entire length of the rack if we don't have to
18:33
if we can ear mounted i'd strongly prefer to do that it doesn't have ear
18:36
mounds well if we can find another way
18:46
oh god you just dropped the switch too i'm
18:50
sorry but it's really hard not to laugh
18:53
and now he's pretending like it doesn't hurt it hurts
18:57
a lot yeah i think you're just a whiny baby
19:00
yeah that pays my paycheck i can't even i can't even see what i'm
19:05
doing just you can't just unplug everything yes i
19:08
can oh oh damn it what the [ __ ]
19:11
who put this there you did it no i didn't Anthony
19:15
what your stupid amplify thing just hit me in
19:19
the face i don't know what i'm doing are you am i
19:22
able to pull this anymore out you should just get a new rack do you
19:27
want to come in for the additional weekend that it would take to swap racks
19:30
okay let's just pull this out we should just pay somebody we got the london look in our server
19:35
right now why did you plug it in it's on look at
19:40
that it's alive we need to switch those fans around hey
19:44
which way are they going they're blowing out this way oh crap i remember that now
19:49
no we can't flip those fans around i thought that was the whole point
19:53
yeah just gentle gentle gentle
19:57
we don't have time for jammed my hand in the thing
20:01
okay so Jake you've got all the
20:04
all the all the wires now the orange wand is still here okay that's fine we
20:08
can leave that i think i've already pulled it out what
20:12
well around the other side around the outside round the outside
20:17
oh you look fine yeah i feel fine
20:20
everything's fine wow we should really not run that on the inside of the rail wait did we just
20:24
unplug all the cameras wait a minute what the hell the camera yeah we unplugged all the
20:28
cameras of course we did yeah we can put the router here but i
20:31
want to move that stupid nvr somewhere else okay so this is just an Ethernet cable
20:36
we can replace this with wait where the hell was that plugged
20:39
into uh on the other side other side far far side far side
20:43
it's gonna sag and look stupid don't put the screws in properly i'm going to put
20:48
it on the top of the ups for now but there's a fan there
20:51
yeah i'm not going to put it on the top of the rack for now fine i'll put it on
20:54
the top no i need the top of the rack for organizing things i'm going to put
20:58
it back there for now so
21:01
uh Anthony figured out why we're not getting an ip Anthony you mean we
21:06
figured out well i figured out he figured out we were not
21:10
getting an ip what do you mean you figured i figured out why
21:14
i said did you set it i told you why i
21:17
asked if we needed a static ip well i didn't hear you okay so
21:22
let's start plugging in devices here shall we yeah
21:28
okay i need more energy from you i'm dying
21:32
trying to access that router so i can get the settings off of it so i
21:35
can get our internet back up long story short vlans
21:40
they don't work when you plug it directly into a computer oh i have a
21:43
switch for you well i i have a switch here that i just plugged in oh yeah
21:46
that's the switch i was going to give you so Linus yeah
21:49
these are numbered the same like i know maybe changing these to a different
21:53
color cable or what if we just mark them with a sharpie i'm gonna just oh you
21:57
just get one this is actually a really good idea yes
22:00
yeah that's right you like that wow you suck you know that
22:04
that's actually really irritating i'm actually genuinely a little bit mad
22:09
now yeah you mark them yourself
22:13
no you can't have it get one
22:21
oh damn it i hot glued the lock on this door
22:26
no he can't lock it don't even
22:29
they're back off i've been watching lots of sword fighting shows
22:35
do you see how they go for the shin you go for the shin in the face oh my
22:38
gosh you didn't even get me oh see that's the thing is the word
22:43
really what are all these kids nobody does that on the potty hey nobody's a strong word
22:49
you can't do that on cable type cable ties zip ties i've got a router
22:54
yeah zip ties too no you need a router i need it i don't i don't think you
22:58
understand they're definitely too close is this better whatever you're doing oh my ankle
23:04
is this minimum focus distance good enough i need zip ties okay i would really like
23:09
for this to not fall down and smoke me in the head
23:12
that would be three for three though all right
23:16
yeah we really need him to drop a third thing on his head
23:20
oh why is there a monitor stand in here
23:24
because it's the stand for that monitor oh my god well where else would i put it
23:28
i don't know like long-term storage for this thing that's
23:31
going to be long-term storage so you went to ubc for science general sciences
23:36
yeah so you were just burning money
23:40
it sounds very this sounds very unlike you to just burn
23:44
money like that clearly i figured it out at some point yeah you did you
23:48
definitely did why didn't you go into business
23:52
because i didn't listen to my uncle who hopefully will not watch this video
23:55
because i will get the most epic told you so
23:59
i just thought i was bleeding but there's some some ass hey Jake do you remember when
24:03
you were uh mining in the server room and you were
24:06
gonna monitor the power usage with this and you were gonna pay me back yeah yeah
24:10
remember how that didn't happen hey david move uh
24:15
uh
24:18
epic power cord that's a nice sheet thick
24:22
looks like twelve it's a thick boy like that Linus guy
24:27
what is all this yeah here
24:31
just i don't know people just bring in a power cord or whatever never take it out
24:36
i know i did that a bunch give a ton of thought to wait weren't you never supposed to unplug that thing jeez
24:42
this the the just sheer amount of extra wiring in
24:47
here is ludicrous
24:50
i think that we're ready to go you think i'm reasonably sure we're ready to go
24:55
this isn't even powered on yet do you have the air screws or the ear screws here you don't need
25:00
them it's fine okay it was a trap Linus what are all
25:04
these screwdrivers what screw drivers
25:08
what are you talking about there's like four screwdrivers just sitting in the
25:11
bottom here what like under the duve yeah under the
25:14
what the kid can do work
25:18
i mean he works real hard at it for like putting tape on the ground i really hope
25:23
it just kind of lights up and works that would be super cool it's gonna be really
25:28
unfortunate if it doesn't yeah i actually don't know what we will
25:31
do we will learn command line switch configuration
25:36
what's beeping oh the ups is having a
25:40
hissy fit oh turn unit off no wait what what is
25:43
going on no no this is kind of moment of truth it's in it's on
25:48
wait here let me unplug this and plug it back in again what no no no no just like
25:52
let's just find out if it works all right okay well i already did that so i
25:55
hope that didn't break anything wait i'm plugged into 15 upstairs i think is that
25:59
plugged in uh i don't know you tell me you're the one who fed me
26:03
all the cables from the front supposedly ah there's a 15 right there plugged in
26:07
cool all right i'm gonna go upstairs and see if we have internet
26:13
that was too much impact from my uh testicles
26:19
so here it is the moment of truth
26:23
it's not working freshbooks is the small business
26:26
accounting software that's custom built for how you want to work it's a simple
26:30
way whether you're a small business owner or a freelancer to be more
26:33
productive more organized and to get paid faster you can create and send
26:38
professional looking invoices in less than 30 seconds you can set up online
26:42
payments with just a couple of clicks to get paid up to four days faster you can
26:46
see when your client has seen your invoice to put an end to the guessing
26:50
games and you can take the entire freshbooks experience with you on the go
26:54
with their iOS and Android apps so don't
26:57
wait try out freshbooks for 30 days for free at freshbooks.com tech tips just
27:02
make sure you enter Linus tech tips in the how you heard about us section it is
27:07
unreachable
27:11
so you said that the switch had to support vlans right yeah well do they
27:16
have to be configured should have been just drop in unless you configure
27:20
are you using new switches i'm using the dell
27:23
so why don't i plug you guys into
27:29
the netgear switch and we see if that works
27:32
it should well let's see if it does