WEBVTT

00:00:00.000 --> 00:00:08.080
now this is the part where we do six video editors with six

00:00:05.520 --> 00:00:12.960
graphics cards but we don't have six graphics cards

00:00:09.920 --> 00:00:14.080
i don't know what accent that is

00:00:12.960 --> 00:00:19.520
now it's not often around here that we have

00:00:16.720 --> 00:00:24.560
a project that's so big we don't even have enough hardware to validate if it's

00:00:21.600 --> 00:00:29.359
going to work but that's what six video editors one CPU has been like

00:00:26.960 --> 00:00:32.559
but the good news is that even though some of the final hardware isn't quite

00:00:31.439 --> 00:00:39.440
here yet we have enough to know for sure if it's

00:00:36.079 --> 00:00:41.120
gonna work so we've got all six monitors

00:00:39.440 --> 00:00:46.480
and the keyboards and mice that go with them for all of our stations we've got

00:00:43.680 --> 00:00:50.239
our pile of high-end graphics cards over here i don't know if you guys can even

00:00:47.760 --> 00:00:55.520
see this but i want one per system over here we've got oh this

00:00:53.199 --> 00:01:01.520
is really cool where is it ah oh yeah here it is we've got the

00:00:57.760 --> 00:01:03.680
replacement for that PCIe 4x interface

00:01:01.520 --> 00:01:07.680
to our daughter board so i believe this is either 8x or 16x which means we

00:01:06.159 --> 00:01:13.200
shouldn't run into bottlenecks for all of our usb controllers and

00:01:11.439 --> 00:01:18.720
we've got Intel optane along with the cards to go

00:01:16.000 --> 00:01:22.640
with that and better coolers for our 28 core cpus

00:01:21.680 --> 00:01:30.180
so today is the acid test does it actually work

00:01:28.479 --> 00:01:34.989
we're going to find out

00:01:37.840 --> 00:01:44.079
smart deploy allows it departments to re-image unlimited computer models from

00:01:42.159 --> 00:01:47.680
one golden image search their library and grab your exclusive free licenses

00:01:46.159 --> 00:01:51.840
worth over six hundred dollars at smartdeploy.com

00:01:49.360 --> 00:01:57.600
Linus so first order of business is to kind of reconstruct what's going

00:01:55.759 --> 00:02:02.479
on in here because we've had to tear apart a lot of it uh over the last

00:02:00.079 --> 00:02:06.799
little while due to other projects like that crazy thing with the four titan v's

00:02:04.880 --> 00:02:12.000
and all that nonsense so let's go ahead and get back to a

00:02:09.920 --> 00:02:16.879
functioning state and then we will go from there now because a big part of the

00:02:14.160 --> 00:02:20.879
goal today is eliminating all of the hypotheticals

00:02:18.400 --> 00:02:26.720
we're gonna do away with things like our gigantic split

00:02:24.239 --> 00:02:31.520
screen 4-way monitor and we're going to actually set up each workstation

00:02:29.440 --> 00:02:35.120
as it is intended to be used with a single monitor and keyboard and mouse

00:02:33.760 --> 00:02:38.959
although it should be noted that we could easily run dual monitors since

00:02:37.680 --> 00:02:44.720
we're just passing through entire graphics cards i gotta get this passenger here sorry

00:02:42.560 --> 00:02:48.640
david we're not quite going back to the

00:02:46.480 --> 00:02:52.080
previous state though one thing that we are going to change

00:02:50.560 --> 00:02:58.879
is this so now instead of a half height like low

00:02:56.400 --> 00:03:01.280
profile card that passes through pci express

00:02:59.840 --> 00:03:04.640
4x we have got this

00:03:03.360 --> 00:03:09.920
honkin sucka that we're gonna go ahead and uh

00:03:07.200 --> 00:03:14.800
i'm not sure which one's the host side and which one is the target side but uh

00:03:12.879 --> 00:03:17.920
we're gonna go ahead and install one of them

00:03:16.000 --> 00:03:22.560
into here you know what i think it actually has dip switches so that you

00:03:20.080 --> 00:03:25.760
can configure it they're both configured the same way

00:03:23.920 --> 00:03:28.959
maybe it doesn't uh

00:03:27.680 --> 00:03:33.920
so on

00:03:30.840 --> 00:03:37.200
on oh my god like it doesn't indicate

00:03:33.920 --> 00:03:38.879
what for six just one two four

00:03:37.200 --> 00:03:43.599
ah we'll figure it out

00:03:40.879 --> 00:03:48.959
okay so i think i figured it out uh these little switches we just need them

00:03:45.440 --> 00:03:50.959
in on on off for this guy and then

00:03:48.959 --> 00:03:55.680
uh hold on off on on for one two and four

00:03:54.720 --> 00:04:03.280
and uh oh okay

00:03:59.360 --> 00:04:04.319
but then six is labeled backplane type

00:04:03.280 --> 00:04:09.920
what it looks like we are running PCIe 8x

00:04:08.720 --> 00:04:18.400
although if we got our hands on another one of these cables we could run 16x

00:04:14.879 --> 00:04:20.799
by using uh dual host

00:04:18.400 --> 00:04:24.320
i think or something anyway

00:04:21.759 --> 00:04:28.800
8x should be enough to start this thing is just ridiculous like this

00:04:26.240 --> 00:04:32.080
connector look at it so even compared to the 4x connector we had last time which

00:04:30.800 --> 00:04:37.600
looks ba that's the 8x connector this is great i

00:04:35.520 --> 00:04:42.800
found the card from last time so instead of this card now we need this card

00:04:40.880 --> 00:04:45.600
so it's basically exactly

00:04:44.240 --> 00:04:48.240
this doubled up

00:04:48.400 --> 00:04:54.800
sheesh now we got to get the other side

00:04:51.759 --> 00:04:54.800
installed in our system here

00:04:55.120 --> 00:05:01.199
that's the only configurable thing on here let's go ahead and install it

00:05:00.000 --> 00:05:07.840
here these are all in

00:05:03.280 --> 00:05:07.840
i've got my NVMe drives here

00:05:09.600 --> 00:05:15.440
so the next thing i need ah there we go

00:05:12.960 --> 00:05:20.400
is the test cart hooked up to the back of the system here

00:05:17.919 --> 00:05:24.320
and then while i do that Yvonne is setting up all the stations

00:05:22.479 --> 00:05:29.919
with their monitors keyboards and mice though it will be a little bit until

00:05:26.960 --> 00:05:33.840
we're actually quite ready for that can i get that big yep

00:05:32.080 --> 00:05:38.000
exactly that and i think

00:05:36.160 --> 00:05:41.680
we should be ready to fire up the system i hooked up the power button this time

00:05:39.520 --> 00:05:44.960
to make my life a little bit easier so i guess we find out if that works right

00:05:43.120 --> 00:05:49.840
now uh-oh

00:05:47.039 --> 00:05:49.840
oh what the crap

00:05:50.479 --> 00:05:56.960
put the motherboard back in without actually hooking the

00:05:54.160 --> 00:06:01.360
motherboard power back up woo okay

00:05:58.800 --> 00:06:05.440
it's a little better so ridiculous

00:06:03.039 --> 00:06:10.960
you have to sign up for an account to get a user manual

00:06:07.360 --> 00:06:14.080
for this card and it wasn't working so

00:06:10.960 --> 00:06:16.960
fine i'm signed up and here we go

00:06:14.080 --> 00:06:22.080
okay i think i did it entirely wrong but i'm not sure why

00:06:19.280 --> 00:06:27.120
because their diagram here doesn't actually correspond

00:06:24.800 --> 00:06:30.720
to the number of dip switches that's on here

00:06:28.080 --> 00:06:34.880
on for one and two off for three and four that is completely different from

00:06:32.720 --> 00:06:37.680
what it says here as far as i can tell on

00:06:36.000 --> 00:06:42.720
for one and two off for three and four i really hope

00:06:40.160 --> 00:06:42.720
this works

00:06:44.080 --> 00:06:49.360
so i think it's configured right now what we should see is this fan spin when

00:06:47.680 --> 00:06:53.360
i power up and

00:06:51.120 --> 00:06:57.919
we got nothing and i don't know why

00:06:55.600 --> 00:07:02.160
okay there's another dip for black backplane type and that's just labeled

00:06:59.680 --> 00:07:06.319
directly on here so let's try selecting a different backplane type shall we

00:07:04.479 --> 00:07:10.160
nothing no power to it at all maybe we have to do the same thing on the other

00:07:07.599 --> 00:07:14.000
side wait oh no i turned this off while i was

00:07:11.360 --> 00:07:14.000
troubleshooting

00:07:14.720 --> 00:07:18.880
this is what happens when you hurry

00:07:18.960 --> 00:07:25.360
not that that fixed it okay now hold on a minute i think i get

00:07:23.280 --> 00:07:28.960
it oh boy

00:07:26.800 --> 00:07:35.680
okay whatever that is probably isn't good stop stop stop stop

00:07:32.080 --> 00:07:35.680
okay so off on off on

00:07:41.440 --> 00:07:47.039
so whatever mode you're using now you have

00:07:44.639 --> 00:07:50.319
to go from the bottom port out into

00:07:48.479 --> 00:07:55.280
the top port and it yeah i don't know it's on so uh maybe

00:07:54.080 --> 00:08:01.840
it's working there it is they have flashing lights on their slots but they're detected so

00:07:59.520 --> 00:08:05.440
presumably they're working uh one way we can tell for sure is just plugging this

00:08:03.520 --> 00:08:12.400
mouse into into one of them wait no i think i already have them stubbed

00:08:09.759 --> 00:08:14.639
yeah i do okay that that's fine that's fine

00:08:14.720 --> 00:08:22.080
oh snap oh crap

00:08:19.440 --> 00:08:26.879
oh shoot i just unplugged this uh that's really bad probably

00:08:24.639 --> 00:08:30.080
oh shoot oh i hope this still works

00:08:32.800 --> 00:08:38.159
don't smell burning it's turning back on and everything

00:08:36.000 --> 00:08:42.640
looks normal hopefully that's fine what just happened there so the next stage

00:08:40.959 --> 00:08:48.640
assuming that we're still past getting this to work stage

00:08:44.399 --> 00:08:48.640
is 10 gig networking for the whole thing

00:08:49.360 --> 00:08:54.560
still works that's good

00:08:52.880 --> 00:09:00.240
oh there it is we're 10 gig all right now i just just

00:08:56.800 --> 00:09:02.480
need to copy our install images off or

00:09:00.240 --> 00:09:07.640
at least one of them because it's time for us to put optane in

00:09:08.160 --> 00:09:14.640
that's how everyone does it that's industry standard

00:09:12.160 --> 00:09:20.800
so i actually only had five usb cards in here before i found another one that

00:09:16.720 --> 00:09:20.800
gives us the full complement of six

00:09:20.839 --> 00:09:28.959
and it's happening i'm swapping out these peasant

00:09:26.080 --> 00:09:34.000
750 series drives for optane the reason we care about

00:09:31.920 --> 00:09:39.600
running optane for our boot drives is that these handle random i o much better

00:09:37.360 --> 00:09:43.360
than traditional ssds and when we're going to have six operating systems

00:09:41.360 --> 00:09:47.920
running off them at the same time that becomes really important

00:09:45.760 --> 00:09:51.600
oh shoot i totally forgot i got to put all the graphics cards in

00:09:50.000 --> 00:09:57.360
let's see x little p

00:09:53.920 --> 00:09:59.120
titan x okay so titan x titan xp 1060

00:09:57.360 --> 00:10:02.480
1070 and

00:10:00.800 --> 00:10:08.240
maybe we'll put another quadro in there i don't know now we've yet to actually boot

00:10:06.320 --> 00:10:12.560
this motherboard with six graphics cards

00:10:10.560 --> 00:10:18.200
so we're in uncharted territory right now this could be the thing that kills

00:10:14.640 --> 00:10:18.200
the entire project

00:10:18.480 --> 00:10:24.000
let's do that one so jank

00:10:24.720 --> 00:10:28.160
jankness is real

00:10:31.279 --> 00:10:37.760
all right let's throw that on there okay

00:10:34.959 --> 00:10:40.480
this last card is our jankiest

00:10:39.120 --> 00:10:44.160
i think it's gonna have to kind of hang out right there

00:10:42.800 --> 00:10:49.519
okay should be fine

00:10:46.640 --> 00:10:49.519
now we fire it up

00:10:51.279 --> 00:10:55.440
and we have a display out so that's a good sign

00:10:55.920 --> 00:11:02.399
that's not a good sign i know we're asking for a lot here

00:11:00.240 --> 00:11:05.279
motherboard but if you could come through for me

00:11:07.519 --> 00:11:14.800
what the hell i don't think i have ever heard a

00:11:11.200 --> 00:11:18.480
hardcore sounding error code like that

00:11:14.800 --> 00:11:19.839
followed by the system just booting

00:11:18.480 --> 00:11:25.279
oh in order to display this message some

00:11:21.600 --> 00:11:26.959
pci devices were set to a disabled state

00:11:25.279 --> 00:11:30.480
oh maybe above 4g decoding will solve this

00:11:29.120 --> 00:11:35.760
problem okay let's see if above 4g decoding is going

00:11:33.279 --> 00:11:38.959
to help us boom there it is i think we're booting

00:11:38.160 --> 00:11:47.760
now did it just turn off now why didn't it pick up my boot device

00:11:44.800 --> 00:11:53.680
well that's interesting our usb key is just not even in here anymore

00:11:51.040 --> 00:11:58.079
okay so uh the only thing i changed was disabling the boot option rom from all

00:11:56.160 --> 00:12:02.720
of our pci express devices which i can't imagine mattered and then i moved our

00:12:00.399 --> 00:12:06.800
usb boot device into a different usb port i wonder if one of our onboard usb

00:12:04.800 --> 00:12:10.399
controllers isn't working because now it's showing up although maybe it

00:12:08.480 --> 00:12:15.760
was just a fluke last time i i don't know so it's here now

00:12:13.680 --> 00:12:18.480
let's see all right

00:12:16.959 --> 00:12:22.399
so now we're going optane on our cache

00:12:22.720 --> 00:12:28.880
and starting the array there's our titan xp

00:12:26.480 --> 00:12:35.120
there's our titan there's our gtx 1060

00:12:31.920 --> 00:12:37.040
there's our quadro gv100

00:12:35.120 --> 00:12:40.959
there's another one and there's our 1070. all six graphics

00:12:39.920 --> 00:12:47.440
cards are here and

00:12:43.440 --> 00:12:49.839
six usb controllers at least

00:12:47.440 --> 00:12:53.920
beautiful and there's our 10 gig card i think we've got everything we need here

00:12:52.160 --> 00:13:00.560
i should go duban show so update time lancho is now complete

00:12:57.279 --> 00:13:02.639
and we can start to dig in and make sure

00:13:00.560 --> 00:13:08.800
everything's working the way we expected now i still only have my four vms set up

00:13:06.560 --> 00:13:15.760
from the last test but this is as simple as making some

00:13:12.279 --> 00:13:18.160
reconfigurations to the CPU assignments

00:13:15.760 --> 00:13:21.440
the GPU assignments and the usb card assignments and bippity boppity we

00:13:19.839 --> 00:13:25.200
should be off to the races so theoretically

00:13:23.040 --> 00:13:28.320
we are going to just fire this bad boy up

00:13:27.040 --> 00:13:32.240
and and go now once we know everything's

00:13:30.560 --> 00:13:34.480
working and it's time to performance optimize we're going to want to do

00:13:33.600 --> 00:13:41.760
things like make sure that none of the vms have

00:13:37.360 --> 00:13:43.440
CPU cores that cross from one CPU socket

00:13:41.760 --> 00:13:47.920
to another because then we're going to take a performance hit there and we're

00:13:46.240 --> 00:13:51.600
also going to want to make sure that every vm

00:13:49.279 --> 00:13:57.440
has a graphics card that's in a slot that is actually also directly connected

00:13:54.480 --> 00:14:01.970
to the CPU that those cores are physically present on that's going to be

00:13:59.600 --> 00:14:07.440
really important

00:14:07.440 --> 00:14:12.399
i think i might have bumped that stupid cable again

00:14:10.720 --> 00:14:16.560
the whole system we started when i bumped that external pci express cable

00:14:15.040 --> 00:14:19.680
well i don't think it's because i bumped the cable i think it's because i don't

00:14:18.240 --> 00:14:23.920
really have the cards screwed in

00:14:22.399 --> 00:14:28.959
okay well while we wait for that we can do the

00:14:26.800 --> 00:14:31.600
uh totally safe

00:14:30.639 --> 00:14:35.199
um plugging in of display cables

00:14:34.399 --> 00:14:40.880
so oh can i just take a moment to point out

00:14:38.480 --> 00:14:45.079
how good i am at plugging in monitor cables without looking

00:14:45.279 --> 00:14:51.519
that no scope monitor plugging in david can i get an HDMI cable from down

00:14:50.240 --> 00:14:55.920
there sorry it's just hard for me to get down

00:14:53.440 --> 00:14:55.920
it's all good

00:14:56.720 --> 00:15:03.600
do you ever just like picture the engineers at Intel and NVIDIA

00:15:00.880 --> 00:15:06.800
watching something like this oh

00:15:04.560 --> 00:15:10.880
okay let's make sure all of our usb doodads are still in here

00:15:08.639 --> 00:15:15.680
one two three and four are up number five's not

00:15:12.959 --> 00:15:19.760
not doing anything did that one fail

00:15:17.600 --> 00:15:24.560
execution error could not find device all right

00:15:22.399 --> 00:15:28.320
we're just gonna do yield reboot and reseed all that stuff

00:15:26.560 --> 00:15:32.320
crap now let's try

00:15:30.399 --> 00:15:35.920
firing this up again and it should be fine so i think what happened was the

00:15:33.839 --> 00:15:40.399
usb controller for this one uh disconnected from the system

00:15:38.800 --> 00:15:44.320
when i bumped the cable and then the one for this one took the

00:15:42.560 --> 00:15:49.040
fifth slot so neither of them was able to start also

00:15:46.480 --> 00:15:54.399
what we can do now is we can come around here and see if

00:15:51.839 --> 00:15:58.399
any of these monitors are lighting up this one just turned blue

00:15:56.800 --> 00:16:02.880
so i think that means it's about to light up

00:16:00.480 --> 00:16:05.360
hey there we go there's one okay we got

00:16:04.320 --> 00:16:11.680
hey one this is not working

00:16:10.399 --> 00:16:16.320
uh do you want to let me know when you see a a pop-up over there

00:16:15.040 --> 00:16:19.600
on the like i'm going to plug in a mouse

00:16:20.240 --> 00:16:26.800
oh that's it yeah now we should be able to figure out which vm is supposed to be

00:16:25.040 --> 00:16:32.560
on all of the other monitors here theoretically this is ws1 but my display

00:16:29.279 --> 00:16:32.560
isn't lit up so

00:16:33.040 --> 00:16:39.839
what i'm hoping is that i'll like move the mouse and it will wake up

00:16:41.199 --> 00:16:46.320
honestly i don't even know what's going on right now

00:16:44.399 --> 00:16:48.880
also the name of this didn't change what is going on here

00:16:47.839 --> 00:16:51.839
yo hey

00:16:52.800 --> 00:16:59.279
wake up like this one just went from having a

00:16:57.120 --> 00:17:04.160
blue light to having no signal and a yellow light as i'm shutting down vms so

00:17:02.000 --> 00:17:09.360
what we can do in the meantime i guess is uh unraid has a new version or two

00:17:07.439 --> 00:17:15.039
actually since uh i installed this so why don't we update

00:17:12.240 --> 00:17:20.319
that and see if everything magically resolves itself the

00:17:17.439 --> 00:17:24.160
plot thickens now that we're rebooting the system to

00:17:21.919 --> 00:17:27.039
apply our update we have power to this keyboard

00:17:25.360 --> 00:17:31.280
my level of pissed off right now is pretty high

00:17:28.559 --> 00:17:34.240
now i've seen monitors that have a bit of a hard time

00:17:34.559 --> 00:17:41.280
picking up signals i have a hard time believing that

00:17:39.440 --> 00:17:44.840
six monitors here all have the same problem but i just say

00:17:43.760 --> 00:17:51.039
no signal so my theory

00:17:48.000 --> 00:17:52.400
about those cards being in order

00:17:51.039 --> 00:17:54.680
whenever it works we're going to label it as quickly as we

00:17:54.080 --> 00:17:58.880
can yeah

00:17:57.360 --> 00:18:01.840
all right next up

00:18:01.919 --> 00:18:08.320
is this guy that's not what i was expecting

00:18:06.080 --> 00:18:11.840
so this is the 1060. which one is that

00:18:10.640 --> 00:18:16.400
who knows so the little game we're playing is

00:18:14.000 --> 00:18:20.240
called find the patterns and so far the only one that has managed a successful

00:18:19.120 --> 00:18:25.600
reboot is number five i believe

00:18:23.440 --> 00:18:30.640
that's the one that i assigned the sound card to

00:18:28.799 --> 00:18:35.200
wouldn't that be funny okay that's actually booting there's four so

00:18:33.840 --> 00:18:39.360
it lit up but has not actually managed to start

00:18:36.960 --> 00:18:44.799
loading Windows yet oh there it goes now one thing john from unraid suggested

00:18:42.480 --> 00:18:48.720
was that we ended up screwing up where our v disks were some of them are on the

00:18:46.640 --> 00:18:52.880
array and some of them are on the cache and he had said he's run into some weird

00:18:50.559 --> 00:18:56.960
i o bottlenecking nonsense with the way that storage devices are virtualized

00:18:55.120 --> 00:19:00.160
that might be explaining some of the finicky behavior

00:18:58.720 --> 00:19:04.160
so we need to make sure all of those are on the octane drives

00:19:01.760 --> 00:19:09.440
number five came up so this one's now consistent which is good to see

00:19:06.320 --> 00:19:12.240
this is getting very interesting

00:19:09.440 --> 00:19:16.720
so six and two are the ones we haven't seen yet

00:19:13.360 --> 00:19:18.000
so everything that we've had working so

00:19:16.720 --> 00:19:23.600
far is working right now

00:19:21.280 --> 00:19:27.840
is six gonna light up for me so six should be this one theoretically

00:19:26.240 --> 00:19:32.640
all right so let's try moving those v discs and

00:19:29.919 --> 00:19:36.960
see if that solves it yeah neither of those are coming up okay

00:19:35.360 --> 00:19:41.520
okay we have some material to work with here i'm gonna shut her down for now

00:19:39.360 --> 00:19:45.280
pia hides your true ip address and allows you to bypass geo restrictions

00:19:43.360 --> 00:19:50.160
and censorship by making you appear as though you're connecting from somewhere

00:19:47.039 --> 00:19:52.320
else and you can use up to five devices

00:19:50.160 --> 00:19:56.240
at once it also helps prevent attacks by blocking unwanted connections it

00:19:54.000 --> 00:19:59.679
autoblocks all traffic if the vpn disconnects and it keeps your data out

00:19:58.000 --> 00:20:04.080
of the hands of advertisers and other activity tracking snoops so go try it

00:20:02.320 --> 00:20:10.559
out at the link in the video description today it's affordable and it works

00:20:10.559 --> 00:20:18.370
you bet you might as well eat some for a bit

00:20:15.039 --> 00:20:23.510
like don't don't die over this project