now this is the part where we do six video editors with six
graphics cards but we don't have six graphics cards
i don't know what accent that is
now it's not often around here that we have
a project that's so big we don't even have enough hardware to validate if it's
going to work but that's what six video editors one CPU has been like
but the good news is that even though some of the final hardware isn't quite
here yet we have enough to know for sure if it's
gonna work so we've got all six monitors
and the keyboards and mice that go with them for all of our stations we've got
our pile of high-end graphics cards over here i don't know if you guys can even
see this but i want one per system over here we've got oh this
is really cool where is it ah oh yeah here it is we've got the
replacement for that PCIe 4x interface
to our daughter board so i believe this is either 8x or 16x which means we
shouldn't run into bottlenecks for all of our usb controllers and
we've got Intel optane along with the cards to go
with that and better coolers for our 28 core cpus
so today is the acid test does it actually work
we're going to find out
smart deploy allows it departments to re-image unlimited computer models from
one golden image search their library and grab your exclusive free licenses
worth over six hundred dollars at smartdeploy.com
Linus so first order of business is to kind of reconstruct what's going
on in here because we've had to tear apart a lot of it uh over the last
little while due to other projects like that crazy thing with the four titan v's
and all that nonsense so let's go ahead and get back to a
functioning state and then we will go from there now because a big part of the
goal today is eliminating all of the hypotheticals
we're gonna do away with things like our gigantic split
screen 4-way monitor and we're going to actually set up each workstation
as it is intended to be used with a single monitor and keyboard and mouse
although it should be noted that we could easily run dual monitors since
we're just passing through entire graphics cards i gotta get this passenger here sorry
david we're not quite going back to the
previous state though one thing that we are going to change
is this so now instead of a half height like low
profile card that passes through pci express
4x we have got this
honkin sucka that we're gonna go ahead and uh
i'm not sure which one's the host side and which one is the target side but uh
we're gonna go ahead and install one of them
into here you know what i think it actually has dip switches so that you
can configure it they're both configured the same way
maybe it doesn't uh
so on
on oh my god like it doesn't indicate
what for six just one two four
ah we'll figure it out
okay so i think i figured it out uh these little switches we just need them
in on on off for this guy and then
uh hold on off on on for one two and four
and uh oh okay
but then six is labeled backplane type
what it looks like we are running PCIe 8x
although if we got our hands on another one of these cables we could run 16x
by using uh dual host
i think or something anyway
8x should be enough to start this thing is just ridiculous like this
connector look at it so even compared to the 4x connector we had last time which
looks ba that's the 8x connector this is great i
found the card from last time so instead of this card now we need this card
so it's basically exactly
this doubled up
sheesh now we got to get the other side
installed in our system here
that's the only configurable thing on here let's go ahead and install it
here these are all in
i've got my NVMe drives here
so the next thing i need ah there we go
is the test cart hooked up to the back of the system here
and then while i do that Yvonne is setting up all the stations
with their monitors keyboards and mice though it will be a little bit until
we're actually quite ready for that can i get that big yep
exactly that and i think
we should be ready to fire up the system i hooked up the power button this time
to make my life a little bit easier so i guess we find out if that works right
now uh-oh
oh what the crap
put the motherboard back in without actually hooking the
motherboard power back up woo okay
it's a little better so ridiculous
you have to sign up for an account to get a user manual
for this card and it wasn't working so
fine i'm signed up and here we go
okay i think i did it entirely wrong but i'm not sure why
because their diagram here doesn't actually correspond
to the number of dip switches that's on here
on for one and two off for three and four that is completely different from
what it says here as far as i can tell on
for one and two off for three and four i really hope
this works
so i think it's configured right now what we should see is this fan spin when
i power up and
we got nothing and i don't know why
okay there's another dip for black backplane type and that's just labeled
directly on here so let's try selecting a different backplane type shall we
nothing no power to it at all maybe we have to do the same thing on the other
side wait oh no i turned this off while i was
troubleshooting
this is what happens when you hurry
not that that fixed it okay now hold on a minute i think i get
it oh boy
okay whatever that is probably isn't good stop stop stop stop
okay so off on off on
so whatever mode you're using now you have
to go from the bottom port out into
the top port and it yeah i don't know it's on so uh maybe
it's working there it is they have flashing lights on their slots but they're detected so
presumably they're working uh one way we can tell for sure is just plugging this
mouse into into one of them wait no i think i already have them stubbed
yeah i do okay that that's fine that's fine
oh snap oh crap
oh shoot i just unplugged this uh that's really bad probably
oh shoot oh i hope this still works
don't smell burning it's turning back on and everything
looks normal hopefully that's fine what just happened there so the next stage
assuming that we're still past getting this to work stage
is 10 gig networking for the whole thing
still works that's good
oh there it is we're 10 gig all right now i just just
need to copy our install images off or
at least one of them because it's time for us to put optane in
that's how everyone does it that's industry standard
so i actually only had five usb cards in here before i found another one that
gives us the full complement of six
and it's happening i'm swapping out these peasant
750 series drives for optane the reason we care about
running optane for our boot drives is that these handle random i o much better
than traditional ssds and when we're going to have six operating systems
running off them at the same time that becomes really important
oh shoot i totally forgot i got to put all the graphics cards in
let's see x little p
titan x okay so titan x titan xp 1060
1070 and
maybe we'll put another quadro in there i don't know now we've yet to actually boot
this motherboard with six graphics cards
so we're in uncharted territory right now this could be the thing that kills
the entire project
let's do that one so jank
jankness is real
all right let's throw that on there okay
this last card is our jankiest
i think it's gonna have to kind of hang out right there
okay should be fine
now we fire it up
and we have a display out so that's a good sign
that's not a good sign i know we're asking for a lot here
motherboard but if you could come through for me
what the hell i don't think i have ever heard a
hardcore sounding error code like that
followed by the system just booting
oh in order to display this message some
pci devices were set to a disabled state
oh maybe above 4g decoding will solve this
problem okay let's see if above 4g decoding is going
to help us boom there it is i think we're booting
now did it just turn off now why didn't it pick up my boot device
well that's interesting our usb key is just not even in here anymore
okay so uh the only thing i changed was disabling the boot option rom from all
of our pci express devices which i can't imagine mattered and then i moved our
usb boot device into a different usb port i wonder if one of our onboard usb
controllers isn't working because now it's showing up although maybe it
was just a fluke last time i i don't know so it's here now
let's see all right
so now we're going optane on our cache
and starting the array there's our titan xp
there's our titan there's our gtx 1060
there's our quadro gv100
there's another one and there's our 1070. all six graphics
cards are here and
six usb controllers at least
beautiful and there's our 10 gig card i think we've got everything we need here
i should go duban show so update time lancho is now complete
and we can start to dig in and make sure
everything's working the way we expected now i still only have my four vms set up
from the last test but this is as simple as making some
reconfigurations to the CPU assignments
the GPU assignments and the usb card assignments and bippity boppity we
should be off to the races so theoretically
we are going to just fire this bad boy up
and and go now once we know everything's
working and it's time to performance optimize we're going to want to do
things like make sure that none of the vms have
CPU cores that cross from one CPU socket
to another because then we're going to take a performance hit there and we're
also going to want to make sure that every vm
has a graphics card that's in a slot that is actually also directly connected
to the CPU that those cores are physically present on that's going to be
really important
i think i might have bumped that stupid cable again
the whole system we started when i bumped that external pci express cable
well i don't think it's because i bumped the cable i think it's because i don't
really have the cards screwed in
okay well while we wait for that we can do the
uh totally safe
um plugging in of display cables
so oh can i just take a moment to point out
how good i am at plugging in monitor cables without looking
that no scope monitor plugging in david can i get an HDMI cable from down
there sorry it's just hard for me to get down
it's all good
do you ever just like picture the engineers at Intel and NVIDIA
watching something like this oh
okay let's make sure all of our usb doodads are still in here
one two three and four are up number five's not
not doing anything did that one fail
execution error could not find device all right
we're just gonna do yield reboot and reseed all that stuff
crap now let's try
firing this up again and it should be fine so i think what happened was the
usb controller for this one uh disconnected from the system
when i bumped the cable and then the one for this one took the
fifth slot so neither of them was able to start also
what we can do now is we can come around here and see if
any of these monitors are lighting up this one just turned blue
so i think that means it's about to light up
hey there we go there's one okay we got
hey one this is not working
uh do you want to let me know when you see a a pop-up over there
on the like i'm going to plug in a mouse
oh that's it yeah now we should be able to figure out which vm is supposed to be
on all of the other monitors here theoretically this is ws1 but my display
isn't lit up so
what i'm hoping is that i'll like move the mouse and it will wake up
honestly i don't even know what's going on right now
also the name of this didn't change what is going on here
yo hey
wake up like this one just went from having a
blue light to having no signal and a yellow light as i'm shutting down vms so
what we can do in the meantime i guess is uh unraid has a new version or two
actually since uh i installed this so why don't we update
that and see if everything magically resolves itself the
plot thickens now that we're rebooting the system to
apply our update we have power to this keyboard
my level of pissed off right now is pretty high
now i've seen monitors that have a bit of a hard time
picking up signals i have a hard time believing that
six monitors here all have the same problem but i just say
no signal so my theory
about those cards being in order
whenever it works we're going to label it as quickly as we
can yeah
all right next up
is this guy that's not what i was expecting
so this is the 1060. which one is that
who knows so the little game we're playing is
called find the patterns and so far the only one that has managed a successful
reboot is number five i believe
that's the one that i assigned the sound card to
wouldn't that be funny okay that's actually booting there's four so
it lit up but has not actually managed to start
loading Windows yet oh there it goes now one thing john from unraid suggested
was that we ended up screwing up where our v disks were some of them are on the
array and some of them are on the cache and he had said he's run into some weird
i o bottlenecking nonsense with the way that storage devices are virtualized
that might be explaining some of the finicky behavior
so we need to make sure all of those are on the octane drives
number five came up so this one's now consistent which is good to see
this is getting very interesting
so six and two are the ones we haven't seen yet
so everything that we've had working so
far is working right now
is six gonna light up for me so six should be this one theoretically
all right so let's try moving those v discs and
see if that solves it yeah neither of those are coming up okay
okay we have some material to work with here i'm gonna shut her down for now
pia hides your true ip address and allows you to bypass geo restrictions
and censorship by making you appear as though you're connecting from somewhere
else and you can use up to five devices
at once it also helps prevent attacks by blocking unwanted connections it
autoblocks all traffic if the vpn disconnects and it keeps your data out
of the hands of advertisers and other activity tracking snoops so go try it
out at the link in the video description today it's affordable and it works
you bet you might as well eat some for a bit
like don't don't die over this project